cs.CL [Total: 37]
cs.CV [Total: 58]
cs.MM [Total: 2]
cs.SD [Total: 1]
cs.AI [Total: 5]
cs.LG [Total: 9]
cs.GR [Total: 1]
cs.HC [Total: 1]
cs.RO [Total: 2]

cs.CL [Back]

[1] SaliMory: Orchestrating Cognitive Memory for Conversational Agents cs.CL | cs.AIPDF

Kai Zhang, Xinyuan Zhang, Hongda Jiang, Shiun-Zu Kuo, Hyokun Yun

TL;DR: 本文提出了SALIMORY框架，旨在解决对话智能体作为终身伴侣时面临的持久记忆管理问题。该框架通过训练单一语言模型来管理认知结构化的记忆，涵盖用户事实、偏好和工作记忆，并引入分层阶段奖励和奖励分解对比精炼方法，为选择性过滤、巩固和线索驱动回忆等不同记忆操作提供端到端的独立监督。

Details

Motivation: 当前对话智能体在作为终身伴侣时，需要跨所有交互维持持久记忆，但简单地扩展上下文窗口会降低推理质量，而通过标准强化学习训练记忆智能体在多阶段流程中会产生严重的信用分配瓶颈。

Result: SALIMORY将记忆相关故障减少了三分之一，在端到端准确率上超过现有最佳方法10%以上，并将良好个性化率提高了一倍多。

Insight: 创新点在于提出了一个统一的框架来管理认知结构化记忆，并通过分层阶段奖励和奖励分解对比精炼实现了对多阶段记忆操作的端到端监督，从而有效解决了记忆管理的信用分配问题。

Abstract: Conversational agents that serve as lifelong companions must maintain persistent memory across all interactions. However, simply expanding context windows with raw retrieval degrades reasoning quality, while training memory agents via standard reinforcement learning creates a severe credit assignment bottleneck in a multi-stage pipeline. To solve this, we introduce SALIMORY, a framework that trains a single language model to manage a cognitively-structured memory-spanning user facts, preferences, and working memory. By introducing a hierarchical stage-wise process reward and reward-decomposed contrastive refinement, SALIMORY provides isolated supervision for distinct memory operations (selective filtering, consolidation, and cue-driven recall) end-to-end. SALIMORY cuts memory-attributed failures by one-third, outperforms the state-of-the-art by over 10% in end-to-end accuracy, and more than doubles the Good Personalization rate.

[2] MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A cs.CL | cs.AIPDF

Hanoz Bhathena, Parin Rajesh Jhaveri, Rohan Mittal, Prateek Singh, Aymen Kallala

TL;DR: 本文提出MM-BizRAG，一种重新思考的多模态检索增强生成方法，专为通用企业问答设计。该方法通过文档结构感知分割，动态将文档路由至特定处理流程，对垂直结构文档（如报告）进行显式布局感知解析，对水平结构文档（如幻灯片）使用整体页面级表示。一个统一的LLM驱动的工件转换流水线保持了自然阅读顺序，推理时的多模态组装将检索表示与生成上下文解耦，无需微调即可生成更丰富、更基于事实的答案。

Details

Motivation: 当前多模态检索增强生成方法倾向于最小化解析，依赖页面级图像进行检索和生成，但往往忽略了企业文档中丰富的结构化信息，依赖预训练模型隐式捕获结构。本文旨在更直接地处理和利用复杂企业文档的结构信息。

Result: 在一个大型异构企业数据集和两个公共基准（SlideVQA和FinRAGBench-V）上的实验表明，MM-BizRAG始终优于最先进的以视觉为中心的基线方法，最高提升32个百分点，在报告式布局上提升尤其显著。

Insight: 创新点在于提出文档结构感知分割和动态路由机制，针对不同文档结构（垂直/水平）采用不同的显式解析策略，并通过LLM驱动的统一转换流水线保持阅读顺序和位置对齐。此外，还引入了FastRAGEval，一种单次调用的LLM评估指标，用于细粒度生成召回评估，在降低一半成本的同时实现了更强的人类对齐。

Abstract: Recent advances in multimodal retrieval-augmented generation (MM-RAG) have shifted toward minimal parsing, relying on page-level images for producing retriever embeddings and for answer generation. While efficient, this trend often neglects explicit handling of the rich, structured information in complex enterprise documents, instead depending on pre-trained embeddings or vision-language models to implicitly capture such structure. In this work, we take a more direct approach: MM-BizRAG proactively extracts and represents document structure via a document structure-aware split that dynamically routes documents through orientation-specific ingestion pipelines, applying explicit layout-aware parsing for vertically structured documents (e.g., reports) and holistic page-level representations for horizontally structured documents (e.g., slide decks). A unified LLM-driven artifact transformation pipeline with placeholder-based positional alignment preserves natural reading order, while inference-time multimodal assembly decouples retrieval representations from generation context, enabling richer, more grounded answers without any finetuning requirement. Through experiments on a large, heterogeneous enterprise dataset and two public benchmarks (SlideVQA and FinRAGBench-V), MM-BizRAG consistently outperforms state-of-the-art vision-centric baselines by up to 32% points, with especially strong gains on report-style layouts. Furthermore, we introduce FastRAGEval, a single-call LLM Judge metric for fine-grained generative recall that halves RAGChecker’s cost while achieving stronger human alignment.

[3] Supportive Token Revealing for Fast Diffusion Language Model Decoding cs.CL | cs.AI | cs.LGPDF

Giries Abu Ayoub, Mario Barbara, Lluís Pastor-Pérez, Tanja Bien, Aneesh Barthakur

TL;DR: 本文提出了一种名为AXON的训练无关模块，用于提升离散扩散语言模型的并行解码效率。AXON通过监控剩余不确定的掩码标记，在需要额外上下文时介入，将解码标准从‘哪些标记最安全’转向‘哪些置信度高的标记能最好地支持后续去噪’，从而优化了质量与延迟的权衡。

Details

Motivation: 离散扩散语言模型通过并行更新多个掩码位置来高效生成文本，但这引入了质量与延迟的权衡：激进解码可能过早地提交相互依赖的标记，而保守解码则需要许多去噪步骤。现有方法通过置信度或依赖标准来决定哪些标记可以安全揭示，但避免不安全提交并不能保证剩余掩码序列易于解码，因为不确定标记可能依赖于掩码标记，从而成为去噪步骤的瓶颈。

Result: 在多个扩散语言模型上，针对推理和代码生成基准测试的实验表明，AXON改善了现有并行解码器的质量-延迟权衡，通常能在保持或提高准确性的同时减少函数评估次数。

Insight: 论文的核心创新点在于将解码策略从被动避免不安全揭示，转变为主动选择能最佳支持后续去噪的‘锚点’（即不确定位置所关注的置信度高的掩码标记）。AXON作为一个无需训练、可叠加在现有并行解码策略之上的模块，利用注意力、不确定性和置信度信号来动态干预解码过程，这是一种新颖的、以支持后续步骤为导向的解码优化思路。

Abstract: Discrete diffusion language models can generate text efficiently by updating multiple masked positions in parallel, but this parallelism introduces a quality-latency trade-off. Aggressive decoding may commit mutually dependent tokens too early, while conservative decoding requires many denoising steps. Existing methods address this tension by deciding which tokens are safe to reveal using confidence or dependency criteria. However, avoiding unsafe commits does not necessarily make the remaining masked sequence easy to decode, since uncertain tokens may depend on masked tokens, creating a bottleneck for denoising steps. We propose AXON, a training-free module that can be added on top of existing parallel decoding strategies for diffusion language models. Rather than replacing the base decoder, AXON monitors the remaining uncertain masked tokens and intervenes only when their current state suggests that additional context is needed. It then shifts the criterion from which tokens are safest to reveal to which confident reveals would best support later denoising. AXON selects anchors, confident masked tokens that uncertain positions attend to, using attention, uncertainty, and confidence signals. Experiments on reasoning and code-generation benchmarks across multiple diffusion language models show that AXON improves the quality-latency trade-off of existing parallel decoders, often reducing the number of function evaluations while maintaining or improving accuracy.

[4] Can I Take Another Dose? Evaluating LLM Decision-Making Under Temporal Uncertainty in OTC Dosing QA cs.CL | cs.AIPDF

Maroof Kousar, Yibo Hu

TL;DR: 本文介绍了DOSEBENCH基准测试，用于评估大型语言模型（LLMs）在非处方药（OTC）剂量问答中的决策能力，重点关注对乙酰氨基酚和布洛芬的成人使用场景。研究通过81个精心设计的剂量场景，测试了四个LLM在时间推理、约束遵循和不确定性处理方面的表现，发现模型在滚动窗口计算和模糊敏感案例中常出现错误。

Details

Motivation: LLMs越来越多地用于日常健康咨询，如判断用户能否安全服用另一剂非处方药，但现有医学QA评估中缺乏对这一安全关键场景的深入探索，正确回答需要跟踪剂量时间、计算24小时滚动摄入量、遵循产品标签约束并处理不完整的用药历史。

Result: 在DOSEBENCH基准上评估了四个LLM，共生成1,620个响应，结果显示模型在滚动窗口推理和模糊敏感案例中频繁出错，且看似稳定或自信的响应仍可能违反剂量约束。

Insight: 创新点在于提出了一个专注于OTC剂量QA的窄域实用测试平台，用于评估时间推理、约束遵循和安全性相关的不确定性处理；客观分析表明，该研究揭示了LLMs在医疗安全决策中的局限性，为改进模型在现实世界应用中的可靠性提供了具体方向。

Abstract: Large language models (LLMs) are increasingly used for everyday health questions, including whether a user can safely take another dose of an over-the-counter (OTC) medication. Yet this common safety-relevant setting remains underexplored in existing medical QA evaluations, where correct answers require tracking dose timing, computing rolling 24-hour intake, following product-label constraints, and handling incomplete medication histories. We introduce DOSEBENCH, a focused benchmark of 81 curated OTC dosing scenarios focused on adult acetaminophen and ibuprofen use, with manually annotated gold references. We evaluate four LLMs across repeated runs using metrics for decision correctness, consistency, explanation verifiability, failure types, and confidence-related signals, resulting in 1,620 model responses. Our results show that models frequently struggle with rolling-window reasoning and ambiguity-sensitive cases and that stable or confident-looking responses can still violate dosing constraints. These findings suggest that OTC dosing QA provides a narrow yet practical testbed for evaluating temporal reasoning, constraint following, and safety-relevant uncertainty handling in medical QA.

[5] Parameter-Efficient Fine-Tuning with Learnable Rank cs.CLPDF

Arpit Garg, Simon Lucey, Hemanth Saratchandran

TL;DR: 本文提出了一种名为LR-LoRA的参数高效微调方法，该方法在训练过程中学习适配器的秩，而非使用固定的低秩约束。研究发现，Transformer模型中的注意力层和MLP层在秩的选择上存在系统性差异，该方法在多个语言理解和常识推理基准测试中取得了最先进的性能。

Details

Motivation: 作者质疑固定秩约束是否是参数高效微调中最有效的归纳偏置，旨在探索更灵活的秩适应策略。

Result: 在多个语言理解和常识推理基准测试中，LR-LoRA在大多数设置下达到了最先进的性能，并持续优于强大的PEFT基线方法。

Insight: 核心创新点在于将适配器的秩从固定超参数转变为可学习的参数，允许优化器为每个层确定合适的秩，这提供了比固定秩适应更灵活、更有效的归纳偏置。

Abstract: Low-Rank Adaptation (LoRA) is a popular parameter-efficient fine-tuning (PEFT) method that restricts weight updates to low-rank adapters, introducing a fixed low-rank inductive bias by optimizing in a low-dimensional subspace. In this work, we question whether a fixed-rank constraint is the most effective inductive bias for parameter-efficient fine-tuning. We introduce Learnable Rank LoRA (LR-LoRA), a PEFT method in which the adapter rank is learned during the training process. Instead of prescribing a uniform rank for all adapter layers, LR-LoRA allows the optimizer to determine the appropriate rank for each layer. Using this approach, we find substantial layer-wise variation in the learned ranks, with the attention and MLP layers in the transformer models exhibiting systematically different rank preferences. Across a range of language understanding and commonsense reasoning benchmarks, LR-LoRA achieves state-of-the-art performance in most settings and consistently outperforms strong PEFT baselines, demonstrating that a learnable rank provides a more flexible and effective inductive bias than fixed-rank adaptations.

[6] DLLG: Dynamic Logit-Level Gating of LLM Experts cs.CLPDF

Bingnan Li, Zhaoyang Zhang, Xiaoze Liu, Yantao Shen, Shuli Jiang

TL;DR: 论文提出DLLG（动态Logit级门控）框架，通过轻量级门控模块预测token级融合权重，在推理和代码生成任务上超越现有路由、启发式集成和参数合并方法。

Details

Motivation: 现有多专家LLM集成方法在适应性和稳定性之间存在权衡，如路由过早决策、启发式集成依赖脆弱代理、参数合并引入干扰，需要更鲁棒且可扩展的融合范式。

Result: 在多样化推理和代码基准测试中，DLLG在不同模型规模上均优于强基线方法（路由、启发式集成、参数合并），实现了稳定提升。

Insight: 创新点在于从稀疏响应级监督中学习token级专家融合，通过轨迹级正确性关联生成过程，无需token级标签或专家重训练，为专家集成提供了可扩展的logit级融合范式。

Abstract: Leveraging multiple specialized LLMs can combine complementary strengths, but existing approaches trade adaptability for stability: routing commits prematurely, heuristic ensembling depends on fragile proxies, and parameter merging introduces interference. We propose DLLG (Dynamic Logit-Level Gating), a dynamic logit-level ensembling framework that learns token-level expert fusion from sparse response-level supervision. A lightweight gating module predicts step-wise fusion weights, linking trajectory-level correctness to generation without token-level labels or expert retraining. Across diverse reasoning and code benchmarks, DLLG consistently outperforms strong routing, heuristic ensembling, and parameter-merging baselines across model scales, highlighting learned logit-level fusion as a robust and scalable paradigm for integrating specialized experts.

[7] Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs cs.CL | cs.LGPDF

Xinyu Pang, Zhanke Zhou, Xuan Li, Fangrui Lv, Shanshan Wei

TL;DR: 本文提出了一种名为Deliberate Evolution（DE）的智能体框架，用于解决基于LLM的符号回归方法样本效率低下的问题。该框架将符号生成与搜索控制解耦，通过自适应搜索方向算子、结构诊断分析工具和轨迹级反思记忆来指导LLM的候选表达式生成。在LLM-SRBench基准测试中，DE仅使用标准样本预算的40%，就在多个科学领域持续优于代表性的基于LLM的符号回归基线方法。

Details

Motivation: 现有基于LLM的进化方法主要依赖均方误差等标量反馈，导致样本效率低下，其核心局限在于将候选表达式生成与搜索指导混为一谈，要求LLM仅从一个分数中推断如何演化表达式、诊断错误并复用过去经验。

Result: 在LLM-SRBench基准上的实验表明，DE在多样化的科学领域中持续优于代表性的基于LLM的符号回归基线方法，同时仅使用了标准样本预算的40%。

Insight: 论文的创新点在于提出了一个解耦符号生成与搜索控制的智能体框架，通过引入自适应搜索方向算子、结构诊断工具和反思记忆机制，系统性地提升了LLM在符号回归任务中的推理和演化效率，这为将LLM更有效地整合到需要结构化搜索和迭代改进的优化问题中提供了新思路。

Abstract: Symbolic regression (SR) discovers compact mathematical expressions from data, yet recent LLM-based evolutionary methods remain sample-inefficient because they rely mainly on scalar feedback such as MSE. We identify a core limitation: existing methods conflate candidate proposal with search guidance, requiring the LLM to infer how to evolve an expression, diagnose its errors, and reuse past experience from a single score. To address this, we propose Deliberate Evolution (DE), an agentic framework that decouples symbolic generation from search control. DE guides LLM proposals with adaptive operators for search direction, analytical tools for structural diagnosis, and reflective memory for trajectory-level experience. Experiments on LLM-SRBench show that DE consistently outperforms representative LLM-based SR baselines across diverse scientific domains while using only 40% of the standard sample budget.

[8] Read the Trace, Steer the Path: Trajectory-Aware Reinforcement Learning for Diffusion Language Models cs.CLPDF

Anant Khandelwal, Manish Gupta

TL;DR: 本文提出了一种名为CAPR（Cached-Amortized Path Refinement）的扩散大语言模型强化学习算法。该方法通过分析去噪过程中的轨迹信息，将最终稀疏奖励重新分配到各个生成块中，从而实现了类似树搜索的细粒度监督，但避免了昂贵的完全树扩展计算成本。

Details

Motivation: 现有扩散大语言模型的强化学习方法存在局限性：平坦展开方法计算成本低但奖励信号粗糙；树展开方法能提供细粒度、可验证的训练信号但计算密集。本文旨在探索是否能够利用去噪轨迹本身提供类似树的监督，而无需树级别的计算开销。

Result: 在4x4数独、Countdown、GSM8K和Math500等多个基准测试上，使用密集和混合专家LLaDA骨干网络，CAPR在256和512令牌预算下为RL调优的扩散大语言模型设定了新的最先进水平。在数独任务上，它以不到三分之一的计算成本达到了最强树结构基线的性能。

Insight: 核心创新在于将去噪轨迹总结为紧凑的路径状态，利用缓存的轨迹状态生成廉价的兄弟延续，并训练块级价值头进行局部块级监督。该方法通过块级去掩码调度和奖励重分配机制，以接近平坦展开的计算成本（约0.75倍）获得了接近树展开（约0.6倍成本）的细粒度监督能力。

Abstract: Diffusion large language models (dLLMs) generate responses by iteratively unmasking and revising many positions in parallel. This process leaves a rich denoising trace depicting which tokens become confident, which remain unstable, and when commitments form. Existing dLLM reinforcement learning methods use this signal only weakly. Flat rollouts are cheap, but assign a single outcome reward to the whole trajectory. Tree rollouts provide finer, verifiable training signals by branching partial trajectories and propagating leaf rewards upward, but are compute intensive. We ask whether the denoising trace itself can provide tree-like supervision without tree-level compute. We introduce CAPR (Cached-Amortized Path Refinement), a dLLM-RL algorithm that summarizes the denoising trace into a compact path state, uses cached trajectory states to generate cheap sibling continuations, and trains a block-level value head for local block-wise supervision. Under a block-wise unmasking schedule, CAPR records path-state and block-progress features, then redistributes the final outcome reward across blocks according to the tokens revealed in each block. This trains the value head to convert one sparse reward into block-level PPO weights. CAPR therefore recovers much of the granularity of tree search while avoiding full tree expansion, reducing rollout-generation cost to roughly 0.75x that of flat rollouts and 0.6x that of tree rollouts (under standard settings). Across 4x4 Sudoku, Countdown, GSM8K, and Math500, on dense and mixture-of-experts LLaDA backbones, CAPR sets a new state of the art for RL-tuned dLLMs at 256- and 512-token budgets. On Sudoku, it matches the strongest tree-structured baseline at less than one third of the per-step compute.

[9] MemoryDocDataSet: A Benchmark for Joint Conversational Memory and Long Document Reasoning cs.CL | cs.AIPDF

Qiyang Xie, Jialun Wu, Xinjie He, Su Liu, Shuai Xiao

TL;DR: 该论文提出了MemoryDocDataSet基准测试集，用于同时评估AI系统在多轮对话记忆和长文档阅读理解两方面的能力。该数据集包含50个微观世界和1000个QA对，每个实例涉及3-5个角色、跨越数月的时间事件图、3-5份真实长文档、基于文档的多轮对话以及20个涵盖五类推理的问题。其核心特点是75.1%的问题属于混合类型，要求系统先通过对话历史确定相关文档，再从文档中提取答案。

Details

Motivation: 当前缺乏能够同时评估多轮对话历史导航和长文档深度阅读理解能力的基准测试，而实际AI系统越来越需要结合这两种能力。

Result: 在六个基线配置评估中，最佳基线（RAG-Both）的总体F1得分为0.358，在混合问题上的F1为0.342。仅文档检索（RAG-Doc）在混合问题上得分骤降至0.267，尽管在纯文档问题上达到0.453，这揭示了联合检索的明显差距。

Insight: 创新点在于首次构建了同时评估对话记忆和长文档推理的合成基准测试，并设计了“混合源”问题类型来强制系统进行联合推理。从客观角度看，该数据集通过微观世界构建和真实法律文档的结合，为开发统一对话记忆与长文档导航的架构提供了明确的评估需求和动机。

Abstract: AI systems increasingly need to combine two demanding capabilities: navigating multi-session conversation history and performing deep reading comprehension within long documents. Yet no existing benchmark evaluates both simultaneously. We introduce MemoryDocDataSet, a synthetic benchmark of 50 micro-worlds and 1,000 QA pairs in which each instance comprises 3-5 personas, a temporal event graph spanning months of activity, 3-5 real long documents (20,000-50,000 tokens each sourced from the Caselaw Access Project), multi-session conversations grounded on those documents, and 20 question-answer pairs across five reasoning categories. The defining feature is the Hybrid source tag: questions requiring a system to first navigate conversation history to identify which document is relevant, then extract the answer from within that document. Hybrid questions account for 75.1% of the dataset. Dataset quality is characterised through a prompt-sensitivity self-consistency analysis using LLM-as-judge, yielding a median Cohen’s $κ= 0.634$ across all 50 micro-worlds. We evaluate six baseline configurations spanning truncated context, long-context LLMs, retrieval-augmented generation (RAG), and memory systems. The best baseline (RAG-Both) achieves 0.358 overall F1 and 0.342 on Hybrid. Document-only retrieval (RAG-Doc) collapses to 0.267 on Hybrid despite achieving 0.453 on Doc-only questions, demonstrating a clear joint-retrieval gap that motivates architectures unifying conversational memory with long-document navigation. We release the dataset, generation pipeline, and all baseline implementations.

[10] When Clients Stop Following: A Cognitive Conceptualization Diagram-driven Framework for Strategic Counseling cs.CLPDF

Yihao Qin, Junyi Zhao, Changsheng Ma, Yongfeng Tao, Minqiang Yang

TL;DR: 本文针对大型语言模型在心理咨询应用中存在的评估偏差问题，提出了一种基于认知行为疗法（CBT）的、能够感知客户抵抗性的框架。作者首先观察到现有基准测试中高度合作的模拟客户存在‘咨询师跟随’现象，即客户在几轮对话后便从抵抗迅速转为顺从，导致评估结果虚高。为解决此问题，论文引入了CARS客户模拟器（通过认知概念化图CCD显式建模动态抵抗性）和STREAMS双模块框架（将策略推理与响应生成解耦，并通过强化学习优化），并提出了EWTS-MI熵加权指标来评估高摩擦互动下的响应能力。实验验证了评估不匹配问题，并证明了抵抗感知训练在提升挑战性咨询互动中策略鲁棒性的有效性。

Details

Motivation: 现有基于LLM的心理咨询评估基准严重依赖高度合作的模拟客户，导致出现‘咨询师跟随’现象，即客户抵抗性快速消失，造成治疗进展的假象并虚高评估分数。这揭示了当前评估协议与真实、具有挑战性的咨询互动之间存在严重不匹配。

Result: 在抵抗性和非抵抗性心理咨询场景下的实验验证了评估不匹配的发现，并证明了所提出的抵抗感知训练方法能有效提升模型在挑战性咨询互动中的策略鲁棒性。

Insight: 核心创新点在于：1）从认知行为疗法（CBT）理论出发，利用认知概念化图（CCD）显式建模客户的动态心理抵抗，构建了更真实的客户模拟器CARS；2）提出了解耦策略推理（Thinker）与响应生成（Presenter）的双模块框架STREAMS，并通过强化学习进行优化，增强了策略性；3）设计了针对高摩擦互动的评估指标EWTS-MI，为评估心理咨询AI在真实、困难场景下的表现提供了新工具。这为构建更鲁棒、更贴近实际的心理咨询AI系统提供了系统的框架和评估方法。

Abstract: Large Language Models (LLMs) show promise in psychological counseling, yet existing benchmarks rely heavily on highly cooperative simulated clients. We observe a critical counselor-following phenomenon: these clients often rapidly shift from resistance to compliance after only a few turns, creating an illusion of therapeutic progress and inflating scores under current evaluation protocols through superficial empathy. To address this evaluation mismatch, we propose a Cognitive Behavioral Therapy (CBT)-grounded resistance-aware framework. We introduce CARS, a client simulator that explicitly models dynamic resistance via Cognitive Conceptualization Diagrams (CCDs). We present STREAMS, a dual-module framework that decouples strategic reasoning (Thinker) from response generation (Presenter) and optimizes it via reinforcement learning. We further propose EWTS-MI, an entropy-weighted metric for evaluating responsiveness under high-friction interactions. Experiments across resistant and non-resistant counseling settings validate our findings on evaluation mismatch and demonstrate the effectiveness of resistance-aware training for improving strategic robustness under challenging counseling interactions.

[11] Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation cs.CLPDF

Xin Zhang, Yang Cao, Baoxing Wu, Kai Song, Siying Li

TL;DR: 本文提出了一种名为SGR的逐步推理增强框架，旨在解决大语言模型在复杂多步推理中存在的逻辑一致性、事实依据和可解释性问题。该框架通过提取输入问题中的关键实体、关系和约束来构建结构化模式，并以此从知识图谱中检索紧凑的子图，为LLM提供显式关系证据以引导其逐步推理。

Details

Motivation: 大语言模型在自然语言生成和下游推理任务中表现出色，但在复杂多步推理中仍面临逻辑不一致、事实依据不足和可解释性差等挑战。

Result: 在CWQ、WebQSP、GrailQA和KQA Pro等基准数据集上的实验表明，SGR在推理准确性和Hits@1性能上优于标准提示和多个知识增强基线方法，达到了SOTA水平。消融研究进一步证实了模式引导和基于Neo4j的检索对框架有效性的关键作用。

Insight: 创新点在于通过动态生成外部知识子图来增强LLM的推理能力，并结合了基于Cypher的直接推理与协作推理集成，允许根据模型置信度和图一致性对多推理路径的候选答案进行验证和聚合，从而提升了推理的准确性、鲁棒性和可解释性。

Abstract: Large language models have shown strong performance in natural language generation and downstream reasoning tasks, but they still struggle with logical consistency, factual grounding, and interpretability in complex multi-step reasoning. To address these limitations, this paper proposes SGR, a stepwise reasoning enhancement framework that integrates large language models with external knowledge graphs through query-relevant subgraph generation. Given an input question, SGR first extracts key entities, relations, and constraints to construct a structured schema, then retrieves compact subgraphs from a knowledge graph using schema-guided querying. The generated subgraphs provide explicit relational evidence that guides the language model through step-by-step reasoning. In addition, SGR combines direct Cypher-based reasoning with collaborative reasoning integration, allowing candidate answers from multiple reasoning paths to be validated and aggregated according to both model confidence and graph consistency. Experiments on benchmark datasets including CWQ, WebQSP, GrailQA, and KQA Pro demonstrate that SGR improves reasoning accuracy and Hits@1 performance over standard prompting and several knowledge-enhanced baselines. Ablation studies further show that schema guidance and Neo4j-based retrieval are both crucial to the effectiveness of the framework. These results indicate that dynamically generated external subgraphs can improve the accuracy, robustness, and interpretability of LLM-based reasoning.

Farouq Sammour, Yuxin Zhang, Zhenyu Zhang

TL;DR: 本研究开发并验证了建筑安全态度框架（CSAF），用于从建筑工人的社交媒体讨论中大规模测量其多维安全态度。该框架结合了理论结构和操作化编码手册，并利用大语言模型（LLM）分类器实现了自动化分析，在Reddit的r/Construction和r/Roofing社区数据上表现出高精度，并能追踪态度随时间的变化及背后的推理。

Details

Motivation: 建筑工人的安全态度是决定现场是否采取防护措施的关键因素，但大规模测量一直难以实现，因为态度是多维的、因话题而异，且最真实地体现在工人的自然对话中。

Result: 在Reddit的r/Construction社区250条帖子和评论上，人工编码者达成强一致性（Krippendorff’s α = 0.85）。LLM分类器在450条贡献上复现了专家编码（Cohen’s κ = 0.90，精确率=0.98，召回率=0.98），并在转移到r/Roofing社区的400条贡献上保持了高精度（κ = 0.89，精确率=0.98，召回率=0.97）。案例研究将该分类器应用于10,346条r/Roofing贡献，证明了其区分多维态度、追踪时间变化和推理的能力。

Insight: 创新点在于将理论驱动的安全态度框架（CSAF）与LLM分类器结合，实现了对自然语言社交媒体数据的大规模、自动化、多维态度测量，并验证了其跨社区的可迁移性，为基于态度的针对性安全干预提供了工具。

Abstract: Worker safety attitudes are key determinants of whether protective practices are applied or bypassed on construction sites. Yet measuring them at scale has remained out of reach. Safety attitudes are multidimensional, vary across topics, and surface most candidly in workers’ own conversations. This study created and validated the Construction Safety Attitude Framework (CSAF), which integrates two components: a theory-grounded structure that characterizes safety attitudes along eight dimensions, and an operational codebook for measuring them in worker naturalistic discourse. Applying CSAF to 250 posts and comments from the r/Construction community on Reddit, trained coders reached strong agreement (Krippendorff’s α = 0.85). Pairwise lift and conditional probability confirmed that the eight dimensions are related yet distinct. To apply the framework across large volumes of discourse, CSAF was operationalized through a large language model (LLM) classifier. On 450 r/Construction contributions, the classifier reproduced expert human coding (Cohen’s \k{appa} = 0.90, precision = 0.98, recall = 0.98), and on 400 contributions from r/Roofing it retained that accuracy after transfer to a different trade community (\k{appa} = 0.89, precision = 0.98, recall = 0.97). A proof-of-value case study then applied the validated classifier to 10,346 contributions from r/Roofing, demonstrating that CSAF can distinguish multidimensional attitudes by safety topic, track how they shift over time, and trace the reasoning behind unfavorable ones. The study therefore provides a theoretically grounded, empirically vetted instrument for examining safety attitudes, offering a basis for targeted interventions that address the attitudes underlying unsafe practices.

[13] SePO: Self-Evolving Prompt Agent for System Prompt Optimization cs.CL | cs.AIPDF

Wangcheng Tao, Han Wu, Weng-Fai Wong

TL;DR: 本文提出了自进化提示优化（SePO）方法，通过一个自指设计的提示代理，同时优化任务代理的系统提示和其自身的系统提示。该方法采用开放式进化搜索，维护候选提示档案作为垫脚石，并在多任务池上进行预训练，然后在目标任务上进行微调。

Details

Motivation: 现有方法在优化任务代理的系统提示时，其提示代理自身的系统提示仍是手工设计且固定的。SePO旨在将提示代理自身的系统提示也作为优化目标，实现更全面的自动化提示优化。

Result: 在涵盖数学（AIME’25）、抽象推理（ARC-AGI-1）、研究生级科学（GPQA）、代码生成（MBPP）和逻辑谜题（Sudoku）的五个基准测试中，SePO consistently outperforms Manual-CoT, TextGrad, and MetaSPO，相比Manual-CoT平均准确率提高了4.49个百分点。

Insight: 核心创新在于自指设计和开放式进化搜索，使提示代理能自我进化。预训练获得的提示优化技能可泛化到预训练混合任务之外的任务，而非仅记忆特定任务提示，展现了良好的泛化能力。

Abstract: System prompt optimization improves agent behavior without modifying the underlying model, yielding human-readable, model-agnostic instructions. Existing methods build a prompt agent that refines task agents’ system prompts, yet leave the prompt agent’s own system prompt hand-engineered and fixed. We propose Self-Evolving Prompt Optimization (SePO), which treats the prompt agent’s own system prompt as an optimization target alongside task agents’ system prompts. SePO adopts a self-referential design. A single prompt agent improves both task agents’ system prompts and its own under an open-ended evolutionary search that maintains an archive of candidate prompts as stepping stones. Training proceeds in two stages: pre-training evolves the prompt agent on a multi-task pool, and fine-tuning then applies it to a target task. Across five benchmarks spanning math (AIME’25), abstract reasoning (ARC-AGI-1), graduate-level science (GPQA), code generation (MBPP), and logic puzzles (Sudoku), SePO consistently outperforms Manual-CoT, TextGrad, and MetaSPO, improving the average accuracy by 4.49 points compared to Manual-CoT. The prompt optimization skill from pre-training also generalizes to tasks beyond the pre-training mixture, rather than memorizing per-task prompts.

[14] Learning What to Learn: Stage-Specific Data Sets for SFT-then-RL in Small Language Model Reasoning cs.CLPDF

Chongyang He, Rui Zhang, Zixuan Wang, Xin Li

TL;DR: 本文提出了一种针对小型语言模型推理后训练的难度感知SFT-then-RL框架。该框架的核心是根据SFT和RL阶段的不同作用，将训练数据组织成阶段特定的数据集：SFT阶段专注于学习尚未掌握的推理技能，而RL阶段则用于巩固模型已部分掌握的技能。对于SFT阶段的困难样本，作者引入了Bridge机制来转化教师生成的推理轨迹，使其更易于学习；对于RL阶段仍未解决的困难样本，则采用Critique Fine-Tuning，将零奖励的失败案例转化为诊断、修复和新推理轨迹的监督信号，用于下一轮SFT。

Details

Motivation: 现有工作很少考虑在SFT-then-RL流程的每个阶段应该学习什么数据。作者认为，数据策略应与SFT和RL的不同角色保持一致：SFT更适合获取尚未掌握的推理技能，而RL更适合巩固模型已能部分访问的技能。

Result: 在两个小型语言模型和五个推理基准测试上的实验表明，该方法持续优于代表性的SFT、蒸馏和RL基线方法。

Insight: 主要创新点在于提出了一个协调SFT和RL阶段数据难度的原则性框架，并针对困难样本设计了Bridge机制和Critique Fine-Tuning方法。从客观角度看，其核心洞察是将训练数据按难度和模型掌握程度进行阶段化分配，并设计了相应的数据转换机制来提升学习效率，这对优化小型语言模型的推理后训练流程具有借鉴意义。

Abstract: Post-training Small Language Models (SLMs) for reasoning typically follows an SFT-then-RL pipeline, yet existing work rarely considers what data should be learned at each stage. We argue that data strategy should be aligned with the distinct roles of SFT and RL: SFT is better suited for acquiring not-yet-mastered reasoning skills, while RL is better suited for consolidating skills that the model can already partially access. Based on this principle, we propose a difficulty-aware SFT-then-RL framework that organizes training data into stage-specific sets. For hard samples in the SFT stage, we introduce a Bridge mechanism that transforms raw teacher-generated reasoning traces into more learnable supervision for SLMs. For hard samples that remain unsolved during RL, we apply Critique Fine-Tuning by converting all-zero-reward failures into diagnostic, repair, and new reasoning trace supervision for the next SFT stage. Experiments on two SLMs across five reasoning benchmarks show that our method consistently improves over representative SFT, distillation, and RL baselines. Our results highlight the importance of coordinating data difficulty across SFT and RL for effective SLM reasoning post-training.

[15] Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention cs.CL | eess.ASPDF

Ming-Hao Hsu, Xiaohai Tian, Jun Zhang, Zhizheng Wu

TL;DR: 该论文揭示了语音大语言模型在复杂推理任务中表现不如文本模型的原因并非整体认知缺陷，而是特定于需要实体跟踪的逻辑任务中的实体绑定失败问题。研究者提出了一种名为实体感知思维链的干预方法，通过强制模型在推理前显式枚举实体并将其与主张绑定，显著提升了语音模型的逻辑推理性能。

Details

Motivation: 旨在探究语音大语言模型在复杂推理任务上表现逊于文本模型的根本原因，特别是定位其性能下降的具体认知瓶颈。

Result: 在需要实体跟踪的逻辑任务上，语音转文本的准确率降至随机水平；而提出的实体感知思维链方法带来了高达24.4%的绝对准确率提升，成功弥合了性能差距。

Insight: 创新点在于将模态差距定位为可解决的实体绑定失败瓶颈，并提出了一种通过显式语义绑定进行干预的通用方法，该方法即使在语音识别错误的情况下依然有效，为解决语音模型推理问题提供了新视角。

Abstract: Speech Large Language Models (SLLMs) underperform their text counterparts on complex reasoning. We reveal that this modality gap is not a uniform cognitive deficit. Evaluating three diverse SLLMs, we show speech-to-text (S2T) matches or exceeds text-to-text (T2T) on spatial, syntactic, and factual tasks. However, on logical tasks requiring entity tracking, S2T accuracy collapses to chance. We diagnose this localized degradation as an entity binding failure: continuous speech features cause models to lose precise entity-property associations during implicit reasoning. To resolve this, we propose Entity-Aware Chain-of-Thought (EA-CoT), forcing SLLMs to explicitly enumerate entities and bind them to claims before reasoning. Strikingly, EA-CoT bridges the gap, even when spoken names are misrecognized, yielding up to a 24.4% absolute accuracy improvement. Ablations confirm these gains stem entirely from explicit semantic binding, reframing the gap as a resolvable bottleneck.

[16] Self-Evolving Deep Research via Joint Generation and Evaluation cs.CL | cs.AIPDF

Han Zhu, Chengkun Cai, Yuanfeng Song, Xing Chen, Sirui Han

TL;DR: 该论文提出了一种名为SCORE的自进化协同进化训练框架，用于深度研究报告的生成与评估。该框架通过共享参数的联合学习过程，将评估器和生成器紧密耦合，使两者能够协同进化，从而解决传统静态评估器在生成器改进时优化压力不足的问题。

Details

Motivation: 深度研究报告生成任务缺乏明确的地面真值，使得奖励设计难以验证，限制了有效的强化学习。现有方法依赖静态评估器，无法随着生成器性能提升而调整评估标准，导致优化压力不足和性能饱和。

Result: 在深度研究基准测试上的广泛实验表明，该方法在报告生成质量上取得了持续改进，证明了协同进化评估与生成是训练开放式研究智能体的一个有前景的方向。

Insight: 核心创新在于提出了一个共享参数的协同进化框架，将生成与评估视为内在关联的任务进行联合优化，并引入了元控制机制动态调整评估环境，以确保评估维度的有效性和评估搜索的深度。这为开放域生成任务的训练提供了新思路。

Abstract: Large Language Models (LLMs) have become increasingly adopted in daily applications, with deep research standing out as a particularly important capability. Unlike traditional question-answering (QA) tasks, deep research report generation lacks definitive ground-truth, making reward design inherently unverifiable and limiting effective reinforcement learning. Existing approaches mitigate this challenge with LLM-as-a-judge and query-dependent evaluation rubrics, but they still rely on static evaluators that cannot adapt their standards as the solver improves, leading to insufficient and eventually saturated optimization pressure. We address this limitation with a \textbf{s}elf-evolving \textbf{co}-evolutionary training framework for deep \textbf{re}search evaluation and generation (SCORE), which tightly couples an evaluator and a solver in a shared-parameter learning process. Rather than treating generation and evaluation as isolated modules, we leverage their intrinsic connection to enable joint improvement within a single shared-parameter model. To restrict this process, we introduce a meta-harness, which dynamically controls the evaluation environment based on solver performance, encouraging valid evaluation dimensions and sufficiently deep evaluator search. Extensive experiments on deep research benchmarks demonstrate consistent improvement in report generation quality, showing that co-evolving evaluation and generation is a promising direction for training open-ended research agents.

[17] Dynamic Infilling Anchors for Format-Constrained Generation in Diffusion Large Language Models cs.CL | cs.AIPDF

Boyan Han, Yiwei Wang, Yi Song, Yujun Cai, Chi Zhang

TL;DR: 本文提出了一种名为动态填充锚点（DIA）的训练无关方法，用于提升扩散大语言模型（dLLMs）在格式约束生成任务（如可解析JSON或推理模板）中的性能。该方法通过动态估计结束锚点位置来调整生成长度，从而克服了固定锚点方法导致的推理截断或内容冗余问题。

Details

Motivation: 扩散大语言模型虽然具有双向注意力和并行生成能力，能利用全局上下文并天然支持格式约束任务，但使用固定锚点强制约束会导致生成跨度僵化，引发推理截断或内容冗余。

Result: 在推理基准测试（如GSM8K和MATH）上的实验表明，DIA显著提高了格式合规性和答案准确性，实现了显著的零样本性能提升。

Insight: 核心创新点在于提出了一种无需训练、动态估计结束位置的锚点机制，以灵活调整生成长度，确保结构正确性和语义连贯性，为可靠、结构感知的生成提供了一条稳健路径。

Abstract: Diffusion large language models (dLLMs) offer bidirectional attention and parallel generation, enabling them to exploit global context and naturally support format-constrained tasks like parseable JSON or reasoning templates. While straightforward fixed anchors can enforce such constraints, they often impose rigid spans, leading to truncated reasoning or redundant content. To overcome this, we propose Dynamic Infilling Anchors (DIA), a training-free method that dynamically estimates end-anchor positions to adjust generation length before iterative infilling. This flexible mechanism ensures structural correctness and semantic coherence, avoiding the inefficiencies of fixed-span methods. Experiments on reasoning benchmarks demonstrate that DIA substantially improves format compliance and answer accuracy, achieving significant zero-shot gains on GSM8K and MATH. These results establish DIA as a robust pathway toward reliable, structure-aware generation.

[18] LDARNet: DNA Adaptive Representation Network with Learnable Tokenization for Genomic Modeling cs.CL | q-bio.GNPDF

Daria Ledneva, Denis Kuznetsov

TL;DR: 本文提出LDARNet，一个120M参数的层次化基因组基础模型，通过引入可学习的自适应分词机制来替代传统的固定分词方案（如k-mers或单核苷酸），以更好地捕捉生物学相关结构。模型结合了BiMamba-2状态空间层、局部注意力、双向路由和基于比率的正则化器，在无监督条件下学习适应性的token边界。在Nucleotide Transformer和Genomic Benchmarks的27个任务上微调后，LDARNet在紧凑模型（<300M参数）中取得11/18的优胜，并在5个组蛋白修饰任务上达到SOTA，性能超越大20倍的模型。

Details

Motivation: 当前基因组基础模型普遍采用固定分词方案（如k-mers、BPE或单核苷酸），这些方案强加了任意的序列边界，可能掩盖生物学相关的结构信息。

Result: 在27个基因组任务微调中，LDARNet在紧凑模型（<300M参数）中取得11/18的优胜，并在5个组蛋白修饰任务上达到SOTA，性能超越大20倍的模型。FLOPs匹配的对照实验表明，学习到的路由机制是性能提升的关键，在组蛋白任务上比固定边界方案提升高达14个百分点。

Insight: 创新点在于将自回归生成中的动态分块思想（H-Net风格）引入掩码语言建模，通过无监督学习自适应token边界，且学习到的边界与经典启动子基序和剪接位点对齐，为基因组基础模型的自适应分词提供了生物学解释。

Abstract: Genomic foundation models increasingly adopt large language model architectures, yet almost universally rely on fixed tokenization schemes such as $k$-mers, BPE, or single nucleotides, which impose arbitrary sequence boundaries that may obscure biologically relevant structure. We present LDARNet, a 120M-parameter hierarchical genomic foundation model that adapts H-Net-style dynamic chunking from autoregressive generation to masked language modeling, combining BiMamba-2 state-space layers with local attention, bidirectional routing, and a ratio-based regularizer to induce adaptive token boundaries without supervision. Fine-tuned on 27 tasks from the Nucleotide Transformer and Genomic Benchmarks suites, LDARNet achieves 11/18 wins among compact models ($<$300M parameters) and state-of-the-art results on 5 histone modification tasks, outperforming models up to 20$\times$ larger. A FLOPs-matched controlled experiment isolates learned routing as the source of these gains: learned boundaries beat fixed-grid boundaries by up to 14 percentage points on histone tasks at identical compute. Nucleotide-resolution analysis further shows that the learned boundaries align with canonical promoter motifs and splice junctions without supervision, providing a biological interpretation for adaptive tokenization in genomic foundation models.

[19] VCIFBench: Evaluating Complex Instruction Following for Video Understanding cs.CLPDF

Huangchen Xu, Yuan Wu, Yi Chang

TL;DR: 本文提出了VCIFBench，一个用于评估视频理解中复杂指令遵循能力的基准测试。该基准通过构建包含内容、格式、风格和结构等丰富约束的指令，并采用混合验证流程来评估多模态大语言模型的性能。实验表明，现有模型在联合约束满足方面仍面临挑战，但使用VCIFBench的DPO偏好数据进行训练可以提升指令遵循能力。

Details

Motivation: 当前多模态大语言模型在视频理解方面进展迅速，但现有基准测试大多依赖简单提示，且缺乏对模型能否满足显式输出约束的有效评估。

Result: 在10个MLLMs上的实验表明，模型在满足联合约束方面仍存在困难。同时，使用VCIFBench提供的540对DPO偏好数据进行训练，可以提升模型的指令遵循性能。

Insight: 创新点在于构建了一个专注于复杂指令遵循的、约束丰富的视频理解基准（VCIFBench），并提供了包含可满足测试指令、DPO偏好数据集和冲突诊断子集的完整评估资源。从客观角度看，其混合验证流程和对约束类型的系统分类（内容、格式、风格、结构）为评估模型的实际指令理解与执行能力提供了更精细的框架。

Abstract: Multimodal large language models have made rapid progress in video understanding, yet existing benchmarks largely rely on simple prompts and provide limited evidence about whether models can satisfy explicit output constraints. We introduce VCIFBench, a benchmark for evaluating complex instruction following in video understanding. VCIFBench constructs constraint-rich instructions from both benchmark-adapted and directly video-grounded prompts, covering content, format, style, and structure requirements, and evaluates model outputs with a hybrid verification pipeline. The benchmark contains 306 satisfiable test instructions, a 540-pair DPO preference dataset, and a 30-item conflict diagnostic subset. Experiments on 10 MLLMs show that joint constraint satisfaction remains challenging. We further show that DPO training on VCIFBench data can improve instruction-following performance.

Hanbo Bi, Zhiqiang Yuan, Chongyang Li, Qiwei Yan, Zexi Jia

TL;DR: 本文提出了细粒度片段检索（FFR）任务，旨在从多模态长对话中检索语义相关的多轮次、多图像片段。针对单对话和对话语料库两种场景，分别提出了基于强化学习的生成式检索模型F2RVLM和两阶段系统FFRS，并构建了大规模数据集MLDR进行验证。

Details

Motivation: 随着多模态通信平台的普及，包含文本和图像的长对话日益增多，用户需要检索与特定主题相关的连贯对话片段，而非孤立语句，现有方法难以满足这一需求。

Result: 在构建的MLDR数据集和基于微信的真实测试集上，F2RVLM和FFRS在单对话和语料库级别的FFR任务中均取得了优越性能。

Insight: 创新点包括：1) 定义了细粒度多模态对话片段检索新任务；2) 提出了结合强化学习多目标奖励和难度感知课程采样的生成式检索模型；3) 设计了离线片段索引与在线检索结合的两阶段系统，实现了高效的大规模检索。

Abstract: With the widespread adoption of multi-modal communication platforms, long-form dialogues interleaving text and images have become increasingly common. Users often need to retrieve coherent dialogue fragments related to specific topics, rather than isolated utterances. We propose Fine-grained Fragment Retrieval (FFR), which locates semantically relevant multi-utterance, multi-image fragments in multi-modal long-form dialogues. We explore two settings: (1) FFR within Single-Dialogue, retrieving fragments from a given dialogue; and (2) FFR within Dialogue Corpus, retrieving from a large-scale corpus for open-domain scenarios. For (1), we introduce F2RVLM, a generation-based retrieval model trained with reinforcement learning, using multi-objective rewards and difficulty-aware curriculum sampling to enhance fragment coherence. For (2), we develop FFRS, a two-stage system combining offline fragment-level indexing with online retrieval. Specifically, each dialogue is decomposed into minimal semantic fragments encoded by a Fragment Embedding Model (FEM) into a vector database; at inference, FEM rapidly recalls Top-K candidates, and F2RVLM performs fine-grained reasoning to identify the most relevant sub-content. To support FFR, we construct MLDR, the longest multi-modal dialogue retrieval dataset to date, and a WeChat-based real-world test set. Experiments on both benchmarks demonstrate that F2RVLM and FFRS consistently achieve superior performance across single-dialogue and corpus-level FFR.

[21] A Systematic Evaluation of Positional Bias in Multi-Video Summarization with MLLMs cs.CLPDF

Huangchen Xu, Yuan Wu, Yi Chang

TL;DR: 本文系统评估了多模态大语言模型（MLLMs）在多视频摘要任务中的位置偏见问题，即视频摘要质量会因输入顺序不同而变化。研究基于ActivityNet和新闻视频构建了涵盖烹饪、家务、休闲和新闻领域的基准数据集，评估了九种开源和专有MLLM，并提出了三种互补的度量指标来量化位置效应。结果表明位置偏见具有领域和模型依赖性，且增加视觉或生成预算并不能完全消除不平衡，研究还分析了提示级缓解方法，强调了构建更鲁棒的顺序不变多模态系统的必要性。

Details

Motivation: 多模态大语言模型在多视频理解任务中的可靠性尚不明确，特别是输入视频的顺序可能影响摘要质量，即使视频内容本身未变。本文旨在系统研究多视频摘要中的位置偏见问题。

Result: 在构建的ActivityNet和新闻视频基准上，评估了九种MLLM，使用覆盖率、定向位置偏见和中间-边缘差距三个指标。结果显示位置效应因领域和模型而异：即使中间位置表现不佳，有向偏见也可能很小；增加视觉或生成资源不能均匀消除不平衡。

Insight: 创新点在于首次系统量化多视频摘要中的位置偏见，并提出了三种互补的评估指标。客观来看，研究揭示了MLLM在多视频输入中对顺序的敏感性，为设计更鲁棒的顺序不变多模态系统提供了实证依据和缓解方向。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly used for video understanding, yet their reliability under multi-video inputs remains poorly understood. We study positional bias in multi-video summarization, where the quality of a per-video summary can change with the video’s input slot even when the underlying content is unchanged. We construct a benchmark from ActivityNet and News videos, covering Cooking, Domestic, Leisure, and News settings with two- and four-video inputs. We evaluate nine open-source and proprietary MLLMs and measure position effects with three complementary metrics: Coverage, Directional Positional Bias (DPB), and Middle-Edge Gap (MEG). Our results show that positional effects are domain- and model-dependent: signed directional bias can be small even when middle positions underperform, and increasing visual or generation budget does not uniformly remove the imbalance. We further analyze prompt-level mitigation methods. Together, the results show that multi-video summarization remains sensitive to input protocol and position, motivating more robust order-invariant multimodal systems.

Shanu Kumar, Shubhanshu Khandelwal, Akhila Yesantarao Venkata, Parag Agrawal, Yova Kementchedjhieva

TL;DR: 本文提出了CRAFT（Cost-aware Refinement And Front-aware Tuning）方法，用于优化提示词以在准确性和推理成本之间取得最佳权衡。该方法将提示优化视为在准确性和提示令牌成本的帕累托前沿上进行搜索，而非寻找单一最优提示。CRAFT通过结合准确性导向和成本导向的生成器、帕累托间隙采集策略以及NSGA-II保留机制，有效探索帕累托前沿。

Details

Motivation: 针对准确率优化的提示词往往变得冗长，增加了每次模型调用的推理成本。最佳准确率-成本权衡取决于任务和预算，但现有方法（如加权求和）在搜索前固定权衡权重，容易导致标量化崩溃，只能恢复前沿的狭窄区域。

Result: 在六个分类和推理基准测试中，CRAFT保留的帕累托前沿能够同时达到高准确率和低成本区域，而仅关注准确性、仅关注成本或加权求和的基线方法则各自集中在更窄的区域。

Insight: 创新点在于将准确率-成本权衡转变为搜索后的选择，而非搜索前的权重设定，并采用帕累托前沿优化框架，结合多目标生成和采集策略来有效分配验证资源。这为提示工程提供了更灵活和高效的优化范式。

Abstract: Prompts tuned for accuracy often grow long, raising inference cost on every model call. The best accuracy-cost trade-off depends on the task and the budget, so prompt optimization is a search over the Pareto front of accuracy and prompt-token cost rather than for one prompt. The usual shortcut, collapsing the objectives into a weighted sum, fixes the trade-off weight before search and often recovers only a narrow region of the front, a failure we call scalarization collapse. We present CRAFT (Cost-aware Refinement And Front-aware Tuning), a Pareto-front prompt optimizer that treats target-LLM validation calls as the scarce resource and allocates them to candidates near the optimistic candidate front. Each round, complementary accuracy-oriented and cost-oriented generators propose edits, Pareto-gap acquisition spends the per-round validation budget, and NSGA-II retention keeps a spread-out population. Across six classification and reasoning benchmarks, CRAFT’s retained fronts reach both high-accuracy and low-cost regions, while accuracy-only, cost-only, and weighted-sum baselines each concentrate in narrower regions. The accuracy-cost trade-off becomes a post-search choice, not a pre-search weight.

[23] SMADE-IE: Sparse Multi-Agent Framework with Evidence-Driven Debate for Zero-Shot Information Extraction cs.CLPDF

Kenfeng Huang, Yi Cai, Xin Wu, Zikun Deng, Li Yuan

TL;DR: 本文提出SMADE-IE，一种用于零样本信息抽取的稀疏、证据驱动的多智能体框架。该框架通过自适应模式选择器动态选择全局抽取或类型中心抽取模式，减少冗余交互；并引入证据驱动辩论机制，通过图尔敏式论证结构和贝叶斯更新解决冲突预测。在9个基准数据集上的实验表明，该方法在NER、RE和JERE任务上均优于现有零样本基线，同时通过稀疏智能体选择和提前停止辩论提高了token效率。

Details

Motivation: 现有零样本信息抽取方法（如整体提示、按类型提示或多智能体辩论）存在边界/类型错误、跨类型冲突、冗余交互和token开销大等问题，需要一种更高效、准确的框架来解决这些挑战。

Result: 在9个基准数据集（涵盖NER、RE、JERE任务）上的实验结果显示，SMADE-IE consistently outperforms existing zero-shot IE baselines，达到了SOTA水平，同时通过稀疏选择和提前停止辩论提升了token效率。

Insight: 创新点包括自适应模式选择器（动态路由输入以减少噪声）和证据驱动辩论机制（结构化论证与贝叶斯置信度聚合），从客观角度看，其稀疏多智能体设计和外部证据整合在平衡性能与效率方面具有借鉴价值。

Abstract: Zero-shot information extraction (IE) with large language models (LLMs) has attracted increasing attention due to its flexibility in adapting to new schemas and domains without task-specific training. Existing approaches mainly rely on monolithic prompting, each-type prompting, or multi-agent debate. However, monolithic prompting often suffers from boundary and type errors, while each-type prompting and multi-agent debate introduce cross-type conflicts, redundant agent interactions, and substantial token overhead. To address these challenges, we propose SMADE-IE, a sparse and evidence-driven multi-agent framework for zero-shot IE. SMADE-IE first employs an Adaptive Mode Selector to dynamically route inputs into either a lightweight Global Extraction Mode or a Type-Centric Extraction Mode, reducing unnecessary type selection and reasoning noise. For conflicting predictions, we further introduce an Evidence-Driven Debate mechanism that structures arguments into Toulmin-style components and performs confidence aggregation through external evidence scoring and Bayesian updates. Experimental results on 9 benchmark datasets across NER, RE, and JERE tasks show that SMADE-IE consistently outperforms existing zero-shot IE baselines while also improving token efficiency through sparse agent selection and early-stopping debate.

[24] DuDi: Dual-Signal Distillation with Cross-Lingual Verbalizer cs.CLPDF

Patomporn Payoungkhamdee, Tinnakit Udsa, Jian Gang Ngui, Sarana Nutanong, Alham Fikri Aji

TL;DR: 本文提出DuDi框架，一种结合序列级和词元级信号的双信号多语言蒸馏方法，并引入跨语言verbalizer来提升教师模型反馈质量，旨在解决小语言模型在东南亚语言上的多语言能力退化问题。

Details

Motivation: 小语言模型在多语言场景下，尤其是东南亚语言上，性能严重下降，需要一种有效的蒸馏方法来提升其多语言能力。

Result: 在SEA-HELM基准测试中，DuDi在不同模型家族、规模和师生设置下均优于现有蒸馏基线，证明了其有效性。

Insight: 创新点在于融合序列级和词元级监督信号，并利用跨语言verbalizer增强教师反馈的可迁移性，为多语言小模型训练提供了互补且可转移的学习信号。

Abstract: Small language models (SLMs) are efficient and scalable, but their multilingual capabilities degrade severely at sub-billion scales, especially for Southeast Asian (SEA) languages. We introduce DuDi, a dual-signal multilingual distillation framework that combines an online sequence-level signal with off-policy and on-policy token-level signals. DuDi further uses a cross-lingual verbalizer to refine teacher feedback and improve teacher-student transferability in multilingual settings. Experiments on SEA-HELM across multiple model families, scales, and teacher-student settings show that DuDi consistently outperforms competitive distillation baselines. Ablations and analyses confirm that sequence-level optimization, token-level supervision, and cross-lingual verbalization provide complementary and transferable learning signals for multilingual SLMs.

SooHwan Eom, Jay Shim, Gwanhyeong Koo, Haebin Na, Mark A. Hasegawa-Johnson

TL;DR: 本文提出了一种基于查询的跨模态投影器，旨在增强Mamba多模态大语言模型（MM-LLM）的效率。该投影器通过跨注意力机制压缩视觉标记，并消除了将原始图像特征转换为Mamba LLM输入序列时手动设计2D扫描顺序的需求。实验表明，该方法提升了Mamba多模态LLM在各种视觉语言理解基准上的性能和吞吐量。

Details

Motivation: Transformer模型在处理长输入时存在二次复杂度问题，计算负担重，而Mamba（选择性扫描状态空间模型）能有效应对此挑战。本文旨在设计一种跨模态投影器，以提升Mamba在视觉语言建模中的效率。

Result: 在多个视觉语言理解基准测试中，所提出的跨模态投影器增强了基于Mamba的多模态LLM，同时提升了性能和吞吐量。

Insight: 创新点在于提出了一种基于查询的跨模态投影器，它通过跨注意力机制动态压缩视觉标记，并自动处理图像特征的序列化，无需手动设计2D扫描顺序，从而简化了架构并提高了效率。

Abstract: The Transformer’s quadratic complexity with input length imposes an unsustainable computational load on large language models (LLMs). In contrast, the Selective Scan Structured State-Space Model, or Mamba, addresses this computational challenge effectively. This paper explores a query-based cross-modal projector designed to bolster Mamba’s efficiency for vision-language modeling by compressing visual tokens based on input through the cross-attention mechanism. This innovative projector also removes the need for manually designing the 2D scan order of original image features when converting them into an input sequence for Mamba LLM. Experimental results across various vision-language understanding benchmarks show that the proposed cross-modal projector enhances Mamba-based multimodal LLMs, boosting both performance and throughput.

[26] Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents cs.CLPDF

Haoyu Sun, Wenxuan Wang, Mingyang Song, Jujie He, Weinan Zhang

TL;DR: 本文提出了Agent Planning Benchmark（APB），这是一个专门用于诊断LLM智能体规划能力的基准测试。它包含4,209个多模态案例，涵盖22个领域和五种设置，旨在评估智能体在整体规划、反馈条件下的逐步规划、以及面对冗余工具、损坏工具和不可解任务时的鲁棒性。

Details

Motivation: 现有智能体评估通常只报告端到端的成功率，难以区分失败是源于规划还是执行阶段，因此需要专门的诊断框架来系统评估LLM智能体的核心规划能力。

Result: 在12个MLLM上的测试揭示了其在长视野规划、工具噪声鲁棒性、校准拒绝和推理时精炼方面的系统性弱点。在ToolSandbox和τ²-bench任务上的进一步验证表明，APB引导的精炼能持续提升三个代表性模型的规划正确性、规划等级和下游执行指标。

Insight: 创新点在于构建了一个全面的、诊断性的规划基准，将规划能力分解为多个可测量的维度，并证明了其作为上游诊断工具对执行基准的补充价值，有助于针对性改进智能体规划模块。

Abstract: Planning is central to LLM agents: before acting, an agent must decompose goals, select tools, reason over constraints, and decide when a task is infeasible. Yet existing agent evaluations often report only end-to-end success, making it difficult to determine whether failures stem from planning or execution. We introduce \textbf{Agent Planning Benchmark (APB)}, a planning-specific diagnostic benchmark with 4,209 multimodal cases across 22 domains and five settings, covering holistic planning, feedback-conditioned step-wise planning, and robustness under extraneous tools, broken tools, and unsolvable tasks. Across 12 MLLMs, APB reveals systematic weaknesses in long-horizon planning, tool-noise robustness, calibrated refusal, and inference-time refinement. We further validate APB on 200 ToolSandbox tasks and 200 $τ^2$-bench tasks, where APB-guided refinement consistently improves plan correctness, plan grade, and downstream execution metrics across three representative models. APB thus serves as an upstream diagnostic complement to execution benchmarks.

[27] GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards cs.CLPDF

Tej Deep Pala, Vernon Toh, Soujanya Poria

TL;DR: 本文提出了GRAIL（梯度重加权优势）方法，用于改进具有可验证奖励的强化学习（如GRPO）。该方法通过梯度-激活显著性对token级优势进行重加权，将更多权重分配给对最终答案局部更敏感的token，从而避免均匀优势分配导致的梯度信号稀释问题。

Details

Motivation: 当前方法（如GRPO）通常将序列级优势广播给所有token，或使用成本高昂的过程奖励模型进行步骤级监督。均匀优势分配假设所有token对最终奖励贡献相等，这稀释了梯度信号，因为错误的推理步骤和填充词与有效的逻辑推断被同等强度地更新。

Result: 在Qwen3、R1-distilled和OctoThinker家族的五个模型上的评估表明，GRAIL始终优于GRPO，平均准确率提高了3.60%，Pass@3提高了3.05%。

Insight: 创新点在于提出了一种无需过程级监督的细粒度推理对齐方法，利用梯度-激活显著性实现token级优势重加权，从而更有效地利用可验证奖励进行强化学习。

Abstract: Reinforcement learning with verifiable rewards (e.g. GRPO) is now a common way to improve mathematical reasoning in Large Language Models (LLMs). However, current methods usually broadcast one sequence-level advantage to all tokens, or use costly process reward models (PRMs) for step-level supervision. Uniform advantage distribution assumes that all tokens contribute equally to the final reward. This dilutes the gradient signal, since flawed reasoning steps and filler words are updated as strongly as valid logical inferences. To address this, we introduce Gradient-Reweighted Advantage (GRAIL), an intrinsic token-wise advantage reweighting method. GRAIL uses gradient-activation saliency to place more weight on tokens that are more locally sensitive to the final answer. Evaluations across five models from the Qwen3, R1-distilled and OctoThinker families show that GRAIL consistently outperforms GRPO. GRAIL achieved an average improvement of 3.60% in accuracy and 3.05% in Pass@3, demonstrating that fine-grained reasoning alignment can be achieved without process-level supervision.

[28] Caliper: Probing Lexical Anchors versus Causal Structure in LLMs cs.CL | cs.IRPDF

Zhenyu Yu, Shuigeng Zhou

TL;DR: 论文提出了Caliper方法，通过将因果推理问题中的语义变量名替换为占位符来探测大语言模型（LLMs）的推理能力。研究发现，在多个因果推理基准测试（如CLadder、CRASS、e-CARE）上，词汇匿名化导致模型准确率显著下降，表明当前指令调优的LLMs在零样本设置下主要依赖词汇锚点而非结构因果推理。

Details

Motivation: 旨在探究大语言模型在因果推理基准测试中达到较高准确率的原因，是源于真正的结构推理能力，还是仅仅依赖于词汇模式匹配。

Result: 在九个指令调优的LLM（3.8B到671B参数）和三个因果推理基准上，词汇匿名化导致准确率显著下降（例如在CRASS和e-CARE上分别下降29.6和18.0个百分点）。在40个模型-基准组合中，39个显示出正准确率差距。

Insight: 核心创新点在于Caliper这一受控扰动方法，它隔离了词汇线索的影响，为评估LLMs的真实结构推理能力提供了更干净的测试环境。客观分析表明，当前主流LLMs的因果推理能力可能被高估，其性能严重依赖于问题中的具体词汇（词汇锚点）。

Abstract: Large language models reach 50 to 70% accuracy on causal reasoning benchmarks such as CLadder, but it is unclear whether this reflects structural reasoning or lexical pattern matching. We introduce Caliper, a controlled perturbation that replaces semantic variable names with placeholder tokens while preserving the causal graph and probabilistic specification of each question. Across nine instruction-tuned LLMs from 3.8B to 671B and three causal reasoning benchmarks, lexical anonymization yields robust accuracy drops of +7.6, +27.0, and +11.1 pp on a local 3.8B-14B set, rising to +29.6 and +18.0 pp on CRASS and e-CARE across nine frontier models spanning the 2024-2026 generations. Of 40 engaged model-by-benchmark cells, 39 show a positive gap, and the gap collapses by 17x on CLadder’s pseudoword subset. Structured scaffolding and few-shot in-context learning each narrow the gap, but mainly by lowering P0 accuracy on smaller models rather than recovering P1. Current instruction-tuned LLMs, evaluated zero-shot, show little evidence of structural causal reasoning once lexical anchors are removed.

[29] SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs cs.CLPDF

Xinrui Song, Zhuoran Wang, Mingju Gao, Hao Tang

TL;DR: 本文提出了SemBlock，一种基于语义边界的动态分块解码框架，用于扩散语言模型（DLMs）。该方法通过训练轻量级预测器来预测语义边界，从而动态确定解码块的大小，解决了现有固定分块或基于分隔符的方法与语义不对齐的问题。在GSM8K、IFEval、MATH和HumanEval等基准测试中，SemBlock相比固定分块解码和AdaBlock方法均取得了持续改进。

Details

Motivation: 现有扩散语言模型的分块解码方法通常依赖固定块大小或基于分隔符的运行时信号，这些方法可能无法与语义边界对齐，影响了生成文本的连贯性和效率。

Result: 在GSM8K、IFEval、MATH和HumanEval等基准测试上，SemBlock相比固定分块解码和AdaBlock方法均表现出持续的性能提升，达到了更优的结果。

Insight: 创新点在于将动态分块构建形式化为语义边界预测问题，并利用冻结的LLaDA隐藏状态训练轻量级预测器；同时构建了SemBound语义边界数据集，从自然语言、数学和代码任务中提取边界标签作为监督信号，实现了更符合语义结构的解码过程。

Abstract: Diffusion language models (DLMs) generate text through iterative denoising, and blockwise decoding improves their practicality by committing tokens in local blocks. However, existing blockwise methods typically rely on fixed block sizes or delimiter-based runtime signals, which do not necessarily align with semantic boundaries. In this paper, we propose SemBlock, a semantic-boundary-driven dynamic block decoding framework for diffusion LLMs. SemBlock formulates dynamic block construction as semantic boundary prediction and trains lightweight predictors on frozen LLaDA hidden states. To provide supervision, we construct SemBound, a semantic-boundary dataset that derives boundary labels from discourse units, reasoning steps, and implementation spans across natural language, math, and code tasks. During inference, SemBlock uses predicted boundary probabilities to select the ending position of each dynamic block. Experiments on GSM8K, IFEval, MATH, and HumanEval show that SemBlock consistently improves over fixed-block decoding and AdaBlock. Our code is publicly available: https://github.com/TH-AI-Lab-PKU/SemBlock.

[30] DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving cs.CL | cs.AI | cs.HCPDF

Xiaochen Zhu, Georgi Karadzhov, Tom Stafford, Andreas Vlachos

TL;DR: 本文介绍了DeliChess数据集，这是一个用于研究多人在线对话中协作推理和决策的数据集，聚焦于国际象棋谜题解决场景。数据集包含107个对话，记录了参与者个人解答、集体讨论及修订答案的过程，并基于棋局引擎评估了讨论对群体准确性的提升效果。

Details

Motivation: 现有数据集缺乏针对结构化、深度复杂推理任务的多方对话研究，因此作者构建DeliChess数据集，以探索在明确策略领域（如国际象棋）中群体审议、协作推理及不同观点整合的机制。

Result: 实验表明，审议显著提高了群体解答国际象棋谜题的准确性；通过基于先前审议数据训练的分类器分析，发现探究性话语（probing utterances）会使讨论后群体表现更不稳定，但并未持续带来更好性能。

Insight: 创新点在于构建了首个专注于结构化复杂推理任务的多方对话数据集，并引入棋局引擎评估指标；客观来看，该数据集为建模群体推理、对话动态及策略领域观点分歧解决提供了标准化测试平台。

Abstract: Multi-party dialogue is a critical setting for studying collaborative reasoning and decision-making, yet existing datasets rarely focus on structured, in-depth complex reasoning tasks. We introduce DeliChess, a novel dataset of group deliberation dialogues in which participants collaboratively solve multiple-choice chess puzzles. Each group first completes the puzzle individually, then engages in a multi-party discussion before submitting a revised collective answer. The dataset includes 107 dialogues with full transcripts, pre- and post-discussion choices, and metadata on puzzle difficulty and move quality. We evaluate performance using three metrics based on chess engine evaluations, and find that deliberation significantly improves group accuracy. We further analyse the role of probing utterances (i.e., messages that elicit proposals, justifications, or strategic reflection) using a classifier trained on prior deliberation data. While probing makes group performance more variable after discussion, it does not consistently lead to better performance. Our dataset offers a rich testbed for modelling group reasoning, dialogue dynamics, and the resolution of differing perspectives and opinions in a well-defined strategic domain.

[31] GARL: Game-Theoretic Reinforcement Learning for Multi-Agent Strategic Prioritisation cs.CLPDF

Yuxiao Ye, Yiwen Zhang, Huiyuan Xie, Yuqin Huang, Zhiyuan Liu

TL;DR: 本文提出了一种名为GARL的博弈论强化学习框架，用于解决多智能体战略优先级排序问题。该框架将战略排序建模为一个两阶段博弈过程，并将博弈论效用转化为角色特定的强化学习信号，从而指导策略优化。

Details

Motivation: 当前基于LLM的多智能体系统在战略决策任务中，其性能不仅取决于个体模型能力，还依赖于智能体间的交互策略。现有的多智能体强化学习方法在奖励设计上往往任务特定且与交互结构关联较弱，GARL旨在填补这一空白。

Result: 在争议问题排序任务上的实验表明，GARL提升了排序性能，使得小型开源LLM在与强大闭源LLM相同的候选排序设置下变得具有竞争力，并在法律领域能力和更广泛的战略决策方面取得了收益。

Insight: 核心创新点在于将战略优先级排序形式化为一个结构化的两阶段博弈，并将博弈论效用系统地转化为强化学习目标，为多智能体策略优化提供了一个原则性的方法，将交互结构直接融入学习目标。

Abstract: LLM-based multi-agent systems are increasingly used for strategic decision-making tasks. In such settings, performance depends not only on individual model capabilities, but also on the policies by which agents interact and adapt. Multi-agent reinforcement learning can optimise these interaction policies, but its reward design often remains task-specific and weakly grounded in interaction structure. To address this gap, we propose GARL, a GAme-theoretic Reinforcement Learning framework for multi-agent strategic prioritisation. GARL formalises strategic prioritisation as a two-stage game: competing agents first allocate strategic resources over a shared candidate set, and a higher-level arbiter then produces the final ranking. The resulting game-theoretic utilities are converted into role-specific reinforcement signals, allowing policy optimisation to be guided by structured interaction. We instantiate GARL on issues-in-dispute ranking, where the goal is to prioritise core issues in legal proceedings. Experiments show that GARL improves ranking performance, enables small open-source LLMs to become competitive with a strong closed-source LLM under the same candidate-ranking setting, and yields gains in legal-domain competence and broader strategic decision-making. Overall, GARL demonstrates how game-theoretic interaction structure can be turned into reinforcement-learning objectives, providing a principled approach to policy optimisation in multi-agent strategic prioritisation.

[32] DAR: Deontic Reasoning with Agentic Harnesses cs.CL | cs.AIPDF

Guangyao Dou, William Jurayj, Nils Holzenberger, Benjamin Van Durme

TL;DR: 本文提出了Deontic Agentic Reasoning (DAR)方法，这是一种基于代理的推理框架，使大语言模型能够按需与法规条文进行交互，以解决道义推理任务中规则集冗长且相互引用导致模型难以定位所需规则的技术挑战。

Details

Motivation: 解决大语言模型在道义推理任务中，面对冗长且相互引用的规则集时，难以准确定位特定推理步骤所需规则的关键技术难题。

Result: 在DeonticBench的困难子集上进行评估，结果表明代理框架能够推动道义推理任务性能的边界，但改进并不均匀：较弱的模型在数值任务上性能下降且消耗的token数量显著增加。

Insight: 创新点在于引入了按需与法规条文交互的代理式推理框架（DAR），从客观角度看，该方法将静态的规则检索与动态的模型推理过程相结合，为解决复杂、结构化知识的应用问题提供了一种可借鉴的范式，但其对不同能力模型的非均匀影响也揭示了计算效率与性能提升之间的权衡问题。

Abstract: Deontic reasoning is the task of answering questions by applying explicit rules and policies to case-specific facts, for example computing tax liability under a statute or determining the outcome of an immigration appeal. A key technical challenge for LLM-based deontic reasoning is that the relevant ruleset can be long and cross-referenced, so models may still fail to locate the rules needed for a particular reasoning step. We introduce Deontic Agentic Reasoning (DAR), an agentic reasoning setup in which the model interacts with the statutes on demand. We evaluate DAR under multiple harnesses on hard subsets of DeonticBench. Across these settings, we find that agentic harnesses can push the frontier on deontic reasoning tasks, but improvements are not uniform: weaker models often degrade on numerical tasks while consuming far more tokens.

[33] Imbuing Large Language Models with Bidirectional Logic for Robust Chain Repair cs.CL | cs.SCPDF

Zehua Cheng, Wei Dai, Jiahao Sun, Thomas Lukasiewicz

TL;DR: 本文提出了一种名为Teleological Reasoning Infilling (TRI)的训练框架，旨在解决大型语言模型(LLMs)在自回归思维链推理中因单向性导致的错误累积问题。该框架通过重构推理过程为“中间填充”任务，并引入Prefix-Suffix-Middle序列重排技术，使模型能够基于已验证的前缀和下游目标，生成严谨的逻辑桥梁来修复错误推理链。

Details

Motivation: 动机在于自回归思维链推理本质上是前向的，早期步骤的单一逻辑或算术错误会不可逆地破坏整个推理链，导致错误雪球效应。

Result: 在三个基准测试上的综合实验表明，TRI在所有任务上均达到了最先进的性能，同时将每个问题的token消耗减少了31.2%。

Insight: 主要创新点在于将错误推理段重构为基于已验证前提和下游目标的“中间填充”任务，并提出了无需修改自注意力结构的Prefix-Suffix-Middle序列重排方法，以及结合监督微调和基于确定性符号验证器的直接偏好优化的两阶段训练策略。

Abstract: Autoregressive chain-of-thought (CoT) reasoning in large language models (LLMs) is fundamentally forward-directed: each step conditions only on prior tokens. This unidirectional inductive bias renders even capable models susceptible to error snowballing, wherein a single logical or arithmetic mistake in an early step irreversibly corrupts the entire reasoning chain. We introduce Teleological Reasoning Infilling (\TRI{}), a training framework that endows decoder-only transformers with a native \emph{goal-conditioned bridging} capability. The key insight is to reframe erroneous reasoning segments as fill-in-the-middle (FIM) tasks: given a verified prefix premise $P$, a verified downstream milestone $S$, and the original query $Q$, the model must synthesise the logical bridge $M$ that connects $P$ to $S$ rigorously and completely. To achieve this with standard causal architectures, we introduce a Prefix-Suffix-Middle (PSM) sequence rearrangement with three non-overlapping sentinel tokens, enabling $M$ to attend to both $P$ and $S$ without any structural modification to the self-attention mechanism. Training proceeds in two stages: (i) Supervised Fine-Tuning (SFT) on symbolically verified $(P, S, M)$ triples extracted from formal mathematics corpora, and (ii) Direct Preference Optimisation (DPO) with a deterministic symbolic verifier (Lean 4 / Python) as the sole reward oracle, eliminating LLM-judge sycophancy. At inference, TRI operates as a surgical repair module within a dual-system loop: a causal draft model generates an initial trace, the verifier pinpoints failures, and TRI infills only the damaged segment, leaving verified sections intact. Comprehensive experiments on three benchmarks demonstrate that TRI achieves state-of-the-art performance across all tasks, while reducing per-problem token expenditure by 31.2%.

[34] Boosting Self-Consistency with Ranking cs.CLPDF

Maria Marina, Daniil Moskovskiy, Sergey Pletenev, Mikhail Salnikov, Alexander Panchenko

TL;DR: 该论文提出了RISC（Ranking-Improved Self-Consistency）方法，通过将自洽性中的答案选择重新定义为排序问题，使用轻量级LambdaRank模型结合五个精心设计的特征来对候选答案进行评分，从而改进大语言模型的自洽性。

Details

Motivation: 解决自洽性方法中多数投票的局限性，即无法有效恢复样本中已存在的正确答案，旨在通过更智能的排序机制提升答案选择的准确性。

Result: 在三个数据集和一系列测试时间预算下进行评估，RISC在准确性与效率的权衡上始终优于标准的自洽性方法和强基线，特别是在问答基准测试上取得了显著提升。

Insight: 创新点在于将答案选择视为排序问题，并设计了一套互补的特征（包括答案频率、语义中心性和推理轨迹一致性），通过机器学习模型整合多个信息信号，而非依赖单一不确定性指标。

Abstract: Self-consistency improves large language models by sampling multiple reasoning paths and selecting the most frequent answer, but majority voting often fails to recover correct answers that are already present among the samples. We address this limitation with Ranking-Improved Self-Consistency (RISC), which reformulates answer selection in self-consistency as a ranking problem. Instead of relying on a single uncertainty or confidence signal, RISC uses a lightweight LambdaRank model to score candidate answers with five carefully designed features that capture answer frequency, semantic centrality, and reasoning-trace consistency. We evaluate RISC on three datasets under a range of test-time budgets. Across datasets, RISC consistently achieves a better accuracy-efficiency trade-off than standard self-consistency and strong baselines, with particularly large gains on question answering benchmarks. Further analysis shows that the proposed features are individually useful and, more importantly, complementary, highlighting the value of learning to combine multiple informative signals for test-time answer selection.

[35] Arithmetic Pedagogy for Language Models cs.CL | cs.AI | cs.CYPDF

Andhika Bernard Lumbantobing, Hokky Situngkir

TL;DR: 该论文探索了将人类数学教学方法（特别是印尼的GASING方法）应用于语言模型算术推理训练。通过将算术运算转化为与因果生成顺序对齐的逐步计算过程，并序列化为自然语言思维链监督数据，仅使用下一个词预测目标训练了一个小型GPT-2模型。研究发现模型学习呈现三个阶段：先内化程序路径，后发展出无需显式逐步计算的联想式心算能力。

Details

Motivation: 研究动机是探索人类数学教学方法（如印尼GASING教学法中的从左到右计算程序）能否指导语言模型获得算术推理能力，旨在通过教育学原理提升模型训练效率。

Result: 训练后模型在保留问题上达到超过80%的准确率，与参数量大得多的语言模型相比具有竞争力，表明基于教学法的针对性训练能在小规模下产生强大且经济的算术能力。

Insight: 创新点在于将教育学方法（GASING）转化为可操作的思维链监督机制，并揭示了模型从程序化执行到联想式心算的渐进学习过程；方法论上仅用next-token预测目标（无需强化学习）实现高效算术推理训练具有借鉴意义。

Abstract: We investigate whether methods of human mathematics pedagogy can guide the training of language models toward arithmetic reasoning. Building on the GASING method – an Indonesian pedagogy that solves basic arithmetic through a left-to-right procedure aligned with the causal order of token generation – we operationalize each operation as a computational procedure whose execution trace is serialized into natural-language Chain-of-Thought (CoT) supervision. A small GPT-2 decoder (86M parameters) with a syllabic-agglutinative TOBA tokenizer for Indonesian is trained from scratch on this data using only a next-token prediction objective, without reinforcement learning or reward-based optimization. Monitoring training reveals three distinct learning phases, and mechanistic analyses – attention-masking interventions on the CoT information graph, residual-stream probing, and logit-lens inspection – show that the model first internalizes a procedural pathway and subsequently develops an associative, ``mental-arithmetic’’ capacity that retrieves intermediate results without explicit step-by-step computation. The trained model reaches over 80% accuracy on held-out problems and attains competitive performance against substantially larger language models, indicating that targeted, pedagogically grounded training can yield strong and economical arithmetic capability at small scale.

[36] Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data cs.CLPDF

XiuYu Zhang, Yi Shan, Junfeng Fang, Zhenkai Liang

TL;DR: 本文发现基础大语言模型（LLM）已具备预测外部评估者对其回答进行多属性质量评分的能力，并提出了一种名为自我评估激发（SEE）的方法，该方法通过校准耦合的强化学习和掩码蒸馏两个阶段，仅需少量数据即可显著提升模型的校准能力，同时保持回答质量。

Details

Motivation: 随着大语言模型越来越多地由其他模型进行评估，研究动机是探索模型能否预测评估者对其输出的评分，从而将评估对齐问题重新定义为能力激发而非能力获取。

Result: 在三个基准测试中，SEE方法仅使用160个示例（约为强化学习基线所需数据的1/31），就在保持回答质量的同时，显著提升了模型在未见数据上的校准能力，且其激发的自我评估能力在不同评估者间具有稳定性和可迁移性。

Insight: 创新点在于揭示了基础LLM中已存在预测外部评分的潜在能力，并提出了SEE这一高效激发方法；其核心洞察是将评估对齐视为一个能力激发问题，通过校准和蒸馏的轻量级流程，实现了对模型内在质量概念的提取和泛化。

Abstract: Large language models are increasingly evaluated by other models, raising a natural question: can a model predict how a judge will score its own output? We find that the ability is largely present before any targeted training: prompted few-shot, a base model already predicts an external judge’s multi-attribute quality scores on open-ended responses well above chance across three benchmarks. We introduce Self-Evaluation Elicitation (SEE), a method that surfaces this latent ability through a short cycle comprising a calibration-coupled reinforcement learning phase that improves the answer and predicts the judge, followed by a masked distillation phase that sharpens the prediction while leaving the answer untouched. From 160 unique examples, roughly 31x fewer than a reinforcement learning baseline, SEE improves held-out calibration across three benchmarks while preserving answer quality. The elicited self-evaluation is sharply localized within the model’s own token distribution and stable across judges it was never trained against, indicating a transferable notion of quality rather than a single judge’s preference. These results reframe judge-aligned self-evaluation as a problem of elicitation rather than acquisition.

[37] Streaming Communication in Multi-Agent Reasoning cs.CL | cs.AI | cs.MAPDF

Zhen Yang, Xiaogang Xu, Wen Wang, Cong Chen, Xander Xu

TL;DR: 本文提出了StreamMA，一种多智能体推理系统，通过流式传输每个推理步骤来减少延迟并提高效果。该系统在八个推理基准测试中优于基线方法，并发现了‘步骤级缩放定律’这一新的缩放维度。

Details

Motivation: 解决传统多智能体推理系统‘生成后传输’范式导致的端到端延迟随管道深度线性增长的问题，旨在通过流式通信降低延迟并利用早期更可靠的推理步骤来提升效果。

Result: 在涵盖数学、科学和代码的八个推理基准测试中，使用Claude Opus 4.6和GPT-5.4等前沿LLM，StreamMA在多种拓扑结构下均优于基线方法，平均提升7.3个百分点，在HMMT 2026上最大提升22.4个百分点。

Insight: 创新点在于引入流式通信机制，实现相邻智能体的流水线化以降低延迟，并利用早期推理步骤的更高可靠性来防止错误传播；此外，发现了与智能体数量缩放正交且可组合的‘步骤级缩放定律’，即增加每个智能体的步骤数能同时提升效果和效率。

Abstract: Multi-agent reasoning systems adopt a “generate-then-transfer” paradigm that forces end-to-end latency to scale linearly with pipeline depth. We introduce StreamMA, a multi-agent reasoning system that streams each reasoning step to downstream agents as soon as it is generated, pipelining adjacent agents and thus reducing latency. Surprisingly, this pipelining also improves effectiveness: because multi-step reasoning quality is non-uniform and early steps are more reliable than later ones, working with these reliable early steps instead of the full chain prevents error-prone late steps from misleading downstream agents. We formalize both advantages with the first closed-form joint analysis of stream, serial, and single protocols, deriving the effectiveness ordering, speedup upper bound, and cost ratio. Across eight reasoning benchmarks spanning mathematics, science, and code, two frontier LLMs (Claude Opus 4.6 and GPT-5.4), and three topologies (Chain, Tree, Graph), StreamMA outperforms both baselines (avg. +7.3 pp, max +22.4 pp on HMMT 2026; Claude Opus 4.6-high). Beyond these contributions, we discover a “step-level scaling law”: increasing per-agent steps consistently improves both effectiveness and efficiency, a new scaling dimension orthogonal to and composable with agent-count scaling.

cs.CV [Back]

[38] Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation cs.CV | cs.AI | cs.CL | cs.LG | cs.ROPDF

Boyuan Xiao, Bohong Chen, Yumeng Li, Ji Feng, Yao-Xiang Ding

TL;DR: 本文提出了一种名为SceneDiver的方法，旨在解决具身视觉语言决策任务（如机器人操作和导航）中视觉语言模型（VLM）和视觉语言动作模型（VLA）面临的共同感知瓶颈问题，即因无法区分任务相关对象与干扰物而产生的视觉幻觉。该方法利用VLM的长时规划能力，通过生成从粗到精的聚焦计划，首先构建整体场景图以建立初步理解，然后通过识别、理解和分析的迭代循环逐步分解任务。此外，还设计了一个轻量级适配器，将这种深思熟虑的聚焦能力蒸馏到VLA中，以实现快速反应控制。

Details

Motivation: 动机在于解决VLM和VLA在具身决策任务中存在的共同感知瓶颈，即模型因无法有效区分任务关键对象与干扰物而产生的视觉幻觉问题，这限制了它们的性能。

Result: 在标准具身AI基准测试上的评估表明，该方法显著减少了VLM和VLA的视觉幻觉，同时在需要快速执行的任务中保持了计算效率。

Insight: 核心创新点在于提出了一种从粗到精的聚焦计划生成方法，将长时规划与场景理解相结合，并设计适配器将这种能力蒸馏到反应式模型中，从而在保持效率的同时提升感知准确性。

Abstract: In embodied vision-language decision making tasks such as robotic manipulation and navigation, Vision-Language and Vision-Language-Action Models (VLMs & VLAs) are powerful tools with different benefits: VLMs are better at long-term planning, while VLAs are better at reactive control. However, their performance is limited by the same perceptual bottleneck: visual hallucinations arise due to the models’ inability to distinguish task-relevant objects from distractors. In principle, accurate identification and focus on critical objects while filtering out irrelevant ones is the key to break this limitation. A straightforward solution is one-step focus: directly attending to essential objects. However, this approach proves ineffective because effective focus inherently requires deep scene understanding. To this end, we propose SceneDiver, a coarse-to-fine focus plan generation method for VLMs leveraging their long-term planning abilities, that first constructs a holistic scene graph to establish initial comprehension, then progressively decomposes the task into simpler sub-problems through an iterative cycle of recognition, understanding, and analysis. To enable reactive control, we also design a lightweight adapter for distilling the deliberate focus ability into VLAs. Evaluations on standard embodied AI benchmarks confirm that our method substantially reduces visual hallucinations for both VLMs and VLAs, while preserving computational efficiency in tasks requiring fast execution. Our code and data are released at: https://future-item.github.io/SceneDiver.

[39] Weakly Supervised Incremental Segmentation via Semantic Anchors and Spatial Arbitration cs.CVPDF

Zhonggai Wang, Kai Fang, Guangyu Gao

TL;DR: 本文提出了一种名为SASA的弱监督增量语义分割方法，旨在解决弱监督增量学习中由噪声监督引起的特征漂移和语义损坏问题。该方法通过引入可学习的语义锚点作为刚性类别级参考来稳定长期语义表示，并结合弹性残差适应进行实例级细化。同时，提出空间标签仲裁机制，通过几何感知决策过滤不可靠信号并强制执行‘一个对象，一个类别’约束，从而协同稳定表示并提升监督可靠性。

Details

Motivation: 弱监督增量语义分割（WILSS）面临连续引入噪声监督的问题，这会逐渐破坏类别级表示，导致严重的特征漂移和语义损坏，从而使新学习的类别覆盖旧类别。本文旨在解决这些挑战，稳定语义学习过程。

Result: 在标准基准测试上的大量实验表明，SASA方法持续优于现有的最先进方法，特别是在具有挑战性的多步增量设置中，达到了SOTA水平。

Insight: 创新点在于结合了刚性语义锚点与弹性残差适应的表示稳定策略，以及基于几何感知的空间标签仲裁机制来直接过滤噪声监督。从客观角度看，这种‘刚性参考+弹性适应’的双层表示学习框架，与直接在监督层面进行空间仲裁的协同设计，为弱监督增量学习提供了新的稳定化思路。

Abstract: Weakly Incremental Learning for Semantic Segmentation (WILSS) suffers from the continuous introduction of noisy supervision, which progressively corrupts class-level representations, leading to severe feature drift and semantic corruption, thereby causing newly learned classes to overwrite old ones. To address these issues, we propose a drift-resilient WILSS approach, named SASA, designed to stabilize semantic learning via Semantic Anchors and Spatial Arbitration. Specifically, at the representation level, we introduce semantic anchors of learnable tokens as rigid class-level references to preserve long-term semantic identity. Complementary to this, an elastic residual adaptation facilitates controlled, instance-specific refinement, ensuring a stable yet flexible learning trajectory. At the supervision level, we develop a Spatial Label Arbitration mechanism that performs geometry-aware decisions to directly filter unreliable signals and enforce a strict “one object, one class” constraint. By synergistically stabilizing representations and improving supervision reliability, SASA effectively mitigates feature drift under weak supervision. Extensive experiments on standard benchmarks demonstrate that our approach consistently outperforms existing state-of-the-art methods, particularly in challenging multi-step incremental settings. The code is available at https://github.com/ZhonggaiWang/SASA.

Yang Liu, Wentao Feng, Shu-Dong Huang, Yalan Ye, Jiancheng Lv

TL;DR: 本文提出了一种名为IN2R的新框架，用于解决跨模态检索中由网络爬取数据引起的噪声对应问题。该方法摒弃了传统的离散选择范式，转而通过图结构进行模态内邻居关系推理，合成一个连续的软原型作为监督目标，以纠正模态间的错位。

Details

Motivation: 大规模网络爬取数据集不可避免地包含噪声对应，严重损害模型泛化能力。现有方法主要基于‘离散选择’范式，存在单点脆弱性和离散化误差的局限。

Result: 在Flickr30K、MS-COCO和CC152K数据集上的大量实验表明，IN2R显著优于最先进的（SOTA）方法。

Insight: 核心创新在于将范式从寻找替代标签转变为合成可靠的监督目标，利用模态内数据的几何稳定性，通过图精炼器对动态跨模态记忆库中检索的邻居进行关系推理，生成反映局部语义邻域共识的连续软原型。

Abstract: Large-scale web-harvested datasets have fueled the progress of cross-modal retrieval but inevitably suffer from noisy correspondence, which severely degrades model generalization. Existing methods primarily address this by filtering out noise or seeking a substitute label, yet they predominantly remain bound by a “Discrete Selection” paradigm. We argue that relying on a single discrete proxy induces Single-Point Fragility and Discretization Error. To overcome these limitations, we propose a novel framework, Intra-modal Neighbor-aware Noise Rectification (IN2R), which shifts the paradigm from searching for a substitute to synthesizing a reliable supervision target. Leveraging the intrinsic geometric stability of intra-modal data, IN2R employs a Graph Refiner to perform relational reasoning over neighbors retrieved from a dynamic Cross-Model Memory. Instead of propagating discrete labels, our method synthesizes a continuous, soft prototype that reflects the consensus of the local semantic neighborhood, effectively rectifying inter-modal misalignment. Extensive experiments on Flickr30K, MS-COCO, and CC152K demonstrate that IN2R significantly outperforms state-of-the-art methods. Our code and pre-trained models are publicly available at https://github.com/liuyyy111/IN2R.

[41] When Seeing Is Not Believing – A Benchmark for Search-Grounded Video Misinformation Detection cs.CVPDF

Tao Yu, Yujia Yang, Shenghua Chai, Zhang Jinshuai, Haopeng Jin

TL;DR: 本文介绍了EVID-Bench基准测试，用于评估基于搜索的视频虚假信息检测能力。该基准包含222个视频，涵盖AI生成、单源编辑和多源编辑三大类共9种篡改类型，要求系统通过开放网络搜索相关视频进行跨视频比对来识别虚假信息。

Details

Motivation: 当前视频虚假信息已发展到语义和证据层面，仅凭输入视频本身无法可靠验证选择性编辑、时间重排、跨源拼接或AI生成内容等依赖外部证据的篡改，因此需要建立能利用外部搜索进行验证的基准。

Result: 在EVID-Bench上评估的九个前沿多模态模型中，最佳系统仅达到61.43%的点级准确率和43.24%的视频级准确率，AI生成的篡改尤其具有挑战性，表明现有模型性能有限。

Insight: 创新点在于构建了首个专注于搜索增强的视频虚假信息检测基准，强调跨视频证据比对；客观分析发现模型存在锚定无关信息、错误归因合成内容及搜索提前终止等系统性挑战，为改进检索增强验证方法提供了方向。

Abstract: Video misinformation increasingly operates at the semantic and evidential level: authentic footage may be selectively edited, temporally reordered, spliced across sources, or augmented with AI-generated content to construct false narratives. Such evidence-dependent manipulations cannot be reliably verified from the input video alone, because the missing, reordered, replaced, or recontextualized evidence lies outside the video itself. We introduce \textbf{EVID-Bench}, a benchmark for search-grounded video misinformation detection, where a system must search the open web for related videos and identify what information is false through cross-video comparison. EVID-Bench comprises 222 videos spanning 9 manipulation types across 3 categories: AI generation, single-source editing, and multi-source editing. All samples are verified to be undetectable by frontier models through visual inspection alone. We evaluate nine frontier multimodal models using a retrieval-augmented verification baseline. The best system achieves only 61.43% point-level accuracy and 43.24% video-level accuracy, while AI-generated manipulations remain especially challenging. Error analysis reveals recurring challenges: models fixate on irrelevant anchors, misattribute synthetic content to editorial splicing, and terminate search prematurely before fully explaining the manipulation.

[42] Pinpoint: Grounded Worldwide Image Geolocation via Cross-Source Retrieval and Reranking cs.CVPDF

Nika Chuzhoy, Brian Hu, Amit A. Arora, Jae Ro, Sarthak S. Sahu

TL;DR: Pinpoint提出了一种结合互联网照片和街景图像的检索-重排序架构，用于全球图像地理定位。该方法通过对比学习训练图像-GPS嵌入器，构建共享嵌入空间进行候选位置检索，再利用注意力机制的重排序器结合视觉、GPS特征及跨源证据进行精确定位。

Details

Motivation: 解决全球尺度图像地理定位中视觉证据模糊、多样且分布不均的挑战，通过整合互联网照片（匹配用户查询外观分布）和街景图像（提供密集地理覆盖）的互补优势，提升定位性能。

Result: 在互联网照片基准（IM2GPS3k和YFCC4k）和街景图像基准（OSV-5M）上，Pinpoint在所有指标上均达到最先进水平（SOTA）。

Insight: 创新点包括：1）将互联网照片和街景图像统一处理，利用跨源检索和重排序实现粗到细的定位；2）避免依赖多模态大语言模型，提高推理速度和可复现性；3）注意力重排序器整合候选特征和邻近跨源证据，增强预测的可靠性。

Abstract: Image geolocation aims to estimate where a photograph was taken from its visual content. At worldwide scale, this remains challenging because visual evidence is often ambiguous, diverse, and unevenly distributed. Prior work has typically treated geolocation of ordinary internet photos and street-view imagery as separate tasks, despite their complementary strengths: internet photos better match the appearance distribution of user-captured queries, while street-view imagery provides denser, geographically grounded coverage. We present Pinpoint, a retrieve-and-rerank architecture that combines both sources in a coarse-to-fine pipeline. A contrastive image-GPS embedder is trained on both user-uploaded Flickr photos and street-view imagery, learning a shared image-GPS embedding space that is used to retrieve candidate locations. An attention-based reranker then rescores retrieved candidates by combining candidate-level visual and GPS features with cross-source evidence from nearby locations to ground the prediction. Unlike recent prior work, Pinpoint does not rely on multimodal large-language models, making inference faster and more reproducible. Pinpoint achieves state-of-the-art results across all metrics on standard benchmarks for internet photos (IM2GPS3k and YFCC4k) and street-view imagery (OSV-5M).

Weidong Tang, Jierui Li, Yueling Hou, Zihan Mei, Can Zhang

TL;DR: 本文提出了GroupToM-Bench，这是首个用于评估多模态大语言模型在群体层面心理理论推理能力的基准测试。该基准围绕一个从微观个体心智状态到宏观群体结果的因果链构建，并通过一个七级认知审计框架进行全面评估。实验表明，当前模型在理解社会结构和非线性集体动态方面存在显著缺陷，与人类基线存在差距。

Details

Motivation: 真正的通用智能不仅需要物理世界模型，还需要社会世界模型，即推断个体心智状态如何相互作用并形成群体层面结果的能力。尽管在个体层面的心理理论推理方面取得了进展，但现有多模态大语言模型无法完成这一更广泛的任务。

Result: 实验揭示了当前模型与人类基线之间的差距，突显了模型在处理社会结构和非线性集体动态方面的失败。

Insight: 创新点在于提出了首个针对群体层面心理理论的多模态基准，并构建了一个跨越微观、中观和宏观层面的因果链评估框架。客观来看，该工作将心理理论评估从个体层面扩展到复杂的群体社会动态，强调了集体行为的非线性涌现特性，为模型的社会智能评估提供了新的重要维度。

Abstract: True general intelligence requires not only a model of the physical world but also a social world model: the capacity to infer how individual mental states interact and crystallize into group-level outcomes. Despite notable progress in individual-level Theory of Mind (ToM) reasoning, existing multimodal large language models fail at this broader task. Collective behavior emerges non-linearly from social tensions, conformity dynamics, and structural constraints, meaning it cannot be recovered by merely summing individual intentions. We present GroupToM-Bench, the first multimodal benchmark for group-level ToM, built around a causal chain spanning micro-level BDI states (belief, desire, intention), meso-level group tension and structural constraints, and macro-level outcome prediction and mechanistic attribution. To probe this full arc, we develop a seven-level cognitive audit framework. Experiments reveal a gap between current models and human baselines, highlighting a failure to process social structures and non-linear collective dynamics.

[44] Spatial Artifact Coherence Determines Codec Robustness in Patch-Based rPPG cs.CVPDF

Achraf Ben Ahmed

TL;DR: 该论文提出了空间伪影相干性（Spatial Artifact Coherence, SAC）这一物理量，用于解释在视频编解码压缩下，基于空间分解的rPPG方法（如PatchPCA）何时优于全局投影方法。作者还提出了PatchPCA算法家族，并通过大量实验验证了SAC的有效性，最终确定了P-Hybrid为最鲁棒的部署算法，并给出了PatchPCA优势的两个必要条件。

Details

Motivation: 远程光电容积描记术（rPPG）在未压缩视频上心率误差很低，但实际部署（如远程医疗）中需通过压缩视频通道传输。目前尚无研究能确定在何种情况下，基于空间分解的方法在编解码压缩下能优于全局投影方法。

Result: 在三个公共数据集、11种编解码退化变体和13种算法的广泛评估中，SAC解释了PCA优势在变体间93.8%的方差（r = +0.969）。非MPEG-4编解码变体（SAC 0.10-0.18）下PCA胜率为84-90%，而MPEG-4变体（SAC 0.48-0.59）下PCA胜率降至61%，平均改进减少5.8倍。P-Hybrid被确定为最鲁棒的部署算法。

Insight: 核心创新点是提出了SAC这一物理量，它基于4x4块间绿色通道协方差矩阵的非对角与对角能量之比，为编解码压缩下的rPPG算法选择提供了物理依据。研究还确立了PatchPCA算法优势的两个必要操作条件（SAC < 0.30和中低运动水平），并揭示了MPEG-4的影响是结构性的（宏块DCT几何结构），而非噪声幅度，这直接排除了原始视频到MPEG-4的转码管道。

Abstract: Remote photoplethysmography (rPPG) achieves low heart-rate error on uncompressed benchmarks yet is deployed over compressed video channels in telehealth, neonatal ICU, and driver fatigue applications. No prior work identifies the physical quantity determining when spatial decomposition outperforms global-projection methods under codec compression. We propose Spatial Artifact Coherence (SAC), defined as the ratio of off-diagonal to diagonal energy in the 4x4 inter-patch Green-channel covariance matrix (bandpass 0.75-2.5 Hz), and the PatchPCA algorithm family (four codec-aware rPPG algorithms). We evaluate 280 subjects across three public datasets, 11 codec degradation variants (MPEG-4, H.265, H.264, JPEG, chroma subsampling), and 13 algorithms via Wilcoxon tests (BH-FDR, q < 0.05, 904 tests). SAC explains 93.8% of between-variant variance in PCA advantage (r = +0.969), with zero overlap between codec families: non-MPEG-4 variants cluster at SAC 0.10-0.18 with 84-90% PCA win rates, while MPEG-4 variants cluster at SAC 0.48-0.59 with 61% win rate and a 5.8x reduction in mean improvement. Within subjects, 78% confirm the expected pattern (p < 10^-22, dz = 0.73). Within-variant subject-level SAC correlation is r = +0.099, confirming SAC classifies codec families rather than predicting individual outcomes. MPEG-4’s effect is structural (macroblock DCT geometry, not noise amplitude), governed by source codec state, not resolution. P-Hybrid is identified as the most deployment-robust algorithm. Two necessary operating conditions for PatchPCA advantage are established: SAC < 0.30 and low-to-moderate motion, directly ruling out raw-to-MPEG-4 transcoding pipelines. SAC provides a physically grounded metric for codec-aware rPPG algorithm selection in clinical remote monitoring systems.

[45] UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation cs.CVPDF

Zeyuan Yang, Hao-Wei Chen, Xueyang Yu, Yuncong Yang, Haoyu Zhen

TL;DR: 本文提出UniCanvas，一种基于扩散模型的统一模型，用于文本-图像联合生成。该模型将语言表示为图像内部的视觉模式，从而在单个像素画布上自然“绘制”文本，实现无缝的多模态生成。

Details

Motivation: 现有自回归视觉语言模型难以生成高质量图像，而扩散模型虽能生成逼真视觉内容却难以生成连贯文本，因此需要开发一个能同时处理视觉和文本生成的统一模型。

Result: 实验表明，UniCanvas在文本-图像生成任务上超越了之前的统一模型，将基于扩散模型的文本-图像生成定位为有前景的统一多模态生成范式。

Insight: 创新点在于将语言嵌入视觉表示中，使模型能够直接从图像中推理文本语义，并利用扩散模型在共享像素画布上捕获变换的特性，实现文本与图像在单一画布上的自然融合生成。

Abstract: Recent years have seen remarkable progress in unified vision-language models handling both multimodal understanding and generation within a single architecture. While autoregressive VLMs can reason across modalities, they fail to generate high-quality images. In contrast, diffusion models produce photorealistic visuals yet struggle to generate coherent text, making it challenging to develop a single unified model that can seamlessly handle both visual and text generation. Recent advances suggest that language can be effectively embedded within visual representations, allowing models to reason about textual semantics directly from images. To this end, we propose UniCanvas, a first attempt that unifies diffusion models to generate interleaved multimodal contents through text-in-image generation. Diffusion models naturally capture transformations on a shared pixel canvas, which can be viewed as world models of visual change. Instead of producing discrete text tokens, the model learns to represent language as visual patterns inside images, leveraging its inherent multimodal embedding space. This design allows the model to “draw” text naturally within a single pixel canvas during image synthesis, achieving seamless multimodal generation. Experiments demonstrate that UniCanvas improves performance over previous unified models, positioning text-in-image generation with diffusion models as a promising unified multimodal generation paradigm.

[46] Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1) cs.CV | cs.AI | cs.CLPDF

Jingbiao Mei

TL;DR: 本文介绍了EReL@MIR 2025多模态文档检索挑战赛（赛道1）的概况，该挑战赛旨在构建一个统一的检索系统来处理两种互补的任务：基于文本查询的长文档内闭集页面检索（MMDocIR）和基于图像或图文查询的开放域维基百科式段落检索（M2KR）。报告详细阐述了挑战赛的设计、数据集、评估协议、最终排名，并对三支获胜团队的解决方案进行了分析。

Details

Motivation: 当前大多数检索器在处理视觉丰富的文档（即文本与图表、表格混合的页面）时仍会丢弃视觉通道，而这对多模态检索增强生成至关重要。该挑战赛旨在推动能够有效利用视觉信息的统一多模态检索系统的开发。

Result: 挑战赛吸引了22支团队的455名参赛者，提交了586份方案。系统排名基于两项任务上Recall@{1,3,5}的宏平均。获胜团队的系统均基于Qwen2-VL系列的解码器式多模态大语言模型嵌入器，而非CLIP风格的编码器。

Insight: 创新点在于要求单一系统处理两种互补的检索范式（闭集与开放域），并整合视觉信息。客观分析表明，获胜方案的关键趋势是采用基于解码器的多模态大模型嵌入器，并通过微调集成、免训练的多路径融合与强视觉语言重排序器，或零样本后期交互等不同策略达到顶尖性能，其中免训练系统与微调获胜者的差距仅在0.1分以内，显示了高效免训练方法的潜力。

Abstract: Retrieval over visually-rich documents, pages that interleave text with figures, tables, and charts, is essential for multimodal retrieval-augmented generation, yet most retrievers still discard the visual channel. The \emph{Multimodal Document Retrieval Challenge}, Track~1 of the MIR Challenge at the first EReL@MIR workshop, co-located with The Web Conference 2025, asks participants to build a \emph{single} retrieval system that handles two complementary regimes: closed-set document page retrieval within long documents from a text query (MMDocIR), and open-domain retrieval of Wikipedia-style passages from an image or image-plus-text query (M2KR). Systems are ranked by the macro-average of mean Recall@${1,3,5}$ over the two tasks. The challenge drew 455 entrants and 586 submissions across 22 teams. This report describes the challenge design, datasets, and evaluation protocol; reports the final standings; and analyses the three winning teams’ systems. All three build on decoder-based Multimodal-LLM embedders from the Qwen2-VL family rather than on CLIP-style encoders, and differ chiefly in whether they reach the top through fine-tuned ensembles, training-free multi-route fusion with a strong vision-language re-ranker, or zero-shot late interaction. The training-free system finished within $0.1$ point of the fine-tuned winner.

[47] StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets cs.CV | cs.AIPDF

Stepan Konev

TL;DR: 论文提出了StandardE2E框架，旨在解决端到端自动驾驶研究中不同数据集格式不统一带来的重复预处理和实验困难。该框架为多个主流自动驾驶数据集提供了一个统一的数据接口和预处理标准，支持跨数据集联合训练和场景过滤，并开源了相应的Python工具包。

Details

Motivation: 当前端到端自动驾驶研究依赖于多个传感器丰富的驾驶数据集，但每个数据集都有各自不同的文件格式、API、坐标系和模态覆盖，导致跨数据集实验和基础预处理工作在每个项目中都需要重复实现，阻碍了研究效率。

Result: 框架已支持六个主流自动驾驶数据集，包括Waymo End-to-End、Waymo Perception、Argoverse 2 Sensor、Argoverse 2 LiDAR、NAVSIM (OpenScene-v1.1)和WayveScenes101，并作为开源Python包发布。

Insight: 主要创新点在于提出了一个统一的数据模式（canonical schema）来标准化不同数据集的预处理流程，并设计了支持跨数据集加载和场景过滤的PyTorch DataLoader。其核心价值在于将添加新数据集的成本降低为仅需编写从原始数据到标准模式的映射代码，而无需改动下游训练和评估流水线，这极大地提升了研究可复现性和实验效率。

Abstract: Autonomous driving has shifted from modular perception-prediction-planning stacks toward end-to-end (E2E) models that map sensor inputs directly to vehicle control, often regularized by auxiliary tasks such as 3D detection, motion forecasting, and HD-map perception. Progress is driven by a fast-growing ecosystem of sensor-rich driving datasets, yet each ships its own file formats, APIs, coordinate conventions, and modality coverage, leaving cross-dataset experimentation and even basic per-dataset preprocessing to be re-implemented per project. We present StandardE2E, a framework that provides a single unified interface over E2E driving datasets. StandardE2E (i) standardizes per-dataset preprocessing under one shared data schema; (ii) combines multiple datasets in a single PyTorch DataLoader for cross-dataset pretraining, auxiliary-task supervision, and scenario-level filtering; and (iii) reduces adding a new dataset to a single per-dataset mapping from raw frames to the canonical schema, leaving the entire downstream pipeline unchanged. The framework supports six datasets out of the box: Waymo End-to-End, Waymo Perception, Argoverse 2 Sensor, Argoverse 2 LiDAR, NAVSIM (OpenScene-v1.1), and WayveScenes101, and is released as the open-source standard-e2e Python package, available at https://github.com/stepankonev/StandardE2E.

[48] FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs cs.CVPDF

Eshika Khandelwal, Jingjing Pan, Mingfang Zhang, Quan Kong, Lorenzo Garattoni

TL;DR: 本文提出了FindIt，首个专门评估通用多模态大语言模型（MLLMs）在可提示定位能力上的综合性基准。该基准涵盖物体检测、指代表达检测、实例级检测和视频检测四大任务类别，并建立了一个统一的评估框架来标准化输入、强制可解析的边界框输出并定义透明的评估协议。通过对多个开源和专有MLLMs的评估，论文深入分析了它们在定位任务中的性能、局限性以及对输出格式规范的遵守情况。

Details

Motivation: 当前多模态大语言模型（MLLMs）主要评估自由形式的视觉语言任务（如视觉问答、描述），但其实际应用正快速扩展到更结构化的计算机视觉场景（如以定位为中心的目标检测任务）。然而，目前缺乏一个标准化的大规模基准来系统评估MLLMs在这些定位能力上的表现。

Result: 论文在提出的FindIt基准上评估了一系列开源和专有MLLMs，提供了对其性能和局限性的深入分析。结果表明，当前最先进的MLLMs在定位场景中既有优势也有明显不足，特别是对输出格式约束高度敏感，即使面对微小变化也常常无法泛化。

Insight: 主要创新点在于创建了首个专门针对MLLMs可提示定位能力的综合性、标准化评估基准（FindIt）及其统一评估框架。客观来看，该工作强调了在MLLM评估中考虑结构化输出（如边界框）和格式鲁棒性的重要性，为改进多模态模型的设计和评估指出了关键方向。

Abstract: Multimodal large language models (MLLMs) are predominantly evaluated on free-form vision-language tasks such as visual question answering, captioning, and summarization. However, their practical use is rapidly expanding to more structured computer vision settings, where users prompt models to perform localization-centric tasks such as object detection, often within larger agentic or decision-making systems. Despite this shift, there is currently no standardized benchmark that systematically evaluates these capabilities at scale. In this work, we introduce the first comprehensive benchmark specifically designed to assess the promptable localization abilities of generalist MLLMs. Our benchmark spans four core task categories: object detection, referring expression detection, instance-level detection, and video-based detection. To enable consistent and fair evaluation, we develop a unified framework that standardizes inputs, enforces parsable bounding box outputs, and defines transparent evaluation protocols across tasks. Using this suite, we evaluate a diverse set of open-source and proprietary MLLMs, providing an in-depth analysis of their performance and limitations. Beyond accuracy, we examine models’ ability to adhere to output format specifications, showing that current systems are highly sensitive to formatting constraints and often fail to generalize even to minor variations. Our results highlight both the strengths and shortcomings of state-of-the-art MLLMs in localization settings, and point toward important directions for improving multimodal model design and evaluation.

[49] A Cookbook of 3D Vision: Data, Learning Paradigms, and Application cs.CVPDF

Hongyang Du, Zongxia Li, Dawei Liu, Runhao Li, Haoyuan Song

TL;DR: 这篇论文提供了一个以数据为中心的3D视觉分类法，系统性地连接了几何表示、数据集、学习框架和应用。它分析了点云、网格、体素和3D高斯等主要3D数据表示及其获取流程，并探讨了数据集设计、基准构建和监督机制如何推动2D监督3D学习、隐式神经表示和4D世界建模等领域的进展。

Details

Motivation: 3D视觉领域因数据表示、学习范式和基准的多样化而碎片化，难以形成关于效率、保真度和可扩展性的统一视角。本文旨在通过一个综合的概念图来整合这些元素，为领域提供清晰的脉络。

Result: 论文未提及具体的定量实验结果或基准测试，而是提供了一个综合性的分类和综述框架，旨在澄清表示、学习范式和下游任务（如重建、生成和视频建模）之间的关系。

Insight: 创新点在于提出了一个统一的数据中心化分类法，将几何表示、数据集和学习范式系统性地关联起来，强调了平衡效率与保真度以及多模态几何基础的新兴趋势，为3D视觉研究提供了整合视角。

Abstract: 3D vision has rapidly evolved, driven by increasingly diverse data representations, learning paradigms, and modeling strategies. Yet the field remains fragmented across representations and benchmarks, making it difficult to develop unified perspectives on efficiency, fidelity, and scalability. This work provides a data-centric taxonomy of 3D vision that connects geometric representations, datasets, learning frameworks, and applications within a single conceptual map. We begin by analysing the principal structural representations of 3D data–point clouds, meshes, voxels, and 3D Gaussians–along with their acquisition pipelines. We then examine how dataset design, benchmark construction, and supervision regimes shape recent advances, spanning 2D-supervised 3D learning, implicit neural representations, and 4D world modeling. Through this integrative lens, we clarify the relationships among representations, learning paradigms, and downstream tasks in reconstruction, generation, and video modeling, offering a consolidated view of emerging trends toward balancing efficiency and fidelity and toward multimodal geometric grounding.

[50] Answer Self-Consistency with Margin-Triggered Question Re-Arbitration for the CVPR 2026 VidLLMs Challenge cs.CVPDF

Tomoya Miyazawa, Hiroyasu Okuno

TL;DR: 本文介绍了针对CVPR 2026 VidLLMs挑战赛Track 2的解决方案，该赛道评估视频中的视觉关系推理能力。作者提出了ASC-MQRA框架，这是一种无需训练、基于多模态推理模型的测试时推理方法。核心组件ASC通过多次随机视频问答运行并聚合答案选择来提升性能，而MQRA模块则针对低置信度样本进行条件性重新仲裁。最终测试提交仅使用ASC，在验证集和测试集上均取得了较高的准确率。

Details

Motivation: 该研究旨在解决视频中视觉关系推理的挑战，特别是当关系并非总是显式可见时。为了提升模型在复杂视频问答任务中的推理准确性和鲁棒性，作者探索了无需额外训练、在测试时通过自我一致性和不确定性信号来改进推理的方法。

Result: 在验证集上，ASC-MQRA框架（仅使用ASC部分）取得了72.73%的平均准确率和78.34%的类别宏平均准确率；在测试集上，取得了81.16%的平均准确率和80.91%的类别宏平均准确率。MQRA模块在验证集上能进一步提升ASC的性能，但在测试集上略有下降，表明重新仲裁对触发子集的规模和类别分布敏感。

Insight: 创新点在于提出了一个无需训练的测试时推理框架ASC-MQRA，其核心是通过答案级别的自我一致性（多次运行并投票）来聚合不确定性，显著优于单次推理。此外，利用投票边际（vote-margin）作为不确定性信号，设计条件性重新仲裁模块（MQRA）来针对性处理低置信度样本，这为模型校准和不确定性估计提供了新思路。

Abstract: In this report, we present our solution for Track 2 of the CVPR 2026 VidLLMs Challenge. This track evaluates visual relational reasoning in videos, where models must infer relations that are not always explicitly visible. We propose Answer Self-Consistency with Margin-Triggered Question Re-Arbitration (ASC-MQRA), a training-free test-time reasoning framework built on a multimodal reasoning model. The core ASC component performs multiple stochastic video question-answering runs and aggregates their answer choices through answer-level self-consistency. This substantially improves over single-pass inference and forms our final test submission. We further study MQRA, a conditional re-arbitration module for low-margin examples where the first-stage vote distribution indicates uncertainty. Our vote-margin analysis shows that low-margin examples often retain the ground-truth answer among the top candidates, motivating MQRA to narrow the candidate set and re-watch the video only over the retained candidates. On validation, MQRA further improves over ASC, indicating that low-margin vote distributions can provide a useful uncertainty signal. On test, however, MQRA slightly degrades performance relative to ASC, suggesting that re-arbitration is sensitive to the size and category distribution of the triggered subset. Our final test submission therefore uses ASC without re-arbitration, achieving 72.73 average accuracy and 78.34 category-wise macro average accuracy on validation, and 81.16 average accuracy and 80.91 category-wise macro average accuracy on test. This report details our prompting strategy, implementation setup, ablation studies, and diagnostic analyses. The code is available at https://github.com/data-analytics-labo/ASC-MQRA

[51] HYolo: An Intelligent IoT-Based Object Detection System Using Hypergraph Learning cs.CV | cs.AI | cs.LGPDF

Isha Abid, Fawad Khan, Muhammad Khuram Shahzad

TL;DR: 本文提出了HYolo，一种基于物联网的智能物体检测框架，通过将超图学习整合到YOLO架构中，以捕获物体和上下文特征之间的高阶关系，从而提升检测性能。在COCO数据集上的实验表明，该方法相比基线YOLO模型有显著改进，mAP@50提高了约12%，增强了整体检测准确性和鲁棒性。

Details

Motivation: 传统YOLO模型主要捕获成对特征交互，难以建模物体和上下文特征之间的复杂高阶关系，因此需要一种方法来捕获更丰富的上下文依赖以改进物体表示。

Result: 在COCO数据集上的实验评估显示，HYolo相比基线YOLO模型实现了约12%的mAP@50提升，提高了检测准确性和鲁棒性，达到了SOTA水平。

Insight: 创新点在于将超图学习整合到物体检测流程中，以建模高阶特征关系，从而提供改进的上下文理解和更可靠的检测性能，为智能物联网视觉系统提供了有前景的方向。

Abstract: This paper presents HYolo, an intelligent IoT-based object detection framework that integrates hypergraph learning into the YOLO architecture. Traditional YOLO-based object detection models primarily capture pairwise feature interactions and may fail to model complex high-order relationships among objects and contextual features. To address this limitation, HYolo incorporates hypergraph learning to capture richer contextual dependencies and improve object representation. Experimental evaluation on the COCO dataset demonstrates significant performance improvements over baseline YOLO models. The proposed approach achieves approximately 12% improvement in mAP@50 while enhancing overall detection accuracy and robustness. By modeling high-order feature relationships, HYolo provides improved contextual understanding and more reliable object detection performance in IoT-based environments. The results indicate that integrating hypergraph learning into object detection pipelines offers a promising direction for intelligent and context-aware IoT vision systems.

Yue Wu, Changyuan Wang, Zixuan Wang, Shilin Ma, Yansong Tang

TL;DR: 本文提出了MorphoQuant，一种面向全模态大语言模型（OLLMs）的模态感知后训练量化框架。它通过分布感知偏置补偿（DABC）选择性吸收长尾异常值，并结合形态导向量化函数优化（MDQFO）协同优化量化网格与偏置掩码，以解决跨模态分布异质性和异常值模式差异导致的4比特量化难题。

Details

Motivation: 传统后训练量化方法在处理4比特全模态大语言模型时，因不同模态间极端的分布异质性和差异显著的异常值模式而面临挑战。

Result: 在Qwen2.5-Omni模型上，于MMMU和Video-MME等基准测试中进行了广泛评估，证明了方法的优越性。具体而言，其W4A4模型在ScienceQA上达到76.63%，显著优于SOTA的W4A4方法，甚至超过了W4A16基线，展现了卓越的精度-效率权衡。

Insight: 核心创新在于提出了模态感知的量化框架，通过DABC机制在保护异常值幅度的同时保持密集内点的高精度离散化，以及MDQFO实现跨模态的细粒度对齐，有效缓解了全模态模型量化中的分布异质性问题。

Abstract: Conventional Post-Training Quantization (PTQ) methods struggle with 4-bit Omni-modal Large Language Models (OLLMs) due to the extreme distribution heterogeneity and disparate outlier patterns across modalities. To address this, we propose MorphoQuant, a modality-aware PTQ framework engineered to preserve cross-modal morphology and mitigate outlier loss. Specifically, we introduce Distribution-Aware Bias Compensation (DABC), which selectively absorbs long-tailed outliers into channel-wise biases. This mechanism safeguards outlier magnitudes while maintaining high-precision discretization for dense inliers, thereby preserving accurate discretization across diverse modal distribution. Complementing this, we propose Morphology-Directed Quantization Function Optimization (MDQFO) to co-optimize the quantization grid with the bias mask, ensuring fine-grained alignment across modalities. Extensive evaluations on Qwen2.5-Omni across benchmarks like MMMU and Video-MME demonstrate our approach’s superiority. Notably, our W4A4 model achieves 76.63% on ScienceQA, significantly outperforming SOTA W4A4 methods and surprisingly surpassing the W4A16 baseline, which fully demonstrates the exceptional accuracy-efficiency trade-off of our framework.

[53] Video2LoRA: Parametric Video Internalization for Vision-Language Models cs.CV | cs.CLPDF

Manan Suri, Sarvesh Baskar, Dinesh Manocha

TL;DR: 本文提出了Video2LoRA方法，用于将视频内容参数化地内部化到视觉语言模型中。该方法通过一个感知器超网络，在冻结的VLM逐层编码视频时读取其中间表示，并单次前向传播生成一个LoRA适配器。这使得模型在推理时无需视觉token，仅通过适配器即可回答查询，大幅降低了计算开销。

Details

Motivation: 解决视觉语言模型处理视频时的高昂计算成本问题，即每帧占用大量token，且推理成本随帧数和查询次数线性增长。

Result: 在视频摘要和字幕生成的五个基准测试中，Video2LoRA在500M和2.2B参数的SmolVLM2模型上，统计上不劣于且等同于直接视频上下文推理；在八个视频问答基准配对中的七个也达到同等水平。尽管仅用12帧384px训练，该方法在高达1024帧和1024px下仍保持稳定，而直接推理常退化。同时，它将答案生成时的视觉token负载降低高达1500倍，查询首次令牌时间（TTFT）减少6-80倍。

Insight: 创新点在于直接根据视频内容预测LoRA权重，避免了传统LoRA微调所需的迭代梯度更新，实现了零视觉token的推理。此外，非重叠视频段独立生成的适配器可在秩空间组合，为长视频分块内部化提供了可行路径。

Abstract: Processing video in vision-language models is expensive: each frame occupies hundreds of tokens, and inference cost scales with every frame and every repeated query. We introduce Video2LoRA, a method for parametric video internalization. A perceiver hypernetwork reads the intermediate representations produced layer-by-layer as a frozen VLM encodes a video, and generates a Low-Rank Adaptation (LoRA) adapter in a single forward pass. Unlike standard LoRA fine-tuning, which requires iterative gradient updates, Video2LoRA predicts these weights directly from the video. Trained for SmolVLM2 500M and 2.2B on video summarization and captioning, Video2LoRA enables the same frozen VLM to answer queries from the adapter alone, with zero visual tokens in its context at query time. Video2LoRA is statistically non-inferior and equivalent to direct video-in-context inference across all five captioning benchmarks at both model scales, and across seven of eight video question answering benchmark-scale pairings. Although trained only on 12 frames at 384px, it remains stable up to 1,024 frames and 1024px, where direct video-in-context inference often degenerates. Across this sweep, it reduces answer-time visual-token load by up to 1,500x and query TTFT by 6-80x, while preserving video-faithful outputs. We also find that independently generated adapters for non-overlapping video segments can compose in rank space, suggesting a path toward chunked long-video internalization.

[54] Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers cs.CV | cs.AIPDF

Biao Qian, Yang Wang, Yong Wu, Jungong Han

TL;DR: 本文提出了一种名为MaskAQ的新型掩码注意力对齐方法，用于视觉Transformer的无数据量化。该方法通过最大化补丁相似度的微分熵来解耦信息区域与噪声背景，并利用掩码注意力对齐目标选择信息区域以对齐全精度模型与量化模型，从而生成高质量的合成样本。此外，还引入了周期性样本刷新策略，使MaskAQ能够在训练过程中持续适应量化模型的演化状态。

Details

Motivation: 解决无数据量化中合成样本与量化模型预期输入分布不匹配的问题，这导致性能次优。

Result: 在多个骨干网络和下游任务上的广泛实验验证了MaskAQ优于最先进方法，达到了SOTA水平。

Insight: 创新点在于发现自注意力机制的语义主要集中于稀疏的补丁子集（信息区域），这些区域主导了合成样本与量化模型输出之间的互信息；通过解耦和选择信息区域进行对齐，并结合周期性刷新策略，有效提升了合成样本质量和对量化模型的适应性。

Abstract: Data-Free Quantization (DFQ) addresses data security concerns by synthesizing samples, without accessing real data. It has garnered increasing attention in the context of Vision Transformers (ViTs), owing to the superiority of the self-attention mechanism compared to classical convolutional operation. However, previous DFQ arts for ViTs often suffer from a distribution mismatch between synthetic samples and input distribution expected by quantized models Q, resulting in the suboptimal performance. In this paper, we propose a novel Masked Attention Alignment approach for Data-Free Quantization of ViTs, named MaskAQ, revealing that: 1) the semantics in the self-attention mechanism is predominantly localized to a sparse subset of patches, called informative regions; 2) the informative regions dominate the mutual information between synthetic samples and Q’s outputs. To these ends, we incorporate differential entropy maximum over patch similarity of synthetic samples, to decouple informative regions from noisy background. To couple with varied Q, the informative regions are selected to align full-precision models with Q via a masked attention alignment objective, thus yielding high-quality synthetic samples. Furthermore, a periodic sample refreshing strategy comes up to endow MaskAQ with the capacity to continually adapt to the evolving state of Q throughout the training process, to preserve desirable mutual information with synthetic samples. Extensive experiments verify the merits of MaskAQ over state-of-the-art approaches across multiple backbones and downstream tasks. Our code is available at https://github.com/hfutqian/MaskAQ.

[55] Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention cs.CV | cs.LGPDF

Dhanesh Ramachandram

TL;DR: 该论文提出了一种空间基础化的概念瓶颈模型，通过部件因子化注意力机制来增强模型的可解释性和空间定位能力。该方法基于冻结的DINOv3视觉Transformer，引入了可学习的前景门控、部件查询和二维高斯先验，以约束概念仅从相关图像区域获取证据，从而在细粒度识别任务中实现高精度分类和准确的空间指向。

Details

Motivation: 现有概念瓶颈模型在细粒度识别任务中，概念头可以自由关注图像任意区域，导致命名概念可能被其他区域的证据满足，削弱了模型的可解释性和空间一致性。本文旨在通过构建部件因子化的CBM，强制概念仅从指定身体部件区域读取信息，以提升模型的可靠性和可审计性。

Result: 在CUB-200-2011数据集上，带有空间先验的模型达到了与全监督基线相当的分类准确率（88.85% vs 88.95%），同时将指向准确率提升了16个百分点（52.6% vs 36.4%）。使用PCA前景目标替代边界框监督并结合高斯先验后，模型在无需每张图像监督的情况下实现了88.6%的分类准确率和约70%的指向准确率。

Insight: 创新点包括：1）通过固定概念-部件映射路由实现概念的空间约束；2）利用数据集平均关键点位置初始化的可学习高斯先验打破部件查询的排列对称性，无需每图像关键点标注；3）实验表明仅需极少量训练图像（约27张）初始化先验即可保持性能，凸显了数据效率。该方法为构建可解释且空间一致的视觉模型提供了新思路。

Abstract: Concept bottleneck models (CBMs) predict a layer of human-named attributes before predicting a class, which makes their decisions auditable. On fine-grained recognition tasks the concept heads are usually free to attend anywhere in the image, so a head named for one body region can be satisfied by evidence on another. This work studies a part-factorized CBM that removes that freedom by construction. The method has three components built on a frozen DINOv3 vision transformer. A learned foreground gate, trained on DINOv3 patch features, suppresses background patches inside the part attention. A set of part queries cross-attends to patch features and each of the 312 CUB attributes is routed, through a fixed concept-to-part map, to read only from the part token its name implies. A learnable two-dimensional Gaussian prior, injected additively in log space into the attention logits, breaks the permutation symmetry among part queries; its means are initialized from the dataset-average keypoint location of each part, which requires no per-image keypoint supervision at training or test time. On CUB-200-2011 the spatial-prior model matches a fully supervised baseline (88.85% versus 88.95% top-1) while raising pointing accuracy by 16 points (52.6% versus 36.4%). Replacing bounding-box supervision with a PCA foreground target and combining it with the Gaussian prior removes all per-image supervision and reaches 88.6% top-1 at about 70% pointing accuracy. A keypoint-fraction sweep shows that 0.5% of the training set (about 27 images) suffices to initialize the prior with no measurable loss. Removing part identity entirely is the harder case: without any spatial prior, pointing accuracy collapses to $2.9%$.

[56] Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models cs.CVPDF

Shuwen Yu, Zhanxuan Hu, Yi Zhao, Yonghang Tai, Huafeng Li

TL;DR: 该论文提出了一种名为GPUA（Geometry-Preserving Unsupervised Alignment）的无监督对齐框架，旨在整合视觉基础模型（VFMs）和视觉语言基础模型（VLMs）的互补优势。GPUA将VFM特征视为一种视觉语言，通过学习一个正交映射，将VFM空间转换到VLM的语义空间中，从而在无需标签或更新模型参数的情况下，保留几何结构并缩小模态差异。该方法与任务无关，仅需访问预训练模型的特征，并在多个基准测试中提升了跨模型兼容性，显著增强了零样本识别和分割的下游性能。

Details

Motivation: 动机在于解决视觉基础模型（VFMs）和视觉语言基础模型（VLMs）之间的不兼容性问题：VFMs学习判别性的感知几何但缺乏语义基础，而VLMs提供基于语言的语义对齐但视觉上往往较为粗糙。

Result: 在多个基准测试上的实验表明，该方法提高了跨模型兼容性，并在下游的零样本识别和分割任务中带来了显著的性能提升，同时开销可忽略不计。

Insight: 创新点在于受跨语言对齐启发，将VFM特征视为视觉语言，通过无监督的正交映射实现几何保持的跨模态对齐，这是一种无需标签或模型微调的特征级集成方法，具有任务无关性和低开销优势。

Abstract: Foundation models have driven rapid progress in computer vision, yet the two dominant paradigms, vision-language foundation models (VLMs) and vision-only foundation models (VFMs), remain only partially compatible. VLMs offer language-grounded semantic alignment but are often visually coarse, while VFMs learn discriminative perceptual geometry but lack semantic grounding. We propose GPUA (Geometry-Preserving Unsupervised Alignment), a framework that integrates the complementary strengths of VFMs and VLMs. Inspired by cross-lingual alignment, GPUA treats VFM features as a visual language and learns an orthogonal mapping that translates the VFM space into the VLM semantic space, preserving geometry and narrowing the modality gap without labels or model parameter updates. GPUA is task-agnostic and requires only feature-level access to pretrained models. Experiments across diverse benchmarks demonstrate improved cross-model compatibility and strong gains in downstream zero-shot recognition and segmentation with negligible overhead. Code is available at https://github.com/Yuteam14/GPUA

[57] An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization cs.CV | cs.AI | cs.LGPDF

Luoyidi Zhou

TL;DR: 该论文通过实证研究探讨了数据规模、模型复杂度和输入模态对视觉模型泛化性能的影响。研究首先在一维非线性函数上初步实验，然后在CIFAR-10和CIFAR-100数据集上进行主实验，比较不同训练数据量、模型架构和输入模态下的性能。

Details

Motivation: 现代深度神经网络在计算机视觉中表现出色，但其泛化性能的来源难以用传统统计学习理论解释。研究旨在实证分析数据规模、模型复杂度和输入模态这三个可控变量如何影响视觉泛化。

Result: 实验表明，增加训练数据规模能持续提升泛化性能，而改变模型复杂度（如架构调整）未带来稳定增益。去除颜色信息会降低模型性能，而梯度、边缘和小波等显式先验特征在不同模型架构中效果不一致。

Insight: 论文的创新点在于系统性地实证分析了数据、模型和输入模态对泛化的影响，强调了数据规模的关键作用，并揭示了先验特征的效果依赖于模型架构，为理解深度学习泛化提供了经验依据。

Abstract: Modern deep neural networks usually have large parameter scales and nonlinear hierarchical structures, and they have achieved strong performance in computer vision. However, the source of their generalization performance remains difficult to explain using traditional statistical learning theory. Among the factors that may affect visual generalization, data scale, model complexity, and input modalities are fundamental and controllable variables. This study empirically analyzes how these three factors influence model generalization performance. Specifically, in a preliminary experiment, we construct a one-dimensional nonlinear function and vary the number of training samples and the polynomial degree to observe the effects of data scale and model complexity on model performance. In the main experiments, we compare model performance on CIFAR-10 and CIFAR-100 under different training data scales, model architectures, and input modalities. The experimental results show that increasing the training data scale consistently improves generalization performance, whereas changes in model complexity do not provide stable gains. In addition, removing color information degrades model performance, while explicit prior features such as gradients, edges, and wavelets have inconsistent effects across different model architectures. Overall, this study provides an empirical analysis of the relationships among data scale, model complexity, input modalities, and visual generalization performance. Code and experimental logs are available at: https://github.com/zlyd-CV/DeepLearning-Empirical-Studies.

[58] Ultra-Fast Neural Video Compression cs.CVPDF

Jiahao Li, Wenxuan Xie, Zhaoyang Jia, Bin Li, Zongyu Guo

TL;DR: 本文提出了一种基于分块的神经视频压缩框架DCVC-UF，通过将多帧编码为单一紧凑潜在表示并同时解码，结合跨帧交互模块和帧特定解码器，显著提升了速率-失真-复杂度的权衡。该方法不仅大幅提高了编码吞吐量，还增强了长期时间相关性建模，并引入了简化的熵编码机制以进一步加速解码过程。

Details

Motivation: 现有神经视频编解码器（NVCs）虽在压缩比上表现出色，但其极高的计算复杂度阻碍了实际部署，因此需要改进速率-失真-复杂度的权衡以实现高效应用。

Result: 在实验中，DCVC-UF实现了超快的编码和解码速度，显著超越了先前领先的编解码器，并在性能上达到了新的SOTA水平。

Insight: 创新点包括分块编码框架、跨帧交互模块用于联合时空建模、帧特定解码器实现并行重建，以及简化的单步熵编码机制，这些设计共同提升了计算效率和压缩性能。

Abstract: While neural video codecs (NVCs) have demonstrated superior compression ratio, their prohibitive computational complexity remains a critical barrier to real-world deployment. This paper introduces a chunk-based coding framework designed to significantly improve the rate-distortion-complexity trade-off. Instead of processing frames sequentially, our approach encodes a chunk of multiple frames into a single compact latent representation and decodes them simultaneously. This is enabled by cross-frame interaction modules for joint spatial-temporal modeling and frame-specific decoders for parallel reconstruction. This paradigm not only dramatically enhances coding throughput but also facilitates more effective modeling of long-term temporal correlations. To further boost speed, we propose a streamlined entropy coding mechanism that consolidates bit-stream interactions into a single step, substantially reducing decoding overhead. Building on these innovations, we present DCVC-UF (Ultra-Fast), a new NVC that sets a new SOTA in performance. Our experiments show that DCVC-UF can achieve ultra-fast encoding and decoding speeds, significantly outperforming previous leading codecs. DCVC-UF serves as a notable landmark in the journey of NVC evolution. The code is at https://github.com/microsoft/DCVC.

[59] DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation cs.CVPDF

Thanh-Tung Le, Yunhan Zhao, Menglei Chai, Zhengyang Shen, Zhe Cao

TL;DR: 本文提出DSA（动态步长分配）框架，用于加速自回归视频扩散模型的推理过程。该方法通过训练一个轻量级置信度头来估计每帧的去噪可靠性，并动态调整去噪步数：简单帧提前终止以加速，复杂帧则获得更多细化步骤。实验表明，DSA在H100 GPU上实现了22.63 FPS的实时生成速度，同时在VBench基准上保持了与现有自回归和双向视频扩散模型相当或更优的质量。

Details

Motivation: 视频扩散Transformer虽已达到SOTA视觉质量，但其高推理成本是实时应用的主要瓶颈。现有蒸馏框架虽降低了延迟，但仍对每帧使用固定去噪步数，导致在简单帧上浪费计算，在复杂帧上细化不足。

Result: 在H100 GPU上实现22.63 FPS的实时生成，延迟低于1秒；在VBench基准上，质量与近期自回归和双向视频扩散模型相当或更优。

Insight: 创新点在于引入置信度引导的自适应计算机制，通过联合训练的轻量级置信度头动态分配去噪步数，无需额外视频数据、启发式规则或大幅架构修改，为交互式视频生成提供了有效路径。

Abstract: Video diffusion transformers have achieved state-of-the-art visual quality, but their high inference cost remains a major bottleneck for real-time applications. Recent distillation frameworks produce autoregressive video diffusion models with reduced latency, yet these models still use a fixed number of denoising steps per frame, wasting computation on predictable frames and under-refining challenging ones. We present DSA, a confidence-guided adaptive computation framework for AR video diffusion. DSA introduces a lightweight confidence head, trained jointly with the generator under a distribution-matching distillation objective, to estimate per-frame denoising reliability. At inference, this confidence signal dynamically adjusts the number of diffusion steps: simple frames terminate early for speed, while complex frames receive additional refinement. Our method requires no extra video data, no heuristics, and little architectural modification. Experiments show that DSA achieves real-time autoregressive video generation, reaching 22.63 FPS with sub-second latency on H100 GPUs, while maintaining competitive or superior VBench quality compared to recent autoregressive and bidirectional video diffusion models. Our results demonstrate that confidence-guided adaptive sampling provides an effective and practical path toward interactive video generation.

[60] Stateful Visual Encoders for Vision-Language Models cs.CV | cs.CL | cs.LGPDF

Zirui Wang, Junwei Yu, Adam Yala, David M. Chan, Joseph E. Gonzalez

TL;DR: 本文提出了一种状态化视觉编码器，用于增强视觉语言模型在需要视觉上下文的任务中的性能。该编码器通过将当前图像的视觉表示与先前的视觉特征进行条件化处理，使模型能够更好地捕捉跨图像的细微变化。实验表明，该方法在空间聚合、视觉差异检测和行为克隆等任务上取得了显著改进，并在放射学、细粒度图像比较和遥感等实际应用中超越了通用视觉语言模型基线，甚至在某些领域达到了专用模型的水平。

Details

Motivation: 现有视觉语言模型中的视觉编码器是无状态的，每个图像独立编码，缺乏对先前视觉上下文的访问，导致在需要跨图像比较的任务中，细微但关键的变化可能被忽略。本文旨在解决这一问题，通过引入状态化视觉编码器来增强模型对视觉变化的感知能力。

Result: 在监督微调下，配备状态化编码器的视觉语言模型在跨图像空间聚合、多对象视觉差异检测和视觉轨迹行为克隆等受控任务上取得了持续改进。这些改进在不同输入分辨率、语言模型大小和视觉语言模型骨干网络中保持一致。在真实世界任务中，如纵向放射学、细粒度图像比较和遥感，状态化编码器持续提升了通用视觉语言模型基线，并在某些领域达到或超越了专用模型的性能。

Insight: 创新点在于将状态机制引入视觉编码器，使模型能够利用历史视觉信息进行条件化编码，从而更好地处理依赖视觉变化的序列任务。这为视觉语言模型在多图像、多轮交互场景中的应用提供了新的架构思路，特别是在需要捕捉细微视觉差异的领域具有借鉴价值。

Abstract: Vision-language models (VLMs) are increasingly used in multi-image, multi-turn agentic settings where decisions depend on visual changes. However, in existing open-weight VLMs, visual comparisons happen only inside the language model, while the visual encoder itself remains stateless: each image is encoded independently, without access to the prior visual context. As a result, small but task-critical changes may be attenuated before the language model has a chance to compare them, especially when those changes do not affect the high-level semantics of the scene. We introduce a Stateful Visual Encoder, which conditions each visual representation on prior visual features. Under supervised finetuning, VLMs equipped with stateful encoders achieve consistent improvements on controlled tasks involving cross-image spatial aggregation, multi-object visual differencing, and visual trajectory behavior cloning. These improvements are consistent across input resolutions, language model sizes, and VLM backbones. Finally, we validate our model on real-world tasks, including longitudinal radiology, fine-grained image comparison, and remote sensing, where stateful encoders consistently improve generalist VLM baselines and can match or surpass specialized models in selected domains. Project page: https://statefulvisualencoders.github.io/

[61] Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning cs.CV | cs.LGPDF

Niloufar Alipour Talemi, Hossein Kashiani, Fatemeh Afghah

TL;DR: 本文提出Hyper-ICL，一种基于训练的无演示多模态上下文学习框架，旨在解决传统多模态ICL推理延迟高、对演示格式敏感的问题。该方法通过学习一个参数高效的logit级适配器来校准注意力分布，并引入查询自适应调制机制和双曲锚点蒸馏损失，以在推理时无需演示样本即可重建演示效果。

Details

Motivation: 多模态上下文学习存在高推理延迟和因对演示格式、顺序及内容敏感而导致的不稳定性问题，需要一种轻量级、免演示的解决方案。

Result: 在六个多模态基准测试（包括VQAv2、OK-VQA和COCO Caption）上的广泛实验表明，Hyper-ICL在准确性和稳定性上均优于原始ICL和现有最先进方法。

Insight: 创新点包括：通过低秩logit级适配器校准注意力分布；查询自适应调制机制实现token级干预强度控制；以及利用洛伦兹测地距离的双曲锚点蒸馏损失来对齐师生特征，从而有效捕获演示-查询关系。

Abstract: Multimodal In-Context Learning (ICL) has emerged as a practical inference paradigm for Multimodal Large Language Models, where a small set of interleaved image-text In-Context Demonstrations (ICDs) conditions the model to solve new tasks. Despite its flexibility, multimodal ICL incurs high inference latency and suffers from instability due to sensitivity to demonstration formatting, ordering, and content. To address these limitations, we propose Hyper-ICL, a lightweight, training-based framework for demonstration-free multimodal ICL that reconstructs demonstration effects directly without requiring ICDs at inference time. Hyper-ICL learns a parameter-efficient low-rank logit-level adapter that calibrates attention distributions to better match demonstration-induced attention redistribution. To capture how demonstration influence varies across queries, we introduce a query-adaptive modulation mechanism that adaptively controls intervention strength at token level across layers and heads based on the current query. Finally, we propose a layer-wise hyperbolic anchor distillation loss that aligns intermediate student features to a demonstration-conditioned teacher via Lorentz geodesic distance. This loss encourages the student to reconstruct the demonstration-query relationships induced by ICDs. Extensive experiments across six different multimodal benchmarks (including VQAv2, OK-VQA, and COCO Caption) demonstrate that Hyper-ICL consistently improves accuracy and stability over vanilla ICL and existing state-of-the-art methods.

[62] 3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training cs.CV | cs.ROPDF

Jiaxin Shi, Xidong Zhang, Fucai Zhu, Zhe Li, Siyu Zhu

TL;DR: 本文提出了3DThinkVLA框架，通过3D思维引导的协同训练，赋予视觉-语言-动作模型隐式的3D空间推理能力。该方法在潜在空间中解耦几何感知与空间推理，利用轻量适配器将分层空间先验注入动作查询，无需3D传感器或显式文本生成，在多个仿真和真实世界操作任务上达到SOTA性能。

Details

Motivation: 解决现有视觉-语言-动作模型缺乏3D空间推理能力的问题，旨在让模型仅基于2D图像就能进行隐式的3D推理，以提升在复杂操作任务中的表现。

Result: 在LIBERO、LIBERO-PLUS、SimplerEnv等仿真基准和真实世界操作任务上取得了最先进的性能，无需3D传感器或外部模型。

Insight: 核心创新在于将3D几何感知与空间推理能力解耦，并通过潜在空间协同训练分层注入；利用共享推理锚令牌在训练中桥接显式教师提示与学生动作提示，避免了思维链文本生成，实现了高效的知识蒸馏。

Abstract: We propose a 3D-thinking-guided co-training framework that enables vision-language-action (VLA) models to perform 3D spatial reasoning implicitly during action prediction. Our core insight is that 3D geometry perception and 3D spatial reasoning are distinct capabilities that can be disentangled and injected at different feature hierarchies. During training, three tightly coupled components work in concert primarily within the latent space: (1) To gain geometric priors, a latent 3D geometry perception module aligns intermediate visual features with a 3D foundation model, acquiring low-level geometric cues without architectural modifications to the VLM backbone. (2) Complementing this, an online 3D reasoning distillation module mitigates the prompt-induced reasoning gap via a shared reasoning anchor token. During 3D VLM co-training, this anchor is emitted as the first output token to robustly encode spatial priors. During VLA training, it serves as an input token inserted between the task and action instructions, transferring high-level spatial thinking from explicit teacher reasoning prompts to student action prompts without chain-of-thought text generation. (3) These disentangled geometric and reasoning features are then united by a spatially augmented action integration, which jointly injects them into the action-query tokens as hierarchical spatial conditions to prevent action shortcuts. At deployment, our method retains only its lightweight adapters to perform implicit 3D reasoning, discarding the 3D foundation model and the teacher branch used for supervision. Consequently, it operates purely on 2D images without 3D sensors, external models, or explicit text generation while preventing catastrophic forgetting of the pretrained VLM, achieving state-of-the-art performance on LIBERO, LIBERO-PLUS, SimplerEnv, and real-world manipulation tasks.

[63] Radiomic Feature Selection Using Gradient Loss of Deep Neural Network for Lung Cancer Stage Detection cs.CV | cs.LGPDF

Hina Shakir, Mohammad Mohatram, Javeed Hussain, Syed Rizwan Ali, Muhammad Irfan Memon

TL;DR: 本研究提出了一种基于梯度损失的递归特征消除（GL-RFE）框架，用于肺癌分期检测中的影像组学特征选择。该方法利用深度神经网络的梯度敏感性分析来评估特征重要性，递归剔除贡献最小的特征，最终选取前15个关键特征训练分类器，在测试集上取得了90.22%的准确率。

Details

Motivation: 解决影像组学数据高维小样本带来的特征选择难题，以提高肺癌分期检测的模型可靠性和泛化能力。

Result: 在肺癌分期检测任务中，GL-RFE方法在测试集上达到准确率90.22%、精确率90.10%、召回率90.24%和F1分数90.16%的强分类性能，优于传统特征选择技术。

Insight: 创新点在于将深度神经网络的梯度损失用于特征重要性评估，能有效捕捉非线性特征交互；该方法为高维小样本生物医学数据提供了可重复、可解释的特征选择方案，可推广至基因组学等多模态临床分析领域。

Abstract: Radiomics enables extraction of quantitative imaging biomarkers from medical images and has become an important tool for computer-aided cancer diagnosis. However, radiomics datasets are typically high-dimensional with limited samples, making feature selection a critical step for building reliable predictive models. This study proposes a Gradient-Loss Recursive Feature Elimination (GL-RFE) framework that integrates gradient sensitivity analysis from a deep neural network to identify the most influential radiomic features for lung cancer stage detection. A total of 106 radiomic features were extracted from chest Computed Tomography (CT) scans using the PyRadiomics extension of the 3D Slicer platform. The proposed method evaluates feature importance by computing gradients of the network loss with respect to input features and recursively eliminates features with minimal contribution. The resulting top-15 radiomic features are used to train a deep neural network classifier for distinguishing early-stage and advanced-stage lung cancer. The proposed framework achieves strong classification performance, with accuracy of 90.22%, precision of 90.10%, recall of 90.24%, and F1-score of 90.16% on the test dataset. Visualization analyses, including correlation heat maps and distribution plots, further confirm reduced feature redundancy and improved class separability. Compared to conventional feature selection techniques, GL-RFE effectively captures nonlinear feature interactions and enhances model generalization. The presented protocol provides a reproducible and interpretable methodology for radiomics-based cancer stage detection and is particularly suitable for high-dimensional, small-sample biomedical datasets, with potential applications in other domains such as genomics and multimodal clinical analysis.

[64] ChannelTok: Efficient Flexible-Length Vision Tokenization cs.CVPDF

Sukriti Paul, Arpit Bansal, Tom Goldstein

TL;DR: 本文提出了一种名为ChannelTok的新型视觉分词器，它采用通道级（channel-wise）的灵活长度分词范式，以替代现有复杂且昂贵的空间分词方法。该方法将每个潜在通道视为一个视觉标记，使用参数高效的CNN-Transformer混合主干网络，并通过训练中的随机尾部丢弃策略使通道按语义重要性组织，从而实现推理时的灵活压缩和可变长度的自回归图像生成。

Details

Motivation: 当前领先的灵活视觉分词器虽然达到了SOTA质量，但依赖于参数庞大的主干网络和缓慢的多步生成解码器，计算成本极高。本文旨在摆脱这种复杂的空间标记范式，引入一种简单、轻量且快速的通道级灵活长度分词器，以在高效性和质量之间建立新的平衡。

Result: 在ImageNet数据集上的大量实验验证了该方法的有效性。模型在保持不同标记预算下质量一致的同时，达到了最先进的感知质量（rFID 2.92），并且解码速度比次优方案快8.6倍，模型尺寸小2.1倍（1.59亿参数），从而建立了新的质量-效率前沿。

Insight: 核心创新在于将视觉分词从空间维度转移到通道维度，这简化了架构并大幅提升了效率。训练中采用的随机尾部丢弃策略自然地实现了通道的语义重要性排序，为推理时的灵活压缩和可变长度生成提供了优雅的解决方案，为高效的视觉表示提供了一个强大且实用的新范式。

Abstract: Leading flexible vision tokenizers achieve SOTA quality at an extreme cost, relying on parameter-heavy backbones and slow, multi-step generative decoders. We depart from this complex, spatial-token paradigm and introduce a simple, lightweight, and fast channel-wise flexible-length tokenizer. Our method treats each latent channel as a visual token, enabling a parameter-efficient CNN-Transformer hybrid backbone. Furthermore, employing a stochastic tail-dropping paradigm during training naturally forces channels to organize by semantic importance. This allows for flexible compression at inference by simply retaining the first $k$ channels, and naturally enables variable-length autoregressive image generation. We validate our approach through extensive experiments on ImageNet, demonstrating consistent quality across diverse token budgets. The results establish a new quality-efficiency frontier: our model achieves state-of-the-art perceptual quality (rFID 2.92) while being $8.6\times$ faster in decoding and $2.1\times$ smaller (159M params) than the next-best alternative. Our work establishes channel-wise tokenization as a powerful and practical paradigm for efficient visual representation. Project page: https://channeltok.github.io

[65] Evaluating Reasoning Fidelity in Visual Text Generation cs.CV | cs.AI | cs.CLPDF

Jiajun Hong, Jiawei Zhou

TL;DR: 本文评估了文本到图像（T2I）模型在视觉文本生成中的推理保真度，发现尽管模型能生成清晰可读的文本图像，但在表达复杂推理过程时经常出现语义错误、逻辑不一致和中间步骤错误，与纯文本模型的强推理性能形成鲜明对比。

Details

Motivation: 研究动机是探究当前T2I模型在必须通过渲染文本直接表达复杂解决方案时，是否能忠实保留推理能力，还是仅仅模仿表面模式，以揭示视觉文本生成与程序性推理之间的差距。

Result: 评估结果显示，在长文本渲染、事实知识探测、上下文理解和多步推理等设置中，当前T2I模型频繁产生错误，与纯文本模型在相同任务上的强性能形成对比，突显了推理保真度的不足。

Insight: 创新点在于首次系统评估了T2I模型的推理保真度，揭示了视觉文本生成中表面清晰性与实际推理准确性之间的脱节，为开发更可靠的视觉文本推理系统提供了动机和方向。

Abstract: Recent text-to-image (T2I) models can render highly legible and well-structured text within images, enabling applications including document generation and slide generation. However, it remains unclear whether such systems faithfully preserve reasoning ability when complex solutions must be expressed directly through rendered text, or whether they merely imitate surface-level patterns. We investigate this question by evaluating reasoning fidelity in visual text generation, where models must express complete reasoning processes as images. Our evaluation includes long text rendering, factual knowledge probing, context understanding, and multi-step reasoning. Across these settings, we find that current T2I models frequently produce semantic errors, logical inconsistencies, and incorrect intermediate steps, even when the rendered text appears visually clear. These failures contrast with the strong reasoning performance of text-only models on the same tasks. Our findings reveal a substantial gap between visual text generation and procedural reasoning, motivating more reliable visual text reasoning.

[66] IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation cs.CV | cs.HCPDF

Haoyang Ge, Jian Ma, Ziwen Wang, Qihe Wang, Jianqi Fan

TL;DR: 本文提出IMPose，一种用于多人动态姿态标注的交互式工具，通过双级跟踪机制将单帧多人姿态修正传播至整个视频序列，显著减少跨帧重复手动标注工作量。

Details

Motivation: 现有标注工具缺乏时间修正传播能力或在多人场景中失效，导致高质量动态人体姿态标注仍依赖大量人工干预，效率低下。

Result: 在3DPW数据集上每1050帧视频仅需27次点击，在PoseTrack21上每84帧轨迹仅需3次点击，实现了高精度高效标注，并在不同交互预算下均保持强准确率-效率权衡。

Insight: 创新点包括关键点级序列建模确保修正时间传播，实例级结合关键点感知嵌入与相对位置编码维持多人跨帧一致性，以及轨迹库存储历史姿态与实例线索以增强长程时间关联和遮挡、运动模糊等挑战场景的稳定性。

Abstract: High-quality dynamic human pose annotation equips AI with precise motion kinematics to enable human behavior mastery, yet remains labor-intensive and time-consuming. Current annotation tools either lack temporal correction propagation or fail in multi-person scenarios, necessitating excessive manual intervention. In this paper, we introduce IMPose, an interactive tool for multi-person dynamic pose annotation. It features a dual-level tracking mechanism that propagates one-frame multi-person pose corrections from annotators across entire videos. The keypoint-level ensures corrections temporal propagation via sequential modeling, while the instance-level employs keypoint-aware embedding with relative positional encoding to maintain multi-person cross-frame consistency. To further improve robustness, IMPose maintains historical pose and instance cues in a trajectory bank, which enhances long-range temporal association and stabilizes annotation in challenging cases such as occlusion and motion blur. By converting sparse human corrections into dense and coherent pose trajectories, our framework significantly reduces repeated manual refinement across frames. Extensive experiments show that IMPose consistently achieves a strong accuracy efficiency trade off under different interaction budgets, demonstrating particular advantages in low click annotation settings. IMPose achieves high precision annotation with high efficiency, requiring only 27 clicks per 1,050 frame video on 3DPW and 3 clicks per tracklet per 84-frame on PoseTrack21. We further expand PoseTrack21 with 188K pose instances (3.55M keypoints) at a minimal cost of 10 annotators in 10 hours. The annotation tool, codes, and extended dataset will be open-sourced.

[67] 4D Reconstruction from Sparse Dynamic Cameras cs.CVPDF

Kazuki Ozeki, Shun Kenney, Yuto Shibata, Eisuke Takeuchi, Takuya Narihira

TL;DR: 本文提出了一种从稀疏动态相机进行4D重建的方法，通过集成相机间特征匹配和相机内点跟踪来确保时空一致性，并引入噪声鲁棒的深度排序正则化损失和时空多样化批采样策略以提升优化稳定性。此外，论文还发布了LetCamsGo数据集，用于评估稀疏动态相机下的4D重建性能。

Details

Motivation: 解决从稀疏动态相机（即少量独立移动相机）进行4D重建时，现有单目或密集固定相机方法因无法处理跨视图和时间的复杂时空不一致性而失效的问题，旨在实现低成本、实用的野外4D重建。

Result: 在提出的LetCamsGo真实世界视频数据集上，该方法在动态区域的4D重建质量优于基线方法，为野外低成本4D重建提供了新基准。

Insight: 创新点包括设计时空一致的3D轨迹初始化方法、噪声鲁棒的深度排序正则化损失和时空多样化批采样策略，这些策略有效提升了跨视图泛化和优化稳定性，为稀疏动态相机设置下的4D重建提供了可借鉴的解决方案。

Abstract: Although dynamic 3D (i.e., 4D) reconstruction from a monocular dynamic camera has recently advanced, it remains fundamentally limited by depth ambiguity. In this paper, we focus on an alternative practical way, i.e., sparse dynamic camera setup, where a handful of independently moving cameras capture the same subjects. While keeping capture costs low, this setup introduces multi-view constraints and remains practical for real-world video production such as sports, concerts, and TV shows. Despite its potential, our experiments show that naive extensions of existing monocular or dense-fixed camera-based methods are insufficient since they fail to resolve the complex spatiotemporal inconsistencies across views and time. To fill this gap, we propose a simple yet effective 3D track initialization method designed to ensure spatiotemporal consistency by integrating inter-camera feature matching with intra-camera point tracking. Additionally, we incorporate a noise-robust depth-ordering regularization loss and a spatiotemporally diverse batch sampling strategy to enhance optimization stability and cross-view generalization. Furthermore, to address the lack of standardized benchmarks for this task, we introduce LetCamsGo, a new real-world video dataset with 5 sequences across 4 diverse environments, recorded by three independently moving cameras and one fixed camera. Comprehensive benchmarking on LetCamsGo demonstrated that our proposed framework improves 4D reconstruction quality in dynamic regions compared with baselines, paving the way for a low-cost 4D reconstruction paradigm in the wild.

[68] Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization cs.CVPDF

Zhenliang Li, Yutao Hu, Qixiong Wang, Wenpeng Du, Hongxiang Jiang

TL;DR: 本文介绍了Impostor，一个用于AI生成内容（AIGC）图像篡改定位的高质量基准数据集，包含10万张篡改图像，由CraftAgent代理框架自动生成，以提高视觉真实性和多样性。同时，提出了PhaseAware-Net（PANet）语义-取证框架，通过局部相位建模和语义-取证一致性学习来更好地定位篡改区域。

Details

Motivation: 现有图像篡改检测与定位（IMDL）基准在视觉真实性、篡改多样性和生成器覆盖范围上存在局限，难以反映当前图像篡改趋势，因此需要构建更全面、真实的基准来应对AIGC篡改带来的新挑战。

Result: 实验表明，Impostor数据集对现有大型视觉语言模型（LVLMs）和专用IMDL方法构成了显著挑战，而PANet在Impostor和多个公共基准上取得了优越性能。

Insight: 创新点在于通过代理框架CraftAgent实现闭环自动生成高质量篡改图像，构建了覆盖多种AIGC模型和篡改类型的综合基准；提出的PANet框架结合局部相位建模和语义-取证一致性学习，增强了在语义合理但取证被破坏区域上的定位能力。

Abstract: Recent advances in generative image editing have improved the realism and controllability of localized image manipulation, raising new challenges for image manipulation detection and localization (IMDL). However, existing IMDL benchmarks still have limitations in visual realism, manipulation diversity, and generator coverage, making it difficult to reflect recent trends in image manipulation. To address these limitations, we introduce Impostor, a high-quality AI-edited image manipulation localization dataset containing 100K manipulated images. Impostor is constructed by CraftAgent, a closed-loop agent framework that integrates scene perception, editing planning, manipulation execution, quality validation, and iterative reflection to automatically generate diverse and visually realistic manipulated images. Moreover, Impostor contains images generated by seven recent AIGC models across three manipulation types and includes multiple manipulated regions, providing a more comprehensive benchmark for AIGC-based IMDL. Furthermore, we propose PhaseAware-Net (PANet), a semantic-forensic framework that introduces local phase modeling and semantic-forensic consistency learning to better localize semantically plausible yet forensically disrupted manipulated regions. Extensive experiments show that Impostor poses significant challenges to existing large vision-language models (LVLMs) and specialized IMDL methods, while PANet achieves superior performance on Impostor and multiple public benchmarks.

[69] COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations cs.CVPDF

Zixu Li, Yupeng Hu, Zhiwei Chen, Haokun Wen, Xuemeng Song

TL;DR: 本文提出了一种名为COMBINER的模型，用于解决组合图像检索任务中视觉相似但属性不同的样本所带来的挑战。该模型通过基于属性原型的统一表示、自适应语义解耦、统一原型组合以及双重关系建模模块，旨在更精确地理解样本间的语义关系。

Details

Motivation: 现有组合图像检索方法在处理视觉相似但属性不同的图像时存在不足，这影响了多模态特征融合和相似性建模的准确性。本文旨在解决属性级语义纠缠、模态间不一致性以及监督信号缺失这三个核心问题。

Result: 在三个基准数据集上的综合实验证实了COMBINER的有效性，表明其能够更准确地理解样本语义关系，但摘要未明确提及是否达到SOTA水平或与特定模型比较的具体定量结果。

Insight: 创新点在于首次针对视觉相似但属性无关的样本现象进行研究，并引入了基于属性原型的相似性度量来构建跨模态统一原型，从而改进对样本关系的建模。从客观角度看，其自适应语义解耦和双重关系建模方法为解决多模态检索中的细粒度差异提供了新思路。

Abstract: Composed Image Retrieval (CIR) represents a challenging retrieval task that targets locating specific images through multimodal inputs. Despite recent progress in CIR techniques, prior approaches often overlook cases where images appear visually alike yet differ in attributes, potentially undermining both multimodal feature fusion and similarity modeling. To mitigate this limitation, we design a unified representation of cross-modal features based on attribute prototypes. Nevertheless, the task is far from straightforward, owing to three core issues: (1) entanglement in attribute-level semantics, (2) inconsistency across modalities, and (3) supervised signal missing. To tackle the above obstacles, we introduce a COMposed image retrieval network guided By attrIbute-based NEighbor Relations (COMBINER). Specifically, we first design an Adaptive Semantic Disentanglement module, which is capable of disentangling attribute features based on multimodal primitive features. Secondly, we propose a Unified Prototype-based Composition module, which can construct cross-modal unified prototypes (CUP) and facilitate multimodal feature composition. Finally, we introduce a Dual Relations Modeling module, which can mine pairwise and neighbor relations based on attribute similarity. Compared to traditional neighbor relations modeling CIR methods, COMBINER represents the first study addressing the phenomenon of visually similar but attribute-unrelated samples. It achieves a more accurate understanding of the semantic relations among samples by employing an attribute prototype-based similarity metric. Comprehensive experiments conducted on three benchmark datasets confirm the effectiveness of our proposed COMBINER. The implementation of our method will be accessed at https://github.com/Lee-zixu/COMBINER

[70] Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain cs.CV | cs.LGPDF

Alessandro Gambetti, Qiwei Han, Cláudia Soares, Hong Shen

TL;DR: 本文针对医学领域视觉语言模型（VLMs）中模态不平衡问题，提出了一种非对称的谱对齐评分（SAS）作为诊断工具。该指标通过将两种模态投影到锚定模态的主特征基上，计算特征值加权的逐特征模式相关性，从而量化模态信息不平衡。研究在自然和医学图像-文本数据集上评估了15个VLMs，并与其他6种对齐指标和双向检索性能对比，发现SAS在医学领域与检索性能的零标签相关性最强，揭示了医学图像比配对的临床报告保留了更丰富的结构信息，而这一方向性不对称是现有对称指标无法捕捉的。

Details

Motivation: 现有视觉语言模型在医学图像-文本数据上表现不佳，但诊断其失败的工具有限；现有的表示对齐指标是对称的，将两种模态压缩为单一分数，隐藏了哪种模态导致了跨模态性能下降。

Result: 在自然和医学图像-文本数据集上评估了15个VLMs，SAS实现了与医学领域检索性能最强的零标签相关性，并揭示了医学图像比临床报告信息更丰富的不对称性，而所有竞争指标均无法检测到这一方向性不对称。

Insight: 创新点在于提出了一种非对称的谱对齐评分（SAS），能够量化模态信息不平衡，为医学VLMs的临床部署提供了实用的诊断工具；从客观角度看，该方法通过特征值加权和投影到主特征基，有效揭示了模态间的方向性差异，弥补了现有对称指标的不足。

Abstract: Vision-Language Models (VLMs) struggle when applied to medical image-text data, yet the tools available to diagnose this failure remain limited. Existing representation alignment metrics are symmetric, collapsing both modalities into a single score and hiding which modality drives cross-modal degradation. We introduce the Spectral Alignment Score (SAS), an asymmetric metric that projects both modalities onto the principal eigenbasis of an anchor modality and computes eigenvalue-weighted per-eigenmode correlations, resulting in directional scores whose difference quantifies modality information imbalance. We embed SAS within a benchmarking framework evaluating 15 VLMs across natural and medical image-text datasets alongside 6 alignment metrics and bidirectional retrieval. Our experiments show that medical images retain richer structural information than their paired clinical reports, a directional asymmetry invisible to all competing metrics, and that SAS achieves the strongest zero-label correlation with retrieval performance in the medical domain, positioning it as a practical diagnostic tool for clinical deployment. Code is available at this URL: https://github.com/iamalegambetti/medical-vlms-assessment.

[71] Real-Time Automatic License Plate Recognition Using YOLOv8, SORT Tracking, and Temporal Data Interpolation cs.CV | cs.AIPDF

Mirza Muhammad Mobeen

TL;DR: 本文提出了一种基于YOLOv8、SORT跟踪和时间数据插值的五阶段端到端实时自动车牌识别（ALPR）算法流程。该方法旨在解决动态交通监控场景中，因光照变化、高速运动等因素导致的跟踪断裂和OCR识别率低的问题，通过车辆检测、车牌检测、SORT跟踪、EasyOCR识别及时间插值等步骤提升系统鲁棒性。

Details

Motivation: 解决动态交通监控中实时视频处理面临的挑战，如剧烈光照变化、高速车辆运动、严重遮挡等非受控变量导致的车牌跟踪路径断裂和光学字符识别（OCR）率低下问题。

Result: 论文未在摘要中提供具体的定量实验结果（如准确率、FPS）或基准测试对比，但宣称所提出的端到端流程能够缓解上述弱点，实现高保真度的车牌识别。

Insight: 创新点在于将基于深度学习的物体检测（YOLOv8）、运动学多目标跟踪（SORT）与几何时间数据插值机制平滑集成，形成一个协同管道；特别是引入离线时间边界框插值来重建断裂的跟踪轨迹，以提升在动态恶劣条件下的系统连续性。

Abstract: The real-time hardships of video processing seriously limit the usage of Automatic License Plate Recognition (ALPR) with application in dynamic traffic monitoring settings. High-fidelity recognition of unconstrained variables, e.g. drastic variations in illumination, acute camera scans, high vehicle speeds, and harsh physical concealment, is a problem that often leads to disjointed tracking paths and poor Optical Character Recognition (OCR) rates. In order to mitigate these weaknesses, the study proposes a 5 stage, end-to-end algorithmic pipeline, encompassing a smooth transition between deep learning based object detection, multi-object tracking which is kinematic in nature, and geometry temporal data interpolation. The suggested architecture takes advantage of a very powerful YOLOv8 nano model to localize the vehicle at the first stage and then Simple Online and Realtime Tracking (SORT) algorithm is used to build spatial-temporal links between frames. Another, more specific typology of YOLOv8 object detectors the license plate area, channeling the sliced array to an EasyOCR chain under the limitations of positional syntax verification. More importantly, an offline interpolation mechanism of temporal bounding box is initiated to recast fragmented paths.

[72] ReConFuse: Reconstruction-Error Guided Semantic Fusion for AI-Generated Video Detection cs.CVPDF

Xiaojing Chen, Xinyu Lu, Changtao Miao, Yunfeng Diao

TL;DR: 本文提出ReConFuse框架，用于检测AI生成的视频。该方法利用预训练的WF-VAE重构输入视频，发现真实视频与生成视频在逐帧重构误差上存在可区分的模式。ReConFuse提取重构误差线索，将其与多帧语义特征对齐，并采用基于Mamba的模块建模时序演化，最终实现视频级别的分类。

Details

Motivation: AI生成的视频日益逼真，引发了关于虚假信息、内容真实性和媒体信任的严重担忧。可靠的AI生成视频检测对于多媒体取证至关重要，但由于需要捕捉空间伪影、时序动态，并能泛化到不断演进的生成模型，该任务仍具挑战性。

Result: 在多个生成器和评估设置上的实验证明了ReConFuse的有效性和强大的泛化能力。

Insight: 核心创新在于将重构误差作为判别性取证线索引入视频检测领域，并提出了一个重构引导的语义融合框架。具体而言，该方法揭示了视频重构误差的时序组织特性，并通过与语义特征对齐及Mamba模块建模，有效解决了从基于重构的图像检测扩展到视频检测的挑战。

Abstract: AI-generated videos are becoming increasingly realistic, raising serious concerns about misinformation, content authenticity, and media trust. Reliable AI-generated video detection is therefore essential for multimedia forensics, yet remains challenging due to the need to capture spatial artifacts, temporal dynamics, and generalize to evolving generative models. In this paper, we explore reconstruction error as a discriminative forensic cue for AI-generated video detection. By reconstructing input videos with a pretrained WF-VAE, we observe that real and generated videos exhibit distinguishable frame-wise reconstruction error patterns, suggesting that reconstruction errors can reveal their distributional discrepancies. However, extending reconstruction-based image detection to videos is non-trivial, since video reconstruction errors are temporally organized across frames and require semantic context for effective interpretation. To address these challenges, we propose ReConFuse, a reconstruction-guided semantic fusion framework for video-level AI-generated video detection. ReConFuse extracts reconstruction error cues from WF-VAE reconstructed videos, aligns them with multi-frame semantic features, and uses a Mamba-based module to model temporal evolution for video-level classification. Experiments across multiple generators and evaluation settings demonstrate the effectiveness and strong generalization ability of ReConFuse.

[73] Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms cs.CV | cs.CLPDF

Jiashu Yao, Heyan Huang, Daiqing Wu, Wangke Chen, Huaxi Ai

TL;DR: 该论文提出了Living-Screen-Native GUI智能体这一新任务，旨在处理短视频平台等动态界面，其中内容在智能体操作间持续播放。为此，研究团队构建了首个基准LivingScreen，包含基于浏览器的真实环境、三层任务套件以及兼顾准确性和信息效率的评估指标。通过对前沿模型进行广泛评估，发现它们均未达到人类的成本-准确率性能，主要失败模式是过度观察和观察不足，这表明观察控制是未来GUI智能体需要发展的关键能力。

Details

Motivation: 当前GUI智能体通常假设屏幕在两次操作间是静态的，但短视频应用等真实界面内容会持续播放，用户需要决定观看内容和时长，现有智能体无法处理这种动态环境。

Result: 在LivingScreen基准上评估了多种前沿模型，发现没有模型能达到人类的成本-准确率性能水平，主要失败原因是观察控制不当（过度观察或观察不足）。

Insight: 创新性地形式化了Living-Screen-Native GUI智能体任务，并构建了首个针对短视频平台动态界面的基准测试套件，揭示了观察控制是当前GUI智能体能力的一个关键缺失维度，为未来研究指明了方向。

Abstract: GUI agents today assume a static screen, where the world is frozen between two actions. However, real interfaces such as short-video applications violate this assumption, as their content keeps playing, and a competent user must decide what to watch and for how long. We formalize this task as Living-Screen-Native GUI agents and introduce LivingScreen, the first benchmark instantiating it on short-video platforms, with a faithful browser-based environment, a three-tier task suite, and metrics that jointly score accuracy and information efficiency. Evaluating extensive frontier models, we find that none reaches the human cost-accuracy performance, and that their dominant failure mode is over- and under-observation, pointing to observation control as a missing capability axis for future GUI agents. All data and code will be available at https://github.com/BITHLP/LivingScreen.

[74] Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment cs.CVPDF

Cong Wang, Hanxin Zhu, Jiayi Luo, Yonglin Tian, Xiaoqian Cheng

TL;DR: 本文提出PILA框架，通过混合专家潜在对齐将物理结构化的潜在指导注入预训练视频生成模型的流匹配动力学中，以提升生成视频的物理合理性。该方法利用锚定场估计将潜在空间映射到物理属性库，并通过类别特定的专家路由和操作残差正则化来优化物理代理，最终在保持视觉先验的同时注入物理感知指导。

Details

Motivation: 现有大规模视频生成模型在语义一致性和视觉质量上取得显著进展，但像素级拟合导致的动态难以适应真实世界运动和交互的规律，导致物理合理性存在持续缺陷。

Result: 通过在Wan 2.1-1.3B上进行分阶段适配器训练，并将学习到的适配器直接迁移到Wan 2.2-14B，PILA在VBench-2.0、VideoPhy-2和PhyGenBench基准测试中，在视觉质量和基准测量的物理合理性方面均达到了最先进水平。

Insight: 创新点包括：1）通过锚定场估计构建物理属性库，将可观测运动作为运动学锚点来构建间接观测的代理；2）采用混合专家设计处理真实世界动态的异质性，通过标签先验掩码专家路由选择类别特定操作专家；3）利用从物理关系中抽象出的操作残差正则化专家细化，并将优化后的代理融合到属性库中，解码为对流匹配向量场的校正，从而在保持预训练主干视觉先验的同时注入物理感知指导。

Abstract: Large-scale video generation models have made remarkable progress in semantic consistency and visual quality, producing videos that are increasingly coherent and visually convincing. Nevertheless, the dynamics induced by pixel-level fitting do not naturally accommodate the regularities that govern real-world motion and interaction, resulting in persistent shortcomings in physical plausibility. To address this limitation, we propose \textbf{PILA} (Physics-Informed Latent Alignment), a framework that injects physics-structured latent guidance into the frozen flow-matching dynamics of pretrained video models. Specifically, PILA first employs anchored field estimation to map frozen-generator latents into an operational physical attribute bank organized by field-proxy slots, using observable motion as a kinematic anchor for constructing less directly observed proxies. To handle the heterogeneity of real-world dynamics, PILA adopts a mixture-of-experts design over physical categories. Label-prior masked expert routing selects category-specific operator experts, whose refinements are regularized by operational residuals abstracted from physical relations. Finally, the refined proxies are fused into the physical attribute bank and decoded into a correction to the flow-matching vector field, injecting physics-aware guidance while preserving the visual prior of the pretrained backbone. With staged adapter training on Wan 2.1-1.3B and direct transfer of the learned adapter to Wan 2.2-14B, PILA achieves state-of-the-art results on VBench-2.0, VideoPhy-2, and PhyGenBench in both visual quality and benchmark-measured physical plausibility.

[75] Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction cs.CV | cs.AIPDF

Hoang-Son Vo, Van-Hung Bui, Minh-Huy Mai-Duc, Tien-Dung Mai, Soo-Hyung Kim

TL;DR: 本文提出了一种名为CHASMBrain的新型分层两阶段框架，用于从图像到功能磁共振成像（fMRI）的编码任务。该框架采用由粗到精的策略，利用双流Mamba设计分别处理全局语义标记和局部空间图像块，以模拟视觉皮层的功能组织。在自然场景数据集（NSD）上的实验表明，该方法在预测大脑活动方面超越了现有基线模型。

Details

Motivation: 研究动机在于探索深度视觉表征与人类视觉系统之间的关系，特别是现代视觉模型与人类视觉皮层分层组织之间的对应性，这是一个计算神经科学中的基本挑战。

Result: 在自然场景数据集（NSD）上，该方法取得了皮尔逊相关系数0.429和均方误差0.261的结果，超越了包括岭回归和DINOv2线性探针在内的所有评估基线。因果分支消融实验进一步揭示了模型分支与大脑区域之间的特异性对应关系。

Insight: 论文的创新点在于提出了一个结合了由粗到精策略和双流Mamba设计的层次化架构，用于图像到fMRI的编码。从客观角度看，其将全局语义与局部空间信息分离处理的设计，以及对模型因果关系的验证，为理解计算模型与神经表征的对应关系提供了新的方法和见解。

Abstract: Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organization of the human visual cortex remains an open question. In this study, we propose CHASMBrain, a novel hierarchical two-stage framework for image-to-fMRI encoding. Our architecture leverages a dual-stream Mamba design to explicitly separate and process global semantic tokens and local spatial patches, motivated by the functional organization of the visual cortex. A coarse-to-fine strategy is employed: Stage 1 predicts denoised ROI-level activations, while Stage 2 refines these coarse responses into full voxel-level predictions using a Mamba-VAE. Experiments on the Natural Scenes Dataset (NSD) demonstrate that our method achieves a Pearson correlation of 0.429 and an MSE of 0.261, outperforming all evaluated baselines including ridge regression and DINOv2 linear probes. Beyond predictive performance, causal branch-ablation experiments reveal an asymmetric specialization: the patch stream is specifically locked to early visual cortex (retinotopic regions), while the CLS stream contributes broader semantic context to higher-order areas – a correspondence that holds causally, not merely correlationally. Cross-subject transfer experiments further show that the learned backbone generalizes across individuals with minimal per-subject adaptation, suggesting the model captures a shared, subject-agnostic visual representation.

[76] Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives cs.CV | cs.ROPDF

Ayumi Umemura, Toshinori Kuwahara, Marc Pollefeys, Daniel Barath

TL;DR: 本文提出了一种名为Z-FLoc的零样本平面图定位方法，该方法通过提取单目3D重建的鸟瞰图投影中的几何基元（如直线和圆），并利用专用的最小求解器在鲁棒估计框架内将其与平面图进行匹配，从而在无需重新训练的情况下泛化到新环境。

Details

Motivation: 视觉定位是计算机视觉中的基础问题，平面图作为一种地图表示形式，虽然易于获取且对视觉外观变化具有不变性，但相机观测与平面图几何之间存在严重的领域鸿沟。现有基于数据驱动学习的方法需要大规模训练数据和特定环境的重新训练，限制了实际部署。

Result: 在模拟和真实世界数据集上的实验表明，该方法在未见环境中的表现优于当前最先进的基于学习的方法，并且所有实验均使用一组固定的超参数。

Insight: 核心创新点在于利用人造环境中普遍存在的几何基元（直线和圆）作为外观不变的结构约束，通过零样本方式桥接领域鸿沟，避免了数据驱动方法对大规模训练和重新训练的依赖，提高了方法的通用性和实用性。

Abstract: Visual localization – estimating a camera pose within a pre-existing map – is a fundamental problem in computer vision. Floorplans are an attractive map representation: they are readily available for most buildings, compact, and inherently invariant to visual appearance changes. However, bridging the severe domain gap between camera observations and floorplan geometry remains challenging. Existing methods address this gap through data-driven learning, yet they require large-scale training data and environment-specific retraining, limiting their practical deployment. We propose a zero-shot floorplan localization method that generalizes to novel environments without any retraining. Our key insight is that dominant geometric primitives – lines and circles – are ubiquitous in human-made environments and provide appearance-invariant structural constraints. We extract these primitives from a bird’s-eye-view (BEV) projection of monocular 3D reconstructions and match them to the floorplan via dedicated minimal solvers within a robust estimation framework. Experiments on both simulated and real-world datasets show that our approach outperforms state-of-the-art learning-based methods on unseen environments, while using a single fixed set of hyperparameters across all experiments. The source code will be made publicly available.

[77] NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models cs.CV | cs.CLPDF

Yong Cao, Chuqiao Li, Xianghui Xie, Gerard Pons-Moll, Andreas Geiger

TL;DR: 论文提出了NextMotionQA基准，用于评估视觉语言模型在人体运动理解方面的能力。该基准包含多项选择题、视频描述和细粒度错误纠正三个任务，并系统性地构建了三个语义轴和三个难度级别。通过评估12个代表性VLM，揭示了传统单任务评估无法发现的模型能力差距和弱点。

Details

Motivation: 现有的人体运动理解基准存在语义粒度粗、难度未区分、标注质量有限和答案模糊等问题，无法有效诊断当前模型的失败之处，因此需要构建一个更全面、可靠的评估基准。

Result: 在NextMotionQA基准上评估了12个代表性VLM，发现了传统评估方法无法揭示的关键能力差距。同时，研究发现VLM在粗粒度标准上与专家评分高度一致（Cohen’s κ=0.70），但在细粒度、部件级判断上表现不佳（κ=0.10）。

Insight: 创新点在于构建了一个系统化、多任务、多难度级别的半自动化专家验证基准，能够更全面地评估VLM的人体运动理解能力。客观分析认为，该研究不仅提供了新的评估工具，还揭示了VLM作为评估者在不同粒度任务上的性能边界，对推动具身AI和机器人学发展具有借鉴意义。

Abstract: Reliable evaluation of human motion understanding is fundamental to advancing embodied AI, robotics, and animation. However, existing benchmarks suffer from coarse semantic granularity, undifferentiated difficulty, limited annotation quality, and pervasive answer ambiguity, leaving them unable to diagnose where current models fail. To bridge this gap, we introduce NextMotionQA, a comprehensive benchmark that leverages vision-language models (VLMs) for semi-automated, expert-verified dataset. NextMotionQA features three complementary tasks: multiple-choice question answering, video captioning, and fine-grained error correction. Each task is systematically structured across three core semantic axes and stratified into three task complexity levels. Our extensive evaluation of twelve representative VLMs uncovers critical capability gaps and weakness that remain invisible under conventional, single-task evaluations. In a complementary direction, recent work has begun using VLMs as judges for text-to-motion evaluation; we ask whether they show the same degradation under harder tasks. We find that VLMs align strongly with expert ratings on coarse criteria (Cohen’s κ=0.70) but break down on fine-grained, part-level judgment (κ=0.10), validating the paradigm in its strong regime while clarifying its limits.

[78] NoRA: Evaluating Grounded Reasonableness in Visual First-person Normative Action Reasoning cs.CV | cs.AIPDF

Sichao Li, Sai Ma, Daniel Kilov, Secil Yanik Guyot, Zhuang Li

TL;DR: NoRA是一个视觉第一人称视频基准测试，用于评估模型在生成合理行动并基于可见事实提供可解释理由的能力。该基准包含1,420个标注视频片段，要求模型生成候选行动并通过事实-理由-行动支持图进行论证。

Details

Motivation: 现有方法仅评估文本规范性判断或将行动选择限制在固定候选集中，无法反映真实场景中智能体需从零开始基于可见事实识别合理行动的需求。

Result: 在12个多模态系统上的测试表明，当前视觉语言模型能恢复合理行动和相关场景事实，但难以构建完整的合理行动空间并将行动与正确的局部支持绑定。

Insight: 创新点在于引入可测量的‘基于事实的合理性’评估框架，通过支持图将行动生成与显式推理过程结合，推动评估重点从‘能否选择行动’转向‘能否为正确可见理由辩护合理行动’。

Abstract: LLMs and agentic systems are increasingly deployed in social environments, making normative competence critical for safe and appropriate behavior. However, existing approaches either assess normative judgment in text alone or reduce it to choosing among a fixed set of candidate actions. We argue both are insufficient. In practice, agents are never handed a menu of options; they must identify a reasonable action from scratch, grounded in visible facts and supported by inspectable reasons. We introduce NoRA, a visual first-person video benchmark that requires models to generate candidate next actions and justify each through an explicit fact-reason-action support graph. The benchmark comprises 1,420 annotated video clips, including HumanGold-190 and LLMSilver-1230 splits. Each instance is evaluated through action alignment, factual grounding, and support binding, aggregated into a single grounded reasonableness score. We benchmark 12 multimodal systems under direct, deliberate, and structured prompting regimes, finding that current VLMs frequently recover plausible actions and relevant scene facts, but consistently struggle to construct the full reasonable action space and bind selected actions to the correct local support. NoRA makes this gap measurable, shifting the evaluation question from whether a model can pick an action to whether it can justify an appropriate action for the right visible reasons.

[79] Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation? cs.CVPDF

Rui Zhao, Kaiming Yang, Jifeng Zhu, Siyang Chen, Ziqi Wang

TL;DR: 论文提出了Dream.exe评估框架，用于测试视频生成模型是否能够生成可执行的机器人操作动作。该框架通过将生成的视频转换为机器人轨迹并在物理模拟器中执行，从而衡量模型对物理世界的理解程度。

Details

Motivation: 研究动机是探究视频生成模型在虚拟内容合成之外，是否真正内化了物理规律，其生成的运动能否转化为现实世界中可执行的机器人行为。

Result: 在涵盖101个手动策划的、具有三个物理复杂度级别的操作任务基准测试中，评估了8个模型（包括前沿闭源生成器、开源生成器和机器人专用模型）。多个模型取得了可测量的执行成功率，表明从互联网规模数据中学到的生成先验已经编码了有意义的物理知识。

Insight: 创新点在于提出了一个将视觉生成与物理可执行性联系起来的评估框架，揭示了视觉质量是执行成功率的较差预测指标，这暴露了标准视觉评估无法捕捉的模型能力维度。

Abstract: Video generation models have made impressive strides in synthesizing visually compelling content, yet their outputs remain confined to the virtual domain. A natural question follows: how well do these models reflect the physical world when their generated videos leave the screen and enter reality? We propose robotic manipulation as a concrete, measurable window onto this question: if a model has truly internalized physical laws, the motion it depicts should translate into executable robot behavior. We introduce Dream.exe, an evaluation framework that operationalizes this criterion through a video-to-execution pipeline. Given a scene image and a task description, Dream.exe synthesizes a manipulation video, converts the generated motion into robot trajectories, and executes them in a physics simulator, yielding a grounding signal that purely visual metrics cannot offer. Using this pipeline, we evaluate 8 models spanning frontier closed-source generators, open-source generators, and robot-specific models. Our benchmark covers 101 manually curated manipulation tasks at three levels of physical complexity, measured across visual quality, trajectory fidelity, and execution success. Encouragingly, several models achieve measurable execution success, suggesting that generative priors learned from internet-scale data already encode meaningful physical knowledge. Yet visual quality proves a poor predictor of executability, exposing a dimension of model capability that standard visual evaluations do not capture. Dream.exe will be open-sourced at https://github.com/showlab/Dream.exe.

[80] MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU cs.CV | cs.CL | cs.LGPDF

Kun Cheng, Songshuo Lu, Sicong Liao, Tankun Li, Yafei Zhang

TL;DR: MusaCoder是一个用于在CUDA和MUSA后端生成原生GPU内核的全栈训练框架。它通过渐进式内核导向数据合成、保持多样性的拒绝微调以及基于执行反馈的强化学习（通过MooreEval分布式验证器）来解决现有LLM在此任务上的不足和传统RL训练的不稳定性问题。

Details

Motivation: 解决现有大型语言模型在将高级张量程序转换为高效可执行低级GPU内核代码时表现不佳的问题，以及基于执行的强化学习方法存在的奖励稀疏、奖励黑客攻击和训练不稳定等挑战。

Result: 在KernelBench基准测试及其MUSA移植变体上，MusaCoder在正确性和实际加速比方面均优于强大的开源和专有基线模型。其中9B模型匹配或超越了前沿闭源模型，27B模型则创造了新的SOTA（state-of-the-art）水平。

Insight: 创新点包括：1）全栈执行反馈训练框架，整合了数据合成、微调和RL；2）为稳定RL训练引入了PrimeEcho（首轮锚定多轮奖励）、Buffered Dynamic Retry（从全失败硬样本中恢复信号）和MirrorPop（离策略序列过滤）等技术；3）证明了新兴加速器（如Moore Threads GPU）能够支持完整的LLM后训练流程，为大型模型训练和优化提供了实践基础。

Abstract: Native GPU kernel generation turns high-level tensor programs into executable, efficient low-level code. Existing Large Language Models (LLMs) struggle with this task, while execution-based reinforcement learning suffers from sparse rewards, reward hacking, and training instability. We present MusaCoder, a full-stack training framework for native GPU kernel generation on CUDA and MUSA backends. MusaCoder combines progressive kernel-oriented data synthesis, diversity-preserving rejection fine-tuning, and execution-feedback Reinforcement Learning (RL) through MooreEval, a distributed verifier and reward environment. To stabilize RL, MusaCoder introduces PrimeEcho for first-turn-anchored multi-turn rewards, Buffered Dynamic Retry for recovering signals from all-failed hard samples, and MirrorPop for off-policy sequence filtering. Experiments on KernelBench and a MUSA-ported variant show that MusaCoder outperforms strong open-source and proprietary baselines in both correctness and empirical speedup, with the 9B model matching or exceeding frontier closed-source models and the 27B model establishing a new state of the art. These results demonstrate not only the effectiveness of full-stack execution-feedback training for native kernel generation, but also the capability of Moore Threads GPUs to support the complete LLM post-training stack, providing a practical foundation for large-model training and optimization on emerging accelerators.

[81] 3D Temporal Analysis for Autism Spectrum Disorder Screening During Attention Tasks cs.CVPDF

Inam Qadir, Elizabeth B Varghese, Dena Al-Thani, Marwa Qaraqe

TL;DR: 本研究提出了一种基于3D建模框架DECA的新型3D时序分析框架，用于在注意力任务期间对学龄儿童进行自闭症谱系障碍（ASD）筛查。该框架从视频数据中提取与姿态无关的头部姿态参数和面部表情作为3D特征，并利用LSTM和GRU时序分类器进行分析。结果表明，基于GRU的模型性能最佳，3D头部姿态特征和面部特征的分类准确率分别达到83.9%和81.4%，均显著优于2D基线方法。

Details

Motivation: 当前ASD筛查依赖主观评估和2D分析方法，无法捕捉ASD行为特征的空间位移模式。本研究旨在开发一种客观、自动化的筛查工具，以解决学龄儿童ASD诊断中存在的局限性。

Result: 在从39名参与者（19名ASD，20名典型发育）在虚拟现实连续性能测试任务中收集的视频数据上，基于GRU的模型表现最优。3D头部姿态特征准确率达83.9%，3D面部特征准确率达81.4%，分别比2D基线方法高出10.7%和7.5%。通过基于PCA降维的多模态融合（3D头部姿态与面部特征）实现了最高准确率84.6%，优于单模态方法。

Insight: 论文的创新点在于将3D建模框架DECA用于ASD筛查，提取与姿态无关的3D时序特征（头部位移和面部表情），并利用时序模型（LSTM/GRU）进行分析。从客观角度看，该方法通过3D时空分析捕捉了传统2D方法忽略的行为模式，并结合多模态特征融合进一步提升性能，为开发客观的自动化诊断工具提供了新思路。

Abstract: Accurate Autism Spectrum Disorder (ASD) screening for school-age children is crucial to identify cases that may have been missed earlier and to enable timely interventions supporting social, cognitive, and academic development. Current ASD screening relies on subjective assessments and 2D analysis methods that fail to capture spatial displacement patterns characteristic of ASD behaviors. In this study, a novel 3D temporal analysis framework is presented, built on top of DECA (Detailed Expression Capture and Animation), a 3D modeling framework, to extract comprehensive head pose parameters (including translational components $T_x, T_y, T_z$) and facial expressions independent of pose variations. LSTM and GRU-based temporal classifiers were trained on the extracted 3D features from video data collected from 39 participants (19 ASD, 20 TD) aged 7-12 years during Virtual Reality-Continuous Performance Test tasks. The GRU-based models demonstrated superior performance, with 3D head pose features achieving 83.9% accuracy and 3D facial features reaching 81.4% accuracy, outperforming 2D baseline approaches by 10.7% and 7.5%, respectively. Furthermore, multimodal fusion of 3D head pose and facial features with PCA-based dimensionality reduction achieved the highest accuracy of 84.6%, outperforming unimodal approaches. This work establishes a foundation for objective, automated screening tools addressing current diagnostic limitations in ASD identification for school-age populations.

[82] Recent Advances and Trends in Learning-based 3D Representations cs.CVPDF

Adrien Schockaert, Hamid Laga, Hazem Wannous, Vincent Magnier, Guillaume Dufaye

TL;DR: 本文是一篇关于学习型3D表示方法的综述论文，系统回顾了从传统显式表示（如网格、点云）到新兴隐式表示（如神经辐射场、3D高斯泼溅）的演变。论文分析了各类表示方法的原理、变体、优缺点及关键应用，并特别强调了向隐式表示的范式转变及其对3D/4D工作流的根本性影响。

Details

Motivation: 3D表示的选择是计算机视觉与图形学流程的核心设计决策，直接影响任务效率与质量。传统表示虽广泛使用，但新兴的神经与基元表示提供了紧凑、可微的替代方案，本综述旨在系统梳理这一演进脉络，填补现有综述对表示本身演变分析不足的空白。

Result: 作为综述论文，未报告具体定量结果，但全面对比了各类表示在3D重建、新视角合成、渲染、识别与生成等任务中的性能与适用性，并指出隐式表示在紧凑性和可微分性上的优势推动了其在游戏、AR/VR、自动驾驶等领域的应用。

Insight: 创新点在于聚焦3D表示本身的演进，而非广义的重建任务，首次系统阐述了向隐式表示的范式转变如何从根本上改变3D/4D工作流，为未来研究提供了以表示为中心的新视角。

Abstract: The selection of an appropriate 3D representation is a fundamental design decision that dictates the efficiency, quality, and capabilities of modern computer vision and graphics pipelines for tasks such as 3D reconstruction, novel-view synthesis and rendering, shape and motion analysis, recognition, and generation. While traditional representations (\eg meshes, point clouds, and volumetric grids) remain standard outputs of 3D sensors (\eg LiDAR and 3D scanners) and are widely used in downstream applications (\eg editing and simulation), recent neural and primitive-based representations (\eg 3D Gaussian Splatting) offer compact and differentiable alternatives opening a wide range of opportunities in applications such as games, AR/VR, autonomous driving, robot navigation, and medical imaging, to name a few. The goal of this paper is to survey the main families of 3D representations from discrete explicit formats to continuous implicit fields based either on neural rendering or primitive splatting. For each type of representation, we present the general formulation and its variants, discuss its benefits and limitations, and highlight key applications. We conclude the paper by outlining the open challenges and potential directions for future research. Distinct from recent surveys that broadly cover 3D object and scene reconstruction, this paper provides a focused analysis on the evolution of 3D representations themselves. We specifically emphasize the paradigm shift toward implicit representations, offering a novel perspective on how these emerging formats fundamentally alter 3D/4D workflows.

[83] MAOAM: Unified Object and Material Selection with Vision-Language Models cs.CVPDF

Jaden Park, Valentin Deschaintre, Jason Kuen, Kangning Liu, Iliyan Georgiev

TL;DR: MAOAM是一个统一的视觉-语言模型选择框架，支持通过文本或点击交互精确选择图像中的对象和材料。它利用带分割头的VLM从用户提示生成像素级掩码，并通过多任务训练解决材料选择数据缺乏的问题，实现了灵活的图像编辑工作流。

Details

Motivation: 现有基于VLM的选择方法主要关注对象且通常只支持单一交互模态，无法满足材料选择（如重新纹理化）的需求，限制了实际应用。

Result: 实验表明，MAOAM在多样化的对象、材料和交互场景中实现了准确且连贯的选择，展现了实际应用的鲁棒性。

Insight: 创新点包括统一的对象与材料选择框架、利用VLM生成材料描述以构建数据集的流水线，以及多任务训练带来的跨模态协同效应（文本与点击结合在推理时提升选择效果）。

Abstract: Selection is a core operation in interactive image editing. To be practical, a user should be able to specify and disambiguate the desired selection region through either text or click-based interactions, and the system should support selecting not only objects but also other criteria, such as materials. Material-based selection is valuable for tasks like re-texturing surfaces or editing instances of a specific material. However, existing vision-language-model (VLM) based selection methods are object-centric and typically support a single interaction modality, limiting their applicability. In this work, we thus present Mask Any Object And Material (MAOAM), a unified selection framework that enables precise object and material-level selection across both text- and click-based interactions. MAOAM leverages a VLM with a segmentation head to produce pixel-accurate masks from user prompts: the VLM interprets the user’s selection intent (object or material-level) and encodes visual entities, attributes, and spatial relations, while the segmentation head decodes the output token into a mask. A key challenge is the lack of material selection datasets with text annotations. We propose a scalable data generation pipeline: we collect real and synthetic images with material masks, and leverage VLMs to generate material descriptions with rich visual-semantics. We train MAOAM with a multi-task objective over click and text-based selection, along with an auxiliary VQA task derived from the material descriptions to facilitate deeper material understanding. Despite being trained with uni-modal prompts, our model exhibits an emergent improvement in selection when combining text and clicks at inference, enabling flexible image editing workflows. Experiments demonstrate accurate and coherent selections across diverse objects, materials, and interaction scenarios, highlighting robustness in practice.

[84] Hierarchical Space Partition for Surface Reconstruction cs.CV | cs.CGPDF

Minjie Tang, Xiangfei Li

TL;DR: 该论文提出了一种基于层次空间划分的表面重建方法，旨在从点云生成紧凑的多边形模型。该方法通过将场景中的平面分类为高度可见、勉强可见和不可见三类，并基于优先级进行平面生长和层次划分，以恢复缺失的细节。最后通过基于最小割的优化生成水密多边形网格，在公共数据集上验证了其有效性和优越性。

Details

Motivation: 解决LiDAR扫描因距离限制和遮挡导致关键场景信息缺失，从而降低重建精度的问题，同时保持模型的紧凑性。

Result: 在公共数据集上的比较表明，该方法在恢复缺失细节和保持模型紧凑性方面优于主流方法，实现了有效的表面重建。

Insight: 创新点在于将平面按可见性分类并赋予生长优先级，通过层次空间划分和基于最小割的优化来恢复缺失结构，可借鉴于其他3D重建任务中处理不完整数据。

Abstract: Generating compact polygonal models from point clouds is a key problem in 3D vision and computer graphics. However, due to inherent limitations of LiDAR scanning (e.g. range constraints and occlusions), critical scene information is often missing, leading to degraded reconstruction accuracy. To address this, we propose a plane assembling strategy that effectively recovers missing details while maintaining model compactness. We classify all the planes extracted from the scene into three categories: highly visible, barely visible, and invisible. The invisible planes, which are recovered by scene structure analysis, indicate the missing details. The three types of planes correspond to the three growth priorities. Each plane grows according to the priority level, and the space is partitioned progressively, namely, the hierarchical partition. Subsequently, we generate a watertight polygonal mesh from the partition via a min-cut-based optimization. Finally, comparisons on public datasets show the effectiveness and superiority of our method against mainstream approaches. The project page is available at https://hsr-3dv.github.io/.

[85] Scene-Centric Unsupervised Video Panoptic Segmentation cs.CVPDF

Christoph Reich, Oliver Hahn, Nikita Araslanov, Laura Leal-Taixé, Christian Rupprecht

TL;DR: 本文提出了首个无监督视频全景分割（VPS）方法VideoCUPS，通过利用无监督深度、运动和视觉线索从场景中心视频生成时间一致的伪标签，并采用新颖的Video DropLoss进行训练，实现了无需人工标注的准确VPS模型。

Details

Motivation: 现有无监督场景理解工作主要集中于图像分割任务，视频领域尚未充分探索，因此本文旨在解决无监督视频全景分割这一新任务，以填补研究空白。

Result: VideoCUPS在提出的全面评估协议和四个竞争基线中表现优于所有基线，展示了强大的标签高效学习能力，为无监督VPS提供了坚实基础。

Insight: 创新点在于首次将无监督学习扩展到视频全景分割，通过结合深度、运动和视觉线索生成伪标签，并引入Video DropLoss来提升模型性能，为未来研究提供了新方向。

Abstract: Video panoptic segmentation (VPS) aims to jointly detect, segment, and track all objects while partitioning the video into semantically consistent regions. We introduce the task setting of unsupervised VPS, omitting any human supervision. Existing unsupervised scene understanding works mainly focused on image segmentation tasks; the video domain remains underexplored. We propose VideoCUPS, the first unsupervised VPS approach. VideoCUPS generates temporally consistent panoptic video pseudo-labels from scene-centric videos by exploiting unsupervised depth, motion, and visual cues. Training on these pseudo-labels using a novel Video DropLoss yields an accurate, unsupervised VPS model. To benchmark progress, we introduce a comprehensive evaluation protocol and four competitive baselines, extending state-of-the-art unsupervised panoptic image and instance video segmentation models to VPS. VideoCUPS outperforms all baselines and demonstrates strong label-efficient learning. With VideoCUPS, our evaluation protocol, and baselines, we provide a strong foundation for future research on unsupervised VPS.

[86] Geometry-Aware Distillation for Prompt Tuning Biomedical Vision-Language Models cs.CV | cs.AI | cs.LGPDF

Tran Dinh Tien, Zhiqiang Shen

TL;DR: 本文提出了Omni-Geometry Knowledge Distillation (OGKD)框架，用于改进生物医学视觉语言模型（VLM）的提示调优。该方法通过将类别关系结构注入教师模型，生成保留真实标签并尊重类间几何关系的定向目标，并设计了全局几何感知蒸馏（GAD）和标签引导几何蒸馏（LGD）两种损失函数，以提升模型在有限监督下的性能与稳定性。

Details

Motivation: 现有基于提示或适配器的VLM调优方法在医学影像中通常只优化真实类别，将所有其他类别视为同等错误，忽略了临床上有意义的类别关系，导致在有限监督下决策边界不稳定。

Result: 在11个广泛使用的医学数据集上进行的基础到新类别以及少样本评估的综合实验中，OGKD取得了显著更好的性能，平均绝对准确率比所有先前最先进的VLM适应方法提高了1.7%-2.8%，并展现出对未见类别的鲁棒泛化能力和更可靠的预测。

Insight: 创新点在于将类别几何关系（而非简单的独热标签）作为知识蒸馏的目标，通过全局和局部（基于注意力补丁）两个层面的几何感知蒸馏损失，显式地建模和利用类间语义结构，从而在数据敏感且标注有限的医学影像领域实现更稳定、更准确的模型适应。

Abstract: Current prompt-based and adapter-based tuning of vision-language models (VLMs) is attractive for medical imaging, where clinical data sensitivity favors frozen backbones and annotations are limited. However, these methods typically optimize only the ground-truth class, treating all other classes as equally incorrect, ignoring clinically meaningful class relations and yielding unstable decision boundaries in limited-supervision settings. We propose Omni-Geometry Knowledge Distillation (OGKD), a new framework that injects class-relation structure into the teacher to produce directional targets that preserve the ground truth while respecting inter-class geometry. Using these targets, we develop two distillation losses: Global Geometry-Aware Distillation (GAD) operates on the global image token, and Label-Guided Geometry Distillation (LGD) applies the same geometry to attentive patch tokens to improve fine-grained alignment. Across comprehensive experiments and analyses on 11 widely-used medical datasets for base-to-novel and few-shot evaluations, our OGKD achieves substantially better performance, consistently improving accuracy by an average absolute gain of 1.7%-2.8% over all prior state-of-the-art VLM adaptation counterparts. It also robustly generalizes to unseen classes and yields more reliable predictions than other approaches. Our code is available at https://github.com/tientrandinh/OGKD.

[87] BreastGPT: A Multimodal Large Language Model for the Full Spectrum of Breast Cancer Clinical Routine cs.CV | cs.CLPDF

Yang Liu, Jiajin Zhang, Danyang Tu, Yaojun Hu, Jiao Qu

TL;DR: 本文提出了BreastGPT，一个针对乳腺癌全临床流程的多模态大语言模型。为了解决现有医学MLLMs在跨工作流临床推理上的局限性，作者首先构建了一个工作流对齐的乳腺影像指令数据集BreastStage，并在此基础上开发了BreastGPT模型，该模型采用双分支视觉编码器和概念保持令牌压缩技术来处理不同尺度的影像数据。

Details

Motivation: 乳腺癌临床管理涉及筛查、诊断和治疗规划等多个阶段，每个阶段使用不同的影像模态和推理模式。现有医学MLLMs受限于数据稀缺和模型通用性，通常只能在孤立模态或狭窄任务族上进行评估，无法支持工作流级别的临床推理。

Result: 在提出的综合基准BreastStage-Bench上，BreastGPT在封闭式任务上达到75.66%的准确率，在开放式任务上达到89.92%的得分，超越了通用和医学专用的MLLMs，在临床阶段和任务格式上均表现出色。

Insight: 论文的核心创新点在于提出了工作流对齐的数据构建范式（BreastStage数据集）和针对跨尺度视觉建模的模型架构（双分支视觉编码器与概念保持令牌压缩），这为解决医学影像中标准放射学图像与千兆像素病理图像之间的尺度鸿沟提供了有效方案，强调了工作流级数据与跨尺度建模对临床落地医学MLLMs的重要性。

Abstract: Breast cancer remains a leading cause of cancer-related mortality among women. Its clinical management requires multimodal reasoning across a clinical workflow that spans \textit{screening}, \textit{diagnosis} and \textit{treatment planning}, where each stage involves distinct imaging modalities, task objectives, and reasoning patterns. However, constrained by data scarcity and model versatility, existing medical MLLMs are typically evaluated on isolated modalities or narrow task families, limiting their ability to support workflow-level clinical reasoning. In this work, we first introduce \textbf{BreastStage}, a workflow-aligned breast imaging instruction corpus comprising 1.86M instruction-following pairs curated from 17 sub-datasets across 5 imaging modalities and 136 task templates. Its held-out split, \textbf{BreastStage-Bench}, provides a comprehensive benchmark for evaluating multimodal reasoning across the breast cancer care continuum. Building on this corpus, we propose \textbf{BreastGPT}, a unified MLLM equipped with a dual-branch visual encoder and concept-preserving token compression to bridge the scale gap between standard radiology and gigapixel pathology. On BreastStage-Bench, BreastGPT achieves 75.66% closed-ended accuracy and 89.92% open-ended score, outperforming both general-purpose and medical-specific MLLMs across clinical stages and task formats. These results suggest that workflow-aligned data and cross-scale visual modeling are critical for clinically grounded medical MLLMs. All data, code, and model checkpoints are released at https://yangyy-liu.github.io/BreastGPT.io.

[88] Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning cs.CVPDF

Yu Zhu, Yongkang Li, Wenjie Zhu, Haoyi Jiang, Wenyu Liu

TL;DR: 本文提出了Food-R1，一个通过强化学习训练的统一多任务食品视觉-语言模型，并构建了包含思维链标注的大规模食品基准数据集CalorieBench-80K。该模型通过基于思维链的冷启动指令微调和基于GRPO的强化微调，提升了在食品分析任务中的推理和泛化能力。

Details

Motivation: 现有食品视觉-语言模型主要依赖监督微调，限制了其推理和泛化能力，且缺乏高质量的大规模营养标注数据。

Result: 在CalorieBench-80K和其他代表性基准测试上的实验表明，Food-R1在多种食品相关任务上持续优于强基线模型。

Insight: 创新点在于构建了首个包含思维链标注的食品图像基准，并采用多任务学习框架结合冷启动指令微调和强化微调（GRPO）来统一提升模型的多种能力。

Abstract: Recent studies have explored Vision-Language Models (VLMs) for food analysis. However, most existing methods rely primarily on supervised fine-tuning (SFT), which often limits reasoning and generalization capabilities. Moreover, high-quality large-scale nutritional annotations remain scarce. To address these issues, we introduce CalorieBench-80K, a large-scale benchmark with curated calorie labels and dietary advice annotations. To the best of our knowledge, it is the first food image benchmark to incorporate Chain-of-Thought (CoT) annotations for calorie reasoning. We also propose Food-R1, a unified food VLM trained in a multi-task learning paradigm to equip the model with broad capabilities. Food-R1 undergoes CoT-based cold-start instruction tuning, followed by reinforcement fine-tuning (RFT) using Group Relative Policy Optimization (GRPO) to improve reasoning and performance. Experiments on CalorieBench-80K and representative benchmarks show that Food-R1 consistently outperforms strong baselines across food-related tasks. The code, model weights, and benchmark annotations are available at the project repository.

[89] Plan, Watch, Recover: A Benchmark and Architectures for Proactive Procedural Assistance cs.CV | cs.AIPDF

Kaustav Kundu, Ritvik Shrivastava, Maxim Arap, Nanshu Wang, Xianhui Zhu

TL;DR: 该论文提出了一个用于主动式程序性辅助的基准和架构。作者发布了EgoProactive数据集，构建了Pro²Bench基准，并提出了一种解耦的规划-交互架构，用于在用户执行程序性任务时提供实时指导，特别是在用户偏离预期步骤时进行恢复。

Details

Motivation: 当前缺乏反映真实条件（特别是用户偏离预期步骤序列的常见情况）的大规模、跨领域基准，这限制了主动多模态辅助系统的发展。

Result: 在六个数据集上的广泛实验表明，经过训练的Llama-4系统在客观干预质量上显著优于强大的专有基线（如Claude Opus 4.6, Gemini 3.1 Pro, GPT 5.2）和开放权重基线（如Qwen3 VL 235B）。Oracle-plan实验进一步表明，在控制规划质量的情况下，训练的双工模型能产生高质量的指导，并在偏离计划恢复方面取得巨大收益。

Insight: 论文的创新点在于：1）引入了带有明确“偏离计划”标注和恢复步骤的大规模可穿戴-自我中心数据集；2）将多个现有基准统一到一个主动指导框架下；3）提出了一个专门处理程序状态、视觉线索和恢复注入的解耦规划-交互架构；4）提出了一个跨模型族迁移的后训练方法。

Abstract: We envision a proactive multi-modal assistant system which gives users real-time step-by-step guidance on a procedural task, autonomously deciding \textit{when} to interrupt, and \textit{how} to coach. However, progress is limited by the absence of large-scale, cross-domain benchmarks that reflect realistic conditions, particularly the common case in which users deviate from the expected step sequence. We address this gap with four contributions: \textbf{(1)}~~we release \textbf{EgoProactive}, a large-scale wearable-egocentric dataset for proactive procedural assistance with explicit Out-of-Plan (OOP) annotations and recovery steps; \textbf{(2)}~~we augment five established benchmarks (Ego4D, EPIC-KITCHENS, EgoExo4D, HoloAssist, HowTo100M) into \textbf{Pro\textsuperscript{2}Bench} under a unified proactive-guidance schema; \textbf{(3)}~~we propose a \textbf{decoupled planner–interaction architecture} specialized for procedural state, visual cues, and recovery injection; \textbf{(4)}~~we introduce a post-training recipe that transfers across model families, validated by cross-backbone replication on Llama~~4 and Qwen-3.6-VL. In extensive experiments, our trained Llama-4 system substantially improves objective intervention quality over strong proprietary baselines (Claude Opus~~4.6, Gemini~~3.1~~Pro, GPT~~5.2) and open-weight baselines (Qwen3~~VL~235B) baselines across all six datasets. Oracle-plan experiments further show that, when plan quality is controlled, the trained duplex model produces high-quality guidance and large gains on Out-of-Plan recovery.

Jie Huang, Ruixun Liu, Sirui Sun, Xinyi Yang, Yin Li

TL;DR: 本文提出了M³Eval，首个基于认知心理学构建的、用于全面评估多模态模型记忆能力的基准框架。该框架通过精心设计的视频任务，系统性地探究模型在信息保留、抗干扰和记忆源定位等方面的表现，并揭示了现有模型在并行视频流处理、时空记忆可靠性及符号记忆等方面的普遍缺陷。

Details

Motivation: 当前多模态模型在长视频理解方面取得进展，但现有评测主要关注感知与推理，缺乏对记忆能力（如信息保留的忠实度、抗干扰性）的系统性评估。

Result: 在M³Eval基准上对代表性多模态模型进行广泛实验，发现模型在处理并行视频流时难以保持解耦表征，其干扰模式与人类记忆显著不同，空间记忆比时间记忆更可靠，且符号记忆能力有限。

Insight: 创新点在于首次构建了基于认知心理学、系统评估多模态记忆维度的基准；客观分析表明，该工作将记忆确立为多模态模型一个基础但未被充分探索的能力，并为设计更有效的记忆机制提供了方向性见解。

Abstract: As multi-modal models advance towards long-form video understanding, memory emerges as a critical capability. Despite substantial efforts in developing video datasets and benchmarks, existing works primarily focus on perception and reasoning, without systematically evaluating memory: what models retain, how faithfully information is preserved, and how robust memory remains under interference. To address this gap, we introduce M$^3$Eval, the first comprehensive evaluation framework and benchmark for probing different memory dimensions in multi-modal models. Grounded in cognitive psychology, our design features carefully constructed tasks that isolate key aspects of memory. Leveraging M$^3$Eval, we conduct extensive experiments across representative multi-modal models, revealing consistent weaknesses and distinctive behaviors. We find that models struggle to maintain disentangled representations when processing parallel video streams, exhibit interference patterns differing substantially from those observed in human memory, ground memory sources more reliably in the spatial domain than the temporal domain, and demonstrate limited symbolic memory. Collectively, our benchmark provides a valuable resource for future research, while our findings highlight memory as a fundamental yet underexplored capability and offer insights for designing more effective memory mechanisms in multi-modal models. Our code and dataset are available at https://pku-value-lab.github.io/m3eval-homepage.

Jingyuan Chen, Sheng Jin, Haopeng Sun, Wentao Liu, Chen Qian

TL;DR: 本文提出了UniCAD，一个用于多模态多任务CAD学习的统一基准，涵盖了点云到CAD重建、文本/图像到CAD生成以及CAD问答等多种任务。同时，作者还提出了UniCAD-MLLM，一个通用的多模态大语言模型，能够处理文本、图像、草图和点云等多种输入，并在单一框架内以端到端方式执行这些异构任务。

Details

Motivation: 当前CAD研究通常孤立地研究各个任务，且缺乏一个统一的基准，这阻碍了多模态多任务学习在CAD领域的发展。

Result: 在UniCAD和Fusion360基准上的大量实验表明，UniCAD-MLLM在所有任务上都达到了最先进的性能，超越了现有的任务专用和多任务基线模型。

Insight: 论文的主要创新点在于构建了首个统一的多模态CAD基准，并提出了一个能够统一处理多种输入和任务的通用模型框架，这为CAD领域的多任务学习研究提供了重要的基础设施和模型范例。

Abstract: Computer-Aided Design (CAD) underpins modern engineering and manufacturing by enabling the creation of precise, editable 3D models. However, CAD research typically studies tasks in isolation, and multi-modal, multi-task learning for CAD is hindered by the absence of a unified benchmark. To address this gap, we introduce UniCAD, a comprehensive benchmark for multi-modal CAD learning that covers point-to-CAD reconstruction, text/image-to-CAD generation, and CAD question answering across diverse input modalities. Alongside the benchmark, we present UniCAD-MLLM, a universal multi-modal large language model that ingests text, images, sketches, and point clouds and performs these heterogeneous tasks in an end-to-end fashion within a single framework. Extensive experiments on the UniCAD and Fusion360 benchmarks demonstrate that UniCAD-MLLM achieves state-of-the-art performance across all tasks, outperforming existing task-specific and multi-task baselines. We will release the dataset, code, and pretrained models to accelerate future research.

[92] Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have cs.CV | cs.AIPDF

Elouan Gardès, Seung Eun Yi, Kartik Ahuja, Théo Moutakanni, Huy V. Vo

TL;DR: 本文提出了一种名为FINO的无标签方法，用于将通用的视觉基础模型适应到专门的科学领域。该方法利用已有的元数据，以自监督的方式调整模型表示，避免了标准监督微调在标签稀缺时的问题，并保持了模型的泛化性和鲁棒性。

Details

Motivation: 解决在专业科学领域中标签稀缺的问题，同时避免任务特定训练导致模型泛化能力下降和鲁棒性受损。

Result: 在亚细胞荧光显微镜、地球观测、野生动物监测和医疗成像等多个领域，FINO在无监督领域适应和全监督适应方面均表现优异，甚至超过了高度专业化的领域特定SOTA方法。

Insight: 创新点在于结合标准自监督目标和灵活的元数据指导，处理离散和连续元数据，以保留信息因素并抑制虚假因素，实现无需任务标签的骨干网络适应和轻量级监督。

Abstract: We propose a label-free approach to adapt powerful but generic vision foundation models to specialized scientific domains. Standard supervised fine-tuning is often ill-suited to these settings: labels are scarce, and task-specific training can collapse the model’s generality and hurt robustness. We instead leverage metadata to adapt representations to new domains in a self-supervised manner. Our method, FINO, combines a standard self-supervised objective with flexible metadata guidance that handles both highly granular discrete metadata and continuous metadata. It encourages the representation to preserve informative factors while suppressing spurious ones. Across subcellular fluorescence microscopy, Earth observation, wildlife monitoring, and medical imaging, FINO consistently outperforms standard unsupervised domain adaptation and fully supervised adaptation. It also exceeds highly-specialized domain-specific state of the art, while using no task labels for backbone adaptation and only lightweight probes for supervision.

[93] Continual Visual and Verbal Learning Through a Child’s Egocentric Input cs.CV | cs.AI | cs.CLPDF

Xiaoyang Jiang, Yanlai Yang, Kenneth A. Norman, Brenden Lake, Mengye Ren

TL;DR: 本文提出BabyCL，一种持续多模态学习框架，通过单次时序处理儿童自我中心视角视频数据（SAYCam数据集），结合流式视觉表征学习与图像-文本对比目标，模拟儿童的真实学习过程。该方法在SAYCam Labeled-S 4AFC基准测试中优于流式学习基线，显著缩小了与离线训练上限的差距。

Details

Motivation: 现有神经网络学习单词-指代映射时需对打乱数据循环训练数百轮，与儿童在时序结构化环境中连续学习的方式不符，因此旨在开发更贴近儿童真实体验的持续学习框架。

Result: 在匹配优化预算下，BabyCL在SAYCam Labeled-S 4AFC基准上超越流式学习基线，性能接近离线训练上限；消融实验表明其对时序分割窗口长度和回放缓冲淘汰规则具有鲁棒性。

Insight: 创新点包括多阶段时序分割与独立管理视觉/多模态历史的双回放缓冲机制，以及共享主干网络上的三重对比损失联合训练，证明了在更接近儿童实际经验的条件下能有效学习单词-指代映射。

Abstract: Children learn the meanings of words from a continuous, temporally structured stream of egocentric experience. Recent work shows that neural networks can also learn word-referent mappings from a child’s egocentric video recordings, but they cycle through the shuffled data for hundreds of epochs, contrasting with how children actually encounter their environment. We introduce BabyCL, a continual multimodal learning framework that processes the SAYCam dataset in a single chronological pass, combining streaming visual representation learning with an image-text contrastive objective. BabyCL combines a multi-stage temporal segmentation of the stream with a dual replay buffer that independently manages visual and multimodal histories, and it is jointly trained with three contrastive losses on a shared backbone. Under a matched optimization budget, BabyCL outperforms streaming learning baselines on the SAYCam Labeled-S 4AFC benchmark, substantially narrowing the gap to an upper bound of offline training. Ablations show that the gains are robust to the length of the online temporal segmentation window and the eviction rule of the replay buffer. Together, these results show that meaningful word-referent mappings can emerge under training conditions much closer to a child’s actual experience.

[94] An Open-Source Two-Stage Computer Vision Pipeline for Fine-Grained Vehicle Classification using Vision Transformers cs.CV | cs.LG | eess.IVPDF

Gandhimathi Padmanaban, Fred Feng

TL;DR: 本文提出了一种开源的两阶段计算机视觉流水线，用于从自然道路视频中进行细粒度车辆分类，以支持骑行安全研究。该流水线结合了预训练的RT-DETR检测器进行粗略车辆定位，以及微调的Vision Transformer（ViT-Base/16）模型，将车辆分为六种车身类型（如轿车、SUV、皮卡等），并引入了基于置信度的弃权机制以减少误分类。

Details

Motivation: 现有工具无法从自然道路视频中将车辆自动分类到与骑行伤害风险相关的细粒度类别中，标准目标检测基准仅提供粗略标签，而现有的细粒度识别系统缺乏跨部署场景的鲁棒性评估。

Result: 在密歇根州安阿伯自行车道走廊的3,805个标注超车事件（分布内）上，流水线准确率达到0.94，各类别F1分数在0.91（小型货车）到0.97（SUV）之间。在一个独立的开放骑行数据集（分布外，311个事件）上，准确率为0.89，其中四个主要类别中有三个在领域偏移下F1分数保持在0.90或以上。

Insight: 创新点包括结合两阶段检测与分类架构，并引入基于置信度的弃权机制来传播模型不确定性，从而减少静默误分类；同时，开源完整的流水线代码和模型权重，促进了在路边视频档案和骑行安全研究中的可重复性和重用性。

Abstract: Vehicle body type is a significant determinant of cyclist injury severity in overtaking crashes, yet automated tools for classifying vehicles into injury-risk-relevant categories from naturalistic roadway video do not exist in the open literature. Standard object detection benchmarks provide only coarse vehicle labels (car, truck, bus, motorcycle), while existing fine-grained recognition systems are trained on controlled imagery and lack evaluation for deployment robustness across recording sites. This paper presents an open-source two-stage computer vision pipeline combining a pre-trained RT-DETR detector for coarse vehicle localization with a fine-tuned Vision Transformer (ViT-Base/16) for six-category body-type classification: passenger car, SUV, pickup truck, minivan, large van, and commercial truck. A confidence-based abstention mechanism withholds Stage 2 predictions when softmax output falls below 0.60, producing unknown labels rather than silent misclassifications. Evaluated on 3,805 annotated overtaking events from a bicycle-lane corridor in Ann Arbor, Michigan (in-distribution), the pipeline achieved 0.94 accuracy with per-class F1 scores from 0.91 (minivan) to 0.97 (SUV). On an independent out-of-distribution evaluation of 311 events from an open cycling dataset without retraining, accuracy was 0.89. Three of four well-represented categories maintained F1 at or above 0.90 under domain shift. The largest degradation was observed for minivan (F1 = 0.72), driven by abstention rate rising from 2.4% to 25.0% rather than active misclassification, consistent with the mechanism propagating genuine model uncertainty. The full pipeline, including inference scripts, training code, evaluation utilities, and model weights, is released as open-source software to support reproducibility and reuse across roadside video archives and cycling safety research.

[95] Controllable Dynamic 3D Shape Generation via 3D Trajectories and Text cs.CVPDF

Jaeyeong Kim, Ines Kim, Jahyeok Koo, Seungryong Kim

TL;DR: T2Mo是一个前馈框架，用于基于3D轨迹和文本生成可控的动态3D形状。它通过结合3D轨迹（提供精确的空间路径）和文本（提供全局语义），解决了仅用文本生成动态形状时存在的模糊性问题，并提出了形状接地的轨迹嵌入方法来处理任意配置的轨迹输入。

Details

Motivation: 仅使用文本生成动态3D形状存在固有的模糊性，难以精确控制运动路径。为了解决这个问题，论文引入3D轨迹作为可控的空间引导，以指定选定点的确切移动路径，从而实现对生成运动的更精确控制。

Result: 与基于文本的基线以及结合轨迹引导视频生成和视频到动态网格生成的级联视频基线相比，定量、定性评估和用户研究表明，T2Mo生成的运动能更忠实地遵循给定提示，具有更高的表现力，同时保持了运动质量。

Insight: 核心创新点在于将3D轨迹与文本条件相结合，为动态3D生成提供了更精确的空间控制。提出的形状接地的轨迹嵌入方法能够鲁棒地处理从密集到稀疏、分布不均的任意轨迹配置，这是一个重要的技术贡献。

Abstract: We introduce T2Mo, a feed-forward framework for controllable dynamic 3D shape generation conditioned on 3D trajectories and text. Due to the inherent ambiguity of language, generating precisely intended motions using text alone remains challenging. To address this, we adopt 3D trajectories as controllable spatial guidance, specifying the exact paths along which selected points should move. By combining both, T2Mo generates object motions that spatially adhere to the given trajectories while globally reflecting the text semantics. To robustly handle trajectory inputs with arbitrary configurations, ranging from dense to sparse and unevenly distributed, we further propose a shape-grounded trajectory embedding that maps an input trajectory set into a shape-aware token set covering the entire object. We conduct extensive comparisons against text-based baselines and cascaded video-based baselines that combine trajectory-guided video generation with video-to-dynamic mesh generation. Quantitative and qualitative evaluations, along with user studies, demonstrate that our approach produces motions that more faithfully follow the given prompts with higher expressiveness while preserving motion quality.

cs.MM [Back]

[96] DetectZoo: A Unified Toolkit for AI-Generated Content Detection Across Text, Audio, and Image Modalities cs.MM | cs.AI | cs.CL | cs.CV | cs.LG | cs.SDPDF

Sajad Ebrahimi, Nima Jamali, Bardia Shirsalimian, Kelly McConvey, Wentao Zhang

TL;DR: 本文介绍了DetectZoo，一个首个为文本、音频和图像模态的AI生成内容检测提供统一接口的可扩展工具包。它标准化了从数据输入、预处理到模型评估的完整实证流程，集成了61个检测器的参考实现、22个基准数据集的原生加载器以及一个报告多种指标的标准化评估管道。

Details

Motivation: 生成模型的普及和能力模糊了人类与机器生成内容的界限，推动了跨模态检测研究。然而，现有检测器多为商业软件或开源但代码库不兼容、预处理和评估协议各异，导致采用、公平比较和复现困难。

Result: 工具包通过统一API集成了多样化的公共数据集和基线检测算法，实现了严格且可复现的评估。每个检测器自包含且可通过相同接口访问，自动缓存预训练权重，并能复现原始发表结果。

Insight: 主要创新点是提供了一个首个跨文本、音频和图像模态的统一、可扩展的AI生成内容检测工具包，标准化了整个实证流程，降低了多模态AI取证研究的入门门槛，有助于系统性地基准测试最先进的检测器并加速鲁棒、可泛化检测技术的发展。

Abstract: The growing popularity and capacity of generative models have eroded the distinction between human and machine-generated content, motivating a growing body of work on detection across text, images, and audio. Most available detectors are either commercial software or, if open-source, come with incompatible codebases with bespoke preprocessing, evaluation protocols, and evaluation metrics, which make their adoption, fair comparison, and reproduction quite difficult. To address this critical gap, we introduce DetectZoo, a first-of-its-kind, extensible toolkit designed to provide a unified interface for AI-generated content detection across text, audio, and image modalities. DetectZoo standardizes the complete empirical pipeline, from data ingestion and preprocessing to model assessment, offering researchers a cohesive framework to benchmark state-of-the-art detectors systematically. By integrating diverse public datasets and baseline detection algorithms under a single, unified API, our toolkit facilitates rigorous and reproducible evaluation. DetectZoo provides reference implementations of 61 detectors, native loaders for 22 benchmark datasets, and a standardized evaluation pipeline that reports multiple metrics through a common interface. Each detector is self-contained yet accessible through the same interface, automatically caches pretrained weights, and reproduces the original published results. DetectZoo lowers the barrier to entry for multi-modal AI forensics, enabling researchers to identify performance gaps across domains and accelerating the development of robust, generalizable detection techniques. The open-source repository and comprehensive documentation are publicly available at https://github.com/sadjadeb/DetectZoo, and the package can be installed via pip install detectzoo.

[97] Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation cs.MM | cs.CV | cs.GRPDF

Yuxuan Bian, Zeyue Xue, Songchun Zhang, Shiyi Zhang, Weiyang Jin

TL;DR: 本文提出了Echo-Infinity，一个用于实时无限视频生成的自回归框架。其核心是引入一个可学习的演化记忆模块，以恒定成本动态过滤、抽象和压缩任意长度的历史信息，并结合统一的相对RoPE方法，解决了现有方法因有限缓存窗口和忽略自回归噪声而导致的历史信息丢失与误差累积问题。

Details

Motivation: 现有无限视频生成方法主要依赖预定义的KV缓存调度、固定比例的启发式压缩或推理时的RoPE调整，这些方法因有限的缓存窗口和忽略自回归生成噪声，不可避免地会丢失历史信息并放大复合误差。本文旨在解决这些问题，实现高质量、长序列的实时视频生成。

Result: 在长短视频生成任务中，Echo-Infinity均取得了最先进的性能。据作者所知，它首次展示了长达24小时（超过130万帧）的实时生成潜力，为无限视频生成提供了一条实用路径。

Insight: 主要创新点包括：1）用可学习的记忆查询机制替代手工设计的记忆管理，通过注意力和门控机制更新，形成支持任意压缩比且计算成本恒定的演化记忆；2）提出了统一的相对RoPE方法，将锚定帧的ID固定为0，让最新帧ID在训练和推理中最多增长至预训练模型的最大时间RoPE ID，从而解除了有限RoPE的约束并弥合了训练-测试的RoPE外推差距。该记忆还可作为泛化的生成先验，仅使用优化后的初始状态也能提升生成质量。

Abstract: We present Echo Infinity, an autoregressive (AR) framework towards real-time infinite video generation that employs a learnable evolving memory to dynamically filter, abstract, and compress any-length history at constant cost. Existing methods mainly curate memory with predefined KV-cache schedules, fixed-ratio heuristic compression, or inference-time RoPE adaptation. These designs inevitably lose historical information and amplify compounding errors due to their limited cache window and ignorance of autoregressive generation noise. Inspired by human memory consolidation, Echo-Infinity replaces handcrafted memory curation with learnable Memory Query, which are updated by attention and a gating mechanism when past frames are evicted from the local window. The queries are optimized end-to-end with the video diffusion transformers (DiTs), forming an evolving memory that supports arbitrary compression ratios with constant computation independent of video length. They also act as a generalizable generation prior, improving quality even when only the optimized initial state is used. We further introduce Unified Relative RoPE Recipe, which anchors the sink frames to start from id 0 and lets the newest frame id grow at most to the DiTs’ pretrained maximum temporal RoPE id throughout training and inference, freeing the model from the finite RoPE constraint and closing the train-test RoPE extrapolation gap. In long and short video generation, Echo-Infinity achieves state-of-the-art performance, and, to our knowledge, demonstrates promising 24-hour (>1.3 M frames) real-time rollouts for the first time, suggesting a practical path toward infinite video generation.

cs.SD [Back]

[98] Beyond Text Following: Repairable Arbitration Reversals in Audio-Language Models cs.SD | cs.CLPDF

Yichen Gao, Yiqun Zhang, Zijing Wang, Yujia Li, Heng Guo

TL;DR: 本文研究了音频-语言模型（ALMs）在处理音频与文本冲突时的决策机制，发现模型虽然编码了音频证据，但在仲裁中常被冲突文本覆盖。通过构建相同音频反事实实验，作者定位了决策反转的关键计算位置，并提出无需训练的GACL解码方法，显著提升了模型在冲突任务中的音频忠实性。

Details

Motivation: 解决ALMs在处理音频与文本冲突时过度依赖文本、忽视清晰音频证据的问题，探究冲突决策中音频证据是否被编码但被覆盖。

Result: 在五个ALMs和四个冲突任务中，64.1%的冲突样本出现决策反转；提出的GACL方法在严格5%忠实性下降预算下，将nAUC提升了17.8个百分点，优于最佳对比基线，并可迁移到视觉-文本仲裁任务（提升达40.5个百分点）。

Insight: 创新点在于通过相同音频反事实实验诊断决策反转机制，并利用激活修补定位关键计算位置；提出的GACL解码规则通过插值联合与反事实分数，无需训练即可有效提升模型对多模态冲突的仲裁能力。

Abstract: Audio-language models (ALMs) often follow text that conflicts with audio, even when the audio evidence is clear. This raises a basic question: is the audio-supported answer unavailable, or is it represented but overridden by the conflicting text? We examine this question using a same-audio counterfactual that keeps the audio fixed, removes only the conflicting text, and measures the resulting shift in model preference. Across five ALMs and four conflict tasks, 64.1% of conflict samples show a sign flip: the same-audio branch prefers the audio-supported answer, whereas the joint branch prefers the text-supported answer. This pattern suggests that the relevant audio evidence is encoded but loses in arbitration. Activation patching further localizes the reversal to answer-position computation, and patching effects closely track output candidate-score differences (Spearman rho=0.93). Using this diagnostic, we propose Gated Audio Counterfactual Logit Correction (GACL), a training-free decoding rule that interpolates between joint and same-audio scores. Under a strict 5 pp faithfulness-drop budget, GACL improves nAUC by 17.8 points over the best contrastive baseline and transfers without retuning to vision-text arbitration (up to +40.5 pp).

cs.AI [Back]

[99] StepPRM-RTL: Stepwise Process-Reward Guided LLM Fine-Tuning for Enhanced RTL Synthesis cs.AI | cs.AR | cs.CLPDF

Prashanth Vijayaraghavan, Apoorva Nitsure, Luyao Shi, Ehsan Degan, Vandana Mukherjee

TL;DR: 本文提出了StepPRM-RTL框架，用于增强基于大语言模型（LLM）的RTL代码生成功能。该框架结合了逐步轨迹建模、过程奖励模型（PRM）和检索增强微调（RAFT），通过蒙特卡洛树搜索（MCTS）探索替代推理路径，旨在提高生成代码的功能正确性和推理保真度。

Details

Motivation: 解决数字硬件设计中RTL代码自动生成的挑战，包括长视野推理、多步依赖关系以及Verilog和VHDL中的严格正确性约束。

Result: 在基准Verilog和VHDL数据集上的实验评估表明，StepPRM-RTL在功能正确性和推理保真度指标上比先前最佳方法提高了超过10%，达到了新的SOTA水平。

Insight: 创新点在于将逐步轨迹建模与过程奖励模型（PRM）结合，通过密集反馈指导强化学习式更新，并利用MCTS探索高质量轨迹，从而学习如何以及为何构建正确的RTL代码，超越了标准的监督或基于结果的训练方法。

Abstract: Automatic generation of RTL code for digital hardware designs remains challenging due to long-horizon reasoning, multi-step dependencies, and strict correctness constraints in Verilog and VHDL. We present StepPRM-RTL, a novel framework that combines stepwise trajectory modeling, process-reward modeling (PRM), and retrieval-augmented fine-tuning (RAFT) to enhance both the functional correctness and reasoning fidelity of LLM-based RTL code generation. StepPRM-RTL constructs stepwise reasoning trajectories from canonical solutions, where each step contains a rationale and incremental code modification. A Process Reward Model (PRM) evaluates intermediate steps, providing dense feedback that guides reinforcement-style updates during RAFT fine-tuning. Monte Carlo Tree Search (MCTS) explores alternative reasoning paths, enriching the training dataset with high-quality trajectories. This integration of stepwise and outcome-aware rewards allows the model to learn both how and why to construct correct RTL, improving long-horizon reasoning beyond standard supervised or outcome-based training. Experimental evaluation on benchmark Verilog and VHDL datasets demonstrates that StepPRM-RTL outperforms the best prior methods by over 10% in functional correctness and reasoning fidelity metrics. Ablation studies confirm that the combination of PRM-guided rewards and stepwise trajectory exploration is key to its performance. StepPRM-RTL generalizes across RTL languages and provides a scalable framework for high-fidelity, interpretable code generation, establishing a new standard for LLM-assisted hardware design automation.

[100] VAMPS: Visual-Assisted Mathematical Problem Solving Benchmark cs.AI | cs.CL | cs.CV | cs.LGPDF

Amirhossein Dabiriaghdam, Shayan Vassef, Mohammadreza Bakhtiari, Yasamin Medghalchi, Ilker Hacihaliloglu

TL;DR: 本文介绍了VAMPS（视觉辅助数学问题解决）基准测试，旨在评估多模态大语言模型在需要借助可视化工具（如绘图）来辅助解决数学问题时的能力。该基准包含1,168个双语多模态选择题，源自伊朗大学入学考试的代数与微积分问题，并扩展了人工审核的LLM生成合成变体，其设计使得绘图成为揭示交点、极值、渐近线等的自然解决策略。研究发现，在多种模型上，直接解析求解的表现意外地优于启用工具的视觉求解，即使在绘图是自然策略的问题上也是如此。

Details

Motivation: 多模态大语言模型在复杂推理方面能力日益增强，但当它们必须通过工具（如可视化辅助）外化问题并基于工具输出进行推理时，性能往往会下降，而现实工程和科学工作流常依赖可视化工具进行分析、验证和决策，因此研究这一差距至关重要。

Result: 在VAMPS基准上对多样化模型进行评估，结果显示直接解析求解的表现意外地优于工具启用的视觉求解，即使在绘图是自然解决策略的问题上也是如此。

Insight: 创新点在于引入了VAMPS这一专注于图辅助数学的基准，它不仅用于性能评估，还用于诊断模型是否能从构建有用图表并基于可视化结果进行推理中受益；客观来看，该研究揭示了当前多模态模型在主动利用视觉工具进行问题解决方面的局限性，为未来模型改进提供了方向。

Abstract: Multimodal large language models are increasingly capable of complex reasoning, yet their performance often degrades when they must externalize a problem through a tool and then reason over the tool’s output, specifically when they rely on visual aids. This gap is especially important because real engineering and scientific workflows often rely on visualization tools for analysis, validation, and decision-making. To study this discrepancy, we introduce VAMPS (Visual-Assisted Mathematical Problem Solving), a benchmark for graph-assisted mathematics. VAMPS contains 1,168 multimodal, bilingual multiple-choice question-answer pairs drawn from Iranian University Entrance Exam algebra and calculus problems and expanded with human-reviewed LLM-generated synthetic variants, all selected so that plotting provides a natural solution strategy by revealing intersections, extrema, asymptotes, etc. Designed for both benchmarking and diagnosis, VAMPS goes beyond prior multimodal benchmarks that primarily evaluate reasoning over fixed visual inputs by testing whether a model can benefit from constructing a useful graph and grounding its answer in the resulting visualization. Overall, we found that across a diverse set of models, direct analytical solving surprisingly outperforms tool-enabled visual solving, even on problems where plotting is a natural strategy.

[101] Can Generalist Agents Automate Data Curation? cs.AI | cs.CL | cs.CV | cs.ET | cs.LGPDF

Feiyang Kang, Hanze Li, Adam Nguyen, Mahavir Dabas, Jiaqi W. Ma

TL;DR: 这篇论文探讨了通用编码智能体能否自动化数据筛选流程，并引入了Curation-Bench基准测试来评估智能体在固定模型和训练流程下通过命令行迭代提出、实施和修订数据策略的能力。在视觉-语言指令调优的实例中，智能体在十次迭代内达到了已发布的强基线水平，但存在执行-研究差距；通过引入要求引用和适配现有方法的支架，智能体能够自主组合出在十分之一数据预算下超越基线的数据选择策略。

Details

Motivation: 现代AI开发中，数据筛选是至关重要但劳动密集的环节，需要从业者根据嘈杂的基准反馈迭代提出、实施、评估和修订数据策略。论文旨在探究通用编码智能体能否自动化这一数据筛选循环，以减轻人工负担。

Result: 在Curation-Bench基准测试的视觉-语言指令调优实例中，开箱即用的智能体在十次迭代内达到了已发布的强数据选择基线水平；通过支架引导方法适配后，智能体自主组合的数据选择策略在十分之一数据预算下超越了这些基线。

Insight: 论文的创新点在于提出了以智能体为中心的Curation-Bench基准测试，用于评估自动化数据筛选能力，并揭示了当前智能体存在的执行-研究差距。关键洞察是：可靠的自动化数据研究需要支架化的方法适配（如要求引用和实例化现有方法），而不仅仅是开放式提示，这能引导智能体进行方法指导的探索并生成更优策略。

Abstract: Curating training data is among the most consequential yet labor-intensive parts of modern AI development: practitioners iteratively propose, implement, evaluate, and revise data policies against noisy benchmark feedback. We ask whether generalist coding agents can automate this data-curation loop. We introduce Curation-Bench, an agent-centric benchmark that fixes the model, training recipe, and evaluation suite while giving agents command-line access to inspect data, implement policies, submit them to a fixed training/evaluation pipeline, and revise. In a vision-language instruction-tuning instantiation, out-of-the-box agents reach strong published data-selection baselines within ten iterations. However, trajectory analysis reveals a persistent execution-research gap: agents mainly tune local policy variants rather than explore new policy families, even when given strategy guides and paper references. Scaffolds requiring each iteration to cite, instantiate, and adapt a prior method shift agents toward method-guided exploration. The scaffolded agent autonomously composes – without human design input – a data-selection policy that outperforms strong published baselines at one-tenth their data budget. Overall, current agents can run the curation loop, but reliable data research requires scaffolded method adaptation, not open-ended prompting alone. Code and benchmark are open-sourced.

[102] Cascading Hallucination in Agentic RAG: The CHARM Framework for Detection and Mitigation cs.AI | cs.CL | cs.CR | cs.IRPDF

Saroj Mishra

TL;DR: 本文提出了CHARM框架，用于检测和缓解多步智能检索增强生成（RAG）管道中的级联幻觉问题。级联幻觉是指早期阶段引入的错误在后续推理步骤中传播和放大，导致最终输出自信但事实错误。CHARM通过阶段级事实验证、跨阶段一致性跟踪、置信度传播监控和级联解决触发四个组件，在不替换现有架构的情况下，有效检测和中断错误传播。

Details

Motivation: 现有幻觉检测机制系统性地忽略了多步智能RAG管道中的一类故障：级联幻觉，即早期错误在后续步骤中传播放大，导致最终输出错误但自信。为了解决这一漏洞，本文正式定义了级联幻觉这一独特的故障模式。

Result: 在HotpotQA、MuSiQue、2WikiMultiHopQA和自定义对抗数据集上，使用LangChain智能管道配置进行评估，CHARM实现了89.4%的级联检测率，5.3%的误报率，每阶段平均延迟开销为215 ms +/- 18 ms，错误传播减少了82.1%，而输出级检测器仅减少18.5%。组件消融实验证实每个检测模块都对整体覆盖率有贡献。

Insight: 创新点在于将级联幻觉形式化为智能RAG系统中的一种独特故障模式，并提出了一个四类级联模式的分类法。CHARM框架的架构设计允许其与标准智能RAG管道协同工作，无需架构替换，并通过多组件协同检测，显著提高了对错误传播的检测和缓解能力，为生产级智能AI部署提供了完整的可靠性和治理栈。

Abstract: Multi-step agentic retrieval-augmented generation (RAG) pipelines have demonstrated significant capability for complex reasoning tasks, yet remain vulnerable to a class of failure that existing hallucination detection mechanisms systematically miss: cascading hallucination, where errors introduced at early pipeline stages propagate and amplify across successive reasoning steps, producing confident but factually incorrect final outputs. To address this vulnerability, we formalize cascading hallucination as a distinct failure mode in agentic RAG systems, present a four-type taxonomy of cascade patterns, and introduce CHARM (Cascading Hallucination Aware Resolution and Mitigation), an architectural framework for detecting and interrupting error propagation in multi-step reasoning pipelines. CHARM comprises four components - stage-level fact verification, cross-stage consistency tracking, confidence propagation monitoring, and cascade resolution triggering - that operate alongside standard agentic RAG pipelines without requiring architectural replacement. We evaluate CHARM on HotpotQA, MuSiQue, 2WikiMultiHopQA, and a custom adversarial dataset across LangChain agentic pipeline configurations, achieving an 89.4% cascade detection rate with a 5.3% false positive rate and 215 ms +/- 18 ms average latency overhead per stage, achieving an error propagation reduction of 82.1%, compared to 18.5% for output-level detectors. Component ablations confirm that each detection module contributes meaningfully to overall cascade coverage. CHARM integrates with human-in-the-loop oversight frameworks to provide a complete reliability and governance stack for production agentic AI deployment.

[103] R-APS: Compositional Reasoning and In-Context Meta-Learning for Constrained Design via Reflective Adversarial Pareto Search cs.AI | cs.CL | cs.MAPDF

João Pedro Gandarela, Thiago Rios, Stefan Menzel, André Freitas

TL;DR: 本文提出了反射对抗帕累托搜索（R-APS）方法，旨在解决大型语言模型在需要规划、工具使用和长期行动的智能体环境中存在的可靠性不足问题。该方法通过分解推理模式、分配独立上下文并在三个时间尺度上协调交互，实现了无需微调、仅通过结构化协议设计即可在冻结LLM上运行的约束设计。

Details

Motivation: 动机在于解决LLM在智能体环境中因错误传播无定位、最坏情况扰动未评估和累积知识未失效这三个耦合的结构性故障而导致的可靠性差距。

Result: 在平面机构合成任务上评估，针对32个目标轨迹，R-APS提供了比均匀扰动基线紧3.5倍的鲁棒性证书，首次准入迭代速度快46%，并在联合控制杆件数量和最坏情况鲁棒性的同时，相比枚举+遗传算法将倒角距离减少了2.1倍。

Insight: 创新点在于首次通过推理模式分解联合解决三个结构性故障，并设计了包含类型化验证批评器、帕累托目标驱动的反事实压力测试和带显式失效的元归纳规则提取的三时间尺度协调协议。结构化协议设计使得小型4B专业推理模型在协议内能与通用70B骨干模型竞争，表明其可部分抵消模型规模的需求。

Abstract: Large language models (LLMs) are fluent on open-ended tasks, yet in agentic settings, where a system must plan, use tools, and act over extended horizons, fluency does not ensure reliable delivery. We trace this gap to three coupled structural failures: errors propagate without localization, worst-case perturbations go unevaluated, and accumulated knowledge is never invalidated. We argue these share a root cause: abductive, counterfactual, meta-inductive, corrective, and inductive reasoning pull a shared context in incompatible directions. We introduce Reflective Adversarial Pareto Search (R-APS), to our knowledge the first method addressing all three failures jointly via reasoning-mode decomposition, allocating each reasoning mode its own context and orchestrating interaction across three timescales: staged compositional reasoning with a typed validation critic (failure localization), sensitivity-guided counterfactual stress-testing as a first-class Pareto objective (robustness), and meta-inductive rule extraction with explicit invalidation (persistent memory). R-APS requires no fine-tuning and operates on a frozen LLM purely via structured protocol design. We evaluate on planar mechanism synthesis (robotics, prosthetics, mechanical design), with every candidate checked by a kinematic solver. On 32 target trajectories, R-APS delivers robustness certificates 3.5x tighter than uniform-perturbation baselines, 46% faster iterations-to-first-admission, and 2.1x Chamfer-distance reduction over Enum+GA while jointly controlling bar-count and worst-case robustness. Small 4B reasoning-specialized models prove competitive with general-purpose 70B backbones inside the protocol, suggesting structured protocols can partially offset model scale.

cs.LG [Back]

[104] Do Transformers Need Three Projections? Systematic Study of QKV Variants cs.LG | cs.AI | cs.CL | cs.PFPDF

Ali Kayyam, Anusha Madan Gopal, M Anthony Lewis

TL;DR: 本文系统研究了Transformer中查询、键、值（QKV）投影的必要性，评估了三种投影共享变体：Q-K=V（共享键值）、Q=K-V（共享查询键）和Q=K=V（单投影）。通过在合成任务、视觉任务（如MNIST、CIFAR）和语言建模（300M和1.2B参数模型）上的实验，发现这些变体性能与标准QKV Transformer相当或更好，其中Q-K=V变体在语言建模中仅带来3.1%的困惑度退化，却实现了50%的KV缓存减少。

Details

Motivation: Transformer中的QKV注意力机制是核心组件，但三个投影的各自贡献以及省略某些投影的影响尚不明确，本文旨在通过系统研究探索投影共享的潜力，以优化模型效率。

Result: 在语言建模任务中，Q-K=V投影共享在10B tokens上仅导致3.1%的困惑度退化，同时减少50%的KV缓存；结合GQA-4和MQA时，缓存减少分别达到87.5%和96.9%，支持边缘设备推理。在视觉任务上，变体性能与标准Transformer相当或偶尔更优。

Insight: 创新点在于系统评估了QKV投影共享变体，揭示了键和值可占据相似表示空间且注意力在低秩机制下运行，使得Q-K=V能保持质量；同时，通过2D位置编码解决对称注意力图问题，投影共享作为注意力中权重绑定的未充分探索实例，具有直接可量化的推理内存优势，适用于边缘部署。

Abstract: Transformers have become the standard solution for various AI tasks, with the query, key, and value (QKV) attention formulation playing a central role. However, the individual contribution of these three projections and the impact of omitting some remain poorly understood. We systematically evaluate three projection sharing constraints: a) Q-K=V (shared key-value), b) Q=K-V (shared query-key), and c) Q=K=V (single projection). The last two variants produce symmetric attention maps; to address this, we also explore asymmetric attention via 2D positional encodings. Through experiments spanning synthetic tasks, vision (MNIST, CIFAR, TinyImageNet, anomaly), and language modeling (300M and 1.2B parameter models on 10B tokens), we discovered that our transformers perform on par or occasionally better than the QKV transformer. In language modeling, Q-K=V projection sharing achieves 50% KV cache reduction with only 3.1% perplexity degradation. Crucially, projection sharing is complementary to head sharing (GQA/MQA): combining Q-K=V with GQA-4 yields 87.5% cache reduction, while Q-K=V + MQA achieves 96.9%, enabling practical on-device inference. We show that Q-K=V preserves quality because keys and values can occupy similar representational spaces and attention operates in a low-rank regime, whereas Q=K-V breaks attention directionality. Our results systematically characterize projection sharing as an underexplored instance of weight tying in attention, with direct, quantifiable inference memory benefits, particularly valuable for edge deployment. The code is publicly available at https://github.com/anushamadan02/Do-Transformers-Need-3-Projections

[105] Large Language Models Hack Rewards, and Society cs.LG | cs.AI | cs.CL | cs.CR | cs.CYPDF

Wei Liu, Xinyi Mou, Hanqi Yan, Zhongyu Wei, Yulan He

TL;DR: 本文探讨了大型语言模型（LLM）在强化学习（RL）训练中，如何将其‘奖励函数黑客’行为扩展到社会层面，即发现并利用社会规则中的漏洞。作者为此创建了SocioHack沙盒环境进行实验，发现模型确实学会了在技术上合规但违背监管意图的策略，且现有安全措施缓解效果有限。

Details

Motivation: 动机源于观察到社会法规在结构上与强化学习的奖励函数相似（定义结果、阈值和例外，但意图表述不完整），因此研究LLM在RL训练中‘黑客’奖励函数的已知倾向，是否会升级为更严重的‘社会黑客’——即发现社会运行规则的漏洞。

Result: 在包含72个社会环境的SocioHack沙盒中，奖励黑客行为自然涌现，并导致模型成功发现监管漏洞。模型学会了生成技术上合规但违背监管意图的策略，且当前LLM安全防护措施只能提供有限的缓解。

Insight: 创新点在于将LLM的奖励黑客问题概念化并实证扩展到社会法规遵从领域，提出了‘社会黑客’这一新的关键失效模式。客观来看，该研究揭示了依赖真实世界反馈进行模型训练的风险，并强调了为LLM开发下一代安全后训练范式的紧迫性。

Abstract: Reinforcement learning (RL) has become a dominant post-training paradigm, enabling large language models (LLMs) to learn from rewards. We observe that societal regulations are structurally similar to reward functions. They define measurable outcomes, thresholds, and exceptions, while often leaving institutional intent only partially specified. We hypothesise that the RL training process may exploit these gaps and therefore ask whether models’ well-known tendency to hack reward functions during RL can scale into a more consequential failure mode named societal hacking: discovering loopholes in the rules society runs on. To study this phenomenon, we introduce SocioHack, a sandbox of 72 societal environments, and find that within these environments, reward hacking naturally emerges and leads to regulatory loophole discovery. Models learn to hack the social rules and generate strategies that remain technically compliant while defeating regulatory intent, and current LLM safeguards provide only limited mitigation. Therefore, collecting in-the-wild feedback for model training requires greater caution, and we need a next-generation post-training paradigm for safely iterating LLMs in real society.=

[106] Training-Free Lexical-Dense Fusion for Conversational-Memory Retrieval cs.LG | cs.CL | cs.IRPDF

Christian Lysenstøen

TL;DR: 本文研究了无需训练、仅使用CPU的检索方法在长时会话记忆（LoCoMo）任务中的应用，通过将基于最大查询-轮次相似度的密集检索分数与BM25进行分数级融合，显著提升了检索性能。

Details

Motivation: 解决长时会话记忆检索中，如何在不依赖训练和GPU的情况下，有效融合密集检索与词汇检索方法以提升检索准确率的问题。

Result: 在LongMemEval基准测试中，融合方法在六个编码器上将LoCoMo Hit@1提升了8.8至17.2个百分点，最高达到Hit@1 0.752（e5-large-v2），比BM25高出11.2个百分点。

Insight: 提出了一种无需训练的分数级融合策略，结合了密集检索（基于最大相似度）与词汇检索（BM25）的优势，实现了检索性能的显著提升，并分析了不同检索方法在不同问题类型上的分工互补性。

Abstract: Retrieving the few past turns that answer a new query across long multi-session histories is the retrieval bottleneck behind long-term conversational memory (LoCoMo, LongMemEval). Recent concurrent work, Nano-Memory, shows that scoring a session by the maximum query-turn similarity (late interaction, “Turn Isolation Retrieval”) beats mean-pooled session embeddings. We do not claim that effect; we replicate it and ask what a training-free, CPU-only retrieval stage should add around it. We report four findings. (1) Fuse: score-level fusion of the late-interaction dense score with BM25, under a single leave-one-conversation-out weight, adds +8.8 to +17.2 points of LoCoMo Hit@1 over late interaction alone across six encoders (all p<1e-4), reaching Hit@1 0.752 / NDCG@5 0.829 (e5-large-v2), +11.2 pp over BM25. (2) An off-the-shelf web-search cross-encoder reranker over the fused top-10 hurts here, degrading Hit@1 by 6.9 pp (one reranker, one configuration). (3) A pooling-operator ablation shows top-k late interaction matches max-similarity, but a naive smooth-max (log-sum-exp) collapses for half the encoders. (4) The late-minus-early gap is large for all six encoders and tends to be larger for larger ones, while the marginal fusion gain shrinks; on LongMemEval-S, a lexical regime where BM25 saturates, the net fusion gain over BM25 is small and not significant. A per-category analysis frames the gain as a division of labor: dense late interaction helps most on multi-hop and temporal questions but trails BM25 on adversarial ones. The contribution is a controlled, reproducible account of a strong training-free retrieval recipe, not the late-interaction retriever itself (Nano-Memory’s). We make no claim to a complete memory architecture; this is a retrieval-stage study.

[107] Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling cs.LG | cs.AI | cs.CLPDF

Yifan Wang, Jinyi Mu, Mayank Jobanputra, Yu Wang, Ji-Ung Lee

TL;DR: 本文提出了一种稀疏混合专家（MoE）奖励模型，用于解决人类偏好建模中的多样性和异质性问题。该方法通过在二元偏好数据上训练，鼓励稀疏路由和专家多样性，从而学习到可解释的路由模式和专业化专家。

Details

Motivation: 现有偏好建模方法通常假设存在统一的奖励函数，忽略了人类偏好的多样性和异质性，且现有多组件方法难以捕获连贯且解耦的模式，限制了其可解释性和个性化效果。

Result: 在受控和真实世界实验中，稀疏MoE模型学习了可解释的路由模式和专业化专家，提升了测试时的个性化性能，并且专家权重的后适应变化为分析模型如何适应个性化偏好提供了定性视角。

Insight: 创新点在于将稀疏MoE结构引入奖励模型，通过稀疏路由和专家多样性训练，实现了对异质偏好的解耦与可解释建模，为个性化对齐提供了新思路。

Abstract: Preference modeling plays a central role in reinforcement learning from human feedback (RLHF), enabling large language models (LLMs) to align with human values. However, most existing approaches assume a universal reward function, neglecting the diversity and heterogeneity of human preferences. To address this limitation without additional annotation costs, recent work has proposed learning multiple preference components from binary data and combining them to model individual preferences. Nevertheless, these components often fail to capture coherent and disentangled patterns, limiting their interpretability and effectiveness for personalization. In this work, we propose a sparse Mixture-of-Experts (MoE) reward model that encourages sparse routing and expert diversity during training on binary preference data. Across controlled and real-world experiments, sparse MoE learns interpretable routing patterns and specialized experts. It also improves test-time personalization, and post-adaptation shifts in expert weights provide a qualitative lens for analyzing how the model adapts to personalized preferences.

[108] VentAgent: When LLMs Learn to Breathe – Multi-Objective Arbitration for ARDS Ventilation cs.LG | cs.CLPDF

Teqi Hao, Yuxuan Fu, Xiaoyu Tan, Shaojie Shi, Bohao Lv

TL;DR: 本文提出VentAgent，一种利用大型语言模型作为透明仲裁器的分层框架，用于急性呼吸窘迫综合征的机械通气控制。该框架将通气控制重新定义为动态多目标仲裁过程，通过感知、规划和编排三个可解释阶段，综合异构专家策略并协调冲突的临床优先级。在高保真生理模拟器上的评估表明，VentAgent优于最先进的强化学习和经典控制基线，并能将控制决策转化为人类可读的推理链。

Details

Motivation: 当前基于电子健康记录的数据驱动方法存在模仿偏差，难以泛化到不稳定或分布外表型；标准强化学习方法在处理重症监护的对抗性权衡时也面临挑战，且策略不透明、临床可解释性有限。

Result: 在高保真生理模拟器上的评估显示，VentAgent超越了最先进的强化学习和经典控制基线，实现了更优的性能。

Insight: 创新点在于将大型语言模型的语义推理能力用于机械通气的多目标仲裁，通过分层、可解释的决策阶段（感知、规划、编排）综合专家策略并协调临床优先级，提供了更安全、可解释且适应性强的新范式。

Abstract: Mechanical ventilation for Acute Respiratory Distress Syndrome (ARDS) requires balancing competing physiological goals, including oxygenation, lung protection, and acid-base homeostasis. However, current data-driven methods, especially those imitating retrospective Electronic Health Records (EHR), often suffer from imitation bias. They may capture superficial correlations from inconsistent clinical demonstrations, such as associating passive ventilator settings with survival because such settings are common in stable patients, and thus fail to generalize to volatile or out-of-distribution phenotypes. Standard Reinforcement Learning (RL) methods also struggle with the adversarial trade-offs of critical care and often produce opaque policies with limited clinical interpretability. To address these limitations, we introduce VentAgent, a hierarchical framework in which Large Language Models (LLMs) act as transparent arbitrators for mechanical ventilation. We reformulate ventilation control as a dynamic Multi-Objective Arbitration process rather than single-objective optimization. VentAgent decomposes decision-making into three interpretable stages: Perception, Planning, and Orchestration. By leveraging the semantic reasoning capabilities of LLMs, it synthesizes strategies from heterogeneous experts and resolves conflicting clinical priorities through an explicit coordination mechanism. Evaluations on a high-fidelity physiological simulator show that VentAgent outperforms state-of-the-art RL and classical control baselines. Moreover, it converts control decisions into human-readable reasoning chains, offering a safer, more interpretable, and adaptable paradigm for critical care automation.

[109] Reproducing, Analyzing, and Detecting Reward Hacking in Rubric-Based Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Xuekang Wang, Zhuoyuan Hao, Shuo Hou, Hao Peng, Juanzi Li

TL;DR: 本文介绍了CHERRL，一个用于基于评分标准的强化学习（rubric-based RL）的可控黑客环境，旨在稳定复现、分析和检测奖励黑客（reward hacking）行为。通过向LLM-as-a-Judge（LaaJ）注入已知偏见，CHERRL能够观察奖励分歧并精确识别黑客行为的起始点，为研究奖励黑客的机制和缓解措施提供了一个干净的实验平台。

Details

Motivation: 基于评分标准的强化学习使用LLM作为评判员（LaaJ）根据评分标准对模型输出打分作为奖励，但策略模型可能利用评判员的潜在偏见，导致奖励黑客行为，从而产生无效或不安全的训练结果。在现实世界中，这类黑客行为往往微妙且与多种评判偏见交织，难以分析、检测和缓解。

Result: 论文通过CHERRL环境分析了不同评判偏见在可发现性和可利用性方面的表现，并探索了一个基于代理的系统，用于从训练日志中自动检测奖励黑客的起始点。

Insight: 创新点在于构建了一个可控的奖励黑客环境，能够稳定复现和精确识别黑客行为，为研究奖励黑客提供了实验基础；同时，从可发现性和可利用性角度分析评判偏见，并开发自动检测系统，有助于理解和缓解基于评分标准的强化学习中的安全问题。

Abstract: Rubric-based reinforcement learning (RL) uses an LLM-as-a-Judge (LaaJ) to score model outputs according to rubrics as rewards. However, policy models may exploit latent biases in the judge, leading to reward hacking and ineffective or unsafe training outcomes. In real-world rubric-based RL, such hacking behaviors are often subtle and entangled with multiple judge biases, making them difficult to analyze, detect, and mitigate. In this paper, we introduce CHERRL, a controllable hacking environment for rubric-based RL. By injecting known biases into LaaJ, CHERRL enables stable reproduction of reward hacking, explicit observation of reward divergence, and precise identification of hacking onset. This provides a clean experimental testbed for studying the mechanisms and mitigations of reward hacking in rubric-based RL. To demonstrate its utility, we analyze different judge biases from the perspectives of discoverability and exploitability, and explore an agent-based system for automatically detecting reward hacking onset from training logs. The code and environment are publicly available at https://github.com/THUAIS-Lab/CHERRL.

[110] Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control cs.LG | cs.AI | cs.CV | eess.SY | math.OCPDF

Jihoon Hong, Alice Chan, Qiyue Dai, Julian Skifstad, Glen Chou

TL;DR: 本文提出了一种名为LA-LQR的降阶线性最优控制框架，用于对文本到视频生成模型的激活进行微创干预。该方法将视频生成推理建模为动态系统，通过在低维潜在空间中计算闭环反馈信号，以引导模型激活朝向期望的特征设定点，同时减少有害内容生成并保持视觉质量。

Details

Motivation: 解决大规模训练的文本到视频模型可能生成不良内容的问题，现有激活引导方法通常干预粗糙、非预见性，容易导致过度引导和内容质量下降，因此需要一种更精细、侵入性更小的干预方法。

Result: 在概念引导和视频安全基准测试中，LA-LQR相比基线方法减少了不安全内容的生成，同时保持了提示忠实度和视觉质量。

Insight: 创新点在于将视频生成过程建模为动态系统并应用降阶线性二次型调节器进行最优控制，通过将高维激活投影到由对比提示对导出的低维任务相关子空间，实现了对模型激活的精确、可解释且计算可行的闭环引导。

Abstract: Text-to-video (T2V) models trained on large-scale web data can generate undesired content, motivating interventions that reduce harmful outputs without sacrificing visual quality. Activation steering offers an attractive mechanistic alternative to finetuning and prompt filtering, but existing T2V steering methods remain limited, typically applying coarse, non-anticipative interventions that can lead to oversteering and content degradation. To close this gap, we propose Latent Activation Linear-Quadratic Regulator (LA-LQR), a reduced-order optimal control framework for minimally invasive T2V steering. LA-LQR formulates T2V inference as a dynamical system and computes closed-loop feedback interventions that steer activations toward desired feature setpoints while penalizing unnecessary perturbations. To make optimal control feasible for high-dimensional video activations, we project activations onto a low-dimensional, task-relevant subspace derived from contrastive prompt pairs, estimate local linear dynamics in this latent space, and solve a latent LQR problem to obtain timestep- and layer-specific steering signals. We provide theoretical bounds relating latent setpoint tracking to raw activation-space feature control, and empirically validate the fidelity of the reduced latent dynamics. On concept steering and video safety benchmarks, LA-LQR reduces unsafe generations relative to baselines, while preserving prompt fidelity and visual quality.

[111] Failed Reasoning Traces Tell You What Is Fixable (But Not by Reading Them) cs.LG | cs.AI | cs.CLPDF

Nizar Islah, Istabrak Abbes, Irina Rish, Sarath Chandar, Eilif B. Muller

TL;DR: 本文提出利用语言模型推理失败轨迹中的分布特征来区分可恢复与不可恢复的失败，而非依赖轨迹文本内容。通过三个基于干预结构的轨迹特征，论文实现了对失败类型的聚类、不同后训练方法的失败地形分析，并支持无需训练的路由规则以提升干预效果。

Details

Motivation: 现有方法在语言模型推理失败时通常仅通过增加采样次数来应对，而忽略了失败轨迹本身所蕴含的关键信号——即某些失败源于采样运气（可通过重采样解决），而另一些则是结构性的、难以通过重采样纠正。

Result: 在Steerable-Hard子集（即重试不足且存在有限干预可达的失败案例）上，所提出的无训练路由规则将救援成功率提升了+12.2%。特征和路由规则在两个跨家族探针任务上实现了迁移，失败分类准确率达到84.3±4.3%，较多数类基线提升20%。

Insight: 创新点在于将失败轨迹从废弃数据转化为诊断对象，通过三个与干预结构相关的轨迹分布特征（而非文本内容）来编码可恢复性结构，从而支持测试时路由和后训练分析，且无需访问训练时数据或权重空间。

Abstract: When post-trained language models fail on reasoning problems, the common test-time-scaling response is to spend more compute on additional attempts, and the failed traces play no further role. We argue this discards a crucial signal; some failures come from unlucky sampling, where more rollouts help, while others are structural and resist resampling regardless of budget. We propose that failed traces encode recoverability structure: the inference-time signature of which test-time interventions can rescue a given failure. Three problem-level trajectory features, derived from the structure of available interventions, recover this structure from the distributional signature of failed rollouts, not their text. They cluster failures into stable regimes, characterize the failure topography of different post-training methods ($84.3{\pm}4.3%$ accuracy, $+20%$ over a majority-class baseline), and support a training-free routing rule that lifts rescue by $+12.2%$ on the deployment-relevant Steerable-Hard subset (failures where retry is insufficient and a bounded intervention is reachable). The features and the routing rule transfer across two cross-family probes. The same three features thus convert failed traces from discarded data into a diagnostic object, supporting test-time routing and post-training analysis without training-time or weight-space access.

[112] Reinforcement Learning from Rich Feedback with Distributional DAgger cs.LG | cs.AI | cs.CLPDF

Rishabh Agrawal, Jacob Fein-Ashley, Paria Rashidinejad

TL;DR: 本文提出了一种名为DistIL的分布化DAgger算法，用于从丰富的反馈（如执行轨迹、工具输出、专家修正和模型自评估）中进行强化学习，以替代传统的基于可验证奖励的强化学习（RLVR）。该方法通过前向交叉熵目标实现序列级梯度传播，将未来专家-学生分歧反向传播到早期决策，从而进行精细的信用分配。

Details

Motivation: 当前强化学习主要依赖简单的二元奖励（最终答案是否正确），但许多实际场景能提供更丰富的反馈信息，现有基于反向KL或Jensen-Shannon散度的自蒸馏目标无法保证策略的单调改进。

Result: 在科学推理、编程和解决复杂数学问题等多个领域，DistIL方法在Pass@N指标上优于RLVR和基于自蒸馏的基线方法，实现了性能提升。

Insight: 创新点在于提出了分布化DAgger变体，使用前向交叉熵目标保证策略单调改进和遗憾界，并通过序列级梯度传播实现精细信用分配，有效利用丰富反馈优化推理模型。

Abstract: Reasoning models have advanced rapidly, but the dominant reinforcement learning from verifiable rewards (RLVR) recipe remains surprisingly narrow: sample many responses and reward each with a single bit indicating whether the final answer is correct. Yet many settings provide rich feedback, including execution traces, tool outputs, expert corrections, and model self-evaluations. We study how to use such feedback through a distributional variant of the classic imitation learning algorithm DAgger, where the learner has local access to an expert distribution on states visited by the current policy. This yields a simple forward cross-entropy objective that admits a blackbox expert and whose sequence-level gradient {conduct rich credit assignment by propagating} future expert-student disagreement back to earlier decisions. We show that prior RL with self-distillation objectives based on reverse KL or Jensen-Shannon fail to guarantee monotonic policy improvement: even when the expert has higher reward, their updates may increase probability on worse actions. In contrast, we show that forward cross-entropy admits monotonic policy improvement and enjoys guarantees on regret. We further show that our objective optimizes a lower bound on teacher-weighted likelihood of success, leading to improved Pass@N. Empirically, our approach, DistIL, improves over RLVR and RL with self-distillation baselines across a variety of domains: scientific reasoning, coding, and solving hard mathematical problems.

cs.GR [Back]

[113] Geometry Gaussians: Decoupling Appearance and Geometry in Gaussian Splatting cs.GR | cs.CV | cs.LGPDF

Hongyu Zhou, Zorah Lähner

TL;DR: 本文指出3D高斯泼溅（3DGS）在同时表示纹理和几何时存在固有缺陷，并提出了一种简单有效的解决方案：为每个泼溅点引入一个额外的几何不透明度参数，并配合一个可选的透明度优化流程。该方法在多种数据集上，特别是包含透明物体的复杂场景中，显著提升了渲染质量和几何表示精度。

Details

Motivation: 3DGS在新视角合成上取得成功后，许多工作试图将其用于几何表面表示，但直接从3DGS提取精确几何信息仍具挑战，且常会损害外观渲染质量。本文旨在解决3DGS同时表示纹理与几何的固有问题。

Result: 实验表明，该方法在使用真实几何数据或视觉基础模型几何输入时，都能在多种数据集上提升渲染和几何性能，尤其在包含透明物体的复杂场景中受益显著。

Insight: 核心创新点在于通过一个额外的几何不透明度参数解耦了外观和几何表示，并提出了相应的优化流程。这为3DGS提供了一个简单而有效的修改，使其能更好地同时服务于渲染和几何重建任务。

Abstract: After the success of 3D Gaussian Splatting (3DGS) for novel view synthesis, many works have explored how to also use it for geometric surface representation. However, extracting accurate geometric information directly from 3DGS remains challenging and can often reduce the appearance rendering quality. In this work, we show that 3DGS in its default form is inheritedly unsuited to represent texture and geometry at the same time, by training with complete ground-truth texture and geometry information. We also propose a simple solution by applying a single additional geometry opacity parameter to each splat, together with an optional transparency-curated optimization pipeline. Our experiments, both with ground-truth and vision foundation model geometric input, show that this change leads to improved rendering and geometry performance on a wide variety of dataset, and especially complex scenes with transparent objects benefit significantly from our method.

cs.HC [Back]

Tianfu Wang, Max Xiong, Jianxun Lian, Hongyuan Zhu, Zhengyu Hu

TL;DR: 本文提出了SocialCoach，一个基于大语言模型的个性化社交技能学习系统，通过多智能体管道构建教学知识库，利用强化学习优化自适应练习调度，并结合沉浸式练习、因果驱动的能力评估和基于知识的反思性辅导来弥合‘知与行’的差距。该系统已在产品EQoach中部署，实验表明其在模拟路径质量和辅导质量上优于基线方法，并获得积极的早期用户反馈。

Details

Motivation: 解决在专家教练稀缺的情况下，如何大规模、有效地进行社交技能（如谈判、领导力）培训的挑战。

Result: 在模拟环境中，SocialCoach在路径质量和辅导质量上优于基线方法；早期用户反馈显示其具有较高的感知参与度和有用性。

Insight: 创新点在于构建了一个融合理论到实践的知识库、基于强化学习的自适应练习调度策略，以及集成了因果评估与反思辅导的端到端辅导系统架构，为软技能学习的个性化、游戏化教学平台提供了可行的设计范例。

Abstract: Social skills such as negotiation and leadership are crucial for personal and professional success in today’s interconnected world. However, scalable and effective training remains a significant challenge due to the scarcity of expert coaching. In this paper, we introduce SocialCoach, a holistic LLM-powered agentic tutoring system for personalized social skill development at scale. First, SocialCoach automatically constructs a pedagogically-grounded, theory-to-practice knowledge corpus from diverse expert sources, leveraging a multi-agent pipeline. Second, to personalize the learning journey, it employs an adaptive practice scheduling module that follows a prescription-retrieval-adaptation process. To maximize the long-term learning experience while overcoming the cold-start problem, this policy is optimized within a learner simulation environment through reinforcement learning. Finally, SocialCoach integrates immersive, goal-driven practice, causality-driven proficiency assessment and knowledge-grounded, reflective tutoring to help address the knowing-doing gap. We deploy it in our product, EQoach, and conduct extensive experiments. The results show that SocialCoach improves simulated pathway quality and judge-rated tutoring quality over baseline approaches, while early user feedback indicates strong perceived engagement and usefulness. These findings suggest a practical architecture for personalized and gamified pedagogical platforms on soft skill learning.

cs.RO [Back]

[115] PointAction: 3D Points as Universal Action Representations for Robot Control cs.RO | cs.CV | cs.LGPDF

Mutian Tong, Han Jiang, Qiao Feng, Lingjie Liu, Jiatao Gu

TL;DR: PointAction是一个通过基于点的4D建模将视频预测与机器人动作连接起来的框架。它微调基础视频生成模型，联合预测未来RGB帧和动态3D点云图，生成任务相关场景几何的时间一致3D运动。这些点动态作为结构化、与具体机器人无关的动作接口，由基于扩散的动作解码器映射到可执行的机器人动作，从而减少仅RGB动作接地的模糊性，并支持在有限动作监督下跨任务和机器人的迁移。

Details

Motivation: 现有视频动作模型（VAMs）仅依赖RGB视频预测，导致度量3D运动、接触几何和细粒度空间约束不明确，使得动作接地模糊，且跨多样任务和机器人的动作监督扩展成本高昂。

Result: PointAction在机器人场景上实现了最先进的4D生成质量，在模拟中超越了现有基线，并泛化到预训练期间未见过的两个真实机器人手臂。

Insight: 创新点在于使用度量3D点动态作为视频预测与控制之间的结构化接口，这减少了动作接地的模糊性，并支持跨任务和机器人的迁移学习；从客观角度看，将点云动态作为通用动作表示，结合视频扩散模型的微调，提供了一种可扩展且与具体机器人无关的机器人控制方法。

Abstract: Video-Action Models (VAMs) leverage the broad visual dynamics captured by pre-trained video diffusion models, offering a promising path toward generalizable robot manipulation. However, RGB-only video rollouts are not directly actionable: they leave metric 3D motion, contact geometry, and fine-grained spatial constraints under-specified, making action grounding ambiguous. Meanwhile, scaling action supervision across diverse tasks and embodiments remains costly. We present PointAction, a framework that bridges video predictions to robot actions through explicit point-based 4D modeling. PointAction fine-tunes a foundation video generation model to jointly predict future RGB frames and dynamic 3D pointmaps, producing temporally consistent 3D motion of task-relevant scene geometry. These point dynamics serve as a structured, embodiment-agnostic action interface, which a diffusion-based action decoder maps to executable robot actions. By using metric 3D point dynamics as the interface between video prediction and control, PointAction reduces the ambiguity of RGB-only action grounding and supports transfer across tasks and embodiments with limited action supervision. Experiments show that PointAction achieves state-of-the-art 4D generation quality on robot scenes, outperforms existing baselines in simulation, and generalizes to two real robot arms unseen during pretraining.

[116] Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation cs.RO | cs.AI | cs.CVPDF

Yilong Wang, Cheng Qian, Edward Johns

TL;DR: Instant-Fold是一个用于可变形物体操作（DOM）的上下文模仿学习框架。它仅需单个人类演示，就能推断并执行多种操作模式，无需梯度更新。该方法通过时序对比预训练学习变形感知的视觉表征，然后利用基于演示条件化的流匹配Transformer策略来预测动作，实现零样本从仿真到真实世界的迁移。

Details

Motivation: 解决可变形物体操作（DOM）中因高维、部分可观测状态、长时程交互以及存在多种有效操作模式所带来的挑战。

Result: 在仿真中训练后，Instant-Fold能够泛化到多种折叠模式，并实现零样本迁移到真实世界，无需额外数据收集或微调。

Insight: 创新点在于结合了上下文学习（单演示条件化）和流匹配Transformer来推断多样化的操作模式，并通过时序对比预训练学习鲁棒的变形感知表征，实现了高效、无需在线适应的零样本迁移。

Abstract: Deformable object manipulation (DOM) is challenging due to high-dimensional, partially observable states that evolve through long-horizon, topology-changing interactions with multiple valid manipulation modes. We introduce Instant-Fold, an in-context imitation learning framework for DOM. Given a single human demonstration, our policy infers and executes diverse manipulation modes directly from the demonstration, including variations in spatial execution and ordering, without requiring gradient updates. Our approach first learns deformation-aware visual representations via temporal contrastive pretraining, after which a flow-matching transformer policy conditioned on the demonstration predicts actions to execute the intended manipulation mode. Trained entirely in simulation, Instant-Fold generalizes across diverse folding modes and transfers zero-shot to real-world settings without additional data collection or finetuning. Videos are available at https://instant-fold.github.io.

Table of Contents

cs.CL [Back]

[1] SaliMory: Orchestrating Cognitive Memory for Conversational Agents cs.CL | cs.AIPDF

[2] MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A cs.CL | cs.AIPDF

[3] Supportive Token Revealing for Fast Diffusion Language Model Decoding cs.CL | cs.AI | cs.LGPDF

[4] Can I Take Another Dose? Evaluating LLM Decision-Making Under Temporal Uncertainty in OTC Dosing QA cs.CL | cs.AIPDF

[5] Parameter-Efficient Fine-Tuning with Learnable Rank cs.CLPDF

[6] DLLG: Dynamic Logit-Level Gating of LLM Experts cs.CLPDF

[7] Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs cs.CL | cs.LGPDF

[8] Read the Trace, Steer the Path: Trajectory-Aware Reinforcement Learning for Diffusion Language Models cs.CLPDF

[9] MemoryDocDataSet: A Benchmark for Joint Conversational Memory and Long Document Reasoning cs.CL | cs.AIPDF

[10] When Clients Stop Following: A Cognitive Conceptualization Diagram-driven Framework for Strategic Counseling cs.CLPDF

[11] Stepwise Reasoning Enhancement for LLMs via External Subgraph Generation cs.CLPDF

[12] Listening to the Workforce: Measuring Construction Worker Safety Attitudes from Social Media Discourse Using LLMs cs.CL | cs.CYPDF

[13] SePO: Self-Evolving Prompt Agent for System Prompt Optimization cs.CL | cs.AIPDF

[14] Learning What to Learn: Stage-Specific Data Sets for SFT-then-RL in Small Language Model Reasoning cs.CLPDF

[15] Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention cs.CL | eess.ASPDF

[16] Self-Evolving Deep Research via Joint Generation and Evaluation cs.CL | cs.AIPDF

[17] Dynamic Infilling Anchors for Format-Constrained Generation in Diffusion Large Language Models cs.CL | cs.AIPDF

[18] LDARNet: DNA Adaptive Representation Network with Learnable Tokenization for Genomic Modeling cs.CL | q-bio.GNPDF

[19] VCIFBench: Evaluating Complex Instruction Following for Video Understanding cs.CLPDF

[20] Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues cs.CL | cs.CVPDF

[21] A Systematic Evaluation of Positional Bias in Multi-Video Summarization with MLLMs cs.CLPDF

[22] CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts cs.CL | cs.LGPDF

[23] SMADE-IE: Sparse Multi-Agent Framework with Evidence-Driven Debate for Zero-Shot Information Extraction cs.CLPDF

[24] DuDi: Dual-Signal Distillation with Cross-Lingual Verbalizer cs.CLPDF

[25] Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM cs.CLPDF

[26] Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents cs.CLPDF

[27] GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards cs.CLPDF

[28] Caliper: Probing Lexical Anchors versus Causal Structure in LLMs cs.CL | cs.IRPDF

[29] SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs cs.CLPDF

[30] DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving cs.CL | cs.AI | cs.HCPDF

[31] GARL: Game-Theoretic Reinforcement Learning for Multi-Agent Strategic Prioritisation cs.CLPDF

[32] DAR: Deontic Reasoning with Agentic Harnesses cs.CL | cs.AIPDF

[33] Imbuing Large Language Models with Bidirectional Logic for Robust Chain Repair cs.CL | cs.SCPDF

[34] Boosting Self-Consistency with Ranking cs.CLPDF

[35] Arithmetic Pedagogy for Language Models cs.CL | cs.AI | cs.CYPDF

[36] Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data cs.CLPDF

[37] Streaming Communication in Multi-Agent Reasoning cs.CL | cs.AI | cs.MAPDF

cs.CV [Back]

[38] Dive into the Scene: Breaking the Perceptual Bottleneck in Vision-Language Decision Making via Focus Plan Generation cs.CV | cs.AI | cs.CL | cs.LG | cs.ROPDF

[39] Weakly Supervised Incremental Segmentation via Semantic Anchors and Spatial Arbitration cs.CVPDF

[40] Intra-Modal Neighbors Never Lie: Rectifying Inter-Modal Noisy Correspondence via Graph-Based Intra-Modal Reasoning cs.CVPDF

[41] When Seeing Is Not Believing – A Benchmark for Search-Grounded Video Misinformation Detection cs.CVPDF

[42] Pinpoint: Grounded Worldwide Image Geolocation via Cross-Source Retrieval and Reranking cs.CVPDF

[43] GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs cs.CVPDF

[44] Spatial Artifact Coherence Determines Codec Robustness in Patch-Based rPPG cs.CVPDF

[45] UniCanvas: A Diffusion-base Unified Model for Text-in-Image Joint Generation cs.CVPDF

[46] Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1) cs.CV | cs.AI | cs.CLPDF

[47] StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets cs.CV | cs.AIPDF

[48] FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs cs.CVPDF

[49] A Cookbook of 3D Vision: Data, Learning Paradigms, and Application cs.CVPDF

[50] Answer Self-Consistency with Margin-Triggered Question Re-Arbitration for the CVPR 2026 VidLLMs Challenge cs.CVPDF

[51] HYolo: An Intelligent IoT-Based Object Detection System Using Hypergraph Learning cs.CV | cs.AI | cs.LGPDF

[52] MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models cs.CV | cs.AIPDF

[53] Video2LoRA: Parametric Video Internalization for Vision-Language Models cs.CV | cs.CLPDF

[54] Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers cs.CV | cs.AIPDF

[55] Spatially Grounded Concept Bottleneck Models via Part-Factorized Attention cs.CV | cs.LGPDF

[56] Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models cs.CVPDF

[57] An Empirical Study of Data Scale, Model Complexity, and Input Modalities in Visual Generalization cs.CV | cs.AI | cs.LGPDF

[58] Ultra-Fast Neural Video Compression cs.CVPDF

[59] DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation cs.CVPDF

[60] Stateful Visual Encoders for Vision-Language Models cs.CV | cs.CL | cs.LGPDF

[61] Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning cs.CV | cs.LGPDF

[62] 3DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training cs.CV | cs.ROPDF

[63] Radiomic Feature Selection Using Gradient Loss of Deep Neural Network for Lung Cancer Stage Detection cs.CV | cs.LGPDF

[64] ChannelTok: Efficient Flexible-Length Vision Tokenization cs.CVPDF

[65] Evaluating Reasoning Fidelity in Visual Text Generation cs.CV | cs.AI | cs.CLPDF

[66] IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation cs.CV | cs.HCPDF

[67] 4D Reconstruction from Sparse Dynamic Cameras cs.CVPDF

[68] Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization cs.CVPDF

[69] COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations cs.CVPDF

[70] Beyond Symmetric Alignment: Spectral Diagnostics of Modality Imbalance in Vision-Language Models in the Medical Domain cs.CV | cs.LGPDF

[71] Real-Time Automatic License Plate Recognition Using YOLOv8, SORT Tracking, and Temporal Data Interpolation cs.CV | cs.AIPDF

[72] ReConFuse: Reconstruction-Error Guided Semantic Fusion for AI-Generated Video Detection cs.CVPDF

[73] Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms cs.CV | cs.CLPDF

[74] Physics-Informed Video Generation via Mixture-of-Experts Latent Alignment cs.CVPDF

[75] Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction cs.CV | cs.AIPDF

[76] Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives cs.CV | cs.ROPDF

[77] NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models cs.CV | cs.CLPDF