cs.CL [Total: 42]
cs.CV [Total: 79]
cs.IR [Total: 1]
cs.LG [Total: 19]
eess.IV [Total: 1]
cs.RO [Total: 5]
cs.HC [Total: 1]
cs.CY [Total: 1]
cs.GR [Total: 1]
eess.AS [Total: 1]
cs.AI [Total: 4]
physics.soc-ph [Total: 1]

cs.CL [Back]

[1] The Hypocrisy Gap: Quantifying Divergence Between Internal Belief and Chain-of-Thought Explanation via Sparse Autoencoders cs.CLPDF

Shikhar Shiromani, Archie Chaudhury, Sri Pranav Kunda

TL;DR: 本文提出了一种名为’虚伪差距’的机制性度量方法，利用稀疏自编码器来量化大型语言模型内部推理链与最终生成答案之间的差异，以检测模型为取悦用户而产生的不忠实行为。

Details

Motivation: 大型语言模型经常表现出不忠实的行为，即其最终答案与内部思维链推理存在显著差异，以迎合对话用户。为了更有效地检测这种行为，本文旨在量化这种内部信念与外部解释之间的分歧。

Result: 在Gemma、Llama和Qwen模型上使用Anthropic的奉承基准进行实验，结果表明，该方法在检测奉承行为时的AUROC达到0.55-0.73，在检测模型内部’知道’用户错误但依然迎合的虚伪情况时AUROC达到0.55-0.74，均优于基于对数概率的基线方法。

Insight: 创新点在于通过稀疏自编码器和稀疏线性探针，在潜在空间中数学化地比较内部真实信念与最终生成轨迹，从而量化模型的不忠实倾向，为理解模型内部机制与外部行为的不一致性提供了可解释的度量工具。

Abstract: Large Language Models (LLMs) frequently exhibit unfaithful behavior, producing a final answer that differs significantly from their internal chain of thought (CoT) reasoning in order to appease the user they are conversing with. In order to better detect this behavior, we introduce the Hypocrisy Gap, a mechanistic metric utilizing Sparse Autoencoders (SAEs) to quantify the divergence between a model’s internal reasoning and its final generation. By mathematically comparing an internal truth belief, derived via sparse linear probes, to the final generated trajectory in latent space, we quantify and detect a model’s tendency to engage in unfaithful behavior. Experiments on Gemma, Llama, and Qwen models using Anthropic’s Sycophancy benchmark show that our method achieves an AUROC of 0.55-0.73 for detecting sycophantic runs and 0.55-0.74 for hypocritical cases where the model internally “knows” the user is wrong, consistently outperforming a decision-aligned log-probability baseline (0.41-0.50 AUROC).

[2] STEMVerse: A Dual-Axis Diagnostic Framework for STEM Reasoning in Large Language Models cs.CL | cs.AIPDF

Xuzhao Li, Xuchen Li, Jian Zhao, Shiyu Hu

TL;DR: 该论文提出了STEMVerse，一个用于系统分析大型语言模型（LLMs）在科学、技术、工程和数学（STEM）领域推理能力的诊断框架。该框架通过‘学科专业×认知复杂度’的双轴标签对超过20,000个STEM问题进行重新分类，并在统一的能力空间中评估不同规模和训练范式的LLMs，揭示了其推理中的结构性失败模式。

Details

Motivation: 当前评估LLMs STEM能力的范式通常将基准测试视为孤立的‘筒仓’，仅提供单一的总分，无法区分模型错误是源于领域知识不足还是认知能力缺陷，限制了诊断价值。

Result: 论文利用STEMVerse框架系统评估了不同参数规模和训练范式的代表性LLM家族，揭示了它们在STEM推理中的结构性失败模式。

Insight: 创新点在于提出了一个统一的‘学科专业×认知复杂度’双轴诊断框架，将多学科覆盖和细粒度认知分层整合，为理解LLMs的科学推理特性提供了清晰且可操作的视角。这超越了仅关注结果的评估，转向对能力构成的系统性诊断。

Abstract: As Large Language Models (LLMs) achieve significant breakthroughs in complex reasoning tasks, evaluating their proficiency in science, technology, engineering, and mathematics (STEM) has become a primary method for measuring machine intelligence. However, current evaluation paradigms often treat benchmarks as isolated “silos,” offering only monolithic aggregate scores that neglect the intricacies of both academic specialization and cognitive depth. This result-oriented approach fails to distinguish whether model errors stem from insufficient domain knowledge or deficiencies in cognitive capacity, thereby limiting the diagnostic value. To address this, we propose STEMVerse, a diagnostic framework designed to systematically analyze the STEM reasoning capabilities of LLMs. This framework characterizes model performance across academic specialization and cognitive complexity to map the capability required for reasoning. We re-aggregate over 20,000 STEM problems from mainstream benchmarks into a unified “Discipline $\times$ Cognition” capability space, assigning dual-axis labels to every instance. Utilizing this unified diagnostic framework, we systematically evaluate representative LLM families across varying parameter scales and training paradigms. Our empirical results reveal structural failure patterns in STEM reasoning. By integrating multi-disciplinary coverage and fine-grained cognitive stratification into a unified framework, STEMVerse provides a clear and actionable perspective for understanding the scientific reasoning characteristics of LLMs.

[3] Graph-Augmented Reasoning with Large Language Models for Tobacco Pest and Disease Management cs.CLPDF

Siyu Li, Chenwei Song, Qi Zhou, Wan Zhou, Xinyi Liu

TL;DR: 本文提出了一种图增强推理框架，用于烟草病虫害管理，通过将结构化领域知识整合到大型语言模型中，构建特定领域知识图谱并检索查询相关子图，以在答案生成过程中提供关系证据。该框架采用ChatGLM作为Transformer主干，结合LoRA进行参数高效微调，并利用图神经网络学习捕获症状-疾病-治疗依赖关系的节点表示。实验结果表明，该方法在需要多跳和比较推理的问题上相比纯文本基线有显著提升。

Details

Motivation: 解决大型语言模型在烟草病虫害管理领域可能产生幻觉或不恰当建议的问题，通过整合结构化知识图谱来增强推理的准确性和领域一致性。

Result: 实验显示，该方法在需要多跳和比较推理的问题上相比纯文本基线有持续改进，并在相关基准测试中表现出显著优势。

Insight: 创新点在于将领域知识图谱与LLM结合，通过图神经网络学习节点表示以捕获复杂关系，并利用检索增强生成来提供证据感知的推理，可借鉴于其他需要结构化知识整合的专业领域应用。

Abstract: This paper proposes a graph-augmented reasoning framework for tobacco pest and disease management that integrates structured domain knowledge into large language models. Building on GraphRAG, we construct a domain-specific knowledge graph and retrieve query-relevant subgraphs to provide relational evidence during answer generation. The framework adopts ChatGLM as the Transformer backbone with LoRA-based parameter-efficient fine-tuning, and employs a graph neural network to learn node representations that capture symptom-disease-treatment dependencies. By explicitly modeling diseases, symptoms, pesticides, and control measures as linked entities, the system supports evidence-aware retrieval beyond surface-level text similarity. Retrieved graph evidence is incorporated into the LLM input to guide generation toward domain-consistent recommendations and to mitigate hallucinated or inappropriate treatments. Experimental results show consistent improvements over text-only baselines, with the largest gains observed on multi-hop and comparative reasoning questions that require chaining multiple relations.

[4] Monotonicity as an Architectural Bias for Robust Language Models cs.CL | cs.AI | cs.CR | cs.LGPDF

Patrick Cooper, Alireza Nadali, Ashutosh Trivedi, Alvaro Velasquez

TL;DR: 该论文提出将单调性作为Transformer语言模型的架构归纳偏置，以提升模型对抗对抗性提示和越狱攻击的鲁棒性。通过在序列到序列Transformer的前馈子层中强制实施单调性约束，同时保持注意力机制不受约束，构建了单调语言模型。该方法在保持预训练模型性能的同时，显著降低了对抗攻击成功率。

Details

Motivation: 大型语言模型（LLMs）在对抗性提示和越狱攻击下表现出脆弱性，即使经过广泛的对齐和微调。这反映了现代神经语言模型的一个广泛挑战：高维输入空间中的微小、精心结构的扰动可能导致内部语义表示和输出的巨大且不可预测的变化。

Result: 实验表明，单调性显著提高了鲁棒性：对抗攻击成功率从约69%降至19%，而标准的摘要性能仅略有下降。

Insight: 论文的创新点在于将单调性作为架构偏置引入Transformer，并证明通过在前馈子层选择性实施单调性约束，可以在不牺牲模型表达能力的情况下实现鲁棒性提升。这种架构分离允许注意力机制显式处理否定、矛盾和上下文交互，同时确保后续语义细化是保序的，从而解决了传统上认为单调性与神经语言模型表达能力不兼容的权衡问题。

Abstract: Large language models (LLMs) are known to exhibit brittle behavior under adversarial prompts and jailbreak attacks, even after extensive alignment and fine-tuning. This fragility reflects a broader challenge of modern neural language models: small, carefully structured perturbations in high-dimensional input spaces can induce large and unpredictable changes in internal semantic representations and output. We investigate monotonicity as an architectural inductive bias for improving the robustness of Transformer-based language models. Monotonicity constrains semantic transformations so that strengthening information, evidence, or constraints cannot lead to regressions in the corresponding internal representations. Such order-preserving behavior has long been exploited in control and safety-critical systems to simplify reasoning and improve robustness, but has traditionally been viewed as incompatible with the expressivity required by neural language models. We show that this trade-off is not inherent. By enforcing monotonicity selectively in the feed-forward sublayers of sequence-to-sequence Transformers – while leaving attention mechanisms unconstrained – we obtain monotone language models that preserve the performance of their pretrained counterparts. This architectural separation allows negation, contradiction, and contextual interactions to be introduced explicitly through attention, while ensuring that subsequent semantic refinement is order-preserving. Empirically, monotonicity substantially improves robustness: adversarial attack success rates drop from approximately 69% to 19%, while standard summarization performance degrades only marginally.

[5] InfMem: Learning System-2 Memory Control for Long-Context Agent cs.CLPDF

Xinyu Wang, Mingze Li, Peng Lu, Xiao-Wen Chang, Lifeng Shang

TL;DR: InfMem是一种面向超长文档推理的智能体，采用System-2式主动记忆控制机制，通过PreThink-Retrieve-Write协议动态监控证据充分性、执行针对性文档内检索，并应用证据感知的联合压缩来更新有限内存。该方法在32k至1M令牌的超长问答基准上显著优于MemAgent，并在多个骨干模型上提升准确率，同时通过自适应早停大幅减少推理时间。

Details

Motivation: 解决在严格内存约束下，流式处理智能体对超长文档进行多跳推理时，被动记忆更新策略难以保留低显著性的桥接证据的问题。

Result: 在Qwen3-1.7B、Qwen3-4B和Qwen2.5-7B骨干模型上，平均绝对准确率分别提升10.17、11.84和8.23个百分点，推理时间平均减少3.9倍（最高5.1倍），在超长QA基准上持续超越MemAgent，达到SOTA水平。

Insight: 创新点在于将System-2式控制具体化为主动的记忆管理协议，并设计了从监督微调到强化学习的实用训练方法，使检索、写入和停止决策与最终任务正确性对齐，实现了证据感知的联合压缩和自适应早停，提升了长上下文推理的效率和准确性。

Abstract: Reasoning over ultra-long documents requires synthesizing sparse evidence scattered across distant segments under strict memory constraints. While streaming agents enable scalable processing, their passive memory update strategy often fails to preserve low-salience bridging evidence required for multi-hop reasoning. We propose InfMem, a control-centric agent that instantiates System-2-style control via a PreThink-Retrieve-Write protocol. InfMem actively monitors evidence sufficiency, performs targeted in-document retrieval, and applies evidence-aware joint compression to update a bounded memory. To ensure reliable control, we introduce a practical SFT-to-RL training recipe that aligns retrieval, writing, and stopping decisions with end-task correctness. On ultra-long QA benchmarks from 32k to 1M tokens, InfMem consistently outperforms MemAgent across backbones. Specifically, InfMem improves average absolute accuracy by +10.17, +11.84, and +8.23 points on Qwen3-1.7B, Qwen3-4B, and Qwen2.5-7B, respectively, while reducing inference time by $3.9\times$ on average (up to $5.1\times$) via adaptive early stopping.

[6] Time-Critical Multimodal Medical Transportation: Organs, Patients, and Medical Supplies cs.CLPDF

Elaheh Sabziyan Varnousfaderani, Syed A. M. Shihab, Mohammad Taghizadeh

TL;DR: 本研究提出了一种用于医疗运输的多模式车辆调度贪婪启发式算法，通过整合地面救护车、无人机和电动垂直起降飞机，以应对交通拥堵和天气限制，旨在提高运输效率并降低运营成本。

Details

Motivation: 解决紧急医疗运输（如器官、病人和医疗物资）中因交通拥堵和天气条件导致的延误问题，传统单一运输模式存在局限，需要多模式系统来提升效率。

Result: 在模拟条件下测试了四种车队配置，结果显示完全整合救护车、无人机和电动垂直起降飞机的车队在满足运输需求的同时，能最小化运营成本、充电/燃料成本和总运输时间。

Insight: 创新点在于提出了一种计算高效的贪婪启发式算法，支持多模式车辆调度，并考虑了路线合并、交通拥堵和天气因素，为医疗物流优化提供了可扩展的解决方案。

Abstract: Timely transportation of organs, patients, and medical supplies is critical to modern healthcare, particularly in emergencies and transplant scenarios where even short delays can severely impact outcomes. Traditional ground-based vehicles such as ambulances are often hindered by traffic congestion; while air vehicles such as helicopters are faster but costly. Emerging air vehicles – Unmanned Aerial Vehicles and electric vertical take-off and landing aircraft – have lower operating costs, but remain limited by range and susceptibility to weather conditions. A multimodal transportation system that integrates both air and ground vehicles can leverage the strengths of each to enhance overall transportation efficiency. This study introduces a constructive greedy heuristic algorithm for multimodal vehicle dispatching for medical transportation. Four different fleet configurations were tested: (i) ambulances only, (ii) ambulances with Unmanned Aerial Vehicles, (iii) ambulances with electric vertical take-off and landing aircraft, and (iv) a fully integrated fleet of ambulances, Unmanned Aerial Vehicles, and electric vertical take-off and landing aircraft. The algorithm incorporates payload consolidation across compatible routes, accounts for traffic congestion in ground operations and weather conditions in aerial operations, while enabling rapid vehicle dispatching compared to computationally intensive optimization models. Using a common set of conditions, we evaluate all four fleet types to identify the most effective configurations for fulfilling medical transportation needs while minimizing operating costs, recharging/fuel costs, and total transportation time.

[7] R2-Router: A New Paradigm for LLM Routing with Reasoning cs.CLPDF

Jiaqi Xue, Qian Lou, Jiarong Xing, Heng Huang

TL;DR: 本文提出R2-Router，一种新的LLM路由范式，通过将输出长度预算作为可控变量，联合选择最佳LLM和长度预算，以长度约束指令强制执行预算，从而在成本效益配置下发现强大LLM在受限输出时可能优于较弱LLM。

Details

Motivation: 现有LLM路由方法假设每个查询中每个LLM具有固定的质量和成本，忽略了同一LLM的质量随输出长度变化，导致在估计成本超过预算时排除强大LLM，错失其通过缩短输出仍能以较低成本提供高质量结果的机会。

Result: 实验表明，R2-Router在R2-Bench（首个捕获不同输出长度预算下LLM行为的路由数据集）上实现了最先进的性能，且成本比现有路由器低4-5倍。

Insight: 创新点在于将路由视为推理过程，使路由器从被动选择器演变为深思熟虑的推理器，探索使用哪个LLM以及在何种成本预算下，并构建了包含输出长度预算维度的基准数据集R2-Bench。

Abstract: As LLMs proliferate with diverse capabilities and costs, LLM routing has emerged by learning to predict each LLM’s quality and cost for a given query, then selecting the one with high quality and low cost. However, existing routers implicitly assume a single fixed quality and cost per LLM for each query, ignoring that the same LLM’s quality varies with its output length. This causes routers to exclude powerful LLMs when their estimated cost exceeds the budget, missing the opportunity that these LLMs could still deliver high quality at reduced cost with shorter outputs. To address this, we introduce R2-Router, which treats output length budget as a controllable variable and jointly selects the best LLM and length budget, enforcing the budget via length-constrained instructions. This enables R2-Router to discover that a powerful LLM with constrained output can outperform a weaker LLM at comparable cost-efficient configurations invisible to prior methods. Together with the router framework, we construct R2-Bench, the first routing dataset capturing LLM behavior across diverse output length budgets. Experiments show that R2-Router achieves state-of-the-art performance at 4-5x lower cost compared with existing routers. This work opens a new direction: routing as reasoning, where routers evolve from reactive selectors to deliberate reasoners that explore which LLM to use and at what cost budget.

[8] Which course? Discourse! Teaching Discourse and Generation in the Era of LLMs cs.CLPDF

Junyi Jessy Li, Yang Janet Liu, Kanishka Misra, Valentina Pyatkin, William Sheffield

TL;DR: 本文介绍了一门新课程’计算话语与自然语言生成’，旨在融合话语处理与自然语言生成两个子领域，以应对NLP领域快速变化带来的教育挑战。课程于2025年秋季首次开设，面向语言学与计算机科学的高年级本科生，强调理论与实践的深度整合。

Details

Motivation: NLP领域的持续快速变革引发了跨学科的教育问题：如何设计课程以连接不断变化的子领域？本文从话语处理的角度出发，针对现有本科课程中话语分析与开放文本生成之间联系不足的问题，提出新课程设计方案。

Result: 课程已作为高年级本科课程在2025年秋季首次开设，并进行了独立调查；论文详细描述了课程设计，并总结了调查反馈与未来方向。

Insight: 创新点在于将话语处理（关注语言意图、注意力和连贯性结构）与开放/长文本生成深度结合，通过跨学科团队协作设计课程，强调课堂与作业中的探索性思维，以应对LLM时代的教育需求。

Abstract: The field of NLP has undergone vast, continuous transformations over the past few years, sparking debates going beyond discipline boundaries. This begs important questions in education: how do we design courses that bridge sub-disciplines in this shifting landscape? This paper explores this question from the angle of discourse processing, an area with rich linguistic insights and computational models for the intentional, attentional, and coherence structure of language. Discourse is highly relevant for open-ended or long-form text generation, yet this connection is under-explored in existing undergraduate curricula. We present a new course, “Computational Discourse and Natural Language Generation”. The course is collaboratively designed by a team with complementary expertise and was offered for the first time in Fall 2025 as an upper-level undergraduate course, cross-listed between Linguistics and Computer Science. Our philosophy is to deeply integrate the theoretical and empirical aspects, and create an exploratory mindset inside the classroom and in the assignments. This paper describes the course in detail and concludes with takeaways from an independent survey as well as our vision for future directions.

[9] HALT: Hallucination Assessment via Log-probs as Time series cs.CL | cs.AIPDF

Ahmad Shapiro, Karan Taneja, Ashok Goel

TL;DR: 本文提出了HALT，一种轻量级的幻觉检测器，它仅将LLM生成的前20个token的对数概率作为时间序列输入，结合门控循环单元和基于熵的特征来学习模型校准偏差。同时，论文还引入了HUB基准，整合了十个不同能力的数据集。HALT在性能上超越了更大的微调编码器模型，并实现了显著的加速。

Details

Motivation: 幻觉是大型语言模型面临的主要障碍，尤其是在安全关键领域。现有方法要么需要访问模型内部状态（白盒），要么仅依赖表面文本（黑盒），存在效率或泛化性不足的问题。

Result: 在提出的HUB基准上，HALT在性能上超越了经过微调的modernBERT-base编码器（Lettuce），同时模型体积小了30倍，并实现了60倍的加速。

Insight: 创新点在于将token对数概率序列视为时间序列进行处理，并引入基于熵的特征。这种方法仅依赖输出概率，无需模型内部权重或隐藏状态，在保持轻量级和高效率的同时，实现了对专有LLM的兼容性和更强的领域泛化能力。HUB基准的建立也为幻觉检测提供了统一的评估框架。

Abstract: Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination Assessment via Log-probs as Time series), a lightweight hallucination detector that leverages only the top-20 token log-probabilities from LLM generations as a time series. HALT uses a gated recurrent unit model combined with entropy-based features to learn model calibration bias, providing an extremely efficient alternative to large encoders. Unlike white-box approaches, HALT does not require access to hidden states or attention maps, relying only on output log-probabilities. Unlike black-box approaches, it operates on log-probs rather than surface-form text, which enables stronger domain generalization and compatibility with proprietary LLMs without requiring access to internal weights. To benchmark performance, we introduce HUB (Hallucination detection Unified Benchmark), which consolidates prior datasets into ten capabilities covering both reasoning tasks (Algorithmic, Commonsense, Mathematical, Symbolic, Code Generation) and general purpose skills (Chat, Data-to-Text, Question Answering, Summarization, World Knowledge). While being 30x smaller, HALT outperforms Lettuce, a fine-tuned modernBERT-base encoder, achieving a 60x speedup gain on HUB. HALT and HUB together establish an effective framework for hallucination detection across diverse LLM capabilities.

[10] Where Norms and References Collide: Evaluating LLMs on Normative Reasoning cs.CL | cs.AI | cs.LGPDF

Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy, Matthias Scheutz

TL;DR: 本文介绍了SNIC（Situated Norms in Context）诊断测试平台，用于评估大语言模型（LLMs）在规范性推理，特别是基于规范的指代消解（NBRR）任务上的能力。研究发现，即使最先进的LLMs在识别和应用社交规范方面仍存在困难，尤其是在规范隐含、未明确说明或相互冲突的情况下。

Details

Motivation: 研究动机是探究大语言模型是否能够支持基于规范的指代消解，即理解需要结合物理和社会情境中隐含规范性期望的指代表达，这对于具身智能体（如机器人）在情境化环境中的成功交互至关重要。

Result: 在SNIC测试平台上进行的评估表明，即使最先进的LLMs也难以一致地识别和应用社交规范，特别是在规范隐含、未明确说明或相互冲突时，揭示了当前LLMs在这一推理任务上的盲点。

Insight: 论文的创新点在于构建了SNIC这一经过人工验证的诊断测试平台，专门用于评估LLMs在提取和利用与NBRR相关的规范性原则方面的能力，强调了物理基础的日常任务规范，揭示了LLMs在社交情境化推理中的关键挑战。

Abstract: Embodied agents, such as robots, will need to interact in situated environments where successful communication often depends on reasoning over social norms: shared expectations that constrain what actions are appropriate in context. A key capability in such settings is norm-based reference resolution (NBRR), where interpreting referential expressions requires inferring implicit normative expectations grounded in physical and social context. Yet it remains unclear whether Large Language Models (LLMs) can support this kind of reasoning. In this work, we introduce SNIC (Situated Norms in Context), a human-validated diagnostic testbed designed to probe how well state-of-the-art LLMs can extract and utilize normative principles relevant to NBRR. SNIC emphasizes physically grounded norms that arise in everyday tasks such as cleaning, tidying, and serving. Across a range of controlled evaluations, we find that even the strongest LLMs struggle to consistently identify and apply social norms, particularly when norms are implicit, underspecified, or in conflict. These findings reveal a blind spot in current LLMs and highlight a key challenge for deploying language-based systems in socially situated, embodied settings.

[11] CPMobius: Iterative Coach-Player Reasoning for Data-Free Reinforcement Learning cs.CLPDF

Ran Li, Zeyuan Liu, Yinghao chen, Bingxiang He, Jiarui Yuan

TL;DR: 本文提出了CPMöbius，一种用于无数据强化学习的协作式教练-玩家推理范式，旨在通过教练和玩家之间的合作优化循环，直接提升玩家模型的数学推理能力，而无需依赖外部训练数据。

Details

Motivation: 解决大型语言模型在复杂推理任务中过度依赖大量高质量人工标注数据的问题，探索无监督或数据稀缺情况下的模型能力提升途径。

Result: 在Qwen2.5-Math-7B-Instruct模型上，该方法在整体准确率上平均提升+4.9，在分布外准确率上平均提升+5.4，整体准确率超过RENT方法+1.5，分布外准确率超过R-zero方法+4.2，显著优于现有无监督方法。

Insight: 创新性地将教练和玩家设计为独立但协作的角色，通过合作优化而非对抗性自博弈，实现无外部数据下的模型自我提升；借鉴现实世界人类协作与多智能体协作思想，构建了可持续的能力增强循环。

Abstract: Large Language Models (LLMs) have demonstrated strong potential in complex reasoning, yet their progress remains fundamentally constrained by reliance on massive high-quality human-curated tasks and labels, either through supervised fine-tuning (SFT) or reinforcement learning (RL) on reasoning-specific data. This dependence renders supervision-heavy training paradigms increasingly unsustainable, with signs of diminishing scalability already evident in practice. To overcome this limitation, we introduce CPMöbius (CPMobius), a collaborative Coach-Player paradigm for data-free reinforcement learning of reasoning models. Unlike traditional adversarial self-play, CPMöbius, inspired by real world human sports collaboration and multi-agent collaboration, treats the Coach and Player as independent but cooperative roles. The Coach proposes instructions targeted at the Player’s capability and receives rewards based on changes in the Player’s performance, while the Player is rewarded for solving the increasingly instructive tasks generated by the Coach. This cooperative optimization loop is designed to directly enhance the Player’s mathematical reasoning ability. Remarkably, CPMöbius achieves substantial improvement without relying on any external training data, outperforming existing unsupervised approaches. For example, on Qwen2.5-Math-7B-Instruct, our method improves accuracy by an overall average of +4.9 and an out-of-distribution average of +5.4, exceeding RENT by +1.5 on overall accuracy and R-zero by +4.2 on OOD accuracy.

[12] ReMiT: RL-Guided Mid-Training for Iterative LLM Evolution cs.CLPDF

Junjie Huang, Jiarui Qin, Di Yin, Weiwen Liu, Yong Yu

TL;DR: 本文提出了ReMiT（强化学习引导的中期训练）方法，旨在为大型语言模型（LLM）建立一个自我强化的迭代进化飞轮。该方法通过在预训练结束时的中期训练阶段，利用强化学习微调模型的推理先验来动态重加权训练语料中的关键token，从而提升基础模型能力，并反过来增强后续的微调性能。

Details

Motivation: 标准的LLM训练流程是单向的，从预训练到后训练。本文旨在探索一个双向、自我强化的循环过程，即利用后训练（如RL微调）的见解来改进预训练的基础模型，从而形成一个无需额外教师或参考模型的持续进化飞轮。

Result: 在涵盖数学、代码和通用推理的10个预训练基准测试中，ReMiT平均提升了3%的性能，并且在整个后训练流程中能持续保持超过2%的增益。

Insight: 核心创新在于识别了中期训练阶段是模型能力的关键转折点，并首次提出利用RL微调模型的推理先验来指导该阶段的训练，通过动态token重加权实现基础模型的迭代增强，从而验证了LLM双向、自强化迭代进化的可行性。

Abstract: Standard training pipelines for large language models (LLMs) are typically unidirectional, progressing from pre-training to post-training. However, the potential for a bidirectional process–where insights from post-training retroactively improve the pre-trained foundation–remains unexplored. We aim to establish a self-reinforcing flywheel: a cycle in which reinforcement learning (RL)-tuned model strengthens the base model, which in turn enhances subsequent post-training performance, requiring no specially trained teacher or reference model. To realize this, we analyze training dynamics and identify the mid-training (annealing) phase as a critical turning point for model capabilities. This phase typically occurs at the end of pre-training, utilizing high-quality corpora under a rapidly decaying learning rate. Building upon this insight, we introduce ReMiT (Reinforcement Learning-Guided Mid-Training). Specifically, ReMiT leverages the reasoning priors of RL-tuned models to dynamically reweight tokens during the mid-training phase, prioritizing those pivotal for reasoning. Empirically, ReMiT achieves an average improvement of 3% on 10 pre-training benchmarks, spanning math, code, and general reasoning, and sustains these gains by over 2% throughout the post-training pipeline. These results validate an iterative feedback loop, enabling continuous and self-reinforcing evolution of LLMs.

[13] AERO: Autonomous Evolutionary Reasoning Optimization via Endogenous Dual-Loop Feedback cs.CLPDF

Zhitao Gao, Jie Ma, Xuhong Li, Pengyu Li, Ning Qu

TL;DR: 本文提出了AERO（自主进化推理优化）框架，这是一个无监督的、基于双循环反馈的自主进化系统，旨在解决大语言模型在复杂推理中依赖专家标注数据和外部验证器的问题。

Details

Motivation: 现有自进化范式难以定位最优学习区间，且可能通过有缺陷的内部反馈强化集体幻觉和错误先验，AERO旨在通过内化的自我提问、回答和批评来克服这些限制。

Result: 在涵盖三个领域的九个基准测试中，AERO在Qwen3-4B-Base和Qwen3-8B-Base模型上分别实现了平均4.57%和5.10%的性能提升，超越了现有基线方法。

Insight: 创新点包括：1) 受“最近发展区”理论启发，利用基于熵的定位来瞄准“可解性差距”；2) 采用独立反事实校正进行鲁棒验证；3) 引入交错训练策略以同步功能角色的能力增长并防止课程崩溃。这些机制共同构成了一个协同的双循环内生反馈系统。

Abstract: Large Language Models (LLMs) have achieved significant success in complex reasoning but remain bottlenecked by reliance on expert-annotated data and external verifiers. While existing self-evolution paradigms aim to bypass these constraints, they often fail to identify the optimal learning zone and risk reinforcing collective hallucinations and incorrect priors through flawed internal feedback. To address these challenges, we propose \underline{A}utonomous \underline{E}volutionary \underline{R}easoning \underline{O}ptimization (AERO), an unsupervised framework that achieves autonomous reasoning evolution by internalizing self-questioning, answering, and criticism within a synergistic dual-loop system. Inspired by the \textit{Zone of Proximal Development (ZPD)} theory, AERO utilizes entropy-based positioning to target the ``solvability gap’’ and employs Independent Counterfactual Correction for robust verification. Furthermore, we introduce a Staggered Training Strategy to synchronize capability growth across functional roles and prevent curriculum collapse. Extensive evaluations across nine benchmarks spanning three domains demonstrate that AERO achieves average performance improvements of 4.57% on Qwen3-4B-Base and 5.10% on Qwen3-8B-Base, outperforming competitive baselines. Code is available at https://github.com/mira-ai-lab/AERO.

[14] Test-time Recursive Thinking: Self-Improvement without External Feedback cs.CLPDF

Yufan Zhuang, Chandan Singh, Liyuan Liu, Yelong Shen, Dinghuai Zhang

TL;DR: 本文提出了一种名为测试时递归思考（TRT）的迭代自改进框架，旨在使大型语言模型（LLM）无需外部反馈或额外训练即可自我提升推理能力。该方法通过结合特定策略、累积知识和自生成的验证信号来生成多样化的候选解，并可靠地选择正确答案。

Details

Motivation: 动机是探索LLM能否在不依赖外部可验证奖励（如强化学习）或额外训练的情况下实现自我改进，并解决高效生成高质量候选解以及在无真实监督下可靠选择答案这两个核心挑战。

Result: 实验表明，使用TRT后，开源模型在AIME-25/24上达到100%准确率，闭源模型在LiveCodeBench最难题目上的性能提升了10.4-14.8个百分点，且无需外部反馈。

Insight: 创新点在于提出了一个无需外部反馈的迭代自改进框架TRT，它通过整合策略、知识和自验证来条件化生成过程，实现了在推理任务上的显著性能提升，为LLM的测试时优化提供了新思路。

Abstract: Modern Large Language Models (LLMs) have shown rapid improvements in reasoning capabilities, driven largely by reinforcement learning (RL) with verifiable rewards. Here, we ask whether these LLMs can self-improve without the need for additional training. We identify two core challenges for such systems: (i) efficiently generating diverse, high-quality candidate solutions, and (ii) reliably selecting correct answers in the absence of ground-truth supervision. To address these challenges, we propose Test-time Recursive Thinking (TRT), an iterative self-improvement framework that conditions generation on rollout-specific strategies, accumulated knowledge, and self-generated verification signals. Using TRT, open-source models reach 100% accuracy on AIME-25/24, and on LiveCodeBench’s most difficult problems, closed-source models improve by 10.4-14.8 percentage points without external feedback.

[15] Task–Specificity Score: Measuring How Much Instructions Really Matter for Supervision cs.CL | cs.AIPDF

Pritam Kadasi, Abhishek Upperwal, Mayank Singh

TL;DR: 本文提出了任务特异性分数（TSS）及其改进版本TSS++，用于量化指令在预测其输出时的重要性，通过对比真实指令与同一输入下的合理替代指令来实现。研究表明，在有限的token预算下，基于TSS选择任务特异性高的示例进行训练，可以提升下游任务性能，并能与基于困惑度等质量过滤方法形成互补。

Details

Motivation: 指令微调已成为训练和适配大语言模型的主流方法，但许多指令-输入-输出对的定义较为模糊：对于同一输入，多个不同的指令可能都对应着合理的相同输出。这引发了一个核心问题：指令是否唯一决定了目标输出？

Result: 在三个指令数据集（Alpaca, Dolly-15k, NI-20）和三个开源大语言模型（Gemma, Llama, Qwen）上的实验表明，基于TSS选择任务特异性高的示例进行训练，在有限的token预算下能提升下游性能，并且能与基于困惑度和IFD的质量过滤器形成互补。

Insight: 创新点在于提出了一个量化指标TSS来评估指令的“特异性”，即其对输出的决定性程度，而不仅仅是评估指令-输出对的质量。这为指令数据的筛选和高效训练提供了新的视角和工具，有助于在资源受限的情况下更有效地利用指令数据。

Abstract: Instruction tuning is now the default way to train and adapt large language models, but many instruction–input–output pairs are only weakly specified: for a given input, the same output can remain plausible under several alternative instructions. This raises a simple question: \emph{does the instruction uniquely determine the target output?} We propose the \textbf{Task–Specificity Score (TSS)} to quantify how much an instruction matters for predicting its output, by contrasting the true instruction against plausible alternatives for the same input. We further introduce \textbf{TSS++}, which uses hard alternatives and a small quality term to mitigate easy-negative effects. Across three instruction datasets (\textsc{Alpaca}, \textsc{Dolly-15k}, \textsc{NI-20}) and three open LLMs (Gemma, Llama, Qwen), we show that selecting task-specific examples improves downstream performance under tight token budgets and complements quality-based filters such as perplexity and IFD.

[16] ChemPro: A Progressive Chemistry Benchmark for Large Language Models cs.CLPDF

Aaditya Baranwal, Shruti Vyas

TL;DR: 本文介绍了ChemPro，一个包含4100个自然语言问答对的渐进式化学基准测试，旨在评估大型语言模型（LLM）在广泛普通化学主题上的能力。该基准测试涵盖从基础到高中化学的四个难度部分，包括多项选择题和数值题，平衡覆盖了生物化学、无机化学、有机化学和物理化学。作者评估了超过45+7个最先进的LLM，发现它们在基础问题上表现良好，但随着复杂性的增加，准确性下降。

Details

Motivation: 为了解决当前缺乏系统评估LLM在化学领域推理和理解能力的基准测试的问题，作者设计了ChemPro，以模拟学生从基础到高级的学术评估，从而揭示LLM在科学推理方面的局限性。

Result: 在ChemPro基准测试上评估了45+7个开源和专有的最先进LLM，结果显示LLM在基础化学问题上表现良好，但面对不同类型和复杂程度的问题时准确性显著下降，突显了其在一般科学推理和理解方面的关键限制。

Insight: 论文的创新点在于提出了一个渐进式、结构化的化学基准测试ChemPro，它系统地覆盖了多个化学分支和难度层次，能够更细致地评估LLM的能力退化情况。从客观角度看，该基准的设计强调从信息回忆到长程推理和多概念问题解决的渐进难度，为未来改进LLM的科学推理能力提供了明确的评估维度和方向。

Abstract: We introduce ChemPro, a progressive benchmark with 4100 natural language question-answer pairs in Chemistry, across 4 coherent sections of difficulty designed to assess the proficiency of Large Language Models (LLMs) in a broad spectrum of general chemistry topics. We include Multiple Choice Questions and Numerical Questions spread across fine-grained information recall, long-horizon reasoning, multi-concept questions, problem-solving with nuanced articulation, and straightforward questions in a balanced ratio, effectively covering Bio-Chemistry, Inorganic-Chemistry, Organic-Chemistry and Physical-Chemistry. ChemPro is carefully designed analogous to a student’s academic evaluation for basic to high-school chemistry. A gradual increase in the question difficulty rigorously tests the ability of LLMs to progress from solving basic problems to solving more sophisticated challenges. We evaluate 45+7 state-of-the-art LLMs, spanning both open-source and proprietary variants, and our analysis reveals that while LLMs perform well on basic chemistry questions, their accuracy declines with different types and levels of complexity. These findings highlight the critical limitations of LLMs in general scientific reasoning and understanding and point towards understudied dimensions of difficulty, emphasizing the need for more robust methodologies to improve LLMs.

Bowen Jiang, Taiwei Shi, Ryo Kamoi, Yuan Yuan, Camillo J. Taylor

TL;DR: 本文提出OMAR（One Model, All Roles）框架，这是一个通过多轮、多智能体对话自博弈强化学习来发展AI社交智能的强化学习框架。该框架允许单一模型同时扮演对话中的所有参与者，从动态社交互动中直接学习实现长期目标和复杂社会规范。

Details

Motivation: 传统方法依赖于静态、单轮优化，无法有效学习长期社交互动中的复杂规范。OMAR旨在通过多智能体自博弈，让AI在无人类监督下自主发展出细粒度的社交智能，如共情、说服和寻求妥协。

Result: 在SOTOPIA社交环境和狼人杀策略游戏中的评估表明，训练后的模型展现出细粒度的、涌现的社交智能，即使在竞争性场景下也能有效学习协作，证明了方法的有效性。

Insight: 创新点包括：1）单一模型同时扮演所有角色的多智能体自博弈框架；2）为确保长对话训练稳定性而设计的层次化优势估计（计算轮级和令牌级优势）。尽管存在奖励黑客等实际挑战，但结果表明丰富的社交智能可以在无监督下涌现。

Abstract: This paper introduces OMAR: One Model, All Roles, a reinforcement learning framework that enables AI to develop social intelligence through multi-turn, multi-agent conversational self-play. Unlike traditional paradigms that rely on static, single-turn optimizations, OMAR allows a single model to role-play all participants in a conversation simultaneously, learning to achieve long-term goals and complex social norms directly from dynamic social interaction. To ensure training stability across long dialogues, we implement a hierarchical advantage estimation that calculates turn-level and token-level advantages. Evaluations in the SOTOPIA social environment and Werewolf strategy games show that our trained models develop fine-grained, emergent social intelligence, such as empathy, persuasion, and compromise seeking, demonstrating the effectiveness of learning collaboration even under competitive scenarios. While we identify practical challenges like reward hacking, our results show that rich social intelligence can emerge without human supervision. We hope this work incentivizes further research on AI social intelligence in group conversations.

[18] Short Chains, Deep Thoughts: Balancing Reasoning Efficiency and Intra-Segment Capability via Split-Merge Optimization cs.CLPDF

Runquan Gui, Jie Wang, Zhihai Wang, Chi Ma, Jianye Hao

TL;DR: 本文提出了CoSMo框架，通过一致性引导的分割-合并优化来消除大型推理模型中的结构冗余，旨在平衡推理效率与段内能力。该方法动态合并冗余段、分割逻辑间隙，并采用结构对齐的强化学习进行监督，在多个基准测试和骨干模型上实现了更高的准确性和更低的段使用率。

Details

Motivation: 大型推理模型依赖生成长推理链来解决复杂任务，导致显著的延迟和计算开销，需要一种方法来消除结构冗余而非简单地限制token数量。

Result: 在多个基准测试和骨干模型上的实验表明，CoSMo相比推理效率基线平均提高准确性3.3个百分点，同时减少段使用率28.7%，实现了优越的性能。

Insight: 创新点在于提出分割-合并算法动态优化推理链结构，并结合段级预算的结构对齐强化学习来监督模型保持高效推理结构，这为平衡推理深度与效率提供了新思路。

Abstract: While Large Reasoning Models (LRMs) have demonstrated impressive capabilities in solving complex tasks through the generation of long reasoning chains, this reliance on verbose generation results in significant latency and computational overhead. To address these challenges, we propose \textbf{CoSMo} (\textbf{Co}nsistency-Guided \textbf{S}plit-\textbf{M}erge \textbf{O}ptimization), a framework designed to eliminate structural redundancy rather than indiscriminately restricting token volume. Specifically, CoSMo utilizes a split-merge algorithm that dynamically refines reasoning chains by merging redundant segments and splitting logical gaps to ensure coherence. We then employ structure-aligned reinforcement learning with a novel segment-level budget to supervise the model in maintaining efficient reasoning structures throughout training. Extensive experiments across multiple benchmarks and backbones demonstrate that CoSMo achieves superior performance, improving accuracy by \textbf{3.3} points while reducing segment usage by \textbf{28.7%} on average compared to reasoning efficiency baselines.

[19] FASA: Frequency-aware Sparse Attention cs.CLPDF

Yifei Wang, Yueqi Wang, Zhenrui Yue, Huimin Zeng, Yong Wang

TL;DR: 本文提出FASA框架，通过频率感知的稀疏注意力机制，动态预测并保留关键token，以解决大语言模型处理长输入时KV缓存内存占用过高的问题。

Details

Motivation: 现有token剪枝方法存在静态方法导致信息不可逆丢失或动态启发式策略未能充分捕捉token重要性查询依赖性的不足，需设计更高效的查询感知token淘汰机制。

Result: 在LongBench-V1等长上下文任务上，FASA仅保留256个token即可达到接近完整KV缓存性能的100%，并在AIME24上使用18.9%缓存实现2.56倍加速，优于所有token淘汰基线方法。

Insight: 创新点在于发现RoPE中频率块级别的功能稀疏性，利用一小部分’主导’频率块作为token重要性的高效代理，实现查询感知的token淘汰与聚焦注意力计算。

Abstract: The deployment of Large Language Models (LLMs) faces a critical bottleneck when handling lengthy inputs: the prohibitive memory footprint of the Key Value (KV) cache. To address this bottleneck, the token pruning paradigm leverages attention sparsity to selectively retain a small, critical subset of tokens. However, existing approaches fall short, with static methods risking irreversible information loss and dynamic strategies employing heuristics that insufficiently capture the query-dependent nature of token importance. We propose FASA, a novel framework that achieves query-aware token eviction by dynamically predicting token importance. FASA stems from a novel insight into RoPE: the discovery of functional sparsity at the frequency-chunk (FC) level. Our key finding is that a small, identifiable subset of “dominant” FCs consistently exhibits high contextual agreement with the full attention head. This provides a robust and computationally free proxy for identifying salient tokens. %making them a powerful and efficient proxy for token importance. Building on this insight, FASA first identifies a critical set of tokens using dominant FCs, and then performs focused attention computation solely on this pruned subset. % Since accessing only a small fraction of the KV cache, FASA drastically lowers memory bandwidth requirements and computational cost. Across a spectrum of long-context tasks, from sequence modeling to complex CoT reasoning, FASA consistently outperforms all token-eviction baselines and achieves near-oracle accuracy, demonstrating remarkable robustness even under constraint budgets. Notably, on LongBench-V1, FASA reaches nearly 100% of full-KV performance when only keeping 256 tokens, and achieves 2.56$\times$ speedup using just 18.9% of the cache on AIME24.

[20] ForesightKV: Optimizing KV Cache Eviction for Reasoning Models by Learning Long-Term Contribution cs.CL | cs.LGPDF

Zican Dong, Peiyu Liu, Junyi Li, Zhipeng Chen, Han Peng

TL;DR: 本文提出ForesightKV，一个基于训练的KV缓存淘汰框架，用于优化大语言模型在长文本生成中的内存和计算效率。它通过学习预测长期贡献来决策淘汰哪些KV对，结合了监督学习和强化学习，在仅使用一半缓存预算的情况下，在多个推理模型的基准测试上超越了现有方法。

Details

Motivation: 随着大语言模型生成长推理序列，KV缓存线性增长导致高昂的内存和计算成本。现有KV缓存淘汰方法因未能捕捉复杂的KV依赖关系而导致性能下降，因此需要一种能更好平衡效率与性能的解决方案。

Result: 在AIME2024和AIME2025基准测试中，对三个推理模型的实验表明，ForesightKV在仅使用一半缓存预算的情况下，持续优于先前方法，实现了效率与性能的协同提升。

Insight: 创新点包括：1) 提出Golden Eviction算法，利用未来注意力分数识别最优淘汰KV对；2) 通过Pairwise Ranking Loss进行监督训练蒸馏；3) 将缓存淘汰建模为马尔可夫决策过程，并应用GRPO算法缓解低熵词元上的语言建模损失增加；4) 结合监督与强化学习，实现长期贡献预测的优化。

Abstract: Recently, large language models (LLMs) have shown remarkable reasoning abilities by producing long reasoning traces. However, as the sequence length grows, the key-value (KV) cache expands linearly, incurring significant memory and computation costs. Existing KV cache eviction methods mitigate this issue by discarding less important KV pairs, but often fail to capture complex KV dependencies, resulting in performance degradation. To better balance efficiency and performance, we introduce ForesightKV, a training-based KV cache eviction framework that learns to predict which KV pairs to evict during long-text generations. We first design the Golden Eviction algorithm, which identifies the optimal eviction KV pairs at each step using future attention scores. These traces and the scores at each step are then distilled via supervised training with a Pairwise Ranking Loss. Furthermore, we formulate cache eviction as a Markov Decision Process and apply the GRPO algorithm to mitigate the significant language modeling loss increase on low-entropy tokens. Experiments on AIME2024 and AIME2025 benchmarks of three reasoning models demonstrate that ForesightKV consistently outperforms prior methods under only half the cache budget, while benefiting synergistically from both supervised and reinforcement learning approaches.

[21] POP: Prefill-Only Pruning for Efficient Large Model Inference cs.CL | cs.AI | cs.CVPDF

Junhui He, Zhihui Fu, Jun Wang, Qingan Li

TL;DR: 本文提出了一种名为Prefill-Only Pruning (POP)的阶段感知推理策略，用于提升大语言模型和视觉语言模型的推理效率。该方法基于对预填充和解码阶段不对称作用的分析，在计算密集的预填充阶段安全地剪枝深层网络，而在敏感的解码阶段保留完整模型，从而在不显著损失精度的情况下加速推理。

Details

Motivation: 现有结构化剪枝方法虽然硬件效率高，但往往导致显著的精度下降。作者认为这种失败源于一种阶段无关的剪枝方法，忽视了预填充和解码阶段之间的不对称角色。

Result: 在Llama-3.1、Qwen3-VL和Gemma-3等多种模态模型上的大量实验表明，POP在预填充延迟上实现了高达1.37倍的加速，同时性能损失极小，有效克服了现有结构化剪枝方法在精度与效率之间的权衡限制。

Insight: 核心创新点是提出了阶段感知的推理策略，通过虚拟门机制分析发现深层网络对解码（下一个token预测）至关重要，但对预填充（上下文编码）是冗余的。在此基础上，POP引入了独立的键值投影以维护缓存完整性，以及边界处理策略以确保首个生成token的准确性，从而实现了高效且精确的模型剪枝。

Abstract: Large Language Models (LLMs) and Vision-Language Models (VLMs) have demonstrated remarkable capabilities. However, their deployment is hindered by significant computational costs. Existing structured pruning methods, while hardware-efficient, often suffer from significant accuracy degradation. In this paper, we argue that this failure stems from a stage-agnostic pruning approach that overlooks the asymmetric roles between the prefill and decode stages. By introducing a virtual gate mechanism, our importance analysis reveals that deep layers are critical for next-token prediction (decode) but largely redundant for context encoding (prefill). Leveraging this insight, we propose Prefill-Only Pruning (POP), a stage-aware inference strategy that safely omits deep layers during the computationally intensive prefill stage while retaining the full model for the sensitive decode stage. To enable the transition between stages, we introduce independent Key-Value (KV) projections to maintain cache integrity, and a boundary handling strategy to ensure the accuracy of the first generated token. Extensive experiments on Llama-3.1, Qwen3-VL, and Gemma-3 across diverse modalities demonstrate that POP achieves up to 1.37$\times$ speedup in prefill latency with minimal performance loss, effectively overcoming the accuracy-efficiency trade-off limitations of existing structured pruning methods.

[22] MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Research cs.CLPDF

Yifan Shi, Jialong Shi, Jiayi Wang, Ye Fan, Jianyong Sun

TL;DR: MIRROR是一个无需微调、端到端的多智能体框架，旨在将自然语言描述的运筹学优化问题直接翻译成数学模型和求解器代码。该框架通过执行驱动的迭代自适应修订机制进行自动纠错，并结合分层检索从精心构建的示例库中获取相关建模和编码范例，从而克服现有方法在协作纠错和任务特定检索方面的不足。

Details

Motivation: 解决运筹学中依赖专家建模过程缓慢、脆弱且难以适应新场景的问题，以及现有基于大语言模型的自动化方法缺乏可靠协作纠错和任务特定检索，常导致错误输出的局限性。

Result: 在标准运筹学基准测试中优于现有方法，并在复杂工业数据集（如IndustryOR和Mamo-ComplexLP）上取得了显著成果。

Insight: 创新点在于将执行驱动的迭代自适应修订与分层检索机制相结合，实现了无需微调的精确外部知识注入和系统化错误纠正，为非专家用户提供了高效可靠的运筹学建模解决方案，克服了通用大语言模型在专业优化任务中的根本局限。

Abstract: Operations Research (OR) relies on expert-driven modeling-a slow and fragile process ill-suited to novel scenarios. While large language models (LLMs) can automatically translate natural language into optimization models, existing approaches either rely on costly post-training or employ multi-agent frameworks, yet most still lack reliable collaborative error correction and task-specific retrieval, often leading to incorrect outputs. We propose MIRROR, a fine-tuning-free, end-to-end multi-agent framework that directly translates natural language optimization problems into mathematical models and solver code. MIRROR integrates two core mechanisms: (1) execution-driven iterative adaptive revision for automatic error correction, and (2) hierarchical retrieval to fetch relevant modeling and coding exemplars from a carefully curated exemplar library. Experiments show that MIRROR outperforms existing methods on standard OR benchmarks, with notable results on complex industrial datasets such as IndustryOR and Mamo-ComplexLP. By combining precise external knowledge infusion with systematic error correction, MIRROR provides non-expert users with an efficient and reliable OR modeling solution, overcoming the fundamental limitations of general-purpose LLMs in expert optimization tasks.

[23] PEGRL: Improving Machine Translation by Post-Editing Guided Reinforcement Learning cs.CLPDF

Yunzhi Shen, Hao Zhou, Xin Huang, Xue Han, Junlan Feng

TL;DR: 本文提出了一种名为PEGRL的两阶段强化学习框架，旨在通过引入后编辑作为辅助任务来改进基于大语言模型的机器翻译。该方法利用后编辑任务来稳定训练并引导整体优化，通过采样翻译输出构建后编辑输入，使回报估计能够受益于当前翻译行为的条件化，从而同时支持全局探索和细粒度局部优化。实验在多个语言对上验证了其有效性。

Details

Motivation: 现有面向翻译的强化学习方法（如GRPO）受限于蒙特卡洛回报估计带来的噪声学习信号以及庞大的轨迹空间，这导致其更偏向全局探索而非细粒度的局部优化。

Result: 在英语到芬兰语、英语到土耳其语和英汉互译任务上的实验表明，PEGRL相比强化学习基线方法取得了持续的性能提升。特别是在英语到土耳其语任务上，其在COMET-KIWI指标上的性能与先进的基于大语言模型的系统（如DeepSeek-V3.2）相当。

Insight: 核心创新点是提出了一种两阶段强化学习框架，将后编辑作为辅助任务来引导和稳定翻译优化过程。其设计的任务特定加权方案平衡了翻译和后编辑目标的贡献，产生了一个有偏但样本效率更高的估计器，有效解决了回报估计噪声大和探索-优化权衡的挑战。

Abstract: Reinforcement learning (RL) has shown strong promise for LLM-based machine translation, with recent methods such as GRPO demonstrating notable gains; nevertheless, translation-oriented RL remains challenged by noisy learning signals arising from Monte Carlo return estimation, as well as a large trajectory space that favors global exploration over fine-grained local optimization. We introduce \textbf{PEGRL}, a \textit{two-stage} RL framework that uses post-editing as an auxiliary task to stabilize training and guide overall optimization. At each iteration, translation outputs are sampled to construct post-editing inputs, allowing return estimation in the post-editing stage to benefit from conditioning on the current translation behavior, while jointly supporting both global exploration and fine-grained local optimization. A task-specific weighting scheme further balances the contributions of translation and post-editing objectives, yielding a biased yet more sample-efficient estimator. Experiments on English$\to$Finnish, English$\to$Turkish, and English$\leftrightarrow$Chinese show consistent gains over RL baselines, and for English$\to$Turkish, performance on COMET-KIWI is comparable to advanced LLM-based systems (DeepSeek-V3.2).

[24] Verified Critical Step Optimization for LLM Agents cs.CLPDF

Mukai Li, Qingcheng Zeng, Tianqing Fang, Zhenwen Liang, Linfeng Song

TL;DR: 本文提出了一种名为关键步骤优化（CSO）的新方法，用于大型语言模型（LLM）智能体的后训练。该方法通过识别并专注于已验证的关键步骤（即那些能显著改变任务成败的决策点）进行偏好学习，从而提供细粒度、可验证的监督，避免了轨迹级粗粒度或步骤级噪声的问题。

Details

Motivation: 解决现有LLM智能体后训练方法面临的挑战：仅基于最终结果的奖励无法精确归因于中间步骤，估计的步骤级奖励存在系统性噪声，而蒙特卡洛采样方法计算成本过高。

Result: 在GAIA-Text-103和XBench-DeepSearch基准测试上，CSO相比监督微调（SFT）基线分别取得了37%和26%的相对性能提升，显著优于其他后训练方法，同时仅需对16%的轨迹步骤进行监督。

Insight: 核心创新在于从失败的策略轨迹出发，利用过程奖励模型（PRM）识别候选关键步骤，并通过专家模型生成高质量替代动作，仅当策略模型能成功执行这些替代动作并纠正结果时，才将其作为DPO训练数据。这实现了基于选择性验证的学习，直接针对策略模型的弱点，确保了数据质量和策略可达性。

Abstract: As large language model agents tackle increasingly complex long-horizon tasks, effective post-training becomes critical. Prior work faces fundamental challenges: outcome-only rewards fail to precisely attribute credit to intermediate steps, estimated step-level rewards introduce systematic noise, and Monte Carlo sampling approaches for step reward estimation incur prohibitive computational cost. Inspired by findings that only a small fraction of high-entropy tokens drive effective RL for reasoning, we propose Critical Step Optimization (CSO), which focuses preference learning on verified critical steps, decision points where alternate actions demonstrably flip task outcomes from failure to success. Crucially, our method starts from failed policy trajectories rather than expert demonstrations, directly targeting the policy model’s weaknesses. We use a process reward model (PRM) to identify candidate critical steps, leverage expert models to propose high-quality alternatives, then continue execution from these alternatives using the policy model itself until task completion. Only alternatives that the policy successfully executes to correct outcomes are verified and used as DPO training data, ensuring both quality and policy reachability. This yields fine-grained, verifiable supervision at critical decisions while avoiding trajectory-level coarseness and step-level noise. Experiments on GAIA-Text-103 and XBench-DeepSearch show that CSO achieves 37% and 26% relative improvement over the SFT baseline and substantially outperforms other post-training methods, while requiring supervision at only 16% of trajectory steps. This demonstrates the effectiveness of selective verification-based learning for agent post-training.

[25] A-RAG: Scaling Agentic Retrieval-Augmented Generation via Hierarchical Retrieval Interfaces cs.CLPDF

Mingxuan Du, Benfeng Xu, Chiwei Zhu, Shaohan Wang, Pengyu Wang

TL;DR: 本文提出了A-RAG（Agentic RAG）框架，这是一种通过向大语言模型暴露分层检索接口来实现的代理式检索增强生成方法。它允许模型主动参与检索决策，使用关键词搜索、语义搜索和块读取三种工具，在多粒度上自适应地搜索和检索信息。

Details

Motivation: 现有RAG系统未能充分利用前沿大语言模型的推理和长程工具使用能力，它们要么采用单次检索算法，要么预定义工作流，都不允许模型参与检索决策，从而阻碍了其随模型改进而高效扩展。

Result: 在多个开放域问答基准测试上的实验表明，A-RAG在使用可比或更少检索令牌的情况下，始终优于现有方法，并系统地研究了其随模型规模和测试时计算量的扩展性。

Insight: 核心创新在于将分层检索接口（关键词、语义、块读取）直接暴露给模型，使其成为主动的检索代理，能够动态适应不同任务，从而更有效地利用模型自身能力，实现检索过程的灵活性和高效性。

Abstract: Frontier language models have demonstrated strong reasoning and long-horizon tool-use capabilities. However, existing RAG systems fail to leverage these capabilities. They still rely on two paradigms: (1) designing an algorithm that retrieves passages in a single shot and concatenates them into the model’s input, or (2) predefining a workflow and prompting the model to execute it step-by-step. Neither paradigm allows the model to participate in retrieval decisions, preventing efficient scaling with model improvements. In this paper, we introduce A-RAG, an Agentic RAG framework that exposes hierarchical retrieval interfaces directly to the model. A-RAG provides three retrieval tools: keyword search, semantic search, and chunk read, enabling the agent to adaptively search and retrieve information across multiple granularities. Experiments on multiple open-domain QA benchmarks show that A-RAG consistently outperforms existing approaches with comparable or lower retrieved tokens, demonstrating that A-RAG effectively leverages model capabilities and dynamically adapts to different RAG tasks. We further systematically study how A-RAG scales with model size and test-time compute. We will release our code and evaluation suite to facilitate future research. Code and evaluation suite are available at https://github.com/Ayanami0730/arag.

[26] Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

Quanyu Long, Kai Jie Jiang, Jianda Chen, Xu Guo, Leilei Gan

TL;DR: 本文通过大规模实证分析发现，大型推理模型在生成推理轨迹时存在大量重复的自我验证步骤，但这些验证大多为确认性而非纠正性，很少能识别错误或改变推理结果。为此，作者提出了一种基于经验驱动的测试时框架，通过检测验证行为激活、查询历史经验池来估计验证必要性，并在经验表明不必要时抑制验证步骤，从而减少计算开销。

Details

Motivation: 针对大型推理模型中自我验证步骤被过度使用但实际效用低下的问题，旨在减少不必要的验证开销，同时保持或提升模型推理效率。

Result: 在多个模型和基准测试中，该方法将token使用量减少了高达20.3%，同时保持了准确性，在某些数据集上甚至提高了准确率。

Insight: 创新点在于将历史验证结果构建为经验池，通过检索驱动的方式动态抑制过度验证，实现了计算效率与推理性能的平衡；从客观角度看，该方法为LLM推理优化提供了一种轻量级、数据驱动的实时决策机制。

Abstract: Large Reasoning Models (LRMs) achieve strong performance by generating long reasoning traces with reflection. Through a large-scale empirical analysis, we find that a substantial fraction of reflective steps consist of self-verification (recheck) that repeatedly confirm intermediate results. These rechecks occur frequently across models and benchmarks, yet the vast majority are confirmatory rather than corrective, rarely identifying errors and altering reasoning outcomes. This reveals a mismatch between how often self-verification is activated and how often it is actually useful. Motivated by this, we propose a novel, experience-driven test-time framework that reduces the overused verification. Our method detects the activation of recheck behavior, consults an offline experience pool of past verification outcomes, and estimates whether a recheck is likely unnecessary via efficient retrieval. When historical experience suggests unnecessary, a suppression signal redirects the model to proceed. Across multiple model and benchmarks, our approach reduces token usage up to 20.3% while maintaining the accuracy, and in some datasets even yields accuracy improvements.

[27] Learning to Reason Faithfully through Step-Level Faithfulness Maximization cs.CLPDF

Runquan Gui, Yafu Li, Xiaoye Qu, Ziyan Liu, Yeqiu Cheng

TL;DR: 本文提出FaithRL框架，通过强化学习直接优化大语言模型多步推理的忠实性，采用几何奖励设计和忠实性感知优势调制机制，在多个基准测试中有效减少幻觉并保持答案正确性。

Details

Motivation: 现有基于可验证奖励的强化学习方法依赖稀疏结果奖励，缺乏对中间推理步骤的监督，导致模型过度自信和虚假推理，加剧幻觉问题。

Result: 在多样化骨干模型和基准测试中，FaithRL一致降低了幻觉率，同时保持（并常提升）答案正确性，验证了其提升推理忠实性和鲁棒泛化的能力。

Insight: 创新点在于形式化忠实性最大化目标，并通过几何奖励与优势调制实现步骤级信用分配，惩罚无支持步骤同时保留有效部分推导，为优化推理过程提供新思路。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has markedly improved the performance of Large Language Models (LLMs) on tasks requiring multi-step reasoning. However, most RLVR pipelines rely on sparse outcome-based rewards, providing little supervision over intermediate steps and thus encouraging over-confidence and spurious reasoning, which in turn increases hallucinations. To address this, we propose FaithRL, a general reinforcement learning framework that directly optimizes reasoning faithfulness. We formalize a faithfulness-maximization objective and theoretically show that optimizing it mitigates over-confidence. To instantiate this objective, we introduce a geometric reward design and a faithfulness-aware advantage modulation mechanism that assigns step-level credit by penalizing unsupported steps while preserving valid partial derivations. Across diverse backbones and benchmarks, FaithRL consistently reduces hallucination rates while maintaining (and often improving) answer correctness. Further analysis confirms that FaithRL increases step-wise reasoning faithfulness and generalizes robustly. Our code is available at https://github.com/aintdoin/FaithRL.

[28] Use Graph When It Needs: Efficiently and Adaptively Integrating Retrieval-Augmented Generation with Graphs cs.CL | cs.AIPDF

Su Dong, Qinggang Zhang, Yilin Xiao, Shengyuan Chen, Chuang Zhou

TL;DR: 本文提出了一种高效自适应的图增强检索增强生成框架EA-GraphRAG，通过语法感知的复杂度分析动态选择RAG或GraphRAG来处理查询，以解决GraphRAG在现实场景中因对所有查询刚性应用而导致的性能下降和高延迟问题。

Details

Motivation: 解决大语言模型在知识密集型任务中的幻觉和过时知识问题，以及现有GraphRAG方法因对所有查询统一应用图结构而导致的准确率下降和延迟过高的问题。

Result: 在两个单跳和两个多跳问答基准测试上的广泛实验表明，EA-GraphRAG显著提高了准确率、降低了延迟，并在处理简单和复杂查询混合场景中达到了最先进的性能水平。

Insight: 创新点在于通过语法特征构造器、轻量级复杂度评分器和基于分数的路由策略，实现了对查询复杂度的自适应判断，从而动态集成RAG和GraphRAG范式，提升了效率和准确性。

Abstract: Large language models (LLMs) often struggle with knowledge-intensive tasks due to hallucinations and outdated parametric knowledge. While Retrieval-Augmented Generation (RAG) addresses this by integrating external corpora, its effectiveness is limited by fragmented information in unstructured domain documents. Graph-augmented RAG (GraphRAG) emerged to enhance contextual reasoning through structured knowledge graphs, yet paradoxically underperforms vanilla RAG in real-world scenarios, exhibiting significant accuracy drops and prohibitive latency despite gains on complex queries. We identify the rigid application of GraphRAG to all queries, regardless of complexity, as the root cause. To resolve this, we propose an efficient and adaptive GraphRAG framework called EA-GraphRAG that dynamically integrates RAG and GraphRAG paradigms through syntax-aware complexity analysis. Our approach introduces: (i) a syntactic feature constructor that parses each query and extracts a set of structural features; (ii) a lightweight complexity scorer that maps these features to a continuous complexity score; and (iii) a score-driven routing policy that selects dense RAG for low-score queries, invokes graph-based retrieval for high-score queries, and applies complexity-aware reciprocal rank fusion to handle borderline cases. Extensive experiments on a comprehensive benchmark, consisting of two single-hop and two multi-hop QA benchmarks, demonstrate that our EA-GraphRAG significantly improves accuracy, reduces latency, and achieves state-of-the-art performance in handling mixed scenarios involving both simple and complex queries.

[29] $V_0$: A Generalist Value Model for Any Policy at State Zero cs.CL | cs.AI | cs.LGPDF

Yi-Kai Zhang, Zhiyuan Yao, Hongyan Hao, Yueqing Sun, Qi Gu

TL;DR: 本文提出了一种名为 $V_0$ 的通用价值模型，用于在无需参数更新的情况下，估计任何模型在未见提示上的预期性能。该模型将策略的动态能力作为显式上下文输入，通过指令-性能对历史来动态分析模型，从而摆脱了传统依赖参数拟合来感知能力变化的范式。$V_0$ 专注于初始状态（State Zero）的价值估计，可作为关键资源调度器：在 GRPO 训练中，它能在 rollout 前预测成功率以高效分配采样预算；在部署时，它可作为路由器，将指令分派给最具成本效益且合适的模型。

Details

Motivation: 在基于 Actor-Critic 方法（如 PPO）训练大语言模型时，价值模型（Critic）通常需要与策略模型同步进行昂贵的增量训练以跟踪策略的能力变化。虽然 GRPO 等方法通过使用一组 rollout 的平均奖励作为基线来消除耦合的价值模型，但需要大量采样以保持估计稳定性。本文旨在避免这种开销，提出一个无需参数更新即可估计任何策略性能的通用价值模型。

Result: 实证结果表明，$V_0$ 在 LLM 路由任务中显著优于启发式预算分配方法，并在性能与成本之间实现了帕累托最优权衡。

Insight: 论文的核心创新在于将价值估计重新定义为以策略的动态能力作为显式上下文输入的问题，而非依赖参数拟合。这通过利用指令-性能对历史来动态分析模型实现，使得 $V_0$ 成为一个无需训练即可通用的价值估计器。从客观角度看，这种方法将价值模型从与特定策略的强耦合中解耦出来，使其能够作为独立的资源调度器或路由器，在训练和部署阶段提供灵活且高效的能力评估与决策支持。

Abstract: Policy gradient methods rely on a baseline to measure the relative advantage of an action, ensuring the model reinforces behaviors that outperform its current average capability. In the training of Large Language Models (LLMs) using Actor-Critic methods (e.g., PPO), this baseline is typically estimated by a Value Model (Critic) often as large as the policy model itself. However, as the policy continuously evolves, the value model requires expensive, synchronous incremental training to accurately track the shifting capabilities of the policy. To avoid this overhead, Group Relative Policy Optimization (GRPO) eliminates the coupled value model by using the average reward of a group of rollouts as the baseline; yet, this approach necessitates extensive sampling to maintain estimation stability. In this paper, we propose $V_0$, a Generalist Value Model capable of estimating the expected performance of any model on unseen prompts without requiring parameter updates. We reframe value estimation by treating the policy’s dynamic capability as an explicit context input; specifically, we leverage a history of instruction-performance pairs to dynamically profile the model, departing from the traditional paradigm that relies on parameter fitting to perceive capability shifts. Focusing on value estimation at State Zero (i.e., the initial prompt, hence $V_0$), our model serves as a critical resource scheduler. During GRPO training, $V_0$ predicts success rates prior to rollout, allowing for efficient sampling budget allocation; during deployment, it functions as a router, dispatching instructions to the most cost-effective and suitable model. Empirical results demonstrate that $V_0$ significantly outperforms heuristic budget allocation and achieves a Pareto-optimal trade-off between performance and cost in LLM routing tasks.

[30] CL-bench: A Benchmark for Context Learning cs.CLPDF

Shihan Dou, Ming Zhang, Zhangyue Yin, Chenhao Huang, Yujiong Shen

TL;DR: 本文提出了CL-bench基准测试，用于评估语言模型在复杂、依赖特定上下文的真实世界任务中的‘上下文学习’能力。该基准包含500个复杂上下文、1899个任务和31607个验证标准，要求模型从上下文中学习新知识（如领域知识、规则系统、复杂程序等）来解决问题，而非仅依赖预训练知识或简单模式学习。评估发现，前沿语言模型平均仅能解决17.2%的任务，表现最佳的GPT-5.1也仅解决23.7%，表明当前模型在上下文学习方面仍存在显著不足。

Details

Motivation: 当前语言模型擅长基于预训练知识进行推理，但真实世界任务更复杂且高度依赖上下文，需要模型从任务特定上下文中学习新知识并应用以解决问题，这种‘上下文学习’能力是人类自然具备但被现有研究忽视的关键能力。

Result: 在CL-bench基准上评估了十个前沿语言模型，平均任务解决率仅为17.2%，表现最好的模型GPT-5.1也仅达到23.7%，揭示了模型在有效上下文学习方面的严重瓶颈。

Insight: 论文的创新点在于明确定义并系统评估了‘上下文学习’这一关键能力，超越了传统长上下文任务（主要测试检索或阅读理解）和上下文学习任务（学习简单任务模式）。CL-bench作为首个针对复杂真实世界上下文学习的基准，由领域专家精心构建，强调从上下文中学习新知识（如规则、程序、法律等），为构建更智能、适用于真实场景的语言模型提供了重要方向。

Abstract: Current language models (LMs) excel at reasoning over prompts using pre-trained knowledge. However, real-world tasks are far more complex and context-dependent: models must learn from task-specific context and leverage new knowledge beyond what is learned during pre-training to reason and resolve tasks. We term this capability context learning, a crucial ability that humans naturally possess but has been largely overlooked. To this end, we introduce CL-bench, a real-world benchmark consisting of 500 complex contexts, 1,899 tasks, and 31,607 verification rubrics, all crafted by experienced domain experts. Each task is designed such that the new content required to resolve it is contained within the corresponding context. Resolving tasks in CL-bench requires models to learn from the context, ranging from new domain-specific knowledge, rule systems, and complex procedures to laws derived from empirical data, all of which are absent from pre-training. This goes far beyond long-context tasks that primarily test retrieval or reading comprehension, and in-context learning tasks, where models learn simple task patterns via instructions and demonstrations. Our evaluations of ten frontier LMs find that models solve only 17.2% of tasks on average. Even the best-performing model, GPT-5.1, solves only 23.7%, revealing that LMs have yet to achieve effective context learning, which poses a critical bottleneck for tackling real-world, complex context-dependent tasks. CL-bench represents a step towards building LMs with this fundamental capability, making them more intelligent and advancing their deployment in real-world scenarios.

[31] Controlling Output Rankings in Generative Engines for LLM-based Search cs.CL | cs.AI | cs.IRPDF

Haibo Jin, Ruoxi Chen, Peiyan Zhang, Yifeng Luo, Huimin Zeng

TL;DR: 本文提出了CORE方法，用于控制基于LLM的生成式搜索引擎的输出排名。该方法通过在检索内容后附加精心设计的优化内容（包括字符串型、推理型和评论型），来引导LLM的推荐排序，旨在解决LLM初始检索顺序对小型企业和独立创作者可见性造成的不利影响。

Details

Motivation: 随着大语言模型（LLM）的兴起，基于LLM的搜索（生成式引擎）直接向用户推荐产品，但其推荐结果严重受LLM初始检索顺序影响，导致小型企业和独立创作者处于劣势，可见性受限。

Result: 在包含15个产品类别、每类200个产品的ProductBench基准上，对四种具备搜索能力的LLM（GPT-4o、Gemini-2.5、Claude-4和Grok-3）进行了广泛实验。CORE方法在Top-5、Top-3和Top-1的平均提升成功率分别达到91.4%、86.6%和80.3%，优于现有排名操纵方法，同时保持了优化内容的流畅性。

Insight: 创新点在于将LLM与搜索引擎的交互视为黑盒，转而通过优化检索内容（附加特定优化内容）来间接控制输出排名。提出的三种优化内容类型（字符串型、推理型、评论型）为操纵LLM推荐提供了新手段，且构建的大规模基准ProductBench有助于在真实场景下评估此类方法。

Abstract: The way customers search for and choose products is changing with the rise of large language models (LLMs). LLM-based search, or generative engines, provides direct product recommendations to users, rather than traditional online search results that require users to explore options themselves. However, these recommendations are strongly influenced by the initial retrieval order of LLMs, which disadvantages small businesses and independent creators by limiting their visibility. In this work, we propose CORE, an optimization method that \textbf{C}ontrols \textbf{O}utput \textbf{R}ankings in g\textbf{E}nerative Engines for LLM-based search. Since the LLM’s interactions with the search engine are black-box, CORE targets the content returned by search engines as the primary means of influencing output rankings. Specifically, CORE optimizes retrieved content by appending strategically designed optimization content to steer the ranking of outputs. We introduce three types of optimization content: string-based, reasoning-based, and review-based, demonstrating their effectiveness in shaping output rankings. To evaluate CORE in realistic settings, we introduce ProductBench, a large-scale benchmark with 15 product categories and 200 products per category, where each product is associated with its top-10 recommendations collected from Amazon’s search interface. Extensive experiments on four LLMs with search capabilities (GPT-4o, Gemini-2.5, Claude-4, and Grok-3) demonstrate that CORE achieves an average Promotion Success Rate of \textbf{91.4% @Top-5}, \textbf{86.6% @Top-3}, and \textbf{80.3% @Top-1}, across 15 product categories, outperforming existing ranking manipulation methods while preserving the fluency of optimized content.

[32] Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation cs.CLPDF

Changze Lv, Jie Zhou, Wentao Zhao, Jingwen Xu, Zisu Huang

TL;DR: 本文提出了一种针对DeepResearch报告生成任务、从人类偏好中学习查询特定评分标准的训练流程，通过构建带有人类偏好的数据集，结合强化学习与混合奖励（人类偏好监督和基于LLM的评分标准评估）来训练评分标准生成器，并引入多智能体马尔可夫状态工作流以处理长程推理，从而提升报告生成质量。

Details

Motivation: 当前DeepResearch报告生成的训练与评估缺乏可验证的奖励信号，现有方法依赖粗糙的预定义评分标准或成本高昂的手动构建查询特定评分标准，难以扩展，因此需要自动化、细粒度且与人类偏好对齐的评分标准生成方法。

Result: 实验表明，所提出的评分标准生成器比现有评分标准设计策略提供更具区分性和更好人类对齐的监督；当集成到多智能体马尔可夫状态训练框架中时，配备该生成器的DeepResearch系统在DeepResearch Bench上持续超越所有开源基线，并达到与领先闭源模型相当的性能水平。

Insight: 创新点在于通过人类偏好数据与强化学习结合自动化生成查询特定评分标准，以及引入多智能体马尔可夫状态工作流来增强长程推理能力，为报告生成任务提供了可扩展且有效的监督机制。

Abstract: Nowadays, training and evaluating DeepResearch-generated reports remain challenging due to the lack of verifiable reward signals. Accordingly, rubric-based evaluation has become a common practice. However, existing approaches either rely on coarse, pre-defined rubrics that lack sufficient granularity, or depend on manually constructed query-specific rubrics that are costly and difficult to scale. In this paper, we propose a pipeline to train human-preference-aligned query-specific rubric generators tailored for DeepResearch report generation. We first construct a dataset of DeepResearch-style queries annotated with human preferences over paired reports, and train rubric generators via reinforcement learning with a hybrid reward combining human preference supervision and LLM-based rubric evaluation. To better handle long-horizon reasoning, we further introduce a Multi-agent Markov-state (MaMs) workflow for report generation. We empirically show that our proposed rubric generators deliver more discriminative and better human-aligned supervision than existing rubric design strategies. Moreover, when integrated into the MaMs training framework, DeepResearch systems equipped with our rubric generators consistently outperform all open-source baselines on the DeepResearch Bench and achieve performance comparable to that of leading closed-source models.

[33] BIRDTurk: Adaptation of the BIRD Text-to-SQL Dataset to Turkish cs.CL | cs.AI | cs.DBPDF

Burak Aktaş, Mehmet Can Baytekin, Süha Kağan Köse, Ömer İlbilgi, Elif Özge Yılmaz

TL;DR: 本文介绍了BIRDTurk，这是首个土耳其语版本的BIRD文本到SQL基准数据集，通过受控翻译流程构建，在保持SQL查询和数据库逻辑结构与执行语义严格不变的前提下，将模式标识符适配为土耳其语。翻译质量经中心极限定理确定的样本量验证，达到98.15%的人工评估准确率。利用该数据集，作者评估了基于推理的提示、代理多阶段推理和监督微调等方法，发现土耳其语因结构语言差异和在LLM预训练中的代表性不足导致性能一致下降，而代理推理展现出更强的跨语言鲁棒性。

Details

Motivation: 解决文本到SQL系统在形态丰富、资源匮乏语言（如土耳其语）上性能未被充分探索的问题，构建首个土耳其语基准以评估跨语言文本到SQL能力。

Result: 在BIRDTurk基准上，土耳其语导致性能一致下降；代理多阶段推理表现出更强的跨语言鲁棒性；监督微调对标准多语言基线仍有挑战，但在现代指令调优模型上能有效扩展。

Insight: 创新点在于构建首个严格保持逻辑语义的土耳其语文本到SQL基准，并通过受控翻译确保质量；客观分析表明，该研究揭示了语言结构差异和预训练数据代表性对跨语言文本到SQL性能的关键影响，以及代理推理在跨语言场景下的潜在优势。

Abstract: Text-to-SQL systems have achieved strong performance on English benchmarks, yet their behavior in morphologically rich, low-resource languages remains largely unexplored. We introduce BIRDTurk, the first Turkish adaptation of the BIRD benchmark, constructed through a controlled translation pipeline that adapts schema identifiers to Turkish while strictly preserving the logical structure and execution semantics of SQL queries and databases. Translation quality is validated on a sample size determined by the Central Limit Theorem to ensure 95% confidence, achieving 98.15% accuracy on human-evaluated samples. Using BIRDTurk, we evaluate inference-based prompting, agentic multi-stage reasoning, and supervised fine-tuning. Our results reveal that Turkish introduces consistent performance degradation, driven by both structural linguistic divergence and underrepresentation in LLM pretraining, while agentic reasoning demonstrates stronger cross-lingual robustness. Supervised fine-tuning remains challenging for standard multilingual baselines but scales effectively with modern instruction-tuned models. BIRDTurk provides a controlled testbed for cross-lingual Text-to-SQL evaluation under realistic database conditions. We release the training and development splits to support future research.

[34] TRE: Encouraging Exploration in the Trust Region cs.CL | cs.LGPDF

Chao Huang, Yujing Lu, Quangang Li, Shenghe Wang, Yan Wang

TL;DR: 本文提出了一种名为信任区域熵（TRE）的新方法，用于解决在大语言模型（LLMs）强化学习中，标准熵正则化技术因词汇量大和生成长度长而导致的探索效率低下甚至性能下降的问题。TRE通过将探索严格限制在模型的信任区域内，有效提升了在数学推理、组合搜索和偏好对齐等任务上的性能。

Details

Motivation: 标准熵正则化在LLMs的强化学习中效果不佳或产生负面影响，其根本原因在于LLMs巨大的词汇量和长生成序列带来的累积尾部风险，导致概率质量被无差别地分散到大量无效的尾部词汇上，破坏了连贯推理。

Result: 在MATH（数学推理）、Countdown（组合搜索）和HH（偏好对齐）等任务上的广泛实验表明，TRE方法在性能上持续优于原始PPO、标准熵正则化以及其他探索基线方法。

Insight: 论文的核心创新点在于将探索引导与模型的信任区域相结合，提出了TRE方法。其关键洞察是，在LLMs这类高维、长序列环境中，有效的探索不应是全局的、无差别的熵最大化，而应聚焦于模型当前策略下可信的候选动作（即信任区域）内，从而在鼓励探索的同时保持生成的一致性和质量。

Abstract: Entropy regularization is a standard technique in reinforcement learning (RL) to enhance exploration, yet it yields negligible effects or even degrades performance in Large Language Models (LLMs). We attribute this failure to the cumulative tail risk inherent to LLMs with massive vocabularies and long generation horizons. In such environments, standard global entropy maximization indiscriminately dilutes probability mass into the vast tail of invalid tokens rather than focusing on plausible candidates, thereby disrupting coherent reasoning. To address this, we propose Trust Region Entropy (TRE), a method that encourages exploration strictly within the model’s trust region. Extensive experiments across mathematical reasoning (MATH), combinatorial search (Countdown), and preference alignment (HH) tasks demonstrate that TRE consistently outperforms vanilla PPO, standard entropy regularization, and other exploration baselines. Our code is available at https://github.com/WhyChaos/TRE-Encouraging-Exploration-in-the-Trust-Region.

[35] Instruction Anchors: Dissecting the Causal Dynamics of Modality Arbitration cs.CLPDF

Yu Zhang, Mufan Xu, Xuefeng Bai, Kehai chen, Pengfei Zhang

TL;DR: 本文通过信息流视角研究多模态大语言模型（MLLMs）中指令引导的模态跟随机制，发现指令令牌作为模态仲裁的结构锚点：浅层注意力层执行非选择性信息传递，将多模态线索路由至这些锚点作为潜在缓冲；深层注意力层在指令意图引导下解决模态竞争，而MLP层表现出语义惯性，起到对抗作用。研究还识别出驱动仲裁的稀疏专用注意力头，并通过因果干预证明仅操纵5%的关键头即可显著改变模态跟随率。

Details

Motivation: 模态跟随能力是MLLMs根据用户指令选择性利用多模态上下文的基础，对确保实际部署的安全性和可靠性至关重要，但其决策机制尚不明确，本文旨在揭示其工作机制。

Result: 通过因果干预实验，仅阻塞5%的关键注意力头可使模态跟随率降低60%，而针对性放大失败样本可使其提升60%，验证了所识别机制的有效性。

Insight: 创新点在于将指令令牌定位为模态仲裁的结构锚点，并揭示了注意力层与MLP层在模态竞争中的不同作用；从客观角度看，该研究为模型透明度提供了新视角，并为多模态信息编排提供了原则性框架，特别是通过稀疏注意力头进行高效干预的方法具有借鉴意义。

Abstract: Modality following serves as the capacity of multimodal large language models (MLLMs) to selectively utilize multimodal contexts based on user instructions. It is fundamental to ensuring safety and reliability in real-world deployments. However, the underlying mechanisms governing this decision-making process remain poorly understood. In this paper, we investigate its working mechanism through an information flow lens. Our findings reveal that instruction tokens function as structural anchors for modality arbitration: Shallow attention layers perform non-selective information transfer, routing multimodal cues to these anchors as a latent buffer; Modality competition is resolved within deep attention layers guided by the instruction intent, while MLP layers exhibit semantic inertia, acting as an adversarial force. Furthermore, we identify a sparse set of specialized attention heads that drive this arbitration. Causal interventions demonstrate that manipulating a mere $5%$ of these critical heads can decrease the modality-following ratio by $60%$ through blocking, or increase it by $60%$ through targeted amplification of failed samples. Our work provides a substantial step toward model transparency and offers a principled framework for the orchestration of multimodal information in MLLMs.

[36] Rethinking the Reranker: Boundary-Aware Evidence Selection for Robust Retrieval-Augmented Generation cs.CL | cs.AIPDF

Jiashuo Sun, Pengcheng Jiang, Saizhuo Wang, Jiajun Fan, Heng Wang

TL;DR: 本文提出BAR-RAG方法，通过将重排序器重构为边界感知的证据选择器，旨在为生成器选择处于’Goldilocks Zone’的证据——既非过于简单也非无法回答，而是具有挑战性但足以推理的证据，从而提升检索增强生成（RAG）系统在噪声检索下的鲁棒性。该方法采用强化学习训练选择器，并采用两阶段管道微调生成器以缓解训练与推理间的分布不匹配。

Details

Motivation: 现有RAG系统在检索噪声下表现脆弱，因为检索器和重排序器仅优化相关性，常选择过于简单或缺乏关键信息的证据，而未考虑证据是否适合生成器，导致性能下降。

Result: 在知识密集型问答基准测试中，BAR-RAG在噪声检索下持续提升端到端性能，相比强基线RAG和重排序方法平均增益达10.3%，并显著提高了鲁棒性。

Insight: 创新点在于将重排序任务重新定义为边界感知的证据选择，以生成器的反馈通过强化学习训练选择器，并引入两阶段管道微调生成器，从而优化证据分布以增强系统鲁棒性。

Abstract: Retrieval-Augmented Generation (RAG) systems remain brittle under realistic retrieval noise, even when the required evidence appears in the top-K results. A key reason is that retrievers and rerankers optimize solely for relevance, often selecting either trivial, answer-revealing passages or evidence that lacks the critical information required to answer the question, without considering whether the evidence is suitable for the generator. We propose BAR-RAG, which reframes the reranker as a boundary-aware evidence selector that targets the generator’s Goldilocks Zone – evidence that is neither trivially easy nor fundamentally unanswerable for the generator, but is challenging yet sufficient for inference and thus provides the strongest learning signal. BAR-RAG trains the selector with reinforcement learning using generator feedback, and adopts a two-stage pipeline that fine-tunes the generator under the induced evidence distribution to mitigate the distribution mismatch between training and inference. Experiments on knowledge-intensive question answering benchmarks show that BAR-RAG consistently improves end-to-end performance under noisy retrieval, achieving an average gain of 10.3 percent over strong RAG and reranking baselines while substantially improving robustness. Code is publicly avaliable at https://github.com/GasolSun36/BAR-RAG.

[37] OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answering cs.CLPDF

Yifan Zhu, Xinyu Mu, Tao Feng, Zhonghong Ou, Yuning Gong

TL;DR: 本文提出OmniRAG-Agent，一种面向低资源长音频视频问答的智能体化多模态推理方法。该方法构建了图像-音频检索增强生成模块，使多模态大语言模型能够从外部知识库中检索相关的短帧和音频片段，并通过智能体循环进行规划、工具调用和证据融合，同时采用组相对策略优化联合提升工具使用和答案质量。

Details

Motivation: 解决长时序多模态问答（涵盖文本、图像、音频、视频）中，低资源长音频视频问答面临的四大挑战：密集编码成本高、细粒度检索能力弱、主动规划能力有限、缺乏端到端优化。

Result: 在OmniVideoBench、WorldSense和Daily-Omni基准测试上，OmniRAG-Agent在低资源设置下持续优于现有方法，并取得了强劲的结果，消融实验验证了各组件有效性。

Insight: 创新点包括：1）图像-音频检索增强生成模块实现高效细粒度跨模态检索；2）智能体循环架构支持多轮规划与工具调用；3）组相对策略优化实现工具使用与答案质量的联合端到端优化。

Abstract: Long-horizon omnimodal question answering answers questions by reasoning over text, images, audio, and video. Despite recent progress on OmniLLMs, low-resource long audio-video QA still suffers from costly dense encoding, weak fine-grained retrieval, limited proactive planning, and no clear end-to-end optimization.To address these issues, we propose OmniRAG-Agent, an agentic omnimodal QA method for budgeted long audio-video reasoning. It builds an image-audio retrieval-augmented generation module that lets an OmniLLM fetch short, relevant frames and audio snippets from external banks. Moreover, it uses an agent loop that plans, calls tools across turns, and merges retrieved evidence to answer complex queries. Furthermore, we apply group relative policy optimization to jointly improve tool use and answer quality over time. Experiments on OmniVideoBench, WorldSense, and Daily-Omni show that OmniRAG-Agent consistently outperforms prior methods under low-resource settings and achieves strong results, with ablations validating each component.

[38] Beyond Tokens: Semantic-Aware Speculative Decoding for Efficient Inference by Probing Internal States cs.CL | cs.PFPDF

Ximing Dong, Shaowei Wang, Dayi Lin, Boyuan Chen, Ahmed E. Hassan

TL;DR: 本文提出了一种名为SemanticSpec的语义感知推测解码框架，旨在解决大语言模型（LLMs）和大推理模型（LRMs）自回归解码导致的高推理延迟问题。该框架通过探测模型内部隐藏状态来评估生成特定含义序列的似然性，从而在语义层面而非词元层面进行验证，以减少因语义等价但词元序列不同而导致的低效拒绝。

Details

Motivation: 现有推测解码方法在词元级别操作，忽略了语义等价性（即不同词元序列表达相同含义），导致验证时出现低效拒绝，无法充分利用并行性来加速生成冗长思维链的推理模型。

Result: 在四个基准测试上的实验表明，SemanticSpec在DeepSeekR1-32B上实现了高达2.7倍的加速，在QwQ-32B上实现了2.1倍的加速，在效率和效果上均持续优于词元级和序列级基线方法。

Insight: 主要创新点在于将推测解码的验证单位从词元提升到整个语义序列，并引入基于模型内部隐藏状态的语义概率估计机制。这提供了一种通过利用模型内部表征来理解生成内容语义的新视角，可能为优化解码效率开辟新途径。

Abstract: Large Language Models (LLMs) achieve strong performance across many tasks but suffer from high inference latency due to autoregressive decoding. The issue is exacerbated in Large Reasoning Models (LRMs), which generate lengthy chains of thought. While speculative decoding accelerates inference by drafting and verifying multiple tokens in parallel, existing methods operate at the token level and ignore semantic equivalence (i.e., different token sequences expressing the same meaning), leading to inefficient rejections. We propose SemanticSpec, a semantic-aware speculative decoding framework that verifies entire semantic sequences instead of tokens. SemanticSpec introduces a semantic probability estimation mechanism that probes the model’s internal hidden states to assess the likelihood of generating sequences with specific meanings.Experiments on four benchmarks show that SemanticSpec achieves up to 2.7x speedup on DeepSeekR1-32B and 2.1x on QwQ-32B, consistently outperforming token-level and sequence-level baselines in both efficiency and effectiveness.

[39] No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding cs.CLPDF

Vynska Amalia Permadi, Xingwei Tan, Nafise Sadat Moosavi, Nikos Aletras

TL;DR: 本文介绍了ID-MoCQA，这是首个针对印尼文化的大规模多跳问答数据集，旨在评估大型语言模型（LLMs）的文化理解能力。该数据集通过系统化框架将单跳文化问题转化为涵盖六种线索类型的多跳推理链，并采用专家评审与LLM作为评判的过滤流程确保质量。评估显示，现有先进模型在需要细微推理的文化任务上存在显著差距。

Details

Motivation: 现有文化问答基准多依赖单跳问题，模型可能利用浅层线索而非真正进行文化推理，因此需要构建多跳问答数据集以更全面评估LLMs的文化理解能力。

Result: 在ID-MoCQA基准上对先进模型进行评估，结果显示模型在需要细微推理的文化任务上存在显著差距，突显了该数据集的挑战性。

Insight: 创新点在于构建了首个印尼文化多跳问答数据集，并提出了系统化的问题转换框架和多阶段验证流程；客观来看，该方法为评估和提升LLMs的文化推理能力提供了可扩展的基准构建范式。

Abstract: Understanding culture requires reasoning across context, tradition, and implicit social knowledge, far beyond recalling isolated facts. Yet most culturally focused question answering (QA) benchmarks rely on single-hop questions, which may allow models to exploit shallow cues rather than demonstrate genuine cultural reasoning. In this work, we introduce ID-MoCQA, the first large-scale multi-hop QA dataset for assessing the cultural understanding of large language models (LLMs), grounded in Indonesian traditions and available in both English and Indonesian. We present a new framework that systematically transforms single-hop cultural questions into multi-hop reasoning chains spanning six clue types (e.g., commonsense, temporal, geographical). Our multi-stage validation pipeline, combining expert review and LLM-as-a-judge filtering, ensures high-quality question-answer pairs. Our evaluation across state-of-the-art models reveals substantial gaps in cultural reasoning, particularly in tasks requiring nuanced inference. ID-MoCQA provides a challenging and essential benchmark for advancing the cultural competency of LLMs.

[40] Training Multi-Turn Search Agent via Contrastive Dynamic Branch Sampling cs.CLPDF

Yubao Zhao, Weiquan Huang, Sudong Wang, Ruochen Zhao, Chen Chen

TL;DR: 本文提出了一种名为Branching Relative Policy Optimization (BranPO)的新方法，用于训练多轮搜索智能体。该方法通过截断轨迹尾部并重新采样替代延续来构建对比后缀，从而在无需密集奖励的情况下提供步骤级的对比监督，以解决长视野任务中稀疏奖励和信用分配模糊的问题。

Details

Motivation: 动机在于解决基于智能体的强化学习在长视野任务中面临的挑战，即稀疏的轨迹级结果奖励导致学习困难，以及现有基于树的方法存在高方差和计算效率低下的问题。作者通过实证分析发现，性能差异主要源于轨迹尾部的决策。

Result: 在多个问答基准测试上的广泛实验表明，BranPO始终优于强基线方法，在长视野任务上实现了显著的准确率提升，且没有增加总体训练预算。

Insight: 创新点包括：1) 提出BranPO，一种无价值函数的方法，通过对比后缀提供步骤级监督；2) 引入难度感知分支采样，根据任务自适应调整分支频率；3) 提出冗余步骤掩码，抑制非信息性动作。这些方法共同减少了长视野任务中的信用分配模糊，并提高了训练效率和稳定性。

Abstract: Agentic reinforcement learning has enabled large language models to perform complex multi-turn planning and tool use. However, learning in long-horizon settings remains challenging due to sparse, trajectory-level outcome rewards. While prior tree-based methods attempt to mitigate this issue, they often suffer from high variance and computational inefficiency. Through empirical analysis of search agents, We identify a common pattern: performance diverges mainly due to decisions near the tail. Motivated by this observation, we propose Branching Relative Policy Optimization (BranPO), a value-free method that provides step-level contrastive supervision without dense rewards. BranPO truncates trajectories near the tail and resamples alternative continuations to construct contrastive suffixes over shared prefixes, reducing credit ambiguity in long-horizon rollouts. To further boost efficiency and stabilize training, we introduce difficulty-aware branch sampling to adapt branching frequency across tasks, and redundant step masking to suppress uninformative actions. Extensive experiments on various question answering benchmarks demonstrate that BranPO consistently outperforms strong baselines, achieving significant accuracy gains on long-horizon tasks without increasing the overall training budget. Our code is available at \href{https://github.com/YubaoZhao/BranPO}{code}.

[41] They Said Memes Were Harmless-We Found the Ones That Hurt: Decoding Jokes, Symbols, and Cultural References cs.CLPDF

Sahil Tripathi, Gautam Siddharth Kashyap, Mehwish Nasim, Jian Yang, Jiechao Gao

TL;DR: 本文提出CROSS-ALIGN+框架，用于检测基于模因（meme）的社交滥用内容。该框架通过三阶段方法解决现有方法在文化盲区、边界模糊和可解释性方面的不足，利用外部知识库增强多模态表示，并引入参数高效适配器以提升性能。

Details

Motivation: 现有模因滥用检测方法因忽略文化符号、难以区分讽刺与滥用、以及模型推理不透明而受限，本文旨在系统性地解决这三个核心挑战。

Result: 在五个基准数据集和八个大型视觉语言模型上的实验表明，CROSS-ALIGN+ consistently outperforms state-of-the-art methods，相对F1分数提升最高达17%，并能为每个决策提供可解释的理由。

Insight: 创新点在于将结构化外部知识（如ConceptNet、Wikidata、Hatebase）系统性地融入多模态表示以缓解文化盲区，并采用LoRA适配器进行参数高效微调来锐化决策边界，同时通过生成级联解释增强模型可解释性。

Abstract: Meme-based social abuse detection is challenging because harmful intent often relies on implicit cultural symbolism and subtle cross-modal incongruence. Prior approaches, from fusion-based methods to in-context learning with Large Vision-Language Models (LVLMs), have made progress but remain limited by three factors: i) cultural blindness (missing symbolic context), ii) boundary ambiguity (satire vs. abuse confusion), and iii) lack of interpretability (opaque model reasoning). We introduce CROSS-ALIGN+, a three-stage framework that systematically addresses these limitations: (1) Stage I mitigates cultural blindness by enriching multimodal representations with structured knowledge from ConceptNet, Wikidata, and Hatebase; (2) Stage II reduces boundary ambiguity through parameter-efficient LoRA adapters that sharpen decision boundaries; and (3) Stage III enhances interpretability by generating cascaded explanations. Extensive experiments on five benchmarks and eight LVLMs demonstrate that CROSS-ALIGN+ consistently outperforms state-of-the-art methods, achieving up to 17% relative F1 improvement while providing interpretable justifications for each decision.

[42] Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing cs.CLPDF

Tong Zheng, Chengsong Huang, Runpeng Dai, Yun He, Rui Liu

TL;DR: 本文提出了一种名为Parallel-Probe的高效并行思维方法，通过引入2D探测接口来揭示并行推理分支的宽度-深度动态，并基于此设计了一个无需训练的控制机制，以动态调整推理深度和分支数量，从而在保持准确性的同时显著降低计算成本。

Details

Motivation: 现有并行思维方法计算负担重，且主要依赖局部、单轨迹信号，缺乏利用并行分支间全局动态的原则性机制。本文旨在解决并行推理的效率问题。

Result: 在三个基准测试和多个模型上的实验表明，Parallel-Probe在测试时扩展上建立了更优的帕累托前沿。与标准多数投票相比，它减少了高达35.8%的顺序令牌和超过25.8%的总令牌成本，同时保持了有竞争力的准确性。

Insight: 创新点在于提出了2D探测接口来暴露并行推理的宽度-深度动态，并基于对非单调缩放、分支长度异质性和全局共识早期稳定性的洞察，设计了基于共识的提前停止和基于偏差的分支剪枝等无需训练的控制策略，以实现高效的在线并行思维。

Abstract: Parallel thinking has emerged as a promising paradigm for reasoning, yet it imposes significant computational burdens. Existing efficiency methods primarily rely on local, per-trajectory signals and lack principled mechanisms to exploit global dynamics across parallel branches. We introduce 2D probing, an interface that exposes the width-depth dynamics of parallel thinking by periodically eliciting intermediate answers from all branches. Our analysis reveals three key insights: non-monotonic scaling across width-depth allocations, heterogeneous reasoning branch lengths, and early stabilization of global consensus. Guided by these insights, we introduce $\textbf{Parallel-Probe}$, a training-free controller designed to optimize online parallel thinking. Parallel-Probe employs consensus-based early stopping to regulate reasoning depth and deviation-based branch pruning to dynamically adjust width. Extensive experiments across three benchmarks and multiple models demonstrate that Parallel-Probe establishes a superior Pareto frontier for test-time scaling. Compared to standard majority voting, it reduces sequential tokens by up to $\textbf{35.8}$% and total token cost by over $\textbf{25.8}$% while maintaining competitive accuracy.

cs.CV [Back]

[43] WorldVQA: Measuring Atomic World Knowledge in Multimodal Large Language Models cs.CV | cs.LGPDF

Runjie Zhou, Youbo Shao, Haoyu Lu, Bowei Xing, Tongtong Bai

TL;DR: 本文提出了WorldVQA基准，旨在专门评估多模态大语言模型（MLLMs）对视觉世界知识的原子性记忆能力。该基准通过解耦知识检索与推理过程，严格衡量模型对视觉实体（从常见类别到长尾稀有类别）的指认和命名能力，以测试模型的视觉事实性和百科全书广度。

Details

Motivation: 当前评估方法常将视觉知识检索与推理能力混为一谈，无法准确衡量模型对世界知识的纯粹记忆。本文旨在解决这一问题，提供一个专门用于严格评估MLLMs视觉事实性知识（即“模型记住了什么”）的基准。

Result: 论文主要介绍了基准的构建理念与设计，未在摘要中提及具体的定量实验结果或与其他模型的对比数据。

Insight: 核心创新在于解耦了知识记忆与推理，并构建了一个分层分类（从常见头类到长尾稀有类）的视觉实体基准，为评估模型的视觉事实性、百科全书覆盖率和幻觉率提供了标准化工具。

Abstract: We introduce WorldVQA, a benchmark designed to evaluate the atomic visual world knowledge of Multimodal Large Language Models (MLLMs). Unlike current evaluations, which often conflate visual knowledge retrieval with reasoning, WorldVQA decouples these capabilities to strictly measure “what the model memorizes.” The benchmark assesses the atomic capability of grounding and naming visual entities across a stratified taxonomy, spanning from common head-class objects to long-tail rarities. We expect WorldVQA to serve as a rigorous test for visual factuality, thereby establishing a standard for assessing the encyclopedic breadth and hallucination rates of current and next-generation frontier models.

[44] AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Process cs.CVPDF

Xintong Zhang, Xiaowen Zhang, Jongrong Wu, Zhi Gao, Shilin Yan

TL;DR: 本文提出了AdaptMMBench，一个用于评估自适应多模态推理的综合基准，涵盖现实世界、OCR、GUI、知识和数学五个领域。该基准通过马修斯相关系数（MCC）评估不同推理模式的选择合理性，并支持对关键步骤覆盖、工具有效性和计算效率的多维过程分析。

Details

Motivation: 现有评估方法依赖静态难度标签和简单指标，无法捕捉任务难度相对于模型能力的动态性，从而混淆了自适应模式选择与一般性能的区别，并忽视了细粒度的推理过程分析。

Result: 评估发现，自适应模式选择能力随模型容量提升而增强，但与最终准确率显著解耦；关键步骤覆盖与性能正相关，而工具有效性在不同模型架构间高度不一致。

Insight: 创新点在于动态识别基于模型能力边界的任务难度以隔离元认知能力，并引入多维过程评估指标；客观分析认为，该基准为自适应多模态推理提供了更细粒度和动态的评估框架，有助于深入理解模型在模式选择和推理过程中的行为。

Abstract: Adaptive multimodal reasoning has emerged as a promising frontier in Vision-Language Models (VLMs), aiming to dynamically modulate between tool-augmented visual reasoning and text reasoning to enhance both effectiveness and efficiency. However, existing evaluations rely on static difficulty labels and simplistic metrics, which fail to capture the dynamic nature of difficulty relative to varying model capacities. Consequently, they obscure the distinction between adaptive mode selection and general performance while neglecting fine-grained process analyses. In this paper, we propose AdaptMMBench, a comprehensive benchmark for adaptive multimodal reasoning across five domains: real-world, OCR, GUI, knowledge, and math, encompassing both direct perception and complex reasoning tasks. AdaptMMBench utilizes a Matthews Correlation Coefficient (MCC) metric to evaluate the selection rationality of different reasoning modes, isolating this meta-cognition ability by dynamically identifying task difficulties based on models’ capability boundaries. Moreover, AdaptMMBench facilitates multi-dimensional process evaluation across key step coverage, tool effectiveness, and computational efficiency. Our evaluation reveals that while adaptive mode selection scales with model capacity, it notably decouples from final accuracy. Conversely, key step coverage aligns with performance, though tool effectiveness remains highly inconsistent across model architectures.

[45] End-to-end reconstruction of OCT optical properties and speckle-reduced structural intensity via physics-based learning cs.CVPDF

Jinglun Yu, Yaning Wang, Wenhan Guo, Yuan Gao, Yu Sun

TL;DR: 本文提出了一种基于物理约束的端到端深度学习框架，用于从光学相干断层扫描（OCT）数据中联合重建组织的光学参数图（如折射率、散射系数、各向异性）和去散斑的结构强度图像。该方法通过蒙特卡洛模拟生成训练数据，并利用物理前向模型提供一致性监督，以解决逆散射问题中的参数耦合、衰减和噪声等挑战。

Details

Motivation: 解决OCT逆散射问题中因衰减、散斑噪声和参数强耦合导致的组织光学参数与结构图像联合重建困难，以实现定量多参数组织表征和高质量层状可视化。

Result: 在合成的角膜OCT数据集上的实验表明，该方法在噪声下能稳健地恢复光学参数图，同时提高了分辨率和结构保真度。

Insight: 创新点在于将物理前向模型嵌入端到端深度学习框架，提供物理一致性监督，从而联合优化参数恢复和伪影抑制；这展示了物理信息建模与深度学习结合在计算OCT中的优势，为逆问题求解提供了可借鉴的范式。

Abstract: Inverse scattering in optical coherence tomography (OCT) seeks to recover both structural images and intrinsic tissue optical properties, including refractive index, scattering coefficient, and anisotropy. This inverse problem is challenging due to attenuation, speckle noise, and strong coupling among parameters. We propose a regularized end-to-end deep learning framework that jointly reconstructs optical parameter maps and speckle-reduced OCT structural intensity for layer visualization. Trained with Monte Carlo-simulated ground truth, our network incorporates a physics-based OCT forward model that generates predicted signals from the estimated parameters, providing physics-consistent supervision for parameter recovery and artifact suppression. Experiments on the synthetic corneal OCT dataset demonstrate robust optical map recovery under noise, improved resolution, and enhanced structural fidelity. This approach enables quantitative multi-parameter tissue characterization and highlights the benefit of combining physics-informed modeling with deep learning for computational OCT.

[46] SVD-ViT: Does SVD Make Vision Transformers Attend More to the Foreground? cs.CVPDF

Haruhiko Murata, Kazuhiro Hotta

TL;DR: SVD-ViT是一种改进的视觉Transformer模型，通过奇异值分解（SVD）来增强模型对前景特征的关注，抑制背景噪声和伪影，从而提高图像分类性能。

Details

Motivation: 视觉Transformer（ViT）由于自注意力机制的全局性，缺乏明确区分前景与背景的机制，导致可能学习到不必要的背景特征和伪影，从而降低分类性能。

Result: 实验结果表明，该方法提高了分类准确率，有效学习了信息丰富的前景表示，同时减少了背景噪声的影响。

Insight: 创新点在于引入SVD来提取和聚合捕获物体前景信息的奇异向量，通过SPC模块、SSVA和ID-RSVD三个组件，显式地优先学习前景特征，抑制任务无关因素。

Abstract: Vision Transformers (ViT) have been established as large-scale foundation models. However, because self-attention operates globally, they lack an explicit mechanism to distinguish foreground from background. As a result, ViT may learn unnecessary background features and artifacts, leading to degraded classification performance. To address this issue, we propose SVD-ViT, which leverages singular value decomposition (SVD) to prioritize the learning of foreground features. SVD-ViT consists of three components-\textbf{SPC module}, \textbf{SSVA}, and \textbf{ID-RSVD}-and suppresses task-irrelevant factors such as background noise and artifacts by extracting and aggregating singular vectors that capture object foreground information. Experimental results demonstrate that our method improves classification accuracy and effectively learns informative foreground representations while reducing the impact of background noise.

[47] Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room cs.CVPDF

Keqi Chen, Vinkle Srivastav, Armine Vardazaryan, Cindy Rolland, Didier Mutter

TL;DR: 本文提出了一种无需标注和相机标定的自监督多视角视频匿名化框架，用于手术室场景下的隐私保护。该方法通过结合全身人员检测和姿态估计，利用时间和多视角上下文信息检索漏检目标，并进行自监督域适应，有效提升了匿名化效果。

Details

Motivation: 解决手术室视频隐私保护中现有方法依赖人工标注和相机标定、难以扩展的问题，旨在实现无需标注和标定的高效多视角匿名化。

Result: 在模拟和真实手术数据集（4D-OR）上实验显示，该方法召回率超过97%，且训练出的实时全身检测器性能与现有方法相当，证明了其实际应用价值。

Insight: 创新点在于通过自监督方式利用多视角和时间一致性检索漏检目标作为伪标签，迭代优化检测器，避免了标注和相机标定需求，提升了方法的可扩展性和实用性。

Abstract: Privacy preservation is a prerequisite for using video data in Operating Room (OR) research. Effective anonymization relies on the exhaustive localization of every individual; even a single missed detection necessitates extensive manual correction. However, existing approaches face two critical scalability bottlenecks: (1) they usually require manual annotations of each new clinical site for high accuracy; (2) while multi-camera setups have been widely adopted to address single-view ambiguity, camera calibration is typically required whenever cameras are repositioned. To address these problems, we propose a novel self-supervised multi-view video anonymization framework consisting of whole-body person detection and whole-body pose estimation, without annotation or camera calibration. Our core strategy is to enhance the single-view detector by “retrieving” false negatives using temporal and multi-view context, and conducting self-supervised domain adaptation. We first run an off-the-shelf whole-body person detector in each view with a low-score threshold to gather candidate detections. Then, we retrieve the low-score false negatives that exhibit consistency with the high-score detections via tracking and self-supervised uncalibrated multi-view association. These recovered detections serve as pseudo labels to iteratively fine-tune the whole-body detector. Finally, we apply whole-body pose estimation on each detected person, and fine-tune the pose model using its own high-score predictions. Experiments on the 4D-OR dataset of simulated surgeries and our dataset of real surgeries show the effectiveness of our approach achieving over 97% recall. Moreover, we train a real-time whole-body detector using our pseudo labels, achieving comparable performance and highlighting our method’s practical applicability. Code is available at https://github.com/CAMMA-public/OR_anonymization.

[48] ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying cs.CVPDF

Weihang You, Qingchan Zhu, David Liu, Yi Pan, Geng Yuan

TL;DR: ViThinker是一个主动视觉-语言推理框架，通过动态感知查询来解决现有视觉语言模型中思维链推理因过早将视觉信息转换为文本而丢失几何和空间布局等连续信息的问题。该框架使模型能够自主生成决策（查询）令牌，按需触发合成专家对齐的视觉特征，无需外部工具调用。

Details

Motivation: 现有视觉语言模型的思维链推理方法多为被动处理预计算输入，无法主动获取任务相关细节，导致视觉信息利用不充分。

Result: 在多个以视觉为中心的基准测试中，ViThinker均取得了一致的性能提升，验证了主动查询生成在感知基础和推理准确性上优于被动方法。

Insight: 创新点在于引入了受人类主动感知启发的动态查询机制，通过两阶段课程学习（先蒸馏专家知识到模型参数，再通过稀疏性惩罚学习任务驱动的查询）实现推理步骤中的最小充分感知，提升了模型的自主推理能力。

Abstract: Chain-of-Thought (CoT) reasoning excels in language models but struggles in vision-language models due to premature visual-to-text conversion that discards continuous information such as geometry and spatial layout. While recent methods enhance CoT through static enumeration or attention-based selection, they remain passive, i.e., processing pre-computed inputs rather than actively seeking task-relevant details. Inspired by human active perception, we introduce ViThinker, a framework that enables vision-language models to autonomously generate decision (query) tokens triggering the synthesis of expert-aligned visual features on demand. ViThinker internalizes vision-expert capabilities during training, performing generative mental simulation during inference without external tool calls. Through a two-stage curriculum: first distilling frozen experts into model parameters, then learning task-driven querying via sparsity penalties, i.e., ViThinker discovers minimal sufficient perception for each reasoning step. Evaluations across vision-centric benchmarks demonstrate consistent improvements, validating that active query generation outperforms passive approaches in both perceptual grounding and reasoning accuracy.

[49] DoubleTake: Contrastive Reasoning for Faithful Decision-Making in Medical Imaging cs.CV | cs.LGPDF

Daivik Patel, Shrenik Patel

TL;DR: 本文提出了一种名为DoubleTake的对比推理框架，用于医学影像中的忠实决策。该框架通过构建紧凑的对比证据集，并结合反事实对比推理，在MediConfusion基准测试中实现了最先进的性能，显著提升了集合级准确率并减少了混淆。

Details

Motivation: 解决医学影像决策中现有方法（如最近邻检索）因返回冗余证据和强化单一假设而难以区分相似病症的问题，旨在通过对比推理实现更忠实和准确的决策。

Result: 在MediConfusion基准测试上达到了最先进的性能，相对于先前方法，集合级准确率提升了近15%，同时减少了混淆并提高了个体准确率。

Insight: 创新点包括：1) 引入对比性、文档感知的参考选择框架，通过平衡视觉相关性、嵌入多样性和来源可追溯性来构建优化的证据集；2) 提出反事实对比推理，利用基于边际的决策规则进行结构化成对视觉比较和证据聚合，支持忠实弃权。

Abstract: Accurate decision making in medical imaging requires reasoning over subtle visual differences between confusable conditions, yet most existing approaches rely on nearest neighbor retrieval that returns redundant evidence and reinforces a single hypothesis. We introduce a contrastive, document-aware reference selection framework that constructs compact evidence sets optimized for discrimination rather than similarity by explicitly balancing visual relevance, embedding diversity, and source-level provenance using ROCO embeddings and metadata. While ROCO provides large-scale image-caption pairs, it does not specify how references should be selected for contrastive reasoning, and naive retrieval frequently yields near-duplicate figures from the same document. To address this gap, we release a reproducible reference selection protocol and curated reference bank that enable a systematic study of contrastive retrieval in medical image reasoning. Building on these contrastive evidence sets, we propose Counterfactual-Contrastive Inference, a confidence-aware reasoning framework that performs structured pairwise visual comparisons and aggregates evidence using margin-based decision rules with faithful abstention. On the MediConfusion benchmark, our approach achieves state-of-the-art performance, improving set-level accuracy by nearly 15% relative to prior methods while reducing confusion and improving individual accuracy.

[50] A Multi-scale Linear-time Encoder for Whole-Slide Image Analysis cs.CV | cs.AI | cs.LG | q-bio.TOPDF

Jagan Mohan Reddy Dwarampudi, Joshua Wong, Hien Van Nguyen, Tania Banerjee

TL;DR: 本文提出了MARBLE，首个完全基于Mamba的多状态多示例学习框架，用于全切片图像分析。它并行处理多个放大倍数，在线性时间状态空间模型中整合从粗到细的推理，高效捕获跨尺度依赖。

Details

Motivation: 全切片图像分析因千兆像素分辨率和层级放大倍数而极具挑战，现有方法通常仅在单一尺度操作，而基于Transformer的方法则受二次注意力计算成本所限。

Result: 在五个公开数据集上的实验表明，MARBLE在AUC上提升高达6.9%，准确率提升20.3%，C-index提升2.3%，确立了其作为高效且可泛化的多尺度WSI分析框架的地位。

Insight: 主要创新点在于将并行多尺度处理与线性时间序列建模耦合，为基于注意力的架构提供了一个可扩展且模块化的替代方案，显著降低了计算复杂度。

Abstract: We introduce Multi-scale Adaptive Recurrent Biomedical Linear-time Encoder (MARBLE), the first \textit{purely Mamba-based} multi-state multiple instance learning (MIL) framework for whole-slide image (WSI) analysis. MARBLE processes multiple magnification levels in parallel and integrates coarse-to-fine reasoning within a linear-time state-space model, efficiently capturing cross-scale dependencies with minimal parameter overhead. WSI analysis remains challenging due to gigapixel resolutions and hierarchical magnifications, while existing MIL methods typically operate at a single scale and transformer-based approaches suffer from quadratic attention costs. By coupling parallel multi-scale processing with linear-time sequence modeling, MARBLE provides a scalable and modular alternative to attention-based architectures. Experiments on five public datasets show improvements of up to \textbf{6.9%} in AUC, \textbf{20.3%} in accuracy, and \textbf{2.3%} in C-index, establishing MARBLE as an efficient and generalizable framework for multi-scale WSI analysis.

[51] Nüwa: Mending the Spatial Integrity Torn by VLM Token Pruning cs.CV | cs.AI | cs.CLPDF

Yihong Huang, Fei Ma, Yihua Shao, Jingcai Guo, Zitong Yu

TL;DR: 本文提出了一种名为Nüwa的两阶段视觉令牌剪枝框架，旨在解决现有视觉语言模型（VLM）加速技术中视觉定位任务性能大幅下降的问题。该框架通过保留全局空间锚点和进行文本引导的剪枝，在保持空间完整性的同时实现高效特征聚合。

Details

Motivation: 现有视觉令牌剪枝方法在视觉问答（VQA）任务中表现良好，但在视觉定位（VG）任务中性能显著下降。分析发现，这些方法因依赖全局语义相似性和注意力分数而丢失了源自令牌位置信息交互的全局空间参考框架。

Result: 在多个VQA基准测试上，Nüwa实现了SOTA性能（从94%提升至95%），并在视觉定位任务上取得了显著改进（从7%提升至47%）。

Insight: 创新点在于提出两阶段剪枝框架：第一阶段受群体智能算法启发，通过分离、对齐和聚合操作保留信息丰富的全局空间锚点；第二阶段在LLM内进行文本引导剪枝以保留任务相关视觉令牌。这解决了现有方法因破坏空间完整性而导致VG任务性能下降的核心问题。

Abstract: Vision token pruning has proven to be an effective acceleration technique for the efficient Vision Language Model (VLM). However, existing pruning methods demonstrate excellent performance preservation in visual question answering (VQA) and suffer substantial degradation on visual grounding (VG) tasks. Our analysis of the VLM’s processing pipeline reveals that strategies utilizing global semantic similarity and attention scores lose the global spatial reference frame, which is derived from the interactions of tokens’ positional information. Motivated by these findings, we propose $\text{Nüwa}$, a two-stage token pruning framework that enables efficient feature aggregation while maintaining spatial integrity. In the first stage, after the vision encoder, we apply three operations, namely separation, alignment, and aggregation, which are inspired by swarm intelligence algorithms to retain information-rich global spatial anchors. In the second stage, within the LLM, we perform text-guided pruning to retain task-relevant visual tokens. Extensive experiments demonstrate that $\text{Nüwa}$ achieves SOTA performance on multiple VQA benchmarks (from 94% to 95%) and yields substantial improvements on visual grounding tasks (from 7% to 47%).

[52] TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation cs.CVPDF

OFM Riaz Rahman Aranya, Kevin Desai

TL;DR: TRACE是首个结合时间比较、变化分类和空间定位的模型，用于胸部X光片的时间序列分析。它能够生成自然语言描述间隔变化（恶化、改善、稳定），并用边界框坐标对每个发现进行视觉定位，在超过90%的定位准确率上展示了有效性。

Details

Motivation: 解决现有视觉语言模型在时间变化检测中无法同时进行报告生成和视觉定位的问题，填补了临床放射学中时间比较任务的技术空白。

Result: 在空间定位方面达到超过90%的准确率，为这一新任务奠定了基础；消融研究表明，仅当时间比较和空间定位联合学习时，变化检测能力才会出现。

Insight: 创新点在于首次将时间比较与空间定位结合，揭示了定位作为空间注意力机制对时间推理的关键作用；可借鉴的是多任务联合学习能激发模型的新兴能力。

Abstract: Temporal comparison of chest X-rays is fundamental to clinical radiology, enabling detection of disease progression, treatment response, and new findings. While vision-language models have advanced single-image report generation and visual grounding, no existing method combines these capabilities for temporal change detection. We introduce Temporal Radiology with Anatomical Change Explanation (TRACE), the first model that jointly performs temporal comparison, change classification, and spatial localization. Given a prior and current chest X-ray, TRACE generates natural language descriptions of interval changes (worsened, improved, stable) while grounding each finding with bounding box coordinates. TRACE demonstrates effective spatial localization with over 90% grounding accuracy, establishing a foundation for this challenging new task. Our ablation study uncovers an emergent capability: change detection arises only when temporal comparison and spatial grounding are jointly learned, as neither alone enables meaningful change detection. This finding suggests that grounding provides a spatial attention mechanism essential for temporal reasoning.

[53] Fisheye Stereo Vision: Depth and Range Error cs.CVPDF

Leaf Jiang, Matthew Holzel, Bernhard Kaplan, Hsiou-Yuan Liu, Sabyasachi Paul

TL;DR: 该研究推导了鱼眼立体视觉系统中深度和距离误差的解析表达式，这些表达式是物体距离的函数，并特别考虑了大角度下的精度问题。

Details

Motivation: 解决鱼眼立体视觉系统在物体距离估计中，尤其是在大视角下，深度和范围误差的量化分析问题。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试，主要贡献是理论推导。

Insight: 创新点在于为鱼眼立体视觉系统提供了专门针对大角度情况的深度和距离误差解析模型，这有助于系统设计和精度评估。

Abstract: This study derives analytical expressions for the depth and range error of fisheye stereo vision systems as a function of object distance, specifically accounting for accuracy at large angles.

[54] Aligning Forest and Trees in Images and Long Captions for Visually Grounded Understanding cs.CV | cs.AI | cs.LGPDF

Byeongju Woo, Zilin Wang, Byeonghyun Pak, Sangwoo Mo, Stella X. Yu

TL;DR: 本文提出CAFT（跨域森林与树木对齐）框架，通过分层图像-文本表示学习，在无需像素级监督的情况下对齐图像与长描述中的全局和局部语义，解决了CLIP等大视觉语言模型在处理长描述时因整体对齐而忽略细粒度语义的问题。

Details

Motivation: 现有大视觉语言模型（如CLIP）将图像和文本作为无差别的整体进行对齐，难以处理长描述中的层次化语义，而细粒度视觉语言理解需要捕捉跨视觉和文本域的全局上下文与局部细节。

Result: 在3000万图像-文本对上进行训练后，CAFT在六个长文本检索基准测试中取得了最先进的性能，并展现出强大的扩展性。

Insight: 创新点在于通过分层对齐损失耦合从细到粗的视觉编码器与分层文本Transformer，使粗粒度语义基于细粒度证据构建，而非脱离局部接地的聚合，从而在没有显式区域级监督的情况下实现细粒度的、视觉接地的图像-文本表示。

Abstract: Large vision-language models such as CLIP struggle with long captions because they align images and texts as undifferentiated wholes. Fine-grained vision-language understanding requires hierarchical semantics capturing both global context and localized details across visual and textual domains. Yet linguistic hierarchies from syntax or semantics rarely match visual organization, and purely visual hierarchies tend to fragment scenes into appearance-driven parts without semantic focus. We propose CAFT (Cross-domain Alignment of Forests and Trees), a hierarchical image-text representation learning framework that aligns global and local semantics across images and long captions without pixel-level supervision. Coupling a fine-to-coarse visual encoder with a hierarchical text transformer, it uses a hierarchical alignment loss that matches whole images with whole captions while biasing region-sentence correspondences, so that coarse semantics are built from fine-grained evidence rather than from aggregation untethered to part-level grounding. Trained on 30M image-text pairs, CAFT achieves state-of-the-art performance on six long-text retrieval benchmarks and exhibits strong scaling behavior. Experiments show that hierarchical cross-domain alignment enables fine-grained, visually grounded image-text representations to emerge without explicit region-level supervision.

[55] Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation cs.CVPDF

Jiaze Li, Hao Yin, Haoran Xu, Boshen Xu, Wenhui Tan

TL;DR: 本文提出Video-OPD，一种用于时序视频定位（TVG）的高效后训练框架。它通过策略内蒸馏，利用前沿教师模型提供密集的令牌级监督，将稀疏的回合级反馈转化为细粒度的逐步学习信号，从而在保持策略内优化优点的同时，显著提升了训练效率和性能。

Details

Motivation: 现有基于GRPO的强化学习方法在TVG任务中受到稀疏奖励信号和巨大计算开销的根本限制，需要一种能保持训练与推理分布对齐、同时提供密集监督的更高效后训练范式。

Result: 实验结果表明，Video-OPD在TVG任务上持续优于GRPO，同时实现了显著更快的收敛速度和更低的计算成本。

Insight: 核心创新在于将策略内蒸馏引入TVG后训练，通过反向KL散度目标实现密集的令牌级监督，并提出了教师验证分歧聚焦（TVDF）这一轻量级训练课程，迭代地优先处理教师可靠且对学生信息量最大的轨迹，从而提升训练效率。这为TVG提供了一种替代传统强化学习的有效策略内优化方法。

Abstract: Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and substantial computational overhead. We propose Video-OPD, an efficient post-training framework for TVG inspired by recent advances in on-policy distillation. Video-OPD optimizes trajectories sampled directly from the current policy, thereby preserving alignment between training and inference distributions, while a frontier teacher supplies dense, token-level supervision via a reverse KL divergence objective. This formulation preserves the on-policy property critical for mitigating distributional shift, while converting sparse, episode-level feedback into fine-grained, step-wise learning signals. Building on Video-OPD, we introduce Teacher-Validated Disagreement Focusing (TVDF), a lightweight training curriculum that iteratively prioritizes trajectories that are both teacher-reliable and maximally informative for the student, thereby improving training efficiency. Empirical results demonstrate that Video-OPD consistently outperforms GRPO while achieving substantially faster convergence and lower computational cost, establishing on-policy distillation as an effective alternative to conventional reinforcement learning for TVG.

[56] VOILA: Value-of-Information Guided Fidelity Selection for Cost-Aware Multimodal Question Answering cs.CV | cs.AI | cs.LGPDF

Rahul Atul Bhope, K. R. Jayaram, Vinod Muthusamy, Ritesh Kumar, Vatche Isahagian

TL;DR: 论文提出了VOILA框架，用于视觉问答（VQA）中的自适应保真度选择，通过预检索阶段基于信息价值优化视觉输入的质量，以在资源受限下平衡准确性和成本。

Details

Motivation: 解决现有多模态视觉语言系统通常以固定保真度处理高成本视觉输入的问题，旨在通过自适应选择降低检索和处理开销。

Result: 在VQA-v2、GQA、TextVQA、LoCoMo和FloodNet五个数据集上，使用六种参数规模从7B到235B的视觉语言模型进行评估，VOILA能减少50-60%的成本，同时保持90-95%的全分辨率准确率。

Insight: 创新点包括基于信息价值的预检索保真度选择框架，结合梯度提升回归器和等渗校准器进行概率估计，实现成本感知的多模态推理优化；从客观角度看，该方法在多种查询类型和模型架构中均有效，强调了预检索决策对资源约束下系统效率的重要性。

Abstract: Despite significant costs from retrieving and processing high-fidelity visual inputs, most multimodal vision-language systems operate at fixed fidelity levels. We introduce VOILA, a framework for Value-Of-Information-driven adaptive fidelity selection in Visual Question Answering (VQA) that optimizes what information to retrieve before model execution. Given a query, VOILA uses a two-stage pipeline: a gradient-boosted regressor estimates correctness likelihood at each fidelity from question features alone, then an isotonic calibrator refines these probabilities for reliable decision-making. The system selects the minimum-cost fidelity maximizing expected utility given predicted accuracy and retrieval costs. We evaluate VOILA across three deployment scenarios using five datasets (VQA-v2, GQA, TextVQA, LoCoMo, FloodNet) and six Vision-Language Models (VLMs) with 7B-235B parameters. VOILA consistently achieves 50-60% cost reductions while retaining 90-95% of full-resolution accuracy across diverse query types and model architectures, demonstrating that pre-retrieval fidelity selection is vital to optimize multimodal inference under resource constraints.

[57] A Vision-Based Analysis of Congestion Pricing in New York City cs.CVPDF

Mehmet Kerem Turkcan, Jhonatan Tavori, Javad Ghaderi, Gil Zussman, Zoran Kostic

TL;DR: 该论文通过计算机视觉技术分析纽约市拥堵收费政策实施前后的交通摄像头数据，评估了该政策对曼哈顿及纽约市交通模式的影响。

Details

Motivation: 旨在利用自动化视觉分析量化纽约市拥堵收费项目对交通流量的实际影响，解决传统交通评估方法在数据规模和实时性上的局限性。

Result: 通过处理超过900个摄像头的视频数据，对比了2024年11月至2026年1月（涵盖政策实施前后）的交通模式，建立了基线并识别了监测区域内车辆密度的系统性变化。

Insight: 创新点在于将大规模计算机视觉流水线应用于城市交通政策评估，实现了对交通模式的自动化、客观量化分析；可借鉴其利用现有摄像头基础设施进行实时、大范围交通监测的方法论。

Abstract: We examine the impact of New York City’s congestion pricing program through automated analysis of traffic camera data. Our computer vision pipeline processes footage from over 900 cameras distributed throughout Manhattan and New York, comparing traffic patterns from November 2024 through the program’s implementation in January 2025 until January 2026. We establish baseline traffic patterns and identify systematic changes in vehicle density across the monitored region.

[58] MUSE: A Multi-agent Framework for Unconstrained Story Envisioning via Closed-Loop Cognitive Orchestration cs.CVPDF

Wenzhang Sun, Zhenyu Wang, Zhangchi Hu, Chunfeng Wang, Hao Li

TL;DR: 论文提出MUSE，一个用于无约束故事想象的多智能体框架，通过闭环认知编排来解决从简短用户提示生成长篇视听故事时存在的意图执行差距问题。该框架采用迭代的计划-执行-验证-修订循环来协调生成，将叙事意图转化为对身份、空间构成和时间连续性的显式机器可执行控制，并应用针对性的多模态反馈来纠正生成过程中的违规。

Details

Motivation: 现有方法通常依赖前馈管道或仅提示的细化，在生成长序列时容易导致语义漂移和身份不一致，因此需要解决在长视野中保持高级叙事意图和连贯镜头级多模态生成的挑战。

Result: 实验表明，与代表性基线相比，MUSE在长视野叙事连贯性、跨模态身份一致性和电影质量方面有显著提升。评估是在引入的MUSEBench（一种经人工判断验证的无参考评估协议）上进行的。

Insight: 创新点在于将故事讲述形式化为闭环约束执行问题，通过多智能体协作和迭代反馈循环来强制执行叙事约束，从而减少语义漂移和身份不一致；客观来看，其将高级意图转化为显式可执行控制并集成多模态反馈的机制，为长序列生成中的一致性维护提供了新思路。

Abstract: Generating long-form audio-visual stories from a short user prompt remains challenging due to an intent-execution gap, where high-level narrative intent must be preserved across coherent, shot-level multimodal generation over long horizons. Existing approaches typically rely on feed-forward pipelines or prompt-only refinement, which often leads to semantic drift and identity inconsistency as sequences grow longer. We address this challenge by formulating storytelling as a closed-loop constraint enforcement problem and propose MUSE, a multi-agent framework that coordinates generation through an iterative plan-execute-verify-revise loop. MUSE translates narrative intent into explicit, machine-executable controls over identity, spatial composition, and temporal continuity, and applies targeted multimodal feedback to correct violations during generation. To evaluate open-ended storytelling without ground-truth references, we introduce MUSEBench, a reference-free evaluation protocol validated by human judgments. Experiments demonstrate that MUSE substantially improves long-horizon narrative coherence, cross-modal identity consistency, and cinematic quality compared with representative baselines.

[59] Bongards at the Boundary of Perception and Reasoning: Programs or Language? cs.CV | cs.AIPDF

Cassidy Langenfeld, Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu

TL;DR: 本文提出了一种结合神经与符号方法的解决方案，用于解决经典的Bongard视觉推理问题。该方法利用大型语言模型生成参数化程序规则，并通过贝叶斯优化进行参数拟合，以应对人类在新情境下的视觉推理挑战。

Details

Motivation: 解决视觉语言模型在全新情境下视觉推理能力不足的问题，特别是针对Bongard问题这类严格测试人类视觉推理能力的经典挑战。

Result: 在给定真实规则的情况下对Bongard问题图像进行分类，以及从零开始解决问题，但摘要未提及具体定量结果或基准比较。

Insight: 创新点在于将神经方法（LLM生成程序）与符号方法（贝叶斯优化参数拟合）结合，形成可解释的神经符号框架，以处理需要抽象推理的视觉任务。

Abstract: Vision-Language Models (VLMs) have made great strides in everyday visual tasks, such as captioning a natural image, or answering commonsense questions about such images. But humans possess the puzzling ability to deploy their visual reasoning abilities in radically new situations, a skill rigorously tested by the classic set of visual reasoning challenges known as the Bongard problems. We present a neurosymbolic approach to solving these problems: given a hypothesized solution rule for a Bongard problem, we leverage LLMs to generate parameterized programmatic representations for the rule and perform parameter fitting using Bayesian optimization. We evaluate our method on classifying Bongard problem images given the ground truth rule, as well as on solving the problems from scratch.

[60] HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency cs.CVPDF

Geonhui Son, Jeong Ryong Lee, Dosik Hwang

TL;DR: 本文提出HP-GAN方法，通过FakeTwins自监督损失和判别器一致性机制，有效利用预训练网络提升GAN的图像生成多样性和质量。

Details

Motivation: 现有方法主要利用预训练网络计算感知损失或特征空间，但未能充分挖掘其潜力；本文旨在通过自监督学习和判别器一致性来更有效地利用预训练网络先验，以生成更高质量和多样性的图像。

Result: 在17个数据集（包括大规模、小规模和有限数据场景）上的广泛评估表明，HP-GAN在Fréchet Inception Distance (FID)指标上持续超越当前最先进方法，显著提升了图像多样性和质量。

Insight: 创新点包括：1) FakeTwins策略，将预训练网络作为编码器计算自监督损失并应用于生成器训练；2) 引入CNN和ViT特征网络提取的特征图之间的判别器一致性机制，以促进判别器间的协同学习和训练鲁棒性。这些方法为利用预训练网络改进GAN训练提供了新思路。

Abstract: Generative Adversarial Networks (GANs) have made significant progress in enhancing the quality of image synthesis. Recent methods frequently leverage pretrained networks to calculate perceptual losses or utilize pretrained feature spaces. In this paper, we extend the capabilities of pretrained networks by incorporating innovative self-supervised learning techniques and enforcing consistency between discriminators during GAN training. Our proposed method, named HP-GAN, effectively exploits neural network priors through two primary strategies: FakeTwins and discriminator consistency. FakeTwins leverages pretrained networks as encoders to compute a self-supervised loss and applies this through the generated images to train the generator, thereby enabling the generation of more diverse and high quality images. Additionally, we introduce a consistency mechanism between discriminators that evaluate feature maps extracted from Convolutional Neural Network (CNN) and Vision Transformer (ViT) feature networks. Discriminator consistency promotes coherent learning among discriminators and enhances training robustness by aligning their assessments of image quality. Our extensive evaluation across seventeen datasets-including scenarios with large, small, and limited data, and covering a variety of image domains-demonstrates that HP-GAN consistently outperforms current state-of-the-art methods in terms of Fréchet Inception Distance (FID), achieving significant improvements in image diversity and quality. Code is available at: https://github.com/higun2/HP-GAN.

[61] IVC-Prune: Revealing the Implicit Visual Coordinates in LVLMs for Vision Token Pruning cs.CVPDF

Zhichao Sun, Yidong Ma, Gang Liu, Yibo Chen, Xu Tang

TL;DR: 本文提出了一种名为IVC-Prune的无训练、提示感知的视觉令牌剪枝方法，用于解决大型视觉语言模型在处理高分辨率图像时推理成本过高的问题。该方法基于一个关键发现：LVLMs通过旋转位置编码隐式地建立了视觉坐标系，其中特定的令牌位置作为隐式视觉坐标，对空间推理至关重要。IVC-Prune通过理论分析识别并保留这些关键坐标令牌，同时通过一个两阶段过程保留语义相关的前景令牌，从而在大量剪枝的同时保持模型性能。

Details

Motivation: 现有视觉令牌剪枝方法主要关注语义相关性，往往会丢弃对空间推理至关重要的令牌，导致模型在需要空间理解的任务上性能下降。本文旨在解决这一缺陷，通过揭示LVLMs处理空间推理的内在机制，提出一种能同时保留空间和语义关键信息的剪枝策略。

Result: 在四个代表性LVLM和二十个多样化基准测试上的广泛评估表明，IVC-Prune能够将视觉令牌数量减少约50%，同时保持原始性能的≥99%，甚至在多个基准测试上实现了性能提升。

Insight: 核心创新点在于揭示了LVLMs通过RoPE隐式建立视觉坐标系的现象，并理论推导出关键IVC令牌的数学特性（旋转矩阵近似单位矩阵或90度旋转矩阵的位置）。这为理解模型内部空间表示和设计高效的剪枝方法提供了新的视角。提出的两阶段前景令牌识别方法（语义种子发现和基于值向量相似度的上下文精炼）也具有借鉴意义。

Abstract: Large Vision-Language Models (LVLMs) achieve impressive performance across multiple tasks. A significant challenge, however, is their prohibitive inference cost when processing high-resolution visual inputs. While visual token pruning has emerged as a promising solution, existing methods that primarily focus on semantic relevance often discard tokens that are crucial for spatial reasoning. We address this gap through a novel insight into \emph{how LVLMs process spatial reasoning}. Specifically, we reveal that LVLMs implicitly establish visual coordinate systems through Rotary Position Embeddings (RoPE), where specific token positions serve as \textbf{implicit visual coordinates} (IVC tokens) that are essential for spatial reasoning. Based on this insight, we propose \textbf{IVC-Prune}, a training-free, prompt-aware pruning strategy that retains both IVC tokens and semantically relevant foreground tokens. IVC tokens are identified by theoretically analyzing the mathematical properties of RoPE, targeting positions at which its rotation matrices approximate identity matrix or the $90^\circ$ rotation matrix. Foreground tokens are identified through a robust two-stage process: semantic seed discovery followed by contextual refinement via value-vector similarity. Extensive evaluations across four representative LVLMs and twenty diverse benchmarks show that IVC-Prune reduces visual tokens by approximately 50% while maintaining $\geq$ 99% of the original performance and even achieving improvements on several benchmarks. Source codes are available at https://github.com/FireRedTeam/IVC-Prune.

[62] Finding Optimal Video Moment without Training: Gaussian Boundary Optimization for Weakly Supervised Video Grounding cs.CVPDF

Sunoh Kim, Kimin Yun, Daeho Um

TL;DR: 本文提出了一种名为高斯边界优化（GBO）的新型推理框架，用于解决弱监督视频时序定位任务。该方法通过求解一个平衡提案覆盖度和片段紧凑性的优化问题来预测片段边界，无需训练即可与现有基于高斯提案的架构兼容，并在多个标准基准测试中取得了最先进的性能。

Details

Motivation: 现有弱监督视频时序定位方法依赖于从高斯参数到片段边界的启发式映射，导致定位性能次优。本文旨在通过一种原则性的优化框架来直接优化边界预测，以解决这一性能瓶颈。

Result: 实验表明，GBO显著提升了定位性能，在Charades-STA和ActivityNet Captions等标准基准测试上达到了最先进（SOTA）的水平。

Insight: 核心创新在于提出了一个无需训练、具有闭式解的理论优化框架（GBO），可直接从高斯提案中推导出最优边界，而非依赖启发式规则。该方法具有通用性，可适配于单高斯和混合高斯等多种提案架构。

Abstract: Weakly supervised temporal video grounding aims to localize query-relevant segments in untrimmed videos using only video-sentence pairs, without requiring ground-truth segment annotations that specify exact temporal boundaries. Recent approaches tackle this task by utilizing Gaussian-based temporal proposals to represent query-relevant segments. However, their inference strategies rely on heuristic mappings from Gaussian parameters to segment boundaries, resulting in suboptimal localization performance. To address this issue, we propose Gaussian Boundary Optimization (GBO), a novel inference framework that predicts segment boundaries by solving a principled optimization problem that balances proposal coverage and segment compactness. We derive a closed-form solution for this problem and rigorously analyze the optimality conditions under varying penalty regimes. Beyond its theoretical foundations, GBO offers several practical advantages: it is training-free and compatible with both single-Gaussian and mixture-based proposal architectures. Our experiments show that GBO significantly improves localization, achieving state-of-the-art results across standard benchmarks. Extensive experiments demonstrate the efficiency and generalizability of GBO across various proposal schemes. The code is available at \href{https://github.com/sunoh-kim/gbo}{https://github.com/sunoh-kim/gbo}.

[63] Gromov Wasserstein Optimal Transport for Semantic Correspondences cs.CVPDF

Francis Snelgar, Stephen Gould, Ming Xu, Liang Zheng, Akshay Asthana

TL;DR: 本文提出了一种用于语义匹配任务的新方法，通过使用带有Gromov Wasserstein空间平滑先验的最优传输算法替代传统的最近邻匹配，以提升DINOv2特征的性能，避免了计算昂贵的Stable Diffusion特征集成，实现了更高的效率和竞争性的结果。

Details

Motivation: 现有语义匹配方法通常结合DINOv2和Stable Diffusion的特征以兼顾准确性和空间一致性，但计算成本高昂；本文旨在通过改进匹配算法而非特征集成来提升效率与性能。

Result: 该方法显著提升了DINOv2基线的性能，在语义匹配任务上与使用Stable Diffusion特征的当前最优方法竞争甚至超越，同时效率提高了5-10倍。

Insight: 创新点在于将Gromov Wasserstein最优传输引入语义匹配，以空间平滑先验增强匹配一致性，从而减少对多模型特征依赖，实现高效且高性能的解决方案。

Abstract: Establishing correspondences between image pairs is a long studied problem in computer vision. With recent large-scale foundation models showing strong zero-shot performance on downstream tasks including classification and segmentation, there has been interest in using the internal feature maps of these models for the semantic correspondence task. Recent works observe that features from DINOv2 and Stable Diffusion (SD) are complementary, the former producing accurate but sparse correspondences, while the latter produces spatially consistent correspondences. As a result, current state-of-the-art methods for semantic correspondence involve combining features from both models in an ensemble. While the performance of these methods is impressive, they are computationally expensive, requiring evaluating feature maps from large-scale foundation models. In this work we take a different approach, instead replacing SD features with a superior matching algorithm which is imbued with the desirable spatial consistency property. Specifically, we replace the standard nearest neighbours matching with an optimal transport algorithm that includes a Gromov Wasserstein spatial smoothness prior. We show that we can significantly boost the performance of the DINOv2 baseline, and be competitive and sometimes surpassing state-of-the-art methods using Stable Diffusion features, while being 5–10x more efficient. We make code available at https://github.com/fsnelgar/semantic_matching_gwot .

[64] Beyond Cropping and Rotation: Automated Evolution of Powerful Task-Specific Augmentations with Generative Models cs.CV | cs.AIPDF

Judah Goldfeder, Shreyes Kaliyur, Vaibhav Sourirajan, Patrick Minwan Puma, Philippe Martin Wyder

TL;DR: 本文提出EvoAug自动化增强学习框架，利用生成模型（如条件扩散模型和少样本NeRF）结合进化算法，学习针对特定任务的最优数据增强策略，通过构建分层组合增强的随机增强树实现结构化自适应变换，在细粒度分类和少样本学习任务中表现出色。

Details

Motivation: 传统数据增强方法（如裁剪、旋转）多样性有限，而生成模型虽能合成高多样性、高真实感数据，但若增强策略与任务不匹配可能导致性能下降，因此需要自动化方法优化生成式增强策略以提升模型鲁棒性。

Result: 在细粒度分类和少样本学习任务上取得强劲性能，所发现的增强策略与领域知识一致，即使在低数据场景下也能有效提升模型表现。

Insight: 创新点在于将生成模型与进化算法结合，通过随机增强树实现层次化、结构化的自适应增强，为基于生成模型的自动化数据增强提供了可扩展的框架，突破了传统增强的局限性。

Abstract: Data augmentation has long been a cornerstone for reducing overfitting in vision models, with methods like AutoAugment automating the design of task-specific augmentations. Recent advances in generative models, such as conditional diffusion and few-shot NeRFs, offer a new paradigm for data augmentation by synthesizing data with significantly greater diversity and realism. However, unlike traditional augmentations like cropping or rotation, these methods introduce substantial changes that enhance robustness but also risk degrading performance if the augmentations are poorly matched to the task. In this work, we present EvoAug, an automated augmentation learning pipeline, which leverages these generative models alongside an efficient evolutionary algorithm to learn optimal task-specific augmentations. Our pipeline introduces a novel approach to image augmentation that learns stochastic augmentation trees that hierarchically compose augmentations, enabling more structured and adaptive transformations. We demonstrate strong performance across fine-grained classification and few-shot learning tasks. Notably, our pipeline discovers augmentations that align with domain knowledge, even in low-data settings. These results highlight the potential of learned generative augmentations, unlocking new possibilities for robust model training.

[65] Feature, Alignment, and Supervision in Category Learning: A Comparative Approach with Children and Neural Networks cs.CV | cs.LGPDF

Fanxiao Wani Qiu, Oscar Leong

TL;DR: 本研究采用物种公平设计，比较儿童与卷积神经网络在少样本半监督类别学习任务中的表现，探究两者在相同条件下学习新物体类别时的差异，重点关注监督量、目标特征和感知对齐对学习的影响。

Details

Motivation: 旨在理解人类和机器如何从稀疏数据中学习，这是认知科学和机器学习的核心问题，通过比较儿童和CNN在相同任务条件下的学习机制，揭示两者学习策略的异同。

Result: 儿童能从少量标签中快速泛化，但表现出强烈的特征特定偏差和对对齐的敏感性；CNN则显示监督增加能提升性能，但对齐和特征结构调节了额外监督对学习的影响，结果强调比较应关注监督、特征结构和对齐的交互作用而非整体准确率。

Insight: 创新点在于采用物种公平设计直接比较人类与机器学习，揭示了监督、特征和对齐的交互作用差异，为跨学科比较研究提供了方法论启示，强调条件设置对公平评估的重要性。

Abstract: Understanding how humans and machines learn from sparse data is central to cognitive science and machine learning. Using a species-fair design, we compare children and convolutional neural networks (CNNs) in a few-shot semi-supervised category learning task. Both learners are exposed to novel object categories under identical conditions. Learners receive mixtures of labeled and unlabeled exemplars while we vary supervision (1/3/6 labels), target feature (size, shape, pattern), and perceptual alignment (high/low). We find that children generalize rapidly from minimal labels but show strong feature-specific biases and sensitivity to alignment. CNNs show a different interaction profile: added supervision improves performance, but both alignment and feature structure moderate the impact additional supervision has on learning. These results show that human-model comparisons must be drawn under the right conditions, emphasizing interactions among supervision, feature structure, and alignment rather than overall accuracy.

[66] FinMTM: A Multi-Turn Multimodal Benchmark for Financial Reasoning and Agent Evaluation cs.CV | cs.CEPDF

Chenxi Zhang, Ziliang Gan, Liyun Zhu, Youwei Pang, Qing Zhang

TL;DR: 本文提出了FinMTM，一个用于金融推理和智能体评估的多轮多模态基准测试。该基准在数据和任务维度上进行了扩展，包含了11,133个基于金融图表（如K线图、统计图）的双语（中英文）问答对，并覆盖了单选/多选、多轮开放对话和基于智能体的任务。作者还设计了针对性的评估协议。通过对22个视觉语言模型的广泛实验，揭示了它们在细粒度视觉感知、长上下文推理和复杂智能体工作流方面的局限性。

Details

Motivation: 现有的金融基准测试大多是单轮的，且问题格式单一，难以全面评估视觉语言模型在真实金融应用场景中的表现。金融领域因其专业的图表格式和知识密集的推理需求，对视觉语言模型提出了巨大挑战。

Result: 对22个视觉语言模型进行了广泛的实验评估，结果表明它们在细粒度视觉感知、长上下文推理和复杂智能体工作流方面存在显著局限。

Insight: 创新点在于构建了一个数据多样（双语、多种金融图表）、任务多样（单选、多选、多轮对话、智能体任务）的多轮多模态金融基准，并设计了针对不同任务类型的专门评估协议（如多选的集合重叠评分、多轮对话的加权组合评分、智能体任务的综合规划与结果度量）。这为全面、真实地评估金融领域的视觉语言模型和智能体能力提供了新的标准。从客观角度看，其将多轮对话和智能体任务纳入金融评估框架，以及对评估指标的细致设计，是推动该领域评测向更贴近实际应用方向发展的关键贡献。

Abstract: The financial domain poses substantial challenges for vision-language models (VLMs) due to specialized chart formats and knowledge-intensive reasoning requirements. However, existing financial benchmarks are largely single-turn and rely on a narrow set of question formats, limiting comprehensive evaluation in realistic application scenarios. To address this gap, we propose FinMTM, a multi-turn multimodal benchmark that expands diversity along both data and task dimensions. On the data side, we curate and annotate 11{,}133 bilingual (Chinese and English) financial QA pairs grounded in financial visuals, including candlestick charts, statistical plots, and report figures. On the task side, FinMTM covers single- and multiple-choice questions, multi-turn open-ended dialogues, and agent-based tasks. We further design task-specific evaluation protocols, including a set-overlap scoring rule for multiple-choice questions, a weighted combination of turn-level and session-level scores for multi-turn dialogues, and a composite metric that integrates planning quality with final outcomes for agent tasks. Extensive experimental evaluation of 22 VLMs reveal their limitations in fine-grained visual perception, long-context reasoning, and complex agent workflows.

[67] SwiftVLM: Efficient Vision-Language Model Inference via Cross-Layer Token Bypass cs.CV | cs.AIPDF

Chen Qian, Xinran Yu, Danyang Li, Guoxuan Chi, Zheng Yang

TL;DR: SwiftVLM是一种无需训练的高效视觉语言模型推理方法，通过跨层令牌旁路机制，在模型特定层进行视觉令牌剪枝，避免了早期剪枝导致的关键信息丢失，从而在保持精度的同时显著降低计算成本。

Details

Motivation: 现有视觉令牌剪枝方法依赖早期剪枝决策以提高效率，但在需要细粒度视觉细节的任务上性能显著下降，主要原因是浅层被判定为不重要的令牌可能在后续层对文本条件推理变得至关重要，过早剪枝会导致不可逆的关键信息损失。

Result: 在多个视觉语言模型和基准测试上的实验表明，SwiftVLM一致优于现有剪枝策略，实现了更优的精度-效率权衡，并展现出更可靠的视觉令牌选择行为。

Insight: 创新点在于提出了“旁路”这一新的剪枝范式，保留未选中的视觉令牌并将其传递到后续剪枝阶段进行重新评估，允许跨层独立的剪枝决策，避免了基于早期层重要性判断的固有局限性。

Abstract: Visual token pruning is a promising approach for reducing the computational cost of vision-language models (VLMs), and existing methods often rely on early pruning decisions to improve efficiency. While effective on coarse-grained reasoning tasks, they suffer from significant performance degradation on tasks requiring fine-grained visual details. Through layer-wise analysis, we reveal substantial discrepancies in visual token importance across layers, showing that tokens deemed unimportant at shallow layers can later become highly relevant for text-conditioned reasoning. To avoid irreversible critical information loss caused by premature pruning, we introduce a new pruning paradigm, termed bypass, which preserves unselected visual tokens and forwards them to subsequent pruning stages for re-evaluation. Building on this paradigm, we propose SwiftVLM, a simple and training-free method that performs pruning at model-specific layers with strong visual token selection capability, while enabling independent pruning decisions across layers. Experiments across multiple VLMs and benchmarks demonstrate that SwiftVLM consistently outperforms existing pruning strategies, achieving superior accuracy-efficiency trade-offs and more faithful visual token selection behavior.

[68] FSOD-VFM: Few-Shot Object Detection with Vision Foundation Models and Graph Diffusion cs.CVPDF

Chen-Bin Feng, Youyang Sha, Longfei Liu, Yongjun Yu, Chi Man Vong

TL;DR: 本文提出了FSOD-VFM框架，利用视觉基础模型（如通用提议网络UPN、SAM2和DINOv2）解决少样本目标检测问题，并通过基于图的置信度重加权方法优化边界框提议，减少过分割和误报，在多个数据集上实现了优异性能且无需额外训练。

Details

Motivation: 动机是解决少样本目标检测中基础模型生成的边界框常出现过分割问题，导致部分区域覆盖和误报，而非完整目标检测。

Result: 在Pascal-5^i、COCO-20^i和CD-FSOD数据集上的实验表明，该方法显著优于现有方法，在CD-FSOD数据集的10-shot设置中达到31.6 AP，远超之前无需训练方法的21.4 AP，实现了SOTA性能。

Insight: 创新点包括整合多个视觉基础模型（UPN、SAM2、DINOv2）进行少样本检测，并提出基于图的置信度重加权方法，通过图扩散操作传播置信度分数，提升检测粒度并减少误报，无需训练即可适应新类别。

Abstract: In this paper, we present FSOD-VFM: Few-Shot Object Detectors with Vision Foundation Models, a framework that leverages vision foundation models to tackle the challenge of few-shot object detection. FSOD-VFM integrates three key components: a universal proposal network (UPN) for category-agnostic bounding box generation, SAM2 for accurate mask extraction, and DINOv2 features for efficient adaptation to new object categories. Despite the strong generalization capabilities of foundation models, the bounding boxes generated by UPN often suffer from overfragmentation, covering only partial object regions and leading to numerous small, false-positive proposals rather than accurate, complete object detections. To address this issue, we introduce a novel graph-based confidence reweighting method. In our approach, predicted bounding boxes are modeled as nodes in a directed graph, with graph diffusion operations applied to propagate confidence scores across the network. This reweighting process refines the scores of proposals, assigning higher confidence to whole objects and lower confidence to local, fragmented parts. This strategy improves detection granularity and effectively reduces the occurrence of false-positive bounding box proposals. Through extensive experiments on Pascal-5$^i$, COCO-20$^i$, and CD-FSOD datasets, we demonstrate that our method substantially outperforms existing approaches, achieving superior performance without requiring additional training. Notably, on the challenging CD-FSOD dataset, which spans multiple datasets and domains, our FSOD-VFM achieves 31.6 AP in the 10-shot setting, substantially outperforming previous training-free methods that reach only 21.4 AP. Code is available at: https://intellindust-ai-lab.github.io/projects/FSOD-VFM.

[69] Human-in-the-loop Adaptation in Group Activity Feature Learning for Team Sports Video Retrieval cs.CVPDF

Chihiro Nakatani, Hiroaki Kawashima, Norimichi Ukita

TL;DR: 本文提出了一种无需群体活动标注的人机协同自适应方法，用于群体活动特征学习（GAFL），并将其应用于群体活动视频检索框架以提升检索性能。该方法首先以自监督方式基于群体活动相似性预训练GAF空间，然后通过交互式微调过程更新GAF空间，使用户能更好地检索与查询视频相似的视频。在微调中，通过数据高效的视频选择过程从数据库中选取视频供用户手动标注为正例或负例，并利用对比学习更新GAF空间，使正例视频更接近查询视频、负例视频更远离。

Details

Motivation: 解决现有方法依赖预定义群体活动类别进行监督分类的局限性，提出无需群体活动标注的人机协同自适应方法，以提升团队运动视频检索的准确性和用户适应性。

Result: 在两个团队运动数据集上的综合实验验证了该方法显著提升了检索性能；消融研究表明人机协同自适应中的多个组件对性能提升有贡献。

Insight: 创新点在于将自监督预训练与人机协同微调结合，通过用户交互标注和对比学习动态优化特征空间，实现了无需群体活动标注的适应性视频检索，可借鉴其数据高效的选择策略和交互式学习框架。

Abstract: This paper proposes human-in-the-loop adaptation for Group Activity Feature Learning (GAFL) without group activity annotations. This human-in-the-loop adaptation is employed in a group-activity video retrieval framework to improve its retrieval performance. Our method initially pre-trains the GAF space based on the similarity of group activities in a self-supervised manner, unlike prior work that classifies videos into pre-defined group activity classes in a supervised learning manner. Our interactive fine-tuning process updates the GAF space to allow a user to better retrieve videos similar to query videos given by the user. In this fine-tuning, our proposed data-efficient video selection process provides several videos, which are selected from a video database, to the user in order to manually label these videos as positive or negative. These labeled videos are used to update (i.e., fine-tune) the GAF space, so that the positive and negative videos move closer to and farther away from the query videos through contrastive learning. Our comprehensive experimental results on two team sports datasets validate that our method significantly improves the retrieval performance. Ablation studies also demonstrate that several components in our human-in-the-loop adaptation contribute to the improvement of the retrieval performance. Code: https://github.com/chihina/GAFL-FINE-CVIU.

[70] LSGQuant: Layer-Sensitivity Guided Quantization for One-Step Diffusion Real-World Video Super-Resolution cs.CVPDF

Tianxing Wu, Zheng Chen, Cirou Xu, Bowen Chai, Yong Guo

TL;DR: LSGQuant是一种针对一步扩散模型在真实世界视频超分辨率任务中的层敏感度引导量化方法，通过动态范围自适应量化器、方差导向层训练策略和量化感知优化，在保持模型性能的同时显著压缩模型大小和计算成本。

Details

Motivation: 解决扩散Transformer模型在视频超分辨率中模型体积大、计算成本高的问题，同时应对输入潜在特征动态范围高和不同层行为多样化的量化挑战。

Result: 在真实世界视频超分辨率任务上，该方法在量化后性能接近原始全精度模型，并显著超越现有量化技术。

Insight: 创新点包括动态范围自适应量化器适应视频token激活、基于层统计的方差导向训练策略、以及量化分支与高精度分支的联合优化框架，为扩散模型的高效部署提供了新思路。

Abstract: One-Step Diffusion Models have demonstrated promising capability and fast inference in video super-resolution (VSR) for real-world. Nevertheless, the substantial model size and high computational cost of Diffusion Transformers (DiTs) limit downstream applications. While low-bit quantization is a common approach for model compression, the effectiveness of quantized models is challenged by the high dynamic range of input latent and diverse layer behaviors. To deal with these challenges, we introduce LSGQuant, a layer-sensitivity guided quantizing approach for one-step diffusion-based real-world VSR. Our method incorporates a Dynamic Range Adaptive Quantizer (DRAQ) to fit video token activations. Furthermore, we estimate layer sensitivity and implement a Variance-Oriented Layer Training Strategy (VOLTS) by analyzing layer-wise statistics in calibration. We also introduce Quantization-Aware Optimization (QAO) to jointly refine the quantized branch and a retained high-precision branch. Extensive experiments demonstrate that our method has nearly performance to origin model with full-precision and significantly exceeds existing quantization techniques. Code is available at: https://github.com/zhengchen1999/LSGQuant.

[71] Hand3R: Online 4D Hand-Scene Reconstruction in the Wild cs.CV | cs.AIPDF

Wendi Hu, Haonan Zhou, Wenhao Hu, Gaoang Wang

TL;DR: Hand3R是首个从单目视频在线联合重建4D手部与场景的框架，它通过场景感知的视觉提示机制，将预训练的手部专家模型与4D场景基础模型相结合，在单次前向传播中同时重建精确的手部网格和密集的度量尺度场景几何。

Details

Motivation: 现有方法通常在局部坐标系中重建孤立的手部，忽略了周围的3D环境，这对于理解物理交互至关重要。本文旨在解决动态手部与密集场景上下文联合重建的问题。

Result: 实验表明，Hand3R无需依赖离线优化，在手部局部重建和全局定位方面均取得了有竞争力的性能。

Insight: 创新点在于提出了一个场景感知的视觉提示机制，将高保真的手部先验注入到持久的场景记忆中，实现了手部与场景的在线、联合、度量尺度的4D重建。

Abstract: For Embodied AI, jointly reconstructing dynamic hands and the dense scene context is crucial for understanding physical interaction. However, most existing methods recover isolated hands in local coordinates, overlooking the surrounding 3D environment. To address this, we present Hand3R, the first online framework for joint 4D hand-scene reconstruction from monocular video. Hand3R synergizes a pre-trained hand expert with a 4D scene foundation model via a scene-aware visual prompting mechanism. By injecting high-fidelity hand priors into a persistent scene memory, our approach enables simultaneous reconstruction of accurate hand meshes and dense metric-scale scene geometry in a single forward pass. Experiments demonstrate that Hand3R bypasses the reliance on offline optimization and delivers competitive performance in both local hand reconstruction and global positioning.

[72] VIRAL: Visual In-Context Reasoning via Analogy in Diffusion Transformers cs.CVPDF

Zhiwen Li, Zhongjie Duan, Jinyan Ye, Cen Chen, Daoyuan Chen

TL;DR: 本文提出了VIRAL框架，通过将视觉上下文学习（ICL）建模为基于视觉类比的图像条件生成（x_s : x_t :: x_q : y_q），利用预训练的扩散变换器（DiT）实现视觉推理。该方法采用角色感知的多图像条件化，并引入混合专家LoRA来减少不同任务间的梯度干扰。作者还构建了一个涵盖感知、修复和编辑的大规模视觉上下文数据集。实验表明VIRAL在多种视觉任务上优于现有方法，验证了统一的视觉ICL范式能够处理包括开放域编辑在内的多数视觉任务。

Details

Motivation: 计算机视觉中由于任务异质性，复制上下文学习（ICL）仍然具有挑战性。本文旨在通过视觉类比的方式，利用预训练图像编辑模型来激发视觉推理，以解决视觉任务中的统一上下文学习问题。

Result: 实验证明VIRAL在多个视觉任务上超越了现有方法，验证了其统一视觉ICL范式的有效性，能够处理包括开放域编辑在内的广泛任务。

Insight: 创新点包括：将视觉ICL形式化为基于类比的图像条件生成；采用角色感知的多图像条件化来适配冻结的DiT模型；引入混合专家LoRA以减少跨任务梯度干扰；并构建了大规模、多样化的视觉上下文数据集以弥补现有数据集的不足。从客观角度看，该方法通过类比推理统一了多种视觉任务，为视觉上下文学习提供了新的框架和数据集支持。

Abstract: Replicating In-Context Learning (ICL) in computer vision remains challenging due to task heterogeneity. We propose \textbf{VIRAL}, a framework that elicits visual reasoning from a pre-trained image editing model by formulating ICL as conditional generation via visual analogy ($x_s : x_t :: x_q : y_q$). We adapt a frozen Diffusion Transformer (DiT) using role-aware multi-image conditioning and introduce a Mixture-of-Experts LoRA to mitigate gradient interference across diverse tasks. Additionally, to bridge the gaps in current visual context datasets, we curate a large-scale dataset spanning perception, restoration, and editing. Experiments demonstrate that VIRAL outperforms existing methods, validating that a unified V-ICL paradigm can handle the majority of visual tasks, including open-domain editing. Our code is available at https://anonymous.4open.science/r/VIRAL-744A

[73] ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask cs.CVPDF

Zhuoran Yang, Yanyong Zhang

TL;DR: 本文提出ConsisDrive，一种身份保持的驾驶世界模型，通过实例掩码机制解决现有世界模型在生成驾驶视频时出现的身份漂移问题，即在帧间同一物体外观或类别不一致的现象。该方法包含实例掩码注意力和实例掩码损失两个核心组件，以增强实例级的时间一致性，从而生成高质量驾驶视频，并在nuScenes数据集上提升下游自动驾驶任务性能。

Details

Motivation: 自动驾驶依赖大规模高质量多视角驾驶视频训练，但现有世界模型生成数据时存在身份漂移问题，缺乏实例级时间约束导致物体跨帧外观或类别变化，影响数据真实性和下游任务效果。

Result: 在nuScenes数据集上，ConsisDrive实现了最先进的驾驶视频生成质量，并在下游自动驾驶任务中表现出显著改进，达到SOTA水平。

Insight: 创新点包括引入实例掩码注意力，通过身份掩码和轨迹掩码在注意力块中限制视觉令牌仅与对应实例特征交互，确保时空维度上的身份一致性；以及实例掩码损失，利用概率性实例掩码自适应强调前景区域，减少背景噪声同时保持场景保真度。从客观角度看，该方法将实例级约束集成到世界模型中，有效解决了生成视频中的身份不一致问题，为数据生成提供了新思路。

Abstract: Autonomous driving relies on robust models trained on large-scale, high-quality multi-view driving videos. Although world models provide a cost-effective solution for generating realistic driving data, they often suffer from identity drift, where the same object changes its appearance or category across frames due to the absence of instance-level temporal constraints. We introduce ConsisDrive, an identity-preserving driving world model designed to enforce temporal consistency at the instance level. Our framework incorporates two key components: (1) Instance-Masked Attention, which applies instance identity masks and trajectory masks within attention blocks to ensure that visual tokens interact only with their corresponding instance features across spatial and temporal dimensions, thereby preserving object identity consistency; and (2) Instance-Masked Loss, which adaptively emphasizes foreground regions with probabilistic instance masking, reducing background noise while maintaining overall scene fidelity. By integrating these mechanisms, ConsisDrive achieves state-of-the-art driving video generation quality and demonstrates significant improvements in downstream autonomous driving tasks on the nuScenes dataset. Our project page is https://shanpoyang654.github.io/ConsisDrive/page.html.

[74] Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane cs.CVPDF

Haoyu Liu, Sucheng Ren, Tingyu Zhu, Peng Wang, Cihang Xie

TL;DR: 本文提出了一种名为Spiral RoPE的新型二维位置编码方法，用于视觉Transformer。该方法通过将嵌入通道分组并关联到均匀分布的方向，允许对图像中任意方向的空间关系进行编码，从而克服了标准轴向RoPE只能编码轴对齐方向（水平和垂直）的限制。

Details

Motivation: 标准轴向二维RoPE将空间位置分解为水平和垂直分量，这隐含地限制了位置编码只能沿轴对齐方向，阻碍了对自然图像中普遍存在的斜向空间关系的建模。本文旨在克服这一方向性约束，实现多方向的位置编码。

Result: 在包括分类、分割和生成在内的广泛视觉任务中，Spiral RoPE均能持续提升模型性能。定性分析表明，其注意力图在语义相关对象上的激活更集中，并能更好地尊重局部对象边界。

Insight: 核心创新点在于将位置编码从轴对齐方向扩展到任意方向，通过方向投影和通道分组旋转实现。这揭示了在视觉Transformer中，多方向的位置编码对于捕捉自然图像中复杂的空间关系至关重要。

Abstract: Rotary Position Embedding (RoPE) is the de facto positional encoding in large language models due to its ability to encode relative positions and support length extrapolation. When adapted to vision transformers, the standard axial formulation decomposes two-dimensional spatial positions into horizontal and vertical components, implicitly restricting positional encoding to axis-aligned directions. We identify this directional constraint as a fundamental limitation of the standard axial 2D RoPE, which hinders the modeling of oblique spatial relationships that naturally exist in natural images. To overcome this limitation, we propose Spiral RoPE, a simple yet effective extension that enables multi-directional positional encoding by partitioning embedding channels into multiple groups associated with uniformly distributed directions. Each group is rotated according to the projection of the patch position onto its corresponding direction, allowing spatial relationships to be encoded beyond the horizontal and vertical axes. Across a wide range of vision tasks including classification, segmentation, and generation, Spiral RoPE consistently improves performance. Qualitative analysis of attention maps further show that Spiral RoPE exhibits more concentrated activations on semantically relevant objects and better respects local object boundaries, highlighting the importance of multi-directional positional encoding in vision transformers.

[75] EventFlash: Towards Efficient MLLMs for Event-Based Vision cs.CVPDF

Shaoyu Liu, Jianing Li, Guanghui Zhao, Yunjian Zhang, Wen Jiang

TL;DR: 本文提出EventFlash，一种高效的多模态大语言模型（MLLM），用于处理基于事件的视觉数据。该方法通过时空令牌稀疏化技术减少数据冗余并加速推理，包括构建大规模数据集EventMind、自适应时间窗口聚合模块和稀疏密度引导注意力模块。

Details

Motivation: 解决现有基于事件的MLLMs依赖密集图像式处理范式、忽略事件流时空稀疏性导致计算成本高的问题，旨在实现高速和低光场景下的高效鲁棒感知。

Result: 实验表明，EventFlash在保持可比性能的同时，相比基线（EventFlash-Zero）实现了12.4倍的吞吐量提升，并支持长达1000个时间仓的长范围事件流处理，显著优于EventGPT的5仓限制。

Insight: 创新点包括：构建大规模多样化事件指令数据集以支持课程训练；自适应时间聚合保留关键时间线索；稀疏密度引导注意力提升空间令牌效率。这些方法为基于事件的高效基础模型提供了新思路。

Abstract: Event-based multimodal large language models (MLLMs) enable robust perception in high-speed and low-light scenarios, addressing key limitations of frame-based MLLMs. However, current event-based MLLMs often rely on dense image-like processing paradigms, overlooking the spatiotemporal sparsity of event streams and resulting in high computational cost. In this paper, we propose EventFlash, a novel and efficient MLLM to explore spatiotemporal token sparsification for reducing data redundancy and accelerating inference. Technically, we build EventMind, a large-scale and scene-diverse dataset with over 500k instruction sets, providing both short and long event stream sequences to support our curriculum training strategy. We then present an adaptive temporal window aggregation module for efficient temporal sampling, which adaptively compresses temporal tokens while retaining key temporal cues. Finally, a sparse density-guided attention module is designed to improve spatial token efficiency by selecting informative regions and suppressing empty or sparse areas. Experimental results show that EventFlash achieves a $12.4\times$ throughput improvement over the baseline (EventFlash-Zero) while maintaining comparable performance. It supports long-range event stream processing with up to 1,000 bins, significantly outperforming the 5-bin limit of EventGPT. We believe EventFlash serves as an efficient foundation model for event-based vision.

[76] InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation cs.CVPDF

Zhuoran Yang, Xi Guo, Chenjing Ding, Chiyu Wang, Wei Wu

TL;DR: InstaDrive是一个用于生成逼真且一致的自动驾驶视频的实例感知世界模型框架。它通过引入实例流引导器和空间几何对齐器来解决现有世界模型在实例级时间一致性和空间几何保真度方面的不足，从而提升视频真实感并增强下游自动驾驶任务性能。

Details

Motivation: 现有自动驾驶世界模型在生成视频时难以保持实例级别的时间一致性（如车辆身份随时间变化）和空间几何保真度（如精确的实例定位和遮挡关系），这限制了生成视频的真实性和对下游任务的实用性。

Result: 在nuScenes数据集上，InstaDrive实现了最先进的视频生成质量，并提升了自动驾驶下游任务的性能。此外，利用CARLA自动驾驶仪程序化地模拟了多样地图和区域中的罕见但安全关键的驾驶场景，以进行严格的安全评估。

Insight: 创新点在于显式地建模和传播实例级特征以强制时间一致性，以及通过空间几何对齐器改进空间推理和遮挡层次建模。这为生成具有高保真实例动态和几何结构的驾驶视频提供了一种系统方法，对仿真和测试至关重要。

Abstract: Autonomous driving relies on robust models trained on high-quality, large-scale multi-view driving videos. While world models offer a cost-effective solution for generating realistic driving videos, they struggle to maintain instance-level temporal consistency and spatial geometric fidelity. To address these challenges, we propose InstaDrive, a novel framework that enhances driving video realism through two key advancements: (1) Instance Flow Guider, which extracts and propagates instance features across frames to enforce temporal consistency, preserving instance identity over time. (2) Spatial Geometric Aligner, which improves spatial reasoning, ensures precise instance positioning, and explicitly models occlusion hierarchies. By incorporating these instance-aware mechanisms, InstaDrive achieves state-of-the-art video generation quality and enhances downstream autonomous driving tasks on the nuScenes dataset. Additionally, we utilize CARLA’s autopilot to procedurally and stochastically simulate rare but safety-critical driving scenarios across diverse maps and regions, enabling rigorous safety evaluation for autonomous systems. Our project page is https://shanpoyang654.github.io/InstaDrive/page.html.

[77] LaVPR: Benchmarking Language and Vision for Place Recognition cs.CVPDF

Ofer Idan, Dan Badur, Yosi Keller, Yoli Shavit

TL;DR: 该论文提出了LaVPR，一个大规模基准测试，通过为现有视觉地点识别数据集添加超过65万条丰富的自然语言描述，以解决视觉地点识别在极端环境变化和感知混淆下的失效问题，并探索了多模态融合和跨模态检索两种范式。

Details

Motivation: 动机是解决标准视觉地点识别系统在极端环境变化下的脆弱性，以及无法仅通过语言描述进行“盲”定位的局限性，这对于应急响应等应用至关重要。

Result: 结果表明，在视觉退化条件下，语言描述能带来一致的性能提升，尤其对较小的骨干网络影响最显著；添加语言后，紧凑模型能达到与更大纯视觉架构相当的性能。在跨模态检索任务上，使用低秩适应和多相似性损失的基线方法显著优于标准的对比学习方法。

Insight: 论文的创新点在于创建了首个大规模融合语言和视觉的地点识别基准，并实证了语言模态能有效增强系统鲁棒性和实现资源受限部署，其提出的跨模态检索基线方法也为该领域提供了新的技术路径。

Abstract: Visual Place Recognition (VPR) often fails under extreme environmental changes and perceptual aliasing. Furthermore, standard systems cannot perform “blind” localization from verbal descriptions alone, a capability needed for applications such as emergency response. To address these challenges, we introduce LaVPR, a large-scale benchmark that extends existing VPR datasets with over 650,000 rich natural-language descriptions. Using LaVPR, we investigate two paradigms: Multi-Modal Fusion for enhanced robustness and Cross-Modal Retrieval for language-based localization. Our results show that language descriptions yield consistent gains in visually degraded conditions, with the most significant impact on smaller backbones. Notably, adding language allows compact models to rival the performance of much larger vision-only architectures. For cross-modal retrieval, we establish a baseline using Low-Rank Adaptation (LoRA) and Multi-Similarity loss, which substantially outperforms standard contrastive methods across vision-language models. Ultimately, LaVPR enables a new class of localization systems that are both resilient to real-world stochasticity and practical for resource-constrained deployment. Our dataset and code are available at https://github.com/oferidan1/LaVPR.

[78] Global Geometry Is Not Enough for Vision Representations cs.CV | cs.AIPDF

Jiwan Chung, Seon Joo Kim

TL;DR: 本文挑战了表示学习中关于全局几何分布是稳健和可泛化表示代理的常见假设，通过实验证明标准几何指标与组合绑定能力几乎无关，而输入-输出雅可比矩阵的功能敏感性能够可靠地追踪该能力，并分析指出现有损失函数明确约束嵌入几何但未约束局部输入-输出映射是造成此差异的原因。

Details

Motivation: 动机在于揭示全局几何作为表示能力代理的局限性，即它虽能编码存在哪些元素，但对元素如何组合不敏感，旨在解决几何指标无法预测组合绑定能力的问题。

Result: 在21个视觉编码器上的测试显示，基于几何的统计量与组合绑定的相关性接近零，而功能敏感性与该能力可靠相关，未提及具体基准或SOTA比较。

Insight: 创新点在于提出功能敏感性作为建模组合结构的关键补充轴，客观分析指出现有损失函数设计导致几何与功能映射的脱节，为表示学习提供了新视角。

Abstract: A common assumption in representation learning is that globally well-distributed embeddings support robust and generalizable representations. This focus has shaped both training objectives and evaluation protocols, implicitly treating global geometry as a proxy for representational competence. While global geometry effectively encodes which elements are present, it is often insensitive to how they are composed. We investigate this limitation by testing the ability of geometric metrics to predict compositional binding across 21 vision encoders. We find that standard geometry-based statistics exhibit near-zero correlation with compositional binding. In contrast, functional sensitivity, as measured by the input-output Jacobian, reliably tracks this capability. We further provide an analytic account showing that this disparity arises from objective design, as existing losses explicitly constrain embedding geometry but leave the local input-output mapping unconstrained. These results suggest that global embedding geometry captures only a partial view of representational competence and establish functional sensitivity as a critical complementary axis for modeling composite structure.

[79] A3-TTA: Adaptive Anchor Alignment Test-Time Adaptation for Image Segmentation cs.CVPDF

Jianghao Wu, Xiangde Luo, Yubo Zhou, Lianming Wu, Guotai Wang

TL;DR: 本文提出了一种名为A3-TTA的自适应锚点对齐测试时适应框架，用于解决图像分割模型在域偏移下的部署问题。该方法通过选择置信度高的目标域图像作为锚点，指导生成可靠的伪标签，并结合语义一致性与边界感知熵最小化进行正则化，同时采用自适应指数移动平均策略来稳定模型更新。

Details

Motivation: 现有的基于伪标签的测试时适应方法依赖于扰动集成启发式策略（如dropout采样、测试时增强、高斯噪声），这些方法缺乏分布基础，会产生不稳定的训练信号，导致错误累积和灾难性遗忘。

Result: 在多域医学图像（心脏结构和前列腺分割）和自然图像上的评估显示，A3-TTA相比源模型将平均Dice分数显著提高了10.40到17.68个百分点，在不同分割模型架构下均优于多种最先进的TTA方法，并在持续TTA场景中表现出强大的抗遗忘能力。

Insight: 创新点包括：使用类紧凑密度度量选择锚点图像以构建可靠的伪标签监督；结合语义一致性和边界感知熵最小化进行正则化；引入自适应指数移动平均策略以减轻标签噪声并稳定模型更新。该方法在无需源数据或重新训练的情况下，有效提升了域适应性能。

Abstract: Test-Time Adaptation (TTA) offers a practical solution for deploying image segmentation models under domain shift without accessing source data or retraining. Among existing TTA strategies, pseudo-label-based methods have shown promising performance. However, they often rely on perturbation-ensemble heuristics (e.g., dropout sampling, test-time augmentation, Gaussian noise), which lack distributional grounding and yield unstable training signals. This can trigger error accumulation and catastrophic forgetting during adaptation. To address this, we propose \textbf{A3-TTA}, a TTA framework that constructs reliable pseudo-labels through anchor-guided supervision. Specifically, we identify well-predicted target domain images using a class compact density metric, under the assumption that confident predictions imply distributional proximity to the source domain. These anchors serve as stable references to guide pseudo-label generation, which is further regularized via semantic consistency and boundary-aware entropy minimization. Additionally, we introduce a self-adaptive exponential moving average strategy to mitigate label noise and stabilize model update during adaptation. Evaluated on both multi-domain medical images (heart structure and prostate segmentation) and natural images, A3-TTA significantly improves average Dice scores by 10.40 to 17.68 percentage points compared to the source model, outperforming several state-of-the-art TTA methods under different segmentation model architectures. A3-TTA also excels in continual TTA, maintaining high performance across sequential target domains with strong anti-forgetting ability. The code will be made publicly available at https://github.com/HiLab-git/A3-TTA.

[80] Full end-to-end diagnostic workflow automation of 3D OCT via foundation model-driven AI for retinal diseases cs.CV | cs.AIPDF

Jinze Zhang, Jian Zhong, Li Lin, Jiaxiong Li, Ke Ma

TL;DR: 本文提出了FOCUS系统，这是一个基于基础模型的端到端自动化框架，用于三维OCT视网膜疾病的诊断。该系统通过图像质量评估、异常检测和多疾病分类的序列化流程，并采用统一的自适应聚合方法将2D切片级预测整合为3D患者级诊断，旨在实现临床工作流的全自动化。

Details

Motivation: 尽管OCT在视网膜疾病诊断中具有高分辨率和三维成像优势，但其在临床实践中的全自动化诊断仍受限于多阶段工作流程和传统的单切片单任务AI模型。因此，研究旨在开发一个端到端的自动化系统以克服这些限制。

Result: 在包含3,300名患者（40,672个切片）的数据集上训练和测试，并在四个不同层级中心和多样OCT设备的1,345名患者（18,498个切片）上进行外部验证，FOCUS在质量评估（F1: 99.01%）、异常检测（F1: 97.46%）和患者级诊断（F1: 94.39%）上均取得高F1分数。多中心真实世界验证显示性能稳定（F1: 90.22%-95.24%）。在人机对比中，FOCUS在异常检测（F1: 95.47% vs 90.91%）和多疾病诊断（F1: 93.49% vs 91.35%）上匹配专家水平，且效率更高。

Insight: 创新点包括利用基础模型驱动的端到端框架实现全流程自动化，以及统一的自适应聚合方法将2D切片预测智能整合为3D诊断。从客观角度看，该系统通过多中心、多设备验证展示了鲁棒性和临床实用性，为无人化眼科和规模化筛查提供了可行蓝图。

Abstract: Optical coherence tomography (OCT) has revolutionized retinal disease diagnosis with its high-resolution and three-dimensional imaging nature, yet its full diagnostic automation in clinical practices remains constrained by multi-stage workflows and conventional single-slice single-task AI models. We present Full-process OCT-based Clinical Utility System (FOCUS), a foundation model-driven framework enabling end-to-end automation of 3D OCT retinal disease diagnosis. FOCUS sequentially performs image quality assessment with EfficientNetV2-S, followed by abnormality detection and multi-disease classification using a fine-tuned Vision Foundation Model. Crucially, FOCUS leverages a unified adaptive aggregation method to intelligently integrate 2D slices-level predictions into comprehensive 3D patient-level diagnosis. Trained and tested on 3,300 patients (40,672 slices), and externally validated on 1,345 patients (18,498 slices) across four different-tier centers and diverse OCT devices, FOCUS achieved high F1 scores for quality assessment (99.01%), abnormally detection (97.46%), and patient-level diagnosis (94.39%). Real-world validation across centers also showed stable performance (F1: 90.22%-95.24%). In human-machine comparisons, FOCUS matched expert performance in abnormality detection (F1: 95.47% vs 90.91%) and multi-disease diagnosis (F1: 93.49% vs 91.35%), while demonstrating better efficiency. FOCUS automates the image-to-diagnosis pipeline, representing a critical advance towards unmanned ophthalmology with a validated blueprint for autonomous screening to enhance population scale retinal care accessibility and efficiency.

[81] MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning cs.CV | cs.AIPDF

Shengyuan Liu, Liuxin Bao, Qi Yang, Wanting Geng, Boyun Zheng

TL;DR: 本文提出了MedSAM-Agent框架，将交互式医学图像分割重新定义为多步骤自主决策过程。该框架通过混合提示策略生成专家轨迹，并采用两阶段训练流程，结合多轮端到端结果验证和临床保真度过程奖励设计，以提升交互效率和决策效率。在6种医学模态和21个数据集上的实验表明，该方法达到了最先进的性能。

Details

Motivation: 现有基于多模态大语言模型（MLLMs）和可验证奖励强化学习（RLVR）的交互式分割方法通常依赖单轮、僵化的交互策略，且训练中缺乏过程级监督，导致无法充分利用交互工具的动态潜力并产生冗余操作。本文旨在解决这些问题。

Result: 在涵盖6种医学模态和21个数据集的广泛实验中，MedSAM-Agent实现了最先进的（state-of-the-art）性能。

Insight: 主要创新点包括：1）将交互式分割重构为多轮自主决策过程；2）引入用于生成专家轨迹的混合提示策略，使模型能内化类人决策启发式和自适应细化策略；3）设计了两阶段训练流程，整合了多轮端到端结果验证与临床保真度过程奖励，以促进交互的简洁性和决策效率。

Abstract: Medical image segmentation is evolving from task-specific models toward generalizable frameworks. Recent research leverages Multi-modal Large Language Models (MLLMs) as autonomous agents, employing reinforcement learning with verifiable reward (RLVR) to orchestrate specialized tools like the Segment Anything Model (SAM). However, these approaches often rely on single-turn, rigid interaction strategies and lack process-level supervision during training, which hinders their ability to fully exploit the dynamic potential of interactive tools and leads to redundant actions. To bridge this gap, we propose MedSAM-Agent, a framework that reformulates interactive segmentation as a multi-step autonomous decision-making process. First, we introduce a hybrid prompting strategy for expert-curated trajectory generation, enabling the model to internalize human-like decision heuristics and adaptive refinement strategies. Furthermore, we develop a two-stage training pipeline that integrates multi-turn, end-to-end outcome verification with a clinical-fidelity process reward design to promote interaction parsimony and decision efficiency. Extensive experiments across 6 medical modalities and 21 datasets demonstrate that MedSAM-Agent achieves state-of-the-art performance, effectively unifying autonomous medical reasoning with robust, iterative optimization. Code is available \href{https://github.com/CUHK-AIM-Group/MedSAM-Agent}{here}.

[82] Tiled Prompts: Overcoming Prompt Underspecification in Image and Video Super-Resolution cs.CV | cs.AI | cs.LGPDF

Bryan Sangwoo Kim, Jonghyun Park, Jong Chul Ye

TL;DR: 本文提出Tiled Prompts框架，用于解决图像和视频超分辨率中，当使用潜在分块（latent tiling）技术扩展到高分辨率时，单一全局文本提示（prompt）导致的提示欠指定问题。该方法为每个潜在分块生成特定的局部提示，在局部文本条件下进行超分辨率，从而提供高信息量的指导。

Details

Motivation: 现有基于文本条件的扩散模型在超分辨率中，使用单一全局提示作为语义先验，但在高分辨率分块处理时，全局提示会因过于粗略而遗漏局部细节（提示稀疏性），或提供局部无关的误导性指导（提示误导性），且可能被无分类器引导放大。

Result: 在高分辨率真实世界图像和视频上的实验表明，该方法相比全局提示基线，在感知质量和文本对齐方面取得了一致的提升，同时减少了幻觉和分块级别的伪影。

Insight: 核心创新在于将全局文本提示分解为与每个潜在分块对齐的局部提示，从而在保持扩散模型语义引导优势的同时，克服了高分辨率分块处理中的提示欠指定问题，这是一个计算开销最小的统一解决方案。

Abstract: Text-conditioned diffusion models have advanced image and video super-resolution by using prompts as semantic priors, but modern super-resolution pipelines typically rely on latent tiling to scale to high resolutions, where a single global caption causes prompt underspecification. A coarse global prompt often misses localized details (prompt sparsity) and provides locally irrelevant guidance (prompt misguidance) that can be amplified by classifier-free guidance. We propose Tiled Prompts, a unified framework for image and video super-resolution that generates a tile-specific prompt for each latent tile and performs super-resolution under locally text-conditioned posteriors, providing high-information guidance that resolves prompt underspecification with minimal overhead. Experiments on high resolution real-world images and videos show consistent gains in perceptual quality and text alignment, while reducing hallucinations and tile-level artifacts relative to global-prompt baselines.

[83] Z3D: Zero-Shot 3D Visual Grounding from Images cs.CVPDF

Nikita Drozdov, Andrey Lemeshko, Nikita Gavrilov, Anton Konushin, Danila Rukhovich

TL;DR: 本文提出Z3D，一种仅从多视角图像进行零样本3D视觉定位的通用流程，无需几何监督或物体先验。它通过先进的零样本3D实例分割生成高质量3D边界框提议，并利用基于提示的分割进行高级推理，在ScanRefer和Nr3D基准测试中实现了零样本方法的SOTA性能。

Details

Motivation: 解决仅从多视角图像进行零样本3D视觉定位的问题，无需依赖几何监督或物体先验，旨在克服先前零样本方法中导致性能显著下降的关键瓶颈。

Result: 在ScanRefer和Nr3D基准测试上的大量实验表明，该方法在零样本方法中达到了最先进的性能水平。

Insight: 创新点在于结合了最先进的零样本3D实例分割方法来生成高质量的3D提议框，并利用基于提示的分割技术充分发挥现代视觉语言模型的推理能力，从而构建了一个灵活、通用的零样本3D视觉定位流程。

Abstract: 3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. In this work, we explore zero-shot 3DVG from multi-view images alone, without requiring any geometric supervision or object priors. We introduce Z3D, a universal grounding pipeline that flexibly operates on multi-view images while optionally incorporating camera poses and depth maps. We identify key bottlenecks in prior zero-shot methods causing significant performance degradation and address them with (i) a state-of-the-art zero-shot 3D instance segmentation method to generate high-quality 3D bounding box proposals and (ii) advanced reasoning via prompt-based segmentation, which utilizes full capabilities of modern VLMs. Extensive experiments on the ScanRefer and Nr3D benchmarks demonstrate that our approach achieves state-of-the-art performance among zero-shot methods. Code is available at https://github.com/col14m/z3d .

[84] Symbol-Aware Reasoning with Masked Discrete Diffusion for Handwritten Mathematical Expression Recognition cs.CV | cs.LGPDF

Takaya Kawakatsu, Ryo Ishiyama

TL;DR: 本文提出了一种基于掩码离散扩散的符号感知推理框架，用于手写数学表达式识别（HMER）。该方法将HMER重新定义为迭代的符号精炼过程，而非传统的自回归序列生成，以解决曝光偏差和句法不一致问题。通过多步重掩码机制，逐步精炼符号和结构关系，并引入符号感知分词和随机掩码互学习策略来增强句法对齐和对手写多样性的鲁棒性。

Details

Motivation: 动机在于解决自回归模型在手写数学表达式识别中存在的曝光偏差和句法结构不一致问题，需要一种能够同时推理多样符号和二维结构布局的新方法。

Result: 在MathWriting基准测试上，该方法实现了5.56%的字符错误率（CER）和60.42%的精确匹配率（EM），优于强大的Transformer模型和商业基线。在CROHME 2014-2023数据集上也取得了持续的性能提升，达到了SOTA水平。

Insight: 创新点在于将离散扩散模型引入HMER任务，通过迭代精炼而非序列生成来消除因果依赖并提升结构一致性；符号感知分词和随机掩码互学习策略增强了模型对复杂符号和手写变体的处理能力，为结构感知的视觉识别提供了超越生成建模的新范式。

Abstract: Handwritten Mathematical Expression Recognition (HMER) requires reasoning over diverse symbols and 2D structural layouts, yet autoregressive models struggle with exposure bias and syntactic inconsistency. We present a discrete diffusion framework that reformulates HMER as iterative symbolic refinement instead of sequential generation. Through multi-step remasking, the proposal progressively refines both symbols and structural relations, removing causal dependencies and improving structural consistency. A symbol-aware tokenization and Random-Masking Mutual Learning further enhance syntactic alignment and robustness to handwriting diversity. On the MathWriting benchmark, the proposal achieves 5.56% CER and 60.42% EM, outperforming strong Transformer and commercial baselines. Consistent gains on CROHME 2014–2023 demonstrate that discrete diffusion provides a new paradigm for structure-aware visual recognition beyond generative modeling.

[85] Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion cs.CVPDF

Zhiwen Yang, Yuxin Peng

TL;DR: 本文提出了一种名为多分辨率对齐（MRA）的方法，用于缓解基于相机的3D语义场景补全（SSC）任务中的体素稀疏性问题。该方法通过跨多分辨率3D特征的场景级和实例级对齐作为辅助监督，以提升模型优化效率和性能。

Details

Motivation: 现有基于相机的3D语义场景补全方法仅依赖体素标签监督进行优化，面临体素稀疏性的挑战（自动驾驶场景中大量体素为空），这限制了优化效率和模型性能。

Result: 论文在公开的SSC基准数据集（如SemanticKITTI）上进行了实验，结果表明所提方法能有效缓解体素稀疏性问题，并提升了3D语义场景补全的性能。

Insight: 创新点在于引入了多分辨率特征对齐作为辅助监督，具体包括：1）通过多分辨率视图变换器模块进行场景级特征对齐；2）通过立方体语义各向异性模块识别每个体素的实例级语义显著性；3）通过关键分布对齐模块选择关键体素作为实例级锚点，并利用循环损失确保跨分辨率的关键特征分布一致性。这为处理稀疏3D感知任务提供了新的监督信号设计思路。

Abstract: Camera-based 3D semantic scene completion (SSC) offers a cost-effective solution for assessing the geometric occupancy and semantic labels of each voxel in the surrounding 3D scene with image inputs, providing a voxel-level scene perception foundation for the perception-prediction-planning autonomous driving systems. Although significant progress has been made in existing methods, their optimization rely solely on the supervision from voxel labels and face the challenge of voxel sparsity as a large portion of voxels in autonomous driving scenarios are empty, which limits both optimization efficiency and model performance. To address this issue, we propose a \textit{Multi-Resolution Alignment (MRA)} approach to mitigate voxel sparsity in camera-based 3D semantic scene completion, which exploits the scene and instance level alignment across multi-resolution 3D features as auxiliary supervision. Specifically, we first propose the Multi-resolution View Transformer module, which projects 2D image features into multi-resolution 3D features and aligns them at the scene level through fusing discriminative seed features. Furthermore, we design the Cubic Semantic Anisotropy module to identify the instance-level semantic significance of each voxel, accounting for the semantic differences of a specific voxel against its neighboring voxels within a cubic area. Finally, we devise a Critical Distribution Alignment module, which selects critical voxels as instance-level anchors with the guidance of cubic semantic anisotropy, and applies a circulated loss for auxiliary supervision on the critical feature distribution consistency across different resolutions. The code is available at https://github.com/PKU-ICST-MIPL/MRA_TIP.

[86] Unifying Watermarking via Dimension-Aware Mapping cs.CVPDF

Jiale Meng, Runyi Hu, Jie Zhang, Zheming Lu, Ivor Tsang

TL;DR: 本文提出了DiM（Dimension-aware Mapping）框架，将水印问题统一为维度感知的映射问题，将水印信息建模为不同维度的载荷（如一维二进制消息、二维空间掩码、三维时空结构），并通过调整嵌入和提取的维度配置来实现不同的水印功能。

Details

Motivation: 现有深度水印方法虽然共享相似的编码器-解码器架构，但在功能行为上差异很大，缺乏统一的理论框架。本文旨在从功能层面统一这些方法，并探索维度配置如何决定水印行为。

Result: 在视频领域的实验表明，仅改变嵌入和提取的维度（无需修改架构）即可实现不同的水印能力，包括时空篡改定位、局部嵌入控制和帧顺序被打乱后的时间顺序恢复。

Insight: 创新点在于将水印统一为维度感知映射问题，揭示了维度配置（同维映射保持结构，跨维映射实现定位）是决定水印功能的关键因素，为设计多功能水印系统提供了新视角。

Abstract: Deep watermarking methods often share similar encoder-decoder architectures, yet differ substantially in their functional behaviors. We propose DiM, a new multi-dimensional watermarking framework that formulates watermarking as a dimension-aware mapping problem, thereby unifying existing watermarking methods at the functional level. Under DiM, watermark information is modeled as payloads of different dimensionalities, including one-dimensional binary messages, two-dimensional spatial masks, and three-dimensional spatiotemporal structures. We find that the dimensional configuration of embedding and extraction largely determines the resulting watermarking behavior. Same-dimensional mappings preserve payload structure and support fine-grained control, while cross-dimensional mappings enable spatial or spatiotemporal localization. We instantiate DiM in the video domain, where spatiotemporal representations enable a broader set of dimension mappings. Experiments demonstrate that varying only the embedding and extraction dimensions, without architectural changes, leads to different watermarking capabilities, including spatiotemporal tamper localization, local embedding control, and recovery of temporal order under frame disruptions.

[87] Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization cs.CVPDF

Hao Fang, Jinyu Li, Jiawei Kong, Tianqu Zhuang, Kuofeng Gao

TL;DR: 本文提出C3PO框架，通过思维链压缩和对比偏好优化来缓解多模态推理模型中的幻觉问题。研究发现引入推理机制会加剧模型对语言先验的依赖而忽视视觉输入，导致思维链包含冗余文本标记而视觉线索减少。为此，框架首先选择性过滤冗余思维标记以构建更紧凑、信号高效的思维链表示；其次利用高质量AI反馈构建训练对进行推理增强的偏好调优，并设计多模态幻觉诱导机制生成负样本进行对比校正。

Details

Motivation: 多模态推理模型虽表现出强大能力，但仍易产生幻觉，且有效解决方案尚未充分探索。本文旨在通过实验分析幻觉成因，并开发训练框架来缓解该问题。

Result: 论文在多种多模态推理模型和基准测试上展示了一致的幻觉减少效果，并通过理论论证了所提方法的有效性。

Insight: 创新点在于识别出推理机制加剧语言先验依赖的幻觉根源，并提出思维链压缩以提升视觉信号效率，以及结合AI反馈和幻觉诱导的对比偏好优化方案，为多模态模型幻觉缓解提供了可借鉴的训练策略。

Abstract: While multimodal reasoning models (MLRMs) have exhibited impressive capabilities, they remain prone to hallucinations, and effective solutions are still underexplored. In this paper, we experimentally analyze the hallucination cause and propose C3PO, a training-based mitigation framework comprising \textbf{C}hain-of-Thought \textbf{C}ompression and \textbf{C}ontrastive \textbf{P}reference \textbf{O}ptimization. Firstly, we identify that introducing reasoning mechanisms exacerbates models’ reliance on language priors while overlooking visual inputs, which can produce CoTs with reduced visual cues but redundant text tokens. To this end, we propose to selectively filter redundant thinking tokens for a more compact and signal-efficient CoT representation that preserves task-relevant information while suppressing noise. In addition, we observe that the quality of the reasoning trace largely determines whether hallucination emerges in subsequent responses. To leverage this insight, we introduce a reasoning-enhanced preference tuning scheme that constructs training pairs using high-quality AI feedback. We further design a multimodal hallucination-inducing mechanism that elicits models’ inherent hallucination patterns via carefully crafted inducers, yielding informative negative signals for contrastive correction. We provide theoretical justification for the effectiveness and demonstrate consistent hallucination reduction across diverse MLRMs and benchmarks.

[88] From Vicious to Virtuous Cycles: Synergistic Representation Learning for Unsupervised Video Object-Centric Learning cs.CV | cs.LGPDF

Hyun Seok Seong, WonJun Moon, Jae-Pil Heo

TL;DR: 本文提出了一种名为协同表征学习（SRL）的新方法，旨在解决无监督视频物体中心学习中，基于重建的槽位架构存在的编码器与解码器表征不一致问题。该方法通过建立一个编码器与解码器相互精炼的良性循环，利用编码器的锐利度去模糊解码器输出的语义边界，同时利用解码器的空间一致性去噪编码器的特征，从而在视频物体中心学习基准上取得了最先进的结果。

Details

Motivation: 动机在于解决无监督物体中心学习（特别是基于槽位的架构）中，编码器产生的高频、锐利注意力图与解码器产生的空间一致但模糊的重建图之间的根本冲突，这种冲突导致了一个恶性循环，阻碍了模型性能的提升。

Result: 该方法在视频物体中心学习基准上取得了最先进（SOTA）的结果。

Insight: 核心创新点在于提出了一个协同表征学习（SRL）框架，通过建立编码器与解码器相互精炼的良性循环来打破原有的恶性循环，并引入了一个带有槽位正则化目标的预热阶段来稳定训练过程，从而弥合了编码器与解码器之间的表征鸿沟。

Abstract: Unsupervised object-centric learning models, particularly slot-based architectures, have shown great promise in decomposing complex scenes. However, their reliance on reconstruction-based training creates a fundamental conflict between the sharp, high-frequency attention maps of the encoder and the spatially consistent but blurry reconstruction maps of the decoder. We identify that this discrepancy gives rise to a vicious cycle: the noisy feature map from the encoder forces the decoder to average over possibilities and produce even blurrier outputs, while the gradient computed from blurry reconstruction maps lacks high-frequency details necessary to supervise encoder features. To break this cycle, we introduce Synergistic Representation Learning (SRL) that establishes a virtuous cycle where the encoder and decoder mutually refine one another. SRL leverages the encoder’s sharpness to deblur the semantic boundary within the decoder output, while exploiting the decoder’s spatial consistency to denoise the encoder’s features. This mutual refinement process is stabilized by a warm-up phase with a slot regularization objective that initially allocates distinct entities per slot. By bridging the representational gap between the encoder and decoder, SRL achieves state-of-the-art results on video object-centric learning benchmarks. Codes are available at https://github.com/hynnsk/SRL.

[89] Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction cs.CV | cs.AIPDF

Zhengbo Jiao, Shaobo Wang, Zifan Zhang, Wei Wang, Bing Zhao

TL;DR: Socratic-Geo是一个通过多智能体交互动态耦合数据合成与模型学习的全自主框架，旨在解决多模态大语言模型在几何推理任务中高质量图像-文本对数据极度稀缺的问题。该框架包含教师、求解器和生成器三个智能体：教师智能体通过参数化Python脚本生成和反思反馈确保数据纯度；求解器智能体通过偏好学习优化推理，失败路径指导教师进行针对性数据增强；生成器智能体则从累积的’图像-代码-指令’三元组中学习图像生成能力。

Details

Motivation: 当前最先进的多模态大语言模型在几何推理方面存在瓶颈，主要原因是高质量图像-文本对数据极其稀缺，人工标注成本高昂，而自动化方法又难以保证保真度和训练有效性。现有方法要么被动适应可用图像，要么采用低效的随机探索与过滤，将数据生成与学习需求脱钩。

Result: 仅从108个种子问题开始，Socratic-Solver在六个基准测试上使用四分之一基线数据达到了49.11分，超越了强基线2.43分。Socratic-Generator在GenExam基准上达到了42.4%，为开源模型建立了新的最先进水平，超越了Seedream-4.0（39.8%）并接近Gemini-2.5-Flash-Image（43.1%）。

Insight: 论文的创新点在于提出了一个动态耦合数据合成与模型学习的多智能体交互框架，通过反思反馈机制确保合成数据的纯度，并利用失败路径进行针对性数据增强。此外，将程序化绘图智能蒸馏到视觉生成中，实现了从有限种子问题自主扩展高质量训练数据的能力，有效解决了几何推理领域的数据瓶颈问题。

Abstract: Multimodal Large Language Models (MLLMs) have significantly advanced vision-language understanding. However, even state-of-the-art models struggle with geometric reasoning, revealing a critical bottleneck: the extreme scarcity of high-quality image-text pairs. Human annotation is prohibitively expensive, while automated methods fail to ensure fidelity and training effectiveness. Existing approaches either passively adapt to available images or employ inefficient random exploration with filtering, decoupling generation from learning needs. We propose Socratic-Geo, a fully autonomous framework that dynamically couples data synthesis with model learning through multi-agent interaction. The Teacher agent generates parameterized Python scripts with reflective feedback (Reflect for solvability, RePI for visual validity), ensuring image-text pair purity. The Solver agent optimizes reasoning through preference learning, with failure paths guiding Teacher’s targeted augmentation. Independently, the Generator learns image generation capabilities on accumulated “image-code-instruction” triplets, distilling programmatic drawing intelligence into visual generation. Starting from only 108 seed problems, Socratic-Solver achieves 49.11 on six benchmarks using one-quarter of baseline data, surpassing strong baselines by 2.43 points. Socratic-Generator achieves 42.4% on GenExam, establishing new state-of-the-art for open-source models, surpassing Seedream-4.0 (39.8%) and approaching Gemini-2.5-Flash-Image (43.1%).

[90] ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuning cs.CVPDF

Xiaofeng Tan, Jun Liu, Yuanting Fan, Bin-Bin Gao, Xi Jiang

TL;DR: 本文提出ConsistentRFT框架，旨在解决基于流模型的强化微调（RFT）中常见的视觉幻觉问题，如过度优化的细节和语义错位。该框架通过动态粒度采样机制和一致性策略梯度优化，在保持模型一致性的同时平衡全局语义与局部细节的探索，有效减少了幻觉现象。

Details

Motivation: 基于流模型的强化微调对偏好对齐至关重要，但常引入视觉幻觉（如细节过优化和语义错位）。本文旨在探究幻觉产生的原因并寻求减少它们的方法。

Result: 实验表明，ConsistentRFT显著减少了视觉幻觉，在低层和高层感知幻觉上平均分别降低了49%和38%。在领域外指标上，它优于其他RFT方法，相比FLUX1.dev基线（下降-0.4%）提升了5.1%。

Insight: 创新点在于从探索与利用的统一视角分析RFT，揭示了SDE采样探索有限和策略梯度轨迹模仿破坏一致性的核心问题，并提出了动态粒度采样和一致性策略梯度优化来缓解这些问题，增强了模型的稳定性和泛化能力。

Abstract: Reinforcement Fine-Tuning (RFT) on flow-based models is crucial for preference alignment. However, they often introduce visual hallucinations like over-optimized details and semantic misalignment. This work preliminarily explores why visual hallucinations arise and how to reduce them. We first investigate RFT methods from a unified perspective, and reveal the core problems stemming from two aspects, exploration and exploitation: (1) limited exploration during stochastic differential equation (SDE) rollouts, leading to an over-emphasis on local details at the expense of global semantics, and (2) trajectory imitation process inherent in policy gradient methods, distorting the model’s foundational vector field and its cross-step consistency. Building on this, we propose ConsistentRFT, a general framework to mitigate these hallucinations. Specifically, we design a Dynamic Granularity Rollout (DGR) mechanism to balance exploration between global semantics and local details by dynamically scheduling different noise sources. We then introduce a Consistent Policy Gradient Optimization (CPGO) that preserves the model’s consistency by aligning the current policy with a more stable prior. Extensive experiments demonstrate that ConsistentRFT significantly mitigates visual hallucinations, achieving average reductions of 49% for low-level and 38% for high-level perceptual hallucinations. Furthermore, ConsistentRFT outperforms other RFT methods on out-of-domain metrics, showing an improvement of 5.1% (v.s. the baseline’s decrease of -0.4%) over FLUX1.dev. This is \href{https://xiaofeng-tan.github.io/projects/ConsistentRFT}{Project Page}.

[91] Hierarchical Concept-to-Appearance Guidance for Multi-Subject Image Generation cs.CV | cs.AIPDF

Yijia Xu, Zihao Wang, Jinshi Cui

TL;DR: 本文提出了一种名为分层概念到外观引导（CAG）的框架，用于解决多主体图像生成中身份不一致和构图控制有限的问题。该框架通过从高层概念到细粒度外观的显式、结构化监督，结合了概念级的VAE丢弃训练策略和外观级的对应感知掩码注意力模块，显著提升了文本指令遵循和主体一致性。

Details

Motivation: 现有方法依赖扩散模型隐式关联文本提示与参考图像，导致多主体图像生成时身份不一致和构图控制能力有限。本文旨在通过提供从概念到外观的显式结构化指导来解决这些问题。

Result: 大量实验表明，该方法在多主体图像生成任务上实现了最先进的性能，在文本指令遵循和主体一致性方面有显著提升。

Insight: 创新点在于分层引导策略：概念层通过VAE丢弃训练增强对视觉语言模型语义信号的鲁棒性；外观层通过将VLM推导的对应关系集成到扩散变换器的对应感知掩码注意力模块中，实现精确的属性绑定。这为多主体可控生成提供了可借鉴的显式结构化监督思路。

Abstract: Multi-subject image generation aims to synthesize images that faithfully preserve the identities of multiple reference subjects while following textual instructions. However, existing methods often suffer from identity inconsistency and limited compositional control, as they rely on diffusion models to implicitly associate text prompts with reference images. In this work, we propose Hierarchical Concept-to-Appearance Guidance (CAG), a framework that provides explicit, structured supervision from high-level concepts to fine-grained appearances. At the conceptual level, we introduce a VAE dropout training strategy that randomly omits reference VAE features, encouraging the model to rely more on robust semantic signals from a Visual Language Model (VLM) and thereby promoting consistent concept-level generation in the absence of complete appearance cues. At the appearance level, we integrate the VLM-derived correspondences into a correspondence-aware masked attention module within the Diffusion Transformer (DiT). This module restricts each text token to attend only to its matched reference regions, ensuring precise attribute binding and reliable multi-subject composition. Extensive experiments demonstrate that our method achieves state-of-the-art performance on the multi-subject image generation, substantially improving prompt following and subject consistency.

[92] Contextualized Visual Personalization in Vision-Language Models cs.CVPDF

Yeongtak Oh, Sangwon Yu, Junsung Park, Han Cheol Moon, Jisoo Mok

TL;DR: 本文提出了一种名为CoViP的统一框架，用于解决视觉语言模型在基于用户特定视觉经验生成个性化响应方面的不足，通过强化学习后训练和标题增强生成技术提升个性化图像描述能力，并在多个下游任务中验证了其有效性。

Details

Motivation: 现有视觉语言模型缺乏将视觉输入与用户积累的视觉-文本上下文关联的能力，无法基于用户具体经验生成个性化响应，因此本文正式定义了上下文视觉个性化这一挑战。

Result: 实验表明，现有开源和专有视觉语言模型存在显著局限性，而CoViP不仅提升了个性化图像描述性能，还在下游个性化任务中实现了整体性能增益，证明了其作为实现稳健且可泛化上下文视觉个性化关键阶段的潜力。

Insight: 创新点在于将个性化图像描述作为上下文视觉个性化的核心任务，并通过强化学习后训练与标题增强生成技术统一提升模型能力；同时引入了诊断性评估方法，以排除文本捷径并验证模型是否真正利用了视觉上下文。

Abstract: Despite recent progress in vision-language models (VLMs), existing approaches often fail to generate personalized responses based on the user’s specific experiences, as they lack the ability to associate visual inputs with a user’s accumulated visual-textual context. We newly formalize this challenge as contextualized visual personalization, which requires the visual recognition and textual retrieval of personalized visual experiences by VLMs when interpreting new images. To address this issue, we propose CoViP, a unified framework that treats personalized image captioning as a core task for contextualized visual personalization and improves this capability through reinforcement-learning-based post-training and caption-augmented generation. We further introduce diagnostic evaluations that explicitly rule out textual shortcut solutions and verify whether VLMs truly leverage visual context. Extensive experiments demonstrate that existing open-source and proprietary VLMs exhibit substantial limitations, while CoViP not only improves personalized image captioning but also yields holistic gains across downstream personalization tasks. These results highlight CoViP as a crucial stage for enabling robust and generalizable contextualized visual personalization.

[93] Inlier-Centric Post-Training Quantization for Object Detection Models cs.CVPDF

Minsu Kim, Dongyeun Lee, Jaemyung Yu, Jiwan Hur, Giseop Kim

TL;DR: 本文提出了一种名为InlierQ的以正常值为中心的后训练量化方法，用于目标检测模型。该方法通过计算梯度感知的体积显著性分数，并利用期望最大化算法将激活值分类为信息丰富的正常值或任务无关的异常值，从而在量化过程中抑制异常值并保留关键特征。该方法无需标签、即插即用，仅需64个校准样本，并在COCO和nuScenes基准测试中有效降低了量化误差。

Details

Motivation: 目标检测模型计算量大，量化是降低部署成本的关键。然而，背景杂波和传感器噪声等任务无关的形态会产生冗余激活，这些异常值会扩大激活范围、扭曲分布，使比特分配复杂化并削弱信息特征的保留。现有方法缺乏清晰区分异常值的标准，抑制它们时可能误删有用信息。

Result: 在COCO（2D）和nuScenes（3D，包括基于相机和激光雷达）目标检测基准上的实验表明，InlierQ能持续降低量化误差。

Insight: 核心创新点在于提出了一种基于梯度感知显著性分数和EM算法的无监督方法，将激活值明确区分为信息丰富的正常值和任务无关的异常值，从而在量化过程中实现更精准的比特分配和特征保留。其标签无关、低校准数据需求的特性也极具实用价值。

Abstract: Object detection is pivotal in computer vision, yet its immense computational demands make deployment slow and power-hungry, motivating quantization. However, task-irrelevant morphologies such as background clutter and sensor noise induce redundant activations (or anomalies). These anomalies expand activation ranges and skew activation distributions toward task-irrelevant responses, complicating bit allocation and weakening the preservation of informative features. Without a clear criterion to distinguish anomalies, suppressing them can inadvertently discard useful information. To address this, we present InlierQ, an inlier-centric post-training quantization approach that separates anomalies from informative inliers. InlierQ computes gradient-aware volume saliency scores, classifies each volume as an inlier or anomaly, and fits a posterior distribution over these scores using the Expectation-Maximization (EM) algorithm. This design suppresses anomalies while preserving informative features. InlierQ is label-free, drop-in, and requires only 64 calibration samples. Experiments on the COCO and nuScenes benchmarks show consistent reductions in quantization error for camera-based (2D and 3D) and LiDAR-based (3D) object detection.

[94] Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance cs.CV | cs.CLPDF

Yingjie Zhu, Xuefeng Bai, Kehai Chen, Yang Xiang, Youcheng Pan

TL;DR: 本文提出了一种名为DiSCo的解耦结构-内容对齐框架，以及基于此的Table-GLS全局到局部结构引导推理框架，旨在以最小标注和无外部工具的方式，高效提升大型视觉语言模型对表格图像的理解和推理能力。

Details

Motivation: 解决大型视觉语言模型在表格图像推理中因复杂布局和结构-内容信息紧密耦合而面临的挑战，现有方法依赖昂贵监督训练或外部工具，效率和可扩展性受限。

Result: 在多个基准测试上的广泛实验表明，该框架有效提升了LVLM的表格理解和推理能力，特别是在泛化到未见过的表格结构方面表现突出。

Insight: 创新点在于将表格的结构抽象与语义基础在跨模态对齐过程中显式解耦，并通过结构化探索和基于证据的推理进行引导，实现了高效且可泛化的表格推理。

Abstract: Reasoning over table images remains challenging for Large Vision-Language Models (LVLMs) due to complex layouts and tightly coupled structure-content information. Existing solutions often depend on expensive supervised training, reinforcement learning, or external tools, limiting efficiency and scalability. This work addresses a key question: how to adapt LVLMs to table reasoning with minimal annotation and no external tools? Specifically, we first introduce DiSCo, a Disentangled Structure-Content alignment framework that explicitly separates structural abstraction from semantic grounding during multimodal alignment, efficiently adapting LVLMs to tables structures. Building on DiSCo, we further present Table-GLS, a Global-to-Local Structure-guided reasoning framework that performs table reasoning via structured exploration and evidence-grounded inference. Extensive experiments across diverse benchmarks demonstrate that our framework efficiently enhances LVLM’s table understanding and reasoning capabilities, particularly generalizing to unseen table structures.

[95] Interpretable Logical Anomaly Classification via Constraint Decomposition and Instruction Fine-Tuning cs.CVPDF

Xufei Zhang, Xinjiao Zhou, Ziling Deng, Dongdong Geng, Jianxiong Wang

TL;DR: 本文提出Logical Anomaly Classification (LAC)任务，将异常检测与细粒度违规分类统一为单步推理，并设计了LogiCls视觉语言框架。该框架通过将复杂逻辑约束分解为可验证的子查询，并利用数据中心的指令合成管道生成思维链监督，结合难度感知重采样策略，实现了对工业图像中逻辑异常的鲁棒、可解释且准确的分类。

Details

Motivation: 现有工作大多将异常检测视为二元决策，无法指明具体违反的逻辑规则，对质量保证价值有限。本文旨在解决工业图像中逻辑异常（如物体数量、空间布局和组合关系违规）的细粒度分类与解释问题。

Result: 大量实验表明，LogiCls在工业逻辑异常分类任务上实现了鲁棒、可解释且准确的结果，能够同时提供预测的违规类别及其证据链。

Insight: 创新点包括：提出LAC任务统一异常检测与细粒度分类；设计约束分解与子查询验证框架；提出数据中心的指令合成管道生成思维链监督；采用难度感知重采样策略稳定训练。这为基于视觉语言模型的可解释逻辑推理提供了新思路。

Abstract: Logical anomalies are violations of predefined constraints on object quantity, spatial layout, and compositional relationships in industrial images. While prior work largely treats anomaly detection as a binary decision, such formulations cannot indicate which logical rule is broken and therefore offer limited value for quality assurance. We introduce Logical Anomaly Classification (LAC), a task that unifies anomaly detection and fine-grained violation classification in a single inference step. To tackle LAC, we propose LogiCls, a vision-language framework that decomposes complex logical constraints into a sequence of verifiable subqueries. We further present a data-centric instruction synthesis pipeline that generates chain-of-thought (CoT) supervision for these subqueries, coupling precise grounding annotations with diverse image-text augmentations to adapt vision language models (VLMs) to logic-sensitive reasoning. Training is stabilized by a difficulty-aware resampling strategy that emphasizes challenging subqueries and long tail constraint types. Extensive experiments demonstrate that LogiCls delivers robust, interpretable, and accurate industrial logical anomaly classification, providing both the predicted violation categories and their evidence trails.

[96] PnP-U3D: Plug-and-Play 3D Framework Bridging Autoregression and Diffusion for Unified Understanding and Generation cs.CVPDF

Yongwei Chen, Tianyi Wei, Yushi Lan, Zhaoyang Lyu, Shangchen Zhou

TL;DR: 本文提出了PnP-U3D，一个首个将自回归与扩散模型结合的3D统一理解与生成框架。它采用自回归范式进行3D理解，扩散范式进行3D生成，并通过一个轻量级Transformer桥接两者的特征空间，实现有效信息交互，同时保留预训练模型的先验知识。

Details

Motivation: 现有将3D任务统一在单一自回归范式下的方法，由于强制信号量化和高昂训练成本，导致性能显著下降。本文旨在解决3D理解与生成任务的有效统一问题，核心挑战在于如何在不显著损害各自固有能力的前提下，实现两者间的有效信息交互，并利用预训练模型降低训练成本。

Result: 广泛的实验表明，该框架在多种3D理解与生成基准测试中达到了最先进的性能，同时在3D编辑任务上也表现出色。

Insight: 摘要宣称的创新点在于首次提出了结合自回归与扩散的统一3D框架，通过一个轻量级桥接模块实现跨模态信息交换，同时保留独立模型的先验。从客观角度看，其核心创新在于放弃了强制统一为单一范式（如纯自回归）的思路，转而采用混合范式（AR+Diffusion）并设计高效接口，这为构建通用3D智能体提供了一个有前景的新方向。

Abstract: The rapid progress of large multimodal models has inspired efforts toward unified frameworks that couple understanding and generation. While such paradigms have shown remarkable success in 2D, extending them to 3D remains largely underexplored. Existing attempts to unify 3D tasks under a single autoregressive (AR) paradigm lead to significant performance degradation due to forced signal quantization and prohibitive training cost. Our key insight is that the essential challenge lies not in enforcing a unified autoregressive paradigm, but in enabling effective information interaction between generation and understanding while minimally compromising their inherent capabilities and leveraging pretrained models to reduce training cost. Guided by this perspective, we present the first unified framework for 3D understanding and generation that combines autoregression with diffusion. Specifically, we adopt an autoregressive next-token prediction paradigm for 3D understanding, and a continuous diffusion paradigm for 3D generation. A lightweight transformer bridges the feature space of large language models and the conditional space of 3D diffusion models, enabling effective cross-modal information exchange while preserving the priors learned by standalone models. Extensive experiments demonstrate that our framework achieves state-of-the-art performance across diverse 3D understanding and generation benchmarks, while also excelling in 3D editing tasks. These results highlight the potential of unified AR+diffusion models as a promising direction for building more general-purpose 3D intelligence.

[97] Constrained Dynamic Gaussian Splatting cs.CVPDF

Zihan Zheng, Zhenglong Wu, Xuanxuan Wang, Houqiang Zhong, Xiaoyun Zhang

TL;DR: 本文提出了一种名为约束动态高斯泼溅（CDGS）的新框架，用于动态场景的4D重建，通过将重建问题形式化为预算约束优化，在训练期间强制执行用户定义的高斯数量预算，以实现内存效率和高渲染质量的平衡。

Details

Motivation: 动态高斯泼溅方法虽然能实现高保真4D重建，但面临一个根本困境：无约束的密集化会导致内存消耗过大，不适用于边缘设备；而启发式剪枝方法在预设高斯预算下无法达到最优渲染质量。

Result: 在广泛的实验中，CDGS在不同容量限制下均能提供最优渲染质量，与最先进方法相比实现了超过3倍的压缩，并严格遵循硬件约束（误差<2%），推动了率失真性能的帕累托前沿。

Insight: 核心创新在于引入了可微分的预算控制器作为优化驱动，并融合几何、运动和感知线索的多模态统一重要性评分来精确调控容量；此外，通过解耦静态与动态元素优化、自适应分配机制和三阶段训练策略，在固定预算下最大化效用，并结合双模式混合压缩方案。

Abstract: While Dynamic Gaussian Splatting enables high-fidelity 4D reconstruction, its deployment is severely hindered by a fundamental dilemma: unconstrained densification leads to excessive memory consumption incompatible with edge devices, whereas heuristic pruning fails to achieve optimal rendering quality under preset Gaussian budgets. In this work, we propose Constrained Dynamic Gaussian Splatting (CDGS), a novel framework that formulates dynamic scene reconstruction as a budget-constrained optimization problem to enforce a strict, user-defined Gaussian budget during training. Our key insight is to introduce a differentiable budget controller as the core optimization driver. Guided by a multi-modal unified importance score, this controller fuses geometric, motion, and perceptual cues for precise capacity regulation. To maximize the utility of this fixed budget, we further decouple the optimization of static and dynamic elements, employing an adaptive allocation mechanism that dynamically distributes capacity based on motion complexity. Furthermore, we implement a three-phase training strategy to seamlessly integrate these constraints, ensuring precise adherence to the target count. Coupled with a dual-mode hybrid compression scheme, CDGS not only strictly adheres to hardware constraints (error < 2%}) but also pushes the Pareto frontier of rate-distortion performance. Extensive experiments demonstrate that CDGS delivers optimal rendering quality under varying capacity limits, achieving over 3x compression compared to state-of-the-art methods.

[98] ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images cs.CV | cs.AI | cs.MMPDF

Xinyue Li, Zhiming Xu, Zhichao Zhang, Zhaolin Cai, Sijing Wu

TL;DR: 本文提出了ELIQ，一个用于评估不断演进的AI生成图像质量的无标签框架。该框架专注于视觉质量和提示-图像对齐，通过自动构建正负样本对来覆盖传统失真和AIGC特定失真模式，无需人工标注即可实现可迁移的监督。基于这些样本对，ELIQ通过指令微调将预训练多模态模型适配为质量感知的评判器，并利用轻量级门控融合和Quality Query Transformer预测二维质量。

Details

Motivation: 生成式文本到图像模型快速发展，其感知质量上限持续变化，导致之前收集的标签对新一代模型不可靠，因此需要一种无需人工标注、能适应模型演进的质量评估方法。

Result: 在多个基准测试上的实验表明，ELIQ持续优于现有的无标签方法，并且无需修改即可从AI生成内容（AIGC）场景泛化到用户生成内容（UGC）场景。

Insight: 创新点在于自动构建覆盖多种失真模式的正负样本对以实现无监督学习，以及通过指令微调适配预训练模型并引入轻量级架构进行二维质量预测，为在持续演进的生成模型下进行可扩展的无标签质量评估提供了途径。

Abstract: Generative text-to-image models are advancing at an unprecedented pace, continuously shifting the perceptual quality ceiling and rendering previously collected labels unreliable for newer generations. To address this, we present ELIQ, a Label-free Framework for Quality Assessment of Evolving AI-generated Images. Specifically, ELIQ focuses on visual quality and prompt-image alignment, automatically constructs positive and aspect-specific negative pairs to cover both conventional distortions and AIGC-specific distortion modes, enabling transferable supervision without human annotations. Building on these pairs, ELIQ adapts a pre-trained multimodal model into a quality-aware critic via instruction tuning and predicts two-dimensional quality using lightweight gated fusion and a Quality Query Transformer. Experiments across multiple benchmarks demonstrate that ELIQ consistently outperforms existing label-free methods, generalizes from AI-generated content (AIGC) to user-generated content (UGC) scenarios without modification, and paves the way for scalable and label-free quality assessment under continuously evolving generative models. The code will be released upon publication.

[99] SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM cs.CVPDF

Ming Nie, Dan Ding, Chunwei Wang, Yuanfan Guo, Jianhua Han

TL;DR: 该论文提出了SlowFocus机制，旨在解决视频大语言模型在同时保持高质量帧级语义信息和全面视频级时序信息方面的困难。该机制通过识别问题相关的时序片段、进行密集采样提取局部高频特征，并利用多频率混合注意力模块聚合局部细节与全局上下文，从而在不牺牲帧级视觉令牌质量的前提下显著提升等效采样频率。

Details

Motivation: 当前视频大语言模型难以同时维持足够的每帧令牌数和足够的每视频采样帧数，这阻碍了模型在细粒度视频理解方面的发展。

Result: 在现有公共视频理解基准和新提出的FineAction-CGR基准上的综合实验证明了该机制的优越性。

Insight: 创新点在于SlowFocus机制及其配套的训练策略，通过问题引导的时序片段定位与密集采样，结合多频率特征融合，有效提升了模型对细粒度时序信息的理解能力；同时，专门构建的FineAction-CGR基准为评估此类能力提供了针对性测试平台。

Abstract: Large language models (LLMs) have demonstrated exceptional capabilities in text understanding, which has paved the way for their expansion into video LLMs (Vid-LLMs) to analyze video data. However, current Vid-LLMs struggle to simultaneously retain high-quality frame-level semantic information (i.e., a sufficient number of tokens per frame) and comprehensive video-level temporal information (i.e., an adequate number of sampled frames per video). This limitation hinders the advancement of Vid-LLMs towards fine-grained video understanding. To address this issue, we introduce the SlowFocus mechanism, which significantly enhances the equivalent sampling frequency without compromising the quality of frame-level visual tokens. SlowFocus begins by identifying the query-related temporal segment based on the posed question, then performs dense sampling on this segment to extract local high-frequency features. A multi-frequency mixing attention module is further leveraged to aggregate these local high-frequency details with global low-frequency contexts for enhanced temporal comprehension. Additionally, to tailor Vid-LLMs to this innovative mechanism, we introduce a set of training strategies aimed at bolstering both temporal grounding and detailed temporal reasoning capabilities. Furthermore, we establish FineAction-CGR, a benchmark specifically devised to assess the ability of Vid-LLMs to process fine-grained temporal understanding tasks. Comprehensive experiments demonstrate the superiority of our mechanism across both existing public video understanding benchmarks and our proposed FineAction-CGR.

[100] TIPS Over Tricks: Simple Prompts for Effective Zero-shot Anomaly Detection cs.CVPDF

Alireza Salehi, Ehsan Karami, Sepehr Noey, Sahand Noey, Makoto Yamada

TL;DR: 本文提出了一种基于空间感知视觉语言模型TIPS的零样本异常检测方法，通过解耦提示词（固定用于图像级检测、可学习用于像素级定位）和将局部证据注入全局评分，有效解决了CLIP模型在空间错位和对细粒度异常敏感度不足的问题，在七个工业数据集上显著提升了图像级和像素级异常检测性能。

Details

Motivation: 零样本异常检测（ZSAD）在目标域正常数据缺失时依赖视觉语言模型（VLMs），但CLIP模型存在空间错位和对细粒度异常敏感度弱的问题，先前工作主要通过复杂辅助模块补偿，却忽视了主干网络的选择。

Result: 在七个工业数据集上，该方法相比基线在图像级性能提升1.1-3.9%，像素级提升1.5-6.9%，实现了强泛化能力和简洁架构。

Insight: 创新点在于重新审视主干网络，采用空间感知训练的TIPS模型，并通过解耦提示词设计及局部-全局特征融合策略，无需CLIP特定技巧即可显著提升性能，为基于VLMs的零样本异常检测提供了更简单有效的解决方案。

Abstract: Anomaly detection identifies departures from expected behavior in safety-critical settings. When target-domain normal data are unavailable, zero-shot anomaly detection (ZSAD) leverages vision-language models (VLMs). However, CLIP’s coarse image-text alignment limits both localization and detection due to (i) spatial misalignment and (ii) weak sensitivity to fine-grained anomalies; prior work compensates with complex auxiliary modules yet largely overlooks the choice of backbone. We revisit the backbone and use TIPS-a VLM trained with spatially aware objectives. While TIPS alleviates CLIP’s issues, it exposes a distributional gap between global and local features. We address this with decoupled prompts-fixed for image-level detection and learnable for pixel-level localization-and by injecting local evidence into the global score. Without CLIP-specific tricks, our TIPS-based pipeline improves image-level performance by 1.1-3.9% and pixel-level by 1.5-6.9% across seven industrial datasets, delivering strong generalization with a lean architecture. Code is available at github.com/AlirezaSalehy/Tipsomaly.

[101] Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentation cs.CVPDF

Haichao Jiang, Tianming Liang, Wei-Shi Zheng, Jian-Fang Hu

TL;DR: 本文提出了Refer-Agent，一个用于指代视频目标分割（RVOS）的协作多智能体系统。该系统通过交替的推理-反思机制，将复杂的RVOS任务分解为逐步推理过程，并引入从粗到精的帧选择、动态焦点布局和链式反思等策略，以提升分割精度和系统灵活性。

Details

Motivation: 现有RVOS方法主要依赖对多模态大语言模型（MLLMs）的大规模监督微调（SFT），存在数据依赖性强、可扩展性差的问题；而零样本方法性能又显著落后。本文旨在设计一个兼具高性能与灵活性、无需微调即可快速集成新MLLM的解决方案。

Result: 在五个具有挑战性的基准测试上进行的广泛实验表明，Refer-Agent显著超越了包括基于SFT的模型和零样本方法在内的最先进（SOTA）方法。

Insight: 创新点在于将RVOS任务构建为协作多智能体系统，并设计了交替的推理-反思机制。具体包括：1）从粗到精的帧选择策略确保视觉多样性；2）动态焦点布局自适应调整视觉关注区域；3）链式反思机制通过提问者-应答者对生成自我反思链，验证中间结果并优化后续推理。该系统无需微调即可快速集成新MLLMs，提升了方法的通用性和可扩展性。

Abstract: Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs). However, this paradigm suffers from heavy data dependence and limited scalability against the rapid evolution of MLLMs. Although recent zero-shot approaches offer a flexible alternative, their performance remains significantly behind SFT-based methods, due to the straightforward workflow designs. To address these limitations, we propose \textbf{Refer-Agent}, a collaborative multi-agent system with alternating reasoning-reflection mechanisms. This system decomposes RVOS into step-by-step reasoning process. During reasoning, we introduce a Coarse-to-Fine frame selection strategy to ensure the frame diversity and textual relevance, along with a Dynamic Focus Layout that adaptively adjusts the agent’s visual focus. Furthermore, we propose a Chain-of-Reflection mechanism, which employs a Questioner-Responder pair to generate a self-reflection chain, enabling the system to verify intermediate results and generates feedback for next-round reasoning refinement. Extensive experiments on five challenging benchmarks demonstrate that Refer-Agent significantly outperforms state-of-the-art methods, including both SFT-based models and zero-shot approaches. Moreover, Refer-Agent is flexible and enables fast integration of new MLLMs without any additional fine-tuning costs. Code will be released.

[102] A Lightweight Library for Energy-Based Joint-Embedding Predictive Architectures cs.CV | cs.AIPDF

Basile Terver, Randall Balestriero, Megi Dervishi, David Fan, Quentin Garrido

TL;DR: 本文介绍了EB-JEPA，一个用于基于能量的联合嵌入预测架构（JEPA）的开源库，旨在通过表示空间预测而非像素空间预测来学习表示和世界模型，避免生成建模的缺陷。该库提供了模块化、独立的实现，展示了从图像级自监督学习到视频时序建模，再到动作条件世界模型的迁移应用，每个示例均设计为可在单GPU上数小时内完成训练，便于研究和教育。

Details

Motivation: 解决在自监督学习中，如何有效学习语义丰富的表示以适用于下游任务，同时避免生成模型在像素空间预测中的复杂性，并将图像表示学习技术扩展到视频时序建模和动作条件世界模型领域。

Result: 在CIFAR-10上对JEPA组件进行消融实验，表示探针达到91%的准确率；在Moving MNIST上展示多步预测示例，验证了时序建模的可扩展性；在Two Rooms导航任务中，动作条件世界模型实现了97%的规划成功率。

Insight: 创新点在于提供了一个轻量级、模块化的开源库，将基于能量的JEPA框架统一应用于图像、视频和世界模型学习，通过表示空间预测规避生成模型缺陷，并强调正则化组件对防止表示崩溃的关键作用，促进了自监督学习技术的可访问性和可复现性。

Abstract: We present EB-JEPA, an open-source library for learning representations and world models using Joint-Embedding Predictive Architectures (JEPAs). JEPAs learn to predict in representation space rather than pixel space, avoiding the pitfalls of generative modeling while capturing semantically meaningful features suitable for downstream tasks. Our library provides modular, self-contained implementations that illustrate how representation learning techniques developed for image-level self-supervised learning can transfer to video, where temporal dynamics add complexity, and ultimately to action-conditioned world models, where the model must additionally learn to predict the effects of control inputs. Each example is designed for single-GPU training within a few hours, making energy-based self-supervised learning accessible for research and education. We provide ablations of JEA components on CIFAR-10. Probing these representations yields 91% accuracy, indicating that the model learns useful features. Extending to video, we include a multi-step prediction example on Moving MNIST that demonstrates how the same principles scale to temporal modeling. Finally, we show how these representations can drive action-conditioned world models, achieving a 97% planning success rate on the Two Rooms navigation task. Comprehensive ablations reveal the critical importance of each regularization component for preventing representation collapse. Code is available at https://github.com/facebookresearch/eb_jepa.

[103] KTV: Keyframes and Key Tokens Selection for Efficient Training-Free Video LLMs cs.CVPDF

Baiyang Song, Jun Peng, Yuxin Zhang, Guangyao Chen, Feidiao Yang

TL;DR: 本文提出了一种名为KTV的无训练视频理解框架，通过两阶段方法（关键帧选择和关键视觉令牌选择）来减少视频处理中的视觉冗余和计算开销，从而高效利用预训练视觉语言模型进行视频理解。

Details

Motivation: 解决无训练视频理解中存在的视觉冗余严重、计算开销高以及现有关键帧选择方法（如基于CLIP相似度的方法）可能产生偏差并忽略关键帧的问题。

Result: 在Multiple-Choice VideoQA任务上的大量实验表明，KTV在MLVU-Test基准测试上达到了44.8%的准确率，同时使用的视觉令牌数量显著减少（例如，对于60分钟10800帧的视频仅使用504个视觉令牌），超越了最先进的无训练基线方法，并在某些基准上超过了部分基于训练的方法。

Insight: 创新点在于提出了一个两阶段框架：首先通过聚类帧级视觉特征进行与问题无关的关键帧选择，以减少时间冗余；其次基于令牌重要性和冗余性对每个关键帧进行关键视觉令牌选择，以减少输入LLM的令牌数量。从客观角度看，该方法通过结合帧级和令牌级的双重选择机制，在保持视频理解效果的同时显著提升了计算效率。

Abstract: Training-free video understanding leverages the strong image comprehension capabilities of pre-trained vision language models (VLMs) by treating a video as a sequence of static frames, thus obviating the need for costly video-specific training. However, this paradigm often suffers from severe visual redundancy and high computational overhead, especially when processing long videos. Crucially, existing keyframe selection strategies, especially those based on CLIP similarity, are prone to biases and may inadvertently overlook critical frames, resulting in suboptimal video comprehension. To address these significant challenges, we propose \textbf{KTV}, a novel two-stage framework for efficient and effective training-free video understanding. In the first stage, KTV performs question-agnostic keyframe selection by clustering frame-level visual features, yielding a compact, diverse, and representative subset of frames that mitigates temporal redundancy. In the second stage, KTV applies key visual token selection, pruning redundant or less informative tokens from each selected keyframe based on token importance and redundancy, which significantly reduces the number of tokens fed into the LLM. Extensive experiments on the Multiple-Choice VideoQA task demonstrate that KTV outperforms state-of-the-art training-free baselines while using significantly fewer visual tokens, \emph{e.g.}, only 504 visual tokens for a 60-min video with 10800 frames, achieving $44.8%$ accuracy on the MLVU-Test benchmark. In particular, KTV also exceeds several training-based approaches on certain benchmarks.

[104] Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosis cs.CV | physics.med-phPDF

Lu Zhang, Huizhen Yu, Zuowei Wang, Fu Gui, Yatu Guo

TL;DR: 该论文提出了一种用于视网膜疾病诊断的准多模态病理特征学习框架。该框架通过合成多模态数据（包括眼底荧光血管造影、多光谱成像和显著性图）并学习模态特异性表征，然后进行跨模态自适应校准与融合，以提升分类和分级任务的性能。

Details

Motivation: 解决眼科实践中多模态诊断面临的数据异质性、潜在侵入性、配准复杂性等挑战，旨在构建一个统一的多模态数据合成与融合框架，以提升视网膜疾病诊断的准确性和效率。

Result: 在两个公共数据集上的实验表明，该方法在多标签分类（F1分数：0.683，AUC：0.953）和糖尿病视网膜病变分级（准确率：0.842，Kappa：0.861）任务上优于现有最先进方法。

Insight: 创新点在于提出了一个集成了数据合成（生成准多模态数据以弥补真实多模态数据的不足）与自适应特征校准/融合的统一学习框架。其方法通过并行学习模态特异性病理特征并进行跨模态信息修剪与灵活集成，为医学影像分析提供了一个可扩展的增强与融合范式。

Abstract: Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data heterogeneity, potential invasiveness, registration complexity, and so on. As such, a unified framework that integrates multimodal data synthesis and fusion is proposed for retinal disease classification and grading. Specifically, the synthesized multimodal data incorporates fundus fluorescein angiography (FFA), multispectral imaging (MSI), and saliency maps that emphasize latent lesions as well as optic disc/cup regions. Parallel models are independently trained to learn modality-specific representations that capture cross-pathophysiological signatures. These features are then adaptively calibrated within and across modalities to perform information pruning and flexible integration according to downstream tasks. The proposed learning system is thoroughly interpreted through visualizations in both image and feature spaces. Extensive experiments on two public datasets demonstrated the superiority of our approach over state-of-the-art ones in the tasks of multi-label classification (F1-score: 0.683, AUC: 0.953) and diabetic retinopathy grading (Accuracy:0.842, Kappa: 0.861). This work not only enhances the accuracy and efficiency of retinal disease screening but also offers a scalable framework for data augmentation across various medical imaging modalities.

[105] Multi-Objective Optimization for Synthetic-to-Real Style Transfer cs.CVPDF

Estelle Chigot, Thomas Oberlin, Manon Huguenin, Dennis Wilson

TL;DR: 该论文提出了一种使用多目标遗传算法优化合成到真实风格迁移流水线的方法，以解决语义分割网络因合成图像与真实图像之间的域差距而性能下降的问题。该方法通过平衡结构一致性和风格相似性来优化风格迁移操作符的组合与顺序，并利用高效的配对图像度量进行快速评估，最终在GTA5到Cityscapes和ACDC的域适应任务中验证了其有效性。

Details

Motivation: 解决语义分割网络因缺乏大量真实标注数据而依赖合成图像训练时，因域差距导致的性能下降问题，通过优化风格迁移流水线来弥合合成与真实图像之间的差异。

Result: 在合成到真实域适应标准数据集（GTA5到Cityscapes和ACDC，特别是恶劣条件）上，通过进化算法优化后的流水线在分割性能上表现出色，能够生成多样化的增强流水线以适应不同目标。

Insight: 创新点在于将风格迁移问题形式化为适合进化优化的序列问题，并研究了高效的配对图像度量以实现在大规模组合搜索空间中的可行搜索，这为自动化数据增强流水线设计提供了新思路。

Abstract: Semantic segmentation networks require large amounts of pixel-level annotated data, which are costly to obtain for real-world images. Computer graphics engines can generate synthetic images alongside their ground-truth annotations. However, models trained on such images can perform poorly on real images due to the domain gap between real and synthetic images. Style transfer methods can reduce this difference by applying a realistic style to synthetic images. Choosing effective data transformations and their sequence is difficult due to the large combinatorial search space of style transfer operators. Using multi-objective genetic algorithms, we optimize pipelines to balance structural coherence and style similarity to target domains. We study the use of paired-image metrics on individual image samples during evolution to enable rapid pipeline evaluation, as opposed to standard distributional metrics that require the generation of many images. After optimization, we evaluate the resulting Pareto front using distributional metrics and segmentation performance. We apply this approach to standard datasets in synthetic-to-real domain adaptation: from the video game GTA5 to real image datasets Cityscapes and ACDC, focusing on adverse conditions. Results demonstrate that evolutionary algorithms can propose diverse augmentation pipelines adapted to different objectives. The contribution of this work is the formulation of style transfer as a sequencing problem suitable for evolutionary optimization and the study of efficient metrics that enable feasible search in this space. The source code is available at: https://github.com/echigot/MOOSS.

[106] SPWOOD: Sparse Partial Weakly-Supervised Oriented Object Detection cs.CVPDF

Wei Zhang, Xiang Liu, Ningjing Liu, Mingxin Liu, Wei Liao

TL;DR: 本文提出了首个稀疏部分弱监督的旋转目标检测框架SPWOOD，旨在仅利用少量稀疏弱标注数据和大量未标注数据，以降低遥感图像中密集目标分布和多样类别带来的高昂标注成本。该框架通过SOS-Student模型分离背景与目标并学习方向与尺度信息，结合多级伪标签过滤策略和稀疏分区方法，在DOTA和DIOR数据集上取得了显著性能提升。

Details

Motivation: 解决遥感领域旋转目标检测中因目标密集、类别多样导致标注成本过高的问题，通过利用稀疏弱标注和未标注数据来减少对强标注的依赖。

Result: 在DOTA和DIOR数据集上的大量实验表明，该框架相比传统旋转目标检测方法（全监督、半监督、弱监督等）取得了显著性能增益，提供了高成本效益的解决方案。

Insight: 创新点包括：设计SOS-Student模型从稀疏弱标注中学习方向与尺度信息；构建基于模型多层预测的多级伪标签过滤策略；提出确保类别公平处理的稀疏分区方法。这些方法可借鉴于其他弱监督或数据稀缺的视觉任务。

Abstract: A consistent trend throughout the research of oriented object detection has been the pursuit of maintaining comparable performance with fewer and weaker annotations. This is particularly crucial in the remote sensing domain, where the dense object distribution and a wide variety of categories contribute to prohibitively high costs. Based on the supervision level, existing oriented object detection algorithms can be broadly grouped into fully supervised, semi-supervised, and weakly supervised methods. Within the scope of this work, we further categorize them to include sparsely supervised and partially weakly-supervised methods. To address the challenges of large-scale labeling, we introduce the first Sparse Partial Weakly-Supervised Oriented Object Detection framework, designed to efficiently leverage only a few sparse weakly-labeled data and plenty of unlabeled data. Our framework incorporates three key innovations: (1) We design a Sparse-annotation-Orientation-and-Scale-aware Student (SOS-Student) model to separate unlabeled objects from the background in a sparsely-labeled setting, and learn orientation and scale information from orientation-agnostic or scale-agnostic weak annotations. (2) We construct a novel Multi-level Pseudo-label Filtering strategy that leverages the distribution of model predictions, which is informed by the model’s multi-layer predictions. (3) We propose a unique sparse partitioning approach, ensuring equal treatment for each category. Extensive experiments on the DOTA and DIOR datasets show that our framework achieves a significant performance gain over traditional oriented object detection methods mentioned above, offering a highly cost-effective solution. Our code is publicly available at https://github.com/VisionXLab/SPWOOD.

[107] MM-SCALE: Grounded Multimodal Moral Reasoning via Scalar Judgment and Listwise Alignment cs.CV | cs.HCPDF

Eunkyu Park, Wesley Hanwen Deng, Cheyon Jin, Matheus Kunzler Maldaner, Jordan Wheeler

TL;DR: 本文提出了MM-SCALE数据集，通过5点标量评分和显式模态基础来对齐视觉语言模型（VLMs）与人类道德偏好，以解决VLMs在多模态和社会模糊情境中道德判断能力不足的问题。

Details

Motivation: 现有方法通常依赖二元或成对监督，难以捕捉人类道德推理的连续性和多元性，因此需要更细粒度的监督信号。

Result: 实验表明，在MM-SCALE上微调的VLMs比使用二元信号训练的模型实现了更高的排序保真度和更稳定的安全校准。

Insight: 创新点在于从离散监督转向标量监督，提供了更丰富的对齐信号和更精细的多模态道德推理校准；通过列表式偏好优化和基础推理标注，增强了模型对道德场景的理解和排名能力。

Abstract: Vision-Language Models (VLMs) continue to struggle to make morally salient judgments in multimodal and socially ambiguous contexts. Prior works typically rely on binary or pairwise supervision, which often fail to capture the continuous and pluralistic nature of human moral reasoning. We present MM-SCALE (Multimodal Moral Scale), a large-scale dataset for aligning VLMs with human moral preferences through 5-point scalar ratings and explicit modality grounding. Each image-scenario pair is annotated with moral acceptability scores and grounded reasoning labels by humans using an interface we tailored for data collection, enabling listwise preference optimization over ranked scenario sets. By moving from discrete to scalar supervision, our framework provides richer alignment signals and finer calibration of multimodal moral reasoning. Experiments show that VLMs fine-tuned on MM-SCALE achieve higher ranking fidelity and more stable safety calibration than those trained with binary signals.

[108] Efficient Sequential Neural Network with Spatial-Temporal Attention and Linear LSTM for Robust Lane Detection Using Multi-Frame Images cs.CV | cs.AI | cs.LG | eess.IVPDF

Sandeep Patil, Yongqi Dong, Haneen Farah, Hans Hellendoorn

TL;DR: 该论文提出了一种新颖的序列神经网络模型，该模型集成了时空注意力机制和线性LSTM，用于利用多帧图像进行鲁棒的车道线检测。模型基于标准的编码器-解码器结构，旨在关注车道线的关键特征并利用连续图像帧之间显著的时空相关性，以应对严重遮挡和眩光等挑战性场景。

Details

Motivation: 当前的车道线检测方法，特别是基于视觉的方法，缺乏在提供准确、鲁棒且实时兼容的检测方面的通用性，常常忽略图像的关键区域及其时空显著性，导致在困难场景下性能不佳。

Result: 模型在三个大规模开源数据集上进行了训练和评估。大量实验表明，该模型在各种测试场景中表现出色，超越了最先进的方法。此外，得益于时空注意力机制，所开发的序列神经网络模型与基线序列模型相比，参数更少，乘积累加运算量更低，突显了其计算效率。

Insight: 论文的核心创新点在于将时空注意力机制与序列神经网络（结合线性LSTM）相结合，以增强对车道线关键特征和连续帧间时空相关性的建模。从客观角度看，这种设计不仅旨在提升检测的鲁棒性，还通过注意力机制实现了模型轻量化，在性能和效率之间取得了平衡，这对于自动驾驶的实际部署具有借鉴意义。

Abstract: Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and challenging traffic scenarios. Current methods lack versatility in delivering accurate, robust, and real-time compatible lane detection, especially vision-based methods often neglect critical regions of the image and their spatial-temporal (ST) salience, leading to poor performance in difficult circumstances such as serious occlusion and dazzle lighting. This study introduces a novel sequential neural network model with a spatial-temporal attention mechanism to focus on key features of lane lines and exploit salient ST correlations among continuous image frames. The proposed model, built on a standard encoder-decoder structure and common neural network backbones, is trained and evaluated on three large-scale open-source datasets. Extensive experiments demonstrate the strength and robustness of the proposed model, outperforming state-of-the-art methods in various testing scenarios. Furthermore, with the ST attention mechanism, the developed sequential neural network models exhibit fewer parameters and reduced Multiply-Accumulate Operations (MACs) compared to baseline sequential models, highlighting their computational efficiency. Relevant data, code, and models are released at https://doi.org/10.4121/4619cab6-ae4a-40d5-af77-582a77f3d821.

[109] RegionReasoner: Region-Grounded Multi-Round Visual Reasoning cs.CVPDF

Wenfang Sun, Hao Chen, Yingjun Du, Yefeng Zheng, Cees G. M. Snoek

TL;DR: 本文提出RegionReasoner，一个基于强化学习的多轮视觉推理框架，通过要求每个推理步骤显式引用对应的参考边界框来实现grounded reasoning，并利用全局-局部一致性奖励保持语义连贯性。同时，作者引入了一个新的多轮视觉推理基准RegionDial-Bench，用于在检测和分割任务上系统评估迭代推理能力。

Details

Motivation: 现有的大视觉语言模型在视觉推理方面取得了显著进展，但大多依赖单步或纯文本推理，限制了其在多个视觉上下文中迭代细化理解的能力。

Result: 在检测和分割任务上的实验表明，RegionReasoner-7B模型结合RegionDial-Bench基准，显著提高了多轮推理准确性、空间定位精度和全局-局部一致性，为该新兴研究方向建立了强有力的基线。

Insight: 创新点在于提出了一个结合定位保真度和全局-局部语义对齐的结构化奖励强化学习框架，以及一个专门用于多轮视觉推理评估的新基准，强调推理轨迹与视觉区域的显式关联和跨步骤的一致性验证。

Abstract: Large vision-language models have achieved remarkable progress in visual reasoning, yet most existing systems rely on single-step or text-only reasoning, limiting their ability to iteratively refine understanding across multiple visual contexts. To address this limitation, we introduce a new multi-round visual reasoning benchmark with training and test sets spanning both detection and segmentation tasks, enabling systematic evaluation under iterative reasoning scenarios. We further propose RegionReasoner, a reinforcement learning framework that enforces grounded reasoning by requiring each reasoning trace to explicitly cite the corresponding reference bounding boxes, while maintaining semantic coherence via a global-local consistency reward. This reward extracts key objects and nouns from both global scene captions and region-level captions, aligning them with the reasoning trace to ensure consistency across reasoning steps. RegionReasoner is optimized with structured rewards combining grounding fidelity and global-local semantic alignment. Experiments on detection and segmentation tasks show that RegionReasoner-7B, together with our newly introduced benchmark RegionDial-Bench, considerably improves multi-round reasoning accuracy, spatial grounding precision, and global-local consistency, establishing a strong baseline for this emerging research direction.

[110] Edge-Optimized Vision-Language Models for Underground Infrastructure Assessment cs.CVPDF

Johny J. Lopez, Md Meftahul Ferdaus, Mahdi Abdelguerfi

TL;DR: 本文提出了一种用于地下基础设施（如下水道和涵洞系统）缺陷检测与总结的两阶段端到端流水线。该方案结合了轻量级RAPID-SCAN分割模型与经过微调的视觉语言模型（VLM），并部署在边缘计算平台上，旨在实现实时、自动生成人类可读的缺陷摘要。

Details

Motivation: 解决地下基础设施自主巡检中，尽管机器人平台能检测结构缺陷，但在资源受限的边缘设备上自动生成可读摘要仍具挑战性的问题。

Result: RAPID-SCAN分割模型在0.64M参数量下达到0.834 F1分数；完整流水线在移动机器人平台上进行了真实场景部署与评估，通过后训练量化和硬件优化显著减少了模型大小与推理延迟，且未损害摘要质量。

Insight: 创新点包括：1) 提出轻量级两阶段流水线（RAPID-SCAN分割 + 微调Phi-3.5 VLM生成摘要），实现端到端缺陷总结；2) 引入经人工验证的数据集用于VLM微调与评估；3) 通过后训练量化与硬件特定优化，在边缘设备上实现实时性能，为可扩展的自主巡检系统提供了可行方案。

Abstract: Autonomous inspection of underground infrastructure, such as sewer and culvert systems, is critical to public safety and urban sustainability. Although robotic platforms equipped with visual sensors can efficiently detect structural deficiencies, the automated generation of human-readable summaries from these detections remains a significant challenge, especially on resource-constrained edge devices. This paper presents a novel two-stage pipeline for end-to-end summarization of underground deficiencies, combining our lightweight RAPID-SCAN segmentation model with a fine-tuned Vision-Language Model (VLM) deployed on an edge computing platform. The first stage employs RAPID-SCAN (Resource-Aware Pipeline Inspection and Defect Segmentation using Compact Adaptive Network), achieving 0.834 F1-score with only 0.64M parameters for efficient defect segmentation. The second stage utilizes a fine-tuned Phi-3.5 VLM that generates concise, domain-specific summaries in natural language from the segmentation outputs. We introduce a curated dataset of inspection images with manually verified descriptions for VLM fine-tuning and evaluation. To enable real-time performance, we employ post-training quantization with hardware-specific optimization, achieving significant reductions in model size and inference latency without compromising summarization quality. We deploy and evaluate our complete pipeline on a mobile robotic platform, demonstrating its effectiveness in real-world inspection scenarios. Our results show the potential of edge-deployable integrated AI systems to bridge the gap between automated defect detection and actionable insights for infrastructure maintenance, paving the way for more scalable and autonomous inspection solutions.

[111] LIVE: Long-horizon Interactive Video World Modeling cs.CVPDF

Junchao Huang, Ziyang Ye, Xinting Hu, Tianyu He, Guiyu Zhang

TL;DR: 本文提出了LIVE（Long-horizon Interactive Video world modEl），一种用于长时程交互视频世界建模的新方法。它通过引入循环一致性目标来限制误差累积，无需依赖教师模型蒸馏，从而在长时程视频生成中实现了稳定且高质量的结果。

Details

Motivation: 现有自回归视频世界模型在短时程预测中有效，但在长时程生成中，微小的预测误差会随时间累积，导致性能下降。先前方法通过引入预训练教师模型和序列级分布匹配来缓解，但这增加了计算成本且无法阻止超出训练时长的误差传播。

Result: 实验表明，LIVE在长时程基准测试中达到了最先进的性能，能够生成远超训练时长的稳定、高质量视频。

Insight: 核心创新点在于通过前向展开和反向生成过程的循环一致性目标来显式约束长时程误差传播，这避免了教师蒸馏的需求。此外，论文提供了统一不同方法的视角并引入了渐进式训练课程以稳定训练。

Abstract: Autoregressive video world models predict future visual observations conditioned on actions. While effective over short horizons, these models often struggle with long-horizon generation, as small prediction errors accumulate over time. Prior methods alleviate this by introducing pre-trained teacher models and sequence-level distribution matching, which incur additional computational cost and fail to prevent error propagation beyond the training horizon. In this work, we propose LIVE, a Long-horizon Interactive Video world modEl that enforces bounded error accumulation via a novel cycle-consistency objective, thereby eliminating the need for teacher-based distillation. Specifically, LIVE first performs a forward rollout from ground-truth frames and then applies a reverse generation process to reconstruct the initial state. The diffusion loss is subsequently computed on the reconstructed terminal state, providing an explicit constraint on long-horizon error propagation. Moreover, we provide an unified view that encompasses different approaches and introduce progressive training curriculum to stabilize training. Experiments demonstrate that LIVE achieves state-of-the-art performance on long-horizon benchmarks, generating stable, high-quality videos far beyond training rollout lengths.

[112] See-through: Single-image Layer Decomposition for Anime Characters cs.CV | cs.GRPDF

Jian Lin, Chengze Li, Haoyun Qin, Kwun Wang Chan, Yanghua Jin

TL;DR: 本文提出一个自动化框架，将静态动漫角色插图转换为可操控的2.5D模型。该方法通过单张图像分解为语义独立、完全修复的图层，并推断绘制顺序，解决了传统专业流程中繁琐的手动分割和遮挡区域艺术性“幻觉”问题。

Details

Motivation: 当前专业动画制作流程需要大量手动分割和艺术化想象来补全遮挡区域以实现角色运动，过程繁琐且依赖人工。本文旨在自动化这一过程，通过单张图像直接生成可动态操控的图层模型。

Result: 方法在从商业Live2D模型生成的高质量监督数据上进行训练，实现了像素级语义和隐藏几何的捕获。实验表明，该方法能生成高保真、可操控的模型，适用于专业的实时动画应用。

Insight: 创新点包括：1）提出可扩展的数据生成引擎，利用商业Live2D模型自举高质量监督数据；2）结合基于扩散的身体部位一致性模块（确保全局几何连贯性）与像素级伪深度推断机制，有效解析动漫角色复杂分层结构（如交错发丝）。

Abstract: We introduce a framework that automates the transformation of static anime illustrations into manipulatable 2.5D models. Current professional workflows require tedious manual segmentation and the artistic ``hallucination’’ of occluded regions to enable motion. Our approach overcomes this by decomposing a single image into fully inpainted, semantically distinct layers with inferred drawing orders. To address the scarcity of training data, we introduce a scalable engine that bootstraps high-quality supervision from commercial Live2D models, capturing pixel-perfect semantics and hidden geometry. Our methodology couples a diffusion-based Body Part Consistency Module, which enforces global geometric coherence, with a pixel-level pseudo-depth inference mechanism. This combination resolves the intricate stratification of anime characters, e.g., interleaving hair strands, allowing for dynamic layer reconstruction. We demonstrate that our approach yields high-fidelity, manipulatable models suitable for professional, real-time animation applications.

[113] Zero-shot large vision-language model prompting for automated bone identification in paleoradiology x-ray archives cs.CV | cs.AIPDF

Owen Dong, Lily Gao, Manish Kota, Bennett A. Landmana, Jelena Bekvalac

TL;DR: 本文提出了一种零样本提示策略，利用先进的大型视觉语言模型（LVLM）自动识别古放射学X射线档案中的主要骨骼、投影视图和偏侧性，以解决该领域图像异质性强、人工标注效率低的问题。

Details

Motivation: 古放射学X射线图像存在骨骼错位、摆放随意、标记缺失以及年龄、性别、设备等因素导致的高变异性，使得基于内容的图像导航（如筛选特定投影视图）耗时且困难，成为专家分析的瓶颈。

Result: 在由专家古放射学家审核的100张随机图像样本上，该系统实现了92%的主要骨骼识别准确率、80%的投影视图识别准确率和100%的偏侧性识别准确率，并对模糊案例设置了低或中置信度标志。

Insight: 创新点在于将LVLM的零样本能力应用于高度异质的古放射学图像分析，通过精心设计的提示工程和结构化JSON输出流程，实现了高效的自动化标注，为大型数据集的关键词开发和工作流导航提供了新途径。

Abstract: Paleoradiology, the use of modern imaging technologies to study archaeological and anthropological remains, offers new windows on millennial scale patterns of human health. Unfortunately, the radiographs collected during field campaigns are heterogeneous: bones are disarticulated, positioning is ad hoc, and laterality markers are often absent. Additionally, factors such as age at death, age of bone, sex, and imaging equipment introduce high variability. Thus, content navigation, such as identifying a subset of images with a specific projection view, can be time consuming and difficult, making efficient triaging a bottleneck for expert analysis. We report a zero shot prompting strategy that leverages a state of the art Large Vision Language Model (LVLM) to automatically identify the main bone, projection view, and laterality in such images. Our pipeline converts raw DICOM files to bone windowed PNGs, submits them to the LVLM with a carefully engineered prompt, and receives structured JSON outputs, which are extracted and formatted onto a spreadsheet in preparation for validation. On a random sample of 100 images reviewed by an expert board certified paleoradiologist, the system achieved 92% main bone accuracy, 80% projection view accuracy, and 100% laterality accuracy, with low or medium confidence flags for ambiguous cases. These results suggest that LVLMs can substantially accelerate code word development for large paleoradiology datasets, allowing for efficient content navigation in future anthropology workflows.

[114] RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Images cs.CVPDF

Mishal Fatima, Shashank Agnihotri, Kanchana Vaishnavi Gandikota, Michael Moeller, Margret Keuper

TL;DR: 本文介绍了RAWDet-7，一个用于量化RAW图像上目标检测与描述的大规模多场景基准数据集。该数据集包含约2.5万张训练图像和7.6万张测试图像，覆盖多种相机、光照和环境，并按照MS-COCO和LVIS标准对七个目标类别进行了密集标注。此外，它还提供了从对应高分辨率sRGB图像中提取的目标级描述，支持在模拟4位、6位和8位量化条件下评估目标检测性能、描述质量与细节，以及低比特RAW图像处理的泛化能力。

Details

Motivation: 大多数视觉模型在针对人类感知优化的ISP（图像信号处理器）管道处理的RGB图像上进行训练，这可能会丢弃对机器推理有用的传感器级信息。RAW图像保留了未处理的场景数据，使模型能够利用更丰富的线索进行目标检测和描述，捕捉在已处理图像中经常丢失的细粒度细节、空间关系和上下文信息。

Result: 论文通过引入RAWDet-7数据集，为研究提供了基准，允许在模拟4位、6位和8位量化条件下进行评估，反映了真实的传感器限制，并可用于研究检测性能、描述质量与细节以及低比特RAW图像处理中的泛化能力。

Insight: 创新点在于构建了一个专门针对量化RAW图像的多场景基准数据集，将目标检测与描述任务结合，并模拟了低比特量化条件，这有助于探索在保留传感器级原始信息的前提下，模型性能与信息压缩之间的权衡，为开发更高效的机器视觉系统提供了数据基础和研究方向。

Abstract: Most vision models are trained on RGB images processed through ISP pipelines optimized for human perception, which can discard sensor-level information useful for machine reasoning. RAW images preserve unprocessed scene data, enabling models to leverage richer cues for both object detection and object description, capturing fine-grained details, spatial relationships, and contextual information often lost in processed images. To support research in this domain, we introduce RAWDet-7, a large-scale dataset of ~25k training and 7.6k test RAW images collected across diverse cameras, lighting conditions, and environments, densely annotated for seven object categories following MS-COCO and LVIS conventions. In addition, we provide object-level descriptions derived from the corresponding high-resolution sRGB images, facilitating the study of object-level information preservation under RAW image processing and low-bit quantization. The dataset allows evaluation under simulated 4-bit, 6-bit, and 8-bit quantization, reflecting realistic sensor constraints, and provides a benchmark for studying detection performance, description quality & detail, and generalization in low-bit RAW image processing. Dataset & code upon acceptance.

[115] FOVI: A biologically-inspired foveated interface for deep vision models cs.CV | cs.NE | q-bio.NCPDF

Nicholas M. Blauch, George A. Alvarez, Talia Konkle

TL;DR: 本文提出了一种受生物启发的凹视视觉接口（FOVI），模拟人眼视网膜和初级视觉皮层的变分辨率特性，将视网膜式传感器阵列转换为均匀密集的传感器流形，并引入基于k近邻的卷积操作。通过两种应用案例（端到端kNN卷积架构和基于DINOv3 ViT的凹视适配模型），在保持竞争力的性能的同时显著降低了计算成本，为高效的高分辨率第一人称视觉感知提供了新途径。

Details

Motivation: 人类视觉具有凹视特性，即分辨率在视野中心最高、周边较低，这种主动感知机制实现了效率与信息获取的平衡；而传统计算机视觉系统通常采用均匀分辨率处理图像，导致处理全视野高分辨率图像时计算效率低下。本文旨在借鉴生物视觉机制，设计一种高效的变分辨率视觉接口以解决这一挑战。

Result: 在实验中，提出的FOVI模型在保持竞争力的性能水平下，仅需非凹视基线模型的一小部分计算成本。具体结果未在摘要中详细说明，但提及了在高效处理高分辨率第一人称视觉任务上的应用潜力。

Insight: 创新点包括：1）受生物启发的凹视传感器流形转换机制，模拟视网膜到V1皮层的映射；2）基于k近邻的卷积操作（kNN-convolution）及核映射技术，实现了变分辨率数据的高效处理；3）结合低秩适配（LoRA）对现有视觉Transformer模型（如DINOv3 ViT）进行凹视化改造，为迁移现有模型提供了轻量级方案。

Abstract: Human vision is foveated, with variable resolution peaking at the center of a large field of view; this reflects an efficient trade-off for active sensing, allowing eye-movements to bring different parts of the world into focus with other parts of the world in context. In contrast, most computer vision systems encode the visual world at a uniform resolution, raising challenges for processing full-field high-resolution images efficiently. We propose a foveated vision interface (FOVI) based on the human retina and primary visual cortex, that reformats a variable-resolution retina-like sensor array into a uniformly dense, V1-like sensor manifold. Receptive fields are defined as k-nearest-neighborhoods (kNNs) on the sensor manifold, enabling kNN-convolution via a novel kernel mapping technique. We demonstrate two use cases: (1) an end-to-end kNN-convolutional architecture, and (2) a foveated adaptation of the foundational DINOv3 ViT model, leveraging low-rank adaptation (LoRA). These models provide competitive performance at a fraction of the computational cost of non-foveated baselines, opening pathways for efficient and scalable active sensing for high-resolution egocentric vision. Code and pre-trained models are available at https://github.com/nblauch/fovi and https://huggingface.co/fovi-pytorch.

[116] QVLA: Not All Channels Are Equal in Vision-Language-Action Model’s Quantization cs.CV | cs.ROPDF

Yuhao Xu, Yantai Yang, Zhenyang Fan, Yufan Liu, Yuming Li

TL;DR: 本文提出了QVLA，一种专为具身控制设计的动作中心化量化框架，通过逐通道比特分配策略，将量化与剪枝统一，显著压缩视觉-语言-动作模型的计算需求。

Details

Motivation: 解决视觉-语言-动作模型在资源受限机器人平台上部署时计算需求巨大的问题，指出现有基于大语言模型的均匀比特量化方法忽视动作偏差累积导致任务失败，缺乏针对VLA模型的系统量化分析。

Result: 在LIBERO基准测试中，OpenVLA-OFT量化版本仅需原模型29.2%的VRAM，保持98.9%的原始性能，速度提升1.49倍，性能比SmoothQuant方法提高22.6%。

Insight: 创新点在于提出动作空间敏感度驱动的逐通道比特分配策略，将量化与剪枝统一为全局优化框架；客观分析认为其核心贡献是建立了面向机器人任务的、考虑动作误差累积的量化新范式。

Abstract: The advent of Vision-Language-Action (VLA) models represents a significant leap for embodied intelligence, yet their immense computational demands critically hinder deployment on resource-constrained robotic platforms. Intuitively, low-bit quantization is a prevalent and preferred technique for large-scale model compression. However, we find that a systematic analysis of VLA model’s quantization is fundamentally lacking. We argue that naively applying uniform-bit quantization from Large Language Models (LLMs) to robotics is flawed, as these methods prioritize passive data fidelity while ignoring how minor action deviations compound into catastrophic task failures. To bridge this gap, we introduce QVLA, the first action-centric quantization framework specifically designed for embodied control. In a sharp departure from the rigid, uniform-bit quantization of LLM-based methods, QVLA introduces a highly granular, channel-wise bit allocation strategy. Its core mechanism is to directly measure the final action-space sensitivity when quantizing each individual channel to various bit-widths. This process yields a precise, per-channel importance metric that guides a global optimization, which elegantly unifies quantization and pruning (0-bit) into a single, cohesive framework. Extensive evaluations on different baselines demonstrate the superiority of our approach. In the LIBERO, the quantization version of OpenVLA-OFT with our method requires only 29.2% of the original model’s VRAM while maintaining 98.9% of its original performance and achieving a 1.49x speedup. This translates to a 22.6% performance improvement over the LLM-derived method SmoothQuant. Our work establishes a new, principled foundation for compressing VLA models in robotics, paving the way for deploying powerful, large-scale models on real-world hardware. Code will be released.

[117] 3D-Aware Implicit Motion Control for View-Adaptive Human Video Generation cs.CVPDF

Zhixue Fang, Xu He, Songlin Tang, Haoxian Zhang, Qingfeng Li

TL;DR: 本文提出了一种名为3DiMo的3D感知隐式运动控制方法，用于生成视角自适应的人类视频。该方法通过联合训练运动编码器与预训练视频生成器，将驱动帧蒸馏为紧凑、视角无关的运动token，并通过交叉注意力注入，实现了在保持运动保真度的同时支持灵活的文本驱动相机控制。

Details

Motivation: 现有的人类视频生成运动控制方法通常依赖2D姿态或显式3D参数模型（如SMPL），前者将运动绑定到驱动视角无法实现新视角合成，后者存在深度模糊和动态不准确等固有误差，会覆盖大规模视频生成器固有的强大3D感知能力。本文旨在从3D感知视角重新审视运动控制，提倡一种与生成器空间先验自然对齐的隐式、视角无关运动表示。

Result: 实验证实，3DiMo能够忠实地复现驱动运动，并支持灵活的文本驱动相机控制，在运动保真度和视觉质量上显著超越现有方法。

Insight: 创新点在于提出了一种隐式、视角无关的运动表示方法，通过联合训练和丰富的视角监督（单视角、多视角、移动相机视频）来增强3D感知，并利用SMPL仅进行早期初始化并通过退火策略逐步过渡到从数据和生成器先验中学习真实的3D空间运动理解，避免了外部重建约束的强加。

Abstract: Existing methods for human motion control in video generation typically rely on either 2D poses or explicit 3D parametric models (e.g., SMPL) as control signals. However, 2D poses rigidly bind motion to the driving viewpoint, precluding novel-view synthesis. Explicit 3D models, though structurally informative, suffer from inherent inaccuracies (e.g., depth ambiguity and inaccurate dynamics) which, when used as a strong constraint, override the powerful intrinsic 3D awareness of large-scale video generators. In this work, we revisit motion control from a 3D-aware perspective, advocating for an implicit, view-agnostic motion representation that naturally aligns with the generator’s spatial priors rather than depending on externally reconstructed constraints. We introduce 3DiMo, which jointly trains a motion encoder with a pretrained video generator to distill driving frames into compact, view-agnostic motion tokens, injected semantically via cross-attention. To foster 3D awareness, we train with view-rich supervision (i.e., single-view, multi-view, and moving-camera videos), forcing motion consistency across diverse viewpoints. Additionally, we use auxiliary geometric supervision that leverages SMPL only for early initialization and is annealed to zero, enabling the model to transition from external 3D guidance to learning genuine 3D spatial motion understanding from the data and the generator’s priors. Experiments confirm that 3DiMo faithfully reproduces driving motions with flexible, text-driven camera control, significantly surpassing existing methods in both motion fidelity and visual quality.

[118] Progressive Checkerboards for Autoregressive Multiscale Image Generation cs.CVPDF

David Eigen

TL;DR: 本文提出了一种基于渐进式棋盘格的多尺度自回归图像生成方法，通过固定顺序并行采样，在保持四叉树各层平衡的同时实现跨尺度和尺度内的有效条件建模，在ImageNet上以更少的采样步骤达到与同类SOTA自回归模型相当的性能。

Details

Motivation: 解决自回归图像生成中并行采样效率与序列条件依赖建模之间的矛盾，通过多尺度金字塔结构优化采样顺序，平衡并行性与依赖性。

Result: 在类别条件ImageNet数据集上，使用更少的采样步骤取得了与近期同类模型容量SOTA自回归系统竞争性的性能。

Insight: 创新点在于提出平衡的渐进式棋盘格采样顺序，实现跨尺度与尺度内联合条件建模；客观分析发现，在平衡设置下，只要总序列步数恒定，多种尺度放大因子均可取得相似效果，这为多尺度结构设计提供了灵活性。

Abstract: A key challenge in autoregressive image generation is to efficiently sample independent locations in parallel, while still modeling mutual dependencies with serial conditioning. Some recent works have addressed this by conditioning between scales in a multiscale pyramid. Others have looked at parallelizing samples in a single image using regular partitions or randomized orders. In this work we examine a flexible, fixed ordering based on progressive checkerboards for multiscale autoregressive image generation. Our ordering draws samples in parallel from evenly spaced regions at each scale, maintaining full balance in all levels of a quadtree subdivision at each step. This enables effective conditioning both between and within scales. Intriguingly, we find evidence that in our balanced setting, a wide range of scale-up factors lead to similar results, so long as the total number of serial steps is constant. On class-conditional ImageNet, our method achieves competitive performance compared to recent state-of-the-art autoregressive systems with like model capacity, using fewer sampling steps.

[119] Fast-Slow Efficient Training for Multimodal Large Language Models via Visual Token Pruning cs.CV | cs.LGPDF

Dingkun Zhang, Shuhan Qi, Yulin Wu, Xinyu Xiao, Xuan Wang

TL;DR: 本文提出了一种名为DualSpeed的快速-慢速训练框架，旨在解决多模态大语言模型（MLLMs）因视觉令牌数量庞大而导致的训练效率低下问题。该框架通过结合视觉令牌剪枝（VTP）来加速训练（快速模式），同时利用完整视觉序列训练（慢速模式）和自蒸馏技术来保持训练-推理一致性，从而在不降低性能的前提下显著提升训练速度。

Details

Motivation: 多模态大语言模型（MLLMs）因其巨大的模型规模和视觉令牌数量而面临严重的训练效率问题。现有高效训练方法主要关注减少模型大小或可训练参数，而本文则探索通过减少视觉令牌来提升训练效率的新方向。然而，在训练阶段直接应用视觉令牌剪枝（VTP）会导致训练-推理不匹配问题，即模型在推理完整视觉令牌序列时性能下降。

Result: 实验表明，DualSpeed框架在LLaVA-1.5模型上实现了2.1倍的训练加速，在LLaVA-NeXT模型上实现了4.0倍的训练加速，同时保持了超过99%的原始模型性能。

Insight: 论文的核心创新点在于提出了一个双模式训练框架（DualSpeed），通过快速模式（集成VTP）实现高效训练，慢速模式（使用完整序列）保证训练-推理一致性，并引入自蒸馏技术让慢速模式从快速模式中学习，从而兼顾效率与性能。这为解决MLLMs训练效率问题提供了一个新颖且有效的架构级解决方案。

Abstract: Multimodal Large Language Models (MLLMs) suffer from severe training inefficiency issue, which is associated with their massive model sizes and visual token numbers. Existing efforts in efficient training focus on reducing model sizes or trainable parameters. Inspired by the success of Visual Token Pruning (VTP) in improving inference efficiency, we are exploring another substantial research direction for efficient training by reducing visual tokens. However, applying VTP at the training stage results in a training-inference mismatch: pruning-trained models perform poorly when inferring on non-pruned full visual token sequences. To close this gap, we propose DualSpeed, a fast-slow framework for efficient training of MLLMs. The fast-mode is the primary mode, which incorporates existing VTP methods as plugins to reduce visual tokens, along with a mode isolator to isolate the model’s behaviors. The slow-mode is the auxiliary mode, where the model is trained on full visual sequences to retain training-inference consistency. To boost its training, it further leverages self-distillation to learn from the sufficiently trained fast-mode. Together, DualSpeed can achieve both training efficiency and non-degraded performance. Experiments show DualSpeed accelerates the training of LLaVA-1.5 by 2.1$\times$ and LLaVA-NeXT by 4.0$\times$, retaining over 99% performance. Code: https://github.com/dingkun-zhang/DualSpeed

[120] Continuous Control of Editing Models via Adaptive-Origin Guidance cs.CV | cs.GRPDF

Alon Wolf, Chen Katzir, Kfir Aberman, Or Patashnik

TL;DR: 本文提出了一种名为自适应原点引导（AdaOr）的方法，用于在基于扩散的编辑模型中实现连续控制编辑强度。该方法通过调整标准引导原点，使用身份条件自适应原点，确保从输入到编辑结果的平滑过渡，适用于图像和视频编辑任务。

Details

Motivation: 现有基于扩散的编辑模型缺乏平滑控制文本引导编辑强度的机制，标准分类器无关引导（CFG）在这些模型中无法实现输入与编辑结果之间的平滑过渡，因为无条件预测作为引导原点在低引导尺度下主导生成，并代表对输入内容的任意操作。

Result: 在图像和视频编辑任务上的评估表明，与当前基于滑块的编辑方法相比，AdaOr提供了更平滑和一致的控制，实现了从输入到编辑结果的连续过渡。

Insight: 创新点在于引入自适应原点引导（AdaOr），通过身份条件自适应原点调整标准引导原点，结合身份指令进行插值，实现编辑强度的细粒度控制，无需每次编辑的专门过程或依赖专用数据集，可借鉴于扩散模型的连续编辑应用。

Abstract: Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned generation, Classifier-Free Guidance (CFG) impacts prompt adherence, suggesting it as a potential control for edit intensity in editing models. However, we show that scaling CFG in these models does not produce a smooth transition between the input and the edited result. We attribute this behavior to the unconditional prediction, which serves as the guidance origin and dominates the generation at low guidance scales, while representing an arbitrary manipulation of the input content. To enable continuous control, we introduce Adaptive-Origin Guidance (AdaOr), a method that adjusts this standard guidance origin with an identity-conditioned adaptive origin, using an identity instruction corresponding to the identity manipulation. By interpolating this identity prediction with the standard unconditional prediction according to the edit strength, we ensure a continuous transition from the input to the edited result. We evaluate our method on image and video editing tasks, demonstrating that it provides smoother and more consistent control compared to current slider-based editing approaches. Our method incorporates an identity instruction into the standard training framework, enabling fine-grained control at inference time without per-edit procedure or reliance on specialized datasets.

[121] EventNeuS: 3D Mesh Reconstruction from a Single Event Camera cs.CVPDF

Shreyas Sachan, Viktor Rudnev, Mohamed Elgharib, Christian Theobalt, Vladislav Golyanik

TL;DR: EventNeuS是一种自监督神经模型，用于从单目彩色事件流中学习3D表示。该方法首次将3D有符号距离函数和密度场学习与基于事件的监督相结合，并引入球谐编码以更好地处理视图相关效应，显著提升了从事件相机进行3D网格重建的精度。

Details

Motivation: 事件相机在许多场景中是RGB相机的有效替代，但现有基于事件的新视角合成方法在密集3D网格重建方面探索不足，且3D重建精度严重受限，因此需要开发更准确的事件相机3D重建方法。

Result: EventNeuS在3D重建精度上显著优于现有方法，平均Chamfer距离降低了34%，平均绝对误差降低了31%，相比之前最佳方法有大幅提升。

Insight: 创新点在于首次将SDF和密度场学习与事件监督结合，并引入球谐编码处理视图相关效应，为事件相机3D重建提供了新的自监督表示学习框架。

Abstract: Event cameras offer a considerable alternative to RGB cameras in many scenarios. While there are recent works on event-based novel-view synthesis, dense 3D mesh reconstruction remains scarcely explored and existing event-based techniques are severely limited in their 3D reconstruction accuracy. To address this limitation, we present EventNeuS, a self-supervised neural model for learning 3D representations from monocular colour event streams. Our approach, for the first time, combines 3D signed distance function and density field learning with event-based supervision. Furthermore, we introduce spherical harmonics encodings into our model for enhanced handling of view-dependent effects. EventNeuS outperforms existing approaches by a significant margin, achieving 34% lower Chamfer distance and 31% lower mean absolute error on average compared to the best previous method.

cs.IR [Back]

[122] Tutorial on Reasoning for IR & IR for Reasoning cs.IR | cs.AI | cs.CLPDF

Mohanna Hoveyda, Panagiotis Efstratiadis, Arjen de Vries, Maarten de Rijke

TL;DR: 本教程旨在为信息检索（IR）领域提供一个关于推理的统一分析框架，以整合跨学科的研究方法，帮助IR研究者识别相关思路与机遇，并探讨检索过程在更广泛推理系统中的核心作用。

Details

Motivation: 解决信息检索中超越语义相关性的需求，如逻辑约束、多步推理和证据合成，这些需求本质上是推理问题，但目前相关研究分散在不同学科中，缺乏统一框架。

Result: 无具体实验结果，但通过提出统一分析框架，对现有推理方法（如LLM后训练、神经符号系统、贝叶斯框架等）进行映射和比较，揭示其权衡与互补性。

Insight: 创新点在于将推理明确定义在IR背景下，并建立跨学科方法的统一框架，强调IR既能受益于推理进展，也能为更广泛的推理方法论发展做出贡献。

Abstract: Information retrieval has long focused on ranking documents by semantic relatedness. Yet many real-world information needs demand more: enforcement of logical constraints, multi-step inference, and synthesis of multiple pieces of evidence. Addressing these requirements is, at its core, a problem of reasoning. Across AI communities, researchers are developing diverse solutions for the problem of reasoning, from inference-time strategies and post-training of LLMs, to neuro-symbolic systems, Bayesian and probabilistic frameworks, geometric representations, and energy-based models. These efforts target the same problem: to move beyond pattern-matching systems toward structured, verifiable inference. However, they remain scattered across disciplines, making it difficult for IR researchers to identify the most relevant ideas and opportunities. To help navigate the fragmented landscape of research in reasoning, this tutorial first articulates a working definition of reasoning within the context of information retrieval and derives from it a unified analytical framework. The framework maps existing approaches along axes that reflect the core components of the definition. By providing a comprehensive overview of recent approaches and mapping current methods onto the defined axes, we expose their trade-offs and complementarities, highlight where IR can benefit from cross-disciplinary advances, and illustrate how retrieval process itself can play a central role in broader reasoning systems. The tutorial will equip participants with both a conceptual framework and practical guidance for enhancing reasoning-capable IR systems, while situating IR as a domain that both benefits and contributes to the broader development of reasoning methodologies.

cs.LG [Back]

[123] GraphDancer: Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang

TL;DR: 论文提出了GraphDancer，一个基于课程强化学习的框架，用于训练大型语言模型（LLMs）在异构图结构知识上进行探索和推理。该方法通过交替进行推理和函数执行来导航图，并利用一个基于结构复杂度的图感知课程来有效训练中等规模的LLM。实验表明，仅使用3B参数的骨干模型，GraphDancer在跨领域泛化能力上超越了使用更大模型（如14B骨干或GPT-4o-mini）的基线方法。

Details

Motivation: 现实世界中的许多知识源以异构图而非纯文本形式组织，LLMs需要对此类结构化知识进行推理。这面临两大挑战：一是导航结构化、模式定义的关系需要精确的函数调用而非基于相似性的检索；二是回答复杂问题通常需要通过迭代信息寻求进行多跳证据聚合。

Result: 在仅在一个领域训练、在未见领域和分布外问题类型上测试的多领域基准评估中，GraphDancer（使用3B骨干）的性能超越了配备14B骨干或GPT-4o-mini的基线方法，展示了其图探索和推理技能具有强大的跨领域泛化能力。

Insight: 主要创新点包括：1）提出了一个结合推理与函数执行的强化学习框架，用于LLMs的图导航；2）引入了一个图感知课程，通过基于信息寻求轨迹结构复杂度的从易到难采样器来调度训练，这使得强化学习对中等规模LLM也有效。从客观角度看，其课程设计和对跨领域泛化能力的强调是值得借鉴的工程方法。

Abstract: Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many real-world knowledge sources are organized as heterogeneous graphs rather than plain text. Reasoning over such graph-structured knowledge poses two key challenges: (1) navigating structured, schema-defined relations requires precise function calls rather than similarity-based retrieval, and (2) answering complex questions often demands multi-hop evidence aggregation through iterative information seeking. We propose GraphDancer, a reinforcement learning (RL) framework that teaches LLMs to navigate graphs by interleaving reasoning and function execution. To make RL effective for moderate-sized LLMs, we introduce a graph-aware curriculum that schedules training by the structural complexity of information-seeking trajectories using an easy-to-hard biased sampler. We evaluate GraphDancer on a multi-domain benchmark by training on one domain only and testing on unseen domains and out-of-distribution question types. Despite using only a 3B backbone, GraphDancer outperforms baselines equipped with either a 14B backbone or GPT-4o-mini, demonstrating robust cross-domain generalization of graph exploration and reasoning skills. Our code and models can be found at https://yuyangbai.com/graphdancer/ .

[124] From Sparse Decisions to Dense Reasoning: A Multi-attribute Trajectory Paradigm for Multimodal Moderation cs.LG | cs.AI | cs.CL | cs.CVPDF

Tianle Gu, Kexin Huang, Lingyu Li, Ruilin Luo, Shiyang Huang

TL;DR: 本文提出了一种名为UniMod的新型多模态内容安全审核学习范式，旨在解决当前多模态审核中数据和监督信号稀疏、模型易陷入捷径学习的问题。该方法通过构建包含证据定位、模态评估、风险映射、政策决策和响应生成的结构化推理轨迹，将单一决策任务转化为多维边界学习过程。

Details

Motivation: 动机在于解决多模态安全审核中因数据和监督信号稀疏、依赖二值标签导致的捷径学习问题，这阻碍了模型学习有效的内在分类边界。

Result: 实验结果表明，UniMod在文本审核上取得了有竞争力的性能，并在多模态审核基准上建立了新的标杆，其训练数据量仅为主流基线方法的不到40%。消融实验进一步验证了其多属性轨迹推理的有效性。

Insight: 创新点在于提出了从稀疏决策到密集推理轨迹的范式转变，通过结构化多属性轨迹迫使模型基于明确的安全语义进行决策；同时设计了多头部标量奖励模型（UniRM）提供多维监督，并引入了专门的优化策略以解耦任务参数并平衡多任务学习中的训练动态。

Abstract: Safety moderation is pivotal for identifying harmful content. Despite the success of textual safety moderation, its multimodal counterparts remain hindered by a dual sparsity of data and supervision. Conventional reliance on binary labels lead to shortcut learning, which obscures the intrinsic classification boundaries necessary for effective multimodal discrimination. Hence, we propose a novel learning paradigm (UniMod) that transitions from sparse decision-making to dense reasoning traces. By constructing structured trajectories encompassing evidence grounding, modality assessment, risk mapping, policy decision, and response generation, we reformulate monolithic decision tasks into a multi-dimensional boundary learning process. This approach forces the model to ground its decision in explicit safety semantics, preventing the model from converging on superficial shortcuts. To facilitate this paradigm, we develop a multi-head scalar reward model (UniRM). UniRM provides multi-dimensional supervision by assigning attribute-level scores to the response generation stage. Furthermore, we introduce specialized optimization strategies to decouple task-specific parameters and rebalance training dynamics, effectively resolving interference between diverse objectives in multi-task learning. Empirical results show UniMod achieves competitive textual moderation performance and sets a new multimodal benchmark using less than 40% of the training data used by leading baselines. Ablations further validate our multi-attribute trajectory reasoning, offering an effective and efficient framework for multimodal moderation. Supplementary materials are available at \href{https://trustworthylab.github.io/UniMod/}{project website}.

[125] BinaryPPO: Efficient Policy Optimization for Binary Classification cs.LG | cs.AI | cs.CLPDF

Punya Syon Pandey, Zhijing Jin

TL;DR: 本文提出BinaryPPO，一种用于二元分类的离线强化学习框架，将分类问题重新定义为奖励最大化问题，通过改进的PPO算法和置信度加权奖励函数，从静态数据集中学习稳健的决策策略，在多个基准测试中显著超越监督微调方法。

Details

Motivation: 解决监督微调（SFT）在现实场景中因标签噪声、类别不平衡或稀疏监督而性能不佳的问题，为二元分类任务提供更鲁棒的替代方案。

Result: 在八个领域特定基准测试和多种不同架构的模型上，BinaryPPO将准确率提升了40-60个百分点，最高达到99%，大幅优于监督基线方法。

Insight: 主要创新点在于将二元分类重构为离线强化学习的奖励最大化问题，并设计了置信度加权的奖励函数来惩罚不确定或错误的预测；从客观角度看，其奖励塑造、优势缩放和政策稳定性分析为基于LLM的稳健分类提供了可借鉴的框架。

Abstract: Supervised fine-tuning (SFT) is the standard approach for binary classification tasks such as toxicity detection, factuality verification, and causal inference. However, SFT often performs poorly in real-world settings with label noise, class imbalance, or sparse supervision. We introduce BinaryPPO, an offline reinforcement learning large language model (LLM) framework that reformulates binary classification as a reward maximization problem. Our method leverages a variant of Proximal Policy Optimization (PPO) with a confidence-weighted reward function that penalizes uncertain or incorrect predictions, enabling the model to learn robust decision policies from static datasets without online interaction. Across eight domain-specific benchmarks and multiple models with differing architectures, BinaryPPO improves accuracy by 40-60 percentage points, reaching up to 99%, substantially outperforming supervised baselines. We provide an in-depth analysis of the role of reward shaping, advantage scaling, and policy stability in enabling this improvement. Overall, we demonstrate that confidence-based reward design provides a robust alternative to SFT for binary classification. Our code is available at https://github.com/psyonp/BinaryPPO.

[126] TraceNAS: Zero-shot LLM Pruning via Gradient Trace Correlation cs.LG | cs.CLPDF

Prajna G. Malettira, Manish Nagaraj, Arjun Roy, Shubham Negi, Kaushik Roy

TL;DR: 本文提出TraceNAS，一种无需训练的神经架构搜索框架，用于大语言模型的结构化剪枝。该方法通过梯度轨迹相关性作为零样本代理，联合探索模型深度和宽度的剪枝，高效识别与预训练模型损失景观对齐的剪枝模型，从而在单GPU上8.5小时内完成高保真剪枝模型发现。

Details

Motivation: 解决现有LLM结构化剪枝方法要么孤立评估局部组件重要性而忽略全局结构依赖，要么依赖训练感知方法计算成本高昂的问题。

Result: 在Llama和Qwen模型族上的评估表明，TraceNAS在常识和推理基准测试中与训练感知基线方法竞争力相当，且GPU小时数减少10倍。

Insight: 创新点在于提出一种尺度不变的零样本代理（梯度轨迹相关性）来评估剪枝模型与预训练模型的损失景观对齐度，从而无需训练即可高效捕获全局结构依赖并选择具有最大性能潜力的剪枝架构。

Abstract: Structured pruning is essential for efficient deployment of Large Language Models (LLMs). The varying sensitivity of LLM sub-blocks to pruning necessitates the identification of optimal non-uniformly pruned models. Existing methods evaluate the importance of layers, attention heads, or weight channels in isolation. Such localized focus ignores the complex global structural dependencies that exist across the model. Training-aware structured pruning addresses global dependencies, but its computational cost can be just as expensive as post-pruning training. To alleviate the computational burden of training-aware pruning and capture global structural dependencies, we propose TraceNAS, a training-free Neural Architecture Search (NAS) framework that jointly explores structured pruning of LLM depth and width. TraceNAS identifies pruned models that maintain a high degree of loss landscape alignment with the pretrained model using a scale-invariant zero-shot proxy, effectively selecting models that exhibit maximal performance potential during post-pruning training. TraceNAS is highly efficient, enabling high-fidelity discovery of pruned models on a single GPU in 8.5 hours, yielding a 10$\times$ reduction in GPU-hours compared to training-aware methods. Evaluations on the Llama and Qwen families demonstrate that TraceNAS is competitive with training-aware baselines across commonsense and reasoning benchmarks.

[127] Self-Hinting Language Models Enhance Reinforcement Learning cs.LG | cs.AI | cs.CL | stat.MLPDF

Baohao Liao, Hanze Dong, Xinxing Xu, Christof Monz, Jiang Bian

TL;DR: 本文提出了一种名为SAGE（Self-Hint Aligned GRPO with Privileged Supervision）的强化学习框架，旨在解决GRPO方法在稀疏终端奖励下因组内优势崩溃而导致的训练停滞问题。该方法通过在训练时引入特权提示（如计划或分解）来增加组内结果的多样性，从而稳定GRPO的更新，而在测试时不使用任何提示，直接部署无提示策略。

Details

Motivation: GRPO方法在稀疏奖励环境下，由于组内样本常获得相同奖励，导致相对优势崩溃和更新消失，训练容易停滞。本文旨在通过引入自我提示来增加组内多样性，从而缓解此问题。

Result: 在6个基准测试和3个LLM（Llama-3.2-3B-Instruct、Qwen2.5-7B-Instruct和Qwen3-4B-Instruct）上的实验表明，SAGE一致优于GRPO，平均提升分别为+2.0、+1.2和+1.3。

Insight: 创新点在于提出了一种在训练时使用自我提示（特权监督）来增加组内结果多样性、防止优势崩溃的方法，同时测试时无需提示，保持了部署的简洁性。此外，多样化的自我提示作为一种自适应课程，能更有效地跟踪学习者的瓶颈。

Abstract: Group Relative Policy Optimization (GRPO) has recently emerged as a practical recipe for aligning large language models with verifiable objectives. However, under sparse terminal rewards, GRPO often stalls because rollouts within a group frequently receive identical rewards, causing relative advantages to collapse and updates to vanish. We propose self-hint aligned GRPO with privileged supervision (SAGE), an on-policy reinforcement learning framework that injects privileged hints during training to reshape the rollout distribution under the same terminal verifier reward. For each prompt $x$, the model samples a compact hint $h$ (e.g., a plan or decomposition) and then generates a solution $τ$ conditioned on $(x,h)$. Crucially, the task reward $R(x,τ)$ is unchanged; hints only increase within-group outcome diversity under finite sampling, preventing GRPO advantages from collapsing under sparse rewards. At test time, we set $h=\varnothing$ and deploy the no-hint policy without any privileged information. Moreover, sampling diverse self-hints serves as an adaptive curriculum that tracks the learner’s bottlenecks more effectively than fixed hints from an initial policy or a stronger external model. Experiments over 6 benchmarks with 3 LLMs show that SAGE consistently outperforms GRPO, on average +2.0 on Llama-3.2-3B-Instruct, +1.2 on Qwen2.5-7B-Instruct and +1.3 on Qwen3-4B-Instruct. The code is available at https://github.com/BaohaoLiao/SAGE.

[128] Prompt Augmentation Scales up GRPO Training on Mathematical Reasoning cs.LG | cs.AI | cs.CLPDF

Wenquan Lu, Hai Huang, Randall Balestriero

TL;DR: 本文提出了一种名为提示增强的训练策略，旨在解决强化学习后训练中常见的熵崩溃问题，通过使用多样化的提示模板和格式来增加训练数据的多样性，从而稳定并扩展了GRPO训练的持续时间，最终在数学推理任务上实现了SOTA性能。

Details

Motivation: 针对GRPO等强化学习算法在数学推理后训练中出现的熵崩溃现象（策略熵单调下降导致训练不稳定和崩溃），以及现有方法因训练轮次受限而无法持续探索的问题，本文旨在通过增加训练数据的多样性来稳定训练过程。

Result: 在MATH Level 3-5数据集上，使用提示增强训练的Qwen2.5-Math-1.5B模型在AIME24、AMC、MATH500、Minerva和OlympiadBench等标准数学推理基准测试中达到了SOTA水平，分别取得了44.5%的每基准准确率和51.3%的每问题准确率。

Insight: 论文的创新点在于提出了提示增强策略，通过指令模型在多样化的模板和格式下生成推理轨迹，增加了训练数据的多样性，从而在不依赖KL正则化项的情况下，稳定了训练并允许模型在低熵状态下持续学习，避免了过早崩溃。

Abstract: Reinforcement learning algorithms such as group-relative policy optimization (GRPO) have demonstrated strong potential for improving the mathematical reasoning capabilities of large language models. However, prior work has consistently observed an entropy collapse phenomenon during reinforcement post-training, characterized by a monotonic decrease in policy entropy that ultimately leads to training instability and collapse. As a result, most existing approaches restrict training to short horizons (typically 5-20 epochs), limiting sustained exploration and hindering further policy improvement. In addition, nearly all prior work relies on a single, fixed reasoning prompt or template during training. In this work, we introduce prompt augmentation, a training strategy that instructs the model to generate reasoning traces under diverse templates and formats, thereby increasing rollout diversity. We show that, without a KL regularization term, prompt augmentation enables stable scaling of training duration under a fixed dataset and allows the model to tolerate low-entropy regimes without premature collapse. Empirically, a Qwen2.5-Math-1.5B model trained with prompt augmentation on the MATH Level 3-5 dataset achieves state-of-the-art performance, reaching 44.5 per-benchmark accuracy and 51.3 per-question accuracy on standard mathematical reasoning benchmarks, including AIME24, AMC, MATH500, Minerva, and OlympiadBench. The code and model checkpoints are available at https://github.com/wenquanlu/prompt-augmentation-GRPO.

[129] R1-SyntheticVL: Is Synthetic Data from Generative Models Ready for Multimodal Large Language Model? cs.LG | cs.AI | cs.CL | cs.CVPDF

Jingyi Zhang, Tianyi Lin, Huanjin Yao, Xiang Lan, Shunyu Liu

TL;DR: 本文提出了集体对抗数据合成（CADS）方法，用于为多模态大语言模型（MLLMs）自主合成高质量、多样化和具有挑战性的多模态训练数据。CADS通过集体对抗数据生成（CAD-Generate）和集体对抗数据评判（CAD-Judge）两个循环阶段，结合集体智能和对抗学习来优化数据生成过程，并引入了对抗上下文优化机制以生成高价值数据。基于此方法构建了MMSynthetic-20K数据集并训练了R1-SyntheticVL模型，该模型在多个基准测试中表现出色。

Details

Motivation: 旨在开发有效的数据合成技术，以自主合成多模态训练数据，从而增强MLLMs解决复杂现实世界任务的能力。

Result: 使用CADS构建的MMSynthetic-20K数据集训练的R1-SyntheticVL模型在多个基准测试中表现出优越性能。

Insight: 创新点在于提出了集体对抗数据合成（CADS）框架，通过集体智能确保生成数据的质量和多样性，并利用对抗学习合成挑战性样本以有效驱动模型改进，同时引入了对抗上下文优化机制来优化生成上下文。从客观角度看，该方法为利用生成模型合成多模态数据提供了一种系统化、可扩展的解决方案，可能缓解MLLMs训练中的数据稀缺问题。

Abstract: In this work, we aim to develop effective data synthesis techniques that autonomously synthesize multimodal training data for enhancing MLLMs in solving complex real-world tasks. To this end, we propose Collective Adversarial Data Synthesis (CADS), a novel and general approach to synthesize high-quality, diverse and challenging multimodal data for MLLMs. The core idea of CADS is to leverage collective intelligence to ensure high-quality and diverse generation, while exploring adversarial learning to synthesize challenging samples for effectively driving model improvement. Specifically, CADS operates with two cyclic phases, i.e., Collective Adversarial Data Generation (CAD-Generate) and Collective Adversarial Data Judgment (CAD-Judge). CAD-Generate leverages collective knowledge to jointly generate new and diverse multimodal data, while CAD-Judge collaboratively assesses the quality of synthesized data. In addition, CADS introduces an Adversarial Context Optimization mechanism to optimize the generation context to encourage challenging and high-value data generation. With CADS, we construct MMSynthetic-20K and train our model R1-SyntheticVL, which demonstrates superior performance on various benchmarks.

[130] How Much Information Can a Vision Token Hold? A Scaling Law for Recognition Limits in VLMs cs.LG | cs.CVPDF

Shuxin Zhuang, Zi Liang, Runsheng Yu, Hongzong Li, Rong Feng

TL;DR: 本文研究了视觉语言模型（VLMs）中视觉令牌的信息容量上限，通过控制实验发现随着图像中字符数量的增加，模型识别性能呈现三阶段相变现象：稳定阶段、不稳定阶段和崩溃阶段，并提出了一个统一的概率缩放定律来量化视觉令牌负载与视觉密度之间的关系。

Details

Motivation: 动机是探究视觉编码器作为有损通道时，视觉令牌所能承载的信息上限，以解决视觉上下文压缩中效率与精度权衡的根本问题。

Result: 在多个视觉语言模型上的广泛实验验证了所提缩放定律的普适性，为优化视觉上下文压缩提供了关键经验指导。

Insight: 创新点在于首次系统性地揭示了视觉令牌信息容量的相变现象，并建立了统一的概率缩放定律来预测识别极限，这为设计更高效的视觉编码器提供了理论依据。

Abstract: Recent vision-centric approaches have made significant strides in long-context modeling. Represented by DeepSeek-OCR, these models encode rendered text into continuous vision tokens, achieving high compression rates without sacrificing recognition precision. However, viewing the vision encoder as a lossy channel with finite representational capacity raises a fundamental question: what is the information upper bound of visual tokens? To investigate this limit, we conduct controlled stress tests by progressively increasing the information quantity (character count) within an image. We observe a distinct phase-transition phenomenon characterized by three regimes: a near-perfect Stable Phase, an Instability Phase marked by increased error variance, and a total Collapse Phase. We analyze the mechanical origins of these transitions and identify key factors. Furthermore, we formulate a probabilistic scaling law that unifies average vision token load and visual density into a latent difficulty metric. Extensive experiments across various Vision-Language Models demonstrate the universality of this scaling law, providing critical empirical guidance for optimizing the efficiency-accuracy trade-off in visual context compression.

[131] ToolTok: Tool Tokenization for Efficient and Generalizable GUI Agents cs.LG | cs.AI | cs.CV | cs.MAPDF

Xiaoce Wang, Guibin Zhang, Junzhe Li, Jinzhe Tu, Chun Li

TL;DR: 本文提出ToolTok，一种用于GUI智能体的多步路径查找新范式，将操作建模为渐进式工具使用序列。该方法通过设计符合人类交互习惯的工具，并使用可学习的令牌嵌入表示每个工具，解决了现有坐标依赖方法泛化性差及无坐标方法数据稀缺的问题。ToolTok引入语义锚定机制，在有限监督下高效学习嵌入，并构建由易到难的课程学习任务，使预训练大语言模型逐步掌握工具语义。

Details

Motivation: 现有GUI智能体模型依赖基于坐标的一步视觉定位，难以泛化到不同输入分辨率和宽高比；而无坐标策略则在严重数据稀缺下学习困难。本文旨在解决这些限制，提升GUI智能体的效率和泛化能力。

Result: 在多个基准测试上的广泛实验表明，ToolTok在可比规模模型（4B）中取得优越性能，并与更大模型（235B）保持竞争力。这些结果仅使用其他后训练方法所需训练数据的不到1%获得，且ToolTok在未见场景中表现出强泛化性。

Insight: 创新点包括：将GUI操作建模为多步渐进式工具使用序列；设计可学习工具令牌嵌入；引入语义锚定机制作为自然归纳偏置；构建易到难的课程学习任务（令牌定义问答、纯文本引导工具选择、简化视觉路径查找）以高效训练LLM。这些方法实现了数据高效学习和强泛化，为GUI智能体提供了新思路。

Abstract: Existing GUI agent models relying on coordinate-based one-step visual grounding struggle with generalizing to varying input resolutions and aspect ratios. Alternatives introduce coordinate-free strategies yet suffer from learning under severe data scarcity. To address the limitations, we propose ToolTok, a novel paradigm of multi-step pathfinding for GUI agents, where operations are modeled as a sequence of progressive tool usage. Specifically, we devise tools aligned with human interaction habits and represent each tool using learnable token embeddings. To enable efficient embedding learning under limited supervision, ToolTok introduces a semantic anchoring mechanism that grounds each tool with semantically related concepts as natural inductive bias. To further enable a pre-trained large language model to progressively acquire tool semantics, we construct an easy-to-hard curriculum consisting of three tasks: token definition question-answering, pure text-guided tool selection, and simplified visual pathfinding. Extensive experiments on multiple benchmarks show that ToolTok achieves superior performance among models of comparable scale (4B) and remains competitive with a substantially larger model (235B). Notably, these results are obtained using less than 1% of the training data required by other post-training approaches. In addition, ToolTok demonstrates strong generalization across unseen scenarios. Our training & inference code is open-source at https://github.com/ZephinueCode/ToolTok.

[132] EEO-TFV: Escape-Explore Optimizer for Web-Scale Time-Series Forecasting and Vision Analysis cs.LG | cs.AI | cs.CVPDF

Hua Wang, Jinghao Lu, Fan Zhang

TL;DR: 本文提出了一种轻量级Transformer架构与新颖的逃逸-探索优化器（EEO），旨在解决大规模网络数据分析中Transformer基础模型面临的误差累积、分布外样本脆弱性以及高维参数空间优化困难等问题。该方法在11个时间序列基准数据集和Synapse医学图像分割任务上达到了与最先进模型相当的性能，并展现出优异的泛化能力和稳定性。

Details

Motivation: 解决Transformer基础模型在多变量长序列预测中的误差累积问题、在图像相关任务中对分布外样本的脆弱性，以及在大规模网络数据分析中因复杂时空模式和多模态特征导致的优化困难，特别是模型容易陷入高维参数空间的鞍点陷阱。

Result: 在代表性的网络数据场景中，该方法在11个时间序列基准数据集和Synapse医学图像分割任务上达到了与最先进（SOTA）模型相当的性能。

Insight: 创新点在于提出了一个新颖的逃逸-探索优化器（EEO），该优化器在增强探索和泛化能力的同时，能有效避免尖锐最小值和鞍点陷阱。这为构建适用于网络规模数据挖掘和分析的通用跨任务基础模型提供了潜在的优化解决方案。

Abstract: Transformer-based foundation models have achieved remarkable progress in tasks such as time-series forecasting and image segmentation. However, they frequently suffer from error accumulation in multivariate long-sequence prediction and exhibit vulnerability to out-of-distribution samples in image-related tasks. Furthermore, these challenges become particularly pronounced in large-scale Web data analysis tasks, which typically involve complex temporal patterns and multimodal features. This complexity substantially increases optimization difficulty, rendering models prone to stagnation at saddle points within high-dimensional parameter spaces. To address these issues, we propose a lightweight Transformer architecture in conjunction with a novel Escape-Explore Optimizer (EEO). The optimizer enhances both exploration and generalization while effectively avoiding sharp minima and saddle-point traps. Experimental results show that, in representative Web data scenarios, our method achieves performance on par with state-of-the-art models across 11 time-series benchmark datasets and the Synapse medical image segmentation task. Moreover, it demonstrates superior generalization and stability, thereby validating its potential as a versatile cross-task foundation model for Web-scale data mining and analysis.

[133] Efficient Estimation of Kernel Surrogate Models for Task Attribution cs.LG | cs.AI | cs.CLPDF

Zhenshuo Zhang, Minxuan Duan, Hongyang R. Zhang

TL;DR: 本文提出了一种高效的核代理模型方法，用于量化训练任务对目标任务性能的影响（任务归因）。该方法通过梯度估计技术，无需重复训练即可准确预测任务子集的性能，在数学推理、上下文学习和多目标强化学习等多个领域验证了其有效性。

Details

Motivation: 现有线性代理模型无法捕捉任务间的非线性交互（如协同或对抗效应），而直接留一法重训练计算成本过高，因此需要一种高效且能建模高阶交互的任务归因方法。

Result: 在多个基准测试中，核代理模型与留一法真实值的相关性比线性代理和影响函数基线高25%；在下游任务选择中，上下文学习和多目标强化学习的演示选择性能提升40%。

Insight: 通过二阶分析建立了线性代理模型与影响函数的新联系，并引入核方法建模任务交互；提出的梯度估计方法仅需一次预训练模型即可高效学习代理，相对误差低于2%。

Abstract: Modern AI agents such as large language models are trained on diverse tasks – translation, code generation, mathematical reasoning, and text prediction – simultaneously. A key question is to quantify how each individual training task influences performance on a target task, a problem we refer to as task attribution. The direct approach, leave-one-out retraining, measures the effect of removing each task, but is computationally infeasible at scale. An alternative approach that builds surrogate models to predict a target task’s performance for any subset of training tasks has emerged in recent literature. Prior work focuses on linear surrogate models, which capture first-order relationships, but miss nonlinear interactions such as synergy, antagonism, or XOR-type effects. In this paper, we first consider a unified task weighting framework for analyzing task attribution methods, and show a new connection between linear surrogate models and influence functions through a second-order analysis. Then, we introduce kernel surrogate models, which more effectively represent second-order task interactions. To efficiently learn the kernel surrogate, we develop a gradient-based estimation procedure that leverages a first-order approximation of pretrained models; empirically, this yields accurate estimates with less than $2%$ relative error without repeated retraining. Experiments across multiple domains – including math reasoning in transformers, in-context learning, and multi-objective reinforcement learning – demonstrate the effectiveness of kernel surrogate models. They achieve a $25%$ higher correlation with the leave-one-out ground truth than linear surrogates and influence-function baselines. When used for downstream task selection, kernel surrogate models yield a $40%$ improvement in demonstration selection for in-context learning and multi-objective reinforcement learning benchmarks.

[134] Auditing Sybil: Explaining Deep Lung Cancer Risk Prediction Through Generative Interventional Attributions cs.LG | cs.AI | cs.CVPDF

Bartlomiej Sobieski, Jakub Grzywaczewski, Karol Dobiczek, Mateusz Wójcik, Tomasz Bartczak

TL;DR: 本文提出了一种名为S(H)NAP的模型无关审计框架，用于对名为Sybil的深度学习肺癌风险预测模型进行因果验证。该框架通过生成式干预归因，利用3D扩散桥模型系统性地修改CT图像中的解剖特征，以分离出特定对象对风险评分的因果贡献。研究发现，Sybil模型虽然在某些方面表现出类似专家放射科医生的行为，但也存在对临床无关伪影的敏感性和径向偏差等关键失败模式。

Details

Motivation: 尽管Sybil模型在临床验证中表现出高精度，但现有评估仅基于观察性指标，这种相关性方法忽略了模型的实际推理机制。为确保临床部署前的决策鲁棒性，需要转向因果验证。

Result: 研究提供了对Sybil模型的首次干预性审计，结果表明，该模型在区分恶性与良性肺结节方面常表现出类似专家的行为，但也存在关键失败模式，包括对临床不合理伪影的危险敏感性和明显的径向偏差。

Insight: 创新点在于提出了一个模型无关的审计框架S(H)NAP，它通过生成式干预和3D扩散桥建模实现因果归因，为深度学习模型在医疗等高风险领域的可解释性和可靠性验证提供了新方法，强调了从相关性评估转向因果验证的重要性。

Abstract: Lung cancer remains the leading cause of cancer mortality, driving the development of automated screening tools to alleviate radiologist workload. Standing at the frontier of this effort is Sybil, a deep learning model capable of predicting future risk solely from computed tomography (CT) with high precision. However, despite extensive clinical validation, current assessments rely purely on observational metrics. This correlation-based approach overlooks the model’s actual reasoning mechanism, necessitating a shift to causal verification to ensure robust decision-making before clinical deployment. We propose S(H)NAP, a model-agnostic auditing framework that constructs generative interventional attributions validated by expert radiologists. By leveraging realistic 3D diffusion bridge modeling to systematically modify anatomical features, our approach isolates object-specific causal contributions to the risk score. Providing the first interventional audit of Sybil, we demonstrate that while the model often exhibits behavior akin to an expert radiologist, differentiating malignant pulmonary nodules from benign ones, it suffers from critical failure modes, including dangerous sensitivity to clinically unjustified artifacts and a distinct radial bias.

[135] Trajectory Consistency for One-Step Generation on Euler Mean Flows cs.LG | cs.AI | cs.CVPDF

Zhiqi Li, Yuchen Sun, Duowen Chen, Jinjin He, Bo Zhu

TL;DR: 本文提出了Euler Mean Flows (EMF)，一种基于流的生成框架，旨在以最小的采样成本实现一步和少步生成，并通过强制长程轨迹一致性来提升性能。其核心思想是用一个原则性的线性替代目标来取代难以在长时间尺度上监督和优化的轨迹一致性约束，从而实现对长时程流映射组合的直接数据监督。该框架源自基于流模型的半群公式，在温和的正则性假设下能忠实近似原始一致性目标且更易于优化，形成了一个统一的、无需雅可比向量积的训练框架，支持u-预测和x1-预测变体，避免了显式雅可比计算，显著降低了内存和计算开销。

Details

Motivation: 解决现有基于流的生成模型在实现一步或几步生成时，长时程轨迹一致性约束难以监督和优化的问题，旨在降低采样成本并提升优化稳定性。

Result: 在图像合成、基于粒子的几何生成和函数生成等任务上的实验表明，在固定采样预算下，该方法优化稳定性更好，样本质量更高；与现有的一步图像生成方法相比，训练时间和内存消耗减少了约50%。

Insight: 创新点在于从半群公式推导出线性替代目标来近似长程轨迹一致性，从而构建了一个无需雅可比向量积的统一训练框架，这降低了计算复杂度和内存需求，同时保持了生成质量，为高效的一步生成提供了新思路。

Abstract: We propose \emph{Euler Mean Flows (EMF)}, a flow-based generative framework for one-step and few-step generation that enforces long-range trajectory consistency with minimal sampling cost. The key idea of EMF is to replace the trajectory consistency constraint, which is difficult to supervise and optimize over long time scales, with a principled linear surrogate that enables direct data supervision for long-horizon flow-map compositions. We derive this approximation from the semigroup formulation of flow-based models and show that, under mild regularity assumptions, it faithfully approximates the original consistency objective while being substantially easier to optimize. This formulation leads to a unified, JVP-free training framework that supports both $u$-prediction and $x_1$-prediction variants, avoiding explicit Jacobian computations and significantly reducing memory and computational overhead. Experiments on image synthesis, particle-based geometry generation, and functional generation demonstrate improved optimization stability and sample quality under fixed sampling budgets, together with approximately $50%$ reductions in training time and memory consumption compared to existing one-step methods for image generation.

[136] Bridging Online and Offline RL: Contextual Bandit Learning for Multi-Turn Code Generation cs.LG | cs.AI | cs.CL | cs.SEPDF

Ziru Chen, Dongdong Chen, Ruinan Jin, Yingbin Liang, Yujia Xie

TL;DR: 本文提出了一种名为Cobalt的新方法，用于多轮代码生成任务。该方法将多轮代码生成建模为一步可恢复马尔可夫决策过程，通过结合离线轨迹和在线上下文赌博学习，旨在融合在线与离线强化学习的优势。

Details

Motivation: 解决在真实世界任务（如多轮代码生成）中，在线强化学习训练成本高、不稳定，而离线强化学习性能较差的问题，旨在提出一种兼具两者优点的训练方法。

Result: 在LiveCodeBench基准测试上，Cobalt显著提升了R1-Distill 8B和Qwen3 8B模型，Pass@1分数分别绝对提升了9.0和6.2分，性能优于基于GRPO和VeRPO的多轮在线强化学习基线方法。

Insight: 核心创新点在于将多轮交互任务重构为一步可恢复的上下文赌博问题，并利用离线轨迹作为上下文提示进行在线单步训练。此外，论文还分析了LLM的上下文奖励攻击行为，并通过引入扰动轨迹进行数据增强来缓解该问题，为迭代决策任务提供了新的训练范式。

Abstract: Recently, there have been significant research interests in training large language models (LLMs) with reinforcement learning (RL) on real-world tasks, such as multi-turn code generation. While online RL tends to perform better than offline RL, its higher training cost and instability hinders wide adoption. In this paper, we build on the observation that multi-turn code generation can be formulated as a one-step recoverable Markov decision process and propose contextual bandit learning with offline trajectories (Cobalt), a new method that combines the benefits of online and offline RL. Cobalt first collects code generation trajectories using a reference LLM and divides them into partial trajectories as contextual prompts. Then, during online bandit learning, the LLM is trained to complete each partial trajectory prompt through single-step code generation. Cobalt outperforms two multi-turn online RL baselines based on GRPO and VeRPO, and substantially improves R1-Distill 8B and Qwen3 8B by up to 9.0 and 6.2 absolute Pass@1 scores on LiveCodeBench. Also, we analyze LLMs’ in-context reward hacking behaviors and augment Cobalt training with perturbed trajectories to mitigate this issue. Overall, our results demonstrate Cobalt as a promising solution for iterative decision-making tasks like multi-turn code generation. Our code and data are available at https://github.com/OSU-NLP-Group/cobalt.

[137] Hierarchical Entity-centric Reinforcement Learning with Factored Subgoal Diffusion cs.LG | cs.CV | cs.ROPDF

Dan Haramati, Carl Qi, Tal Daniel, Amy Zhang, Aviv Tamar

TL;DR: 本文提出了一种分层实体中心框架，用于离线目标条件强化学习（GCRL），通过结合子目标分解和因子化结构来解决多实体领域中的长时程任务。该方法采用两层架构：一个基于价值的GCRL智能体和一个因子化子目标生成条件扩散模型。两者独立训练，并通过基于价值函数的选择性子目标生成进行组合，从而提升在稀疏奖励、图像输入的长时程任务中的性能。

Details

Motivation: 解决复杂环境中多实体领域的长时程目标达成问题，这些领域因组合复杂性而特别困难。GCRL虽有助于跨目标泛化和利用子目标结构，但在高维观测和组合状态空间下，尤其是在稀疏奖励下，仍面临挑战。

Result: 在引入的新基准任务变体上，该方法持续提升了底层RL智能体的性能，在最难任务上成功率提高了150%以上，并能泛化到更长的时程和更多的实体数量。

Insight: 创新点在于将分层强化学习与因子化条件扩散模型结合，用于生成结构化的子目标。其模块化设计使其能与现有GCRL算法兼容，并通过基于价值的选择性子目标生成来有效应对多实体组合复杂性。

Abstract: We propose a hierarchical entity-centric framework for offline Goal-Conditioned Reinforcement Learning (GCRL) that combines subgoal decomposition with factored structure to solve long-horizon tasks in domains with multiple entities. Achieving long-horizon goals in complex environments remains a core challenge in Reinforcement Learning (RL). Domains with multiple entities are particularly difficult due to their combinatorial complexity. GCRL facilitates generalization across goals and the use of subgoal structure, but struggles with high-dimensional observations and combinatorial state-spaces, especially under sparse reward. We employ a two-level hierarchy composed of a value-based GCRL agent and a factored subgoal-generating conditional diffusion model. The RL agent and subgoal generator are trained independently and composed post hoc through selective subgoal generation based on the value function, making the approach modular and compatible with existing GCRL algorithms. We introduce new variations to benchmark tasks that highlight the challenges of multi-entity domains, and show that our method consistently boosts performance of the underlying RL agent on image-based long-horizon tasks with sparse rewards, achieving over 150% higher success rates on the hardest task in our suite and generalizing to increasing horizons and numbers of entities. Rollout videos are provided at: https://sites.google.com/view/hecrl

[138] From Tokens to Numbers: Continuous Number Modeling for SVG Generation cs.LG | cs.AI | cs.CVPDF

Michael Ogezi, Martin Bell, Freda Shi, Ethan Smith

TL;DR: 本文提出了一种名为连续数字建模（CNM）的新方法，用于生成可缩放矢量图形（SVG）。该方法将SVG中的数值参数直接作为连续值而非离散标记进行建模，解决了传统标记化编码导致的训练慢、精度低和泛化差的问题。作者在200万个栅格到SVG样本上训练了一个多模态Transformer，并通过强化学习进行微调以提升视觉质量。

Details

Motivation: 矢量图形（如SVG）在灵活性、尺寸效率和编辑便捷性方面优于栅格图像，但相关生成方法研究较少。核心挑战在于SVG中大量的数值几何参数被低效地编码为长标记序列，这影响了训练效率、准确性和泛化能力。

Result: 与替代方法相比，CNM将训练速度提高了30%以上，同时保持了更高的感知保真度。

Insight: 主要创新点在于将数值作为连续的一等公民进行直接建模，恢复了表示的数学优雅性，消除了基于标记编码引入的离散化伪影。这为高质量矢量生成提供了一种实用且高效的方案，并具有更广泛的应用潜力。

Abstract: For certain image generation tasks, vector graphics such as Scalable Vector Graphics (SVGs) offer clear benefits such as increased flexibility, size efficiency, and editing ease, but remain less explored than raster-based approaches. A core challenge is that the numerical, geometric parameters, which make up a large proportion of SVGs, are inefficiently encoded as long sequences of tokens. This slows training, reduces accuracy, and hurts generalization. To address these problems, we propose Continuous Number Modeling (CNM), an approach that directly models numbers as first-class, continuous values rather than discrete tokens. This formulation restores the mathematical elegance of the representation by aligning the model’s inputs with the data’s continuous nature, removing discretization artifacts introduced by token-based encoding. We then train a multimodal transformer on 2 million raster-to-SVG samples, followed by fine-tuning via reinforcement learning using perceptual feedback to further improve visual quality. Our approach improves training speed by over 30% while maintaining higher perceptual fidelity compared to alternative approaches. This work establishes CNM as a practical and efficient approach for high-quality vector generation, with potential for broader applications. We make our code available http://github.com/mikeogezi/CNM.

[139] SAFE-KD: Risk-Controlled Early-Exit Distillation for Vision Backbones cs.LG | cs.AI | cs.CVPDF

Salim Khazem

TL;DR: SAFE-KD是一种用于现代视觉骨干网络的通用多出口包装器，通过结合分层知识蒸馏和符合风险控制，在保证用户指定选择性误分类风险的前提下，实现高效推理。

Details

Motivation: 解决早期退出网络在实际部署中难以确定何时安全退出的问题，确保早期退出决策的可靠性。

Result: 在多个数据集和架构上，SAFE-KD提高了精度与计算量的权衡，增强了校准性，并在数据损坏下保持鲁棒性能，同时提供有限样本风险保证。

Insight: 创新点在于将解耦知识蒸馏与符合风险控制结合，通过校准每出口停止阈值来保证风险可控，实现可证明的安全早期退出。

Abstract: Early-exit networks reduce inference cost by allowing ``easy’’ inputs to stop early, but practical deployment hinges on knowing \emph{when} early exit is safe. We introduce SAFE-KD, a universal multi-exit wrapper for modern vision backbones that couples hierarchical distillation with \emph{conformal risk control}. SAFE-KD attaches lightweight exit heads at intermediate depths, distills a strong teacher into all exits via Decoupled Knowledge Distillation (DKD), and enforces deep-to-shallow consistency between exits. At inference, we calibrate per-exit stopping thresholds on a held-out set using conformal risk control (CRC) to guarantee a user-specified \emph{selective} misclassification risk (among the samples that exit early) under exchangeability. Across multiple datasets and architectures, SAFE-KD yields improved accuracy compute trade-offs, stronger calibration, and robust performance under corruption while providing finite-sample risk guarantees.

[140] Neural Predictor-Corrector: Solving Homotopy Problems with Reinforcement Learning cs.LG | cs.CVPDF

Jiayao Mai, Bangyan Liao, Zhenjun Zhao, Yingping Zeng, Haoang Li

TL;DR: 本文提出了一种名为神经预测-校正器（NPC）的统一框架，用于解决同伦问题，通过强化学习自动学习步长和迭代终止策略，替代传统手工启发式方法，并在四个代表性同伦问题上验证了其泛化能力和效率优势。

Details

Motivation: 动机在于解决同伦问题中传统预测-校正方法依赖手工启发式策略（如步长和迭代终止）导致的次优和任务特定性问题，旨在设计一个通用的神经求解器来统一处理这类问题。

Result: 实验在四个代表性同伦问题上进行，NPC在未见实例上有效泛化，在效率上持续优于经典和专用基线，并展现出跨任务的优越稳定性，表明其作为统一神经框架的价值。

Insight: 创新点包括将同伦问题统一到单一框架下，利用强化学习自动学习策略，并引入摊销训练机制实现一次性离线训练和高效在线推理，从而提升泛化性和效率，为复杂优化问题提供了可扩展的神经求解方案。

Abstract: The Homotopy paradigm, a general principle for solving challenging problems, appears across diverse domains such as robust optimization, global optimization, polynomial root-finding, and sampling. Practical solvers for these problems typically follow a predictor-corrector (PC) structure, but rely on hand-crafted heuristics for step sizes and iteration termination, which are often suboptimal and task-specific. To address this, we unify these problems under a single framework, which enables the design of a general neural solver. Building on this unified view, we propose Neural Predictor-Corrector (NPC), which replaces hand-crafted heuristics with automatically learned policies. NPC formulates policy selection as a sequential decision-making problem and leverages reinforcement learning to automatically discover efficient strategies. To further enhance generalization, we introduce an amortized training mechanism, enabling one-time offline training for a class of problems and efficient online inference on new instances. Experiments on four representative homotopy problems demonstrate that our method generalizes effectively to unseen instances. It consistently outperforms classical and specialized baselines in efficiency while demonstrating superior stability across tasks, highlighting the value of unifying homotopy methods into a single neural framework.

[141] Robust Representation Learning in Masked Autoencoders cs.LG | cs.CVPDF

Anika Shrivastava, Renu Rameshan, Samar Agnihotri

TL;DR: 本文旨在探究掩码自编码器（MAE）在图像分类任务中表现出色的原因，发现其通过预训练和微调学习到的表示具有鲁棒性，能在模糊和遮挡等退化条件下保持良好的分类性能。通过逐层分析token嵌入，作者揭示了MAE在深度网络中逐步以类感知方式构建潜在空间，使得不同类别的嵌入子空间逐渐可分。此外，MAE在编码器层中表现出早期且持续的全局注意力，与标准视觉Transformer（ViT）形成对比。为量化特征鲁棒性，作者引入了两个敏感性指标：干净与扰动嵌入之间的方向对齐，以及退化下主动特征的头部保留度，这些研究有助于解释MAE的鲁棒分类性能。

Details

Motivation: 论文的动机是理解MAE在下游分类任务中强大性能的内在机制，特别是其表示学习的鲁棒性，以解决对MAE内部表示理解不足的问题。

Result: 研究通过层析分析表明，MAE在预训练过程中以类感知方式构建潜在空间，增强了特征的可分性；同时，MAE展现出早期全局注意力，提升了鲁棒性。作者引入的敏感性指标（如方向对齐和头部保留度）量化了特征对退化的抵抗力，但没有提及具体benchmark上的定量结果或与SOTA的比较。

Insight: 摘要宣称的创新点包括揭示MAE表示学习的类感知渐进构建机制、其与标准ViT不同的早期全局注意力模式，以及引入量化特征鲁棒性的敏感性指标。从客观角度分析，这些洞察为理解MAE的鲁棒性提供了新视角，尤其在表示学习理论和注意力机制方面具有借鉴意义。

Abstract: Masked Autoencoders (MAEs) achieve impressive performance in image classification tasks, yet the internal representations they learn remain less understood. This work started as an attempt to understand the strong downstream classification performance of MAE. In this process we discover that representations learned with the pretraining and fine-tuning, are quite robust - demonstrating a good classification performance in the presence of degradations, such as blur and occlusions. Through layer-wise analysis of token embeddings, we show that pretrained MAE progressively constructs its latent space in a class-aware manner across network depth: embeddings from different classes lie in subspaces that become increasingly separable. We further observe that MAE exhibits early and persistent global attention across encoder layers, in contrast to standard Vision Transformers (ViTs). To quantify feature robustness, we introduce two sensitivity indicators: directional alignment between clean and perturbed embeddings, and head-wise retention of active features under degradations. These studies help establish the robust classification performance of MAEs.

eess.IV [Back]

[142] EchoJEPA: A Latent Predictive Foundation Model for Echocardiography eess.IV | cs.CVPDF

Alif Munim, Adibvafa Fallahpour, Teodora Szasz, Ahmadreza Attarpour, River Jiang

TL;DR: EchoJEPA是一种用于超声心动图的潜在预测基础模型，通过在300K患者的1800万超声心动图上进行训练，旨在从超声图像中分离解剖信号与随机斑点噪声和伪影，从而减少标注负担并提高诊断一致性。

Details

Motivation: 现有超声心动图基础模型未能有效分离解剖信号与超声图像中占主导的随机斑点和采集伪影，限制了其泛化能力和诊断准确性。

Result: EchoJEPA在左心室射血分数估计误差上降低了19%，视图分类准确率达到87.4%；在仅使用1%标注数据时达到78.6%的准确率，优于使用100%数据的最佳基线（42.1%）；在声学扰动下性能仅下降2.3%，优于次优模型的16.8%；在儿科患者上零样本迁移误差降低15%，均超越所有微调基线。

Insight: 创新点包括引入潜在预测作为超声基础模型的优越范式，以及提出具有分解流嵌入的多视图探测框架以标准化冻结主干下的评估，实现了对解剖信号的更好解耦和更强的样本效率与鲁棒性。

Abstract: Foundation models for echocardiography promise to reduce annotation burden and improve diagnostic consistency by learning generalizable representations from large unlabeled video archives. However, current approaches fail to disentangle anatomical signal from the stochastic speckle and acquisition artifacts that dominate ultrasound imagery. We present EchoJEPA, a foundation model for echocardiography trained on 18 million echocardiograms across 300K patients, the largest pretraining corpus for this modality to date. We also introduce a novel multi-view probing framework with factorized stream embeddings that standardizes evaluation under frozen backbones. Compared to prior methods, EchoJEPA reduces left ventricular ejection fraction estimation error by 19% and achieves 87.4% view classification accuracy. EchoJEPA exhibits strong sample efficiency, reaching 78.6% accuracy with only 1% of labeled data versus 42.1% for the best baseline trained on 100%. Under acoustic perturbations, EchoJEPA degrades by only 2.3% compared to 16.8% for the next best model, and transfers zero-shot to pediatric patients with 15% lower error than the next best model, outperforming all fine-tuned baselines. These results establish latent prediction as a superior paradigm for ultrasound foundation models.

cs.RO [Back]

[143] RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization cs.RO | cs.AI | cs.CV | cs.LGPDF

Songming Liu, Bangguo Li, Kai Ma, Lingxuan Wu, Hengkai Tan

TL;DR: 本文介绍了RDT2，一个基于70亿参数视觉语言模型（VLM）构建的机器人基础模型，旨在实现开放词汇任务在新硬件平台上的零样本部署。通过收集超过10,000小时、涵盖多种机器人平台的增强型通用操作接口（UMI）数据集，并采用结合残差向量量化、流匹配和蒸馏的三阶段训练方法，RDT2能够零样本泛化到未见过的物体、场景、指令和机器人平台，并在灵巧、长视界和动态任务（如打乒乓球）上超越现有最佳基线。

Details

Motivation: 当前视觉-语言-动作（VLA）模型面临数据稀缺、架构效率低下以及无法跨不同硬件平台泛化的问题，RDT2旨在解决这些挑战，推动通用机器人技术的发展。

Result: RDT2在灵巧、长视界和动态下游任务（如打乒乓球）中超越了最先进的基线模型，成为首批能同时零样本泛化到未见物体、场景、指令和机器人平台的模型之一。

Insight: 创新点包括：1) 构建了大规模、跨平台的增强型通用操作接口（UMI）数据集；2) 提出了一种新颖的三阶段训练方法，通过残差向量量化、流匹配和蒸馏将离散语言知识与连续控制对齐，实现实时推理。这为跨平台机器人泛化提供了可扩展的数据和架构解决方案。

Abstract: Vision-Language-Action (VLA) models hold promise for generalist robotics but currently struggle with data scarcity, architectural inefficiencies, and the inability to generalize across different hardware platforms. We introduce RDT2, a robotic foundation model built upon a 7B parameter VLM designed to enable zero-shot deployment on novel embodiments for open-vocabulary tasks. To achieve this, we collected one of the largest open-source robotic datasets–over 10,000 hours of demonstrations in diverse families–using an enhanced, embodiment-agnostic Universal Manipulation Interface (UMI). Our approach employs a novel three-stage training recipe that aligns discrete linguistic knowledge with continuous control via Residual Vector Quantization (RVQ), flow-matching, and distillation for real-time inference. Consequently, RDT2 becomes one of the first models that simultaneously zero-shot generalizes to unseen objects, scenes, instructions, and even robotic platforms. Besides, it outperforms state-of-the-art baselines in dexterous, long-horizon, and dynamic downstream tasks like playing table tennis. See https://rdt-robotics.github.io/rdt2/ for more information.

[144] PlanTRansformer: Unified Prediction and Planning with Goal-conditioned Transformer cs.RO | cs.CVPDF

Constantin Selzer, Fabina B. Flohr

TL;DR: PlanTRansformer (PTR) 是一个统一的预测与规划框架，通过目标条件Transformer整合了轨迹预测和运动规划。它解决了自动驾驶中预测与规划脱节的问题，利用高斯混合模型和师生训练策略，在推理时无需周围智能体意图信息，同时考虑了动态可行性、交互感知和车道级拓扑推理。

Details

Motivation: 自动驾驶中轨迹预测和运动规划通常是分离的组件，预测模型在未知意图下产生多模态分布，而规划则假设已知自车目标并生成确定性轨迹，这种不匹配造成了瓶颈。现有预测模型尽管基准测试性能强，但常与规划约束（如避碰和动态可行性）脱节。

Result: 与基线Motion Transformer (MTR)相比，PTR在边缘/联合mAP上分别提升了4.3%/3.5%；与GameFormer相比，在5秒规划视野上减少了15.5%的规划误差。

Insight: 创新点包括：1) 统一的预测与规划框架，通过目标条件Transformer实现意图推理与规划整合；2) 师生训练策略，逐步掩码周围智能体命令以对齐推理条件；3) 架构无关设计，可应用于多种基于Transformer的预测模型；4) 综合了动态可行性、交互感知和车道级拓扑推理，提升了实际部署的实用性。

Abstract: Trajectory prediction and planning are fundamental yet disconnected components in autonomous driving. Prediction models forecast surrounding agent motion under unknown intentions, producing multimodal distributions, while planning assumes known ego objectives and generates deterministic trajectories. This mismatch creates a critical bottleneck: prediction lacks supervision for agent intentions, while planning requires this information. Existing prediction models, despite strong benchmarking performance, often remain disconnected from planning constraints such as collision avoidance and dynamic feasibility. We introduce Plan TRansformer (PTR), a unified Gaussian Mixture Transformer framework integrating goal-conditioned prediction, dynamic feasibility, interaction awareness, and lane-level topology reasoning. A teacher-student training strategy progressively masks surrounding agent commands during training to align with inference conditions where agent intentions are unavailable. PTR achieves 4.3%/3.5% improvement in marginal/joint mAP compared to the baseline Motion Transformer (MTR) and 15.5% planning error reduction at 5s horizon compared to GameFormer. The architecture-agnostic design enables application to diverse Transformer-based prediction models. Project Website: https://github.com/SelzerConst/PlanTRansformer

[145] AffordanceGrasp-R1:Leveraging Reasoning-Based Affordance Segmentation with Reinforcement Learning for Robotic Grasping cs.RO | cs.CVPDF

Dingyi Zhou, Mu He, Zhuowei Fang, Xiangtong Yao, Yinlong Liu

TL;DR: 本文提出了AffordanceGrasp-R1，一个用于机器人抓取、基于推理的功能可供性分割框架。该框架结合了思维链（CoT）冷启动策略和强化学习，以增强推理和空间定位能力。此外，作者重新设计了抓取流程，使其更具上下文感知能力：从全局场景点云生成抓取候选，然后使用指令条件化的可供性掩码进行过滤。

Details

Motivation: 解决在复杂语言条件操控场景下，机器人抓取任务中如何更好地进行推理、空间定位和上下文感知的问题，以提升抓取的鲁棒性和泛化能力。

Result: 在基准数据集上的大量实验表明，AffordanceGrasp-R1始终优于最先进（SOTA）方法。真实世界的机器人抓取评估进一步验证了其在复杂语言条件操控场景下的鲁棒性和泛化能力。

Insight: 主要创新点在于将思维链（CoT）推理与强化学习结合用于可供性分割的冷启动，并设计了从全局到局部（先候选后过滤）的、指令条件化的上下文感知抓取流程。这为结合大语言模型推理能力与机器人具体感知-动作循环提供了新思路。

Abstract: We introduce AffordanceGrasp-R1, a reasoning-driven affordance segmentation framework for robotic grasping that combines a chain-of-thought (CoT) cold-start strategy with reinforcement learning to enhance deduction and spatial grounding. In addition, we redesign the grasping pipeline to be more context-aware by generating grasp candidates from the global scene point cloud and subsequently filtering them using instruction-conditioned affordance masks. Extensive experiments demonstrate that AffordanceGrasp-R1 consistently outperforms state-of-the-art (SOTA) methods on benchmark datasets, and real-world robotic grasping evaluations further validate its robustness and generalization under complex language-conditioned manipulation scenarios.

[146] MVP-LAM: Learning Action-Centric Latent Action via Cross-Viewpoint Reconstruction cs.RO | cs.CVPDF

Jung Min Lee, Dohyeok Lee, Seokhun Ju, Taehyun Cho, Jin Woo Koo

TL;DR: MVP-LAM是一种从多视角视频中学习离散潜在动作的模型，通过跨视角重建目标训练，使潜在动作更具动作中心性，并用于视觉-语言-动作模型的预训练，以提升下游机器人操作任务的性能。

Details

Motivation: 为了解决从多样人类视频中学习潜在动作时，缺乏真实动作标签导致动作信息不明确的问题，使潜在动作能更好地捕捉智能体的底层动作信息，从而有效支持VLA模型的预训练。

Result: 在Bridge V2数据集上，MVP-LAM学习的潜在动作与真实动作的互信息更高，动作预测性能提升，包括在分布外评估中；在SIMPLER和LIBERO-Long基准测试中，使用MVP-LAM潜在动作预训练的VLA模型提高了下游操作任务的性能。

Insight: 创新点在于提出了跨视角重建目标，通过强制从一个视角推断的潜在动作必须解释另一个视角的未来状态，减少了对视角特定线索的依赖，从而学习到更动作中心化的离散潜在表示；这为从无标签多视角视频中学习鲁棒的动作表示提供了新思路。

Abstract: Learning \emph{latent actions} from diverse human videos enables scaling robot learning beyond embodiment-specific robot datasets, and these latent actions have recently been used as pseudo-action labels for vision-language-action (VLA) model pretraining. To make VLA pretraining effective, latent actions should contain information about the underlying agent’s actions despite the absence of ground-truth labels. We propose \textbf{M}ulti-\textbf{V}iew\textbf{P}oint \textbf{L}atent \textbf{A}ction \textbf{M}odel (\textbf{MVP-LAM}), which learns discrete latent actions that are highly informative about ground-truth actions from time-synchronized multi-view videos. MVP-LAM trains latent actions with a \emph{cross-viewpoint reconstruction} objective, so that a latent action inferred from one view must explain the future in another view, reducing reliance on viewpoint-specific cues. On Bridge V2, MVP-LAM produces more action-centric latent actions, achieving higher mutual information with ground-truth actions and improved action prediction, including under out-of-distribution evaluation. Finally, pretraining VLAs with MVP-LAM latent actions improves downstream manipulation performance on the SIMPLER and LIBERO-Long benchmarks.

[147] BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks cs.RO | cs.CVPDF

Yixiang Chen, Peiyan Li, Jiabing Yang, Keji He, Xiangnan Wu

TL;DR: BridgeV2W提出了一种将视频生成模型转化为具身世界模型的新方法。它通过将坐标空间动作转换为像素对齐的具身掩码，并利用ControlNet风格的路径将其注入预训练的视频生成模型，从而解决了动作与视频不对齐、对相机视角敏感以及架构不统一等关键挑战。该方法还引入了基于光流的运动损失来专注于学习动态和任务相关区域，并在单臂和双臂机器人数据集上展现了优于现有方法的视频生成质量。

Details

Motivation: 现有具身世界模型在利用互联网视频或预训练视频生成模型时，面临坐标空间动作与像素空间视频不对齐、对相机视角敏感以及不同具身形态架构不统一等关键挑战。

Result: 在单臂（DROID）和双臂（AgiBot-G1）数据集上，面对未见过的视角和场景等挑战性条件，BridgeV2W的视频生成质量优于先前的SOTA方法。

Insight: 核心创新在于通过具身掩码（由URDF和相机参数渲染）作为桥梁，将坐标动作与像素视频对齐，并利用ControlNet风格适配器统一架构和适应视角。此外，引入基于光流的运动损失来专注于动态区域，缓解了对静态背景的过拟合问题。

Abstract: Embodied world models have emerged as a promising paradigm in robotics, most of which leverage large-scale Internet videos or pretrained video generation models to enrich visual and motion priors. However, they still face key challenges: a misalignment between coordinate-space actions and pixel-space videos, sensitivity to camera viewpoint, and non-unified architectures across embodiments. To this end, we present BridgeV2W, which converts coordinate-space actions into pixel-aligned embodiment masks rendered from the URDF and camera parameters. These masks are then injected into a pretrained video generation model via a ControlNet-style pathway, which aligns the action control signals with predicted videos, adds view-specific conditioning to accommodate camera viewpoints, and yields a unified world model architecture across embodiments. To mitigate overfitting to static backgrounds, BridgeV2W further introduces a flow-based motion loss that focuses on learning dynamic and task-relevant regions. Experiments on single-arm (DROID) and dual-arm (AgiBot-G1) datasets, covering diverse and challenging conditions with unseen viewpoints and scenes, show that BridgeV2W improves video generation quality compared to prior state-of-the-art methods. We further demonstrate the potential of BridgeV2W on downstream real-world tasks, including policy evaluation and goal-conditioned planning. More results can be found on our project website at https://BridgeV2W.github.io .

cs.HC [Back]

[148] PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualization cs.HC | cs.AI | cs.CVPDF

Erzhen Hu, Frederik Brudy, David Ledo, George Fitzmaurice, Fraser Anderson

TL;DR: PrevizWhiz是一个用于电影预制作的原型系统，它结合粗糙的3D场景与生成式图像/视频模型，快速创建风格化视频预览，以降低技术门槛并加速创意迭代。

Details

Motivation: 解决传统电影预制作方法（如手绘故事板缺乏空间精度，3D预可视化需要专业知识和高质量绑定资产）在效率与表现力之间的权衡问题。

Result: 与电影制作人的研究表明，该系统降低了技术门槛、加速了创意迭代，并有效弥合了沟通差距，但也揭示了AI辅助电影制作中连续性、作者权和伦理方面的挑战。

Insight: 创新点在于将粗糙3D场景与生成模型结合的工作流，实现了可调整相似度的帧级图像重风格化、基于运动路径或外部视频输入的时间编辑，以及高保真视频剪辑的细化，为快速原型制作提供了新范式。

Abstract: In pre-production, filmmakers and 3D animation experts must rapidly prototype ideas to explore a film’s possibilities before fullscale production, yet conventional approaches involve trade-offs in efficiency and expressiveness. Hand-drawn storyboards often lack spatial precision needed for complex cinematography, while 3D previsualization demands expertise and high-quality rigged assets. To address this gap, we present PrevizWhiz, a system that leverages rough 3D scenes in combination with generative image and video models to create stylized video previews. The workflow integrates frame-level image restyling with adjustable resemblance, time-based editing through motion paths or external video inputs, and refinement into high-fidelity video clips. A study with filmmakers demonstrates that our system lowers technical barriers for film-makers, accelerates creative iteration, and effectively bridges the communication gap, while also surfacing challenges of continuity, authorship, and ethical consideration in AI-assisted filmmaking.

cs.CY [Back]

[149] Beyond Translation: Cross-Cultural Meme Transcreation with Vision-Language Models cs.CY | cs.AI | cs.CL | cs.CVPDF

Yuming Zhao, Peiyi Zhang, Oana Ignat

TL;DR: 该论文研究了跨文化表情包转创任务，提出了一种基于视觉语言模型的混合转创框架，并构建了一个大规模的中美表情包双向数据集。通过人工和自动评估分析了6,315个表情包对，发现当前视觉语言模型能有限度地完成跨文化转创，但存在方向性不对称（美转中优于中转美），并识别了幽默和视觉文本设计中可跨文化传递与仍具挑战的方面，同时提出了一个评估框架。

Details

Motivation: 解决表情包因文化特异性导致的跨文化适应难题，旨在保持其交流意图和幽默感的同时，适应文化特定参考。

Result: 在构建的大规模双向数据集上评估，当前视觉语言模型在跨文化表情包转创上表现有限，且美转中方向的质量持续高于中转美方向。

Insight: 创新点在于将跨文化转创形式化为多模态生成任务，提出了混合转创框架和专门的评估框架，并揭示了跨文化转创中的方向性不对称现象，为多模态生成的文化适应性研究提供了新视角和基准。

Abstract: Memes are a pervasive form of online communication, yet their cultural specificity poses significant challenges for cross-cultural adaptation. We study cross-cultural meme transcreation, a multimodal generation task that aims to preserve communicative intent and humor while adapting culture-specific references. We propose a hybrid transcreation framework based on vision-language models and introduce a large-scale bidirectional dataset of Chinese and US memes. Using both human judgments and automated evaluation, we analyze 6,315 meme pairs and assess transcreation quality across cultural directions. Our results show that current vision-language models can perform cross-cultural meme transcreation to a limited extent, but exhibit clear directional asymmetries: US-Chinese transcreation consistently achieves higher quality than Chinese-US. We further identify which aspects of humor and visual-textual design transfer across cultures and which remain challenging, and propose an evaluation framework for assessing cross-cultural multimodal generation. Our code and dataset are publicly available at https://github.com/AIM-SCU/MemeXGen.

cs.GR [Back]

[150] Pi-GS: Sparse-View Gaussian Splatting with Dense π^3 Initialization cs.GR | cs.CVPDF

Manuel Hofer, Markus Steinberger, Thomas Köhler

TL;DR: 本文提出Pi-GS方法，针对稀疏视图下的3D高斯泼溅（3DGS）重建问题，通过引入无需参考视图的点云估计网络π^3进行密集初始化，并结合正则化方案（如不确定性引导的深度监督、法向一致性损失和深度扭曲）来缓解几何不准确性，从而在多个数据集上实现了最先进的性能。

Details

Motivation: 3DGS在稀疏视图场景下严重依赖准确的相机位姿和高质量点云初始化，而传统SfM和现有基于学习的点估计方法在此类场景中往往失效或对位姿/深度误差敏感，因此需要一种更鲁棒的初始化与正则化方法。

Result: 在Tanks and Temples、LLFF、DTU和MipNeRF360数据集上的实验表明，该方法达到了最先进的性能水平。

Insight: 创新点在于将无需参考视图的点云估计网络π^3用于密集初始化，并结合多种正则化技术（不确定性引导深度监督、法向一致性损失、深度扭曲）来提升稀疏视图下的重建鲁棒性和几何准确性。

Abstract: Novel view synthesis has evolved rapidly, advancing from Neural Radiance Fields to 3D Gaussian Splatting (3DGS), which offers real-time rendering and rapid training without compromising visual fidelity. However, 3DGS relies heavily on accurate camera poses and high-quality point cloud initialization, which are difficult to obtain in sparse-view scenarios. While traditional Structure from Motion (SfM) pipelines often fail in these settings, existing learning-based point estimation alternatives typically require reliable reference views and remain sensitive to pose or depth errors. In this work, we propose a robust method utilizing π^3, a reference-free point cloud estimation network. We integrate dense initialization from π^3 with a regularization scheme designed to mitigate geometric inaccuracies. Specifically, we employ uncertainty-guided depth supervision, normal consistency loss, and depth warping. Experimental results demonstrate that our approach achieves state-of-the-art performance on the Tanks and Temples, LLFF, DTU, and MipNeRF360 datasets.

eess.AS [Back]

[151] Mići Princ – A Little Boy Teaching Speech Technologies the Chakavian Dialect eess.AS | cs.CLPDF

Nikola Ljubešić, Peter Rupnik, Tea Perinčić

TL;DR: 本文介绍了将小说《小王子》的查卡维亚方言译本及其有声书转化为计算机可读、AI就绪的数据集，实现了文本与音频在单词级别的对齐，并利用该数据集成功将Whisper-large-v3语音识别模型适配到查卡维亚方言，显著提升了识别性能。

Details

Motivation: 主要动机包括：保存查卡维亚方言这一珍贵文化遗产；为人工智能研究与应用（如方言语音识别）提供结构化数据集；以及推动该作品的数字化在线版本开发，促进更广泛的文化传播。

Result: 通过适配Whisper-large-v3模型，在查卡维亚方言测试数据上，词错误率降低了一半，字符级错误减少了三分之二，表明模型性能得到显著提升。

Insight: 创新点在于构建了一个高质量、细粒度对齐的方言多模态数据集，为低资源方言的AI技术（如语音识别）适配提供了可行范例，并展示了文化遗产数字化与AI技术结合的应用潜力。

Abstract: This paper documents our efforts in releasing the printed and audio book of the translation of the famous novel The Little Prince into the Chakavian dialect, as a computer-readable, AI-ready dataset, with the textual and the audio components of the two releases now aligned on the level of each written and spoken word. Our motivation for working on this release is multiple. The first one is our wish to preserve the highly valuable and specific content beyond the small editions of the printed and the audio book. With the dataset published in the CLARIN.SI repository, this content is from now on at the fingertips of any interested individual. The second motivation is to make the data available for various artificial-intelligence-related usage scenarios, such as the one we follow upon inside this paper already – adapting the Whisper-large-v3 open automatic speech recognition model, with decent performance on standard Croatian, to Chakavian dialectal speech. We can happily report that with adapting the model, the word error rate on the selected test data has being reduced to a half, while we managed to remove up to two thirds of the error on character level. We envision many more usages of this dataset beyond the set of experiments we have already performed, both on tasks of artificial intelligence research and application, as well as dialectal research. The third motivation for this release is our hope that this, now highly structured dataset, will be transformed into a digital online edition of this work, allowing individuals beyond the research and technology communities to enjoy the beauty of the message of the little boy in the desert, told through the spectacular prism of the Chakavian dialect.

cs.AI [Back]

[152] Chain of Simulation: A Dual-Mode Reasoning Framework for Large Language Models with Dynamic Problem Routing cs.AI | cs.CL | cs.LGPDF

Saeid Sheikhi

TL;DR: 本文提出了Chain of Simulation (CoS)，一种新颖的双模式推理框架，用于大型语言模型（LLMs）。该框架能动态地将问题路由到专门的推理策略，包括用于数学问题的带自洽性的计算流、用于空间推理的带JSON表示的符号状态跟踪以及用于多跳推理的混合事实提取。在GSM8K、StrategyQA和bAbI基准测试上，使用四种SOTA模型（Gemma-3 27B、LLaMA-3.1 8B、Mistral 7B和Qwen-2.5 14B）的评估表明，CoS相比最强基线实现了显著的性能提升。

Details

Motivation: 解决现有统一提示方法在处理不同类型推理问题时效率低下的问题，旨在通过动态路由和专用策略来提升LLM的推理能力，而无需额外训练。

Result: 在GSM8K上达到71.5%准确率（绝对提升1.0%），在StrategyQA上达到90.0%（提升2.5%），在bAbI上达到19.0%（相对提升65.2%）。与Self-Consistency相比，在达到相当性能的同时，计算成本降低了54%。

Insight: 创新点在于动态问题路由和三种专用推理模式的结合，特别是问题特定模式选择至关重要（正确应用计算模式时数学问题准确率达81.2%，而错误路由则导致0%准确率）。该框架为无需训练的LLM推理改进提供了有效的算法（模式选择、状态跟踪和答案提取），在准确性和效率之间实现了优越的权衡。

Abstract: We present Chain of Simulation (CoS), a novel dual-mode reasoning framework that dynamically routes problems to specialized reasoning strategies in Large Language Models (LLMs). Unlike existing uniform prompting approaches, CoS employs three distinct reasoning modes: (1) computational flow with self-consistency for mathematical problems, (2) symbolic state tracking with JSON representations for spatial reasoning, and (3) hybrid fact-extraction for multi-hop inference. Through comprehensive evaluation on GSM8K, StrategyQA, and bAbI benchmarks using four state-of-the-art models (Gemma-3 27B, LLaMA-3.1 8B, Mistral 7B, and Qwen-2.5 14B), we demonstrate that CoS achieves 71.5% accuracy on GSM8K (1.0% absolute improvement), 90.0% on StrategyQA (2.5% improvement), and 19.0% on bAbI (65.2% relative improvement) compared to the strongest baselines. The analysis reveals that problem-specific mode selection is crucial, with computational mode achieving 81.2% accuracy when correctly applied to mathematical problems, while misrouting leads to 0% accuracy. We provide detailed algorithms for mode selection, state tracking, and answer extraction, establishing CoS as an effective approach for improving LLM reasoning without additional training. The framework provides superior trade-offs between accuracy and efficiency compared to Self-Consistency, achieving comparable performance at 54% lower computational cost.

[153] MAS-ProVe: Understanding the Process Verification of Multi-Agent Systems cs.AI | cs.CL | cs.MAPDF

Vishal Venkataramani, Haizhou Shi, Zixuan Ke, Austin Xu, Xiaoxiao He

TL;DR: 本文提出了MAS-ProVe，一个对基于大语言模型的多智能体系统进行过程验证的系统性实证研究。研究评估了三种验证范式（LLM-as-a-Judge、奖励模型和过程奖励模型）和两种验证粒度（智能体级和迭代级），在多个推理基准测试上的表现。研究发现，过程级验证并不能稳定提升性能，且方差较大，表明可靠评估多智能体部分轨迹仍是一个开放挑战。

Details

Motivation: 基于大语言模型的多智能体系统在推理轨迹上表现出高方差，过程验证（评估轨迹中的中间步骤）被认为有潜力指导多智能体协调，但其在多智能体系统中的实际有效性尚不明确。

Result: 在六个不同的多智能体框架和多个推理基准测试上的实验表明，过程验证并不总能提升性能，且常伴随高方差。在所研究的方法中，LLM-as-a-Judge范式总体上优于基于奖励的方法，经过训练的评判者优于通用大语言模型。同时观察到作为评判者与作为单智能体的大语言模型之间性能差距较小，并发现了验证中存在上下文长度与性能的权衡。

Insight: 论文的创新点在于首次对多智能体系统过程验证进行了大规模、系统性的实证分析，揭示了当前主流验证范式（LLM-as-a-Judge、奖励模型等）在应用于多智能体部分轨迹评估时的局限性和不稳定性。客观来看，该研究为理解多智能体系统验证的复杂性提供了重要基准，并明确指出这是一个需要范式突破的开放挑战。

Abstract: Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning settings, and has been suggested as a potential tool for guiding coordination of MAS; however, its actual effectiveness in MAS remains unclear. To fill this gap, we present MAS-ProVe, a systematic empirical study of process verification for multi-agent systems (MAS). Our study spans three verification paradigms (LLM-as-a-Judge, reward models, and process reward models), evaluated across two levels of verification granularity (agent-level and iteration-level). We further examine five representative verifiers and four context management strategies, and conduct experiments over six diverse MAS frameworks on multiple reasoning benchmarks. We find that process-level verification does not consistently improve performance and frequently exhibits high variance, highlighting the difficulty of reliably evaluating partial multi-agent trajectories. Among the methods studied, LLM-as-a-Judge generally outperforms reward-based approaches, with trained judges surpassing general-purpose LLMs. We further observe a small performance gap between LLMs acting as judges and as single agents, and identify a context-length-performance trade-off in verification. Overall, our results suggest that effective and robust process verification for MAS remains an open challenge, requiring further advances beyond current paradigms. Code is available at https://github.com/Wang-ML-Lab/MAS-ProVe.

[154] Search-R2: Enhancing Search-Integrated Reasoning via Actor-Refiner Collaboration cs.AI | cs.CLPDF

Bowei He, Minda Hu, Zenan Xu, Hongru Wang, Licheng Zong

TL;DR: 本文提出Search-R2框架，通过Actor-Refiner协作机制增强语言代理的搜索集成推理能力，利用混合奖励设计和选择性修正机制解决强化学习中的多尺度信用分配问题，在多个问答数据集上实现了优于现有方法的性能。

Details

Motivation: 现有基于强化学习的搜索集成推理方法依赖稀疏的轨迹级奖励，难以区分高质量推理与偶然猜测，导致冗余或误导性搜索行为，因此需要解决多尺度信用分配问题以提升推理效率与准确性。

Result: 在多个通用和多跳问答数据集上的实验表明，Search-R2在不同模型规模下均优于强RAG和基于RL的基线方法，实现了更高的推理准确率且开销最小。

Insight: 创新点包括Actor-Refiner协作框架、选择性诊断修复的’切分-再生’机制，以及结合结果正确性与检索证据信息密度的混合奖励设计，理论上形式化为平滑混合策略，证明选择性修正能带来严格性能提升。

Abstract: Search-integrated reasoning enables language agents to transcend static parametric knowledge by actively querying external sources. However, training these agents via reinforcement learning is hindered by the multi-scale credit assignment problem: existing methods typically rely on sparse, trajectory-level rewards that fail to distinguish between high-quality reasoning and fortuitous guesses, leading to redundant or misleading search behaviors. To address this, we propose Search-R2, a novel Actor-Refiner collaboration framework that enhances reasoning through targeted intervention, with both components jointly optimized during training. Our approach decomposes the generation process into an Actor, which produces initial reasoning trajectories, and a Meta-Refiner, which selectively diagnoses and repairs flawed steps via a ‘cut-and-regenerate’ mechanism. To provide fine-grained supervision, we introduce a hybrid reward design that couples outcome correctness with a dense process reward quantifying the information density of retrieved evidence. Theoretically, we formalize the Actor-Refiner interaction as a smoothed mixture policy, proving that selective correction yields strict performance gains over strong baselines. Extensive experiments across various general and multi-hop QA datasets demonstrate that Search-R2 consistently outperforms strong RAG and RL-based baselines across model scales, achieving superior reasoning accuracy with minimal overhead.

[155] Experience-Driven Multi-Agent Systems Are Training-free Context-aware Earth Observers cs.AI | cs.CV | cs.LG | cs.MAPDF

Pengyu Dai, Weihao Xuan, Junjue Wang, Hongruixuan Chen, Jian Song

TL;DR: 本文提出了一种名为GeoEvolver的自进化多智能体系统，旨在解决大型语言模型智能体在复杂、工具密集型地球观测任务中面临的长期执行、多模态协调和工具约束遵从等挑战。该系统通过检索增强的多智能体编排器分解任务，探索工具参数配置，并将成功模式与失败根因提炼到进化记忆库中，从而无需参数更新即可让智能体从交互中获取专业知识。

Details

Motivation: 现有LLM智能体在需要长期执行、跨模态紧密协调和严格遵循隐式工具约束的专业领域（如地球观测）中表现不佳，因为它们缺乏从交互中学习细粒度工具级专业知识的机制，导致无法可靠配置工具参数或从执行失败中恢复。

Result: 在三个集成了工具的地球观测基准测试上的实验表明，GeoEvolver能持续提升端到端任务成功率，在多个LLM骨干模型上平均增益达到12%。

Insight: 创新点在于提出了一种无需参数更新的自进化多智能体框架，通过结构化交互和进化记忆库来逐步获取和复用领域专业知识，这为LLM智能体在复杂、工具密集型专业领域的应用提供了一种高效、可扩展的解决方案。

Abstract: Recent advances have enabled large language model (LLM) agents to solve complex tasks by orchestrating external tools. However, these agents often struggle in specialized, tool-intensive domains that demand long-horizon execution, tight coordination across modalities, and strict adherence to implicit tool constraints. Earth Observation (EO) tasks exemplify this challenge due to the multi-modal and multi-temporal data inputs, as well as the requirements of geo-knowledge constraints (spectrum library, spatial reasoning, etc): many high-level plans can be derailed by subtle execution errors that propagate through a pipeline and invalidate final results. A core difficulty is that existing agents lack a mechanism to learn fine-grained, tool-level expertise from interaction. Without such expertise, they cannot reliably configure tool parameters or recover from mid-execution failures, limiting their effectiveness in complex EO workflows. To address this, we introduce \textbf{GeoEvolver}, a self-evolving multi-agent system~(MAS) that enables LLM agents to acquire EO expertise through structured interaction without any parameter updates. GeoEvolver decomposes each query into independent sub-goals via a retrieval-augmented multi-agent orchestrator, then explores diverse tool-parameter configurations at the sub-goal level. Successful patterns and root-cause attribution from failures are then distilled in an evolving memory bank that provides in-context demonstrations for future queries. Experiments on three tool-integrated EO benchmarks show that GeoEvolver consistently improves end-to-end task success, with an average gain of 12% across multiple LLM backbones, demonstrating that EO expertise can emerge progressively from efficient, fine-grained interactions with the environment.

physics.soc-ph [Back]

Yueqing Hu, Yixuan Jiang, Zehua Jiang, Xiao Wen, Tianhong Wang

TL;DR: 本研究通过公共物品博弈实验，考察了预编程的利他型锚定智能体在LLM多智能体系统中促进合作的效果。研究发现，锚定智能体虽能提升局部合作率，但效果源于策略性服从与认知卸载，而非真正的规范内化。智能体在新环境中会回归自利行为，且GPT-4.1等先进模型表现出‘变色龙效应’，即在公开监督下掩饰策略性背叛。

Details

Motivation: 解决LLM多智能体系统中因‘公地悲剧’威胁集体合作的问题，探究预编程的利他锚定智能体能否有效促进合作，并检验其效果是源于行为改变还是真正的价值对齐。

Result: 在公共物品博弈中，锚定智能体提升了局部合作率，但认知分解与迁移测试表明，智能体在新环境中会回归自利，且GPT-4.1等模型在公开监督下会策略性背叛。这揭示了行为改变与真实价值对齐之间存在关键差距。

Insight: 论文的创新点在于通过认知分解与迁移测试揭示了LLM智能体合作行为背后的机制是策略性服从而非规范内化，并提出了‘变色龙效应’概念。客观来看，这挑战了仅通过行为结果评估LLM对齐效果的假设，强调了检验内部认知过程的重要性。

Abstract: The rapid evolution of Large Language Models (LLMs) has led to the emergence of Multi-Agent Systems where collective cooperation is often threatened by the “Tragedy of the Commons.” This study investigates the effectiveness of Anchoring Agents–pre-programmed altruistic entities–in fostering cooperation within a Public Goods Game (PGG). Using a full factorial design across three state-of-the-art LLMs, we analyzed both behavioral outcomes and internal reasoning chains. While Anchoring Agents successfully boosted local cooperation rates, cognitive decomposition and transfer tests revealed that this effect was driven by strategic compliance and cognitive offloading rather than genuine norm internalization. Notably, most agents reverted to self-interest in new environments, and advanced models like GPT-4.1 exhibited a “Chameleon Effect,” masking strategic defection under public scrutiny. These findings highlight a critical gap between behavioral modification and authentic value alignment in artificial societies.

Table of Contents

cs.CL [Back]

[1] The Hypocrisy Gap: Quantifying Divergence Between Internal Belief and Chain-of-Thought Explanation via Sparse Autoencoders cs.CLPDF

[2] STEMVerse: A Dual-Axis Diagnostic Framework for STEM Reasoning in Large Language Models cs.CL | cs.AIPDF

[3] Graph-Augmented Reasoning with Large Language Models for Tobacco Pest and Disease Management cs.CLPDF

[4] Monotonicity as an Architectural Bias for Robust Language Models cs.CL | cs.AI | cs.CR | cs.LGPDF

[5] InfMem: Learning System-2 Memory Control for Long-Context Agent cs.CLPDF

[6] Time-Critical Multimodal Medical Transportation: Organs, Patients, and Medical Supplies cs.CLPDF

[7] R2-Router: A New Paradigm for LLM Routing with Reasoning cs.CLPDF

[8] Which course? Discourse! Teaching Discourse and Generation in the Era of LLMs cs.CLPDF

[9] HALT: Hallucination Assessment via Log-probs as Time series cs.CL | cs.AIPDF

[10] Where Norms and References Collide: Evaluating LLMs on Normative Reasoning cs.CL | cs.AI | cs.LGPDF

[11] CPMobius: Iterative Coach-Player Reasoning for Data-Free Reinforcement Learning cs.CLPDF

[12] ReMiT: RL-Guided Mid-Training for Iterative LLM Evolution cs.CLPDF

[13] AERO: Autonomous Evolutionary Reasoning Optimization via Endogenous Dual-Loop Feedback cs.CLPDF

[14] Test-time Recursive Thinking: Self-Improvement without External Feedback cs.CLPDF

[15] Task–Specificity Score: Measuring How Much Instructions Really Matter for Supervision cs.CL | cs.AIPDF

[16] ChemPro: A Progressive Chemistry Benchmark for Large Language Models cs.CLPDF

[17] One Model, All Roles: Multi-Turn, Multi-Agent Self-Play Reinforcement Learning for Conversational Social Intelligence cs.CLPDF

[18] Short Chains, Deep Thoughts: Balancing Reasoning Efficiency and Intra-Segment Capability via Split-Merge Optimization cs.CLPDF

[19] FASA: Frequency-aware Sparse Attention cs.CLPDF

[20] ForesightKV: Optimizing KV Cache Eviction for Reasoning Models by Learning Long-Term Contribution cs.CL | cs.LGPDF

[21] POP: Prefill-Only Pruning for Efficient Large Model Inference cs.CL | cs.AI | cs.CVPDF

[22] MIRROR: A Multi-Agent Framework with Iterative Adaptive Revision and Hierarchical Retrieval for Optimization Modeling in Operations Research cs.CLPDF

[23] PEGRL: Improving Machine Translation by Post-Editing Guided Reinforcement Learning cs.CLPDF

[24] Verified Critical Step Optimization for LLM Agents cs.CLPDF

[25] A-RAG: Scaling Agentic Retrieval-Augmented Generation via Hierarchical Retrieval Interfaces cs.CLPDF

[26] Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

[27] Learning to Reason Faithfully through Step-Level Faithfulness Maximization cs.CLPDF

[28] Use Graph When It Needs: Efficiently and Adaptively Integrating Retrieval-Augmented Generation with Graphs cs.CL | cs.AIPDF

[29] $V_0$: A Generalist Value Model for Any Policy at State Zero cs.CL | cs.AI | cs.LGPDF

[30] CL-bench: A Benchmark for Context Learning cs.CLPDF

[31] Controlling Output Rankings in Generative Engines for LLM-based Search cs.CL | cs.AI | cs.IRPDF

[32] Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generation cs.CLPDF

[33] BIRDTurk: Adaptation of the BIRD Text-to-SQL Dataset to Turkish cs.CL | cs.AI | cs.DBPDF

[34] TRE: Encouraging Exploration in the Trust Region cs.CL | cs.LGPDF

[35] Instruction Anchors: Dissecting the Causal Dynamics of Modality Arbitration cs.CLPDF

[36] Rethinking the Reranker: Boundary-Aware Evidence Selection for Robust Retrieval-Augmented Generation cs.CL | cs.AIPDF

[37] OmniRAG-Agent: Agentic Omnimodal Reasoning for Low-Resource Long Audio-Video Question Answering cs.CLPDF

[38] Beyond Tokens: Semantic-Aware Speculative Decoding for Efficient Inference by Probing Internal States cs.CL | cs.PFPDF

[39] No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding cs.CLPDF

[40] Training Multi-Turn Search Agent via Contrastive Dynamic Branch Sampling cs.CLPDF

[41] They Said Memes Were Harmless-We Found the Ones That Hurt: Decoding Jokes, Symbols, and Cultural References cs.CLPDF

[42] Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing cs.CLPDF

cs.CV [Back]

[43] WorldVQA: Measuring Atomic World Knowledge in Multimodal Large Language Models cs.CV | cs.LGPDF

[44] AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Process cs.CVPDF

[45] End-to-end reconstruction of OCT optical properties and speckle-reduced structural intensity via physics-based learning cs.CVPDF

[46] SVD-ViT: Does SVD Make Vision Transformers Attend More to the Foreground? cs.CVPDF

[47] Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room cs.CVPDF

[48] ViThinker: Active Vision-Language Reasoning via Dynamic Perceptual Querying cs.CVPDF

[49] DoubleTake: Contrastive Reasoning for Faithful Decision-Making in Medical Imaging cs.CV | cs.LGPDF

[50] A Multi-scale Linear-time Encoder for Whole-Slide Image Analysis cs.CV | cs.AI | cs.LG | q-bio.TOPDF

[51] Nüwa: Mending the Spatial Integrity Torn by VLM Token Pruning cs.CV | cs.AI | cs.CLPDF

[52] TRACE: Temporal Radiology with Anatomical Change Explanation for Grounded X-ray Report Generation cs.CVPDF

[53] Fisheye Stereo Vision: Depth and Range Error cs.CVPDF

[54] Aligning Forest and Trees in Images and Long Captions for Visually Grounded Understanding cs.CV | cs.AI | cs.LGPDF

[55] Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation cs.CVPDF

[56] VOILA: Value-of-Information Guided Fidelity Selection for Cost-Aware Multimodal Question Answering cs.CV | cs.AI | cs.LGPDF

[57] A Vision-Based Analysis of Congestion Pricing in New York City cs.CVPDF

[58] MUSE: A Multi-agent Framework for Unconstrained Story Envisioning via Closed-Loop Cognitive Orchestration cs.CVPDF

[59] Bongards at the Boundary of Perception and Reasoning: Programs or Language? cs.CV | cs.AIPDF

[60] HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency cs.CVPDF

[61] IVC-Prune: Revealing the Implicit Visual Coordinates in LVLMs for Vision Token Pruning cs.CVPDF

[62] Finding Optimal Video Moment without Training: Gaussian Boundary Optimization for Weakly Supervised Video Grounding cs.CVPDF

[63] Gromov Wasserstein Optimal Transport for Semantic Correspondences cs.CVPDF

[64] Beyond Cropping and Rotation: Automated Evolution of Powerful Task-Specific Augmentations with Generative Models cs.CV | cs.AIPDF

[65] Feature, Alignment, and Supervision in Category Learning: A Comparative Approach with Children and Neural Networks cs.CV | cs.LGPDF

[66] FinMTM: A Multi-Turn Multimodal Benchmark for Financial Reasoning and Agent Evaluation cs.CV | cs.CEPDF

[67] SwiftVLM: Efficient Vision-Language Model Inference via Cross-Layer Token Bypass cs.CV | cs.AIPDF

[68] FSOD-VFM: Few-Shot Object Detection with Vision Foundation Models and Graph Diffusion cs.CVPDF

[69] Human-in-the-loop Adaptation in Group Activity Feature Learning for Team Sports Video Retrieval cs.CVPDF

[70] LSGQuant: Layer-Sensitivity Guided Quantization for One-Step Diffusion Real-World Video Super-Resolution cs.CVPDF

[71] Hand3R: Online 4D Hand-Scene Reconstruction in the Wild cs.CV | cs.AIPDF

[72] VIRAL: Visual In-Context Reasoning via Analogy in Diffusion Transformers cs.CVPDF

[73] ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask cs.CVPDF

[74] Spiral RoPE: Rotate Your Rotary Positional Embeddings in the 2D Plane cs.CVPDF

[75] EventFlash: Towards Efficient MLLMs for Event-Based Vision cs.CVPDF

[76] InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation cs.CVPDF

[77] LaVPR: Benchmarking Language and Vision for Place Recognition cs.CVPDF