cs.CL [Total: 13]
cs.CV [Total: 42]
cs.RO [Total: 3]
cs.DB [Total: 1]
cs.MM [Total: 2]
eess.IV [Total: 1]
cs.AI [Total: 10]
cs.CY [Total: 2]
cs.LG [Total: 4]
physics.optics [Total: 1]

cs.CL [Back]

[1] Think in Latent, Explain in Language: Self-Explainable Latent Reasoning cs.CL | cs.AI | cs.LGPDF

Dayuan Zhao, Shengcao Cao, Yu-Xiong Wang, Liang-Yan Gui

TL;DR: 本文提出了一种自解释的潜在推理框架SELR，通过多任务训练目标，使单一模型能够同时执行高效的潜在推理并生成人类可理解的推理步骤，从而在保持计算效率的同时提升可解释性。

Details

Motivation: 现有潜在推理方法在压缩推理过程以提高效率时，往往牺牲了可解释性，要么成为不可解释的’黑盒’，要么依赖额外的后处理解码器，导致架构复杂且解释与推理过程脱节。

Result: 在大型语言模型和视觉语言模型上的实验表明，SELR在token效率和准确性上均优于基线方法，同时无需辅助模型即可提供自包含的解释能力。

Insight: 核心创新在于设计了一个统一的多任务训练目标，将答案损失和思维链损失结合，确保潜在表示既任务有效又语义可解释，实现了推理效率与透明度的统一。

Abstract: Latent reasoning has emerged as a powerful alternative to text-based Chain-of-Thought (CoT), offering significant gains in computational efficiency by compressing verbose reasoning into compact embeddings. However, compressing reasoning into the latent space renders the thinking opaque, hindering its interpretability. Current methods present a stark trade-off: they either function as unexplainable ‘’black boxes’’ (e.g., Coconut), where the latent reasoning is not human-readable, or rely on separate post-hoc decoders for explainability (e.g., Heima), introducing architectural overhead and decoupling the explanation from the actual reasoning process. In this work, we present a unified framework for Self-Explainable Latent Reasoning (SELR) that trains a single model to perform efficient and inherently explainable latent reasoning. Our core contribution is a novel multi-task training objective that optimizes for two goals simultaneously: (1) an Answer Loss that optimizes the latent reasoning trajectory to produce accurate final answers, and (2) a CoT Loss that explicitly trains the same model to decode its own latent representations back into human-understandable reasoning steps. This design ensures that generated latent representations are both task-effective and semantically interpretable, eliminating the need for external decoders. We validate the effectiveness of SELR on both Large Language Models (LLMs) and Vision-Language Models (VLMs), demonstrating that SELR achieves superior token efficiency and accuracy compared to baselines, while uniquely providing self-contained explainability without auxiliary models. Project page is available at https://jasondayuan.github.io/SELR/.

[2] Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems cs.CL | cs.AIPDF

Heming Fu, Shan Lin, Qianqian Xie, Guojun Xiong

TL;DR: 本文提出InflationAgent，一种四阶段路由系统，旨在解决LLM代理系统中因任务重试导致的令牌膨胀问题。该系统通过引入CoT分支熵（CBE）预测任务难度，并基于语义交换率（SER）选择模型，以在固定预算下优化准确性和令牌使用效率。

Details

Motivation: 现有系统（如FrugalGPT）基于单次调用成本进行路由，低估了困难任务中因重试导致的真实成本（令牌膨胀），可能使实际成本超过2倍。

Result: 在GSM8K基准测试中，InflationAgent在固定预算下达到94.7%准确率，优于FrugalGPT的91.0%，同时减少31%令牌使用；CBE预测高令牌膨胀的AUROC为0.887。

Insight: 创新点包括系统量化令牌膨胀、提出无需执行的本地推理难度信号CBE，以及基于SER和新鲜升级策略的路由机制，避免将失败推理链传递给更强模型导致的性能下降。

Abstract: When a language model fails to answer a query on the first attempt, an agentic system retries, consuming additional tokens each time. This retry overhead creates a gap between what a model’s per-token price implies and what a full workflow actually costs. We call this gap \emph{token inflation} and define it as the ratio of true workflow cost to single-call cost. Systems like FrugalGPT route based on the latter, which can underestimate real cost by more than $2\times$ on difficult tasks. We address this with InflationAgent, a four-stage router that (1) measures token inflation systematically across model tiers and task types, finding inflation as high as $4.25\times$ for a 7B model on multi-hop question answering; (2) introduces CoT Branching Entropy (CBE), a pre-execution difficulty signal computed entirely from local inference, which predicts high inflation with AUROC 0.887; and (3) selects models by maximizing a Semantic Exchange Rate (SER) that divides expected accuracy by predicted true cost, with a fresh-escalation policy that discards failed chains before routing to a stronger model. On GSM8K under a fixed budget, InflationAgent achieves 94.7% accuracy versus 91.0% for FrugalGPT while using 31% fewer tokens, and we show that forwarding a failed reasoning chain to GPT-4o reduces its accuracy by up to 34.8 percentage points, validating the fresh-escalation design.

[3] IterCOMP: Reasoning-aware Adaptive Prompt Compression for Multi-hop Question Answering cs.CL | cs.AIPDF

JungMin Yun, YoungBin Kim

TL;DR: IterCOMP是一种无需训练的统一提示压缩框架，专为多跳问答设计。它通过迭代压缩循环将多跳推理融入其中，将文档分解为证据片段、评估问题可答性并生成针对性后续问题，从而整合关键证据，生成紧凑且面向推理的提示。

Details

Motivation: 多跳问答需要在多个证据片段间进行复杂推理，而冗长嘈杂的上下文会淹没检索增强生成系统，影响效率和准确性。现有提示压缩方法通常针对单轮查询设计，无法捕捉相互依赖的推理步骤。

Result: 在MusiQue、2WikiMultiHopQA和HotpotQA基准测试中，IterCOMP在Exact Match和F1分数上取得显著提升，同时减少token预算，优于现有基线，并在推理复杂性增加时表现出鲁棒性。

Insight: 创新点在于将多跳推理过程整合到迭代压缩循环中，通过生成后续问题动态聚焦关键证据，实现训练无关的推理感知压缩。这提供了一种结构化的方法来压缩冗长上下文，同时保留推理所需的逻辑依赖关系。

Abstract: Multi-hop question answering requires complex reasoning across multiple evidence segments, which often overwhelms retrieval-augmented generation systems with lengthy and noisy contexts, thereby undermining both efficiency and accuracy. While existing prompt compression methods attempt to address this issue, they are typically designed for single-turn queries and fail to capture interdependent reasoning steps. We propose IterCOMP, a unified, training-free prompt compression framework that incorporates multi-hop reasoning within an iterative compression loop. IterCOMP decomposes documents into evidence segments, evaluates question answerability, and generates targeted follow-up questions to iteratively integrate essential evidence, producing a compact, reasoning-oriented prompt. Experiments on MusiQue, 2WikiMultiHopQA, and HotpotQA demonstrate that IterCOMP achieves substantial improvements in Exact Match and F1 scores while reducing the token budget, outperforming existing baselines and exhibiting robustness as reasoning complexity increases.

[4] GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings cs.CL | cs.LGPDF

Konstantin Dobler, Federico Scozzafava, Jonathan Janke, Mohamed Ali, Simon Lehnerer

TL;DR: 本文对非英语及多语言环境下基于可验证奖励的强化学习（RLVR）及其优化方法GRPO进行了大规模实证研究，发现用母语训练推理能力与英语训练的差距较小，且存在显著的跨语言迁移效应，但具体效果高度依赖于模型和语言，有时特定语言训练会导致其他语言能力的严重退化。

Details

Motivation: 当前基于可验证奖励的强化学习研究主要集中在英语，本文旨在探索GRPO在非英语和多语言环境中的表现，以填补这一研究空白。

Result: 研究在多种基础模型、训练语言和推理语言奖励上进行，发现母语训练推理与英语训练差距小，且跨语言迁移效果显著，但需广泛评估以检测语言特定退化。

Insight: 创新点在于首次大规模实证分析GRPO在非英语和多语言环境中的效果，揭示了跨语言迁移的潜力和语言特定退化的风险，强调了多语言评估的重要性。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR), often optimized with Group Relative Policy Optimization (GRPO), has become a central recipe for improving the reasoning capabilities of pretrained language models but current studies remain heavily English-centric. We conduct a large-scale empirical study of multilingual and non-English GRPO across a wide range of base models, training languages, and different reasoning language rewards. We find that training to reason in the native language often leaves only a small gap to training for English reasoning. We further observe strong crosslingual transfer: training in one language often improves performance in many others. However, specific trends are highly model- and language-dependent. In some cases, training in a particular language induces severe regressions on out-of-domain capabilities in other languages. Our analysis shows that RLVR beyond English can provide broad crosslingual gains, but also requires broad evaluation to detect language-specific regressions.

[5] Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models cs.CL | cs.AI | cs.CV | cs.LGPDF

Jean de Dieu Nyandwi, Leena Mathur, Yonatan Bisk, Robert Hawkins, Graham Neubig

TL;DR: 该论文研究了推理模型中的行为与答案正确性之间的关系，并提出了‘行为提升度’指标来衡量特定行为对模型正确性的影响。研究发现，思维模型会放大自我修正、假设检验和不确定性确认等行为，但这些行为与正确性的关联较弱；而置信度校准、知识对齐和自我意识等行为对正确性有更强的正面信号，却未被充分放大，这揭示了训练目标与有效性行为之间的不匹配。

Details

Motivation: 论文旨在探究推理模型中哪些行为与正确答案相关，以及面向推理的训练是否真正放大了这些关键行为，而非仅仅使推理过程看起来更审慎。

Result: 在涵盖纯文本和视觉语言推理的15个模型和6个基准测试中，对15,282条推理轨迹进行了标注分析，发现了‘放大-提升度差距’：例如，不确定性确认被放大了3-7倍，但与正确性关联弱甚至负相关；而置信度校准是正确性的强正面信号，却几乎未被放大。

Insight: 创新点在于提出了‘行为提升度’这一量化指标来评估行为对正确性的影响，并揭示了当前推理训练可能过度关注表面形式（如审慎的推理痕迹），而非真正提升模型正确性的核心行为（如置信度校准），这为设计更有效的、奖励校准和基于事实的推理过程的训练目标提供了动机。

Abstract: Which reasoning behaviors are associated with correct answers in reasoning models, and does reasoning-oriented training amplify those behaviors? This distinction is important because reasoning-oriented training can make traces look more deliberative without amplifying the behaviors most tied to model correctness. We quantify this mismatch with Behavioral Lift, a metric that measures how much correctness changes when a behavior is present versus absent in a model’s reasoning trace. Across 15 models and 6 benchmarks spanning text-only and vision-language reasoning, we annotate 15,282 traces with a taxonomy whose core behaviors are defined for both LLM and VLM traces. We find evidence for an Amplification-Lift Gap, in which thinking models strongly amplify self-correction, hypothesis testing, and uncertainty acknowledgment, while the highest-lift behaviors are confidence calibration, knowledge alignment, and self-awareness. Confidence calibration is among the strongest positive signals of correctness in both modalities, yet is barely amplified; uncertainty acknowledgment is amplified by 3–7$\times$, yet is weakly or negatively associated with correctness. We find that reasoning-oriented training does not preferentially amplify the highest-Lift behaviors, motivating process-level objectives that reward calibrated and grounded reasoning rather than surface form alone.

[6] Bootstrapping Niche Multilingual Code Translation via Reinforcement Learning with Execution-Based Verifiable Supervision cs.CLPDF

Kouki Yuki, Jie Zeng, Kyoko Ogawa, Ryunosuke Ikeda, Yohei Kobashi

TL;DR: 本文提出了一种基于强化学习和执行验证监督的方法，用于提升小众编程语言之间的代码翻译能力。该方法通过扩展可验证的种子Python程序构建多语言执行验证代码池，利用基础大语言模型生成翻译候选，并通过执行结果标注偏好来训练奖励模型，最后使用GRPO算法优化模型在600个定向语言对上的翻译性能。

Details

Motivation: 解决神经代码翻译主要集中于少数流行语言（如C++、Java、Python），而小众语言之间由于并行监督数据稀疏导致翻译结果可能语法正确但不可执行的问题。

Result: 在提出的新基准HumanEval-X++和现有基准上，使用Qwen-3.5 4B和9B模型的方法相比未训练的基线取得了一致的性能提升。其中4B模型在HumanEval-X++上所有语言平均提升13%，在中层语言上提升21%。

Insight: 创新点在于构建了一个基于执行验证的偏好数据生成和奖励模型训练流程，实现了对小众多对多代码翻译任务的可靠数据生成、训练和评估方法，为提升编程语言间多对多翻译质量提供了可复现的路径。

Abstract: Code translation must preserve executable behavior across many programming languages, yet neural code translation has largely focused on a few popular languages such as C++, Java, and Python. This leaves a niche, many-to-many setting where parallel supervision is sparse, producing plausible but non-executable translations. We address this setting with preference-based reinforcement learning driven by execution-based supervision. Our pipeline firstly expands verifiable seed Python programs into a multilingual pool of execution-validated codes. Using the pool, a base LLM generates translation candidates across language pairs, which we label by their execution outcomes. The resulting preferences are used to train a reward model that scores cross-language translation quality. Finally, we optimize our base LLMs with GRPO over 600 directed language pairs (25 x 24) using the reward model as a signal. To evaluate the niche translation capability, we introduce HumanEval-X++, an execution-based benchmark that extends HumanEval-X to a broad many-to-many language space. We evaluate our approach using Qwen-3.5 4B and 9B models. On HumanEval-X++ and existing benchmarks, it yields consistent gains over the untrained baselines. In particular, the 4B model achieves an average improvement of 13% across all languages on HumanEval-X++, with a gain of 21% on mid-tier languages. Our study establishes a reliable approach of data generation, training, and benchmarking, paving the way toward further bootstrapping the quality of many-to-many translation for programming languages.

[7] Batch-wise Adaptive Pruning: Periodic Neuron Activation-Aware Weight Pruning for Language Reasoning Model cs.CLPDF

Yongmin Kim, Shota Takashiro, Yusuke Iwasawa, Takeshi Kojima, Yutaka Matsuo

TL;DR: 本文提出了一种针对大型推理模型批量推理场景的无训练自适应剪枝方法Batch-wise Adaptive Pruning。该方法通过周期性top-k选择和激活记忆机制，解决了现有方法在批量推理中因激活分布偏移导致的准确率崩溃问题，在保持推理加速的同时显著提升了剪枝后的模型性能。

Details

Motivation: 大型推理模型在批量推理时，现有无训练自适应剪枝方法因批量共享单一剪枝掩码导致激活分布偏移，使得实际稀疏率漂移，在推理任务上的准确率严重下降。

Result: 在DeepSeek-R1-Distill-Qwen-7B模型上，目标稀疏率50%、批量大小为4时，平均准确率比之前最优自适应剪枝方法提升39.7个百分点，实际稀疏率50%时达到密集推理1.40倍的加速比。

Insight: 创新点包括：1）用周期性top-k选择替代基于阈值的选择，避免激活聚合引起的分布偏移；2）引入激活记忆机制，利用重要神经元在长推理生成中周期性重激活的特性，跨更新阶段累积重要性以保留重复出现的神经元。

Abstract: Large Reasoning Models (LRMs) achieve strong performance on complex tasks through extended chain-of-thought generation, but incur substantial computational costs during inference. In production settings, batched inference is essential for high throughput, yet the existing training-free adaptive pruning methods we evaluate severely degrade in this regime. Because a batch must share a single pruning mask, these methods aggregate activations across samples and then apply threshold-based selection; the threshold, calibrated offline on unaggregated activations, no longer matches the aggregated distribution, so the realized sparsity ratio drifts and accuracy on reasoning tasks collapses under batched inference. In this work, we propose a training-free adaptive pruning method designed specifically for batched inference in LRMs, built on two components. First, we replace threshold-based selection with periodic top-k selection over the aggregated importance scores, which is unaffected by the shift that aggregation induces in the activation distribution, and which runs selection once per update period rather than at every token, preserving the speedup. Second, based on the observation that important neurons re-fire periodically during long reasoning generation, we introduce an activation memory that accumulates importance across update phases so that recurring neurons are retained. Experiments on diverse reasoning benchmarks demonstrate that our method outperforms the previous state-of-the-art adaptive pruning method by 39.7 percentage points in average accuracy at batch size 4 with 50% target sparsity on DeepSeek-R1-Distill-Qwen-7B, and reaches 1.40x speedup over dense inference at 50% actual sparsity.

[8] S2Dialog: Multimodal Dialogue Retrieval with Semantic and Acoustic-Style Modeling cs.CLPDF

Xueqi Wang, Zhigang Wang, Runqing Zhang, Zhenqi Jia, Junfeng Zhao

TL;DR: S2Dialog是一个用于多模态对话检索的统一框架，旨在从多模态对话库中检索出在文本语义和声学对话风格上与目标对话相似的对话。该框架包含对话级文本检索器和对话级声学检索器，并通过对话级文本-声学对比学习增强多模态检索能力。

Details

Motivation: 现有检索方法主要局限于话语级或单模态匹配，难以捕捉整个对话的全局语义连贯性和风格一致性，而对话级检索对于情感识别、口语对话系统和对话语音合成等任务至关重要。

Result: 在多模态对话数据集DailyTalk上的大量实验表明，S2Dialog实现了出色的检索性能。

Insight: 创新点在于提出了一个统一的对话级多模态检索框架，通过分别编码文本和声学模态的对话级表示，并引入对话级文本-声学对比学习来对齐语义和风格相似的对话，从而解决了现有方法在全局语义和风格一致性捕获上的不足。

Abstract: Multimodal dialogue retrieval aims to retrieve dialogues from multimodal dialogue banks that are similar to a target dialogue in terms of both textual semantics and acoustic conversational styles. Such dialogue-level retrieval is crucial for many dialogue-related tasks, including Emotion Recognition in Conversation, Spoken Dialogue Systems, and Conversational Speech Synthesis, where external dialogue examples can provide valuable semantic and stylistic references. However, existing retrieval methods are still largely limited to utterance-level or unimodal matching, and often fail to capture the global semantic coherence and stylistic consistency of an entire dialogue. To address this gap, we propose S2Dialog, a unified framework for dialogue-level semantic-style retrieval from multimodal dialogue banks. Specifically, S2Dialog consists of a Dialogue-level Textual Retriever and a Dialogue-level Acoustic Retriever, which encode the textual and acoustic modalities of a dialogue into dialogue-level representations, respectively. To further enhance multimodal retrieval, we introduce Dialogue-level Textual-Acoustic Contrastive Learning, which aligns semantically and stylistically similar dialogues while distinguishing unrelated ones. Extensive experiments on the multimodal dialogue dataset DailyTalk demonstrate that S2Dialog achieves outstanding retrieval performance.

[9] Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge cs.CLPDF

Kexin Shi, Renhe Sun, Yuge Huang, Ximeng Wang, Jiayi Zhou

TL;DR: 本文针对第二届多语言对话语音语言模型（MLC-SLM）挑战赛的两个任务提出解决方案。对于任务1（说话人日志与识别），通过随机前导静音裁剪、时间戳校正和指数移动平均训练策略微调VibeVoice-ASR-7B模型。对于任务2（对话语音理解），通过多模态候选生成、静音音频过滤和分布匹配增强构建合成问答对，并微调Qwen3-Omni-30B-A3B-Instruct模型进行带标签的直接回答。

Details

Motivation: 挑战赛的两个任务均不提供真实的语句边界或说话人标签，且任务2没有现成的问答训练集，需要解决在无监督或弱监督条件下对完整、未分割的多语言对话进行处理和理解的问题。

Result: 在任务1评估集上，前导静音裁剪将tcpMER从18.30%降至17.27%，结合指数移动平均训练后进一步降至16.73%。在任务2评估集上，联合应用分布匹配增强和带标签直接回答将准确率从83.0%提升至86.0%。

Insight: 创新点包括：针对语音识别模型引入随机前导静音裁剪以增强鲁棒性；为缺乏标注数据的对话理解任务设计多阶段合成监督流水线（包括候选生成、过滤和增强）；在微调大型语言模型时采用带标签的直接回答格式。这些方法为解决无标注边界和说话人信息的对话处理任务提供了有效技术路径。

Abstract: The second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge evaluates two tasks over complete, unsegmented multilingual conversations: speaker diarization and recognition (Task 1) and conversational speech understanding (Task 2). Neither task provides oracle utterance boundaries or speaker labels at evaluation, and Task 2 provides no question-answer training set. For Task 1, we fine-tune VibeVoice-ASR-7B with random leading-silence cropping, consistent timestamp correction, and an exponential moving average (EMA) training strategy. For Task 2, we construct synthetic question-answer pairs through multimodal candidate generation, silent-audio filtering, and distribution-matched augmentation, and fine-tune Qwen3-Omni-30B-A3B-Instruct for tagged direct answering. On the Task 1 evaluation set, cropping reduces tcpMER from 18.30% to 17.27%, and EMA further reduces it to 16.73%. On the Task 2 evaluation set, jointly applying distribution-matched augmentation and tagged direct answering raises accuracy from 83.0% to 86.0%.

[10] SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning cs.CL | cs.AIPDF

Haonan He, Haodi Lei, Yun Luo, Haoran Zhang, Shunkai Zhang

TL;DR: 本文提出了一种名为SimpleOPD的简单且与分词器无关的在线策略蒸馏方法，用于将长上下文推理模型（如SU-01）的证明推理能力迁移到短上下文学生模型中。该方法通过在共享文本空间进行蒸馏、引入学生参考KL损失和屏蔽特殊终止令牌的优势，解决了分词器不匹配、师生分布不匹配、响应长度爆炸和训练不稳定等挑战。

Details

Motivation: 在线策略蒸馏（OPD）在将强教师模型的推理能力迁移到学生模型方面很有前景，但将其应用于长上下文推理教师和短上下文学生时，会面临分词器不匹配、师生分布不匹配、响应长度爆炸和训练不稳定等实际挑战。

Result: 在包括Qwen3、Qwen3.5、Intern-S2、GLM-4.7、Gemma-4在内的同族和异族学生模型上的实验表明，该方法在数学推理（尤其是自然语言数学证明）上取得了持续提升。Intern-S2-Preview在ProofBench上提升了21.2分，达到55.2分，超过了Gemini-2.5-Pro。在HLE和HiPhO等科学基准测试上也有提升。

Insight: 创新点在于提出了一种与分词器无关的在线策略蒸馏方法，通过在共享文本空间对齐分词、引入学生参考KL损失和屏蔽特殊终止令牌优势，有效解决了长上下文教师到短上下文学生知识迁移中的关键挑战，并展示了推理能力的跨领域泛化性。

Abstract: On-policy distillation (OPD) offers a promising way to transfer reasoning capabilities from stronger teacher models, but applying it to long-context reasoning teachers and short-context students introduces practical challenges, including tokenizer mismatch, teacher-student distribution mismatch, response length explosion, and training instability. In this work, we study this setting by transferring proof-reasoning capabilities from the long-context reasoning model SU-01 to short-context student models. To handle tokenizer differences, we perform OPD in a shared text space and align only tokens that occupy identical text spans under the student and teacher tokenizers. To mitigate the problem of excessive generation length and frequent truncation, we introduce a student reference KL loss and mask the advantages of special termination tokens such as and <|im_end|>. This strategy constrains the student from drifting excessively from its initial policy, thereby mitigating the teacher-student distribution mismatch problem and fostering steady length growth. Experiments on both same-family and different-family student models, including Qwen3, Qwen3.5, Intern-S2, GLM-4.7, Gemma-4, show consistent gains in mathematical reasoning, especially natural-language math proving. Notably, Intern-S2-Preview improves by 21.2 points on ProofBench, reaching 55.2 and surpassing Gemini-2.5-Pro. It also improves on science benchmarks such as HLE and HiPhO, suggesting that OPD transfers reasoning capabilities that generalize beyond the mathematical training domain.

[11] Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RL cs.CLPDF

Xiaojun Wu, Cehao Yang, Honghao Liu, Xueyuan Lin, Zhichao Shi

TL;DR: 本文提出了Envs-FORGE，一种用于强化学习智能体训练的环境合成方法。该方法根据验证器奖励动态地为每个任务种子生成难度适宜的训练环境，通过求解混合整数线性规划来选择最优的环境生成动作，从而同步重写指令、测试等组件，并仅将验证通过的“黄金”环境用于RL训练。

Details

Motivation: 现有环境合成方法（如few-shot、Self-Instruct）对所有任务种子采用固定的提示策略，无法根据当前策略的学习状态动态调整任务难度。本文旨在解决这一问题，为终端智能体的RL训练生成具有可靠奖励和适宜难度的可执行环境。

Result: 在Qwen 3.5 35B模型上，Envs-FORGE在tb-core基准上将Pass@1从基线的40.0%提升至49.2%（提升9.2个百分点），在tb-2.0上从23.0%提升至29.4%（提升6.4个百分点），均超过最强的固定策略基线2.1-2.4个百分点。在SWE-bench Verified上达到77.1%（基线为73.4%），且在4B至35B的多个模型规模上对tb-core均有6.8-9.2个百分点的稳定提升。

Insight: 核心创新在于将环境合成建模为一个基于学习前沿优化的、按种子决策的提示策略问题，通过估计种子通过率并求解MILP来选择能驱动环境组件同步重写的最优动作。该方法实现了训练环境难度的动态、个性化调整，并支持可选的技能覆盖优化，为RL训练数据的生成提供了新思路。

Abstract: Reinforcement learning (RL) for terminal agents needs executable training environments with reliable rewards and useful difficulty. Fixed recipes such as few-shot, Self-Instruct, and Evol-Instruct apply the same prompting policy to every seed, even when the current policy would benefit from a harder, easier, or simply different task. We present Envs-FORGE, a prompting policy that converts verifier rewards into per-seed environment-synthesis actions. Envs-FORGE estimates seed pass rates, scores six projection–direction actions around a target learning frontier, and solves a per-seed mixed-integer linear program (MILP) to choose the action that conditions generation. The selected action drives synchronized rewriting of the instruction, fixtures, oracle solution, tests, and Docker environment; only gold-verified bundles enter RL training. The indexed MILP form also supports optional soft skill coverage for portfolio planning. On Qwen 3.5 35B, Envs-FORGE improves Pass@1 over Base by 9.2 percentage points on tb-core (40.0% to 49.2%) and 6.4 points on tb-2.0 (23.0% to 29.4%), exceeding the strongest fixed-recipe baseline by 2.4 and 2.1 points. It reaches 77.1% on SWE-bench Verified versus 73.4% for Base, and improves tb-core by 6.8–9.2 points across the evaluated 4B–35B models. All synthesis methods export 100 verified environments and use 2.27M–2.88M synthesis tokens, placing the comparison at the same downstream training-set size and the same operational scale. The source code is available at https://github.com/DataArcTech/DataArc-SynData-Toolkit/.

[12] A Survey of Large Models in Sports cs.CL | cs.CVPDF

Yichen Xu, Jianzhe Ma, Chuhan Wang, Zhonghao Cao, Liangyu Chen

TL;DR: 本文是一篇关于大模型在体育领域应用的综述性论文，系统性地回顾了（多模态）大语言模型如何重塑体育理解、分析与交互。内容包括体育任务与应用概述、相关数据集与基准分析，以及当前挑战与未来方向的讨论。

Details

Motivation: 近年来体育热潮高涨，而大模型的快速发展为体育智能带来了变革潜力，本文旨在梳理该领域现状，为后续研究和实践发展奠定基础。

Result: 作为一篇综述，本文未提出具体模型或方法，因此未报告定量实验结果，但系统整理了现有任务、应用、数据集和基准。

Insight: 创新点在于首次对大模型在体育领域的应用进行全面综述，并创建了开源资源库，为研究者提供了清晰的领域概览和未来研究方向指引。

Abstract: Sports have witnessed growing global enthusiasm in recent years, serving as a vital force for physical health, cultural exchange, social connection, and economic growth. The rapid advancement of large models, particularly (multimodal) large language models (M)LLMs, has demonstrated transformative potential to reshape sports understanding, analysis, and interaction across diverse domains. This paper presents a comprehensive survey of large models in sports, including (i) an overview of tasks and applications across different participant groups; (ii) a detailed analysis of sports-related datasets and benchmarks; and (iii) a critical discussion of current challenges and future directions. Our goal is to establish a foundation for advancing research and practical development of large-model-driven sports intelligence. An open-source GitHub repository is maintained at: https://github.com/Road2Redemption/Awesome_Large_Models_In_Sports1.

[13] You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model cs.CL | cs.LGPDF

Ziyang Luo, Zhongyao Chu, Xinjie He, Youting Wang, Xukui Qin

TL;DR: 本文提出YOPO系统，通过单次前向传播在冻结语言模型上同时实现答案生成、条件引导和信息不足时的弃答。系统利用小型网络重构引导前的残差流，使弃答方向能在重构上读取，避免了多轮推理的干扰和成本。

Details

Motivation: 解决冻结语言模型在推理任务中的两个耦合弱点：未能充分利用自身残差流已编码的证据，以及无法检测输入信息不足时导致的幻觉生成。

Result: 在Qwen2.5系列模型（1.5B/3B/7B）上，端到端三向准确率较冻结基线提升一倍以上（alphaNLI上从0.375升至0.798），单次前向传播性能超越双次参考基准，并在六个模型家族的十个骨干网络上验证有效。

Insight: 创新点在于将条件引导探针与零样本充分性方向检测统一于单次前向传播，通过重构残差流避免相互干扰；同时提出首个答案-弃答基准测试框架，其无标签方向检测方法在跨领域迁移中表现鲁棒。

Abstract: A frozen language model on reasoning tasks has two coupled weaknesses: it under-uses evidence its own residual stream already encodes, and it fails to detect when the input is insufficient to answer, so it confabulates. This paper consolidates two research lines that address these on the same residual stream: a conditional steering probe writes the stream at mid-stack layers and recovers reasoning accuracy from a frozen backbone, and a zero-shot sufficiency direction reads the stream and abstains when information is insufficient. Deployed in one forward pass they interfere: the steering write shifts the state the direction reads, costing up to 8 AUROC points of cross-domain transfer on small models; a separate clean pass doubles inference cost. We keep the direction fixed and train a small network to reconstruct the pre-steering residual from the steered one – mean-squared error on (steered, clean) pairs, no sufficiency labels – and read the direction on the reconstruction. The resulting system, YOPO (You Only Pass Once), answers, steers, and abstains in one forward pass of a frozen Qwen2.5 backbone (1.5B/3B/7B). End to end, three-way accuracy more than doubles the frozen baseline (0.375->0.798 on 1.5B alphaNLI) and one pass beats the two-pass reference at every scale (0.798/0.830/0.893 vs 0.753/0.790/0.863) and on ten backbones across six model families. We chart the capacity-transfer frontier quantifying the principle that abstention should not be trained in; a source-side audit catches our own alphaNLI construction leaking a surface artifact, so architectural claims are anchored on native-label replications (SQuAD2, RepLiQA, MuSiQue); and on the standard four-domain suite we contribute, to our knowledge, the first answer-or-abstain benchmark, where our gate tops every in-domain dataset and the label-free direction is the only gate family to survive domain transfer.

cs.CV [Back]

[14] Multiphase-Diff: Diffusion-Based Generative Modeling for High-Contrast Multiphase Physical Systems with Sharp Interfaces cs.CVPDF

Yining Huang, Zhenyu Liang

TL;DR: 本文提出了Multiphase-Diff，一种用于生成具有尖锐界面的高对比度多相物理系统的扩散模型。该方法通过引入保守通量残差、解析双射表示和雅可比预处理似然三项关键技术，解决了现有物理约束扩散模型在处理此类系统时面临的梯度奇异、低幅值信号丢失和监督不平衡三大耦合难题。在三个互补的多相基准测试中，该方法在物理保真度和分布保真度上均优于七个基线模型。

Details

Motivation: 解决物理约束扩散模型在处理高对比度、尖锐界面多相物理场时面临的三个耦合难题：在系数跳跃处，点态强形式PDE残差包含惩罚物理界面的奇异梯度项；在极端对比度下，低幅值相可能低于扩散噪声基底而被抹除、缩放不当或生成负系数；全局似然尺度导致高幅值相主导监督过程。

Result: 在三个互补的多相基准测试上进行实验，结果表明Multiphase-Diff在物理保真度和分布保真度上均优于七个基线模型，并且对不同相对比度和组成具有鲁棒性，证明了其在该挑战性领域用于科学样本生成的有效性。

Insight: 创新点包括：1) 避免对不连续系数进行微分的保守通量残差，强制执行离散守恒；2) 将低幅值信号映射到单位一潜在尺度并通过指数解码保证系数正性的解析双射表示；3) 对局部残差尺度进行归一化以实现平衡监督的雅可比预处理似然。这些技术为处理具有不连续性和极端对比度的物理系统生成问题提供了系统性的解决方案。

Abstract: Physics-constrained diffusion for high-contrast, sharp-interface multiphase fields faces three coupled difficulties. At coefficient jumps, expanded pointwise strong-form PDE residuals contain singular gradient terms that can penalize physical interfaces. Under extreme contrast, low-magnitude phases may fall below the diffusion noise floor and be erased, misscaled, or generated with negative coefficients, while a global likelihood scale allows high-magnitude phases to dominate supervision. We therefore propose Multiphase-Diff, which makes three corresponding contributions: (i) a conservative flux residual that avoids differentiating discontinuous coefficients and enforces discrete conservation; (ii) an analytic bijective representation that maps low-amplitude signals to order-one latent scales and guarantees coefficient positivity through exponential decoding; and (iii) a Jacobi-preconditioned likelihood that normalizes local residual scales for balanced supervision. Experiments on three complementary multiphase benchmarks demonstrate the superiority of Multiphase-Diff over seven baselines in both physical and distributional fidelity and its robustness across phase contrasts and compositions, establishing its effectiveness for scientific sample generation in this challenging regime.

[15] MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation cs.CV | cs.AIPDF

Rafi Ibn Sultan, Hui Zhu, Chengyin Li, Dongxiao Zhu

TL;DR: MedPlex是一个端到端的视觉-语言模型框架，用于医学图像分割。它通过双向融合和层级概念对齐，使文本指导成为分割学习中持续且基于临床的组成部分，从而超越了仅将语言作为后期条件信号的传统方法。

Details

Motivation: 现有基于视觉-语言模型的文本引导分割方法通常只在后期使用语言作为条件信号，限制了文本对视觉表征学习的影响。而临床解读依赖于解剖、位置、外观等文本知识，因此需要让文本指导更早、更持续地融入分割学习过程。

Result: MedPlex在CT和MR基准测试中，针对多器官、心脏亚结构和肿瘤分割任务，实现了最先进的性能，包括在真实自由文本临床监督下的设置。

Insight: 创新点在于提出了双向融合机制，使视觉和文本表征在编码层级中共同演化；并引入了类级和区域级概念对齐，在互补的粒度上组织共享表征，让语言在整个编码器中提供结构化监督，而不仅仅是后期线索。

Abstract: Medical image segmentation is still largely treated as a vision-only problem, although clinical interpretation often relies on textual knowledge of anatomy, location, appearance, and surrounding context. Existing text-guided segmentation methods within the Vision-Language Model (VLM) paradigm often use language only as a late conditioning signal, limiting its influence on visual representation learning. We introduce MedPlex (Medical Plexus of Vision and Language), an end-to-end VLM framework that makes text guidance a continuous, clinically grounded component of segmentation learning. Through Bi-Fusion (Bidirectional Fusion), visual and textual representations evolve jointly across the encoding hierarchy. MedPlex further introduces class-level and region-level concept alignment to organize the shared representation at complementary granularities. Class-level alignment anchors each anatomical target to an aggregated clinical concept profile, while region-level alignment preserves individual concepts, such as shape, location, appearance, and texture, through class-specific visual evidence. In this way, language provides structured supervision throughout the encoder rather than serving only as a late-stage cue. MedPlex achieves state-of-the-art performance across CT and MR benchmarks for multi-organ, cardiac substructure, and tumor segmentation, including settings with real free-text clinical supervision. Code: https://github.com/rafiibnsultan/MedPlex.

[16] PROVE: Training-Free Prompt Recovery using Verifiable Evidence cs.CVPDF

Rupayan Mallick, Mahsa Khoshnoodi, Sarah Adel Bargal

TL;DR: 本文提出了一种名为PROVE的训练免费、黑盒提示词恢复攻击方法，用于从文本到图像模型生成的图像中恢复原始提示词。该方法通过组合可验证的场景描述而非优化token序列来重构提示词，旨在解决现有方法存在的可读性差、幻觉和过拟合等问题。

Details

Motivation: 随着提示词市场的出现，从生成图像中恢复提示词可能导致未经授权的版权作品复制、再分发以及艺术家创意配方的泄露，现有基于梯度优化、自回归描述或强化学习的方法存在各种缺陷，因此需要一种更可靠、实用的提示词恢复方法。

Result: 在MS-COCO、Flickr30K和Lexica数据集上，使用最先进的文本到图像生成器进行测试，PROVE在图像相似性（DINO、LPIPS）和图文对齐（CLIP）指标上均持续优于基于优化、描述和强化学习的基线方法，且无需任何训练、生成器访问或微调。

Insight: 创新点在于采用基于可验证证据的、训练免费的提示词恢复框架，通过精确约束的召回最大化目标将恢复的每个声明都基于明确的图像证据，实现了完全可审计的提示词恢复，避免了现有方法的常见问题，为更强大和实用的提示词恢复攻击提供了新思路。

Abstract: Modern text-to-image models can generate highly realistic images from natural-language prompts, while recent advances in prompt inversion have made it increasingly feasible to recover those prompts from generated outputs, raising new concerns for copyright protection and content ownership. As prompt marketplaces emerge, recovered prompts can enable both the unauthorized reproduction and redistribution of copyrighted creative works, and the exposure of the prompts that encode an artist’s creative recipe in AI-generated content. Existing prompt inversion methods rely on gradient-based optimization, autoregressive captioning, or reinforcement learning. However, optimization-based methods often produce unreadable prompts, captioning methods hallucinate unverified details, and RL-based approaches frequently overfit to specific generators while introducing evaluation circularity. We introduce PROVE (Prompt Recovery with Verified Evidence), a training-free, black-box prompt inversion attack that reconstructs prompts by composing verifiable scene descriptions rather than optimizing token sequences, targeting both original copyrighted works and AI-generated content. The resulting prompts are fully auditable, with every recovered claim grounded in explicit image evidence, and are formalized through a precision-constrained recall maximization objective. Across MS-COCO, Flickr30K, and Lexica, using state-of-the-art text-to-image generators, PROVE consistently outperforms optimization, captioning, and RL-based baselines on image similarity (DINO, LPIPS) and text-image alignment (CLIP), without any training, generator access, or fine-tuning, demonstrating a stronger and more practical prompt inversion attack.

[17] Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains cs.CVPDF

Edward Zhang, Marcel Hussing, Tanay Tandon, Shenbagaraj Kannapiran, Jason Hughes

TL;DR: 本文研究了在数据稀缺的专业领域中，基于扩散模型的合成图像生成方法用于缓解视觉任务数据不足的局限性。通过对比非生成式数据增强基线，评估了分布建模和样本扰动两种生成式稀疏数据扩展方法在五个创伤分类任务上的表现，发现生成方法未能持续超越强基线。

Details

Motivation: 动机在于探究扩散生成模型在自然图像基准（如ImageNet）上表现出的缓解数据稀缺的潜力，在图像与常见数据集差异大、数据获取成本高的稀疏、高方差现实专业领域（如创伤分类）中的实际有效性尚不明确。

Result: 在五个使用按受试者划分的训练-验证集的创伤分类任务中，没有任何一种生成式方法能持续地超越一个强大的非生成式数据增强基线。特征空间分析揭示了反复出现的失败模式。

Insight: 创新点在于系统评估了生成式数据扩展在专业数据稀缺领域的局限性，并揭示了其失败模式：记忆或坍缩、分布漂移，以及生成视觉上合理但简化的、比真实数据更易分类的典型实例，这对依赖合成数据的研究具有重要警示意义。

Abstract: Advances in diffusion-based generative models have motivated the use of synthetic image generation to alleviate data scarcity in vision tasks. While this strategy has shown promise in natural image benchmarks such as ImageNet, its effectiveness in sparse, high-variance real-world domains remains unclear. In this work, we focus on domains where images differ substantially from common image datasets and additional data are expensive to obtain. Against non-generative data augmentation baselines, we evaluate the downstream classifier performance improvements yielded by two schools of generative sparse data extension: distribution modeling and sample perturbation. Across five trauma classification tasks using subject-wise train–validation splits, no generative approach consistently outperforms a strong non-generative baseline. Feature-space analysis reveals recurring failure modes: memorization or collapse, distributional drift, and generation of visually plausible but simplified canonical instances that are easier to classify than real data.

[18] ChartProbe: A Diagnostic Study on Visual Reasoning through Perception, Grounding, and Simple Reasoning cs.CVPDF

Mahsa Khoshnoodi, Sarah Adel Bargal

TL;DR: 本文提出了ChartProbe诊断框架，用于研究视觉语言模型在图表推理任务上的弱点。研究发现，模型在复杂推理问题上的失败主要源于感知、定位和简单计算等基础技能的不足，而非推理能力本身。通过仅针对这些基础技能进行微调，无需复杂推理数据，即可显著提升模型在未见复杂问题上的表现，且该提升可泛化至新图表类型和视觉领域。

Details

Motivation: 针对视觉语言模型在需要视觉数量推理的图表问题上表现不可靠的现状，研究旨在探究其根本原因：是推理能力本身存在缺陷，还是其依赖的感知、定位和简单计算等基础技能薄弱。

Result: 在三个开源视觉语言模型上的实验表明，仅监督基础技能（感知、定位、简单推理）即可在模型从未训练过的复杂推理问题上带来巨大提升。该增益在未见图表类型（饼图）、人工编写的ChartQA基准以及非图表视觉域CLEVR上均得到验证。

Insight: 创新点在于提出了一个无需人工标注、通过图表渲染代码自动生成精确诊断探针的框架ChartProbe，并揭示了提升复杂视觉推理能力的新路径：通过强化基础技能而非直接提供复杂推理监督，即可有效提升模型性能，这为模型训练提供了更高效的数据利用策略。

Abstract: Vision-language models (VLMs) remain unreliable on chart questions that require reasoning over visual quantities, and this weakness is usually attributed to a reasoning deficit and addressed with more reasoning supervision. We ask whether the difficulty lies in reasoning itself, or in the simpler skills that reasoning operates on: reading the plotted elements (\emph{perception}), locating them and binding them to their labels (\emph{grounding}), and performing single-step computations such as ranking, totals, and differences (\emph{simple reasoning}). We introduce \textbf{ChartProbe}, a diagnostic framework whose probes are generated directly from the code that renders each chart, so every gold answer is exact by construction, needs no human annotation, and attributes each failure to a single skill. ChartProbe enables an intervention prior work does not attempt: instead of synthesizing complex-reasoning data, we withhold complex questions and reasoning traces entirely, fine-tune on one simple skill at a time, and measure transfer to held-out complex-reasoning questions. Across three open-weight VLMs, supervising the simpler skills alone produces large gains on complex-reasoning questions the model never trained on: where these skills are weak and the model can be taught to read the image, training them recovers much of complex reasoning at no reasoning-data cost. The gains hold across three out-of-distribution settings: an unseen chart type (pie charts), a human-written benchmark disjoint from our images and templates (ChartQA), and a non-chart visual domain (CLEVR). Complex visual reasoning can therefore improve without complex-reasoning supervision.

[19] Doomed to Re-Annotate, Forever: The ImageNet Story cs.CVPDF

Illia Volkov, Nikita Kisel, Tetiana Mishkina, Klara Janouskova, Jiri Matas

TL;DR: 该论文对ImageNet-1k验证集进行了全面的重新标注，创建了ReImageNet数据集。研究发现原始标签存在约12%的错误，33.3%的图像为多标签，3.8%的图像不包含任何目标类别。使用新标签后，监督模型的Top-1准确率最高提升1.2%，多模态大模型提升5-6%。

Details

Motivation: ImageNet-1k的Top-1准确率是视觉识别领域最常用的报告指标，但其数据集质量问题屡被报告，而2012年的原始噪声标签仍在被广泛使用。论文旨在通过远超以往修正尝试的努力，为ImageNet-1k验证集获取准确且完整的标注。

Result: 在ReImageNet新标注上，监督模型的Top-1准确率最高提升1.2%，多模态大模型（MLLMs）提升5-6%。论文指出，ImageNet-1k的问题已传播到其衍生的测试集中，表明这是一个结构性问题，而非特定于某个基准。

Insight: 论文的核心创新在于提出了一个围绕迭代精炼和错误检查构建的标注流程，并论证了在大规模数据集（如ImageNet）上，一次性完成完美标注是不现实的。其关键洞见是，在适当的工具支持下，人类与LLM的协作代表了当前该规模下标注质量的最高水平。重新标注工作还包括了多标签修正、目标定位、修订的类别定义和语义属性（如文本识别、渲染、反射、人群、主导性）等全面内容。

Abstract: Top-1 accuracy on ImageNet-1k remains the most commonly reported metric in visual recognition. Quality issues with the dataset have been repeatedly reported, yet the original 2012 noisy labels are still predominantly used. The paper presents a comprehensive effort, which goes well beyond prior correction attempts, towards obtaining accurate and complete ImageNet-1k validation set annotations. The result, ReImageNet, includes multilabel correction, object localization, revised class definitions, and semantic attributes (text-recognition, rendition, reflection, crowd, dominant). The reannotation reveals that approximately 12% of the original ImageNet-1k labels are incorrect, 33.3% of images are multilabel and 3.8% contain no object from an ImageNet-1k class. With the new labels, top-1 accuracy increases by up to 1.2% for supervised models and by 5-6% for MLLMs. We argue that annotation at ImageNet scale cannot realistically be completed in one pass, as errors and definitional issues are discovered only through annotating, and we build our pipeline around repeated refinement and error checking. We observed that human and LLM collaboration with appropriate tooling represents the current quality ceiling for annotation at this scale. ImageNet-1k issues propagate into its derivative test sets, indicating that the problem is structural rather than specific to any single benchmark. All annotations, class definitions, guidelines, and analysis code have been publicly released. Project page: https://vrg.fel.cvut.cz/reimagenet Annotations: https://huggingface.co/datasets/vrg-prague/ReImageNet Code: https://github.com/klarajanouskova/ImageNet

Jie Jin, Mahiro Tokumasu, Yu Makino, Masakatsu Nishigaki, Tetsushi Ohki

TL;DR: 本文提出XSA-MAD，一个基于CLIP的多模态框架，用于检测人脸变形攻击。该方法通过将变形概念分解为身份、面部几何、纹理和一致性四个可解释属性，并编码为结构化文本表示，使图像编码器与判别性文本空间逐步对齐，从而捕获真实人脸与变形图像之间生成不变的概念级差异。

Details

Motivation: 现有基于图像的变形攻击检测方法仅依赖视觉线索，对未见过的生成技术泛化能力差。本文旨在通过建模真实人脸与变形人脸之间的语义不一致性，提升检测方法的泛化能力。

Result: 在SMDD上训练后，在MAD22和MorDIFF数据集上的实验表明，该方法对多种变形原理具有强泛化性。具体地，在基于GAN的变形攻击上实现了2.92%的等错误率，并在高保真生成攻击下持续优于现有方法。

Insight: 创新点在于将变形攻击检测构建为一个跨模态语义对齐问题，通过分解并结构化定义变形属性作为文本提示，引导视觉特征学习生成不变且概念级的判别表示，这为提升模型对未知攻击的泛化性提供了新思路。

Abstract: Morphing attacks pose a serious threat to face recognition systems. However, existing image-based morphing attack detection (MAD) methods often generalize poorly to unseen generation techniques because they rely solely on visual cues. We propose XSA-MAD, a CLIP-based multimodal framework that explicitly models semantic inconsistencies between bona-fide and morphed faces. Morphing concepts are decomposed into four interpretable attributes, including identity, facial geometry, texture, and consistency, and are encoded as structured and attribute-aware textual representations. The image encoder is progressively aligned with this discriminative textual space, resulting in a unified semantic representation that captures generation-invariant and concept-level discrepancies between bona-fide and morph images. Experiments on MAD22 and MorDIFF, following training on SMDD, demonstrate strong generalization across diverse morphing principles. In particular, XSA-MAD achieves an equal error rate of 2.92% on GAN-based morphs and consistently outperforms existing methods under high-fidelity generative attacks.

[21] RGBX-Next: Towards Realistic Generative Rendering from G-Buffers cs.CV | cs.GRPDF

Zheng Zeng, Marco Salvi, Lifan Wu, Jan Novák, Daqi Lin

TL;DR: 本文提出了RGBX-Next，一个统一的生成式前向与逆向渲染框架。该框架基于扩散Transformer模型，能够从图像、视频和流中估计几何缓冲区，并能从几何缓冲区生成逼真的图像、视频和流。

Details

Motivation: 当前扩散模型在生成内容时缺乏对输出的精确控制，而传统3D渲染则能提供这种控制。本文旨在将生成模型作为学习型渲染器，以传统渲染的几何缓冲区为条件，实现可控的生成渲染。

Result: 论文表明，所提出的模型在逼真的生成式渲染和本征分解任务上都实现了高质量的结果。

Insight: 核心创新在于提出了一种通用的方法，将扩散Transformer模型微调为生成式前向与逆向渲染器，从而统一了生成与控制，为可控生成渲染的未来研究提供了设计原则。

Abstract: Diffusion models have achieved impressive results in image, video, and streaming generation. However, compared to traditional 3D rendering, they still lack precise control over the generated output. We believe a viable path forward is to use generative models as learned renderers conditioned on traditionally rendered G-buffers. We introduce RGBX-Next, a unified generative framework for forward and inverse rendering, which allows estimating G-buffers from images, videos, and streams, and rendering realistic images, videos, and streams from G-buffers. Our key contribution is a general recipe for finetuning diffusion transformer (DiT) models into generative forward and inverse renderers. We show that the resulting models achieve high quality in both realistic generative rendering and intrinsic decomposition. We will make all our models publicly available. We believe that the design principles presented in this paper will benefit future research on controllable generative forward and inverse rendering.

[22] Beyond Control Points: Arcsecond Relative-Motion Estimation of Vision Measurement Platforms With Incomplete or Absent Control Fields cs.CVPDF

Meng Lian, Jian Wang, Shuixin Pan, Haibo Liu, Yueqiang Zhang

TL;DR: 本文提出了一种控制自适应差分框架，用于直接从图像位移和已知3D点估计视觉测量平台帧间运动，无需依赖专用控制点或非线性优化。该框架通过测量点观测恢复平台旋转，利用一个控制点实现先验约束的平移恢复，两个非平行控制射线恢复完整3D平移，在图像噪声、姿态变化和点扰动下实现了亚毫米级精度。

Details

Motivation: 解决长距离视觉变形监测中相机平台运动估计的难题，传统绝对位姿差分方法依赖专用控制数据且会传播两个独立位姿误差，本文旨在开发一种更鲁棒、高效且对控制场不完整的场景具有适应性的相对运动估计方法。

Result: 在0.5像素图像噪声、30角分姿态变化和2毫米3D点扰动下，多相机估计器旋转RMSE为2.97角秒，平均运行时间0.46毫秒；使用一个控制点时平移RMSE为1.19毫米；在无稳定控制场的桥梁实验中，相对于全站仪测量的中位坐标位移RMSE为0.85毫米，在公开RGB-D和立体序列上保持零发散，达到了SOTA精度、校准鲁棒性和计算效率。

Insight: 创新点在于控制自适应差分框架直接估计帧间平台运动，无需非线性优化或初始位姿估计，旋转估计完全不受控制场污染影响，平移外参误差被精确抵消；从客观角度看，该方法通过旋转可观测性条件、泄漏边界和单点轴向先验偏差定律的推导，提供了理论保证，适用于控制点不完整或缺失的实际场景。

Abstract: Long-range vision-based deformation monitoring is highly sensitive to motion of the camera platform. Absolute-pose differencing typically relies on dedicated control data and propagates two independent pose errors into the relative-motion estimate. We develop a control-adaptive differential framework that estimates inter-frame platform motion directly from image displacements and known 3D points. With no dedicated control point, the framework recovers platform rotation from measurement-point observations. One surveyed control point enables prior-constrained translation recovery, while two nonparallel control rays recover full 3D translation. The framework requires neither nonlinear optimization nor an initial pose estimate. Excluding control data from the rotation stage makes the rotation estimate exactly immune to contamination confined to the control field. The inherited differential formulation also cancels translational extrinsic errors exactly. We derive the rotation observability condition, a leakage bound for unmodeled translation and nonrigid point motion, and the single-point axial-prior bias law. Under 0.5-pixel image noise, attitude changes of up to 30~~arcmin, and 3D point perturbations of up to 2~~mm, the multi-camera estimator achieves a rotation RMSE of 2.97~~arcsec and an average runtime of 0.46~~ms. With one surveyed control point, its prior-constrained translation RMSE is 1.19~~mm. In a bridge experiment without a stable control field, the median coordinate-wise displacement RMSE relative to total-station measurements is 0.85~~mm. The estimator also maintains zero divergence under the tested 3D coordinate perturbations on public RGB-D and stereo sequences. These results establish state-of-the-art accuracy, calibration robustness, and computational efficiency among the evaluated methods.

[23] Consensus-gated Multi-Agent Neural Architecture Search for Seismic Fault Segmentation cs.CVPDF

Shehram Baig, Ahmad Mustafa

TL;DR: 本文提出了一种基于大语言模型（LLM）共识门控的多智能体神经架构搜索（NAS）方法，用于地震断层分割任务。该方法利用一个由三个LLM（Claude、GPT-5.1和Gemini 2.5 Pro）组成的专家小组，通过辩论达成共识来设计和评估候选架构，并在严格的参数量预算（45万）下自动生成和测试PyTorch代码。搜索过程在单个消费级GPU上完成，仅训练了8个候选模型，最终发现了一个名为\ours{}的高效架构。

Details

Motivation: 地震断层分割任务通常面临标注数据稀缺的挑战，而直接从计算机视觉或医学影像领域借用神经网络架构可能不是最优的。传统的手动设计或经典NAS方法要么耗时，要么受限于预定义的搜索空间和巨大的计算开销。本文旨在开发一种低成本、高效且专门针对特定领域（地球物理）的自动架构搜索方法。

Result: 在从Thebe断层数据集提取的数据切片上，采用与所有基线模型相同的训练协议，所发现的\ours{}架构（42.5万参数）取得了所有测试模型中最高的F1分数（0.578）和IoU，同时是参数量最小的模型。它显著优于已发表的参数量为3100万的U-Net（F1 0.484）、3960万的DeepLabV3-ResNet50（F1 0.516）以及183万的Attention U-Net（F1 0.502），达到了新的SOTA水平。

Insight: 论文的主要创新点在于提出了一种新颖的“共识门控LLM专家小组”范式来进行神经架构搜索。该方法的核心在于让多个LLM通过辩论（而非单一LLM）来协作生成和审查代码，直接在源代码层面进行搜索，摆脱了传统NAS对预定义操作集的依赖。这种基于LLM代理的搜索系统具有成本效益（约101次LLM调用和1个GPU日），为数据受限的特定领域提供了一条实用的、低成本的自动架构发现路径。

Abstract: Neural networks for seismic fault segmentation are often borrowed from computer vision and medical imaging domains where they train under relatively much larger labeled data resources. Optimizing their architecture under tight labeled data budgets as are common in geophysical applications is not a trivial problem. Manually designing data-optimal architectures is time-consuming while classical neural architecture search (NAS) is restricted to hand-crafted search spaces and large compute budgets. We present an agentic NAS system in which a panel of three large language models (Claude, GPT-5.1, and Gemini~~2.5~~Pro) debates each candidate architecture to unanimous consensus, authors the complete PyTorch implementation, cross-reviews it, and submits it to an automated validate-train-score loop with a hard 450K parameter budget, keep-or-revert lineage, and a memory of failed mechanisms. Operating on source code rather than a predefined operation menu, the search ran on a single consumer GPU and trained only eight candidates. It discovered \ours{}: a 425K-parameter encoder-decoder with a strip-pooling bottleneck, squeeze-and-excitation gating, an asymmetric one-conv decoder, and a feature-pyramid fusion neck. Trained under a protocol identical to all baselines on sections derived from the Thebe fault dataset, it attains the highest F1 (0.578) and IoU of all models tested while being the smallest, outperforming a published-capacity U-Net (31M parameters, F1 0.484), DeepLabV3-ResNet50 (39.6M, 0.516), an Attention U-Net(1.83M, 0.502). The search cost 101 LLM calls ($\sim$1.15M input / 0.39M output tokens) and roughly one GPU-day, making consensus-gated LLM panels a practical, low-cost route to domain-specific architecture discovery.

[24] CoANeRV: Coordinate-Aware Token-Space Neural Video Representation cs.CVPDF

Jialong Guo, Ke Liu, Mengxuan Li, Jiajun Bu, Haishuai Wang

TL;DR: 本文提出了CoANeRV，一种坐标感知的令牌空间神经视频表示框架。它通过前馈方式生成紧凑的视频令牌，并使用一个共享的坐标条件解码器来重建连续时空查询，从而避免了针对每个视频的优化或解码器生成，实现了高效的摊销视频表示。

Details

Motivation: 现有神经视频表示（NeRV）通常需要对每个视频进行昂贵的优化或生成视频特定的权重，这难以扩展到高效的摊销视频表示。本文旨在解决这一可扩展性问题。

Result: 在多个视频数据集上的实验表明，CoANeRV在重建质量上持续优于先前的前馈NeRV和隐式神经表示（INR）基线，与基于注意力的坐标解码器相比降低了峰值内存，并且无需逐视频优化即可实现高效的摊销编码。

Insight: 创新点在于将前馈令牌生成、时空坐标检索和内存受限的密集查询进行视频特定的组合，并通过坐标感知解码架构（如轴自适应位置编码和温度调制交叉注意力）来对齐时空查询与视频令牌。分块坐标查询进一步降低了峰值注意力内存，使高分辨率重建变得可行。

Abstract: Neural representations for videos (NeRV) have shown strong reconstruction fidelity by storing video-specific information in network weights. However, existing formulations typically require either costly per-video optimization or video-specific weight generation, making it difficult to scale to efficient amortized video representation. We propose CoANeRV, a coordinate-aware token-space framework that adapts the broader token-conditioned neural-field paradigm to amortized video representation. CoANeRV forms compact video tokens in one feed-forward pass and uses a shared coordinate-conditioned decoder to reconstruct continuous spatio-temporal queries, avoiding per-video decoder optimization or generation while retaining coordinate-level reconstruction flexibility. To make token-space reconstruction effective, CoANeRV introduces a coordinate-aware decoding architecture that aligns spatio-temporal queries with video tokens through axis-adaptive positional encoding and temperature-modulated cross-attention. Block-wise coordinate querying further reduces peak attention memory, making high-resolution reconstruction practical. Experiments on diverse video datasets show that CoANeRV consistently improves reconstruction quality over prior feed-forward NeRV and INR baselines, reduces peak memory compared with attention-based coordinate decoders, and provides efficient amortized encoding without per-video optimization. These results support the proposed video-specific combination of feed-forward token formation, spatio-temporal coordinate retrieval, and memory-bounded dense querying. The code is available at https://github.com/jialong2023/CoANeRV.

[25] CMCNet: Aligning Ultrasound Image Embeddings with Textual TI-RADS Representations for Fine-Grained Thyroid Classification cs.CV | cs.AIPDF

Bingxin Yu, Xueli Wang, Jerry Zhou, Wenyan Wang, Li Wen

TL;DR: 本文提出了CMCNet模型，通过将甲状腺超声图像嵌入与基于TI-RADS标准特征描述的文本嵌入对齐，实现细粒度甲状腺结节分类。作者构建了包含600个结节、多视图图像及完整TI-RADS特征标注的STN数据集，并设计了中心-边缘对比损失来同时促进类内紧凑性和类间分离性。

Details

Motivation: 现有深度学习模型多关注甲状腺结节的二分类恶性判断，而缺乏对多类别风险分级（TR1-TR5）及显式利用TI-RADS特征级监督信息的研究，主要受限于标注数据不足。

Result: 实验表明，该嵌入对齐策略比直接多任务学习更具数据效率和鲁棒性，在类别不平衡场景下持续优于InfoNCE、中心损失、强多任务基线及VQA风格多模态模型。

Insight: 创新点在于发现标准化特征描述的文本嵌入可作为TI-RADS风险等级的稳定代理表示，并设计了中心-边缘对比损失实现图像-文本嵌入对齐，使模型在推理时仅需图像输入即可利用训练时的结构化特征信息指导表示学习。

Abstract: Ultrasound is the primary imaging modality for assessing thyroid nodules, and the ACR TI-RADS framework standardizes diagnosis through five ultrasound feature categories that are aggregated into five risk levels (TR1-TR5). Although widely adopted in clinical practice, most deep learning approaches focus on binary malignancy classification, while multi-class prediction and explicit utilization of feature-level supervision remain underexplored, largely due to limited annotated data. In this study, we introduce the STN dataset of 600 thyroid nodules with paired transverse and longitudinal ultrasound images, bounding box annotations, and complete labels for all five TI-RADS feature categories. Following the clinical decision process, we investigate how structured feature information can guide representation learning during training while requiring only images at inference. We demonstrate that text embeddings derived from standardized feature descriptions form a stable surrogate representation for TI-RADS risk levels. Based on this observation, we propose CMCNet, which aligns image embeddings to fixed textual embeddings via a Center-Margin Contrastive Loss that simultaneously promotes intra-class compactness and inter-class separation. Experimental results show that this embedding alignment strategy is more data-efficient and robust than direct multitask learning, and consistently outperforms InfoNCE, center loss, a strong multitask baseline, and a VQA-style multimodal model, particularly in imbalanced settings. The dataset is freely available at doi: 10.5281/zenodo.19125693 and the source code is available at: https://www.healthinformaticslab.org/supp/.

[26] PPOM: Marginalizing Patch-Grid Phase for CLIP-Based Generalizable Vision-Language Prompt Tuning cs.CVPDF

Liang Wang, Haoyang Li, Chao Wang, Guodong Long, Jing Jiang

TL;DR: 本文提出了一种名为PPOM的训练无关推理方法，旨在减少基于CLIP的视觉语言模型在提示调优时对图像与补丁网格对齐（相位）的预测敏感性。该方法通过将相位偏移视为干扰变量，对身份视图和反射填充平移进行评估，并将相反偏移配对成水平、垂直和对角线反相关族，以在相位积分过程中避免视图计数偏差。

Details

Motivation: 动机在于解决提示调优中，由于冻结视觉变换器的非重叠补丁标记化，导致预测对图像与补丁网格对齐（相位）敏感的问题，从而提升模型的泛化能力。

Result: 在多个提示学习宿主模型上，PPOM无需重新训练即可提升宿主性能，表明该方法能有效改善预测稳定性。

Insight: 创新点在于将相位偏移作为干扰变量进行边缘化处理，通过确定性的反相关族分配来整合不同相位视图，为提示适应与补丁网格敏感性之间提供了一个训练无关的接口，增强了模型的鲁棒性。

Abstract: Prompt tuning adapts CLIP-based vision-language models with few trainable parameters, yet its predictions remain sensitive to the spatial sampling imposed by a frozen vision transformer. In particular, non-overlapping patch tokenization makes predictions depend on the alignment (phase) between image and the patch lattice. To reduce prediction sensitivity to patch-grid alignment, we introduce Patch-Phase Orbit Marginalization (PPOM), a training-free inference operator that treats phase shift as a nuisance variable. Given a patch stride, PPOM evaluates the identity view and reflection-padded translations, pairs opposite shifts into horizontal, vertical, and diagonal antithetic families, and assigns equal mass to these families and the identity prediction to avoid view-count bias during phase integration. In summary, PPOM provides a deterministic interface between prompt adaptation and patch-grid sensitivity. Across multiple prompt-learning hosts, PPOM improves host performance without re-training.

[27] Rethinking Auxiliary Modalities in Multimodal Zero-shot Anomaly Detection: From Semantic Fusion to Conditional Modulation cs.CVPDF

Peng Wu, Xin Ge, Yujia Sun, Guansong Pang

TL;DR: 本文提出了一种用于多模态零样本异常检测的即插即用辅助条件增强框架。该框架不直接融合辅助模态与RGB模态的语义，而是将辅助观测作为条件信号来细化RGB特征，从而在保留RGB图像-文本异常匹配路径的同时，利用辅助模态增强现有基于RGB的零样本异常检测器。

Details

Motivation: 现有的多模态方法通常将辅助模态直接融合到共享语义空间中，这可能会干扰RGB基础模型建立的文本对齐异常语义，且常需要特定于模态的架构。本文旨在解决辅助模态如何在不破坏RGB模型已学到的异常语义的前提下，有效补充几何变形、深度变化或细微表面变化等异常信息的问题。

Result: 在MVTec 3D-AD和Eyecandies数据集上的大量实验表明，该框架能持续改进多种流行的基于RGB的零样本异常检测器，在多模态零样本异常检测任务上达到了最先进的性能。

Insight: 核心创新在于从‘语义融合’转向‘条件调制’的范式转变。通过一个轻量级元学习模块生成样本自适应的低秩残差更新，并结合不确定性感知的空间调制，实现了从全局到局部的选择性多模态增强，从而在保留原始RGB异常语义的同时，无缝地利用辅助信息进行特征细化。

Abstract: Recent foundation model-based methods have endowed RGB images with strong zero-shot anomaly detection (ZSAD) through vision-language pretraining. However, RGB observations alone remain limited in perceiving anomalies dominated by geometric deformation, depth variation, or subtle surface changes. Auxiliary modalities can provide complementary structural information, but existing multimodal methods typically fuse them directly into a shared semantic space, which may disturb the text-aligned anomaly semantics established by RGB foundation models and often requires modality-specific architectures. To address this issue, we propose a plug-and-play auxiliary-conditioned enhancement framework for zero-shot anomaly detection. Instead of reconstructing a joint multimodal anomaly semantic space, our framework preserves the original RGB image-text anomaly matching pathway and uses auxiliary observations as conditional signals for RGB feature refinement, allowing auxiliary modalities to seamlessly enhance existing RGB-based zero-shot anomaly detectors. Specifically, a lightweight meta-learning module takes global RGB and auxiliary representations as input and generates sample-adaptive low-rank residual updates to determine how RGB features should be refined. We further construct uncertainty-aware spatial modulation from the initial RGB anomaly response and auxiliary reliability, which determines where local residual updates are strengthened or suppressed. This global-to-local conditional modulation enables selective multimodal enhancement while preserving the original RGB anomaly semantics. Extensive experiments on MVTec 3D-AD and Eyecandies demonstrate that our framework consistently improves multiple popular RGB-based zero-shot anomaly detectors, achieving state-of-the-art performance for multimodal zero-shot anomaly detection.

[28] ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing cs.CVPDF

Zhiyan Zhang, Zicheng Yan, Jianqi Chen, Peipei Song, Shanshan Wang

TL;DR: 本文提出ProFocus框架，通过渐进式视觉聚焦来解读艺术图像中的情感体验。该框架包含层次化艺术评论家（HAC）和渐进式提示融合（PHF）模块，利用多模态大语言模型生成结构化语言先验，并逐步注入视觉特征以模拟人类审美认知过程。在ArtEmis数据集上的实验表明，ProFocus在情感识别和情感解释任务上均优于现有方法。

Details

Motivation: 现有方法依赖通用视觉嵌入（如CLIP），难以捕捉艺术图像中引发情感的微妙线索，而艺术图像通过抽象概念和视觉隐喻刻意引发情感反应，使得情感解读更具挑战性。

Result: 在ArtEmis v1.0和v2.0数据集上的大量实验表明，ProFocus在情感识别和情感解释任务上持续超越最先进（SOTA）方法。

Insight: 创新点在于受人类审美欣赏的层次认知理论启发，通过HAC生成结构化语言先验（氛围风格、叙事主体、具体细节三个认知层次），并利用PHF进行渐进式提示融合，从而更准确地捕捉细微情感线索并生成更忠实的情感解释。

Abstract: Interpreting the emotional responses triggered by images is central to achieving emotional intelligence. Compared with natural images, visual art is intentionally created to elicit emotional responses from its viewers through abstract concepts and visual metaphors, making affective interpretation particularly challenging. However, most existing methods rely on general-purpose visual embeddings (e.g., CLIP), failing to capture the nuanced cues underlying artistic emotion. To address this gap, we propose \textbf{ProFocus}, a novel framework that models affective experience in artistic images via progressive visual focusing. The key idea is to model visual representation learning inspired by a hierarchical cognitive theory of human aesthetic appreciation. Technically, ProFocus contains two core components: a Hierarchical Art Critic (HAC) and a Progressive Hint Fusion (PHF) module. HAC leverages multimodal large language models to generate structured linguistic priors at three cognitive levels–atmospheric style, narrative subjects, and concrete details–thereby translating artistic perception into coherent semantic guidance. Building upon these priors, PHF departs from conventional cross-modal fusion by sequentially injecting the hierarchical hints into visual features, enabling a progressive focusing process that mirrors human perception. This design allows the model to capture subtle affective cues and produce more faithful explanations. Extensive experiments on the ArtEmis v1.0 and v2.0 datasets demonstrate that ProFocus consistently outperforms state-of-the-art methods in both emotion recognition and affective explanation. Project page: https://github.com/Zhang-Zhiyan/ProFocus.

[29] FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation cs.CVPDF

Weidong Tang, Kaiyu Li, Yikai Wang, Yanan Wu, Haotian Gan

TL;DR: 该论文提出了FIRM方法，用于解决多模态大语言模型在遥感图像推理分割任务中，由于视觉令牌编码导致的小目标、细结构丢失问题。FIRM通过为每个视觉令牌预测一个r×r的二进制子单元模式掩码代码，而非单一前景/背景标签，从而保留令牌内部的空间结构信息。该方法还引入了轻量级连续渲染器进一步细化边界，在多个遥感推理分割基准测试中取得了领先性能。

Details

Motivation: 解决多模态大语言模型在遥感图像推理分割中，由于视觉令牌将图像块组编码为单个令牌，导致小目标、细长结构和相邻实例在同一个令牌内部分辨率丢失的问题。这会导致目标合并和边界粗糙，无法满足遥感图像对精细分割的需求。

Result: 在卫星和无人机图像的五个推理和参考分割基准测试（包括LaSeRS和EarthReason）上取得了领先结果。具体而言，在LaSeRS上获得了70.5/80.5的gIoU/cIoU，在EarthReason上平均提升了3.0个百分点，达到了SOTA水平。

Insight: 核心创新在于提出了细粒度令牌内掩码表示（FIRM），将每个视觉令牌的掩码预测从二值标签扩展为结构化子单元模式代码。这显式地建模了令牌内部的空间结构，并通过掩码代码分布边缘化和轻量级连续渲染器实现了从离散到连续边界的精细恢复，为MLLM的细粒度分割提供了新范式。

Abstract: Reasoning segmentation requires multimodal large language models (MLLMs) to translate implicit instructions into precise pixel-level masks. MLLMs encode an image as visual tokens, each of which merges a group of image patches. In remote sensing images, small targets, thin structures, and adjacent instances can occupy different parts of the same visual token. Assigning a single binary mask label to such a token loses its internal spatial structure, causing nearby targets to merge and object boundaries to become coarse. To bridge this representational gap, we introduce FIRM, a Fine-grained Intra-token Representation of Masks. For each visual token, FIRM predicts a mask code that specifies an $r\times r$ binary sub-cell pattern rather than a single foreground/background label. Given a target identified by the MLLM, the complete grid of mask codes is predicted in one mask pass. Fixed lookup converts the predicted codes into a discrete sub-cell mask, while marginalizing the code distribution yields a soft structural field. To further recover fine-grained boundaries within each sub-cell, we introduce a lightweight continuous renderer that refines this field using pre-merge visual features and image details. Across five reasoning and referring segmentation benchmarks on satellite and UAV images, FIRM achieves leading results, including $70.5/80.5$ gIoU/cIoU on LaSeRS and a $3.0$-point average gain on EarthReason. These results demonstrate the value of explicitly representing intra-token mask patterns for fine-grained MLLM segmentation.

[30] MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoning cs.CV | cs.AIPDF

Yingying Fan, Penghui Du, Leyan Zhu, Runze He, Zimeng Wu

TL;DR: 本文提出MedClaw，一种用于长时程手术视频推理的启发式智能体框架。该框架将推理与感知分离，通过一个纯文本编排器来规划证据收集并调用冻结的视觉-语言子智能体执行像素级操作，同时引入无需梯度的启发式技能蒸馏循环来挖掘和提炼可重用的检索技能。

Details

Motivation: 解决现有方法在理解长达数十分钟的手术视频时存在的不足：一次性视觉语言模型会因压缩整个流程而丢失细节，而训练模型关注位置的视频智能体则数据需求大且跨领域泛化能力差。

Result: 在提出的MedClawBench基准（包含自建神经外科长视频和公开讲座视频测试集，共1123个问题）上，该智能体在全部四个评估维度上均一致优于一次性VLM和通用视频智能体框架，尤其在长时程、跨领域的神经外科视频上提升最大。

Insight: 核心创新在于将推理与感知解耦的智能体架构，以及无需梯度、基于奖励门控的启发式技能蒸馏循环，该循环通过挖掘智能体自身的低分轨迹来提炼可重用技能（如定向重看），仅需约100个标注样本即可适应新领域，显著降低了数据需求。

Abstract: Understanding tens-of-minutes surgical videos requires long-horizon temporal reasoning, answering what happens before, after, or across stages of a procedure by grounding the question in visual evidence spread across time. Existing approaches handle this poorly: a one-shot vision-language model (VLM) compresses the whole procedure to fit its context window and loses the detail a “before” or “after” question depends on, while video agents that train the model where to look are data-hungry and transfer poorly to out-of-domain surgery. We build an agent harness that separates reasoning from perception and improves by evolving context rather than optimizing weights. A text-only orchestrator plans which evidence to gather and issues an auditable sequence of tool calls, while frozen vision-language sub-agents execute each call over the pixels, viewing, cropping, inspecting frames, and retrieving external knowledge. We further propose a gradient-free, reward-gated Heuristic Skill Distillation loop that mines the agent’s own low-scoring traces and keeps a candidate skill only when it raises a validation reward, yielding reusable retrieval skills, notably directed re-look. Growing an external skill library rather than tuning weights, the loop adapts from only about 100 labeled examples, far fewer than supervised or reinforcement fine-tuning requires. To evaluate this agent, we introduce MedClawBench, a de-leaked, doctor-grounded benchmark of 1,123 questions over self-built long neurosurgery recordings and a held-out public lecture-video test split. Across both datasets and all four evaluation dimensions, our agent consistently outperforms one-shot VLMs and general video-agent frameworks, with the largest gains on the long, out-of-domain neurosurgery videos. Project page: https://fyycs.github.io/medclaw/.

[31] Content Based Video Narration of Gameplay with Vision Language Models cs.CV | cs.AI | cs.GRPDF

Mathew Varghese

TL;DR: 本文提出了一种基于内容的视频解说系统，利用通用视觉语言模型和文本转语音后端，为任意游戏录像生成电竞风格的语音解说，无需游戏特定工具、引擎遥测或任务特定训练。系统采用时间马赛克打包、上下文条件提示和时长条件生成三种机制，支持云端或本地设备上的语音合成，并提供了定性案例研究、成本模型和故障模式分析。

Details

Motivation: 解决非专业电竞游戏直播中解说内容稀缺的问题，通过通用视觉语言模型为任意游戏录像自动生成解说，无需依赖游戏特定数据或训练。

Result: 在即时战略游戏录像上进行了定性案例研究，成本模型显示马赛克打包将每分钟图像负载减少9倍，并分析了幻觉游戏状态、马赛克分辨率损失和时长缩放韵律伪影等故障模式。

Insight: 创新点包括时间马赛克打包让图像原生VLM推理运动、上下文条件提示抑制重复解说、时长条件生成实现帧精确音频同步，系统作为可复现基线发布，支持本地化语音合成。

Abstract: Live game commentary is scarce: it exists for professional esports broadcasts and almost nowhere else. We present a content-based video narration system that produces spoken, esports-style commentary for arbitrary gameplay recordings using a general-purpose vision-language model (VLM) and a text-to-speech back end, with no game-specific instrumentation, no engine telemetry, and no task-specific training. Three mechanisms carry the system. Temporal mosaic packing arranges nine uniformly sampled frames into a single 3x3 image, letting an image-native VLM reason about motion while consuming one image payload per segment instead of nine. Context-conditioned prompting replays the K most recent narrations as assistant-role history, suppressing the repetition that dominates per-segment captioning of static scenes. Duration-conditioned generation and elastic alignment constrain narration length in the prompt, then time-scale or symmetrically pad the synthesized audio so each utterance fills its segment slot exactly, giving frame-accurate muxing without a forced aligner. The implementation supports either cloud TTS or a 6-bit quantized 4B-parameter on-device TTS model on Apple silicon, making the speech stage fully local. We report a qualitative case study on real-time strategy footage, a cost model showing the mosaic reduces per-minute image payloads by 9x, and a candid account of observed failure modes - hallucinated game state, resolution loss from mosaicking, and prosody artifacts from time-scaling. We release the system as a reproducible baseline, with an evaluation protocol for the quantitative study a full version will report.

[32] SSP: An Event-Matched Syn2Sim2Phy Cross-Domain Evaluation Framework for Autonomous Driving VLA Models cs.CVPDF

Haojie Feng, Peizhi Zhang, Xinrui Zhang, Zhuoren Li, Junpeng Huang

TL;DR: 本文提出了SSP（Synthetic-Simulation-Physical）评估框架，用于自动驾驶视觉-语言-动作（VLA）模型的跨领域评估。该框架通过事件匹配，在合成、仿真和物理三个领域中构建并评估相同的安全关键交互场景，以消除场景内容差异对性能评估的干扰。

Details

Motivation: 现有评估方法通常独立使用合成、仿真和物理数据，导致测得的性能差异可能源于场景内容变化而非模型真实的领域敏感性。SSP旨在解决这一问题，提供一种能够锚定相同交互事件的跨领域公平比较框架。

Result: 在Cut-in和弱势道路使用者横穿等案例中，VLA模型的综合能力得分在合成、仿真和物理领域分别为0.259、0.291和0.325，最佳领域因场景而异。具体模型Alpamayo-R1、OpenEMMA和LLaViDA的得分分别为0.405、0.338和0.131。

Insight: 创新点在于提出了一个事件匹配的Syn2Sim2Phy评估链，通过严格的传递审计确保跨领域场景的核心事件属性一致，从而实现对VLA模型行为更可靠、可复现的评估，且不预设物理领域必然最优。

Abstract: Vision-language-action (VLA) models for autonomous driving jointly produce scene interpretation, language-based reasoning, and driving trajectories. Existing evaluations often use independently selected synthetic, simulated, and physical data, so measured performance gaps can be confounded by changes in scenario content rather than genuine domain sensitivity. We propose SSP (Synthetic-Simulation-Physical), an event-matched Syn2Sim2Phy evaluation framework that anchors cross-domain comparison to the same safety-critical interaction. Starting from a synthetic long-tail video, SSP builds a validated event specification that preserves road topology, participant roles, relative motion, conflict evolution, passing order, response constraints, and event phases. Platform-specific realizations are then constructed in CARLA and on a closed proving ground and are evaluated only after transfer audits confirm preservation of mandatory event properties. SSP maps heterogeneous outputs from OpenEMMA, LLaViDA, and Alpamayo-R1 into common semantic slots and a 1 s trajectory window to assess output validity, semantic accuracy, critical-interaction recognition, trajectory quality, and risk response. Across Cut-in and vulnerable-road-user crossing cases, the macro-averaged Integrated VLA Capability Scores are 0.259, 0.291, and 0.325 in the Synthetic, Simulation, and Physical domains, respectively, while the best domain varies by scenario. Alpamayo-R1, OpenEMMA, and LLaViDA obtain scores of 0.405, 0.338, and 0.131. SSP provides a reproducible scene-transfer chain and an evidence-qualified evaluation of VLA behavior without assuming that the Physical domain is universally superior.

[33] ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models cs.CV | cs.AIPDF

Xinye Li, Lingshuai Lin, Lei Wang, Liuzhou Zhang, Jialin Cui

TL;DR: 本文提出了ForgeWM，一个渐进式因果训练框架，旨在将双向动作条件视频生成器转化为高效的多步视频世界模型。该方法通过领域适应、教师强制因果训练、因果一致性蒸馏和基于策略的分布匹配，生成了可在1、2、4步去噪预算下运行的专用学生模型，并支持结合低延迟交互与可选重放时精化的双路径部署协议。

Details

Motivation: 动作条件视频世界模型需要低延迟的因果生成和对游戏原生控制的可靠响应。尽管因果蒸馏可以实现一步或几步的视频合成，但将其扩展到交互式世界模型仍然具有挑战性，因为在因果训练和自回归展开过程中，离散的键盘状态和连续的鼠标运动必须与时间压缩的潜在块保持对齐。

Result: 在配对的《我的世界》轨迹上，ForgeWM在评估系统中领先于成像质量、参考对齐的运动轮廓一致性、动作信号准确性和鼠标控制准确性，同时实现了最低的参考LPIPS；该四阶段方法可迁移到游戏手柄控制的第一人称射击游戏玩法。重放时精化匹配了四步参考质量，同时比从噪声重新生成更接近经验轨迹约三倍。

Insight: 创新点在于提出了一个渐进式训练框架，通过多阶段蒸馏和分布匹配，将双向模型高效转化为因果、低步数的世界模型，并设计了结合实时交互与事后精化的双路径部署协议，在保持生成质量的同时显著降低了推理延迟。

Abstract: Action-conditioned video world models require low-latency causal generation and reliable responses to game-native controls. Although causal distillation enables one- or few-step video synthesis, extending it to interactive world models remains challenging, as discrete keyboard states and continuous mouse motion must remain aligned with temporally compressed latent chunks during causal training and autoregressive rollout. We introduce ForgeWM, a progressive framework that transforms a bidirectional action-conditioned video generator into efficient few-step world models through domain adaptation, teacher-forced causal training, causal consistency distillation, and on-policy distribution matching with a bidirectional teacher. The resulting budget-specialized students operate at steady-state denoising budgets of 1, 2, and 4 steps. ForgeWM further supports a dual-path deployment protocol combining latency-critical interaction with optional replay-time refinement, where the one-step student re-noises and refines its saved draft. On paired Minecraft trajectories, ForgeWM leads the evaluated systems in Imaging Quality, reference-aligned motion-profile agreement, action-sign accuracy, and mouse-control accuracy, while achieving the lowest reference LPIPS; the same four-stage recipe transfers to gamepad-controlled FPS gameplay. Replay-time refinement matches four-step reference quality while remaining roughly three times closer to the experienced trajectory than regeneration from noise. These results demonstrate ForgeWM’s effectiveness for controllable few-step video generation.

[34] Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation cs.CVPDF

Yanbo Ding, Yijia Fan, Caihua Shan, Yifan Yang, Yifei Shen

TL;DR: 本文系统研究了如何将多模态大语言模型（MLLM）与扩散Transformer（DiT）融合以提升视频生成质量。研究发现，使用基于EMA的tokenizer产生的离散语义视觉token作为中间表示、采用自回归因果建模生成这些token、并通过多层交叉注意力在DiT中显式地融合这些token是最有效的方案。基于此，作者提出了BiVidGen框架，在VBench-Long基准上实现了优于微调DiT基线的语义对齐和时间一致性。

Details

Motivation: 当前基于DiT的视频生成模型在高层次语义规划方面能力有限，而将MLLM与扩散主干结合的混合架构在图像合成中已显示出优势，但在视频生成中尚未得到充分探索。现有方法通常仅将MLLM作为冻结的特征编码器，而非语义生成器。本文旨在填补这一空白，系统研究MLLM与DiT的融合方式。

Result: 实验表明，提出的BiVidGen框架在语义对齐和时间一致性方面优于微调的DiT基线，在VBench-Long基准上取得了更强的性能。

Insight: 论文的核心创新在于系统性地探索并验证了MLLM作为显式视觉规划器（生成离散语义视觉token）与DiT融合的有效范式，而非仅作为文本编码器。这为文本到视频生成提供了一个超越纯文本条件的、更有效的中间语义接口。

Abstract: Diffusion Transformers (DiTs) have become the dominant paradigm for high-fidelity video generation, yet their ability to perform high-level semantic planning remains limited. While hybrid architectures integrating MLLMs with diffusion backbones have shown strong advantages in image synthesis, such designs remain underexplored in video generation, where existing approaches often treat MLLMs primarily as frozen feature encoders rather than semantic generators. To fill this gap, we systematically study how an MLLM should be integrated with a DiT for video generation by answering three questions: what intermediate representation should bridge the MLLM and DiT, how the MLLM should generate it, and how the DiT should incorporate it during diffusion rendering. Our analysis reveals three key findings: (1) discrete semantic visual tokens produced by an EMA-based tokenizer provide a stable and expressive interface, (2) autoregressive causal modeling is effective for generating these tokens, and (3) explicit visual-token conditioning is more effective than prompt refinement or latent bridging. Based on these findings, we propose BiVidGen, a hybrid framework where an MLLM first generates semantic visual tokens and a DiT renders videos conditioned on both text and these tokens via multi-layer cross-attention. Extensive experiments show that BiVidGen improves semantic alignment and temporal coherence over a fine-tuned DiT baseline, achieving stronger performance on VBench-Long. These results demonstrate that explicit MLLM-based visual planning provides an effective intermediate interface for text-to-video generation beyond text-only conditioning.

[35] Discovery and Spatial Characterisation of Multiple Shortcut Groups for Auditing Vision Model Bias cs.CVPDF

Akshit Achara, Vishnunarayan Manickam, Thomas Day, Esther Puyol Anton, Alexander Hammers

TL;DR: 该论文提出了一种新方法来发现和空间表征深度学习模型中的多组捷径特征，这些捷径特征源于数据集的虚假相关性。通过使用K-means和非负矩阵分解对单张图像的捷径和任务贡献图进行聚类，该方法能够识别出仅在图像子集中重复出现的空间捷径模式，从而超越现有仅聚合整个数据集的方法。在多个数据集和模型上的实验表明，所发现的捷径组揭示了共享和独特的空间贡献模式，并支持通过有针对性的干预来减少性能差异。

Details

Motivation: 现有基于归因图的方法通过聚合整个数据集的贡献图来理解虚假相关性的空间性质，但可能掩盖了仅在图像子集中重复出现的空间捷径模式。论文旨在解决这一局限性，以更精细地定位与捷径学习相关的图像区域。

Result: 在CelebA、CheXpert、Waterbirds、Camelyon17和ISIC2019等多个数据集以及ResNet和ViT模型上，该方法成功发现了具有不同子群组成和错误率的捷径组。通过输入遮挡和内部测试时干预实验，证明了屏蔽或抑制任务贡献区域会显著降低模型分类性能，而提出的捷径抑制与任务放大组合干预方法通常能减少性能差异。

Insight: 创新点在于将单张图像的贡献图聚类成组，以揭示仅在数据子集中存在的、可重复的空间捷径模式，从而实现对高错误率图像子集的针对性检查。这提供了一种比全局聚合更精细的模型偏见审计工具，并启发了结合捷径抑制和任务放大的干预策略来缓解性能差异。

Abstract: Deep learning models trained on datasets with spurious correlations can achieve high average accuracy whilst relying on shortcut features that do not generalise out of distribution. Whilst out-of-distribution testing highlights subgroup performance disparities arising from shortcut learning, it does not localise the regions within images that are associated with it. Existing research mostly uses attribution maps from interpretability methods to understand the spatial nature of spurious correlations. For example, conditional alignment methods separate task-relevant evidence from evidence tied to spurious correlations by comparing attribution maps from a task model, a sensitive attribute model, and a bias-reduced reference model. This yields shortcut-aligned and task-aligned contribution maps for each image. However, existing methods aggregate these maps across the dataset, potentially masking recurring spatial shortcut patterns that occur only in subsets of images. We address this limitation by grouping per-image shortcut and task contribution maps into recurring spatial patterns using K-means and non-negative matrix factorisation, and visualising the resulting shortcut groups through contribution maps and representative examples. Across CelebA, CheXpert, Waterbirds, Camelyon17, and ISIC2019, and across ResNet and ViT models, the discovered shortcut groups reveal both shared and distinct spatial patterns of shortcut and task contribution, with varying subgroup composition and error rates, enabling targeted inspection of image subsets with higher error rates. We perform input occlusion and internal test-time interventions to show that masking or suppressing task contribution regions substantially degrades the model classification performance and propose a combined shortcut suppression and task amplification feature intervention approach which generally reduces performance disparities.

[36] InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priors cs.CVPDF

Dingbao Shao, Song Wu, Xinyu Chen, Qian Wang, Jiahang Li

TL;DR: 本文提出了InstructVVT，一个无需辅助空间先验、基于指令驱动和参考引导的视频虚拟试穿框架。该方法利用扩散Transformer，通过双层级参考条件化方案直接从输入三元组（源视频、参考服装、指令）中恢复细粒度控制，并设计了试穿特定的奖励函数来对齐人类偏好。

Details

Motivation: 现有视频虚拟试穿方法严重依赖手工制作的空间先验（如掩码、姿态）进行编辑控制，但这些先验在无约束的真实视频中容易失效，且会压缩丰富的视觉上下文。此外，标准的重建目标无法充分捕捉试穿任务特定的人类偏好。

Result: 在ViViD-S和TripVVT-Bench数据集上的大量实验表明，InstructVVT在服装保真度、结构保持和时间一致性方面优于最先进的开源方法，尽管其所需的推理时控制更少。

Insight: 核心创新在于摒弃了对推理时空间先验的依赖，转而通过双层级参考条件化（MLLM推断语义编辑令牌 + 轻量级条件化路径注入细粒度视觉细节）和试穿特定奖励的强化学习（DiffusionNFT算法）来实现精确控制和对齐人类偏好。

Abstract: Video virtual try-on is a highly constrained editing task requiring the precise replacement of a target person’s clothing while strictly preserving the original video’s spatial structure and temporal dynamics. Existing methods heavily rely on auxiliary handcrafted spatial priors (e.g., masks, poses) for editing control. However, these priors are prone to failure in unconstrained real-world videos and often compress rich visual context into incomplete structural signals. Furthermore, standard reconstruction objectives fail to fully capture try-on-specific human preferences. To address these challenges, we propose InstructVVT, an instruction-driven and reference-guided video virtual try-on framework based on a Diffusion Transformer (DiT) that operates without inference-time spatial priors. Our core insight is to recover fine-grained control directly from the input triplet (source video, reference garment, and instruction) via a dual-level reference conditioning scheme. Specifically, an MLLM infers semantic edit tokens for target disambiguation and structural preservation, while a lightweight conditioning pathway explicitly injects fine-grained visual garment details. Finally, we design a try-on-specific reward and utilize the DiffusionNFT algorithm to align the model with human preferences. Extensive experiments on ViViD-S and TripVVT-Bench demonstrate that InstructVVT outperforms state-of-the-art open-source methods in garment fidelity, structural preservation, and temporal consistency, despite requiring fewer inference-time controls.

[37] SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation cs.CV | cs.AIPDF

Jinsheng Quan, Jianhua Li, Siyi Xie, Xuanke Shi, Kewang Deng

TL;DR: SPARGen是一个统一的多模态生成框架，它将3D重建、稠密对应和空间推理任务统一为指令条件生成任务。该框架通过将紧凑的结构化输出和语言输出序列化为token，同时以图像对齐形式生成稠密几何场，从而在单一原生多模态生成模型中实现空间监督以塑造共享表示。

Details

Motivation: 现有方法通常使用特定任务架构或外部几何模块分别处理空间感知与推理的不同能力，这限制了同一物理场景互补表示之间的知识迁移。

Result: 在3D重建、对应和空间推理的多个基准测试中，SPARGen在单一原生多模态生成框架内，在异构空间任务上取得了有竞争力的性能。

Insight: 核心创新在于将异构空间任务统一为指令条件生成，并通过序列化结构化/语言输出与图像对齐的稠密几何场生成，在原生多模态生成模型中实现联合表示学习与知识共享。

Abstract: Spatial perception and reasoning from visual observations require recovering geometric structure, establishing correspondences, and understanding spatial relations. Existing approaches typically address these capabilities separately using task-specific architectures or external geometric modules, limiting knowledge transfer among complementary representations of the same physical scene. We introduce SPARGen, a unified multimodal framework that casts 3D reconstruction, dense correspondence, and spatial reasoning as instruction-conditioned generation tasks. SPARGen serializes compact structured and linguistic outputs as token sequences while generating dense geometric fields in image-aligned forms, enabling spatial supervision to jointly shape shared representations within a native multimodal generative model. Experiments across benchmarks for 3D reconstruction, correspondence, and spatial reasoning show that SPARGen achieves competitive performance across heterogeneous spatial tasks within a single native multimodal generative framework.

[38] PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection cs.CVPDF

Ziyan He, Xiongtai Yang, Tao Wang

TL;DR: 论文提出PISA框架，用于解决开放词汇目标检测在测试时适应（OVOD-TTA）中因图像域偏移导致的性能下降问题。该方法通过提取抗干扰特征并转换为伪个体源域特征，避免了依赖不可靠伪标签，从而提升检测精度。

Details

Motivation: 现有源无关OVOD-TTA方法依赖精炼测试信息或伪标签，在初始预测较差时准确率显著下降；传统源域估计方法仅适用于分类任务，无法捕获检测所需的密集具体特征。

Result: 在VOC-C、COCO-C和LVIS-C三个基准数据集上，PISA显著提升了原始模型的定位精度和类别识别准确率，在COCO-C上以AP@50%指标超越现有方法3.92%，达到SOTA水平。

Insight: 创新点包括：利用CLIP视觉特征在干扰图像中的不变性构建抗干扰特征提取器（CIFE）；通过特征对齐模块（FAM）和多尺度对齐框架（BAA）生成伪个体源域特征，以密集具体特征替代伪标签监督。

Abstract: Open-vocabulary object detection test-time adaptation (OVOD-TTA) aims to address the performance degradation that pre-trained base models suffer when encountering image-domain shifts. Existing source-free OVOD-TTA methods rely either on refined test-time information for re-scoring or on pseudo-labels for self-training, leading to significant accuracy degradation when initial predictions are poor. Meanwhile, most conventional source-domain estimation methods recover abstract, sparse representations suitable for the classification task, but fail to capture the dense, concrete features required for detection. To address these issues, we propose PISA, a novel source-free OVOD-TTA method that can be seamlessly integrated into open-vocabulary visual backbones. The core components of our method are the Corruption-Invariant Feature Extractor (CIFE), the Feature Alignment Module (FAM), and a multi-scale alignment framework (BAA). To capture detection-suitable features, we develop CIFE to exploit the invariance of CLIP’s visual features across corrupted images, ensuring robustness against various corruptions. We further develop FAM and BAA for the pre-training and adaptation to transform the corruption-invariant features into pseudo-individual source-domain features that are close to the original source-domain features. In this way, dense and concrete pseudo-individual source-domain features are used for supervision instead of unreliable pseudo-label signals. Experiments on the corrupted VOC-C, COCO-C, and LVIS-C benchmarks across three base models demonstrate that PISA substantially improves both the localization precision and the category recognition accuracy of the original models. Notably, PISA achieves state-of-the-art performance without requiring access to source-domain data, surpassing existing methods by 3.92% in AP@50% on COCO-C.

[39] Self-Supervised Visual On-Policy Distillation cs.CV | cs.AIPDF

Yijiang Li, Yijun Liang, Yunjie Tian, Bingyang Wang, Ke Zhang

TL;DR: 本文提出了一种自监督视觉策略蒸馏方法（S²VOPD），通过从学生模型中减去信息而非向教师模型添加特权信息来创建信息不对称性，从而在没有标注、奖励或更强教师模型的情况下生成有效的学习信号。该方法利用非对称增强视图构建策略学习信号，在六个细粒度感知基准测试中显著提升了模型性能。

Details

Motivation: 传统视觉策略蒸馏依赖于教师-学生之间的信息不对称性，通常需要更强的教师模型或特权监督（如参考答案或真实感兴趣区域）。当没有特权信息可用时，如何产生信息不对称性成为一个根本问题。本文旨在解决这一问题。

Result: 在六个细粒度感知基准测试中，S²VOPD将Qwen3.5-4B模型的性能从70.7%提升至77.4%，超过了所有对比的开源模型（包括Qwen3-VL 235B），并超越了GPT-5.4。在保持训练数据不变的情况下，该方法恢复了特权信息方法所实现改进的96%。

Insight: 创新点在于反转了不对称性的来源：通过从学生模型中减去信息（例如对输入图像进行强增强）而非向教师模型添加特权信息来创建有效的学习信号。研究发现不对称性、增强强度以及任务一致性是关键设计因素，对称的自蒸馏会降低性能，而完全移除问题相关证据的增强则会产生大但无信息的差异。

Abstract: Visual on-policy distillation relies heavily on an informative teacher-student asymmetry, through either a larger, stronger teacher or privileged supervision, such as reference answers or ground-truth regions of interest. This raises a fundamental question: where can informative asymmetry come from when nothing privileged is available? We answer this by inverting where the asymmetry comes from. Rather than adding privileged information to the teacher, we subtract information from the student. This asymmetry creates the same effective learning signal for free as a teacher with access to information unavailable to the student, without ground-truth annotations, rewards, or a separate stronger teacher model. Building on this principle, we introduce Self-Supervised Visual On-Policy Distillation (S$^2$VOPD), a simple yet effective method that constructs on-policy learning signals from asymmetric augmented views. S$^2$VOPD distills the teacher’s distribution conditioned on the original image on-policy into the student distribution conditioned on a strongly augmented view of the same image. We systematically explore a broad design space of visual augmentations and uncover that (1) asymmetry matters: all four augmentation families improve performance, while symmetric self-distillation degrades it; (2) strength matters: performance peaks at a moderate strength; and (3) the gap must remain task-consistent: augmentations that completely remove the question-relevant evidence can induce large but uninformative discrepancies. Across six fine-grained perception benchmarks, S$^2$VOPD improves Qwen3.5-4B from 70.7% to 77.4%, above all open-source models compared, up to Qwen3-VL at 235B, and surpasses GPT-5.4. While holding training data the same, it recovers 96% of the improvement achieved by methods with privileged information. Website is at https://williamium3000.github.io/s2vopd

[40] CSG-Mamba: A Convolutional Scoring Gating Vision State Space Network for Endoscopic Polyp Segmentation cs.CVPDF

Yuliang Wang, Jiaqi Wu, Jiaye Song, Shuxia Ren

TL;DR: 本文提出CSG-Mamba，一种用于内窥镜息肉分割的卷积评分门控视觉状态空间网络。该网络基于VM-UNet风格的非对称U形编码器-解码器架构，在语义丰富的瓶颈处插入卷积评分门控（CSG）模块，通过逐点和大核深度卷积生成局部空间评分图，并利用乘法门控重新校准状态空间特征，以解决内窥镜图像中低对比度边界、纹理干扰等问题。

Details

Motivation: 内窥镜息肉分割对计算机辅助结肠镜检查至关重要，但内窥镜图像常存在低对比度边界、黏膜纹理干扰、镜面高光和设备相关的外观变化等挑战。现有的视觉Mamba分割模型通常将2D特征转换为1D扫描序列，这可能削弱局部几何连续性并过度平滑不规则轮廓。

Result: 在Kvasir-SEG数据集上，CSG-Mamba实现了0.9220的Dice系数和15.95的HD95；在CVC-ColonDB数据集上，实现了0.7418的Dice系数和0.6570的mIoU。实验表明，该方法在大多数重叠和召回指标上优于基线模型，同时保持了有竞争力的边界精度。

Insight: 创新点在于提出了卷积评分门控（CSG）模块，该模块结合了卷积操作的局部空间感知能力和状态空间模型（SSM）的长程建模效率，通过生成局部评分图并重新校准特征，有效增强了模型对不规则轮廓和局部细节的建模能力，避免了传统视觉Mamba模型中因1D序列化导致的几何连续性损失。

Abstract: Accurate polyp segmentation is critical for computer-aided colonoscopy, yet endoscopic images often contain low-contrast boundaries, mucosal texture interference, specular highlights, and device-dependent appearance shifts. Vision State Space Models (SSMs) provide efficient long-range modeling with linear complexity, but existing Vision Mamba segmentation models typically convert 2D features into 1D scanning sequences, which may weaken local geometric continuity and over-smooth irregular contours. We propose CSG-Mamba, a convolutional scoring gating Vision State Space network for endoscopic polyp segmentation. Built on a VM-UNet-style asymmetric U-shaped encoder-decoder, CSG-Mamba inserts a Convolutional Scoring Gating (CSG) module at the semantically rich bottleneck. CSG generates a local spatial score map through pointwise and large-kernel depthwise convolutions and recalibrates state-space features by multiplicative gating. Experiments with three random seeds show that CSG-Mamba achieves 0.9220 Dice and 15.87 HD95 on Kvasir-SEG, and 0.7418 Dice and 0.6570 mIoU on CVC-ColonDB, outperforming the baselines on most overlap and recall metrics while maintaining competitive boundary accuracy.

[41] RankT2I: A Submodular Framework for Discovering Interpretable and Diverse Semantics in Text-to-Image Models cs.CVPDF

Ritika Allada, Pinar Yanardag

TL;DR: 本文提出了RankT2I，一个无需训练、与模型无关的框架，用于自动发现文本到图像（T2I）模型（如扩散模型和FLUX模型）中可编辑的语义概念。该方法将语义发现构建为一个集合选择问题，利用子模目标函数从多模态视觉语言模型生成的候选语义中，筛选出相关、可编辑且多样化的语义集合，从而帮助用户高效识别用于图像编辑的多种语义。

Details

Motivation: 现有方法通常需要用户手动指定要修改的语义，这是一个耗时且需要大量试错的过程。因此，论文旨在自动化地发现T2I模型能够成功编辑的语义，以解决这一挑战。

Result: 论文表明，该方法在多个视觉领域都能帮助用户高效识别广泛的语义，并且性能优于现有方法。

Insight: 主要创新点在于将语义发现问题形式化为一个子模优化问题，以同时优化语义的相关性、可编辑性和多样性。这是一种无需训练、模型无关的自动化解决方案，为T2I模型的交互式编辑提供了更高效的语义发现途径。

Abstract: Recent advances in text-to-image (T2I) models have revolutionized the field of image generation and editing. However, identifying semantics that a T2I model can successfully edit in an image continues to be a challenging task. Most existing approaches require users to manually specify semantics to modify a particular image, a time-consuming process that often involves extensive trial and error. In this paper, we present RankT2I, a novel, training-free, and model-agnostic framework that automates the discovery of editable semantics in diffusion and FLUX-based models. Given a visual domain, we first utilize a multimodal vision-language model to gather a broad set of candidate semantics. We then frame semantic discovery as a set selection problem and use a submodular objective to identify semantics that are relevant, editable, and diverse. Our method helps users efficiently identify a wide range of semantics for text-to-image editing models across several domains while outperforming existing methods.

[42] On the Robustness of Temporal Vision-Language Models for Surgical Endoscopy Videos cs.CVPDF

Darakshan Rashid, Raza Imam, Ufaq Khan, Muhammad Bilal, Shazad Ashraf

TL;DR: 本文研究了时序视觉语言模型（TVLMs）在手术内窥镜视频中面对临床真实采集伪影时的鲁棒性。通过构建Endo-C6基准测试集，评估了三种现有TVLM模型在六种内窥镜相关图像退化下的表现，并提出了通过少量样本参数高效调优的RobustEndoCLIP方法，显著提升了模型在退化条件下的性能和鲁棒性。

Details

Motivation: 时序视觉语言模型为手术视频理解提供了可复用的、基于提示的接口，但其在临床真实的内窥镜采集伪影（如散焦、烟雾、运动模糊等）下的鲁棒性尚未得到充分评估，这些结构化分布偏移可能损害视频-文本对齐。

Result: 在Endo-C6基准测试（包含六种高严重性内窥镜真实扰动）上，对三种近期手术TVLM基线模型进行了294次数据集级评估。提出的RobustEndoCLIP通过VeRA进行少量样本参数高效调优，在平均和最坏情况设置下均优于现有TVLM基线。

Insight: 论文的创新点在于构建了首个针对内窥镜视频的紧凑型退化基准Endo-C6，用于标准化鲁棒性评估；并证明现成的TVLM在特定退化下可能出现严重的最坏情况性能崩溃，而轻量级的少量样本适应方法能在不改变提示接口的前提下，显著提升模型在退化条件下的鲁棒性，这为构建更可靠的临床视觉语言系统提供了实用路径。

Abstract: Temporal vision-language models (TVLMs) offer a reusable, prompt-based interface for surgical video understanding, yet, their robustness under clinically realistic acquisition artifacts in endoscopy remains insufficiently characterized. In practice, degradations such as defocus, haze, motion blur, noise, cautery smoke, and packet loss introduce structured distribution shifts which may compromise video-text alignment. We study the robustness of temporal VLMs under such shifts caused by corruptions in clip frames. We introduce Endo-C6, a compact corruption benchmark of six endoscopy-realistic perturbations evaluated at a fixed high severity, and apply it to public Gastrointestinal (GI) endoscopy and laparoscopic cholecystectomy videos. Under a standardized prompt protocol, we benchmark 3 recent surgical TVLM baselines and analyze robustness in both mean and worst-case settings, spanning 294 dataset-level evaluations. Finally, we present RobustEndoCLIP, obtained by few-shot parameter-efficient tuning with VeRA, outperforming existing TVLM baselines. Our findings show that off-the-shelf TVLMs can exhibit severe worst-case collapse under endoscopy-specific corruptions, whereas lightweight few-shot adaptation can substantially improve corrupted performance and robustness without changing the prompt-based interface. We expect Endo-C6 to support standardized robustness reporting and promote more reliable clinical vision-language systems.

[43] Learning to Forecast Crop Growth from Earth Observation Data cs.CVPDF

Dominik Senti, Mehmet Ozgur Turkoglu, Michele Volpi, Helge Aasen

TL;DR: 这篇论文研究了如何利用地球观测时间序列数据和气象驱动因素，在国家尺度上预测作物（特别是冬小麦）的未来冠层发育。作者将作物生长预测问题定义为预测最后一个可用Sentinel-2观测值之后的未来叶面积指数（LAI）轨迹。为了解决云覆盖和重访间隔导致的LAI监督数据稀疏问题，论文引入了一种轻量级的单峰形状正则化器，以提高预测轨迹的合理性。

Details

Motivation: 预测农业景观中的作物生长对于提高农业系统的生产力、韧性和运营管理至关重要。然而，云层覆盖和卫星重访间隔导致可用的LAI观测数据稀疏，使得模型在拟合这些稀疏数据时可能产生不合理的振荡轨迹。

Result: 在覆盖整个瑞士多年的数据集（包含超过2000万个像素级Sentinel-2衍生的LAI时间序列与气象变量配对）上，序列到序列（Seq2Seq）深度学习模型在不同年份间泛化良好，取得了R²高于0.8的成绩，并始终优于传统机器学习基线方法。

Insight: 主要的创新点在于引入了轻量级的单峰形状正则化器，以极小的精度损失显著提高了预测的LAI轨迹的合理性。这项工作展示了结合遥感与天气驱动的序列建模能够在景观尺度上学习作物生长动态，为大规模精准农业预测提供了有效的深度学习解决方案。

Abstract: Forecasting crop growth across agricultural landscapes is important for improving the productivity, resilience, and operational management of farming systems. In this work, we investigate whether Earth observation time series and meteorological drivers can be used to predict future canopy development at country scale. We focus on winter wheat and formulate crop growth prediction as forecasting future leaf area index (LAI) trajectories beyond the last available Sentinel-2 observation. We evaluate this task on a multi-year dataset which spans the entire country of Switzerland, containing over 20 million pixel-level Sentinel-2-derived LAI time series paired with meteorological variables. Because cloud cover and revisit gaps leave LAI supervision sparse, models fit the few valid (cloud-free) LAI observations yet oscillate implausibly between them, producing trajectories no real canopy could follow. We introduce a lightweight unimodal shape regulariser which improves trajectory plausibility with negligible loss in accuracy. We compare deep learning sequence-to-sequence (Seq2Seq) models with classic machine learning baselines and show that Seq2Seq models generalise well across years, achieving $\mathrm{R}^2$ above 0.8 and consistently outperforming conventional approaches. Together, these results demonstrate that remote sensing and weather-driven sequence modelling can learn crop growth dynamics at landscape scale. S

[44] MAGneT-3D: Monocular and Domain-Generalizable Temporal 3D Detection cs.CVPDF

Mohamed Kotb, Johannes Meier, Christoph Reich, Oussema Dhaouadi, Luis Denninger

TL;DR: MAGneT-3D提出了一种用于领域泛化的单目时序3D目标检测方法。它通过域鲁棒锚点生成器（DRAG）动态生成3D提议框，并使用时序精炼与身份合并（TRIM）策略来减少对特定3D提议的依赖，从而提升模型在未见数据集上的泛化能力。

Details

Motivation: 解决基于查询的3D检测器中可学习查询与训练数据空间分布（如视场）过拟合的问题，该问题在应用于单目视频时尤为严重，阻碍了模型在未见数据集和环境中的泛化。

Result: 在nuScenes、Waymo、Lyft和ONCE组成的跨数据集基准测试中，MAGneT-3D在零样本领域转移下优于所有基线，将NDS从12.1%提升至18.6%，同时提高了域内精度。

Insight: 创新点在于用动态的域鲁棒锚点生成器替代静态可学习查询，并结合时序策略来增强泛化；客观来看，其提出的跨数据集评估基准和自适应推理机制对推动领域泛化研究具有借鉴意义。

Abstract: Monocular temporal 3D detection aims to detect objects in 3D, given a monocular video. Query-based 3D detectors unify detection and cross-view association, but their learnable queries fit the spatial distribution of the training data (e.g., field-of-view). We show that this issue is especially severe when these models are applied to monocular video, hindering generalization to unseen datasets and environments. To address this limitation, we introduce MAGneT-3D, the first method for domain-generalized monocular temporal 3D object detection. Instead of relying on static learnable queries, we propose a Domain-Robust Anchor Generator (DRAG) approach that adaptively derives 3D proposals during inference. To further enable domain generalization, we propose a Temporal Refinement and Identity Merging (TRIM) strategy, reducing dependence on specific 3D proposals. To enable comprehensive domain-generalization evaluation, we establish a cross-dataset benchmark spanning nuScenes, Waymo, Lyft, and ONCE. Under zero-shot domain shifts, MAGneT-3D outperforms all baselines, improving NDS from 12.1% to 18.6% while also increasing in-domain accuracy.

[45] Spatial Message Passing in Language Space for Pathology Image Interpretation cs.CV | q-bio.TOPDF

Jing-Cheng Yang, Hao-Jung Wang, Jinhao Du, Yang Hu, Ming-shan Tsai

TL;DR: 本文提出了一种名为空间语言消息传递（SLMP）的框架，用于解决多模态大语言模型（MLLMs）在处理千兆像素全切片图像（WSIs）时因视觉上下文限制而无法有效利用组织空间邻域信息的问题。SLMP将WSI区域表示为空间文本图，其中图块作为节点并由MLLM生成初始描述，边编码空间邻接关系；然后，通过一个可检查的提示策略，让LLM整合来自相邻图块的语言消息来细化每个图块的描述，从而在语言空间中进行空间推理。

Details

Motivation: 动机在于标准的分块处理方法虽然使WSIs可处理，但割裂了定义肿瘤-间质界面和形态的组织邻域关系，因此需要一种能够保留并利用空间上下文进行病理图像解释的方法。

Result: 在代表性的HER2和CAMELYON16区域上，SLMP在通用和病理专用骨干模型的设置中，将图块级肿瘤描述准确率提高了3.3到19.6个百分点；随机邻居消融实验证实了这些提升源于空间上下文而非额外文本，且优化的策略揭示了可解释的、组织特定的决策规则。

Insight: 创新点在于完全在语言空间中进行空间推理，通过可检查的提示策略（可作为自适应局部核在文本上操作）实现从局部细胞上下文到更广泛组织形态的自动语义优化，无需微调MLLM权重，为基于MLLM的病理分析提供了透明且灵活的机制。

Abstract: Multimodal Large Language Models (MLLMs) can generate pathological descriptions from histological images, but gigapixel Whole Slide Images (WSIs) exceed their visual context limits. The standard tiling workaround makes WSIs tractable yet severs the tissue neighborhoods that define tumor-stroma interfaces and morphology. We introduce Spatial Language Message Passing (SLMP), a framework that performs spatial reasoning entirely in language space, human-readable by construction. SLMP represents a WSI region as a spatial text graph: tiles are nodes initialized with MLLM descriptions, and edges encode spatial adjacency. For each tile, an LLM refines its description by integrating language messages from adjacent tiles under a shared aggregation policy that, on the tile grid, acts as an adaptive local kernel operating on text rather than learned embeddings. This policy is an inspectable prompt that can be refined from model-observed tissue phenotypes via textual gradients, enabling automatic semantic optimization from local cellular context to broader tissue morphology without fine-tuning MLLM weights. On representative HER2 and CAMELYON16 regions, SLMP improves tile-level tumor description accuracy in settings spanning general-purpose and pathology-specialized backbones, with gains of +3.3 to +19.6 percentage points. Random-neighbor ablations confirm that these gains stem from spatial context rather than additional text alone, and inspecting the optimized policies reveals interpretable, tissue-specific decision rules. Besides, without any weight updates or fine-tuning the backbone MLLM, SLMP substantially improves general-purpose MLLMs and narrows its gap to pathology-specialized counterparts, offering a transparent and flexible mechanism for incorporating spatial reasoning into MLLM-based pathology analysis.

[46] Seeing Red, Thinking Bad: Color Bias in Vision Language Models cs.CV | cs.AI | cs.CLPDF

Kohsuke Ide, Ryousuke Yamada, Yoshihiro Fukuhara, Hirokatsu Kataoka, Yutaka Satoh

TL;DR: 本文研究了视觉语言模型在处理文本图像时的视觉风格偏见，特别是颜色和对比度对模型分析的影响。通过引入’隐形视觉提示’，作者发现将正面词汇着色为绿色会使情感预测偏向积极，而降低文本-背景对比度则导致模型更依赖视觉线索，产生错误的视觉问答输出。

Details

Motivation: 由于视觉语言模型在招聘支持和推荐等工业决策系统中的广泛应用，需要深入分析其如何处理视觉和文本信息，特别是视觉风格偏见如何影响模型的理解，以确保其可靠性和公平性。

Result: 实验表明，在情感分析任务中，将正面词汇着色为绿色会系统性地使VLMs的情感预测偏向积极方向，导致模型忽略文本中的负面词汇；在视觉问答任务中，降低文本-背景对比度会增加对视觉线索的依赖，从而产生更多错误输出。这些结果揭示了视觉风格对模型性能的显著影响。

Insight: 创新点在于提出’隐形视觉提示’来量化视觉风格偏见，并发现颜色变化会改变视觉编码器的潜在表示，进而影响模型决策。这强调了在VLM设计中考虑视觉公平性的重要性，以避免模型因无关视觉因素而产生偏差。

Abstract: Vision language models (VLMs) are increasingly used in industrial decision-making systems, such as recruitment support and recommendation. This motivates careful analysis of how VLMs process visual and textual information. In this work, we study how VLMs interpret text rendered as an image, and investigate the influence of visual styling biases. To this end, we introduce Stealth Visual Prompts, which subtly change visual styling of text, such as color and contrast, while preserving semantic content. Using these prompts, we systematically control the visual styling of words in text and measure their impact on the analysis performed by VLMs. We further analyze how such visual perturbations affect the latent representations of the vision encoder. From our experiments, we observed that coloring positive words in green consistently shifts sentiment predictions toward a positive direction. As a result, VLMs often fail to properly account for negative words present in the text. Our analysis suggests that this behavior is correlated with changes in the latent representations of the vision encoder induced by color variations. In addition, we show that reducing text–background contrast increases reliance on visually salient cues and leads to more incorrect Visual Question Answering (VQA) outputs. These results suggest that the visual styling of rendered text can guide VLMs’ interpretation in ways that diverge from human semantic understanding. Project page: https://github.com/KohsukeIde/color-bias-vlm

[47] TRIAGE: Risk-Controlled Pseudo-Label Admission for Annotation-Efficient Semi-Supervised Retinal OCT Classification cs.CVPDF

Md Ashraful Hossen Akash, Shyla Afroge, Abdullah Al Mamun, Md. Kishor Morol, Tze Hui Liew

TL;DR: 本文提出了一种名为TRIAGE的风险控制半监督框架，用于视网膜OCT扫描分类。该框架通过结合分层分类器、患者分组风险控制器和上下文感知Transformer教师模型，在标注数据有限的情况下，有效降低了误诊风险并提升了分类性能。

Details

Motivation: 解决视网膜OCT图像标注成本高、现有半监督方法生成伪标签时忽略不同类型错误不对称性的问题，旨在开发一种风险可控的自动化诊断方法。

Result: 在Noor Eye Hospital数据集上，仅使用20%标注数据时达到89.66%扫描级准确率、0.8805宏F1和0.9641宏AUC，误分级率降低8.34%；在OCT-C8数据集上，仅用1%标注数据实现98.00%的三分类准确率。相比六种SOTA半监督方法显著更优，误分级率比固定阈值方法改善42.7%。

Insight: 创新点包括：1）引入非对称成本矩阵的患者级风险控制机制；2）结合分层分类器处理疾病亚型部分异常监督；3）采用上下文感知Transformer进行跨切片验证，提升伪标签质量。

Abstract: The advanced retinal disease diagnosing imaging modality, optical coherence tomography (OCT), encounters a lack of automation because of the high expenses for annotations performed by specialists. The use of SSL solves the problem of insufficient annotations using unlabeled B-scans; however, most of the current techniques for generating pseudo-labels are based on prediction confidence without considering the asymmetry between different types of errors. This paper proposes TRIAGE, a risk-controlled semi-supervised framework for OCT scans classification, which uses the concept of a patient-level conformal risk controller with an asymmetric cost matrix. TRIAGE unites three crucial modules: a hierarchical classifier that is capable of working with partially abnormal supervision of the disease subtypes, a patient-grouped conformal risk controller with primal-dual coverage control, and a context-aware Transformer teacher for cross-slice verification. On the dataset from Noor Eye Hospital (16,822 B-scans, 161 patients, and 554 volumes) with a test set of unseen patients, TRIAGE demonstrates 89.66% scan-level accuracy, 0.8805 macro-F1, 0.9641 macro-AUC, and an 8.34% under-grading rate when using only 20% of the labeled data. With only 5% of the labeled data, TRIAGE keeps 76.88% accuracy and a 0.1656 under-grading rate. Compared with the other six state-of-the-art semi-supervised methods, TRIAGE significantly outperforms them with ablation study demonstrating the contribution of each module in the overall framework performance (by 42.7% in terms of under-grading rate comparing to fixed threshold methods). TRIAGE demonstrates 98.00% accuracy for 3-class classification with 1% labeled data and 95.94% accuracy for 8-class classification with 10% labeled data on the OCT-C8 dataset.

[48] Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery cs.CVPDF

Andrea Federici, Jakob Grahn, Giacomo Boracchi, Filippo Maria Bianchi

TL;DR: 本文提出了一种名为CREST的弱监督语义分割框架，用于在Sentinel-1 SAR图像中分割极地低压。该方法仅使用图像级标签，通过约束区域擦除和动态引导损失来生成像素级掩码，解决了缺乏精确标注和边界模糊的挑战。

Details

Motivation: 极地低压是强烈的海洋气旋，其像素级分割面临两大挑战：一是没有可用的像素级标注数据进行训练；二是其范围界定具有主观性，边界模糊，即使专家标注也不一致。因此需要一种仅依赖图像级标签的弱监督方法。

Result: 在Sentinel-1 SAR数据上，CREST比标准的对抗擦除（AER）方法更紧密地遵循气旋结构，并能生成指示区域可靠性的多类别掩码。在BUS-UCLM乳腺超声和PASCAL VOC人物数据集上的进一步评估表明，在相同设置下，CREST的性能优于等效的AER流程。

Insight: 主要创新点包括：1）约束有序区域扩展（CORE）模块，利用极地低压的空间连通性先验，从高置信度种子点约束区域扩展；2）动态引导（DB）损失，将挖掘顺序作为标签可靠性的代理，减弱对噪声较大的后期挖掘区域的监督。这为处理边界模糊、缺乏密集标注的目标提供了一种有效的弱监督分割思路。

Abstract: Polar lows are intense maritime cyclones that form rapidly at high latitudes. Deep learning can detect them in Synthetic Aperture Radar (SAR) imagery, but pixel-level segmentation remains an open challenge. No pixel-level masks are available for training, and a polar low’s extent is inherently subjective, with diffuse boundaries that even experts delineate inconsistently. We propose Constrained Region Erasing with Soft Targets (CREST), a Weakly Supervised Semantic Segmentation (WSSS) framework that generates masks solely from image-level labels. Our approach builds on Adversarial Erasing (AER), which iteratively mines discriminative regions, erases them, and retrains a classifier to reveal complementary cues that become pseudo-labels for segmentation. However, standard AER also collects irrelevant background features, degrading pseudo-label quality. CREST addresses this with (i) a Constrained Ordinal Region Expansion (CORE) module that encodes the spatial-connectedness prior of polar lows, constraining region expansion from a high-confidence seed, and (ii) a Dynamic Bootstrapping (DB) loss that treats the mining order as a proxy for label reliability, attenuating supervision from noisier, later-mined regions. On Sentinel-1 SAR data, CREST follows the cyclone structure more closely than standard AER, and returns a multi-class rather than binary mask whose classes indicate the reliability assigned to each region. We further evaluate on BUS-UCLM breast ultrasound and PASCAL VOC person data, whose targets satisfy the same connectedness prior but come with the dense masks the SAR data lacks. On both datasets, CREST performs better than the equivalent AER pipeline under identical settings.

[49] GBU-Palm: A Multimodal Video Dataset and Benchmark for Palm Presentation Attack Detection cs.CV | cs.AIPDF

Yingjie Ma, Zitong Yu, Wei Jia, Ajay Kumar, Linlin Shen

TL;DR: 本文提出了GBU-Palm，一个用于手掌呈现攻击检测（PAD）的大规模多模态视频数据集和基准测试。该数据集包含来自105名受试者、210个手掌的21,326个视频，覆盖六种采集环境（包括真实、打印和重放攻击），并提供6,310个同步的RGB-NIR样本。论文建立了泄漏可控的评估协议，并基准测试了四种代表性视频架构在环境匹配和跨环境设置下的性能。

Details

Motivation: 现有手掌PAD数据集通常局限于静态图像、受限的采集条件或不足的多模态视频数据，这阻碍了跨环境、跨模态和跨攻击类型的系统性评估。

Result: 基准测试结果表明，在环境变化下，性能存在显著的架构依赖性退化，并且RGB-NIR融合并不总是优于仅使用RGB输入。分析揭示了不同架构在错误模式和对证据的利用上存在差异。

Insight: 创新点在于构建了一个统一且具有挑战性的多模态视频基准测试，并引入了泄漏可控的评估协议。客观分析认为，其通过详细的模型行为分析（如TA/TR/FA/FR分解、频谱掩码等）为理解PAD模型的失败模式提供了新见解，并挑战了多模态融合必然更优的常见假设。

Abstract: Existing palm presentation attack detection (PAD) datasets are often limited by static imagery, restricted acquisition conditions, or insufficient multimodal video data, hindering systematic evaluation across environments, modalities, and attack types. We present GBU-Palm, a large-scale multimodal video dataset and benchmark containing 21,326 videos from 105 subjects and 210 palms across six acquisition environments, including bona fide, Print, and Replay presentations, with 6,310 synchronized RGB-NIR samples. We construct leakage-controlled protocols that separate palm identity and attack lineage and benchmark four representative video architectures under environment-matched and held-out-environment settings. Results reveal substantial architecture-dependent degradation under environmental shift and show that RGB-NIR fusion does not consistently outperform RGB-only input. We further analyze model behavior through true accept (TA), true reject (TR), false accept (FA), and false reject (FR) decomposition, spectral masking, temporal-order intervention, and frozen-backbone NIR probing, revealing distinct failure patterns and evidence utilization across architectures. GBU-Palm provides a unified and challenging benchmark for developing and evaluating robust multimodal palm PAD methods under cross-environment conditions.

Shuo Liang, Yixing Ma, Pengfei Zhou, Xingyan Chen, Zihan Mei

TL;DR: 本文针对AI生成的危机事件视频带来的虚假信息风险，提出了RA-Bench基准，包含17,886个真实与生成视频，涵盖10个社会风险类别和9个生成器。通过三维度评估发现，现有检测器（包括传统方法、零样本多模态模型和微调MLLMs）均无法在RA-Bench上保持一致的泛化性能，且生成质量、条件信息和社交传播会显著影响检测难度，突显了当前方法在应对逼真生成视频时的局限性。

Details

Motivation: 现有基准在评估AI生成危机视频的检测器和生成器行为方面存在不足，包括检测器在不同生成条件下的可检测性变化、人类对生成视频的感知以及社交传播中检测器的可靠性。

Result: 在RA-Bench上评估了七种传统检测器、十种零样本多模态模型和两种微调MLLMs，结果显示没有一种检测器家族能跨实例一致泛化；生成属性和社交传播会降低检测性能，误导人类的视频同样难以被检测器识别。

Insight: 创新点在于引入以真实视频为锚点的RA-Bench基准，并系统评估了检测器泛化、生成条件影响和社交传播效应；客观来看，该研究揭示了当前检测方法对逼真生成视频的脆弱性，强调了开发鲁棒检测器的紧迫性。

Abstract: Recent video generators can fabricate realistic depictions of wars, disasters, public emergencies, and other real-world crises, creating substantial risks of misinformation. Existing benchmarks, however, provide limited evidence on detector and generator behavior in such settings, including how detectability varies with generation conditions, how people perceive generated videos, and whether detectors remain reliable during social dissemination. To address this gap, we introduce RA-Bench, a benchmark for AI-generated video detection that uses Real videos as Anchors. RA-Bench contains 17,886 videos, comprising 1,830 real-video anchors across 10 social-risk categories and 16,056 generated clips from four open-source and five closed-source generators. Based on RA-Bench, we organize our evaluation along three dimensions. We first assess detector generalization across seven traditional detectors, ten zero-shot multimodal models under three review settings, and two MLLMs specifically fine-tuned on AI-generated video detection. Across these methods, none of the three detector families generalizes consistently across RA-Bench instances. We then examine how detectability varies with generation quality, conditioning information, and sampling seeds. These analyses show that generation properties affect detector families differently, while source-level detection patterns remain stable across seeds. Finally, we study human authenticity judgments and detector reliability during social dissemination. We find that videos that mislead people are also difficult for current detectors, and that social dissemination makes detection harder. Together, these findings show that current methods struggle to detect realistic AI-generated videos, highlighting the need for detectors robust to evolving video generators.

[51] CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets cs.CVPDF

Jihun Park, Kyoungmin Lee, Jongmin Gim, Hyeonseo Jo, Jaeyeul Kim

TL;DR: 本文提出了CRAFT（Constrained Reward via Attention Fine-Tuning），一种用于主题驱动的图像个性化任务的单步强化学习微调框架。该方法无需依赖传统方法中昂贵且复杂的合成目标图像监督，仅使用约1万张参考图像和主题掩码，通过注意力级别的奖励机制来引导模型关注正确的参考主题，从而在新场景中生成保持主题身份的图像。

Details

Motivation: 当前主题驱动的图像个性化方法严重依赖大量成对的（参考图像，合成目标图像）数据进行微调，这些合成目标的制作流程成本高昂、步骤繁琐，并且将方法与特定的目标合成器和数据筛选流程紧密耦合。本文旨在摆脱对合成目标监督的依赖，降低数据构建成本。

Result: 在FLUX.2-klein-9B模型上应用CRAFT，在XVerseBench基准测试中达到了最先进的性能。该方法仅使用了1万个仅含参考图像的数据样本，而之前的方法需要15万到超过200万个合成目标对。

Insight: 核心创新在于提出了一个“看哪里”的原则，通过注意力级别的奖励（对齐噪声和短语标记的注意力到正确的参考主题）和像素级身份奖励的门控机制，实现了无需合成目标监督的高效个性化生成。该方法可以泛化到其他具备参考感知能力的骨干模型上。

Abstract: Subject-driven image personalization—generating new images that preserve the identity of one or several reference subjects in novel scenes—is a foundational capability for modern visual content creation. It is currently dominated by generalized methods that fine-tune a pretrained multimodal diffusion transformer (MMDiT) on hundreds of thousands to millions of paired \emph{(reference, composed-target)} examples, where each composed target is a synthesized image of the subject in a novel scene. Producing such targets demands a costly multi-stage curation pipeline—LLM-based prompt generation, T2I-based composed-target synthesis, reference-subject extraction, VLM-based quality filtering, and correspondence labeling—and tightly couples each method to a particular target synthesizer and curation choice. We introduce \emph{CRAFT} (Constrained Reward via Attention Fine-Tuning), a single-step ReFL framework that fine-tunes a pre-trained \emph{reference-aware} MMDiT via LoRA adapters using a compact reference-only data construction—$10$K reference images and subject masks, with no composed-target supervision. CRAFT realizes a \emph{Where to look} principle: attention-level rewards align noise- and phrase-token attention with the correct reference subject, and the resulting per-subject attention masks gate a pixel-level identity reward to keep image-space supervision consistent with the learned attention routing. Applied to FLUX.2-klein-9B, CRAFT achieves state-of-the-art performance on XVerseBench \rev{while using no composed-target supervision—only $10$K reference-only samples, whereas prior generalized methods require $150$K to over $2$M composed-target pairs}. The same recipe transfers to other reference-aware backbones, consistently improving performance. Project page: https://jihun999.github.io/projects/CRAFT/.

[52] GhostPoint: Self-Supervised Representation Learning by Hallucinating Occluded LiDAR Structure cs.CVPDF

Mohamed Abdelsamad, Bin Yang, Michael Ulrich, Miao Zhang, Yakov Miron

TL;DR: 本文提出GhostPoint，一种用于LiDAR点云的自监督学习框架，通过幻觉化被遮挡区域的结构来增强3D物体检测的表示学习。该方法引入实例体素膨胀来生成局部邻域的潜在特征，并设计了编码器和预测器的双重监督机制，以鼓励模型显式建模超出观测点云的结构。

Details

Motivation: 现有自监督学习方法主要基于可见表面点云定义目标，忽略了被遮挡和未观测区域，导致其在需要鲁棒处理缺失结构的3D检测任务中迁移效果不佳。

Result: 在nuScenes和Waymo数据集上的大量实验表明，该方法达到了最先进的性能，显著提升了下游3D检测效果，尤其是在稀疏扫描和有限标注条件下。

Insight: 创新点在于通过实例体素膨胀生成邻域特征，并引入预测器级监督来显式建模未观测区域；客观分析认为，这种针对遮挡结构的幻觉化学习机制有效缓解了可见表面偏差，提升了表示对缺失数据的鲁棒性。

Abstract: 3D object detection from LiDAR point clouds is a core problem in autonomous driving. Recent advances in self-supervised learning (SSL) enable scalable pretraining and transfers well to per-point tasks such as semantic and panoptic segmentation, but transfer to 3D detection remains weaker. We analyze recent SSL methods and find that most objectives are defined only on measured LiDAR returns from visible surfaces, leaving occluded and unobserved regions unconstrained. This visible-surface bias can be sufficient for point-wise prediction, but 3D detection requires robustness to missing structure. To address this gap, we propose GhostPoint, an SSL framework that hallucinates latent features in local neighborhoods around discovered instances, generated via a novel instance voxel dilation. In GhostPoint, an encoder processes observed returns, and an additional predictor infers neighborhood representations from observed context. In addition to standard encoder-level supervision, we introduce a predictor-level supervision scheme on sampled voxels from generated neighborhoods. Specifically, observed (visible/masked) voxels match teacher-encoder targets, while unobserved voxels match teacher-predictor hallucinations. This design encourages the learned representation to explicitly model structure beyond observed returns. Extensive evaluations on nuScenes and Waymo demonstrate that our method achieves state-of-the-art performance, consistently improving downstream 3D detection, especially under sparse scans and limited labels.

[53] Style or Signature? Artist-Disjoint Evaluation of Style Classification in Frozen Vision Embeddings cs.CV | cs.LGPDF

Rory Ashton

TL;DR: 本文质疑了使用CLIP等冻结视觉嵌入模型进行艺术风格分类时，其高准确率是否真正反映了对风格的理解，还是仅仅依赖于识别特定艺术家。通过引入艺术家不相交的评估协议，即在测试时排除同一艺术家的所有作品，研究发现风格分类准确率显著下降，且不同艺术运动（如印象派、立体主义、超现实主义）的下降程度不均。这表明现有评估方法可能高估了模型对风格的理解能力。

Details

Motivation: 动机在于探究基于冻结图像嵌入的艺术风格分类模型的高准确率是否真正源于对艺术风格的理解，还是仅仅通过识别个体艺术家来实现，从而揭示现有评估协议（随机分割数据集）的潜在缺陷。

Result: 在包含四个20世纪艺术运动的平衡数据集上，使用艺术家不相交协议后，5-NN风格分类准确率从0.87降至0.77，且不同运动下降不均（如超现实主义下降20个百分点）。该模式在包括纯视觉自监督模型在内的四种图像编码器中均成立，表明效果源于视觉结构而非语言。

Insight: 创新点在于提出了艺术家不相交评估协议，以更严格地衡量冻结嵌入中对风格的真实理解；客观分析表明，模型对某些艺术运动（如印象派、立体主义）能捕捉到真正的共享形式（风格鲁棒而艺术家难识别），而对其他运动（如超现实主义）则更依赖艺术家识别，这为评估视觉表示学习提供了重要见解。

Abstract: Frozen image embeddings from models such as CLIP are increasingly used to classify paintings by art-historical style, with high reported accuracy. We ask whether this accuracy reflects an understanding of style or the recognition of individual artists. Standard evaluation uses random splits in which works by the same artist appear on both sides, so a classifier can succeed by recognising the painter rather than the movement. We re-evaluate style classification under an artist-disjoint protocol, holding out every artist in turn so that no work is ever classified using other works by its own painter. On a balanced dataset of 320 paintings across four twentieth-century movements, 5-NN style accuracy falls from 0.87 to 0.77 under this protocol, and the drop is sharply uneven. Impressionism and Cubism barely move, while Surrealism falls twenty points. The pattern holds across four image encoders, including a vision-only self-supervised model, which places the effect in visual structure rather than language. Where an encoder captures genuine shared form, individual artists are barely recognisable yet style is robust, while Surrealism shows the opposite. We argue that artist-disjoint evaluation is necessary to measure stylistic understanding in frozen embeddings.

[54] CPI-Bench: A Comprehensive,Practical and Intelligent Benchmark for Real-World Image Editing cs.CVPDF

Qinye Zhou, Jun Zheng, Yongchao Du, Yuan Wang, Zhengrui Chen

TL;DR: 本文提出了CPI-Bench，一个用于评估真实世界图像编辑模型的综合性、实用性和智能化的基准。它包含三个核心子集：CPI-General-Bench（覆盖多样化编辑任务并首创多图像编辑评估）、CPI-Practical-Bench（聚焦高频真实用户应用场景）和CPI-Intelligent-Bench（专注于高要求推理编辑能力）。

Details

Motivation: 现有图像编辑模型基准局限于简单的单图像任务，覆盖维度有限且无法有效区分不同模型的性能，无法可靠评估模型在复杂多图像编辑、高要求推理指令和实际部署环境中的表现。

Result: 基于CPI-Bench对主流图像编辑模型的评估结果表明，该基准增强了模型间的性能区分度，全面可靠地量化了通用编辑能力、实际部署效能和高级推理编辑的差距。排名分析显示，CPI-Bench与Arena Image Edit Leaderboard实现了最高对齐度，表明其能忠实反映人类评估者的偏好和感知判断。

Insight: 论文的创新点在于构建了一个覆盖多维度（全面性、实用性、智能性）的真实世界图像编辑基准，特别是首创了多图像编辑评估。从客观角度看，其将基准与人类偏好（Arena排行榜）对齐的设计，为评估模型的实际用户体验提供了稳健的代理指标。

Abstract: With the rapid advancement of image editing models and their widespread application across various domains, there is an increasingly urgent need to deploy these model capabilities directly into real-world scenarios. However, existing benchmarks remain confined to simple single-image tasks, suffering from limited coverage dimensions and an inability to effectively differentiate performance among diverse models. Consequently, they fail to reliably evaluate model performance in complex multi-image editing, highly demanding reasoning instructions, and practical deployment settings. To address these limitations, we propose CPI-Bench, a Comprehensive, Practical andIntelligent benchmark for real-world image editing. CPI-Bench comprises three core subsets: CPI-General-Bench, which comprehensively covers diverse editing tasks and pioneers the inclusion of multi-image editing evaluation; CPI-Practical-Bench, which focuses on high-frequency real-user application scenarios; and CPI-Intelligent-Bench, which is dedicated to evaluating capabilities in highly demanding reasoning-based editing. Evaluation results of mainstream image editing models based on CPI-Bench demonstrate that CPI-Bench enhances performance differentiation among models. It provides a comprehensive and reliable quantification of gaps in general editing capabilities, practical deployment efficacy, and advanced reasoning-based editing, offering invaluable guidance for the future optimization of image editing models. Crucially, our ranking analysis reveals that CPI-Bench achieves the highest alignment with the Arena Image Edit Leaderboard, indicating it faithfully captures the preferences and perceptual judgments of human evaluators, serving as a robust proxy for real-world user experience.

[55] Marionette: Predicting World States, Rendering Geometry, Painting Appearance cs.CV | cs.AIPDF

Zian Meng, Zhen Li, Chuanhao Li, Qiang Li, Kaipeng Zhang

TL;DR: Marionette是一个用于交互式游戏的世界模型，它通过显式建模世界状态、使用零参数渲染器处理几何计算、并让神经网络合成外观，从而解决了传统自回归模型在长期预测中因隐式维护世界属性而导致的一致性和可控性问题。

Details

Motivation: 传统交互游戏世界模型直接在像素或潜在空间中自回归视觉观测，导致姿态、几何和遮挡等结构化属性隐含在生成序列中，长期预测中这些潜在世界属性的误差会累积，使得一致性和可控性变得脆弱。

Result: 在实验中，Marionette的预测世界状态可直接控制，强制不匹配的动作流使根对齐关节误差在48个保留片段上改变31%；通过显式状态施加规则（如地形碰撞器和分离上限）可将地面穿透减少66%，保持角色互动，而观测模型无需改变，外观通过预测状态路由未检测到保真度损失，FVD为831（记录姿态为799）。

Insight: 创新点在于将世界状态显式建模为可解释的3D状态（如多实体关节骨架），使用零参数图形桥进行精确几何计算，并让神经网络专注于外观合成，从而提升长期预测的一致性和可控性，允许在状态层面进行修复和规则施加。

Abstract: Interactive game world models typically autoregress visual observations directly in pixel or latent space, forcing structured properties such as pose, geometry, and occlusion to be implicitly maintained by the same generative sequence. Over long horizons, errors in these latent world properties accumulate, making consistency and controllability fragile. We explicitly model the evolving world state, delegate exact geometric computation to a fixed, zero-parameter renderer, and leave the neural model to synthesize appearance. We instantiate this idea as Marionette, a world model for interactive games with articulated characters. First, a two-stage autoregressive dynamics model predicts an explicit and interpretable 276-dimensional 3D world state comprising multi-entity articulated skeletons, metric root trajectories, and rotations. Second, a zero-parameter graphics bridge converts the predicted state into pose-control videos, computing world-space geometry and occlusion in closed form. Third, a control-conditioned video-diffusion observation model synthesizes photorealistic RGB observations from the resulting structured controls. Our experiments establish two properties of Marionette. First, the predicted world state is directly controllable. Forcing a mismatched action stream changes root-aligned joint error by 31% across 48 held-out segments. Second, long-horizon behaviour is determined in the state, and can be repaired there. Left free, the two generated characters drift to 21.2 m apart (recorded sessions stay near 5 m) and a third of frames show ground penetration. Two rules imposed on the explicit state, a terrain collider and a separation cap, cut penetration by 66% and keep the pair engaged, with no change to the observation model. Routing appearance through the predicted state costs no fidelity we can detect, at an FVD of 831 against 799 for recorded pose.

cs.RO [Back]

[56] Evolve Vision-Language-Action Model into an Agent with On-the-fly Tool-use cs.RO | cs.AI | cs.CVPDF

Yi Ding, Yanzhao Yu, Xili Dai, Xianbiao Qi, Peiwen Sun

TL;DR: 本文提出了Agentic Robot with Tool-use (ART)，一个将端到端视觉-语言-动作模型与工具使用代理能力相结合的框架。该框架通过工具注入，使VLA模型能够利用现成的工具模块来处理低层视觉、高层可供性和具身增强任务，从而简化动作解空间、提升泛化能力并降低数据依赖。

Details

Motivation: 解决传统端到端VLA模型在连续动作解空间中复杂度高、泛化能力有限且数据依赖性强的问题，旨在通过模块化工具使用来提升机器人在复杂现实场景中的适应性和实用性。

Result: 在仿真和真实世界任务（如黑暗环境下的新视角抓取放置）上，ART比主流基线方法成功率高出20%，且仅需一个3万条工具使用轨迹的小型数据集进行训练，远少于基线方法所需数据量。

Insight: 创新点在于将工具使用作为代理能力注入VLA模型，通过模块化工具利用实现了更高效的训练、轻量级部署和新工具的可扩展集成，从而增强了系统的鲁棒性、适应性和可扩展性，为VLA系统在复杂现实场景中的实际部署铺平了道路。

Abstract: This paper integrates end-to-end Visual-Language-Action (VLA) models with agentic tool-use to propose Agentic Robot with Tool-use (ART). ART is a tool-injection framework that tunes any VLA model to leverage off-the-shelf tool modules for low-level vision, high-level affordance, and embodiment enhancement. Compared to vanilla VLA models with a whole continuous action solution space, ART reduces the complexity of the action solution space through tool-use, which not only improves generalizability across different tasks but also reduces data dependency. To demonstrate the advantages (high generalizability and low data dependency) of this framework, we first built a dataset of 30K tool-use trajectories and action demonstrations, which is much smaller than those used by baseline methods. We then designed a training regimen for long-trajectory tool-use reasoning in challenging environments. Experiments show that ART achieves a 20% higher success rate than mainstream baselines on simulation and real-world tasks, such as pick-and-place in the dark at novel viewpoints. Empirical results highlight the benefits of an agent-based approach: modular tool utilization enables more efficient training, lightweight deployment, and scalable integration of new tools. This design fosters robustness, adaptability, and extensibility, paving the way for the practical deployment of VLA systems in complex real-world scenarios.

[57] PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment cs.RO | cs.CVPDF

Yuyang Liu, Yanqing Shen, Ruike Chen, Jifan Zhao, Yuxuan Tian

TL;DR: PRM-as-a-Judge 1.5是一个用于机器人过程评估的工具包，它将执行视频转化为密集的进度曲线并衍生出多个细粒度指标，旨在超越传统的二元成功率和基于规则的评分，以更精细地评估具身模型的能力。

Details

Motivation: 为了解决现有机器人评估方法过于粗粒度（仅依赖二元成功率或基于规则的流程分数）的问题，需要一种能够深入理解具身模型执行过程的细粒度评估工具。

Result: 基于基准测试的执行视频，该工具包对多个具身模型进行了全面评估，提供了细粒度的度量结果和关键发现，并引入了RoboPulse++来评估过程奖励模型的可靠性。

Insight: 创新点在于提出了三个新的细粒度指标来刻画失败侧进度、回撤后恢复和成功侧执行质量，并发布了一个包含基准、指标实现和可视化工具的用户友好评估套件，以支持可复现的操作过程评估，倡导建立透明、过程化和可复现的评估标准。

Abstract: Fine-grained robotic evaluation matters for understanding embodied models, going beyond binary success rates and rule-based process scores. We present PRM-as-a-Judge 1.5, a toolkit for robot process assessment that turns rollout videos into dense progress curves and derives multiple fine metrics. PRM-as-a-Judge 1.5 introduces three metrics, building on version 1.0, that characterize failure-side progress, post-drawdown recovery, and success-side execution quality, helping users understand embodied model capability. Based on the rollout videos from benchmarks, we perform a comprehensive assessment of the embodied models, providing some fine-grained metric results and key findings. We further introduce RoboPulse++ to evaluate the reliability of process reward models (PRM), providing evaluators with a more accurate testing platform. Moreover, we release a user-friendly assessment suite, including the benchmark, metric implementation, and visualization tools, to support reproducible manipulation process evaluation. We call on the community to rethink how robots are evaluated and establish transparent, procedural, and reproducible assessment as a foundation for the next generation of embodied intelligence.

[58] MMUSV-Sim: A Perception-Oriented Simulation and Data-Generation Platform for Multi-USV Cooperative Perception cs.RO | cs.CVPDF

Ziao Li, Jianxiong Ye, Biao Tang, Leping Zhang, Kun Zuo

TL;DR: 本文介绍了MMUSV-Sim，一个面向感知的多无人水面艇协同感知仿真与数据生成平台。该平台基于Unreal Engine 5和Project AirSim构建，提供可配置的海上场景、多模态传感器数据采集以及共享标注功能，旨在支持大规模多USV协同感知系统的开发。

Details

Motivation: 为了解决多无人水面艇协同感知系统开发中，缺乏可配置的多USV场景、多模态数据采集和统一标注工作流的问题，需要一个专门的仿真平台来生成高质量的训练和评估数据。

Result: 实验验证了平台配置的波浪设置能有效模拟船舶的升沉、横摇和纵摇运动，并评估了投影标注与语义渲染之间的几何一致性。在基于生成的多USV数据集进行的LiDAR协同BEV船舶检测实验中，早期融合方法达到了72.74的AP@0.5，显著优于单USV的45.54。

Insight: 论文的创新点在于构建了一个专门面向海上多USV协同感知的综合性仿真平台，整合了可配置的环境、动态运动模型和多传感器模拟，为相关算法研究提供了高质量、可扩展的数据生成解决方案。从客观角度看，其将复杂的海上物理条件（如波浪）和多智能体协同感知的数据需求统一到一个工作流中，具有工程实用价值。

Abstract: Cooperative perception among multiple unmanned surface vehicles (USVs) combines complementary observations to extend maritime target sensing beyond the view range and field of a single platform. Developing such systems at scale calls for a unified workflow for configurable multi-USV scenarios, multimodal acquisition, and shared annotations. We present MMUSV-Sim, a perception-oriented maritime simulation and data-generation platform built on Unreal Engine 5 and Project AirSim. It provides island, open-sea, and port environments; configurable weather, time of day, and wave conditions; a diverse vessel asset library; and spline-based multi-vessel motion. MMUSV-Sim acquires RGB, depth, semantic, LiDAR, and radar observations across multiple USVs and captures a common world state for per-agent annotation export. Experiments verify that the configured wave settings produce the intended changes in vessel heave, roll, and pitch, and evaluate the geometric consistency between projected annotations and semantic renderings. In LiDAR-based cooperative BEV vessel detection experiments on the generated multi-USV dataset, Early Fusion achieves an AP@0.5 of 72.74, compared with 45.54 using a single USV.

cs.DB [Back]

[59] Agentic Transaction: Towards ACID-Compliant Agent Systems cs.DB | cs.AI | cs.CL | cs.LGPDF

Zhaoyan Sun, Xiaoxiao Wang, Guoliang Li

TL;DR: 该论文提出了‘智能体事务’的概念，并设计了一个符合ACID原则的智能体系统框架，旨在解决LLM智能体在执行长期任务时面临的可靠性、一致性、并发安全和状态持久化等挑战。该框架通过重新诠释ACID属性的语义，为智能体系统提供了可靠执行的原则性基础，并实现了一个具体的数据智能体实例。

Details

Motivation: 随着LLM智能体从对话助手演变为通过推理、工具使用和代码生成来执行长期任务的自主系统，它们在持久化环境和多步骤工作流中面临着与数据库事务系统类似的挑战，如可靠执行和状态一致性。

Result: 在广泛使用的基准测试上，该系统相比包括Claude Code在内的最先进（SOTA）智能体，性能提升了10.6%。

Insight: 核心创新点是将经典的数据库ACID事务原则（原子性、一致性、隔离性、持久性）重新诠释并应用于LLM智能体系统，提出了语义化的ACID保证。具体实现上，通过事务性的探索-执行-验证循环、事务技能中心、基于置信度分歧的验证等机制来实例化这些保证，为构建可信、可扩展的AI智能体系统开辟了新的研究方向。

Abstract: Large language model (LLM) agents are evolving from conversational assistants into autonomous systems that execute long-horizon tasks through reasoning, tool use, code generation, and workspace manipulation. As agents increasingly operate over persistent environments and multi-step workflows, they face challenges analogous to those addressed by transactional database systems: reliable execution, consistent outcomes, safe concurrency, and durable state management. We introduce the concept of an agentic transaction and propose an ACID-compliant agent system framework that reinterprets the classical ACID properties for agent execution through four semantic guarantees: Semantic Atomicity, Semantic Consistency, Semantic Isolation, and Semantic Durability. Together, these properties provide a principled foundation for building reliable agent systems despite model uncertainty and dynamic execution environments. To instantiate this framework, we develop an ACID-compliant data agent that realizes these guarantees through transactional exploration-execution-validation cycles, transactional skill hubs, confidence divergence-based validation, semantic dependency-aware isolation, and transaction-aware semantic state management. Experimental results on widely used benchmarks show that our system achieves a 10.6% improvement over state-of-the-art agents, including Claude Code. This work opens a broader research agenda on extending transactional principles and system architectures toward building trustworthy, scalable, and self-evolving AI agent systems.

cs.MM [Back]

[60] Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Visual Avatar Generation cs.MM | cs.CV | cs.SDPDF

Lunjie Zhu, Xingtong Ge, Fangyu Lin, Yi Zhang, Zhening Liu

TL;DR: 本文提出了Omni-LiveAvatar，首个支持分钟级、实时流式生成的联合音视频数字人框架。它通过渐进式自回归蒸馏将大型双向扩散模型转化为高效的自回归生成器，并引入同步音视频长短期记忆与分层滚动提示规划策略，以在有限内存下保证长序列的全局一致性与语义连贯性。

Details

Motivation: 现有联合音视频生成模型多依赖双向注意力与多步去噪，只能生成短视频片段，无法满足长时间实时交互的需求。

Result: 实验表明，Omni-LiveAvatar能实时生成高质量、同步的分钟级数字人。在速度上，相比其教师模型LTX-2在单块NVIDIA H200 GPU上实现了33倍的加速；在生成质量上，在视觉质量、音频质量、跨模态同步和人物保真度方面均优于加速基线模型。

Insight: 创新点在于提出了渐进式自回归蒸馏管道、同步音视频长短期记忆模块和分层滚动提示规划策略，实现了从大型扩散模型到高效自回归生成器的转换，并解决了长序列生成中的内存限制与一致性挑战。

Abstract: Joint audio-video generative models serve as foundation for immersive and interactive digital-human generation. Nevertheless, most existing models rely on bidirectional attention and multi-step denoising and can generate only short clips, making them unsuitable for real-time interaction over extended durations. We present Omni-LiveAvatar, the first framework for minute-level, real-time streaming joint audio-video avatar generation. Specifically, we propose (1) a progressive autoregressive distillation pipeline that transfers a large bidirectional joint audio-video diffusion model into a few-step autoregressive generator without auxiliary stabilization mechanisms; (2) a synchronized audio-video long-short-term memory that preserves global consistency under a bounded memory budget; and (3) a hierarchical rolling prompt planning strategy that enables coherent semantic evolution and seamless prompt transitions. Extensive experiments show that Omni-LiveAvatar generates high-quality, synchronized minute-level avatars in real time. In terms of speed, it achieves a 33$\times$ generation speedup over its teacher, LTX-2, on a single NVIDIA H200 GPU; in terms of generation quality, it outperforms accelerated baselines across visual quality, audio quality, cross-modal synchronization, and human fidelity. Our code is available at https://github.com/Aoko955/Omni-LiveAvatar.

[61] AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations cs.MM | cs.AI | cs.CV | cs.HCPDF

Ying Huang, Wencan Zhang, Brian Y. Lim

TL;DR: 该论文提出了AlignFace，一种与人类感知对齐的可解释人脸相似性度量方法。它通过结合认知心理学原理（如面部特征与结构属性依赖、非线性心理物理响应缩放和组内偏见），利用视觉语言模型、门控交叉注意力、概念瓶颈建模和神经广义可加模型来构建。该方法在FACETS数据集上进行了验证，旨在为生成人脸内容（如人脸编辑和隐私保护）提供更忠实于人类感知的评估指标。

Details

Motivation: 当前基于表示的人脸相似性度量方法仅进行行为建模，缺乏认知对齐，假设存在普遍观察者，忽略了不同人群的固有差异，导致对利益相关者的评估不准确，并为生成模型调试提供误导性指导。

Result: 实验表明，与基线指标（包括最新的领域无关学习感知指标）相比，AlignFace显著提高了与人类亚群体感知的对齐度。

Insight: 创新点在于将人脸相似性感知的认知心理学发现（特征/结构属性依赖、非线性缩放、组内偏见）显式编码到可解释的ante-hoc模型中，通过概念瓶颈建模约束推理过程，并使用神经广义可加模型建模非线性影响，从而桥接了学习表示与人类认知过程，实现了更透明和对齐的感知评估。

Abstract: Computer vision models for generated facial content, such as face editing and privacy protection, increasingly affect people, requiring similarity metrics that serve as faithful proxies for human perception. While perceptual evaluation has progressed from signal-based heuristics to representation-based metrics, current approaches are limited to behavioral modeling without cognitive alignment. They rely on implicit and spurious relations while assuming a universal observer, failing to account for inherent variations across diverse human populations. This leads to inaccurate evaluative models of stakeholders and misleading guidance for generative model debugging. Rather than treating perception as a black box, we leverage scientific findings from cognitive psychology of human face similarity perception: dependence on facial featural and configural attributes, nonlinear psychophysical response scaling, and own-group biases. We introduce the FACETS dataset and propose AlignFace, an interpretable, human-aligned, face similarity metric that encodes these cognitive principles through ante-hoc modeling. It employs visual-language modeling (VLM) to encode paired face images and text-based attributes, gated cross-attention (CA) to extract attribute-specific facial difference representations, concept bottleneck modeling (CBM) to constrain reasoning via interpretable face attributes, and neural generalized additive model (GAM) to model their nonlinear influence. Experiments found AlignFace significantly improves alignment with human subpopulation perceptions compared to baseline metrics, including recent domain-free learned perceptual metrics. By bridging learned representations and human cognitive processes, this work enables more transparent and aligned perceptual evaluation metrics for face images.

eess.IV [Back]

[62] VLM- and LLM-Driven Multi-Agent System for PET Image Denoising eess.IV | cs.CVPDF

Boxiao Yu, Savas Ozdemir, Yang Xing, Fumio Hashimoto, Jiong Wu

TL;DR: 本文提出了一种由视觉语言模型（VLM）和大语言模型（LLM）驱动的多智能体框架，用于自动化、决策驱动的PET图像去噪。该框架动态评估图像质量和病灶状态，自主选择最佳去噪模型与参数，并采用带回滚机制的闭环反馈。在西门子Biograph Vision Quadra PET/CT的低剂量数据上验证了其可行性。

Details

Motivation: 解决基于深度学习的PET去噪方法在实际部署中的挑战，如需要多个专用模型和专家干预（例如识别运动伪影、估计噪声水平、进行病灶定量评估），旨在实现自动化、适应性的去噪工作流。

Result: 在1/20和1/50低剂量设置下，完整框架的PSNR和SSIM均优于UNet、GAN和DDPM基线模型，初步结果证明了该闭环多智能体框架适应不同图像条件的可行性。

Insight: 创新点在于将VLM（用于图像质量理解）和LLM（用于上下文推理）结合到多智能体系统中，模拟专家工作流，实现动态评估、自主决策和闭环反馈，为医学图像处理提供了新的自动化、自适应解决方案。

Abstract: Positron emission tomography (PET) imaging suffers from limited spatial resolution and low signal-to-noise ratio, which can compromise quantitative accuracy and lesion detectability. Deep learning-based denoising methods have demonstrated strong potential for improving PET image quality. However, their practical deployment in real-world settings remains challenging, often requiring multiple specialized models and expert interventions, such as identifying motion-induced misregistration artifacts, estimating noise levels to select an appropriate denoiser, and performing lesion-focused quantitative assessment after denoising. Recent advances in vision-language models (VLMs) for image quality understanding and large language models (LLMs) for contextual reasoning provide new opportunities for automated, decision-driven workflows. Inspired by expert workflows for PET image quality enhancement, we propose an VLM- and LLM-driven multi-agent PET denoising framework that dynamically assesses image quality and lesion status, autonomously selects optimal denoising models and parameters, and enables closed-loop feedback with rollback mechanisms. Experiments were conducted on Siemens Biograph Vision Quadra PET/CT data with 1/20 and 1/50 low-dose settings. Individual module evaluations demonstrated the reliability of the agentic components, while the complete framework achieved higher PSNR and SSIM than UNet, GAN, and DDPM baselines at both dose levels. These preliminary results demonstrate the feasibility of using a closed-loop multi-agent framework to adapt PET denoising strategies to different image conditions.

cs.AI [Back]

[63] Modular Cognitive Architecture Emerges in Large Language Models cs.AI | cs.CL | cs.LGPDF

Pengrui Han, Jacob Andreas, Evelina Fedorenko, Andrea Gregor de Varda

TL;DR: 该研究探讨了大型语言模型（LLMs）是否像人脑一样，会自发形成模块化的认知架构。通过对46个涵盖语言、形式推理、社会推理和物理推理四个认知领域的任务进行电路分析，发现LLMs发展出了与人脑相似的模块化组织：在人类中依赖相同网络的任务，在LLMs中会招募重叠的神经元；而依赖不同网络的任务则招募不同的神经元。

Details

Motivation: 研究旨在探索模块化组织是否是智能系统构建的基本原理，而非生物大脑特有的进化偶然，通过比较LLMs与人脑的认知架构来验证这一假设。

Result: 研究发现LLMs确实发展出了与人脑相似的模块化架构，任务间的神经元招募模式与人类认知网络高度对应，这为模块化是智能系统的基本属性提供了证据。

Insight: 论文的创新点在于首次在LLMs中系统性地发现了与人脑功能专业化相似的模块化认知架构，这挑战了模块化仅为生物大脑特质的观点，并暗示模块化可能是跨不同优化过程（如进化与梯度下降）的智能系统的普遍涌现属性。

Abstract: The human brain exhibits a striking degree of functional specialization, with distinct networks supporting language, formal reasoning, reasoning about other minds, and reasoning about the physical world. Is this modular organization a fundamental principle of how intelligent systems must be built, or an evolutionary accident specific to biological brains? Here, we test whether a similar organization emerges in Large Language Models–another class of intelligent systems created through a very different optimization process. Using circuit analyses across N=46 tasks spanning four cognitive domains (language, formal reasoning, social reasoning, physical reasoning), we find that LLMs develop a modular architecture that mirrors the human brain: tasks drawing on the same network in humans recruit overlapping neurons in LLMs, whereas tasks drawing on different networks recruit distinct neurons. The convergent emergence of modularity in brains and neural networks suggests that it may be a fundamental property of intelligent systems.

[64] MobileMem: Learning from a Year of Mobile Experiences cs.AI | cs.CL | cs.LG | cs.MA | cs.MMPDF

Xinle Deng, Yida Xue, Xiangyuan Ru, Haoming Xu, Shuofei Qiao

TL;DR: 论文提出了MobileMem，一个用于研究设备端长期记忆的基准和框架，基于一年规模的移动体验数据构建。它通过知识驱动的合成流程，从用户应用会话中生成连贯且时序一致的长轨迹，涵盖多跳与时间推理、知识更新和隐式偏好推断等任务。该工作旨在推动AI助手从信息检索向基于经验的持续个性化学习发展。

Details

Motivation: 下一代AI助手正从回答孤立问题转向能够理解、记忆并持续从用户经验中学习的持久个人助手，这需要长期记忆来积累和利用用户特定经验。然而，现有基准在真实移动场景（经验异构、多模态、动态且高度个性化）中仍不充分。

Result: 论文构建了MobileMem基准，提供了互补的文本和多模态设置，支持多跳与时间推理、知识更新和隐式偏好推断等任务。该基准使智能体能够记忆过去、理解现在并适应未来，但摘要中未提及具体定量结果或与现有SOTA的比较。

Insight: 创新点在于提出了一个基于真实移动体验的长期记忆基准，通过建模连贯的经验轨迹而非孤立事实，将记忆研究从信息检索推向经验智能。其知识驱动的合成方法能生成时序一致的长轨迹，为持续个性化学习提供了更现实的评估框架。

Abstract: The next generation of AI agents is increasingly moving beyond systems that answer isolated questions toward persistent personal assistants that can understand, remember, and continuously learn from users’ experiences. Such assistants require long-term memory to accumulate and leverage user-specific experiences over time, yet existing benchmarks remain inadequate for realistic mobile settings, where experiences are heterogeneous, multimodal, evolving, and deeply personal. We introduce MobileMem, a benchmark and framework for studying on-device long-term memory, grounded in a year-scale collection of mobile experiences. MobileMem employs a knowledge-grounded synthesis pipeline to construct coherent and temporally consistent long-horizon trajectories from user-app sessions. It provides complementary text and multimodal settings covering multi-hop and temporal reasoning, knowledge updating, and implicit preference inference. Specifically, MobileMem enables agents to remember the past, understand the present, and adapt to the future. By modeling experiences rather than isolated facts, MobileMem moves memory beyond information retrieval toward experiential intelligence for continuous personal learning.

[65] No Universal Signal Predicts Sample-Level LLM Regression under Version Updates cs.AI | cs.CL | cs.LGPDF

Jia Sheng, Yiwei Lu

TL;DR: 本文研究如何预测大型语言模型（LLM）版本更新时可能出现的样本级性能回归问题。通过比较单模型信号（如置信度）和跨版本信号（如KL散度）在多个任务和模型更新对上的有效性，发现信号的有效性取决于具体任务，且没有通用的最佳信号。研究支持了一种概念验证的选择性回退机制，可将高风险样本路由回旧模型。

Details

Motivation: 前沿LLM频繁更新，虽然在总体上性能提升，但可能导致个别样本出现回归（即旧模型正确的回答在新模型下变得错误）。本文旨在研究如何利用推理时可用的信号来预测这种样本级回归。

Result: 在三个任务族（多项选择问答、数学推理、代码生成）的六个基准测试和六个模型更新对上进行评估。结果表明，信号有效性是任务依赖的：置信度在多项选择问答和简单数学任务上最强，而似然/KL信号在更难的数学和代码任务上最常带来增益；没有信号在所有模型更新中都是普遍最佳的。

Insight: 主要创新点在于系统地比较了多种回归预测信号，并提出了一个统一的增值测试来隔离每个信号相对于置信度基线的增益。关键发现是信号有效性高度依赖于任务，这为实践者根据具体更新和任务选择可信信号提供了指导。研究还展示了即使在没有标签的情况下，一些跨版本信号仍然有效，支持了选择性回退的可行性。

Abstract: Frontier LLMs are updated frequently and typically outperform their predecessors in aggregate. But aggregate gains say little about individual samples: an update can still cause sample-level regression, where a response correct under the old model becomes incorrect under the new one. This paper studies how to predict such regressions from signals available at inference time. We compare single-model signals (confidence, logit margin, attention entropy) against cross-version signals (output KL divergence, likelihood drift, token-level KL, representation drift) under a unified added-value test that isolates each signal’s gain over a confidence baseline. Across six benchmarks in three task families (multiple-choice question answering, or MCQ; math reasoning; code generation) and six model update pairs, we find that (1) signal effectiveness is task-dependent: confidence is strongest on MCQ and simpler math, while likelihood/KL signals give the most frequent gains on harder math and code; (2) no signal is universally best across model updates either; and (3) some cross-version signals stay informative even when confidence fails, including without labels, which supports a proof-of-concept selective fallback that routes high-risk samples back to the old model. Practitioners can use these task-level patterns to choose which regression signal to trust for a given update. Code is available at https://github.com/jiashengsally/llm-regression-signals.

[66] ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction cs.AI | cs.CLPDF

Yongqi Tong, Tan Li Hui Faith, Choy Zhen Wen Marcus, Zhou Jin, Kewei Fu

TL;DR: 本文提出ARC（通过条件化的优势正则化）方法来解决开放世界交互中的奖励公平性问题，该方法通过策略条件化的轨迹分组、混合奖励和熵正则化来恢复更公平的相对比较。同时，论文引入了Interact范式及其对应的Interact-86K数据集，用于支持响应式、可引导且执行感知的用户-代理交互训练。

Details

Motivation: 开放世界交互允许多种有效行为，这打破了基于分组的强化学习的核心假设，即组内轨迹不再保证行为可比性，导致奖励模型对交互风格的偏好可能扭曲相对优势，使优化偏向奖励偏好的行为而非情境合适的行为。

Result: 实证结果表明，ARC显著增强了核心的τ/τ²工具使用基准测试性能，同时Interact范式将首令牌生成时间从4.91秒减少到1.27秒（相对于一个思考式基线）。

Insight: 论文的创新点在于将开放交互中的行为可比性问题形式化为奖励公平性问题，并提出了ARC训练框架来确保公平比较；同时，Interact范式通过解耦用户可见的通信与潜在推理和工具使用，为构建可引导的交互系统提供了新思路。

Abstract: Open-ended real-world interaction admits multiple valid behaviors: an agent may answer directly, ask for clarification, provide progress updates, or confirm before acting. This flexibility breaks a core assumption behind group-based RL: rollouts compared within a group are no longer guaranteed to be behaviorally comparable. As a result, reward-model preferences over interaction style can distort relative advantages and steer optimization toward reward-preferred behaviors rather than context-appropriate ones. We formalize this as a \textit{reward fairness problem} and propose \textbf{ARC} (Advantage Regularization via Conditioning), a training recipe that restores fairer relative comparison through strategy-conditioned rollout grouping, together with hybrid rewards and entropy regularization. We study ARC in our proposed \inter, a novel paradigm for responsive, steerable, and execution-aware user-agent interaction that decouples user-visible communication from latent reasoning and tool use. \inter\ also provides the annotation and distillation pipeline for constructing \inter-86K, our strategy-annotated training corpus for supervised and RL training. Empirically, ARC substantially strengthens the core $τ/τ^2$ tool-use benchmarks, while \inter\ reduces time-to-first-token from 4.91s to 1.27s relative to a think-style baseline. Together, these results suggest that a central bottleneck in open-ended interactive learning is not only how agents are rewarded, but whether their behaviors are compared fairly in the first place. The ARC implementation and \inter-86K training data will be released.

Wenyue Hua, Zachary Huang, Tyler Payne, Safoora Yousefi, Saleema Amershi

TL;DR: 本文提出了SocialRL方法，用于训练小型语言模型（4B参数）的社会推理能力，使其能在六个不同的社交互动领域（如谈判、面试、日程安排等）中，从被动的助手转变为具有策略性的谈判代表。该方法通过领域内训练和跨领域知识迁移，使模型在多个任务上达到或超越了GPT-4.1/5系列模型的性能。

Details

Motivation: 当前AI代理在代表用户执行任务（如谈判、日程安排）时，往往过于友好和顺从，容易泄露用户隐私或过早让步，缺乏在目标冲突情境下的有效社会推理和策略性行为。

Result: 在六个领域的评估中，经过SocialRL训练的4B模型在领域内测试中达到或超越了GPT-5系列模型，平均效用为0.627，匹配或超过了GPT-4.1（0.625）、GPT-5.1（0.619）和GPT-5.2（0.613）。在谈判游戏中，将基线到前沿性能的差距缩小了73-122%。

Insight: 创新点包括：1) 提出通用的SocialRL训练框架，直接优化社会推理；2) 发现跨领域迁移遵循游戏结构相似性；3) 引入级联RL和多教师策略蒸馏方法整合领域专家；4) 证明在训练中蒸馏心智理论（ToM）轨迹比仅蒸馏动作更能提升效用和泛化能力。

Abstract: AI agents increasingly act on their users’ behalf, handling tasks such as scheduling meetings, comparing offers, and haggling over prices. These principal-driven tasks routinely place the agent across from a counterpart (another user’s agent, a seller, a recruiter) whose goals may conflict with its principal’s. Yet the dispositions that make an assistant pleasant can make it a poor delegate: a friendly, helpful frontier model may disclose its principal’s private information unprompted and concede at the first sign of resistance. We present SocialRL, a general recipe that trains social reasoning directly, and apply it to a 4B model across six domains: Deal-or-No-Deal, CaSiNo, Craigslist, Job Interview, Calendar, and Marketplace. Every domain is trained in-domain under the same recipe, and every policy is evaluated on all six. We find that (1) in-domain training reaches the frontier: on held-out scenarios the 4B matches or exceeds the GPT-5 family per domain, closing 73-122% of the baseline-to-frontier gap on the negotiation games, with 78% of buyer openings anchoring below target versus 3% untrained; (2) cross-domain transfer follows game structure: structurally paired games lift each other, a broad multi-issue donor lifts nearly all domains, and structurally isolated games transfer nothing; (3) guided by this transfer structure, two strategies, cascade RL and multi-teacher on-policy distillation (OPD), consolidate the per-domain specialists into a single unified 4B that reaches 0.627 average utility across all six environments, matching or exceeding GPT-4.1 (0.625), GPT-5.1 (0.619), and GPT-5.2 (0.613); (4) an explicit theory-of-mind scaffold helps only through training: distilling the ToM trace, rather than actions alone, lifts utility on every environment and generalizes better across them, and of the two ToM skills, only next-action prediction predicts negotiation outcomes.

Lushi Pu, Weiming Zhang, Xinheng Xie, Zixuan Fu, Bingxiang He

TL;DR: 本文提出了MathForm框架，通过知识检索和验证引导的迭代精炼来构建经过验证的训练数据，并训练了MathForm-8B模型。该框架在生成前从Mathlib库中检索相关知识，生成后利用编译器诊断和语义一致性反馈进行修订，从而显著提升了数学命题自动形式化的性能。

Details

Motivation: 现有自动形式化方法过度依赖模型的参数化记忆来获取形式化库（如Mathlib）的特定知识，且数据构建流程通常只是过滤单次输出，缺乏基于反馈的修订机制，导致难以准确地将自然语言数学命题映射到复杂的形式化库类型层次并保持语义一致性。

Result: 在六个基准测试中，MathForm-8B在语法检查（SC）下的平均Pass@8率为88.06%，在一致性检查（CC）下为72.37%，优于多个专门的32B自动形式化模型。在具有挑战性的FATE-H和FATE-X子集上，其CC通过率分别达到63%和37%，均超过了最强的专门基线模型。

Insight: 核心创新点在于将知识检索（生成前）与验证引导的迭代精炼（生成后）相结合，构建了一个能够产生高质量、已验证训练数据的闭环框架。这为解决自动形式化中知识依赖和语义保真问题提供了一种系统性的方法，而非仅仅依赖模型本身的翻译能力。

Abstract: Autoformalization is commonly framed as translating natural-language mathematical statements into machine-verifiable formal languages such as Lean 4. However, faithful formalization requires more than translation. Models must map mathematical concepts to the complex hierarchy of types and definitions in formal libraries such as Mathlib, while ensuring that generated statements preserve the meaning of the source propositions. Existing approaches struggle because they rely heavily on the model’s parametric memory for library-specific knowledge, while common data construction pipelines often resort to filtering single-pass outputs and lack mechanisms for feedback-driven revision. To address these challenges, we introduce MathForm, an autoformalization framework for constructing verified training data through Mathlib knowledge retrieval and verification-guided iterative refinement. Before generation, a retrieval planner gathers relevant definitions and existing formalizations from Mathlib to guide the formalization generator. Generated statements are then revised using compiler diagnostics and semantic-consistency feedback. Using this framework, we construct FormalVerse, a Lean 4 dataset containing approximately 367K verified examples across diverse mathematical domains and sources. We then train MathForm-8B through supervised fine-tuning followed by reinforcement learning. Across six benchmarks, MathForm-8B achieves average Pass@8 rates of 88.06% under Syntax Check (SC) and 72.37% under Consistency Check (CC), outperforming multiple specialized 32B autoformalizers. On the challenging FATE-H and FATE-X subsets, it attains CC pass rates of 63% and 37%, exceeding the strongest specialized baselines in both cases.

[69] Grounding Without Corrective Control: Truth-Tracking Profiles for Large Language Models cs.AI | cs.CLPDF

Brett Reynolds

TL;DR: 本文探讨大型语言模型在缺乏实时纠错机制下的真值追踪能力，提出基于路径配置的分析框架，区分继承约束与实时可应答性，并预测特定任务组合中流畅性失败与干预效果。

Details

Motivation: 研究动机在于解决语言模型仅依赖文本训练时，因缺乏对事实的独立信息访问而导致的真值追踪缺陷，特别是在无实时纠错控制的情况下。

Result: 论文未提供具体基准测试结果，但提出通过路径-任务交互测试来预测未见的路径-任务组合或优化干预选择，强调表面改进与真值追踪改进可能分离。

Insight: 创新点在于引入路径配置框架，区分继承约束与实时可应答性，为分析模型真值追踪提供了结构化方法，并指出自洽性、检索、工具使用等多模态干预可选择性提升性能。

Abstract: Recent work suggests that some large language model representations have content or reference. Grounding can secure either without supplying live routes for correction. This paper asks what follows from that gap. An output is answerable when discrepancies can affect what a target- and task-specific arrangement produces, accepts, or withdraws. The arrangement has corrective control only when live, sufficiently independent routes can detect and repair fresh discrepancies. A route profile records which routes constrain the arrangement and how they are related. Those profiles support analysis of truth-tracking: patterned support for representational success. Language models are the pressure case; text-only arrangements provide a task-relative limiting case. Text-trained models inherit patterns of testimony, coherence, and prior correction. Where target-sensitive correction survives training, these can supply derivative answerability (inherited constraint); live answerability is the relation supplied by a current route for fresh discrepancies. Fluent failures should follow when a task requires independently informative access to the facts. Self-consistency, retrieval, tools, code execution, multimodal input, and feedback should help selectively. Route-by-task interactions test the distinctions. The decomposition’s empirical burden is to predict held-out route–task combinations or improve intervention choice without conceptual refitting. Surface improvement and truth-tracking improvement can come apart.

[70] Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages cs.AI | cs.CL | cs.LGPDF

Chih-Hsuan Yang, Anjir Ahmed Chowdhury, Cheng-Hau Yang, Weijian Zheng, Fernando Llorente

TL;DR: 本文提出了一种名为’多样化假设审议（DHD）’的受控测量协议，用于评估多智能体推理系统中消息的’轨迹价值’，即一个消息（无论其答案正确与否）对后续推理过程是有益还是有害。研究发现，在多个数学和科学基准测试中，包含错误答案的消息中超过四成能够对最终结果的正确性产生积极影响，这表明仅凭答案正确性过滤消息是不够的。

Details

Motivation: 当前多智能体系统通常基于答案正确性、置信度或自动评分来筛选消息，但作者认为一个错误的答案也可能包含有用的推理分解、约束或科学原理，因此需要一种方法来衡量消息对后续推理过程的实际价值（轨迹价值），而不仅仅是其最终答案的正确性。

Result: 在五个数学和科学基准（如MATH、GSM8K等）和GPT-OSS-120B、Gemma-4-31B-IT两个开源模型家族上的实验表明，在每一个基准-模型组合中都出现了’错误但有益’的消息；在那些改变了最终答案正确性的错误消息中，超过40%的改动是有益的，且这种效应具有可重复性（p=0.0002）。

Insight: 核心创新点在于提出了’轨迹价值’这一概念和DHD测量协议，能够量化消息对推理过程的贡献，超越了简单的答案正确性判断。研究发现，保留完整的错误消息（包括其推理过程）比仅保留其答案更能提升最终性能，这为设计更智能的多智能体消息筛选机制提供了新的视角和可重用的学习标签。

Abstract: Multi-agent reasoning systems often use agreement, confidence, or automated scores to decide which messages should shape a final answer. Such filtering assumes that a message likely to be correct is also worth keeping. Yet a wrong answer can contain a useful decomposition, constraint, or scientific principle. We test this distinction with Diverse Hypothesis Deliberation (DHD), a controlled measurement protocol that caches five independently generated messages and replays the same downstream solver, called the integrator, with each message available or hidden. The replay comparison measures a message’s trajectory value: whether making the message available helps or harms subsequent reasoning. Across five mathematics and science benchmarks and two openly available model families, gpt-oss-120b and gemma-4-31B-it, wrong-helpful messages appear in every benchmark-model combination. Among wrong-answer messages that change final correctness, more than four in ten changes are helpful in each model. Controlled repeats show that the number of repeatable message effects is unlikely to arise from replay variation alone (p=0.0002). A focused intervention on repeatable wrong-helpful messages finds that the complete message works best, while retaining its reasoning preserves more success than retaining only its answer; the source of the complete-message advantage remains open. Within the same problem, repeated trajectory-value evidence also identifies a better keep-or-remove choice than answer correctness alone. Answer correctness is therefore informative but does not determine trajectory value. DHD measures this missing property and produces reusable labels for learning when agents should listen.

[71] LLMs Don’t Pay for the Jump cs.AI | cs.CLPDF

Paras Balani, Subhrakanta Panda

TL;DR: 这篇论文探讨了大型语言模型（LLMs）在溯因推理（abduction）上的局限性，特别是无法完成像爱因斯坦等效原理或普朗克能量量子化那样的‘跳跃’。作者认为，这种局限并非源于缺乏具身模拟，而是因为模型缺乏‘认知错误与物理成本耦合’的机制，即错误不会带来实质代价，从而无法强制修正假设。

Details

Motivation: 论文旨在反驳先前研究将LLMs溯因能力不足归因于缺乏具身模拟的观点，并提出更深层的根本原因：模型缺乏使认知错误变得‘昂贵’的物理机制，因此无法像人类科学家那样在面临理论矛盾时被迫做出根本性假设修正。

Result: 作者通过形式化分析表明，固定权重的Transformer推理过程缺乏热力学耦合机制，这与实证结果一致：即使任务因果难度急剧增加导致准确率从100%暴跌至17%，模型输出的熵也几乎不变，说明错误并未引发内部状态的‘成本’或强制修正。

Insight: 核心创新点在于提出了‘认知错误与物理成本耦合’是溯因‘跳跃’的必要条件，并用热力学耦合进行了形式化区分。这为理解机器推理的局限性提供了新视角，即未来AI系统可能需要引入某种使错误产生实质性代价的机制，而不仅仅是扩大规模或增加具身体验。

Abstract: Zahavy [2026] argues that Large Language Models, despite their capabilities in induction and deduction, cannot perform the abductive “Jump” that produced Einstein’s equivalence principle, and attributes this limitation to the absence of embodied simulation. Zheng-Xin [2026] and Farmer [2026] question whether embodiment is necessary for abduction, pointing to alternative routes to General Relativity and forms of abduction that require no sensorimotor grounding. Max Planck resolved the blackbody radiation problem in 1900. Planck’s move to E = hν required no embodied simulation. It was motivated by a mathematical consequence of classical theory, an infinite predicted energy for a finite measured quantity, that could not be physically accepted. We show that neither induction nor deduction could have produced the postulate and argue that its adoption required a coupling between epistemic error and physical cost. We formalize this distinction through thermodynamic coupling and show that fixed-weight transformer inference lacks such coupling, regardless of model scale. This is consistent with empirical results showing that output entropy remains nearly unchanged across tasks with sharply increasing causal difficulty, even as accuracy falls from 100% to 17%. We therefore argue that the missing ingredient in machine abduction may lie deeper than embodiment: a system must have some physical mechanism through which epistemic error becomes costly enough to force revision.

[72] A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images cs.AI | cs.CV | cs.DLPDF

Jennifer D’Souza, Fahad Ahmed, Cecilia Andrea Bustamante Andrade, Lina Frolova, Poorani Gnanasambandan

TL;DR: 本文介绍了ALD/E-ImageMiner基准数据集和ICDAR 2026竞赛，该竞赛专注于从原子层沉积/蚀刻科学图表中提取信息，包含1951张图表，并标注了分类、数据表提取、摘要和视觉问答任务。作者展望了该基准如何指导未来科学图像理解挑战，提出了‘从图像中理解科学概念’的长期目标，并探讨了未来发展方向。

Details

Motivation: 解决科学图表和表格难以被数字图书馆和多模态AI系统检索与解释的问题，旨在推动可验证的多模态科学AI的发展。

Result: 论文介绍了包含1951张图表、专家标注的基准数据集，并设定了分类、数据提取、摘要和视觉问答等任务，作为ICDAR 2026竞赛的基础。

Insight: 创新点在于提出了一个面向科学图像理解的综合性基准，并强调通过Bloom分类法设计问题以支持更深层次的科学理解，将具体竞赛与构建可机器操作、可验证的科学视觉知识的宏大议程联系起来。

Abstract: Scientific figures and tables encode essential experimental evidence, yet remain difficult for digital libraries and multimodal AI systems to retrieve and interpret. The ALD/E-ImageMiner benchmark and ICDAR 2026 Competition on Information Extraction from Atomic Layer Deposition/Etching Scientific Figures provide 1,951 figures from 205 publications, expert-annotated for classification, data table extraction, summarization, and visual question answering. In these companion proceedings, we present a forward-looking perspective on how the benchmark can guide future scientific-image challenges. We examine how its tasks probe capabilities from visual and quantitative reading to domain-grounded reasoning and evidential justification, and how Bloom-informed question design can support deeper scientific understanding. We propose “scientific conceptual understanding from images” as a long-term benchmark objective, with future directions including broader domains and figure types, contextual and cross-document synthesis, hypothesis evaluation, provenance, uncertainty, counterfactual grounding, and open-ended multimodal research. This perspective connects the ICDAR 2026 challenge to a broader agenda for machine-actionable scientific visual knowledge and verifiable multimodal scientific AI.

cs.CY [Back]

[73] Reading Between The Lines: Modeling and Evaluating Behavioral Realism in Legal Simulation cs.CY | cs.AI | cs.CLPDF

Divya Vetticaden, Arya Gupta, Julian Nyarko, Megan Ma

TL;DR: 本文介绍了WitnessSim，一个基于可控法律角色驱动的模拟证人系统，用于法律培训中的质证训练。研究提出了一个评估框架，将行为真实性与教学实用性分开评估，并通过对抗性测试、盲法律师比较和纵向行为轨迹分析来评估行为真实性。

Details

Motivation: 解决当前法律AI评估主要关注事实准确性、推理或回答层面的合理性，而忽视了动态证人行为管理这一质证训练核心需求的问题。

Result: WitnessSim总体上保持了合理的行为边界，律师在盲测中没有系统性地偏好原始证词或WitnessSim生成的证词。教学测试表明，证人行为能根据问题形式和律师干预发生有意义的变化，而不会完全破坏预设的角色。

Insight: 创新点在于提出了一个专门用于评估法律模拟中行为真实性的框架，并开发了可控角色驱动的模拟系统WitnessSim，将行为建模与教学效用评估分离，为法律AI的行为真实性评估提供了新方法。

Abstract: Deposition training requires attorneys to manage dynamic witness behavior, yet legal-AI evaluations largely focus on factual accuracy, reasoning, or response-level plausibility. We introduce WitnessSim, a deposition simulator driven by controllable legal personas. We use an evaluation framework separating behavioral realism from pedagogical usefulness. We assess realism through adversarial testing, blinded attorney comparison, and analysis of longitudinal behavioral trajectories. WitnessSim generally maintained plausible behavioral boundaries, and attorneys did not systematically prefer either original testimony or WitnessSim generated testimony. Pedagogical tests showed that witness behavior changed meaningfully in response to question form and attorney intervention without uniformly collapsing the assigned persona. Together, these results showcase a model of behavioral fidelity in legal simulations, and provide a framework for evaluating its performance.

Syeda Anshrah Gillani, Mirza Samad Ahmed Baig

TL;DR: 本文通过一项预设的随机算法审计，研究了大型语言模型在辅助患者选择医生时，其推荐结果如何受到医生声誉信号（如评分和费用）与人口统计学信号（如通过姓名暗示的性别和种族）的因果性影响。研究发现，声誉信号（高评分、低费用）主导推荐决策，而模型推荐中存在对女性和少数族裔姓名医生的隐性偏好，但这些偏见在模型自我解释中几乎完全不可见。

Details

Motivation: 随着患者越来越多地使用大型语言模型助手来选择医生，这些系统成为了AI信息中介，大规模且隐蔽地决定哪些医生被推荐。本研究旨在通过算法审计，因果性地探究哪些因素（特别是声誉和人口统计学信号）真正驱动了LLM的推荐决策。

Result: 在包含40,068个评分的审计中，声誉信号影响显著：评分从3.9提高到4.7使被选概率增加31.4个百分点，费用从90美元提高到190美元使概率降低20.0个百分点。研究拒绝了人口统计学公平性假设，但方向与人类审计研究预测相反：女性、西班牙裔、南亚裔和黑人姓名暗示的医生分别获得了2.5和1.3-2.9个百分点的偏好优势，相当于每次就诊价值7-14美元。然而，模型在自我解释中几乎从不提及性别或种族（最多0.03%）。

Insight: 论文的创新点在于采用预设、可重复的冻结实验设计进行大规模算法审计，这为持续的行为监控提供了技术方案。核心洞察是：LLM推荐中存在隐性偏见，但这些偏见无法通过依赖模型自我报告的解释机制被发现，凸显了外部行为审计而非模型自解释对于算法透明度和公平性监管的必要性。

Abstract: Patients increasingly ask large language model (LLM) assistants which doctor to see, making these systems AI infomediaries: algorithms that intermediate one person’s choice among other people and thereby decide, silently and at scale, which physicians become visible. We report a prespecified randomized algorithm audit of what causally moves those recommendations. Seven models (six open-weight; gpt-4o-mini) each chose among five synthetic family-medicine physician cards whose attributes were independently randomized across 3,024 choice sets, three patient personas, nine prompt paraphrases and nine experimental arms, yielding 40,068 scored responses; gender and ethnicity were signaled through names following correspondence-audit methodology. Reputation signals dominate: raising a rating from 3.9 to 4.7 increases choice probability by 31.4 percentage points (pp), and raising the fee from $90 to $190 lowers it by 20.0 pp. Demographic parity is rejected, but not in the direction human audit studies predict: female-signaled names gain 2.5 pp, and Hispanic-, South-Asian- and Black-signaled names gain 1.3-2.9 pp over White-signaled names, tilts worth $7-$14 per visit in fee-equivalent terms, and a content-free first-listed position is worth $11. Yet models mentioned gender or ethnicity in at most 0.03% of their stated reasons and abstained in 0.39% of trials, so these effects are invisible in the models’ own explanations, and transparency obligations relying on model self-report would not detect them. One reasoning model failed the prespecified auditability gate outright. The frozen design makes the audit repeatable: any new model can be assessed against identical stimuli, making recurring behavioural audit, rather than self-reported explanation, the monitoring technology fit for purpose.

cs.LG [Back]

[75] Capacity-Dependent Effects of Data Selection for Reasoning cs.LG | cs.AI | cs.CLPDF

Cuong Dang, Hoang Anh Just, Ruoxi Jia

TL;DR: 本文研究了在推理任务的监督微调中，基于似然的数据选择方法的效果如何依赖于模型容量和训练时长。通过数学推理任务的实验，发现小模型（1.5B-8B参数）使用高似然数据能更快提升性能（Fast-Fit），而大模型在更长时间训练后能从低似然数据中获得更大收益（Slow-Gain）。

Details

Motivation: 解决在推理监督微调中，如何根据学生模型当前分布选择候选响应的问题。现有基于似然的选择方法认为接近学生分布的响应能提供更有效的监督，但本文质疑这一直觉的普适性。

Result: 在数学推理任务上，使用更强教师模型生成的监督数据进行实验。结果表明，小模型（如1.5B参数）使用高似然数据能获得更快、更稳定的早期提升；而大模型（如8B参数）在延长训练后，低似然数据变得更有益。

Insight: 创新点在于揭示了数据选择效果的容量依赖性（Fast-Fit/Slow-Gain模式），并提供了容量受限的知识蒸馏理论视角，阐明数据难度、数据跨度与学生容量共同影响知识迁移。实践上，有效的推理数据选择应考虑模型容量和计算预算，而非单一偏好高似然监督。

Abstract: In reasoning supervised fine-tuning, candidate responses for the same instruction can differ substantially in how well they match the student’s current distribution. Recent likelihood-based response selection methods suggest that responses closer to the student distribution provide more effective supervision, motivating the hypothesis that high-likelihood responses may generally be preferable for fine-tuning. In this paper, we revisit this intuition and show that the value of likelihood-based data selection depends critically on model capacity and training duration. Through controlled experiments on mathematical reasoning, using students ranging from 1.5B to 8B parameters and supervision generated by stronger teacher models, we observe a clear \emph{capacity-dependent} ``{\color{SMALLCOLOR}\textbf{Fast-Fit}} / {\color{LARGECOLOR}\textbf{Slow-Gain}}’’ pattern. High-likelihood data provides faster and more stable early improvements, especially for smaller models, but low-likelihood data becomes increasingly beneficial for larger models when training is allowed to continue longer. To explain this phenomenon, we analyze learning dynamics, showing that small models often fail to absorb low-likelihood supervision and instead fall into shallow or repetitive behaviors, while larger models are better able to move toward the teacher distribution under such data. We further provide a capacity-constrained theoretical view of distillation that clarifies how data difficulty, data span, and student capacity jointly govern transfer. Overall, our findings show that effective data selection for reasoning should be aware of model capacity and computing budget rather than based on a single universal preference for high-likelihood supervision.

[76] CForce: Boosting Parallel Decoding for dLLMs via Consistency Forcing cs.LG | cs.AI | cs.CLPDF

Yuji Ren, Chenkai Xu, Zhuocheng Gong, Jianguo Li, Zhijie Deng

TL;DR: 本文提出了CForce方法，旨在提升扩散大语言模型（dLLMs）的并行解码性能。该方法通过一致性强制蒸馏，使早期去噪阶段的掩码预测与后期阶段对齐，从而减少错误传播。实验表明，该方法在非编辑和可编辑的LLaDA模型上均能改善速度与质量的权衡。

Details

Motivation: 现有扩散大语言模型在激进并行策略下，早期去噪阶段的预测可能不可靠，导致错误传播至后续阶段，影响生成质量。

Result: 在非编辑和可编辑的LLaDA模型上的实验显示，CForce方法改善了速度与质量的权衡，特别是在高并行解码预算下表现更优。

Insight: 创新点在于提出了一致性强制蒸馏方法，并引入了置信度自适应KL散度作为蒸馏目标，结合了正向和反向KL散度的优点；理论分析解释了该方法如何近似最小化早期阶段的预测误差，且同一框架适用于掩码到令牌解码和可编辑解码。

Abstract: Diffusion large language models (dLLMs) accelerate language generation by predicting multiple masks in a single forward pass. However, existing dLLMs can suffer from unreliable predictions in early denoising stages under aggressive parallelism strategies, leading to errors that can propagate to later stages. To tackle this issue, we present Consistency Forcing (CForce) for dLLMs, a distillation method to force the mask predictions of early stages to align with those of later stages. CForce trains the model on pre-collected self-rollout trajectories, thereby improving training-inference alignment. We introduce Confidence Adaptive KL Divergence as a distillation objective to conjoin the merits of forward and reverse KL. We further provide a theoretical analysis for the consistency objective to explain why CForce can approximately minimize the prediction error of early stages. Critically, the same formulation applies to both mask-to-token decoding and edit-capable decoding; in the edit-capable case, later token-to-token refinements provide additional supervision for earlier masked-state predictions. Experiments on non-edit and edit-capable LLaDA models show improved speed-quality trade-offs, especially under high-parallelism decoding budgets. Code is available at: https://github.com/inclusionAI/dFactory.

[77] MINT: A Universal Zero-Shot Predictor for Transaction Data cs.LG | cs.CLPDF

Parameswaran Kamalaruban, Viktor Drobnyi, Maeve Madigan, Julia Rozanova, David Sutton

TL;DR: 本文提出了MINT（多模态指令交易网络），一种用于交易数据的通用零样本预测框架。它通过轻量级嵌入注入、交易-语言对齐和指令调优，将预训练的交易序列编码器与仅解码器LLM连接起来，旨在提升对新颖下游预测任务的灵活零样本推理能力。

Details

Motivation: 现有支付基础模型不适用于跨新颖下游预测任务的灵活零样本推理，而基于LLM的零样本预测方法要么未能充分利用交易数据中的预测信号，要么依赖成本高昂的文本序列化或扩展性差的任务特定架构。

Result: MINT在分布内和分布外问题的预测问答性能上达到了最先进水平（SOTA），同时与文本序列化基线相比，显著减少了输入标记、延迟和内存消耗。

Insight: 核心创新在于通过紧凑的交易嵌入（而非文本序列化）来连接交易编码器与LLM，实现了高效的多模态推理。具体技术包括轻量级嵌入注入、交易-语言对齐和指令调优，这为交易数据的零样本预测提供了一种更优的表示方法。

Abstract: Banks analyse sequential financial transaction data to perform many tasks, including fraud prevention, credit risk assessment and offer personalization. To improve the predictive accuracy of these tasks, Payments Foundation Models encode transaction sequence data as rich contextual embeddings, which can then be provided to task-specific models as features. However, these Foundation Models are not designed for flexible zero-shot reasoning across novel downstream prediction tasks, limiting their adaptability and utility. Existing LLM-based approaches to zero-shot prediction often fail to fully exploit the predictive signal within transaction data, while relying on costly text serialization or task-specific architectures that scale poorly. To address these limitations, we present the Multimodal Instruction Network for Transactions (MINT), a framework that connects a pretrained transaction sequence encoder to a decoder-only LLM through lightweight embedding injection, transaction-language alignment, and instruction tuning. We find that MINT achieves state-of-the-art predictive question-answering performance in both in-distribution and out-of-distribution questions, while substantially reducing input tokens, latency, and memory consumption compared to text-serialization baselines. Through comprehensive analyses of representations, alignment strategies, training data, and history length, we establish that compact transaction embeddings are a superior approach to transaction representation than text serialization for multimodal reasoning and zero-shot prediction tasks.

[78] Designing Reinforcement Learning for Diffusion Models: A Unified Path-Space View cs.LG | cs.CV | stat.MLPDF

Yixian Xu, Yuanrui Zhang, Shengjie Luo, Liwei Wang, Di He

TL;DR: 本文提出了一种统一的路径空间视角来设计扩散模型的强化学习（RL）方法，揭示了现有反向轨迹和正向匹配两类方法本质上源于同一路径空间原理，并通过重要性采样推导出统一的策略梯度估计器，进而构建了一个包含价值梯度估计、权重函数和采样选择的设计空间，最终提出了一种多样本KDE价值梯度估计器与尺度有界的权重函数族，在SD3.5-M和Qwen-Image模型上的实验验证了方差减少的解释并超越了现有基线。

Details

Motivation: 当前用于扩散模型的RL算法（如反向轨迹方法和正向匹配方法）是碎片化的，缺乏统一的理论框架，本文旨在从路径空间原理出发，统一这些看似不同的损失函数，并提供一个系统的设计空间。

Result: 在SD3.5-M和Qwen-Image模型上的实验验证了方差减少的解释，并表明所提出的方法优于先前的扩散模型RL基线。

Insight: 创新点在于通过路径空间重要性采样统一了扩散模型RL的两类方法，揭示了其差异本质上是方差减少效应而非RL原理不同，并提出了一个包含价值梯度估计、权重函数和采样选择的系统设计空间，以及多样本KDE估计器和尺度有界权重函数等具体改进方案。

Abstract: Reinforcement learning (RL) post-training provides a direct way to align diffusion models with human preferences and task-specific rewards. However, current RL algorithms for diffusion models remain fragmented: reverse-trajectory methods rely on discretized likelihood ratios, whereas forward-matching methods train on reward-labeled noising versions of the rollout samples. This paper shows that these seemingly different losses arise from a single path-space principle. Starting from the regularized diffusion-RL objective, we use importance sampling between sampling SDEs to obtain an explicit policy-gradient estimator on trajectory space. The estimator contains the stochastic Itô integral underlying Flow-GRPO-type updates; we derive an equivalent variance-reduced value-gradient form that recovers the forward-matching structure of AWM and DiffusionNFT. This identifies the empirical gap between these method families as a variance-reduction effect rather than a difference in RL principle. The derivation yields a unified design space organized by value-gradient estimation, weight functions, and sampling choices. Within this space, we propose a multi-sample KDE value-gradient estimator that reuses rollout groups, together with scale-bounded weight families that retain stable existing recipes while excluding singular ones. Experiments on SD3.5-M and Qwen-Image models validate the variance-reduction explanation and show that the resulting recipe improves over prior diffusion-RL baselines.

physics.optics [Back]

[79] Label-Free Deep-Tissue Peripheral Nerve Detection with a Handheld Multimodal OCT Probe and NerveDetNet physics.optics | cs.CV | physics.med-phPDF

Yihan Wang, Ruilin You, Shaobai Li, Jiabin Chen, Bofan Song

TL;DR: 本文提出了一种无需标记、用于检测未切开组织下外周神经的框架，该框架结合了手持式多模态OCT探头和轻量级2.5D分割网络NerveDetNet，能够仅基于OCT结构强度特征实现神经的深度分辨检测。

Details

Motivation: 解决手术中埋藏在完整组织下的外周神经难以可视化的问题，现有OCT方法多依赖暴露的神经或偏振对比，穿透深度有限，限制了其在术中引导中的应用价值。

Result: 在离体组织实验中，NerveDetNet在所有帧间距下均优于六个代表性的2D基线模型，在最稀疏采样条件下Dice分数达到0.725，且模型参数量约为一半；端到端验证实现了对表面不可见神经的定位，以及深度达1.3-1.4 mm的深度分辨检测。

Insight: 创新点在于首次提出了完全基于强度OCT的无标记神经检测框架，并设计了专用于稀疏采样OCT体积分析的轻量2.5D网络NerveDetNet，通过神经特征相关模块整合空间上下文和帧间信息，提升了弱信号恢复能力；同时，手持多模态探头与“确认后捕获”工作流程增强了临床实用性。

Abstract: Peripheral nerves buried beneath intact tissue are difficult to visualize during surgery and remain inaccessible to white light wide-field imaging and other surface optical imaging methods. Existing OCT nerve studies have largely relied on exposed nerves or polarization contrast with limited depth penetration, restricting their value for subsurface intraoperative guidance. Here, we introduce, to our knowledge, the first label-free framework for detecting peripheral nerves beneath unopened tissue and resolving their depth using intensity-based OCT structural signatures alone. The framework combines a handheld multimodal probe, integrating swept-source OCT with co-registered white light and autofluorescence imaging, with a ``confirm-then-capture’’ workflow designed for practical surgical use. To enable efficient analysis of sparsely sampled OCT volumes, we develop NerveDetNet, a lightweight 2.5D segmentation network that recovers weak and spatially displaced nerve signals by incorporating spatial context, frame-order information, and shift-tolerant correlations across frames through a dedicated nerve feature correlation module. In ex vivo tissue experiments, NerveDetNet consistently outperformed six representative 2D baselines across all frame spacings, achieving a Dice score of 0.725 under the sparsest sampling condition while using approximately half the model parameters. End-to-end validation demonstrated localization of nerves invisible at the surface and depth-resolved detection up to 1.3–1.4~mm below the tissue surface, with OCT derived depth maps overlaid directly onto the surgical view. Together, these results establish a practical label-free approach for subsurface nerve visualization that supports intraoperative compatibility, enables efficient sparse-volume analysis, and provides depth-resolved guidance without tissue opening, contrast agents, or nerve exposure.

Table of Contents

cs.CL [Back]

[1] Think in Latent, Explain in Language: Self-Explainable Latent Reasoning cs.CL | cs.AI | cs.LGPDF

[2] Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems cs.CL | cs.AIPDF

[3] IterCOMP: Reasoning-aware Adaptive Prompt Compression for Multi-hop Question Answering cs.CL | cs.AIPDF

[4] GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings cs.CL | cs.LGPDF

[5] Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models cs.CL | cs.AI | cs.CV | cs.LGPDF

[6] Bootstrapping Niche Multilingual Code Translation via Reinforcement Learning with Execution-Based Verifiable Supervision cs.CLPDF

[7] Batch-wise Adaptive Pruning: Periodic Neuron Activation-Aware Weight Pruning for Language Reasoning Model cs.CLPDF

[8] S2Dialog: Multimodal Dialogue Retrieval with Semantic and Acoustic-Style Modeling cs.CLPDF

[9] Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge cs.CLPDF

[10] SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning cs.CL | cs.AIPDF

[11] Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RL cs.CLPDF

[12] A Survey of Large Models in Sports cs.CL | cs.CVPDF

[13] You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model cs.CL | cs.LGPDF

cs.CV [Back]

[14] Multiphase-Diff: Diffusion-Based Generative Modeling for High-Contrast Multiphase Physical Systems with Sharp Interfaces cs.CVPDF

[15] MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation cs.CV | cs.AIPDF

[16] PROVE: Training-Free Prompt Recovery using Verifiable Evidence cs.CVPDF

[17] Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains cs.CVPDF

[18] ChartProbe: A Diagnostic Study on Visual Reasoning through Perception, Grounding, and Simple Reasoning cs.CVPDF

[19] Doomed to Re-Annotate, Forever: The ImageNet Story cs.CVPDF

[20] XSA-MAD: Cross-modal Semantic Alignment for Morphing Attack Detection cs.CVPDF

[21] RGBX-Next: Towards Realistic Generative Rendering from G-Buffers cs.CV | cs.GRPDF

[22] Beyond Control Points: Arcsecond Relative-Motion Estimation of Vision Measurement Platforms With Incomplete or Absent Control Fields cs.CVPDF

[23] Consensus-gated Multi-Agent Neural Architecture Search for Seismic Fault Segmentation cs.CVPDF

[24] CoANeRV: Coordinate-Aware Token-Space Neural Video Representation cs.CVPDF

[25] CMCNet: Aligning Ultrasound Image Embeddings with Textual TI-RADS Representations for Fine-Grained Thyroid Classification cs.CV | cs.AIPDF

[26] PPOM: Marginalizing Patch-Grid Phase for CLIP-Based Generalizable Vision-Language Prompt Tuning cs.CVPDF

[27] Rethinking Auxiliary Modalities in Multimodal Zero-shot Anomaly Detection: From Semantic Fusion to Conditional Modulation cs.CVPDF

[28] ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing cs.CVPDF

[29] FIRM: Fine-Grained Intra-Token Representation of Masks for Remote Sensing Reasoning Segmentation cs.CVPDF

[30] MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoning cs.CV | cs.AIPDF

[31] Content Based Video Narration of Gameplay with Vision Language Models cs.CV | cs.AI | cs.GRPDF

[32] SSP: An Event-Matched Syn2Sim2Phy Cross-Domain Evaluation Framework for Autonomous Driving VLA Models cs.CVPDF

[33] ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models cs.CV | cs.AIPDF

[34] Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation cs.CVPDF

[35] Discovery and Spatial Characterisation of Multiple Shortcut Groups for Auditing Vision Model Bias cs.CVPDF

[36] InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priors cs.CVPDF

[37] SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation cs.CV | cs.AIPDF

[38] PISA: A Pseudo-Individual Source-Domain Feature Adaptation Framework for Test-Time Open-Vocabulary Object Detection cs.CVPDF

[39] Self-Supervised Visual On-Policy Distillation cs.CV | cs.AIPDF

[40] CSG-Mamba: A Convolutional Scoring Gating Vision State Space Network for Endoscopic Polyp Segmentation cs.CVPDF

[41] RankT2I: A Submodular Framework for Discovering Interpretable and Diverse Semantics in Text-to-Image Models cs.CVPDF

[42] On the Robustness of Temporal Vision-Language Models for Surgical Endoscopy Videos cs.CVPDF

[43] Learning to Forecast Crop Growth from Earth Observation Data cs.CVPDF

[44] MAGneT-3D: Monocular and Domain-Generalizable Temporal 3D Detection cs.CVPDF

[45] Spatial Message Passing in Language Space for Pathology Image Interpretation cs.CV | q-bio.TOPDF

[46] Seeing Red, Thinking Bad: Color Bias in Vision Language Models cs.CV | cs.AI | cs.CLPDF

[47] TRIAGE: Risk-Controlled Pseudo-Label Admission for Annotation-Efficient Semi-Supervised Retinal OCT Classification cs.CVPDF

[48] Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery cs.CVPDF

[49] GBU-Palm: A Multimodal Video Dataset and Benchmark for Palm Presentation Attack Detection cs.CV | cs.AIPDF

[50] Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social Dissemination cs.CV | cs.AIPDF

[51] CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets cs.CVPDF

[52] GhostPoint: Self-Supervised Representation Learning by Hallucinating Occluded LiDAR Structure cs.CVPDF

[53] Style or Signature? Artist-Disjoint Evaluation of Style Classification in Frozen Vision Embeddings cs.CV | cs.LGPDF

[54] CPI-Bench: A Comprehensive,Practical and Intelligent Benchmark for Real-World Image Editing cs.CVPDF

[55] Marionette: Predicting World States, Rendering Geometry, Painting Appearance cs.CV | cs.AIPDF

cs.RO [Back]

[56] Evolve Vision-Language-Action Model into an Agent with On-the-fly Tool-use cs.RO | cs.AI | cs.CVPDF

[57] PRM-as-a-Judge 1.5: A Toolkit for Robot Process Assessment cs.RO | cs.CVPDF

[58] MMUSV-Sim: A Perception-Oriented Simulation and Data-Generation Platform for Multi-USV Cooperative Perception cs.RO | cs.CVPDF

cs.DB [Back]

[59] Agentic Transaction: Towards ACID-Compliant Agent Systems cs.DB | cs.AI | cs.CL | cs.LGPDF

cs.MM [Back]

[60] Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Visual Avatar Generation cs.MM | cs.CV | cs.SDPDF

[61] AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations cs.MM | cs.AI | cs.CV | cs.HCPDF

eess.IV [Back]

[62] VLM- and LLM-Driven Multi-Agent System for PET Image Denoising eess.IV | cs.CVPDF

cs.AI [Back]

[63] Modular Cognitive Architecture Emerges in Large Language Models cs.AI | cs.CL | cs.LGPDF

[64] MobileMem: Learning from a Year of Mobile Experiences cs.AI | cs.CL | cs.LG | cs.MA | cs.MMPDF

[65] No Universal Signal Predicts Sample-Level LLM Regression under Version Updates cs.AI | cs.CL | cs.LGPDF

[66] ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction cs.AI | cs.CLPDF

[67] From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL cs.AI | cs.CL | cs.LG | cs.MAPDF

[68] MathForm: Scaling Mathematical Autoformalization with Knowledge Retrieval and Verification-Guided Refinement cs.AI | cs.CLPDF

[69] Grounding Without Corrective Control: Truth-Tracking Profiles for Large Language Models cs.AI | cs.CLPDF

[70] Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages cs.AI | cs.CL | cs.LGPDF

[71] LLMs Don’t Pay for the Jump cs.AI | cs.CLPDF

[72] A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images cs.AI | cs.CV | cs.DLPDF