cs.CL [Total: 11]
cs.CV [Total: 33]
cs.SE [Total: 1]
cs.LG [Total: 4]
cs.AI [Total: 5]
cs.MM [Total: 1]
cs.RO [Total: 2]

cs.CL [Back]

[1] Adversarial Style Optimization: Enhancing VLM Jailbreaks by GRPO-based Stylistic Triggers Optimization cs.CL | cs.AIPDF

Bingjun Luo, Jialin Guo, Yue Yao, Xinpeng Ding

TL;DR: 本文提出了一种名为对抗性风格优化（ASO）的即插即用增强模块，旨在通过基于GRPO的风格触发器优化来增强对多模态大语言模型（MLLMs）的越狱攻击。研究发现MLLMs存在风格不一致性，即其内容理解能力对视觉风格鲁棒，但安全防御机制却容易被特定风格触发绕过。ASO通过微调图像编辑模型，在给定对抗图像上叠加优化的风格修改，利用结合了基于logit的拒绝检测信号和强大评判模型高保真语义评估的结构化分层奖励函数来指导GRPO代理，从而显著提升现有视觉越狱攻击的成功率。

Details

Motivation: 现有基于内容的越狱攻击在面对快速发展的MLLMs时表现不一致且效果不佳，未能有效利用非内容层面的漏洞。本文的动机是基于实证发现MLLMs存在风格不一致性，即其安全能力比理解能力更容易受到视觉风格变化的影响，从而提出通过优化风格触发器来增强越狱攻击。

Result: 大量实验表明，ASO能显著提升最先进（SOTA）攻击的攻击成功率（ASR），证明了风格偏差是红队测试MLLMs的一个可扩展向量。

Insight: 本文的核心创新点在于揭示了MLLMs的风格不一致性这一新漏洞，并提出了ASO框架，将风格优化问题形式化为一个由结构化分层奖励函数指导的GRPO强化学习问题，从而实现了对现有视觉越狱攻击的通用、可插拔式增强。从客观角度看，将风格作为独立的对抗扰动维度，并利用强化学习进行优化，为理解和攻击多模态模型的安全对齐提供了新视角。

Abstract: Multimodal Large Language Models (MLLMs) have achieved impressive performance, but their safety alignment remains vulnerable to jailbreak attacks. Existing content-based jailbreaks are often inconsistent and show unsatisfying performance against the rapidly evolving MLLMs, failing to exploit non-content-based vulnerabilities. Unlike previous research, we empirically find that MLLMs exhibit a Stylistic Inconsistency between their comprehension ability and safety ability: MLLMs can robustly understand content regardless of visual style, yet their defense mechanisms can be easily bypassed by specific stylistic triggers. Based on this finding, we propose Adversarial Style Optimization (ASO), a plug-and-play enhancement module to amplify existing visual jailbreaks. ASO fine-tunes an image-editing model to superimpose an optimized stylistic modification onto a given adversarial image, using a Group Relative Policy Optimization (GRPO) agent guided by a Structurally-Tiered Reward Function that combines a logit-based signal for detecting explicit refusals with a high-fidelity semantic evaluation from a powerful judge model. Extensive experiments show that ASO significantly enhances the ASR of SOTA attacks, demonstrating that stylistic biases are a scalable vector for red-teaming MLLMs. Our code is available at https://github.com/bingjunluo/ASO.

[2] Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms cs.CL | cs.AI | cs.CVPDF

Abu Tyeb Azad, Fahim Ahmed, Ishita Sur Apan, Ezharuddin Jubaer, Sumaiya Karim Katha

TL;DR: 本文介绍了Khondo，这是首个针对孟加拉国政府表格文档包分割的多模态基准数据集。该数据集是双语（孟加拉语-英语）且基于视觉原生的，模型直接在页面图像上操作。通过零样本评估多模态大语言模型（MLLMs），发现模型能较好地将页面聚类到源文档中，但在恢复打乱后的原始页面顺序方面存在困难。研究通过控制分析指出，页面顺序重建是主要挑战，语言是次要但一致的影响因素。

Details

Motivation: 解决在政府和管理工作流中常见的文档包（多个文档拼接成单个文件）分割问题，特别是针对低资源语言（如孟加拉语）的困难，现有基准主要基于英语和OCR文本，缺乏多模态和双语支持。

Result: 在Khondo基准上的零样本评估显示，MLLMs在页面聚类方面表现较好，但在页面顺序重建上存在显著挑战；控制分析表明，明确指令和语言（英语比孟加拉语更可靠）主要影响排序而非聚类。

Insight: 创新点在于引入了首个双语、视觉原生的文档包分割基准，强调页面顺序重建作为基于视觉的低资源文档理解中的关键开放问题；客观分析认为，该研究突出了多模态模型在文档结构恢复方面的局限性，为未来研究提供了可控的评估框架。

Abstract: Document packets, multiple documents concatenated into a single file, are common in government and administrative workflows, yet splitting them into their constituent documents is difficult, especially for low-resource languages. We introduce Khondo (Bangla for split/segment), the first benchmark for document packet splitting on Bangladeshi government forms. Unlike prior English and OCR-text-based datasets, Khondo is bilingual (Bangla–English) and vision-native; where models operate directly on page images. It spans five concatenation schemes, from sequential to fully shuffled, across 14 administrative domains, with ground-truth boundaries, domain types, and page order. Zero-shot evaluation of MLLMs shows they cluster pages into their source documents fairly well but struggle in restoring the original page order once shuffled. To isolate what drives this difficulty, we run two controlled analyses, varying the prompt instruction and then the packet language. Both primarily affect ordering rather than clustering: (a) explicit page-order instructions are necessary but insufficient, and (b) English packets are ordered more reliably than Bangla, making page arrangement the dominant challenge and language a secondary but consistent factor. Khondo establishes page-order reconstruction as a key open problem in vision-based, low-resource document understanding, and provides a controlled benchmark for measuring progress toward solving it. Our dataset and code is available at https://huggingface.co/datasets/Mausul/khondo

[3] A Consensus-Based Framework for Relative Preference Evaluation of Large Language Models cs.CLPDF

Mohtashim Khan

TL;DR: 本文提出了一种基于共识的大语言模型相对偏好评估框架，通过让一组不同的LLM对同一提示的匿名候选响应进行排序，以模型间的一致性作为盲测条件下感知响应质量的代理指标。该框架在编程、常识、安全、逻辑推理和数学等多个领域，使用五个SOTA LLM进行了控制研究，并计算了反映模型响应被其他模型偏好评频率的相对智能指数（RII）。

Details

Motivation: 传统LLM基准主要依赖静态数据集和客观评分指标，当存在多个可接受答案时，仅凭正确性无法区分响应在清晰度、完整性和有用性上的差异。因此，需要一种能够衡量模型生成响应之间相对偏好而非绝对正确性的评估方法。

Result: 研究在多个领域使用五个SOTA LLM进行实验，计算了相对智能指数（RII），揭示了跨领域的一致偏好模式，即某些模型的响应更频繁地被其他模型高度评价。但结果反映的是模型间偏好一致性，而非客观正确性或人类判断。

Insight: 创新点在于提出了一个可扩展的、模型驱动的比较评估框架，通过模型间的共识投票来评估响应质量，为存在多个有效答案的场景提供了评估响应质量的新视角。该方法将聚合的模型间一致性作为盲测感知质量的代理信号，尽管不直接与人类评估对齐，但可作为相关性的部分参考。

Abstract: Traditional benchmarks for LLMs primarily rely on static datasets and objective scoring metrics, which often fail to capture differences in response quality when multiple answers are acceptable. In such settings, correctness alone is insufficient to distinguish between responses that vary in clarity, completeness, and usefulness. This paper introduces a consensus-based evaluation framework that measures relative preference among model-generated responses rather than absolute correctness. Instead of evaluating outputs against a fixed ground truth, we assess how a panel of diverse LLMs ranks anonymized candidate responses to the same prompt. This approach treats aggregate inter-model agreement as a proxy for perceived response quality under blind conditions. We conduct a controlled study using five state-of-the-art LLMs across multiple domains, including programming, general knowledge, safety, logical reasoning, and mathematics. Each model generates responses and independently ranks peer outputs through a structured voting process. Scores are aggregated into a Relative Intelligence Index (RII), representing how frequently a model’s responses are preferred by other models. Our findings reveal consistent preference patterns across domains, with certain models more frequently ranked highly by their peers. However, we emphasize that these results reflect inter-model preference alignment rather than objective correctness or human judgment. This framework provides a scalable, model-driven method for comparative evaluation, offering an alternative perspective on response quality in scenarios where multiple valid answers exist. While not directly aligned with human evaluation, prior work suggests that aggregated model preferences can partially correlate with human judgments, motivating this as a proxy signal.

[4] J-CoT: Chain-of-Thought in J-Space cs.CL | cs.AIPDF

Junde Wu, Jiayuan Zhu, Fengling Liu, Minhao Hu, Jiazhen Pan

TL;DR: 本文提出J-CoT，一种基于J空间的循环推理框架，旨在改进思维链提示方法。它通过在模型隐藏表示中定义一个词汇索引坐标系（J空间），将中间状态表示为词汇系数（J-thought）进行传递，从而避免了完全依赖自然语言或传递整个密集隐藏向量的限制。

Details

Motivation: 现有思维链方法仅依赖自然语言作为循环接口过于受限，而潜在推理方法传递整个隐藏向量又缺乏对下一步推理所需信息的显式选择和组织机制。因此，需要一种既保持语言基础性又无需解码完整句子的中间接口。

Result: 在匹配主干网络和推理设置下，J-CoT-Zero在各项基准测试中均达到或超过最强的潜在推理基线；J-CoT-Train在数学、科学、编码和结构化路径推理任务上获得了最高分。

Insight: 创新点在于引入J空间作为词汇索引的中间表示，允许以系数形式选择性地传递和组织信息，实现了介于自然语言和完整隐藏状态之间的高效循环推理接口。

Abstract: Chain-of-thought prompting improves language-model reasoning by carrying intermediate states across successive computation steps. However, relying on natural language as the only recurrent interface is overly restrictive, since many transient computations do not need to be fully verbalized. Existing latent-reasoning methods remove this constraint by recurrently propagating continuous hidden states. However, these methods pass a dense hidden vector as a whole, without an explicit mechanism for selecting and organizing the information needed by the next reasoning step. This motivates an intermediate interface that remains linguistically grounded without requiring a decoded sentence. We introduce \textbf{J-CoT}, a recurrent reasoning framework built on \emph{J-space}, a vocabulary-indexed coordinate system within the model’s hidden representations. Within each cycle, the model computes in its full hidden space. At the cycle boundary, J-CoT expresses the intermediate state as vocabulary-indexed coefficients, carries these coefficients forward as a \emph{J-thought}, and maps them back into the model’s hidden representation for the next cycle. J-CoT therefore requires neither a fluent intermediate rationale nor recurrence over the complete hidden state. Under matched backbone and inference settings, J-CoT-Zero matches or exceeds the strongest evaluated latent-reasoning baseline on every benchmark, while J-CoT-Train obtains the highest score across the evaluated mathematical, scientific, coding, and structured path-reasoning tasks.

[5] Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs cs.CLPDF

Zixuan Ren, Jinliang Lu, Junhong Wu, Yang Zhao, Dai Dai

TL;DR: 本文系统研究了强化学习（RL）训练的大语言模型（LLM）在模型合并中的行为，发现相较于传统的监督微调（SFT），RL训练能显著减少任务冲突，使合并后的模型性能下降更小，更适合模型合并过程。

Details

Motivation: 模型合并对于整合多个专业模型至关重要，但现有研究主要关注合并策略，而训练范式（如SFT和RL）对合并效果的影响尚未被充分探索。

Result: 通过对五个代表性任务的综合评估，发现RL训练显著减少了任务冲突，并导致合并后性能下降更少。

Insight: RL训练通过其策略内训练数据控制梯度更新幅度、其优化目标（“足够即好”）在模型收敛时减少冲突参数更新的幅度和数量，以及正负样本的联合优化将模型导向无偏的任务特定参数子空间，这三个关键因素共同使其更适合模型合并。

Abstract: Model merging plays a crucial role in consolidating multiple specialized models into a single, unified model, especially in the era of large language models (LLMs). Recent research has primarily focused on developing strategies to enhance merging performance with the trained models, while the impact of training paradigms, such as supervised fine-tuning (SFT) and reinforcement learning (RL), on the effectiveness of model merging remains underexplored. In this study, we systematically explore the merging behavior of RL-trained LLMs compared to those trained with traditional SFT. Through comprehensive evaluations across five representative tasks, we find that RL significantly reduces task conflicts and results in less performance degradation after merging, making RL-trained models particularly well-suited for this process. To unearth the reasons behind the superior suitability of RL for model merging, we conduct extensive empirical experiments and theoretical analyses. Our findings highlight three key factors: (1) On-policy training data in RL control the gradient updates in a smaller magnitude, reducing the risk of overwriting existing knowledge for other tasks in the model. (2) The RL optimization objective, which favors ``\textit{enough is as good as a feast}”, progressively reduces the magnitude and the number of conflict parameter updates as the model converges. (3) Joint optimization of positive and negative examples in RL steers the model towards an unbiased task-specific parameter subspace, ensuring robust performance while further preventing parameter conflicts.

[6] Scaling Native Multimodal Pre-Training From Scratch cs.CL | cs.CVPDF

Haoyuan Wu, Aoqi Wu, Hai Wang, Jiajia Wu, Jinxiang Ou

TL;DR: 本文系统研究了原生多模态预训练的扩展规律，即在固定计算预算下，如何最优分配模型规模和训练数据量（token数）。研究发现，语言和多模态目标遵循不同的扩展规律：语言学习的资源分配对数据组成不敏感，而多模态学习的资源分配高度依赖于数据中文本与图像的比例，文本密集型数据在更大模型规模下才计算高效。

Details

Motivation: 尽管大语言模型（LLM）展现出强大的推理能力，但其纯文本预训练限制了其对多模态物理世界的感知。原生多模态预训练通过从头开始在多模态输入上训练模型，可以实现深度的跨模态融合，但该范式的扩展特性尚未得到系统研究。

Result: 研究揭示了最小目标损失遵循可预测的计算定律，而计算最优的模型规模和token数量则按幂律扩展。下游评估表明，原生多模态预训练能引发积极的跨模态迁移，从而增强纯文本的空间推理能力，并实现鲁棒的多模态上下文学习。

Insight: 核心创新在于首次系统刻画了原生多模态预训练的扩展规律，并推导出由模型规模、token数量和数据混合比例共同定义的效率前沿。这为可预测地扩展多模态基础模型提供了关键的经验基础，特别是揭示了数据组成对资源分配策略的决定性影响。

Abstract: Although large language models (LLMs) exhibit remarkable reasoning capabilities, their reliance on text-only pre-training restricts the perception of the multimodal physical world. Native multimodal pre-training avoids this limitation by training models from scratch on multimodal inputs, thereby achieving deep cross-modal integration and mitigating optimization asymmetries inherent to traditional late-fusion architectures. Despite these advantages, the scaling properties of this paradigm remain systematically uncharacterized. To address this gap, we investigate the optimal model size and token count for training a transformer-based vision-language model under a fixed computational budget. We demonstrate that minimal objective loss adheres to a predictable compute law, whereas compute-optimal model sizes and token counts scale as power laws. Notably, language and multimodal objectives manifest distinct scaling behaviors. The language allocation law is largely invariant to the composition of the data, indicating stable language learning regardless of the multimodal data ratio. Conversely, the multimodal allocation law is highly sensitive to this composition. Specifically, text-heavy mixtures become compute-efficient only at larger model scales, shifting the optimal resource allocation toward greater model capacity. Additionally, by modeling the influence of data composition on compute laws and allocation exponents, we derive an efficiency frontier specifying precise configurations of model size, token count, and data mixture. Downstream evaluations further reveal that native multimodal pre-training induces positive cross-modal transfer, thereby enhancing pure-text spatial reasoning and enabling robust multimodal in-context learning. In summary, this empirical research establishes the essential groundwork for predictably scaling multimodal foundation models.

[7] Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination cs.CL | cs.AIPDF

Isak Hwang, Yoon Pyo Lee

TL;DR: 本研究评估了Gemma 4 31B-IT多模态大模型在美国核监管委员会（NRC）反应堆操作员执照考试上的表现，对比了监督微调（SFT）、检索增强生成（RAG）和检索增强微调（RAFT）等八种模型-检索配置。结果表明，结合固定大小分块RAG的SFT配置在14场考试中通过了8场，达到了接近人类通过标准（80%）的79.7%总准确率，优于其他配置。

Details

Motivation: 将大语言模型（LLMs）集成到核电行业需要其输出基于特定领域知识。本研究旨在评估一个开源多模态模型应用核知识的能力，通过其在专业执照考试上的表现，确定哪种微调与检索策略组合能达到操作员水平。

Result: 在NRC反应堆操作员基础考试（GFE）上，采用固定大小分块RAG的SFT配置达到了79.7%的总准确率（置信区间跨越80%阈值），在14场考试中通过了8场，超过了人类通过标准，且显著优于未微调的配置。在压水堆（PWR）题目上准确率达到了80.2%。

Insight: 主要创新点在于系统性地对比了SFT、RAG和RAFT在专业领域考试上的组合效果，发现微调是关键，且最佳分块策略（固定大小滑动窗口与结构感知分块）的选择取决于模型的训练状态。一个有趣的发现是，在匹配的搜索环境下，RAFT的表现反而逊于标准SFT。

Abstract: The integration of large language models (LLMs) into the nuclear power industry requires outputs grounded in domain-specific knowledge. This study evaluates a 31-billion-parameter open-weight multimodal model (Gemma 4 31B-IT) on its capacity to apply nuclear knowledge by benchmarking eight model-retrieval configurations against the U.S. Nuclear Regulatory Commission (NRC) Reactor Operator licensing examination. We evaluate 14 Generic Fundamentals Examinations (GFE) from the 2015-2021 March sittings (seven pressurized and seven boiling water reactor exams) using the standard 80% human passing criterion. The base model is compared against configurations utilizing supervised fine-tuning (SFT) on Gemini-distilled chain-of-thought (CoT) rationales, retrieval-augmented generation (RAG) with BM25 sparse retrieval over the U.S. Department of Energy Fundamentals Handbook, and retrieval-augmented fine-tuning (RAFT). Within the retrieval pipeline, we compare fixed-size sliding-window chunking against structure-aware chunking. The SFT configuration with fixed-size chunking RAG met the criterion on 8 of the 14 examinations, outperforming all alternatives, whereas no configuration without fine-tuning passed any. Aggregate accuracy reached 79.7%, with a confidence interval spanning the threshold, and 80.2% on PWR items specifically. Furthermore, two regularities emerged: the preferred chunking strategy reverses depending on the model’s training state, and RAFT underperforms compared to standard SFT in matching search environments. These results demonstrate which combination of fine-tuning and search approaches achieves operator-level capabilities.

[8] MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond cs.CL | cs.AI | eess.ASPDF

Lorenzo Concina, Seraphina Fong, Marco Matassoni, Alessio Brutti

TL;DR: MEUSLI是一个连接Whisper语音编码器与开源多语言大语言模型（LLM）的轻量级投影器家族，支持28种欧洲语言的端到端自动语音识别（ASR）。它通过持续学习技术可扩展至未见语言，并超越ASR，应用于多语言语音翻译和主题识别任务。

Details

Motivation: 现有连接语音编码器与LLM的投影器系统通常仅支持少数语言（尤其是英语），缺乏开源的多语言解决方案，限制了语音理解任务的包容性和可扩展性。

Result: MEUSLI在28种欧洲语言（包括高资源和低资源语言）的ASR任务上取得了强劲性能，并展示了在少量监督下即可用于多语言语音翻译和主题识别。

Insight: 创新点在于构建了首个开源的多语言投影器家族，将Whisper与多语言LLM结合，并通过持续学习实现语言扩展，为开源SpeechLLM提供了可扩展且包容的基础框架。

Abstract: Lightweight projectors are an established way to connect pre-trained speech encoders with large language models (LLMs), mapping acoustic features into token-level embeddings for tasks like ASR and spoken question answering. Existing systems, however, typically only support a few languages and are often limited to English. We introduce MEUSLI, the first open-science multilingual projector family that links a Whisper encoder with open-source multilingual LLMs, enabling fully open-source end-to-end ASR in 28 European languages. MEUSLI extends prior monolingual pipelines, delivering strong results across high- and low-resource languages. Using proper continual leaning techniques, MEUSLI can be easily extended to other languages not seen in training. We further demonstrate that the MEUSLI projector can be leveraged beyond ASR, enabling multilingual speech translation and topic identification with only a few hours of task specific supervision per language. Overall, MEUSLI provides a solid foundation for multilingual speech understanding tasks, supporting scalable and inclu- sive open-source SpeechLLM

[9] Dynamic Commonsense Coordination for Empathetic Response Generation cs.CLPDF

Zhengyu Qi

TL;DR: 本文提出了一个动态常识协调框架DCC，用于提升共情对话生成任务中模型对常识知识的动态协调能力。该框架包含三个互补模块：基于残差的常识交互、关联引导的常识过滤和迭代的常识感知解码，旨在更好地整合和利用常识知识来生成共情响应。

Details

Motivation: 现有共情响应生成方法通常在理解和生成阶段复用固定的常识表示，限制了在不同阶段协调常识知识的能力，因此需要一种动态协调机制来更有效地利用常识进行推理。

Result: 在Empathetic-Dialogues基准测试上，DCC相比CEM基线提升了情感分类准确率和响应多样性，同时保持了可比的困惑度；基于LLM的盲评进一步表明DCC生成的响应在相关性、连贯性和信息量方面更优。

Insight: 创新点在于提出了一个动态协调常识的框架，通过三个模块分别处理常识表示的整合、过滤和动态检索，实现了常识知识在对话生成过程中的灵活运用，而非静态复用。

Abstract: Empathetic Response Generation (ERG) requires models to recognize users’ emotions and generate empathetic responses. Commonsense knowledge has been shown to support such reasoning, yet existing approaches typically reuse fixed commonsense representations across understanding and generation, limiting their ability to coordinate such knowledge across different stages. We propose DCC, a Dynamic Commonsense Coordination Framework with three complementary modules: residual-based commonsense interaction (SCE-AttnRes) to integrate contextual and situational commonsense representations, Association-Guided Commonsense Filtering (AGCF) to down-weight low-relevance commonsense relations, and Iterative Commonsense-Aware Decoding (ICAD) to dynamically retrieve commonsense memories during generation. Experiments on the Empathetic-Dialogues benchmark show that DCC improves emotion classification accuracy and response diversity over the CEM baseline while maintaining comparable perplexity. An LLM-based blind evaluation further demonstrates that DCC generates responses with better relevance, coherence, and informativeness. The code and implementation details will be publicly available at https://github.com/Hanabi-Q/DCC-ERG.

[10] From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models cs.CL | cs.AIPDF

Shixin Fang, Jiachen Wo, Wenjuan Qin, Sihang Jiang, Yanghua Xiao

TL;DR: 本文提出一个用于评估大语言模型（LLM）能力的多层分类法，包含14个能力域和91个子技能，分为原始层、构建层和整合层。通过分析2013-2025年间31,505篇论文，发现研究集中在语言语义能力、推理、规划与决策、感知等少数领域，而多个领域研究不足。该分类法旨在从孤立任务转向结构化能力分析，以支持研究组织、覆盖度审计和评估解释。

Details

Motivation: 当前LLM评估围绕孤立任务而非底层能力组织，导致跨研究比较困难、能力与任务关系模糊、覆盖缺口难以识别。需要一种基于人类认知科学的结构化能力分类法来统一评估框架。

Result: 通过对ACL、AAAI、ICML、NeurIPS会议2013-2025年间的31,505篇论文进行筛选，映射出15,934篇LLM相关论文。研究发现：语言语义能力（22.3%）、推理（21.3%）、规划与决策（13.5%）和感知（12.3%）占据主导，而6个领域出现比例低于2%；多数领域内最频繁子技能的中位流行度达97.9%。

Insight: 创新点在于提出基于认知科学而非模型架构的多层能力分类法，将分析单元从任务转向结构化能力。客观来看，该分类法为系统性评估LLM能力分布、识别研究盲区提供了可操作的框架，特别是通过大规模文献计量揭示了领域间的不均衡关注度。

Abstract: Large language model (LLM) evaluation spans diverse tasks and benchmarks, yet evidence remains organized around tasks rather than the capabilities they probe. This fragmentation limits cross-study comparison, obscures capabilities tasks recruit, and makes coverage gaps difficult to identify. We introduce a multi-layer taxonomy of 14 capability domains and 91 subskills across Primitive, Constructed, and Integrative layers. Human cognitive science guides capability definition and organization, not LLM architecture. Layer assignments draw on developmental precedence and hypothesized functional support, while human-origin constructs are adapted to observable model behavior. To demonstrate operational utility, we screened 31,505 papers from ACL, AAAI, ICML, and NeurIPS between 2023 and 2025 and mapped 15,934 LLM-focused papers through multi-model annotation, consensus, and arbitration. Direct research attention concentrated on Language-Semantic Competence (3,551; 22.3%), Reasoning (3,388; 21.3%), Planning and Decision-Making (2,149; 13.5%), and Perception (1,954; 12.3%), whereas six domains appeared in fewer than 2% of papers. Within domains, the most frequent subskill had a median prevalence of 97.9% and appeared in at least 90% of papers in 10 of 14 domains. Language-Semantic Competence and Reasoning formed the highest-volume pair (n = 1,864; 11.7%; lift = 2.47), whereas Theory of Mind and Social Reasoning and Interaction showed the highest lift among pairs with at least 20 co-occurrences (n = 62; lift = 30.84). By shifting the unit of analysis from isolated tasks to structured capabilities, the taxonomy supports research organization, coverage audits, evaluation interpretation, and testable hypotheses for diagnosis, training, and transfer.

[11] Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills cs.CLPDF

Siyuan Huang, Pengyu Cheng, Haotian Liu, Tao Chen, Yihao Liu

TL;DR: 本文提出Skill Self-Play（Skill-SP）框架，通过技能协同进化解决LLM自我进化中任务多样性与验证可靠性之间的矛盾。该框架包含任务提议者、求解器和动态技能控制器，在强化学习循环中协同进化，生成基于技能的任务并收集执行反馈以扩展技能库。实验表明，Skill-SP能持续提升骨干模型的性能上限，并对初始未对齐模型产生显著改进。

Details

Motivation: 现有LLM自我进化方法面临任务多样性与验证可靠性的根本矛盾：环境约束方法反馈精确但学习领域狭窄，而开放式自我生成方法任务空间广泛但缺乏可靠验证，导致误导性奖励污染训练循环。

Result: 在工具使用和推理基准测试上的实证评估表明，Skill-SP作为一个稳健的进化引擎，能持续提升有竞争力骨干模型的性能上限，并催化初始未对齐模型的显著逆转。

Insight: 创新点在于将智能体技能作为调和上述矛盾的有力中间地带：每个技能确保在特定场景中的深度、可验证执行，而跨技能的动态路由保持开放式任务多样性。提出的Skill-SP框架通过提议者、求解器和技能控制器的协同进化，有效桥接了结构化验证与开放式探索之间的鸿沟。

Abstract: LLM training is shifting from manual design and annotation to interaction-driven self-evolution. However, existing self-evolutionary methods face a fundamental dilemma between task diversity and verification reliability: environment-bound methods obtain precise feedback but confine learning to narrow domains, while open-ended self-generation broadens the task space but lacks reliable verification, allowing misleading rewards to pollute the training loop. We identify agent skills as a powerful middle ground to reconcile this tension: each skill ensures deep, verifiable execution in a specific scenario, while dynamic routing across skills maintains open-ended task variety. Leveraging this insight, we introduce Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a dynamic skill controller. Orchestrated via a reinforcement learning loop, these components co-evolve in a continuous self-play loop: the proposer generates challenging tasks conditioned on dynamically sampled skills; the solver explores candidate solutions to push its capability boundaries; and the skill controller collects execution feedback to update and expand the skill library. This interactive co-evolution effectively bridges the gap between structured verification and open-ended exploration. Empirical evaluations on tool-use and reasoning benchmarks demonstrate that Skill-SP, serving as a robust evolution engine, consistently pushes the performance ceiling of competent backbones while catalyzing striking turnarounds for initially misaligned models. Our code is available at https://github.com/Qwen-Applications/skill-self-play.

cs.CV [Back]

[12] Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On cs.CVPDF

Yong Liu, Xiaolong Fu, Zihang Xu, Wen Xue, Xueheng Li

TL;DR: 本文提出了Oxygen-TryOn，一个专为时尚领域设计的统一基础模型，用于实现任意物品的虚拟试穿。该模型通过专门的数据引擎和训练流程，能够根据一个或多个参考物品（如产品图或穿着照片）和目标人物图像，生成人物穿着这些物品的逼真图像，支持多种时尚类别和复杂场景。

Details

Motivation: 现有虚拟试穿系统通常局限于单一服装类别或工作室环境，且多为以服装为中心；本文旨在构建一个时尚原生的基础模型，以支持多样化的物品、场景和多物品组合，并忠实保留人物身份和物品外观。

Result: 在公开基准测试和内部Oxygen-TryOn Bench上，该模型在单物品试穿上实现了状态最优（SOTA）的一致性和真实感，在多物品试穿上也处于领先地位，性能匹配或超越了领先的专有系统（如Nano Banana Pro）和开源模型（如FLUX.2）。

Insight: 创新点在于将试穿任务重新定义为多参考、理解驱动的生成任务，而非基于掩码的图像修复；并构建了一个大规模高质量数据引擎，以及结合持续预训练、监督微调和强化学习的三阶段训练方案，其中强化学习阶段使用了混合奖励机制来联合监督细粒度一致性和指令级质量。

Abstract: We present Oxygen-TryOn, a unified foundation model for any-item virtual try-on. Rather than repurposing a general-purpose image editor, Oxygen-TryOn is fashion-native, built for try-on through a dedicated data engine and try-on-specific training. Given one or more reference items (clean product shots or in-the-wild worn-on photos) and a single target subject image, it synthesizes a photorealistic image of the subject wearing the items across virtually any fashion category. Prior systems handle a single garment category in a studio setting, and recent multi-reference methods remain garment-centric; in contrast, Oxygen-TryOn supports diverse items and scenarios, including full- and half-body views, a variable number of references, and free multi-item composition, while faithfully preserving both subject identity and item appearance. Instead of mask-based inpainting, we reformulate try-on as a multi-reference, understanding-driven generation task. We build a data engine that collects, manufactures, annotates, and filters high-quality try-on data at scale, and design a three-stage recipe of continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL). The RL stage uses a hybrid reward combining an in-house try-on reward model with a proprietary, rubric-guided general-purpose model, jointly supervising fine-grained consistency and instruction-level quality. It also follows general editing instructions (e.g., pose changes) in the same pass. Across public benchmarks and our in-house Oxygen-TryOn Bench, it achieves state-of-the-art consistency and realism on single-item try-on and leads on multi-item try-on, matching or surpassing both leading proprietary systems (Nano Banana Pro, GPT-Image-2, Seedream5 Lite) and open-source models (FLUX.2).

[13] Be Consistent! Enhancing Robust Visual Reasoning in LVLMs with Consistency Constraints cs.CVPDF

Liqiang Jing, Xiong Zhou, Siddharth Varia, Neha Anna John, Xinya Du

TL;DR: 该论文针对大型视觉语言模型在复杂视觉推理任务中的逻辑一致性问题，提出了ConVBench基准测试和ConVLM模型。ConVBench是一个包含六类复杂视觉推理任务的基准，每个图像对应两个逻辑等价的问题，用于评估模型的逻辑一致性和鲁棒准确性。ConVLM模型则通过基于组相对策略优化的强化学习框架，结合新颖的一致性奖励机制，利用自动生成的逻辑等价问答对来提升模型的推理一致性和准确性。

Details

Motivation: 现有基准主要关注符号数学或简单视觉任务，对复杂视觉推理和逻辑一致性的评估有限，而逻辑一致性是可靠推理系统的关键要求，因此需要新的基准和方法来增强LVLMs在视觉推理中的鲁棒性。

Result: 论文在提出的ConVBench基准上评估模型，定义了逻辑一致性和鲁棒准确性两个联合评估指标。ConVLM模型通过结合准确性和一致性奖励的强化学习，有效提升了推理性能，该框架在有或没有严格答案监督的情况下都能有效工作。

Insight: 创新点在于构建了专注于逻辑一致性的复杂视觉推理基准ConVBench及其评估指标，并提出了基于GRPO强化学习和双奖励设计（准确性+一致性）的ConVLM训练框架，利用自动生成的逻辑等价问答对来强制模型输出的一致性，这为提升LVLMs的可靠推理提供了新思路。

Abstract: While Large Vision-Language Models (LVLMs) exhibit strong perceptual capabilities, they remain vulnerable in visual reasoning tasks. Existing benchmarks largely focus on symbolic mathematical or scientific problems and simple vision-centric tasks, offering limited assessment of complex visual reasoning and logical consistency, a critical requirement for reliable reasoning systems. We introduce ConVBench, a complex vision-centric reasoning benchmark in which each image is paired with two logically equivalent questions across six categories: action and state, complex counting, spatial reasoning, causal and intent understanding, commonsense reasoning, and temporal perception. To complement this benchmark, we define two evaluation metrics, logical consistency and robust accuracy, that jointly assess both the correctness and consistency of model responses. We further present ConVLM, which improves LVLM reasoning through Group Relative Policy Optimization (GRPO)-based reinforcement learning with a novel consistency reward. This method leverages automatically generated logically equivalent question-answer pairs and a dual-reward design combining accuracy- and consistency-based signals, encouraging agreement between paired responses. The framework functions effectively with or without strict answer supervision.

[14] Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Rendering cs.CVPDF

Wenchao Ma, Changran Liu, Sharon X. Huang, Haomiao Jiang

TL;DR: 本文提出了一种无需额外训练的方法来解决自回归生成渲染中的重访不一致问题。该方法利用3D引擎提供的时间和空间对应关系，通过时间对应将历史潜在块检索到KV缓存作为闭环记忆，并通过空间对应引导注意力机制，从而在保持视频整体质量的同时显著提升重访一致性。

Details

Motivation: 自回归视频生成模型在长序列生成中，当摄像机重访先前位置时，由于KV缓存中相关上下文已被逐出，模型会生成外观不一致的帧，即使条件渲染（如深度图）与底层几何完全对齐。本文旨在解决这一重访不一致问题，而无需进行额外的模型训练。

Result: 在从TartanAir和TartanGround数据集中挖掘的闭环轨迹上进行评估，该方法在重访一致性方面优于现有的无需训练基线，同时不损失整体视频质量。

Insight: 核心创新在于利用3D引擎固有的对应关系（时间与空间）来增强自回归生成模型的记忆与注意力机制，实现了一种轻量级的闭环一致性增强策略。这为长序列生成中的状态持久性问题提供了一种新颖的、无需重新训练的解决方案。

Abstract: Recent conditional video generation models have shown promising potentials to transform 3D engine renderings, such as depth maps and untextured geometry, into photorealistic videos for gaming and immersive content creation. These applications require long-horizon auto-regressive generation that continuously synthesizes new frames while preserving a persistent 3D world. Auto-regressive generators synthesize video chunk by chunk with a bounded KV cache, so when the camera revisits a location after its context has been evicted, the model often regenerates inconsistent appearance, even though the conditioning renderings (e.g., depth) remain perfectly aligned with the underlying geometry.We address this revisit inconsistency without any post-training by exploiting correspondences the 3D engine already provides: temporal correspondence retrieves pose-matched historical latent chunks into the KV cache as loop-closure memory, while spatial correspondence from camera pose and depth reprojection biases token-level attention toward geometrically corresponding regions of the retrieved chunks. We demonstrate our method on loop-closure trajectories mined from TartanAir and TartanGround dataset to mirror complicate real-world application scenarios, where it outperforms existing training-free baselines on revisit consistency without losing overall video quality. Project Page: https://wenchao-m.github.io/ClosetheLoop.github.io/

[15] What Happens to Accuracy When Photo Lineups Contain Non-Mated Rank-One Images From Large Galleries? cs.CVPDF

Genesis Argueta, Kevin W. Bowyer, Michael King, Jayeeta Dhar

TL;DR: 本文研究了一对多人脸识别过程中，当算法从大型图库中检索出非匹配的排名第一图像并用于照片队列时，对目击者识别准确性的影响。实验发现，随着图库规模增大，目击者错误识别的概率及其对错误识别的信心均会上升，这引发了关于此类人脸识别流程在司法程序中使用的合理性问题。

Details

Motivation: 针对人脸识别算法在监控视频与证件照图库匹配后，将排名第一的图像用于照片队列可能导致错误逮捕的问题，研究旨在探究图库规模是否会影响目击者识别的准确性。

Result: 在500、5,000和24,000张图像的图库规模下进行实验，结果显示更大的图库会显著增加目击者错误识别的可能性，并提升他们对错误识别的信心。

Insight: 论文揭示了人脸识别技术在实际司法应用中的潜在风险：算法检索的“最佳匹配”图像可能因图库规模扩大而引入更多错误，这挑战了仅凭照片队列结果作为逮捕依据的可靠性，强调了需要更严谨的验证流程。

Abstract: One-to-many facial identification is commonly used to match a probe image from surveillance video against a gallery of driver’s licenses and/or booking photos. The algorithm’s rank-one image from the gallery, or a human examiner’s selection from the algorithm’s top-ranked images, may then be placed in a photo lineup shown to a witness. Witness selection of the gallery image in the photo lineup may then lead directly to the person in the gallery image being arrested. This facial identification process is involved in at least 9 wrongful arrests. This work specifically examines whether the probability of a witness making an incorrect identification increases with the size of the gallery searched. We compare photo lineup accuracy when the “suspect” image is drawn from galleries of 500, 5,000, and 24,000 images. We find that larger galleries increase both the likelihood of a witness making an incorrect identification and their confidence in that (incorrect) identification. These results raise questions of whether an image resulting from such a facial identification process should be used in photo lineups and of whether results of a photo lineup alone should constitute probable cause for arrest.

[16] SCALE: Self-Supervised Constraint-Aware Layout GEneration for Local P&R DRV Fixing at Advanced Nodes cs.CV | cs.AIPDF

Chia-Tung Ho, Haoyu Yang, Guanglei Zhou, Yoshi Nishi, Yaguang Li

TL;DR: 本文提出SCALE框架，用于先进工艺节点下的局部布局布线设计规则违规修复。该框架包含一个自监督布局生成阶段，通过序列化多层布局几何结构为文本，并微调语言模型从上下文重建掩码多边形，以生成多样化的违规倾向布局变体。这些变体经DRC检查器验证后，用于微调一个领域适应的DRC视觉语言模型，为局部DRV修复提供规则感知的几何指导。

Details

Motivation: 随着半导体制造进入2纳米以下节点，局部布局布线设计规则违规修复受到复杂规则交互、密集多层布线几何和代工厂特定约束的限制。尽管大语言模型在EDA脚本和文档方面表现出色，但在视觉布局理解方面的应用仍待探索，因为从布局图像诊断DRC违规需要精确的几何推理和代工厂特定规则知识。

Result: 在100个真实的2纳米以下案例（涵盖包围、间距、宽度和颜色间距违规）上，该方法将最先进代理的解决率提升了12-25%（最高达97%）。

Insight: 创新点在于将自监督学习应用于布局生成，通过序列化几何结构和语言模型重建来学习布局表示，无需违规标签。同时，利用自然语言规则约束和高温采样生成多样化布局变体，并结合领域适应的视觉语言模型提供规则感知的修复指导，有效提升了DRV修复的自动化水平。

Abstract: As semiconductor manufacturing advances toward sub-2nm nodes, local place-and-route (P&R) design-rule violation (DRV) fixing is increasingly limited by complex rule interactions, dense multi-layer routing geometries, and foundry-specific constraints. While Large Language Models (LLMs) have recently demonstrated strong capabilities in EDA scripting and documentation, their application to visual layout understanding remains largely unexplored: diagnosing DRC violations from layout imagery demands precise geometric reasoning and foundry-specific rule knowledge absent from general-purpose VLM training. We propose SCALE, a framework with a self-supervised layout-generation stage for local DRV fixing at advanced nodes. Multi-layer layout geometry is serialized into structured text, and a fine-tuned language model learns to reconstruct randomly masked polygons from surrounding BEOL context alone without violation labels. At inference, natural-language rule constraints and high-temperature sampling steer generation toward diverse, violation-prone layout variants validated by an industrial signoff DRC checker, producing DRC-annotated layout–violation pairs used to fine-tune a domain-adapted DRC-VLM. This VLM provides rule-aware geometric guidance for local DRV repair, boosting state-of-the-art agents’ solve rates by +12–25% (up to 97%) on 100 real sub-2nm cases spanning enclosure, spacing, width, and color-spacing violations.

[17] Learning Adaptive Semantic Gaussian Allocation for 3D Occupancy cs.CVPDF

Kanglin Ning, Yiran Zhao, Wenrui Li, Houde Quan, Qifan Li

TL;DR: 本文提出了一种名为SAGFormer的方法，用于解决3D语义占用预测中语义高斯分配不平衡的问题。该方法通过评分和选择固定数量的高斯基元，优化了内存和计算效率，并在nuScenes-SurroundOcc和SSCBench-KITTI-360数据集上验证了其有效性。

Details

Motivation: 现有方法在3D语义高斯表示中主要关注基元的表示、初始化或添加，但未明确解决在有限数量下如何选择最有用的高斯基元，导致简单区域冗余而困难区域语义支持不足的分配瓶颈。

Result: 在nuScenes-SurroundOcc和SSCBench-KITTI-360基准测试中，SAGFormer在评估协议下提高了占用预测性能，减少了语义混合，增强了类别一致的体素支持，并产生了更少未使用的高斯基元，表明其优于现有方法。

Insight: 创新点在于引入显式容量分配机制，通过高斯属性和局部几何-语义特征评分选择固定高斯集，这补充了高斯细化过程，提升了语义一致性和资源利用率，为3D语义占用预测提供了新思路。

Abstract: Semantic 3D Gaussians provide a compact representation for 3D semantic occupancy prediction by rendering semantic primitives into a voxel volume under voxel-wise supervision. Recent methods have improved the modeling ability and efficiency of this representation through more flexible primitive shapes, geometry-guided initialization, and progressive densification. However, these advances mainly determine how primitives are represented, initialized, or added, and do not explicitly address how to select the most useful Gaussians when their total number must be limited to control memory and computation. This imbalance creates an allocation bottleneck: redundant Gaussians remain in simple regions, while difficult regions receive insufficient semantic support. We propose the Semantic Gaussian Allocation Transformer (SAGFormer), which uses Gaussian attributes and local geometric-semantic features to score candidates and select a fixed final Gaussian set. Experiments on nuScenes-SurroundOcc and SSCBench-KITTI-360 show that SAGFormer improves occupancy prediction under the evaluated protocols and yields more semantically consistent and better-utilized Gaussian representations. Under similar final counts and raw coverage, it reduces semantic mixing, strengthens class-consistent voxel support, and produces fewer unused Gaussians. The results indicate that explicit capacity allocation is a useful complement to Gaussian refinement for semantic occupancy prediction.

[18] Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model cs.CV | eess.SPPDF

Zihang Zeng, Shu Sun, Meixia Tao, Zhiyong Chen, Jianhua Mo

TL;DR: 本文提出PanoLAMP框架，利用全景RGB-D观测和预训练视觉语言模型，预测低空无人机通信中的多径信道参数（时延、功率、方位角和天顶角偏移）。该方法旨在解决传统统计模型精度不足和确定性方法计算复杂的问题，并在合成数据集上验证了其优于基线模型的性能。

Details

Motivation: 传统统计信道模型在特定环境下精度有限，而射线追踪等确定性方法依赖精确三维环境模型且计算复杂。现有多模态信道预测方法主要关注大尺度参数（如路径损耗），对小尺度参数建模不足。

Result: 在包含18,949条无人机-车辆链路的合成数据集上，所提方法在多种无人机高度下，在多径参数和统计指标上均持续优于代表性基线，并展现出更强的跨飞行高度泛化能力。

Insight: 创新点在于将预训练视觉语言模型作为主干，结合收发两端的全景RGB-D观测来提取传播环境特征，实现了对小尺度多径参数的高效预测，避免了复杂三维建模。

Abstract: Unmanned aerial vehicle (UAV) communication is expected to support a wide range of low-altitude applications in 6G mobile networks. However, traditional statistical channel models provide limited accuracy in specific environments, while deterministic methods such as ray tracing usually rely on accurate three-dimensional environment models and involve high computational complexity. Existing multimodal channel prediction approaches mainly focus on large-scale metrics such as path loss, and remain insufficient for modeling small-scale parameters. To address these limitations, this paper proposes PanoLAMP, a Panoramic perception and vision-language model-based Low-Altitude Multipath Prediction framework. It adopts a pretrained vision-language model as the backbone and captures the propagation environment features through panoramic RGB-D observations collected at both the transmitter and receiver to predict the delay, power, azimuth angle, and zenith angle offset relative to the line-of-sight path. Experiments are conducted on a synthetic dataset containing 18,949 UAV-vehicle links across seven UAV altitudes. Experimental results show that the proposed method consistently outperforms representative baselines in both multipath parameters and statistical metrics, and demonstrates stronger generalization across different flight heights.

[19] TextSLIP: Text Self-Supervised CLIP for Medical Report Generation cs.CV | cs.AIPDF

Haoyu Jiang, Ziping Cong

TL;DR: 本文提出了TextSLIP，一种用于医学报告生成的通用视觉语言预训练框架。它通过引入模态内文本对比学习来增强标准CLIP，旨在为视觉编码器提供更细粒度的语义监督。在700万脑部MRI图像-文本对数据集上进行预训练后，其在报告生成任务上相比CLIP基线模型取得了稳定的性能提升。

Details

Motivation: 现有CLIP风格的医学视觉语言建模方法主要优化跨模态对齐，但未能显式地结构化文本嵌入空间，这可能导致对复杂报告生成的语义监督不足。

Result: 在700万脑部MRI图像-文本对数据集上预训练后，将视觉编码器微调用于报告生成任务。与CLIP风格基线相比，TextSLIP在报告生成指标上显示出持续改进。消融研究表明文本侧的自监督对性能增益有贡献。

Insight: 核心创新点在于通过自监督增强的文本对进行模态内文本对比学习，以提升文本嵌入的区分性，从而为视觉表示学习提供更细粒度的语言监督。这为改进医学视觉-文本对齐提供了一个有前景的方向。

Abstract: Automating radiology report generation is important for improving reporting consistency and clinical workflows . While Contrastive Language–Image Pretraining (CLIP) has advanced medical vision language modeling, existing CLIP-style approaches may still provide insufficient fine-grained semantic supervision for complex report generation. Standard CLIP primarily optimizes cross-modal alignment, without explicitly structuring the textual embedding space that guides visual representation learning. To address this limitation, we propose TextSLIP, a general medical vision-language pretraining framework that augments CLIP with intra-modal text contrastive learning. By improving textual embedding discriminability through self-supervised augmented text pairs, TextSLIP is designed to provide finer-grained linguistic supervision to the visual encoder. As an initial validation, we pretrain TextSLIP on a curated dataset of 7 million brain MRI image-text pairs and fine-tune the pretrained visual encoder within a report generation architecture. In controlled comparisons with CLIP-style baselines, TextSLIP shows consistent improvements on report generation metrics. Ablation studies further suggest that text-side self-supervision contributes to the observed gains. These results indicate that text-level contrastive learning is a promising direction for improving medical visual-textual alignment, while broader validation across additional medical domains remains an important next step.

[20] Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models cs.CVPDF

Bannapol Limanond, Masanori Suganuma, Takayuki Okatani

TL;DR: 本文提出了一个名为Medical-Checklist的新基准测试，用于评估医学多模态模型。该测试通过让模型在给定医学图像和两个描述（一个正确、一个错误）中选择正确描述，来检验模型是否准确理解图像并关联相关文本。评估发现，尽管现有先进模型在特定任务（如Med-VQA）上表现优异，但在这种基础理解测试中仍存在不足，揭示了其在临床应用上的局限性。

Details

Motivation: 当前多模态模型在医学视觉-语言任务中展现出潜力，但评估其是否真正准确理解图像并关联文本具有挑战性。现有评估方法难以统一衡量不同设计原则的模型，且存在数据偏差和分布外处理能力评估的困难。

Result: 在Medical-Checklist基准上评估了四种先进的医学多模态模型，结果显示它们在特定任务（如Med-VQA）中表现优秀，但在这种基础理解测试中未能正确理解图像，表明距离临床应用仍有差距。

Insight: 创新点在于设计了一个简单但统一的二选一测试基准，专注于单个医学概念的准确性替换，能减少数据偏差并评估分布外处理能力。客观来看，这种基准提供了一种标准化方法来揭示模型在医学概念理解上的根本缺陷，有助于推动更可靠的医学AI发展。

Abstract: This paper introduces a new benchmark test, Medical-Checklist, for assessing medical multimodal models. The recent advancements in multimodal models have demonstrated significant potential in the field of medical vision-language tasks. However, it is becoming increasingly clear that evaluating these models’ performance, whether they are applied to natural or medical images, is challenging. The critical question is whether the models can accurately understand an input image while associating it with relevant input text. To address this, Medical-Checklist imposes a binary test on the models: they are given an image and two captions, where one is correct and the other incorrect, and the model must select the correct one. The incorrect caption contains a single medical concept (word or phrase) that is inaccurately substituted from the correct caption. Although the task is simple, this simplicity enables the unified assessment of diverse multimodal models designed and learned on different principles. It also enables us to verify whether models correctly understand a wide range of medical concepts across various medical sub-domains. Medical-Checklist is designed to reduce potential biases in data and to enable evaluation of the models’ ability to handle out-of-distribution inputs, which were difficult in existing datasets. When evaluating four state-of-the-art medical multimodal models with Medical-Checklist, it was revealed that despite their excellent performance in specific tasks such as Med-VQA, they may not correctly understand images, suggesting a long journey ahead for clinical application. The dataset and code will be made public upon acceptance.

[21] Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation cs.CVPDF

Yuqi Li, Xi Xiao, Yunbei Zhang, Lin Zhao, Yu Li

TL;DR: 本文提出了一种名为Prompted Information Bottlenecks (PIB)的新框架，用于高效适应冻结的视觉基础模型。该框架受信息瓶颈原理启发，通过正则化层间压缩与充分性的权衡，来重新思考并控制提示条件下表征在深度网络中的信息分配，旨在保留任务相关证据并逐步丢弃冗余细节。

Details

Motivation: 现有基于提示的适应方法（如VPT）性能对提示深度、放置位置和任务分布敏感，且标准域内基准测试的增益不能保证鲁棒的泛化能力。作者认为这不仅是优化问题，更是一个层间信息分配问题，即缺乏对提示条件表征在深度网络中应保留、抑制和传播何种信息的原理性控制。

Result: 在34个数据集上的广泛实验表明，PIB实现了强劲性能，在FGVC上达到92.1%，在HTA上达到93.01%，在VTAB-1k上达到77.33%，同时在主要设置中平均仅调整0.35%的参数。

Insight: 论文的核心创新点是将信息瓶颈原理引入提示调优，为适应冻结视觉基础模型提供了一个兼具实用性和解释性的信息分配视角。PIB框架不仅提升了基准准确率，还帮助解释了提示容量缩放的非单调行为，减少了对捷径特征的依赖，并改善了分布偏移和细粒度识别设置下的鲁棒性。

Abstract: Vision foundation models are increasingly reused as frozen backbones for downstream visual recognition, making parameter-efficient adaptation a central problem. Prompt-based adaptation, including Visual Prompt Tuning (VPT), provides a lightweight way to specialize these models, but its layer-wise behavior remains poorly understood: performance is sensitive to prompt depth, placement, and task distribution, and gains on standard in-domain benchmarks do not always translate into robust generalization. We argue that this limitation is not solely an optimization issue, but a layer-wise information allocation issue: existing prompt-based methods lack principled control over what prompt-conditioned representations should preserve, suppress, and propagate across depth. Inspired by the Information Bottleneck principle, we introduce Prompted Information Bottlenecks (PIB), a framework that regularizes layer-wise compression-sufficiency trade-offs and promotes a more coherent cross-layer information path. The key idea is that effective adaptation should be minimal yet sufficient, retaining task-relevant local evidence in earlier layers while progressively discarding nuisance factors and redundant details in deeper layers. Extensive experiments show that PIB achieves strong performance across 34 datasets, reaching 92.1% on FGVC, 93.01% on HTA, and 77.33% on VTAB-1k, while tuning only 0.35% parameters on average across the main settings. Beyond benchmark accuracy, PIB helps explain the non-monotonic behavior of prompt capacity scaling, reduces shortcut reliance, and improves robustness under distribution shift and fine-grained recognition settings. These results position PIB as both a practical method and an information-allocation perspective for adapting frozen vision foundation models. Our code is available at https://github.com/itsnotacie/MM-26-PIB

[22] Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning cs.CV | cs.AIPDF

Hao Yang, Jin Wang, Xuejie Zhang

TL;DR: 该论文提出了一种名为视觉显著性引导蒸馏（VSSD）的方法，旨在解决多模态思维链推理中，当不同图像与相同文本配对（或反之）时，融合过程难以区分细微跨模态差异的问题。VSSD利用多模态大语言模型的注意力图生成扰动图像以捕捉任务敏感特征方向，并通过奇异值分解提取主导引导向量来指导层间知识蒸馏，从而提升推理性能。

Details

Motivation: 动机在于解决小模型在有限token预算下进行多模态思维链推理时，模态交互融合过程容易抑制微小跨模态差异的挑战，尤其是在不同图像与相同文本（或不同文本与相同图像）配对时，融合后的输入难以区分，导致推理困难。

Result: 在ScienceQA和M^3CoT基准测试上的实验表明，VSSD方法改善了理由生成和答案推理的性能。

Insight: 创新点在于利用大模型的注意力图生成扰动图像来显式捕捉任务敏感特征方向，并通过奇异值分解提取引导向量进行层间蒸馏，这是一种新颖的、针对多模态细微差异的蒸馏策略，可借鉴于提升小模型在多模态任务中的区分和推理能力。

Abstract: Multimodal chain-of-thought (CoT) reasoning integrates visual and textual cues through step-by-step inference. In small models with limited token budgets, modality-interaction fusion often suppresses tiny cross-modal differences. In particular, multimodal CoT often struggles when different images pair with identical text or different texts pair with an identical image, making such inputs nearly indistinguishable after fusion. This study proposes Visual Saliency Steering Distillation (VSSD). VSSD leverages the attention maps of multimodal large language models to generate perturbed images that capture task-sensitive feature directions, and then applies singular value decomposition to extract dominant steering vectors to guide inter-layer distillation. Experiments on ScienceQA and M$^3$CoT demonstrate that VSSD improves rationale generation and answer inference. The code is available at https://github.com/BGWH123/VSSD.

[23] EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection cs.CV | cs.AIPDF

Hao Yang, Jin Wang, Xuejie Zhang

TL;DR: 本文提出了一种增强型视觉语言多链式思维（EVL-MCoT）方法，用于有害MEME检测。该方法通过多链式思维增强决策一致性并减少偏见，并设计了原型引导和上下文引导的解码框架，以更精确地对齐文本和视觉信息。在HatefulMemes和MultiOff数据集上取得了有希望的结果。

Details

Motivation: 现有方法通常采用双流视觉语言模型同时提取视觉和文本特征，但缺乏背景信息和先验知识，且简单的链式思维（CoT）方法缺乏多视角思考，依赖浅层特征融合，无法深入理解视觉与文本间的复杂联系。

Result: 在HatefulMemes和MultiOff数据集上取得了有希望的结果，但摘要中未明确提及是否达到SOTA水平或与特定模型相当的具体定量指标。

Insight: 创新点在于提出了多链式思维（Multi-CoT）以增强决策一致性，并设计了原型引导和上下文引导的解码框架，通过视觉原型引导融合过程，实现更精细的文本-视觉信息对齐，这有助于更深入地理解MEME的隐含含义。

Abstract: MEMEs are widely used on the internet and often carry strong elements of sarcasm or irony. Understanding their hidden meanings typically requires a joint interpretation of text and vision. Existing methods focus on the dual-stream vision-language model to extract the visual and text simultaneously, which lacks background information and prior knowledge about the comprehensive explanation of MEME. One feasible option is to adopt chain-of-thought (CoT). However, the simple CoT approach lacks multi-perspective thinking, which may compromise the reliability of the resulting answers. Moreover, it often relies on shallow feature fusion, lacking the fusion of local details and fine-grained visual-prompt text alignment. This limitation prevents a deeper understanding of the intricate connections between the visual and the text. Herein, an enhanced vision-language multi-CoT (EVL-MCoT) approach is proposed to address these limitations. By promoting multi-CoT, EVL-MCoT enhances consistency and reduces bias in the decision-making process. Additionally, we design a prototype-guided and context-guided decoding framework, which incorporates visual prototypes to guide the fusion process and enables the model to align textual and visual information more precisely. We achieve promising results on the HatefulMemes and MultiOff datasets. The source code has been publicly released and is available at https://github.com/BGWH123/EVL-MCoT.

[24] ReCowGnition: A Realistic Biometric Benchmark for Cow Face Recognition cs.CVPDF

Marco Huber, Marco Kiesewalter, Judith Louise Pieper, Bastian Kubsch, Naser Damer

TL;DR: 本文提出了一个名为ReCowGnition的公开奶牛面部识别基准数据集，包含6,838张图像，涵盖161头奶牛，采集于真实的自动化农场场景。作者定义了两种验证和四种识别评估协议，并评估了六种基准模型（包括小数据训练、跨物种微调和零样本基础模型方法）在该数据集上的性能。

Details

Motivation: 随着精准畜牧业和计算机视觉的发展，视觉动物生物识别技术受到关注，但现有研究面临复杂场景、外观相似、遮挡、非合作行为以及公开标注数据集有限等挑战。

Result: 在提出的ReCowGnition数据集上，评估了六种基准模型，包括小数据训练、跨物种微调和零样本基础模型方法，为后续研究提供了性能基准。

Insight: 创新点在于提供了一个真实场景下采集的公开奶牛面部识别数据集和标准化评估协议，促进了该领域可比较的研究；客观分析，该工作通过引入跨物种微调和零样本基础模型评估，探索了迁移学习和通用模型在动物识别中的潜力。

Abstract: With the development of precision livestock farming and the advances in computer vision, visual animal biometrics has gained attention. Using biometric technologies that have been proven effective for humans to identify livestock can increase animal welfare as well as production efficiency. However, challenges such as complex scenarios, similar appearances, occlusions, and non-cooperative behavior, as well as the limited amount of publicly available labeled datasets, remain. In this work, we contribute a novel, publicly available cow face benchmark dataset that has been collected in a realistic automatic scenario with 6,838 images of 161 different cows at a dairy farm. In addition to the public dataset, we define two verification and four identification evaluation protocols to foster comparable research in the cow recognition research field. Further, we provide evaluation results on our dataset of six benchmark models, which include models trained on limited data, cross-species fine-tuned models, and zero-shot foundation model approaches.

[25] Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era cs.CV | cs.LGPDF

Yu Wang, Hongyu Yang

TL;DR: 本文在基础模型时代重新审视了车辆重识别中多分支架构和CNN-Transformer融合的有效性。研究发现，单个经过DINOv3预训练的ConvNeXt模型，配合调优的训练方案，在仅使用视觉线索的情况下，在VeRi-Wild数据集上达到了与最强依赖元数据的多分支基线相当的性能。通过无训练重排序可进一步提升性能。研究进一步表明，增加表示多样性（如多分支拼接或跨主干网络融合）带来的增益微乎其微，提升单个强基础模型主干网络并配合检索阶段重排序是更有效的策略。

Details

Motivation: 动机是重新评估在基础模型时代，多分支架构和CNN-Transformer融合是否仍是提升车辆重识别性能的有效方法，挑战了长期以来认为结合互补表示有效的假设。

Result: 在VeRi-Wild Small和Large数据集上，单个ConvNeXt模型分别达到88.19和77.47 mAP，匹配最强多分支基线。应用无训练重排序后，性能分别提升至92.38和83.68 mAP。多分支拼接带来的增益小于1个mAP点，而跨主干网络融合的最大增益估计仅为+0.11 mAP。

Insight: 核心创新点在于通过严谨的实证研究，揭示了在强大的基础模型（如DINOv3预训练模型）和调优训练方案下，模型架构的复杂性（多分支、异构主干融合）带来的边际收益非常有限。可借鉴的洞察是：在类似场景下，应优先投资于优化单个强主干模型和检索后处理（如重排序），而非盲目增加模型复杂度和参数量。

Abstract: Multi-branch architectures and CNN-Transformer fusion have long been regarded as effective ways to improve vehicle re-identification (Re-ID) by combining complementary representations. In this work, we revisit this assumption in the foundation-model era through a comprehensive empirical study. A single DINOv3-pretrained ConvNeXt trained with a tuned recipe achieves 88.19 mAP on VeRi-Wild Small and 77.47 mAP on VeRi-Wild Large using visual cues alone, matching the strongest protocol-verified metadata-dependent multi-branch baseline. Applying training-free re-ranking further improves performance to 92.38 and 83.68 mAP, respectively. Using this strong baseline together with retrieval-level branch diagnostics, we evaluate whether increasing representational diversity still provides measurable gains. Across both benchmarks, concatenating multiple branches built on a shared backbone changes the best single-branch performance by less than one mAP point while increasing the embedding dimension by 4x, and the resulting representation has an effective rank close to the original feature dimension. We further study cross-backbone fusion using an asymmetric frozen-anchor strategy to combine ConvNeXt and Vision Transformer representations. Despite these favorable conditions, Transformer branches consistently remain 13-15 mAP below the ConvNeXt backbone, and paired per-query bootstrap analysis estimates the largest observed fusion gain to be only +0.11 mAP (95% confidence interval). Our results suggest that, under the evaluated setting, improving a single strong foundation-model backbone together with retrieval-stage re-ranking is more effective than increasing architectural complexity through additional branches or heterogeneous backbones. We restrict our conclusions to single-seed training and one family of foundation models and discuss conditions under which these observations may not hold.

[26] CommandLM: Data driven behavior level descriptor for ego vehicles cs.CVPDF

Boris Tokic, Constantin Selzer, Fabian B. Flohr

TL;DR: 本文提出了CommandLM，一种多模态大语言模型，用于从融合的多传感器数据中生成自动驾驶车辆简洁、可读的行为描述。模型通过Q-Former适配器处理LiDAR和多摄像头输入的时间融合鸟瞰图表示，并连接到量化、LoRA微调的大语言模型。在CommandLM-nuScenes数据集上训练，模型生成意图感知、可解释的描述，适用于规划器监督和安全审计。实验表明模型在语言和行为对齐方面表现强劲，显著优于BLIP-2基线，人类评估确认了其现实世界可行性。

Details

Motivation: 随着自动驾驶系统向现实世界部署，可解释的行为级决策对于安全、信任和监管至关重要。本文旨在解决生成可解释行为描述的问题，以增强自动驾驶的透明度和可靠性。

Result: 在nuScenes数据集上的实验显示，CommandLM在CIDEr指标上达到0.67，BERT-F1达到0.88，显著优于BLIP-2基线（CIDEr 0.52，BERT-F1 0.86）。人类评估中，58%的生成描述被评为准确、高效且符合规则，确认了其实用性。

Insight: 创新点包括结合多模态融合与语言推理来实现高效透明的行为级理解，以及使用Q-Former适配器和量化LoRA微调的大语言模型处理时间融合的传感器数据。这为自动驾驶的可解释决策提供了新工具，有助于下游验证系统识别和纠正行为偏差。

Abstract: As autonomous driving systems move toward real-world deployment, interpretable, behavior-level decision-making is essential for safety, trust, and regulation. We introduce CommandLM, a multimodal large language model that generates concise, human-readable behavior descriptions for ego vehicles from fused multi-sensor data. Our model processes temporally fused bird’s-eye view representations from LiDAR and multi-camera inputs via a Q-Former adapter connected to a quantized, LoRA-fine-tuned large language model. Trained on our CommandLM-nuScenes dataset, CommandLM produces intent-aware, interpretable captions suitable for planner supervision and safety auditing. Experiments demonstrate strong linguistic and behavioral alignment, achieving CIDEr 0.67, and BERT-F1 0.88, substantially outperforming the BLIP-2 baseline (CIDEr 0.52, BERT-F1 0.86). In human evaluation, 58% of the generated descriptions were rated accurate, efficient and rule-compliant, confirming their real-world plausibility. While the remaining descriptions may not always select the most efficient, goal-oriented behavior, CommandLM’s interpretable outputs enable downstream validation systems to identify and correct such cases, making it an effective tool for transparent behavior auditing. These results show that integrating multimodal fusion with language reasoning yields efficient and transparent behavior-level understanding for autonomous driving. We release our code and dataset at: https://github.com/b-tok/CommandLM

Xingyu Xiang, Shuang Hao, Fan Wang, Jianhua Ma, Chunfeng Lian

TL;DR: 本文介绍了BraTS-GLI Anatomy-Lesion（GLI-AL），一个基于BraTS 2023-GLI训练队列构建的多模态胶质瘤MRI标签资源，提供统一的八类解剖-病变标签集，旨在解决现有数据集未系统标注共存白质高信号（WMH）的问题，从而减少联合分割任务中的标签噪声。

Details

Motivation: 现有BraTS-GLI数据集专注于肿瘤亚区分割，但未系统标注共存的WMH，导致在联合分割中将病理区域误视为正常组织，引入任务特定的标签噪声。

Result: 验证研究使用MedNeXt和T1/FLAIR输入表明，WMH感知的监督在域内GLI和外部WMH数据集中保持了健康组织分割性能，同时相对于噪声控制训练提高了对共存病变的敏感性。

Insight: 创新点在于构建了一个统一的解剖-病变标签空间，整合了健康脑组织和先前未标注的共存异常，支持联合解剖-病变监督、标签噪声分析和可重复评估，为多模态MRI分割提供了更全面的监督资源。

Abstract: Existing BraTS-GLI datasets provide a widely used benchmark for adult glioma MRI segmentation, but their task definition focuses on tumor subregions and does not systematically represent coexisting white matter hyperintensities (WMH). In joint segmentation settings, such unlabeled abnormalities introduce task-specific label noise by treating pathological regions as normal tissue. To address this limitation, we introduce BraTS-GLI Anatomy-Lesion, a controlled-access, labels-only derived resource built from the BraTS 2023-GLI training cohort. The resource provides 1,251 unified eight-class anatomy-lesion label sets aligned with the original four-modal MRI cases, including image-repair labels for 116 cases requiring repaired imaging inputs. The cohort is organized into a 394-case purified subset and an 857-case extended subset, with case-level metadata covering label source, image-repair requirements, quality-control status, access conditions, checksums, and release boundaries. Compared with the original BraTS-GLI annotations, the resource substantially expands foreground supervision by incorporating healthy brain tissues and previously unlabeled coexisting abnormalities within a unified label space. A validation study using MedNeXt and T1/FLAIR inputs suggests that WMH-aware supervision preserves healthy-tissue segmentation performance across both in-domain GLI and external WMH datasets, while improving sensitivity to coexisting lesions relative to noisy-control training. The resource is intended for scientific research and supports joint anatomy-lesion supervision, label-noise analysis, and reproducible evaluation. Data are available at https://www.synapse.org/Synapse:syn75210889/wiki/, and code is available at https://github.com/xyx200/brats-gli-anatomy-lesion-code. The data resource DOI is https://doi.org/10.7303/SYN75210889.

[28] CARDIAG: A Dense Segment Classification Benchmark of Deep Learning Architectures for Coronary Angiography cs.CV | cs.AI | cs.LGPDF

Dominik Bernard Lau, Hubert Malinowski, Jerzy Szyjut, Adam Brzeski, Tomasz Dziubich

TL;DR: 本文提出了CARDIAG基准，用于评估深度学习模型在冠状动脉造影图像上进行密集像素分类（SYNTAX类别或背景）的性能。该基准包含一个多中心、多标签的数据集，并评估了24种从经典卷积网络到最新状态空间视觉算法的架构。研究确定ConvNeXt V2编码器与DeepLab V3 Plus解码器组合性能最佳，并通过集成进一步提升，同时分析了模型的泛化能力和数据效率。

Details

Motivation: 冠状动脉造影的精确像素级分类对心血管疾病评估至关重要，但该领域缺乏标准化的评估协议。

Result: 在CARDIAG基准上，ConvNeXt V2编码器与DeepLab V3 Plus解码器组合取得了最佳性能，宏观F1分数为0.456；与Mamba U-Net和特征金字塔网络集成后，F1分数提升至0.479。研究还验证了所有架构的良好校准性，并评估了前5名方法的泛化能力。

Insight: 创新点包括引入一个精心划分的多中心、多标签基准数据集以可靠计算指标，并系统评估了从经典到前沿的多种架构。客观分析表明，研究强调了高分辨率和低分辨率特征在编码中的重要性，并为未来研究（如病变检测）提供了稳健的评估基础。

Abstract: Accurate pixel-level classification of coronary angiograms is critical for cardiovascular disease assessment, yet the field lacks standardized evaluation protocols. In this work we demonstrate a new benchmark for the assessment of deep learning models which densely classify pixels of coronary angiograms to one of SYNTAX classes (or background). The evaluation covers 24 distinct architectures starting with classic convnets to recent state-space-based vision algorithms. We release CARDIAG - a multi-center, multi-label dataset which we carefully split to reliably compute metrics, accounting for diameter error, overlap, centerline quality and calibration. The data contains SYNTAX labels, binary, uncertainty and segmentation masks as well as intermediate frames together with the selected non-sensitive DICOM metadata. From the multitude of algorithms, we nominate ConvNeXt V2 encoder with DeepLab V3 Plus decoder as the best performing, achieving macro $F_1=0.456$, which we then ensemble with Mamba U-Net and Feature Pyramid Network, for an increased $F_1=0.479$. We demonstrate all the architectures to be well calibrated and determine the generalization of the top 5 methods, together with the data efficiency of these architectures. We highlight the importance of both high-resolution and low-resolution features in encoding. We also demonstrate the model correctness in the context of patient demographic, vessel sides and projection angle configurations. Overall the released benchmark allows for future studies to robustly and rigorously assess the proposals, not only for SYNTAX segmentation, but lesion detection and many more.

[29] Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation cs.CV | cs.CL | cs.LGPDF

M M Asif Ferdous

TL;DR: 本研究评估了两种小型开源视觉语言模型（Qwen2-VL-2B-Instruct和SmolVLM-Instruct）在六种真实图像退化场景下的表现，重点比较了模型在自然语言中陈述的置信度与其内部生成答案的平均token概率这两种不确定性信号。研究发现，模型内部token概率能有效区分正误答案（AUROC高达0.92-0.99），而语言化置信度要么几乎恒定、错误检测能力接近随机（AUROC约0.50），要么难以解析获取。在严重曝光不足条件下，两种模型的准确率均大幅下降，但两种置信度信号却几乎不变，内部错误检测也失效。

Details

Motivation: 视觉语言模型越来越多地部署在消费级硬件上，这些环境中的输入图像常因压缩、相机抖动和光照不良而退化。在此类场景中，可靠的不确定性信号比原始准确率更重要，因为它决定了系统何时应选择拒绝回答而非强行应答。

Result: 在六种真实图像退化（三个严重级别）下的3,800次预测中，Qwen2-VL的语言化置信度几乎恒定（均值0.87-0.90），错误检测能力接近随机水平（AUROC 0.39-0.75，通常约0.50），而其内部token概率却能以AUROC 0.92-0.99的高水平区分正误。SmolVLM的语言化置信度大多无法解析，但其内部概率仍能提供高于随机水平的错误检测（AUROC 0.54-0.92）。在严重曝光不足时，两种模型的准确率均崩溃（Qwen2-VL从0.99降至0.22，SmolVLM从0.97降至0.42），但两种置信度信号几乎不变，内部错误检测也降至随机水平。

Insight: 论文的核心发现是，小型VLM编码了可用的自我认知（即内部token概率能有效反映不确定性），但其语言化输出未能表达这一信息。因此，在受限部署中，内部概率是比语言化置信度更优的延迟决策信号。然而，在严重低光条件下，两种信号均不可信。这一发现对VLM的实际部署和可靠性评估具有重要启示，强调了直接利用模型内部不确定性信号的必要性，并揭示了当前模型在极端退化条件下的脆弱性。

Abstract: Vision-language models (VLMs) are increasingly deployed on consumer hardware where input images are degraded by compression, camera shake, and poor lighting. In such settings, a reliable uncertainty signal matters more than raw accuracy, because it determines when a system should defer rather than answer. We evaluate two small open-weight VLMs – Qwen2-VL-2B-Instruct and SmolVLM-Instruct – across six realistic photographic degradations at three severity levels, comparing two confidence signals: the confidence the model states in natural language, and the model’s own mean token probability over its generated answer. Across 3,800 predictions, we find a large and consistent gap. Verbalized confidence in Qwen2-VL is almost constant (mean 0.87-0.90 across all conditions) and detects its own errors at chance level (AUROC 0.39-0.75, typically ~0.50), while internal token probability from the same model separates correct from incorrect answers with AUROC 0.92-0.99. In SmolVLM, verbalized confidence proved largely unobtainable: across three prompt templates, only one of five pilot attempts produced a parseable confidence value, while internal probability again yielded above-chance error detection (AUROC 0.54-0.92). Both models fail in the same place: under severe underexposure, accuracy collapses (0.99->0.22 for Qwen2-VL, 0.97->0.42 for SmolVLM) while both confidence signals barely move, and internal error-detection falls to chance. We conclude that small VLMs encode usable self-knowledge that their verbalized output does not express, that internal probability is therefore the better deferral signal in constrained deployment, and that neither signal should be trusted under severe low-light conditions.

[30] JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervision cs.CV | cs.ROPDF

Wooyung Yun, Dongwook Kim, Soomok Lee

TL;DR: 本文提出JustDepth，一种仅使用雷达、相机和单次扫描LiDAR进行训练的单阶段雷达-相机深度估计方法。该方法将所有雷达点聚合成固定宽度的1D表示，解耦运行时与点数量，通过高度融合块融合多模态信息，轻量级GNN全局传播深度，并引入仅训练时使用的置信度解码器稳定学习。在nuScenes数据集上，JustDepth在保持精度的同时，推理时间减少39.7倍，条纹伪影减少66%。

Details

Motivation: 解决自动驾驶系统中雷达-相机感知对准确且低延迟深度估计的需求。相机提供丰富外观但缺乏度量尺度，车载雷达提供度量距离但稀疏且噪声大，现有方法多为多阶段或依赖辅助标注，导致延迟高且可移植性有限。

Result: 在nuScenes数据集上，与最新SOTA方法相比，JustDepth在保持精度的同时，推理时间减少39.7倍，通过垂直-水平梯度比（VHGR）量化的条纹伪影减少66%。

Insight: 创新点包括：1）将雷达点聚合为固定宽度1D表示以解耦运行时与点数量；2）高度融合块有效融合多模态信息；3）轻量级GNN全局传播深度；4）仅训练时使用的置信度解码器稳定学习且无测试时开销；5）通过简单数据增强缓解条纹伪影并用VHGR量化评估。

Abstract: Accurate yet low-latency depth is essential for radar-camera perception in autonomous systems. Cameras provide rich appearance but lack metric scale, whereas automotive radar offers metric range but is sparse and noisy. Many pipelines are multi-stage or depend on auxiliary annotations, increasing latency and limiting portability. We introduce JustDepth, a single-stage radar-camera depth estimator trained only with radar, camera, and single-scan LiDAR. All radar returns are aggregated into a fixed-width 1D representation, decoupling runtime from point count. A Height Fusion Block fuses modalities, a lightweight GNN propagates depth globally, and a training-only confidence decoder stabilizes learning with zero test-time cost. We mitigate stripe artifacts via simple augmentations and quantify them using the Vertical-Horizontal Gradient Ratio (VHGR). On nuScenes, compared to recent state-of-the-art methods, JustDepth maintains accuracy while reducing inference time by 39.7x and stripe artifacts by 66% as measured by VHGR.

[31] Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis cs.CVPDF

Maria Peribañez, Javier Civera, Rudolph Triebel, Riccardo Giubilato

TL;DR: 本文提出了一种在低纹理、感知混叠、光照恶劣且视角稀疏的行星类似环境中进行视觉重定位的方法。该方法摒弃了传统的基于特征匹配的流程，转而通过构建基于3D高斯泼溅（3DGS）的可微分地图表示，直接从单张图像估计相机6自由度位姿。其核心贡献是一种结合光度与几何损失的几何感知训练策略，其中几何监督首次通过结合多视图立体（MVS）和激光雷达深度来提供。

Details

Motivation: 在行星类似地形（低纹理、感知混叠、光照恶劣、由漫游车运动导致视角稀疏且重叠度低）中，现有的基于图像到图像或图像到地图匹配的先进方法性能显著下降，因此需要一种更鲁棒的重定位方法。

Result: 在行星模拟环境数据上进行的大量实验验证了该方法的有效性，在挑战性条件下，重定位精度获得了显著提升。

Insight: 主要创新点在于：1）采用3DGS作为可微分地图表示，绕过传统特征匹配流程；2）提出结合光度与几何损失的几何感知训练策略，首次利用MVS与LiDAR深度联合提供几何监督，从而优化3DGS模型以更好地拟合场景几何，提升位姿估计的鲁棒性和准确性。

Abstract: Visual localization becomes extremely challenging in planetary-like terrains characterized by low texture, perceptual aliasing, harsh illumination, and sparse, weakly overlapping viewpoints induced by forward rover motion and unconstrained driving directions. Under these conditions, state-of-the-art image-to-image and image-to-map matching pipelines suffer significant performance degradation. In this work, we propose a visual relocalization method that departs from classical correspondence-based pipelines by directly estimating camera poses against a differentiable map representation built with 3D Gaussian Splatting (3DGS). Our key contribution is a geometry-aware training strategy that combines photometric and geometric losses, where the geometric supervision is provided for the first time by combining multi-view stereo (MVS) and LiDAR depths. We show that this joint optimization produces a 3DGS model that better fits the underlying scene geometry, leading to improved photometric and geometric consistency and more robust, accurate single-image 6-DoF pose estimation. Extensive experiments on data acquired in planetary-analog environments validate the effectiveness of our approach, showing substantial gains in relocalization accuracy under challenging conditions. Code is available at https://github.com/DLR-RM/multimodal-gsplat-relocalization.

[32] LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR cs.CVPDF

Xudong Liu, Bicheng Wan, Yulin Jin

TL;DR: 本文提出LayoutLite，一种用于高效文档OCR的轻量级即插即用模块。它通过在视觉编码器和语言解码器之间进行令牌级隐式布局分析，预测每个视觉令牌的重要性分数并移除低信息令牌，从而显著减少视觉令牌长度和推理成本，同时保持识别质量。

Details

Motivation: 基于视觉语言模型的端到端OCR系统在处理复杂文档时性能强大，但效率受限于文档图像产生的大量视觉令牌，其中许多对应空白边缘或视觉冗余区域，而直接应用通用视觉令牌压缩方法可能移除OCR关键细节。

Result: 在OmniDocBench上的实验表明，LayoutLite能大幅减少视觉令牌长度和推理成本，且识别质量下降可忽略。在FireRed-OCR和Logics-Parsing-V2两个OCR专用VLM上评估，在高达50%令牌压缩下，LayoutLite几乎保持相同分数，同时将预填充延迟、FLOPs和KV缓存内存减少超过40%，仅带来少量额外推理开销。

Insight: 创新点在于提出令牌级隐式布局分析，避免了显式文档布局检测；通过强化学习框架以OCR输出一致性驱动优化令牌选择，无需人工标注；保留保留令牌的原始空间位置信息，确保压缩后不丢失关键布局上下文。

Abstract: End-to-end OCR systems based on vision-language models have achieved strong performance in complex document OCR, but their efficiency is limited by the large number of visual tokens produced from document images. Many of these tokens correspond to blank margins or visually redundant regions, yet directly applying generic visual token compression methods may remove OCR-critical fine-grained details. In this paper, we propose LayoutLite, a lightweight plug-and-play module for efficient document OCR. Instead of relying on explicit document layout detection, LayoutLite performs implicit layout analysis at the token level between the vision encoder and the language decoder. It aggregates multi-layer visual representations from the vision encoder, and predicts an importance score for each visual token with a lightweight scoring network. Low-information tokens are then removed before entering the language decoder while preserving the original spatial positional information of retained tokens. To train LayoutLite without human annotations, we cast token selection as a reinforcement learning problem and optimize it with a group-relative policy optimization objective driven by OCR output consistency, together with an auxiliary layout supervision signal to stabilize training. Experiments on OmniDocBench demonstrate that LayoutLite can substantially reduce visual token length and inference cost with negligible degradation in recognition quality. We further evaluate LayoutLite on two OCR-specialized VLMs, FireRed-OCR and Logics-Parsing-V2. Under up to 50% token compression, LayoutLite preserves almost the same score on both models while reducing prefill latency, FLOPs, and KV cache memory by over 40%, with only a small additional inference overhead. These results show that token-level implicit layout analysis is an effective and practical approach for accelerating VLM-based OCR systems.

[33] Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs cs.CV | cs.AIPDF

Yuheng Zong, Minghua Wang, Xin Zhao, Zhi-Hui Zhan, Antonio Plaza

TL;DR: 本文提出了一种名为’先填充后提升’(FBA)的能力差距驱动的后训练方法，用于解决遥感多模态大语言模型(RS-MLLMs)在特定场景(如沿海港口理解)中因高质量数据稀缺和能力覆盖不全而面临的细粒度专业化挑战。该方法通过构建CPRS三层监督数据集，分三个阶段(遥感语义锚定、领域桥接收敛、证据基础场景调优)逐步填补模型的能力缺口，再推进场景专业化。

Details

Motivation: 现有遥感多模态大语言模型在通用航空图像理解上有所提升，但地球观测应用需要针对特定场景进行细粒度专业化，这受到高质量场景数据稀缺和模型能力覆盖不完整的限制。

Result: 在可比的训练预算下，在HarborEval基准测试上，FBA方法将LLaVA-v1.5的得分从Direct-SFT的57.95提升至70.29，将Qwen3-VL的得分从81.09提升至83.37。FBA也优于Collapsed-SFT，并在港口相关的VRSBench/RSVQA子集和OpenEval上领先。

Insight: 创新点在于将模型适应问题形式化为能力差距驱动的后训练问题，并提出了分阶段、渐进式的训练策略(FBA)，即先系统性填补基础能力缺口，再进行场景专业化，而非直接在目标域样本上进行单阶段监督微调。这通过构建结构化的监督数据集和分阶段训练流程来实现，并通过诊断性基准和阶段分析验证了其有效性。

Abstract: Remote sensing multimodal large language models (RS-MLLMs) have improved general aerial-image understanding. However, Earth observation applications require fine-grained scenario specialization, constrained by scarce high-quality scenario data and incomplete capability coverage. We formulate this adaptation as a capability-gap-driven post-training problem and propose filling before advancing (FBA). Rather than relying on single-stage supervised fine-tuning (SFT) over target-domain samples, FBA first fills prerequisite capability gaps before advancing toward scenario specialization. We instantiate FBA for coastal harbor understanding, a representative multi-source scenario, by constructing CPRS (Coastal-Port Remote Sensing), a three-layer supervision dataset coupled with three ordered stages: (1) RS semantic anchoring for overhead-view visual-language alignment; (2) domain-bridge convergence for shared RS priors across target and bridging scenarios under different modalities; and (3) evidence-grounded scenario tuning for downstream performance. We construct HarborEval, an eight-track diagnostic benchmark covering perception, spatial understanding, robustness, and generation. Under comparable training budgets, HarborEval increases from 57.95 with Direct-SFT to 70.29 with FBA on LLaVA-v1.5, and from 81.09 to 83.37 on Qwen3-VL. FBA also outperforms Collapsed-SFT and leads on harbor-related VRSBench/RSVQA subsets and OpenEval. Stage-wise and role-replacement analyses validate progressive gap filling and stage-specific roles. Public examples and release updates for CPRS, HarborEval, code, and trained weights are available at https://github.com/Z0ngL1ng/filling-before-advancing.

[34] TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution cs.CV | cs.AIPDF

Sicheng Gao, Zhuyun Zhou, Yixuan Liu, Tong Shen, Zongwei Wu

TL;DR: TRaM-VSR是一种用于一步扩散视频超分辨率的高效框架，通过重要性感知的令牌路由与合并机制，自适应地分配计算资源。它融合了上下文感知的视频先验和网络级先验，将令牌分为高保真局部流和紧凑全局流进行处理，在显著加速推理的同时保持了最先进的重建质量和时间一致性。

Details

Motivation: 现有基于大规模扩散Transformer的视频超分辨率方法虽能获得卓越的感知质量，但其处理密集时空令牌序列的二次计算成本使其不实用。现有效率导向的方法存在不可逆细节丢失和时间闪烁的风险，这一弱点在一步扩散模型中尤为突出。

Result: 大量实验表明，TRaM-VSR在保持最先进重建质量和鲁棒时间一致性的同时，显著加速了推理。

Insight: 创新点在于提出了一种自适应令牌分配框架，通过融合运动敏感时间线索和语义文本相似性来估计令牌重要性，并利用离线规划器进行校准，以指导跨最优分组网络块的路由。技术上将关键令牌在高保真局部流中处理，而信息较少的令牌聚合到紧凑全局流中，并与扩散模型的多粒度特性对齐。

Abstract: Video super-resolution (VSR) using large-scale Diffusion Transformer (DiT) priors achieves exceptional perceptual quality but is often impractical due to the quadratic computational cost of processing dense spatio-temporal token sequences. Existing efficiency-oriented methods risk irreversible detail loss and temporal flickering, a vulnerability especially pronounced in one-step diffusion models. To address this, we propose TRaM-VSR, a Token Routing and Merging framework for adaptive token allocation, leveraging both context-aware video priors and network-level priors. First, token importance is estimated by fusing motion-sensitive temporal cues with semantic text similarity, isolating dynamic objects and structural boundaries. Next, this importance is further calibrated and adjusted by an offline planner to guide routing across optimally grouped network blocks. Technically, within each routed group, structurally critical tokens are processed in a high-fidelity local stream, while less informative tokens are aggregated into a compact global stream, both modulated by network depth and aligned with the multigranular nature of diffusion models. Extensive experiments show that TRaM-VSR accelerates inference significantly while preserving state-of-the-art reconstruction quality and robust temporal consistency. The code is available at https://github.com/Ree1s/TRaM-VSR.

[35] AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment cs.CVPDF

Ziyao Huang, Shunkai Li, Juan Cao, Chenyu Li, Youliang Zhang

TL;DR: 本文提出AgentHOI，一种基于文本驱动的人-物交互视频生成方法，采用’先思考后生成’框架，通过多智能体推理连接高层文本意图与物理执行，并引入隐式文本-运动对齐策略，无需推理时显式运动输入即可实现鲁棒的HOI合成。

Details

Motivation: 现有HOI视频生成方法严重依赖显式运动控制，限制了在不同物体和交互场景中的可扩展性和泛化能力，因此需要一种能更好理解文本指令并生成自然交互的方法。

Result: 实验表明，AgentHOI在穿戴、骑行等以物体为中心的挑战性场景中，显著提升了交互自然度、物体外观保持度以及对复杂文本指令的遵循能力。

Insight: 创新点在于结合了多智能体推理框架（感知、交互、运动规划）和隐式文本-运动对齐策略，将文本到运动的先验知识蒸馏到视频扩散模型中，从而实现了无需显式运动输入的、可控的HOI视频生成。

Abstract: Recent advances in video diffusion models have spurred interest in human-object interaction (HOI) video generation, which demands fine-grained control over interaction logic beyond single-subject animation. However, existing HOI methods rely heavily on explicit motion control, limiting scalability and generalization across diverse objects and interactions. In this study, we propose AgentHOI, a text-driven HOI video generation following a thinking-before-generation framework that bridges the gap between high-level textual intent and physical execution through multi-agent reasoning over perception, interaction, and motion planning. Building upon the generated interaction plans, we further strengthen text-driven motion understanding. We introduce an implicit text-motion alignment strategy that distills text-to-motion priors into the video diffusion model, enabling robust HOI synthesis without explicit motion inputs at inference. Experiments show that AgentHOI significantly improves interaction naturalness, object appearance preservation, and adherence to complex textual instructions across challenging object-centric scenarios such as wearing and riding. The code is available at https://github.com/bone-11/agenthoi.

[36] RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding cs.CVPDF

Jianqin Liu, Weiwei Cao, Wanxing Chang, Ruifeng Yuan, Bowen Shi

TL;DR: 本文提出了RadSight，一种面向感知可靠性的多模态放射学图像理解模型。研究首先通过大规模基准测试Perception-Bench揭示了现有医学MLLMs在低级视觉感知（如病灶属性判断）上的根本缺陷，并指出这是导致其临床诊断不可靠的关键瓶颈。为此，作者构建了一个基于双2D/3D编码器架构的感知驱动MLLM，采用渐进式课程学习在感知导向的大规模语料库上进行训练，从而在视觉感知和临床诊断任务上实现了显著提升。

Details

Motivation: 现有医学多模态大语言模型（MLLMs）在复杂图像理解任务中可靠性不足，经常出现视觉解释错误。本研究旨在系统追溯这些失败根源，发现其诊断不可靠性源于一个被忽视的低级视觉感知瓶颈。

Result: 在提出的包含113万个样本的Perception-Bench基准测试中，RadSight在六个评估维度（属性判断、空间定位、空间理解、疾病预测、异常检测和报告生成）上均一致优于现有MLLMs，尤其在空间定位和临床诊断方面提升显著。在公开的2D和3D医学基准测试上也取得了持续改进。

Insight: 创新点在于系统揭示了医学MLLMs的可靠性问题根植于低级视觉感知缺陷，并提出了一个感知驱动的四阶段渐进理解框架（视觉-语言对齐、细粒度视觉感知、临床诊断、诊断解释）以及结合双2D/3D编码器和渐进课程学习的模型架构，强调了鲁棒的低级视觉感知是可靠临床理解的基石。

Abstract: Medical multimodal large language models (MLLMs) are increasingly expected to perform complex image understanding tasks, yet their reliability is often compromised by frequent errors in visual interpretation. To systematically trace these failures, we traverse the hierarchy from high-level clinical tasks down to fundamental visual perception. We therefore introduce Perception-Bench, a large-scale benchmark comprising 1.13 million samples that assesses medical MLLMs across six dimensions: attribute judgment, spatial grounding, spatial understanding, disease prediction, anomaly detection, and report generation, spanning both 2D and 3D radiology images. Our analysis on Perception-Bench reveals that existing MLLMs lack the ability to capture even the most basic lesion attributes, such as location, size, and density. This inability to ground clinical outputs in primary visual evidence reveals that the models’ diagnostic unreliability is rooted in a critical but overlooked bottleneck in low-level visual perception. Motivated by this, we propose RadSight, a perception-driven MLLM built upon a dual 2D/3D encoder architecture that preserves native imaging spatial structures. RadSight formulates medical image understanding as a four-stage progressive process: visual-language alignment, fine-grained visual perception, clinical diagnosis, and diagnostic interpretation. The model is trained on an 8.37 million perception-oriented corpus using progressive curriculum learning. On Perception-Bench, RadSight consistently outperforms existing MLLMs across all six evaluation dimensions, with particularly strong gains in spatial grounding and clinical diagnosis. It also achieves consistent improvements on public 2D and 3D medical benchmarks, further demonstrating that robust low-level visual perception is a critical foundation for reliable clinical understanding. Code and model will be publicly available.

[37] SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images cs.CVPDF

Baptiste Podvin, Alexandre Ancel, Flavio Milana, Chiara Innocenzi, Davide Arrigo

TL;DR: SLIP是一个用于3D医学图像交互式分割的端到端可训练框架，通过解耦图像编码与提示引导的细化过程，实现低延迟、可逆提示和跨交互的响应性。它采用轻量级补丁记忆库维护交互感知的分割状态，支持一次图像特征计算和重复使用，显著降低交互延迟。

Details

Motivation: 现有基于补丁的交互式分割方法（如nnInteractive）存在高交互延迟、对连续交互响应有限、缺乏可逆提示支持等问题，且评估多依赖模拟而非真实用户交互研究。

Result: SLIP在13个公共数据集上达到SOTA交互分割性能，在三个临床标注任务、六名专家参与的前瞻性用户研究中，相比手动分割和nnInteractive，表现出更低的交互延迟、更高的响应性、可逆提示支持以及更高的用户偏好。

Insight: 创新点在于将图像表示与交互推理分离，通过轻量级补丁记忆库实现交互上下文的全局传播，支持可逆提示且无需重新计算图像特征，提升了框架的通用性和效率。

Abstract: Interactive deep image segmentation enables efficient medical image annotation by iteratively refining predictions from user prompts, such as positive and negative clicks. Recent patch-based methods, including nnInteractive, achieve strong segmentation performance but remain limited in annotation workflows by high interaction latency, limited responsiveness to successive interactions, and the lack of support for reversible prompting. Furthermore, evaluation relies predominantly on simulated rather than controlled real-user interaction studies. We present SLIP, an end-to-end trainable framework for interactive 3D medical image segmentation that decouples image encoding from prompt-guided refinement. Image features are computed once and reused, while a lightweight patch memory bank maintains an interaction-aware segmentation state shared across patches. This representation enables prediction updates by propagating interaction context throughout the image, supports reversible prompting without recomputing image features, and substantially reduces interaction latency. By separating image representation from interactive reasoning, SLIP remains compatible with a wide range of image encoders. We train a single SLIP model for general interactive segmentation across diverse anatomical structures and imaging modalities. Beyond standard simulated evaluation, we conduct a controlled prospective user study comparing manual segmentation, nnInteractive, and SLIP across three clinical annotation tasks, six expert participants, and subjective usability measures, addressing the limited human validation of interactive segmentation methods. SLIP achieves SOTA interactive segmentation performance across 13 public datasets while providing lower interaction latency, greater responsiveness, support for reversible prompting, and higher user preference than existing approaches.

[38] fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction cs.CVPDF

Jingyang Huo, Xiangru Huang, Chentao Shen, Yikai Wang, Yun Wang

TL;DR: 本文提出了fMRI-Face数据集和fMRI2Face解码框架，用于从fMRI脑活动信号重建动态人脸视频。fMRI-Face是首个包含可控全高清数字人脸视频与fMRI配对的数据集，而fMRI2Face则是一个几何引导的神经视频解码框架，通过从脑活动中提取外观上下文和可变形3D面部控制来生成高保真面部视频。

Details

Motivation: 解决基于fMRI的人脸解码研究中缺乏高分辨率、可控神经数据集以及现有方法难以同时恢复身份特定外观和时变面部动态的问题。

Result: 实验表明，fMRI2Face在重建保真度、身份保持、面部几何和运动一致性方面持续优于代表性的神经解码基线方法，为基于fMRI的数字人重建设立了新基准。

Insight: 创新点在于构建了首个全高清可控fMRI-视频配对数据集，并提出了一个结合脑驱动外观上下文和可变形3D面部控制的几何引导解码框架，通过神经控制视频扩散模型实现高保真重建，为动态人脸感知研究提供了结构化平台。

Abstract: Reconstructing dynamic human faces from brain activity provides a powerful way to study how the mind perceives identity, expression, and facial motion. However, progress in fMRI-based face decoding has been limited by scarce controlled, high-resolution neural datasets and by methods that struggle to recover both identity-specific appearance and time-varying facial dynamics. We present fMRI-Face, the first fMRI dataset paired with controllable full-HD digital human facial videos rendered at 1920$\times$1080 resolution. During scanning, participants watched photorealistic, background-free facial videos with controlled identity, expression, and head pose, while fMRI activity was recorded. The resulting dataset contains 62,856 paired fMRI-video samples, providing a structured resource for studying dynamic face perception and reconstruction. Building on this dataset, we propose fMRI2Face, a geometry-guided neural video decoding framework for reconstructing facial videos from fMRI signals. fMRI2Face derives two complementary neural controls from brain activity: Brain-derived Appearance Context, which captures global identity-related visual attributes, and Morphable 3D Facial Control, which provides explicit geometry-aware guidance for pose, expression, and non-rigid facial dynamics. These controls are integrated through Neural-Controlled Video Diffusion with auxiliary latent completion, enabling high-fidelity facial video reconstruction directly from brain activity. Experiments show that fMRI2Face consistently improves reconstruction fidelity, identity preservation, facial geometry, and motion consistency over representative neural decoding baselines. Together, fMRI-Face and fMRI2Face establish a controlled platform for studying dynamic face perception and provide a new benchmark for fMRI-based digital human reconstruction.

[39] SiPhy: Single-Image Physical Property Reasoning cs.CV | cs.AIPDF

Hoang Le, Joonwoo Kwon, Elkhan Ismayilzada, Yufei Zhang, Zijun Cui

TL;DR: SiPhy是一个从单张RGB图像推理物体物理属性（如质量、密度、杨氏模量）的统一框架。它通过采样伪体素点、提取CLIP特征，并结合视觉语言模型（VLM）提出的材料候选信息，实现了3D感知视觉线索与基于语言的材料知识的对齐。该方法在多个数据集上实现了最先进的单图像性能，并展示了在真实手-物体交互数据集上的应用潜力。

Details

Motivation: 从单张图像推断物理属性对于仿真和具身AI至关重要，但现有方法大多依赖多视角重建或基于物理的监督，因此需要一种仅从单视图进行推理的框架。

Result: 在ABO-500、MVImgNet-100和PhysXNet-100数据集上，SiPhy实现了最先进的单图像性能：质量相对误差（MnRE）比PUGS提升高达93%，密度平均绝对误差（MAE）比NeRF2Physics降低35.5%，杨氏模量误差降低23.5%。

Insight: 创新点在于将3D感知视觉线索（深度）与基于语言的材料知识（通过VLM）进行对齐，并引入了基于部件的对比聚合器来增强区域一致性，以及针对密集物体的重量感知细化来改进厚度和体积估计。

Abstract: Inferring physical properties such as mass, stiffness, and elasticity from a single image is essential for simulation and embodied AI, yet most existing approaches rely on multi-view reconstruction or physics-based supervision. We introduce SiPhy, a unified framework for single-image physical property reasoning that aligns 3D-aware visual cues, depth with language-based material knowledge. From one RGB image, SiPhy samples pseudo-voxel points, extracts CLIP features, and grounds them to material candidates proposed by a VLM. A part-based contrastive aggregator enforces region consistency, while a heaviness-aware refinement improves thickness and volume estimation for dense objects. Across ABO-500, MVImgNet-100, and PhysXNet-100, SiPhy achieves state-of-the-art single-image performance, surpassing multi-view reconstruction methods by improving mass MnRE by up to 93% (vs. PUGS), reducing density MAE by 35.5% (vs. NeRF2Physics), and lowering Young’s modulus error by 23.5%. We further validate SiPhy on real hand-object interaction datasets, demonstrating its potential as a data annotation engine for physical understanding from single-view imagery.

[40] Active few-shot segmentation by reinforcing data selection cs.CVPDF

Chenlan Zhao, Benny Wong, Timothy F. Lundberg, Ahmed M. Elsayed, Abdallah Aljarkas

TL;DR: 本文提出了一种基于强化学习的主动少样本分割方法，用于优化医学图像分割中的支持集选择。该方法通过联合优化支持集样本，而非独立评分，以最大化下游分割性能。在跨机构盆腔MRI数据集上的实验表明，该方法优于随机选择和现有最先进方法。

Details

Motivation: 现有主动数据选择方法主要独立评估样本，未充分考虑样本间的互补性，导致少样本分割适应性能受限。

Result: 在跨机构盆腔MRI数据集上，该方法相比随机选择和当前SOTA方法取得了性能提升，验证了支持集互补性的重要性。

Insight: 创新点在于使用强化学习框架联合优化支持集选择，强调样本间交互作用；可借鉴之处是将支持集选择视为序列决策问题，以端到端方式优化适应性能。

Abstract: Few-shot learning enables medical image segmentation models to adapt to new tasks using only a small number of labelled examples. However, adaptation performance depends strongly on which examples are selected for the support set. Effective support sets should capture relevant variation within the target domain and be informative for adaptation, with constituent samples providing complementary information. Despite this, existing active data selection approaches largely prioritise samples individually and do not explicitly account for interactions between examples. In this work, we propose a reinforcement learning framework for support-set selection in few-shot medical image segmentation, enabling support sets to be optimised jointly rather than through independent sample scoring. Given a pool of unlabelled candidate images, an agent directly predicts a support set that maximises downstream segmentation performance. Experiments on a cross-institutional pelvic MRI dataset demonstrate improvements over random selection and current state-of-the-art methods. Our findings highlight the importance of support-set complementarity for effective adaptation and demonstrate the potential of reinforcement learning for optimising adaptation sets.

[41] Time-Reversed Imaging: A Multimodal Benchmark and Framework for Reconstructing Past Human-Environment Interactions cs.CV | cs.AI | eess.IVPDF

Jorge Bacca, Kebin Contreras, Luis Toscano-Palomino, Mauro Dalla Mura

TL;DR: 本文提出了时间反转成像这一新范式，旨在从多模态残留痕迹中推断场景中刚发生的人类-环境交互。作者构建了首个概念验证数据集TRACE-HEI，并提出了一种结合结构化文本描述与视觉语言引导扩散模型的多模态推理方法，以重建合理的过去帧。

Details

Motivation: 解决从热成像、紫外线和可见光谱中可观测的残留物理印记推断过去交互的问题，超越传统视频帧插值或外推，探索基于多模态痕迹的场景理解新方向。

Result: 实验表明，从衰减痕迹推断近期事件具有挑战性，但当互补模态减少解空间歧义时是可行的；该工作为时间反转成像建立了首个计算与实验基础。

Insight: 创新点在于将多模态物理痕迹转化为结构化文本约束，并利用视觉语言引导的扩散模型进行逆向重建，为融合视觉、物理与生成推理的场景理解开辟了新途径。

Abstract: We introduce time-reversed imaging, a new paradigm that infers what just happened in a scene from fading multimodal traces. Instead of extrapolating or interpolating video frames, our goal is to infer past human-environment interactions from residual physical imprints observable in thermal, ultraviolet, and visible spectra. To study this problem, we present TRACE-HEI, the first proof-of-concept dataset for time-reversed imaging, containing synchronized tri-modal video sequences of actions such as sitting, touching, moving objects, and liquid spills, captured across diverse materials and recorded up to three minutes after contact. To establish the benchmark, we propose a multimodal inference approach that extracts structured textual descriptions of detected traces and uses them to constrain a vision-language-guided diffusion model for reconstructing plausible past frames. Experiments show that inferring recent events from fading traces is challenging but feasible when complementary modalities reduce solution ambiguity. This work defines the first computational and experimental foundation for time-reversed imaging, bridging vision, physics, and generative reasoning, and opening new directions for scene understanding beyond instantaneous observation.

[42] IR275K: A Benchmark for Infrared Multi-Frame Super-Resolution Toward Efficient Remote Sensing cs.CVPDF

Jie Deng, Heyang Wang, Changxin Wang, Junkai Shen, Hongyi Chen

TL;DR: 本文提出了IR275K，一个用于红外多帧超分辨率（MFSR）的大规模基准数据集，旨在解决红外遥感中高效处理的问题。该数据集包含594个红外视频序列和超过27.5万帧图像，并提供了可复现的X4超分评估协议。作为初步架构探索，论文还评估了一个名为CGMamba的轻量级状态空间模型，该模型结合了2D旋转位置编码和中心引导的交叉Mamba融合，在显著降低计算成本的同时，取得了优于红外单图超分辨率方法的性能。

Details

Motivation: 当前红外遥感领域面临探测器分辨率、功耗和下行带宽的限制，而多帧超分辨率（MFSR）作为一种基于软件的增强路径，其评估在红外领域仍缺乏统一标准。现有基准未能充分捕捉红外视频特有的热对比度、传感器噪声、弱纹理和平台引起的帧间变化，因此需要一个专门的基准来推动高效、准确的红外MFSR研究。

Result: 在提出的IR275K基准上，轻量级模型CGMamba（参数量10.90M，计算量112.14G FLOPs）达到了33.19dB的峰值信噪比（PSNR），比红外单图超分辨率参考方法高出0.35-0.52 dB，且计算成本显著更低。消融实验表明，移除2D旋转位置编码会导致性能下降1.53dB并产生严重的网格状伪影。

Insight: 论文的核心创新点在于构建了首个大规模、可复现的红外多帧超分辨率基准IR275K，填补了该领域评估标准的空白。从方法角度看，CGMamba模型将状态空间模型（SSM）与2D旋转位置编码和中心引导的交叉融合机制相结合，证明了在红外条件下，显式的空间锚定对于稳定基于SSM的跨帧门控机制至关重要，这为资源受限的红外感知中空间感知的SSM设计提供了具体起点。

Abstract: Efficient processing is becoming increasingly important in infrared remote sensing, where satellite constellations produce large volumes of observations under constrained detector resolution, power, and downlink bandwidth. Multi-frame super-resolution (MFSR) offers a software-based route to spatial enhancement, but its evaluation in infrared sensing remains fragmented across private datasets and ad-hoc protocols. Existing benchmarks do not explicitly capture the thermal contrast, sensor noise, weak texture, and platform-induced frame-to-frame variation that characterize infrared video. We introduce IR275K, a curated benchmark containing 594 infrared video sequences and 275,196 frames. It provides sequence-level train/validation/test splits and a reproducible X4 evaluation protocol. As an initial architectural probe, we further evaluate CGMamba, a lightweight state-space model with 10.90M parameters and 112.14G FLOPs. CGMamba combines 2D rotary position encoding (2D~~RoPE) with center-guided cross-Mamba (CGCM) fusion for implicit multi-frame reconstruction. It achieves 33.19dB PSNR, outperforming infrared single-image super-resolution references by 0.35–0.52~~dB at substantially lower computational cost. Ablation results show that removing 2D~RoPE from CGCM causes a 1.53dB drop and severe grid-like artifacts. This indicates that explicit spatial anchoring is critical for stabilizing SSM-based cross-frame gating under infrared conditions. IR275K provides a reproducible foundation for accuracy–efficiency evaluation of infrared MFSR methods, while the architectural analysis offers a concrete starting point for spatially aware SSM design under resource-constrained infrared sensing. Dataset and evaluation resources are available at: https://github.com/InfraRecon7/IR275K.

[43] SM4RT: Learning Structured Motion Geometry for 4D Reconstruction cs.CV | cs.AI | cs.ROPDF

Shing Ho J. Lin, Wenzhao Zheng, Dong Zhuo, Yuqi Wu, Jie Zhou

TL;DR: 本文提出SM4RT（结构化运动4D重建Transformer），一种用于从单目RGB视频进行端到端3D重建和结构化运动感知的方法。该方法的核心创新是引入“运动结构”来表示场景动态，将场景运动分解为一组紧凑的运动基（每个基表示为SE(3)中的6D twist序列），并通过稀疏的、时间共享的逐像素分配权重来恢复稠密场景运动，确保同一物体上的点共享共同的刚体运动轨迹。

Details

Motivation: 现有运动感知方法（如稀疏跟踪、稠密点状流）将运动视为独立的点位移，忽略了物理运动的结构化本质。现实世界物体通常遵循刚体运动学，点应集体运动而非孤立移动。运动本身具有几何结构（由SE(3)刚体变换支配），因此需要一种能捕捉这种结构化运动的方法来推进4D动态理解。

Result: SM4RT在运动重建性能上表现出色，同时保持了场景运动的几何结构。论文声称其实现了强大的运动重建性能，但摘要中未提及具体的定量结果、基准测试或与SOTA的比较。

Insight: 主要创新点在于提出了“运动结构”表示，将场景运动分解为基于SE(3)的紧凑运动基，并通过稀疏权重分配实现稠密运动恢复，从而在单次前向传播中联合推断3D几何、世界坐标运动和场景运动学结构。这为4D重建提供了一种更符合物理规律的结构化运动建模方法。

Abstract: Geometry Foundation Models (GFMs) have substantially advanced monocular 3D reconstruction, yet extending this capability to 4D dynamic understanding remains a fundamental challenge. Most existing motion perception methods (e.g., sparse tracking, dense point-wise flow) treat motion as independent point-wise displacements, ignoring the structured nature of physical motion. However, real-world objects usually obey rigid-body kinematics, and points thus usually move collectively, not in isolation. Motion itself possesses geometric structure: physical objects undergo a set of rigid-body transformations governed by SE(3), rather than unstructured point-wise displacements. Building on this insight, we propose SM4RT, a Structured Motion 4D Reconstruction Transformer for end-to-end 3D reconstruction and structured motion perception. SM4RT introduces Structure-of-Motion to represent scene dynamics, where scene motion is decomposed into a compact set of motion bases, each represented as a temporal sequence of 6D twists in SE(3). Dense scene motion is then recovered by sparse, time-shared per-pixel assignment weights over these bases, ensuring points on the same object share a common rigid-body motion trajectory. SM4RT introduces a parallel motion geometry encoder and decoder that jointly infer 3D geometry, world-coordinate motion, and scene kinematic structure in a single forward pass from monocular RGB video. SM4RT achieves strong motion reconstruction performance while preserving the geometric structure of scene motion.

[44] Twins: Learn to Predict Unified Representations with Focal Loss cs.CVPDF

Kaixiong Gong, Xin Cai, Bin Lin, Hao Wang, Yunlong Lin

TL;DR: 本文提出Twins方法，通过通道级联ViT和VAE特征构建统一的连续标记空间，以同时支持多模态理解和图像生成。针对联合建模中的优化不平衡问题，作者采用焦点回归目标来提升VAE维度的大误差权重，从而改善ViT和VAE组件之间的优化平衡。

Details

Motivation: 现有连续多模态模型通常使用语义特征（如ViT）进行理解、低级潜在表示（如VAE）进行合成，导致潜在空间不匹配；本文旨在构建统一的连续标记空间来解决这一问题。

Result: 在ImageNet上，该方法相比朴素MSE损失实现了高达10.57 gFID的提升（无需分类器无关引导）；在多模态理解基准上表现具有竞争力，并提高了重建保真度，缩小了理解导向和生成导向表示之间的差距。

Insight: 创新点包括通过通道级联ViT和VAE特征构建统一连续标记空间，以及采用焦点回归目标解决优化不平衡问题；这为统一多模态模型的设计提供了新的思路，平衡了理解和生成任务的需求。

Abstract: Unified multimodal models seek a shared visual token space that supports both multimodal understanding and image generation. Discrete methods unify the interface via a shared codebook, whereas continuous pipelines often rely on two disparate representations – semantic features (e.g., ViT) for understanding and low-level latents (e.g., VAE) for synthesis – resulting in mismatched latent spaces. We propose Twins, a unified continuous token space formed by channel-wise concatenating ViT and VAE features on the same token grid, so the sequence length is unchanged and attention cost does not increase. However, jointly modeling Twins in a Diffusion Transformer exposes a severe optimization imbalance: the model fits the ViT component well but struggles to match the VAE latent distribution. We trace this imbalance to three sources of heterogeneity: frequency bias, intrinsic dimensionality, and condition-aligned vs condition-independent uncertainty. To address it, we adapt a focal regression objective for flow matching that upweights large-error VAE dimensions, better balancing optimization across the ViT and VAE components. On ImageNet, this yields up to 10.57 gFID gain over naive MSE loss without classifier-free guidance. Twins also performs competitively on multimodal understanding benchmarks and improves reconstruction fidelity, narrowing the gap between understanding- and generation-oriented representations.

cs.SE [Back]

[45] Pixels for Programs? A Cross-Provider Case Study of Input-Token Accounting for Source Code as Text and Images cs.SE | cs.AI | cs.CVPDF

Ronak Bhalgami

TL;DR: 本文是一项跨供应商的案例研究，探讨了将源代码作为文本与图像输入时，商业API如何计算输入令牌。研究比较了Anthropic、OpenAI和Google Vertex AI三家供应商在五种编程语言、九种代码长度下，对原始文本与紧凑渲染图像表示的令牌计数差异。

Details

Motivation: 长源代码上下文会消耗大量文本令牌，因此有人提议将代码渲染为图像供视觉语言模型处理。本文旨在研究一个不同的系统问题：商业API如何计算这种转换后的请求令牌，以评估其潜在的令牌节省效果。

Result: 在675个完整的文本/图像对中，图像与文本的聚合令牌比分别为0.135、0.194和0.242，对应报告的输入令牌减少86.5%、80.6%和75.8%。但不同供应商行为差异显著：Anthropic和OpenAI的图像在所有测试规模下都获得更低计数，而Gemini图像在20行代码时需要6.95倍令牌，仅在200行以上时才低于文本计数。

Insight: 论文的创新点在于首次系统测量了商业API对源代码图像表示的令牌计数机制，揭示了不同供应商在令牌计算上的显著差异和非单调行为。这为优化基于令牌计费的代码处理应用提供了重要的系统级洞察，并开源了可复现的研究工具链。

Abstract: Long source-code contexts consume many text tokens, motivating the proposal to render code as images for vision-language models. Recent work asks whether models can still solve code tasks after this transformation. We examine a different systems question: how commercial APIs count the resulting requests. We present a reproducible measurement case study of provider-reported input tokens for raw source text and a compact rendered-image representation. The benchmark pairs requests across five programming languages, nine source lengths from 20 to 2,000 lines, and 15 available model aliases exposed by Anthropic, OpenAI, and Google Vertex AI. These aliases collapse to approximately five distinct accounting signatures and are not independent model replications. Across 675 complete text/image pairs, aggregate image-to-text ratios are 0.135, 0.194, and 0.242, corresponding to reported input-token reductions of 86.5%, 80.6%, and 75.8%, respectively. These totals conceal materially different break-even behavior: Anthropic and OpenAI images receive lower counts at every tested size, while Gemini images require 6.95 times as many tokens at 20 lines and cross below text only at 200 lines in the aggregate. A targeted audit also reproduces non-monotonic Gemini image accounting across a page boundary. This study measures black-box request accounting for one compact rendering pipeline. It does not measure semantic fidelity, task accuracy, latency, monetary cost, or coding-agent efficiency. We release the scripts, revision-pinned corpus specification, raw usage records, validators, and deterministic analysis needed to reproduce and extend the study.

cs.LG [Back]

[46] Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning cs.LG | cs.CL | cs.DCPDF

Jian Hu, Huiying Li, Hao Zhang, Binfeng Xu, Yifan Zhang

TL;DR: Molt是一个专为智能体强化学习设计的可扩展PyTorch原生训练框架，旨在降低算法迭代成本。它通过简洁的代码库支持端到端算法流程修改，并能在异步训练中保持多模态和专家混合策略的一致性。

Details

Motivation: 现有主流框架中，智能体强化学习的算法修改需穿透多层训练器、分布式后端和交互逻辑，导致研究人员迭代成本高昂。

Result: 在完全异步协议下，Molt与基于Megatron的先进框架在统计性能上相当，达到了SOTA水平。

Insight: 框架设计强调代码简洁性和可读性，使AI编码助手能整体理解，便于端到端追踪和修改；采用单一异步循环统一训练流程，确保生成数据、策略版本和模型语义的一致性。

Abstract: Agentic reinforcement learning research is constant algorithm modification, new estimators, new pipeline stages, new rollout schemes, and in mainstream frameworks each change threads through layers of trainer, distributed backend, and rollout glue: the cost lands on the researcher at every iteration. Molt is a PyTorch-native training framework built to keep that cost small: a codebase compact and clean enough for a researcher to hold in their head, and for an AI coding assistant to read and reason about in its entirety, so the algorithm flow can be traced and changed end to end. The agent is an ordinary program, and one asynchronous loop trains multimodal and mixture-of-experts policies while never training on a token it did not generate, consistent in tokens, policy versions, and model semantics. Leanness does not cost performance: under a matched, fully asynchronous protocol, Molt is statistically comparable to a state-of-the-art Megatron-based stack. Molt is open source and provides recipes and containers at https://github.com/NVIDIA-NeMo/labs-molt.

[47] LeAct: Learning to Reason from Expert Actions cs.LG | cs.AI | cs.CLPDF

Ziran Yang, Chengshuai Shi, Raj Ghugare, Benjamin Eysenbach, Karthik Narasimhan

TL;DR: LeAct（从专家动作中学习推理）提出了一种从专家系统（如游戏引擎、规划器）的沉默动作中恢复其背后思维链（CoT）作为自然语言推理的方法。该方法将CoT视为隐变量，通过优化使学生模型能从专家动作中采样候选推理链，并保留那些能提高自身预测动作概率的链。在多个不完全信息游戏和机器人仿真基准测试中，LeAct在可枚举小游戏上达到求解器性能极限，在大规模场景下显著优于基线，证明了专家系统可作为基础模型的新型推理知识来源。

Details

Motivation: 当前推理模型依赖人工标注或从更强LLM蒸馏的数据，而专家系统（如游戏引擎、规划器）能产生近乎最优的动作，但其背后的推理过程（思维链）是沉默的。恢复这些隐式的推理链，可以将其知识蒸馏到学生模型中，实现超越演示动作的泛化。

Result: 在多个不完全信息游戏（包括小规模可枚举游戏和大规模Flop Hold’em，约10^9信息集）以及模拟机器人基准测试上，LeAct在小游戏上达到求解器数值下限；在大规模Flop Hold’em上以+60 mbb/g优势胜出，比最强的专家迭代基线接近求解器5倍；在机器人探测任务中是唯一超越直接模仿的训练方法。

Insight: 创新点在于将专家动作背后的思维链视为隐变量进行优化学习，通过学生模型采样并筛选能提升自身动作预测概率的推理链，从而从沉默的专家动作中蒸馏出可泛化的自然语言推理知识。这为利用专家系统作为基础模型的推理教师提供了原则性框架。

Abstract: Modern reasoning models depend on reasoning data, today sourced from human annotations or distilled from stronger LLMs. However, a rich and largely untapped source of supervision lies in expert systems (e.g., game engines, classical planners, theorem provers), which routinely produce near-optimal actions across diverse domains. But these experts are silent: they commit to an action without writing down the chain of thought (CoT) behind it. Recovering that CoT as natural-language reasoning would distill expert knowledge into a student that generalizes beyond the demonstrated actions. We treat it as a latent variable and study how to recover it from the action alone. Our approach, LeAct (Learning to reason from Actions), optimizes this latent variable: the student samples candidate CoTs for each expert action, and we retain those that measurably improve its own probability of recovering the action. Across imperfect-information games at multiple scales and a simulated robotics benchmark, LeAct reaches the solver’s numerical floor on small enumerable games. At larger scale, it is $5\times$ closer to the solver than the strongest expert-iteration baseline. At Flop Hold’em ($\sim 10^9$ infosets), LeAct wins head-to-head by $+60$ mbb/g, and on the robotics probe it is the only training recipe that improves on direct imitation. We present a principled framework and the result: expert systems become a categorically new source of reasoning teachers for foundation models.

[48] Teaching LLMs to Self-Evolve: Cultivating Core Meta-Skills with Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Shujin Wu, Cheng Qian, Xiusi Chen, Heng Ji

TL;DR: 这篇论文提出了MetaEvolve框架，旨在通过数据合成、进化感知的强化学习和推理时进化搜索，来培养大型语言模型（LLMs）进行自我进化的核心元技能。该框架在编程领域进行了验证，利用程序执行提供的连续奖励信号来合成进化轨迹作为训练数据，并通过强化学习训练模型。实验表明，该方法在多个编程基准测试和开放领域算法优化问题上取得了显著性能提升。

Details

Motivation: 论文的动机是解决传统后训练方法忽视模型自我进化元技能（如基于环境反馈的自我反思）的问题。作者认为，像AlphaEvolve这样的测试时迭代自我进化框架的成功依赖于这些元技能，而MetaEvolve旨在填补这一空白，通过强化学习系统地培养这些技能。

Result: 在七个编程基准测试中，MetaEvolve在分布内任务上比最强基线绝对提升了10.01%，在分布外任务上提升了24.12%。在完全超出训练领域的开放算法优化问题上，它进一步实现了46.9%的相对改进。

Insight: 论文的创新点在于明确提出了通过强化学习培养LLMs自我进化元技能的框架，并利用程序执行产生的可验证奖励信号来合成训练数据。从客观角度看，其将进化过程本身作为可学习的技能，并强调其在缺乏丰富训练信号的开放问题上的可迁移性，是一个有前景的研究方向。

Abstract: Test-time scaling through iterative self-evolution with environment feedback, as demonstrated by AlphaEvolve, shows remarkable performance gains. We hypothesize that the success of such evolution frameworks hinges on meta-skills, such as self-reflection with environment feedback, that enable effective multi-round refinement, yet are largely neglected by traditional post-training. To bridge this gap, we present MetaEvolve, a framework designed to develop these meta-skills via a data synthesis pipeline, evolution-aware reinforcement learning (RL), and inference-time evolutionary search. Concretely, we ground MetaEvolve in coding, where program execution provides natural, continuous reward signals beyond binary correctness. Building on these signals, we synthesize evolution trajectories as training data, each containing a current program, its fitness score (combining correctness and efficiency), and a history of prior attempts, and train the model via RL with verifiable rewards derived from test case execution. By training on large-scale code data, we aim to inspire generalizable domain-agnostic meta-skills that can transfer broadly to open-ended problems where such rich training signals are scarce. Across seven coding benchmarks, MetaEvolve outperforms the strongest baseline by 10.01% absolute on in-distribution tasks and 24.12% on out-of-distribution tasks. On open-ended algorithm optimization problems entirely outside the training domain, it further achieves a 46.9% relative improvement. These results demonstrate that explicitly cultivating self-evolution meta-skills offers a principled path toward more capable and autonomously self-evolving AI.

[49] Physiological Signals as a Forensic Modality for Talking-Face Deepfake Detection cs.LG | cs.CR | cs.CV | cs.MMPDF

Othmane Harraq, Tamer Aldwairi

TL;DR: 本文提出了一种利用生理信号（特别是远程光电容积描记术rPPG）作为法医模态来检测说话人脸（Talking-Face）深度伪造视频的方法。该方法通过RhythmFormer提取视频中的rPPG波形，并使用轻量级分类器区分真实与合成的生理信号。在Celeb-DF++数据集的TF子集上，该方法在严格的主体无关协议下取得了有竞争力的检测性能，并揭示了检测难度高度依赖于生成方法的内在生理特性。

Details

Motivation: 针对现有基于图像的检测器难以识别由静态图像和音频合成的逼真说话人脸（TF）深度伪造视频的问题，本文的动机是利用TF伪造视频缺乏真实生理信号（如心跳）这一固有缺陷，将rPPG信号作为一种独特的检测模态。

Result: 在Celeb-DF++数据集的TF子集上，采用严格的主体无关协议进行评估，所提出的1D ResNet分类器取得了AUC 0.806和EER 27.8%的结果，与当前最佳通用检测器（Effort, ICML 2025）的差距在2.4个百分点以内。同时，研究复现了先前的rPPG检测器DeepFakesON-Phys，发现其在TF数据上的性能（AUC 0.622）远低于其在传统换脸数据上的性能（AUC 0.999）。

Insight: 核心创新点在于将生理信号（rPPG）确立为检测说话人脸深度伪造的一个独特且有效的法医模态。一个关键的洞察是，不同TF生成器产生的伪造视频，其检测难度（AUC从0.985到0.690不等）与生成方法本身可解释的生理特性强相关，这构成了本工作的主要理论贡献，并为理解不同伪造技术的缺陷提供了新视角。

Abstract: Talking-face (TF) deepfake generation synthesizes photore- alistic facial video from a static source image and an au- dio signal, producing forgeries that current image-based detectors consistently fail to identify. Unlike face-swap ma- nipulation, TF synthesis has no underlying real video from which to inherit physiological characteristics, making re- mote photoplethysmography (rPPG) a uniquely motivated detection modality for this forgery category. We propose a detection framework that extracts per-video rPPG wave- forms via RhythmFormer and trains a suite of lightweight classifiers to distinguish real from synthesized physiologi- cal signals. Evaluated on the TF subset of Celeb-DF++ un- der a strict subject-independent protocol, where test identi- ties are completely separated from training identities, our 1D ResNet achieves an AUC of 0.806 and EER of 27.8%, placing it within 2.4 points of the best published general- purpose detector (Effort, ICML 2025) while operating ex- clusively on the physiological channel. We document a con- trolled reproduction study of DeepFakesON-Phys, the rep- resentative prior rPPG detector, demonstrating degrada- tion from AUC 0.999 on legacy face-swap data to 0.622 on the TF subset of Celeb-DF++. We further show that detec- tion difficulty is strongly method-dependent: AUC ranges from 0.985 (Real3DPortrait) to 0.690 (IP-LAP) across the seven TF generators, with the ranking remaining perfectly stable across all evaluation protocols. This spread reflects an interpretable physiological property of each generator rather than evaluation noise, and constitutes the primary theoretical contribution of the work.

cs.AI [Back]

[50] The Hard Decision Layer: Evidence for Committed Inference in Transformers cs.AI | cs.CLPDF

Ashwath Vaithinathan Aravindan, Mayank Kejriwal

TL;DR: 本文研究了基于Transformer的语言模型在多选题推理过程中何时及如何做出预测决策，发现了’硬决策层’（HDL）这一自然架构特性，即答案选项的排名在推理过程中会突然稳定。通过四个语言模型和四个基准数据集的实证验证，表明HDL的出现具有一致性且不受微调影响，并在该层观察到显著的准确率提升。

Details

Motivation: 动机在于探究Transformer语言模型在推理时何时’承诺’其预测，即确定答案选项的排名何时稳定，以深入理解模型的内部决策机制。

Result: 在四个模型（Qwen、Llama、Granite、Mistral）和四个基准数据集（如CommonsenseQA）上的实验表明，HDL普遍存在，且在HDL处准确率显著提升（例如Qwen在CommonsenseQA上提升高达+0.61），之后性能趋于稳定。系统消融实验证实该现象是模型架构固有的。

Insight: 创新点在于识别出Transformer架构中固有的’硬决策层’，为模型推理提供了机制性解释；这一发现无需学习路由策略，且对微调保持不变，为高效推理和模型引导提供了新机会。

Abstract: We investigate where and how transformer-based language models commit to predictions in multiple-choice question answering. We identify the Hard Decision Layer (HDL), a natural architectural property where answer option rankings stabilize abruptly during inference. Empirical validation across four language models (Qwen, Llama, Granite, Mistral) and four benchmark datasets demonstrates consistent HDL emergence without learned routing policies. We also show that the HDL is invariant to fine-tuning. Our results reveal striking accuracy improvements at the HDL: up to +0.61 (Qwen on CommonsenseQA), after which performance stabilizes. Systematic ablations on label formats and problem complexity confirm the phenomenon is fundamental to model architecture. These findings offer mechanistic insights into transformer inference and suggest opportunities for efficient reasoning and model steering. All code and results required to reproduce this work are available in https://github.com/Mystic-Slice/hard-decision-layer

[51] Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models cs.AI | cs.CLPDF

Gwang Gook Lee, Kenan Emir Ak, Jay Mohta, Yan Xu, Dimitrios Dimitriadis

TL;DR: 本文研究了视觉语言模型在文档理解任务中作为转录工具的忠实性问题，发现当文本存在瑕疵时，VLMs倾向于将其重写为更合理的形式，而非忠实转录。为此，作者构建了多语言扰动基准FaithC4，并评估了15个系统，发现通用VLMs在扰动下性能下降最显著。通过逐层分析模型，揭示了重写行为与词长及最终层FFN表示与原始编码的接近程度有关。

Details

Motivation: 当前VLMs被越来越多地用于替代传统OCR进行文档理解，但其在文本不完美时是否作为忠实转录器尚不清楚。现有基于干净文本的OCR基准无法检测其重写行为，因此需要新的评估方法来量化这种不忠实性。

Result: 在提出的FaithC4基准（包含英语、中文、韩语）上评估了15个系统。结果表明，在扰动下，通用VLMs的词错误率下降高达4.5个百分点，OCR专用VLMs下降0.2-2个百分点，而传统OCR下降小于0.6个百分点（英语）。短词（4-6字符）的重写率高达10%，而超过8字符后重写率降至0%。

Insight: 论文的核心创新在于揭示了VLMs在文档转录中的系统性重写行为，并构建了专门用于评估转录忠实性的扰动基准。从客观角度看，其通过逐层分析（如对Qwen3-VL-4B）发现的重写触发机制（即最终层FFN表示与原始编码的接近性）以及词长效应，为理解VLMs的内部工作机制提供了有价值的洞见。

Abstract: Vision Language Models (VLMs) are increasingly used in place of traditional OCR pipelines for document understanding. In this paper, we show they do not always act as faithful transcribers: when text is imperfect, they often tend to rewrite it into a more plausible form - a behavior that clean-text OCR benchmarks cannot detect. We introduce FaithC4, a multilingual perturbation benchmark of 1,455 single-page documents (English, Chinese, Korean) with three perturbation families: scramble, random substitution, and visually similar substitution. We use the benchmark to evaluate 15 systems spanning general-purpose VLMs, OCR-specialized VLMs, and traditional OCR pipelines. These three categories differ in WER degradation under perturbation: general-purpose VLMs degrade by up to 4.5 points, OCR-specialized VLMs by 0.2-2 points, and traditional OCR by less than 0.6 points on English. Probing Qwen3-VL-4B layer-by-layer, we identify a consistent pattern: rewriting fires only when a perturbed word’s final layer FFN representation stays close to the original encoding; when the representation diverges sufficiently, the model transcribes faithfully. Word length affects rewriting rate: short words (4-6 characters) are rewritten up to 10% of the time, with a sharp cutoff at 8 characters above which rewriting drops to 0%.

[52] Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode cs.AI | cs.CLPDF

Nanbeige Lab, :, Chen Yang, Chengrui Huang, Fufeng Lan

TL;DR: 本文介绍了Nanbeige4.2-3B，一个具有30亿非嵌入参数的紧凑型通用智能体模型。它通过在28000亿token上从头预训练，采用循环Transformer结构重用层堆栈以在不增加参数的情况下提升能力。模型在代码智能体、办公智能体和复杂工具使用任务上表现出色，同时在数学、编码和科学推理任务上保持竞争力。

Details

Motivation: 旨在开发一个参数规模紧凑但具备强大智能体能力的通用模型，以解决在资源受限环境下部署高性能智能体的需求。

Result: 广泛的评估表明，Nanbeige4.2-3B在多种智能体基准测试中超越了包括Qwen3.5-9B和Gemma4-12B在内的更大模型，同时在推理和对齐任务上保持竞争力。与OpenClaw结合的性能进一步支持其作为紧凑型本地个人助理的用途。

Insight: 主要创新点包括：1）采用循环Transformer（Looped Transformer）重用层堆栈来高效扩展模型容量；2）通过真实部署和大规模合成来扩展SFT数据和轨迹构建的多样性；3）应用混合模式的RLHF（针对思考与非思考响应）、长度控制的推理RL以及结合结果与过程奖励的智能体RL，以提升模型质量、平衡准确性与效率，并稳定长程训练。

Abstract: We present Nanbeige4.2-3B, a compact general agentic model with 3B non-embedding parameters. It delivers strong performance across code-agent, office-agent, and complex tool-use tasks while maintaining highly competitive reasoning capabilities in mathematics, coding, and science. Nanbeige4.2-3B is pretrained from scratch on 28T tokens with a Looped Transformer that reuses the layer stack to increase capacity without adding parameters. For SFT data and trajectory construction, we expand the diversity of executable environments, task assets, and agentic scaffolds through real-world deployment and large-scale synthesis. Our RL pipeline applies mixed-mode RLHF over Think and Non-Think responses to improve overall model quality and reduce failure cases, length-controlled reasoning RL to balance accuracy and reasoning efficiency, and agentic RL with outcome and process rewards to stabilize long-horizon training. Extensive evaluations show that Nanbeige4.2-3B outperforms larger models, including Qwen3.5-9B and Gemma4-12B, across diverse agentic benchmarks while remaining competitive on reasoning and alignment tasks. Performance with OpenClaw further supports its use as a compact local personal assistant.

[53] Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents cs.AI | cs.CL | cs.CV | cs.ROPDF

Suman Navaratnarajah, Taehyoung Kim, Jona Ruthardt, Ishaan Bhimwal, Ryousuke Yamada

TL;DR: 本文介绍了MissionBench，一个用于评估多模态大语言模型（MLLMs）在航空3D环境中执行任务级、长视野具身任务能力的基准测试。该基准包含120个任务，涵盖5个模拟环境和4个任务类型，要求智能体仅依赖自我中心观测和动作历史进行自主规划、导航和报告。在评估22个开源和闭源MLLMs后，发现最强模型成功率低于35%，远低于人类84.4%的表现，揭示了多步骤具身任务的挑战性。

Details

Motivation: 当前尚不清楚通用多模态大语言模型（MLLMs）在仅接收单一高级指令的情况下，解决长视野具身任务的能力如何。本文旨在通过构建一个任务级基准来量化评估MLLMs在复杂航空3D环境中的零样本具身智能水平。

Result: 在MissionBench基准测试中，最强的MLLM模型成功率低于35%，而人类表现达到84.4%，显示出巨大差距。研究观察到模型规模扩大能带来性能提升，表明更大的通用模型具备更强的零样本具身能力。

Insight: 论文的创新点在于提出了首个专注于航空3D环境、任务级、零样本评估的基准MissionBench，强调了对MLLMs进行闭环评估的重要性。客观分析认为，其核心洞察是：任务级能力不仅需要空间感知，更需要多步骤规划和自适应推理等多能力的协调，这为基于规模扩展的具身AI发展指明了前景与风险。

Abstract: Multimodal Large Language Models (MLLMs) are emerging as core reasoning modules for embodied agents, yet it remains unclear how well general-purpose models can solve long-horizon embodied tasks from a single high-level instruction. We introduce MissionBench, a benchmark for mission-level evaluation of MLLMs in aerial 3D environments. It comprises 120 missions across five simulated 3D environments and four task families. Agents must autonomously plan, navigate, and report outcomes using only egocentric observations and its action history, without aerial-specific fine-tuning. Across 22 open- and closed-source MLLMs, the strongest model succeeds on fewer than 35% of missions compared to 84.4% human performance, highlighting the difficulty of multi-step embodied tasks. Despite large variations between model families, we observe gains from scaling, indicating that larger general-purpose models possess stronger zero-shot embodied capabilities. Our analysis shows that mission-level competence requires coordinating multiple capabilities beyond spatial perception, including multi-step planning and adaptive reasoning. This motivates closed-loop evaluation and highlights both the promise and risk of scaling-driven improvements for embodied AI.

[54] SceneActBench: Can Agents Act on the 3D Scenes They See? cs.AI | cs.CVPDF

Yifei Zhao, Xiangxin Zhou, Wenhao Yang, Jiaqi Tang, Pu Jian

TL;DR: 本文提出了SceneActBench，一个用于评估视觉语言模型（VLM）智能体在3D场景中执行动作能力的基准测试。该基准包含五个3D任务，通过统一的智能体-环境循环进行评估，使用几何指标衡量最终输出。在11个专有VLM配置上的实验表明，所有模型得分在38.6到50.2之间，且没有模型在所有任务上表现一致良好。

Details

Motivation: 现有3D基准主要评估文本响应或单对象操作，缺乏对智能体在完整多对象3D场景中执行动作的综合评估，因此需要一个新的基准来填补这一空白。

Result: 在SceneActBench的五个任务上，测试的11个专有VLM配置的总体得分范围为38.6到50.2，没有模型能在所有任务中表现一致良好。

Insight: 创新点在于构建了一个统一的智能体-环境循环框架来评估多任务3D场景动作执行，并使用任务特定的几何指标进行客观评估，这为评估VLM智能体的3D交互能力提供了更全面的基准。

Abstract: Vision-language model (VLM) agents increasingly use tools to act on 3D scenes rather than only describe them. Existing 3D benchmarks score textual responses or single-object operations, leaving agent action on complete multi-object 3D scenes under evaluated. We present SceneActBench, a benchmark for visually conditioned action across five 3D tasks under a unified agent-environment loop. Given PNG images or sampled video frames and, where applicable, supplied 3D assets, an agent acts on a 3D environment. We evaluate each final output against hidden ground truth with task-specific geometric metrics. SceneActBench comprises five tasks built from 210 source instances, yielding 520 task cases including paired input conditions. Every task runs through one fixed agent loop to keep the comparison fair. Across eleven proprietary VLM configurations, Overall scores span 38.6-50.2, and none performs consistently well across tasks. We further analyse where and how failures manifest.

cs.MM [Back]

[55] CARA: Concept-Aware Risk Attention for Interpretable Collision Anticipation cs.MM | cs.CVPDF

Zhishan Tao, Ruoyu Wang, Yucheng Wu, Enjun Du, Yilei Yuan

TL;DR: 该论文提出了CARA（概念感知风险注意力）框架，用于自动驾驶中的碰撞预测。该框架通过从事故叙述中提取领域相关的风险概念，利用视觉-语言相似性将其与视频帧对齐，并组织成动态演化的概念轨迹，从而提供可解释的风险证据来指导空间注意力、时间注意力和预测。

Details

Motivation: 现有碰撞预测方法在可解释性方面存在不足：特征驱动模型不透明，事后解释缺乏保真度，而基于概念的方法多针对静态识别而非动态驾驶场景。因此，需要一种能够提供可解释推理、跟踪风险因素及其随时间演化的方法。

Result: 在三个基准测试上的广泛实验表明，CARA在预测准确性和预警提前性方面持续优于强基线方法，同时提供了稀疏且语义基础的概念证据。

Insight: 创新点在于将语义风险因素作为动态中间证据而非辅助事后解释，从而将可解释性与预测过程紧密耦合；通过概念轨迹引导注意力机制，使语义概念直接影响模型的空间和时间关注点及风险预测。

Abstract: Collision anticipation in autonomous driving requires not only accurate early warnings but also interpretable reasoning about what risk factors are being tracked and how risk evolves over time. Existing methods fall short in this regard: feature-driven models are opaque, post-hoc explanations often lack fidelity, and concept-based methods are mostly designed for static recognition rather than dynamic driving scenes. We propose CARA (Concept-Aware Risk Attention), an intrinsically interpretable spatio-temporal framework for collision anticipation. CARA derives domain-grounded risk concepts from accident narratives, aligns them with video frames via vision-language similarity, and organizes them into evolving concept trajectories. These trajectories provide explicit risk evidence that guides spatial attention, temporal attention, and anticipation, allowing semantic concepts to directly influence both where the model attends and how it predicts risk over time. By treating semantic risk factors as dynamic intermediate evidence rather than auxiliary post-hoc explanations, CARA tightly couples interpretability with the predictive process. Extensive experiments on three benchmarks show that CARA consistently improves anticipation accuracy and warning earliness over strong baselines, while providing sparse and semantically grounded concept evidence.

cs.RO [Back]

[56] Progress Reward Modeling for Robotic Learning: A Comprehensive Survey cs.RO | cs.CLPDF

Jianshu Zhang, Keliang Wu, Haoran Lu, Anbang Liu, Ce Zhang

TL;DR: 这篇综述论文系统性地梳理了机器人学习中的进度奖励建模领域，旨在为该领域提供一个统一的分析框架。论文将现有研究归纳为三个相互关联的步骤：模型接口（输入输出）、内部构建方法以及数据与基准测试，从而连接了进度模型的定义、构建和验证。

Details

Motivation: 机器人学习在动态环境中进行，仅靠最终的成功信号无法提供执行过程中的反馈，无法判断行为是在取得进展、停滞不前还是倒退。现有研究缺乏统一的框架，导致方法难以比较和评估。

Result: 作为一篇综述性论文，本文并未提出新的模型或报告具体的定量结果，而是对现有方法进行了系统性的分类和梳理，并指出了当前方法的局限性和未来的研究方向。

Insight: 论文的核心创新在于提出了一个从模型接口、内部方法到数据基准的三步统一分析框架，为理解和比较纷繁复杂的进度奖励建模方法提供了清晰的脉络。这有助于研究者明确不同方法的核心假设、验证内容和适用范围。

Abstract: Robotic learning takes place in dynamic environments with large behavior spaces. A terminal success signal only tells the robot whether the task is completed. It does not explain whether the current behavior is making progress, remaining unchanged, or undoing earlier progress. For this reason, recent studies have increasingly explored progress rewards that provide feedback during task execution. However, the current literature lacks a shared framework. Existing methods use different observations, goal specifications, output signals, supervision sources, and evaluation protocols. This makes it difficult to compare them and understand what their results actually validate. In this survey, we provide a unified view of progress reward modeling for robotic learning. We organize the field in three connected steps. We first study the interface of a progress model. This defines the problem from the outside by asking what information the model receives and what form of progress signal it produces. We then move inside the model and study the methods used to construct this signal. This reveals the different assumptions and mechanisms behind progress estimation and reward generation. Finally, we examine the data and benchmarks that support these methods. This shows how progress supervision is obtained and what different evaluations actually measure. Together, these three perspectives connect what a progress model is, how it is built, and how its quality is validated. We further summarize the main limitations of current approaches and discuss future research directions.

[57] Robot-Factored World Models via Robot Rendering cs.RO | cs.CVPDF

Byungjun Kim, Taeksoo Kim, Hyunsoo Cha, Hanbyul Joo

TL;DR: 本文提出了一种名为‘机器人因子化世界模型’的新方法，用于机器人操作中的视频世界建模。该方法通过将动作命令转换为机器人名义轨迹并渲染机器人几何体，将机器人特定的动作实现和几何外观从世界模型中分离出来，从而构建一个共享的视觉接口。实验表明，该方法在性能上优于基线模型，并能泛化到未见过的机器人形态，甚至能从人类演示中生成机器人操作视频。

Details

Motivation: 现有动作条件视频世界模型在机器人领域面临挑战：直接以动作命令为条件要求模型学习机器人自身的动作实现过程，而以记录的未来状态为条件则会泄露本应预测的交互结果。本文旨在解决这一问题，将机器人特定的因素（如动作实现和几何渲染）从世界模型中分离，使模型专注于学习场景对机器人动作的响应。

Result: 实验表明，所提出的渲染接口方法在性能上优于基于向量条件的基线模型。该方法能够泛化到推理时未见过的机器人形态（embodiments），并在机器人操作视频生成任务上展示了有效性，例如通过将人手运动重定向并渲染为机器人几何体来生成机器人操作视频。

Insight: 核心创新点在于将机器人动作实现（通过控制器和运动学生成名义轨迹）和机器人渲染（通过URDF渲染几何体）从世界模型中因子化（factored out），形成了一个共享的、与视角和机器人形态无关的视觉接口。这避免了模型学习机器人内部动力学，并提供了明确的几何线索（如深度配对）来处理接触和遮挡，使模型能更专注于学习物体对可见机器人几何体的响应规律。

Abstract: Action-conditioned video world models predict future observations from an initial observation and an action signal. In robotics, actions influence future observations through two distinct processes: they are first realized into robot motion by the robot body and controller, and the scene then responds through contact and object motion. Conditioning directly on action commands asks the world model to learn the realization process itself, while conditioning on logged future states leaks the interaction outcomes it is meant to predict. We propose robot-factored world models, which move two robot-specific factors outside the world model. First, action realization: each command is rolled through the robot’s own controller and kinematics into a deployment-available nominal trajectory, a middle signal that avoids both action-realization learning and future-state leakage. Second, robot rendering: this nominal trajectory is rendered through the robot URDF, factoring the robot’s geometry, kinematics, and appearance out of the model and into explicit rendered robot geometry. To resolve depth ambiguity, we pair end-effector depth with scene depth, giving geometric cues for contact and occlusion beyond image-plane overlap. Together, camera-aware static RGB/depth context and rendered robot geometry form a shared visual world-model interface that stays consistent across viewpoints and robot embodiments, so the model sees the action only as visible robot geometry and learns how objects respond to it. Our experiments show that the rendered interface outperforms vector-conditioned baselines and generalizes to unseen robot embodiments at inference. We further demonstrate that our model generates robot manipulation videos from human demonstrations by retargeting and rendering the hand motion as robot geometry.

Table of Contents

cs.CL [Back]

[1] Adversarial Style Optimization: Enhancing VLM Jailbreaks by GRPO-based Stylistic Triggers Optimization cs.CL | cs.AIPDF

[2] Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms cs.CL | cs.AI | cs.CVPDF

[3] A Consensus-Based Framework for Relative Preference Evaluation of Large Language Models cs.CLPDF

[4] J-CoT: Chain-of-Thought in J-Space cs.CL | cs.AIPDF

[5] Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs cs.CLPDF

[6] Scaling Native Multimodal Pre-Training From Scratch cs.CL | cs.CVPDF

[7] Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination cs.CL | cs.AIPDF

[8] MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond cs.CL | cs.AI | eess.ASPDF

[9] Dynamic Commonsense Coordination for Empathetic Response Generation cs.CLPDF

[10] From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models cs.CL | cs.AIPDF

[11] Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills cs.CLPDF

cs.CV [Back]

[12] Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On cs.CVPDF

[13] Be Consistent! Enhancing Robust Visual Reasoning in LVLMs with Consistency Constraints cs.CVPDF

[14] Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Rendering cs.CVPDF

[15] What Happens to Accuracy When Photo Lineups Contain Non-Mated Rank-One Images From Large Galleries? cs.CVPDF

[16] SCALE: Self-Supervised Constraint-Aware Layout GEneration for Local P&R DRV Fixing at Advanced Nodes cs.CV | cs.AIPDF

[17] Learning Adaptive Semantic Gaussian Allocation for 3D Occupancy cs.CVPDF

[18] Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model cs.CV | eess.SPPDF

[19] TextSLIP: Text Self-Supervised CLIP for Medical Report Generation cs.CV | cs.AIPDF

[20] Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models cs.CVPDF

[21] Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation cs.CVPDF

[22] Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning cs.CV | cs.AIPDF

[23] EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection cs.CV | cs.AIPDF

[24] ReCowGnition: A Realistic Biometric Benchmark for Cow Face Recognition cs.CVPDF

[25] Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era cs.CV | cs.LGPDF

[26] CommandLM: Data driven behavior level descriptor for ego vehicles cs.CVPDF

[27] GLI-AL: A Multi-Modal Glioma MRI Label Resource with Unified Anatomy-Lesion Labels cs.CVPDF

[28] CARDIAG: A Dense Segment Classification Benchmark of Deep Learning Architectures for Coronary Angiography cs.CV | cs.AI | cs.LGPDF

[29] Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation cs.CV | cs.CL | cs.LGPDF

[30] JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervision cs.CV | cs.ROPDF

[31] Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis cs.CVPDF

[32] LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR cs.CVPDF

[33] Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs cs.CV | cs.AIPDF

[34] TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution cs.CV | cs.AIPDF

[35] AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment cs.CVPDF

[36] RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding cs.CVPDF

[37] SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images cs.CVPDF

[38] fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction cs.CVPDF

[39] SiPhy: Single-Image Physical Property Reasoning cs.CV | cs.AIPDF

[40] Active few-shot segmentation by reinforcing data selection cs.CVPDF

[41] Time-Reversed Imaging: A Multimodal Benchmark and Framework for Reconstructing Past Human-Environment Interactions cs.CV | cs.AI | eess.IVPDF

[42] IR275K: A Benchmark for Infrared Multi-Frame Super-Resolution Toward Efficient Remote Sensing cs.CVPDF

[43] SM4RT: Learning Structured Motion Geometry for 4D Reconstruction cs.CV | cs.AI | cs.ROPDF

[44] Twins: Learn to Predict Unified Representations with Focal Loss cs.CVPDF

cs.SE [Back]

[45] Pixels for Programs? A Cross-Provider Case Study of Input-Token Accounting for Source Code as Text and Images cs.SE | cs.AI | cs.CVPDF

cs.LG [Back]

[46] Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning cs.LG | cs.CL | cs.DCPDF

[47] LeAct: Learning to Reason from Expert Actions cs.LG | cs.AI | cs.CLPDF

[48] Teaching LLMs to Self-Evolve: Cultivating Core Meta-Skills with Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

[49] Physiological Signals as a Forensic Modality for Talking-Face Deepfake Detection cs.LG | cs.CR | cs.CV | cs.MMPDF

cs.AI [Back]

[50] The Hard Decision Layer: Evidence for Committed Inference in Transformers cs.AI | cs.CLPDF

[51] Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models cs.AI | cs.CLPDF

[52] Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode cs.AI | cs.CLPDF

[53] Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents cs.AI | cs.CL | cs.CV | cs.ROPDF

[54] SceneActBench: Can Agents Act on the 3D Scenes They See? cs.AI | cs.CVPDF

cs.MM [Back]

[55] CARA: Concept-Aware Risk Attention for Interpretable Collision Anticipation cs.MM | cs.CVPDF

cs.RO [Back]

[56] Progress Reward Modeling for Robotic Learning: A Comprehensive Survey cs.RO | cs.CLPDF

[57] Robot-Factored World Models via Robot Rendering cs.RO | cs.CVPDF