cs.CL [Total: 31]
cs.CV [Total: 64]
cs.DL [Total: 1]
cs.AI [Total: 10]
cs.LG [Total: 5]
cs.RO [Total: 5]
cs.MM [Total: 1]

cs.CL [Back]

[1] On Measuring Semantic Preservation in Legal Ontology Learning cs.CLPDF

Albert Sadowski, Jarosław A. Chudziak

TL;DR: 本文提出了一种评估本体学习过程中语义保留程度的新方法，通过比较大型语言模型在原始文档和结构化表示上的任务性能差异来量化语义损失。该方法在法律合并协议分析领域进行了验证，揭示了语义损失会因推理复杂度和模型-方法组合的不同而产生显著变化。

Details

Motivation: 当前本体学习的评估方法主要关注结构正确性，而无法衡量信息在结构化转换过程中是否保留了其原始含义，这可能导致语义丢失的风险。

Result: 在法律合并协议分析任务中，对六种语言模型和三种本体学习方法进行了测试，结果表明存在系统性的语义损失，且损失程度因推理复杂度和模型-方法的交互作用而有显著差异。

Insight: 创新点在于提出了一个基于LLM任务性能比较的语义保留评估框架，并提供了经验证据表明语义损失高度依赖于模型与方法的配对，这为在法律知识系统中选择最优配置提供了指导。

Abstract: Ontology learning transforms unstructured text into structured representations for automated reasoning. Yet structuring information risks losing it, and current evaluation methodologies cannot detect such loss, focusing on structural correctness while failing to measure whether meaning survives transformation. We propose an evaluation methodology that addresses this: comparing LLM task performance on source documents against performance on transformed representations, with the difference quantifying semantic loss. We demonstrate this approach on legal merger agreement analysis, a domain chosen for its complex language and precise semantic requirements, comparing direct LLM application against three ontology learning methods across six language models. The results reveal systematic semantic loss with significant variation based on reasoning complexity and model-method interactions. Our contributions are: (1) an evaluation framework for measuring semantic preservation in ontology learning, and (2) empirical evidence that semantic loss varies dramatically with model-method pairing, providing guidance for selecting optimal configurations in legal knowledge systems.

[2] LLMs Know the Constraint But Do Not Use It: Activation Bottlenecks in Pragmatic Constraint Reasoning cs.CL | cs.AIPDF

Yubo Li, Ramayya Krishnan, Rema Padman

TL;DR: 本文研究发现，当显性表面线索与隐含可行性约束竞争时，大语言模型（LLMs）常出现失败，但总体准确率混淆了真正的约束推理与保守默认行为。作者将这种区别形式化为条件约束激活问题，并通过诊断发现两种失败模式：约束知识在模型中已编码，但有时未被路由到决策中。

Details

Motivation: 动机是探究LLMs在表面线索与隐含约束竞争时的失败本质，区分其是知识缺失问题还是激活路由问题，以澄清模型在语用约束推理中的真实能力。

Result: 在14个模型上的诊断揭示了两种失败模式；对两个开源权重的探针解码约束的准确率超过88%，但激活修补仅修复其中一种失败模式（提升+6.4 nats），另一种无效（-0.07 nats）。所有提示干预均未能达到修复效果，反而通过单一中介路径（前提提及）加剧了保守偏差。

Insight: 创新点在于将LLMs的约束推理失败归因于激活路由问题而非知识问题，并提出了条件约束激活框架（知识、对称性、路由、修复）进行诊断。客观分析认为，该研究揭示了模型内部知识表征与决策路由之间的脱节，为理解模型推理机制提供了新视角。

Abstract: When a salient surface cue competes with an implicit feasibility constraint, LLMs often fail – but aggregate accuracy conflates genuine constraint inference with conservative defaulting. We formalize the distinction as conditional constraint activation: the constraint is internally encoded (Knowledge) symmetrically across constraint-present and -absent prompts (Symmetry), yet only sometimes routed into the decision (Routing) and repairable by a donor activation (Repair). A quartet diagnostic over 14 models reveals two failure modes; probes on two open weights decode the constraint above $88%$, yet activation patching repairs one ($+6.4$ nats) and not the other ($-0.07$). On a mitigation frontier, no prompted intervention reaches the repair corner: all inflate conservative bias through a single mediation pathway – prerequisite mention. Hidden-constraint failure is a routing problem, not a knowledge problem.

[3] What Drives LLM Self-Reflection? A Controlled Ablation of Uncertainty Routing in Armed Conflict Forecasting cs.CL | cs.AIPDF

Poli Nemkova, Haeshitha Indukuri

TL;DR: 这篇论文通过一个受控的六条件消融实验，研究了驱动大语言模型自我反思能力提升的关键组件。实验在武装冲突预测任务中，隔离了证据暴露、诊断支架、分类词汇和行动路由四个组件。研究发现，结构化诊断问题和完整的分类词汇并未带来显著增益，而类型化的行动路由是驱动性能提升的核心机制。

Details

Motivation: 自我反思被广泛认为能提升LLM的推理能力，但具体是哪个组件驱动了这种增益尚不清楚。本研究旨在通过受控消融实验，分离并识别LLM自我反思中真正有效的核心机制。

Result: 在武装冲突预测基准上，类型化行动路由带来了显著增益（F1从0.296提升至0.379），而结构化诊断问题和分类词汇均无显著贡献（F1变化不显著，p值分别为1.000和0.773）。该机制在GPT-4o上得到复现，尤其在缅甸和乌克兰等结构新颖的冲突案例中效果显著。

Insight: 核心创新点在于通过精细的受控消融实验，明确了类型化行动路由是LLM自我反思中有效的设计原则，而非之前可能被高估的诊断支架或分类词汇。这为构建具有元认知能力的LLM预测智能体提供了关键的设计指导。

Abstract: Self-reflection is widely assumed to improve LLM reasoning, yet which component drives the gain remains poorly understood. We present a controlled six-condition ablation isolating four components of LLM self-reflection: evidence exposure, diagnostic scaffolding, taxonomy vocabulary, and action routing. Two precise null results converge on a single mechanism. First, structured diagnostic questions add no measurable value over unstructured reflection ($\text{F1} = 0.296$ vs $0.297$, $p = 1.000$, 95% CI $[-0.041, +0.040]$). Second, presenting the full uncertainty taxonomy while collapsing the action space to a single generic action also adds no value ($Δ\text{F1} = +0.008$, overlapping 95% CIs), ruling out taxonomy vocabulary as the mechanism. Typed action routing provides consistent directional gains ($\text{F1} = 0.379$ vs $0.296$); the conservative estimate controlling for taxonomy vocabulary is $Δ\text{F1} = +0.075$, and the overall gain over the single-shot baseline is significant by bootstrap CI ($Δ\text{F1} = +0.101$, 95% CI $[+0.020, +0.185]$). The vocabulary-routing decomposition replicates on GPT-4o: taxonomy vocabulary adds no significant value over generic reflection ($p = 0.773$), while action routing provides significant gains ($p = 0.025$), confirming the mechanism holds across backbones. Gains concentrate on structurally novel conflicts: in Myanmar ($\text{F1}: 0.000 \rightarrow 0.353$) and Ukraine ($0.167 \rightarrow 0.500$), the vocabulary-only condition recovers no more than generic reflection while action routing breaks the degenerate prior. These findings identify typed action routing – not diagnostic scaffolding or taxonomy vocabulary – as a promising design principle for metacognitive LLM forecasting agents, while motivating larger-scale evaluation across conflict typologies.

[4] Thought-Aware KV Cache Compaction for Reasoning via Adaptive Attention Matching cs.CL | cs.AIPDF

Yang Liu, Bin Chong, Chongyang Zhang, Hao Zheng, Jiayu Liang

TL;DR: 本文提出了一种名为Thought-Aware Attention Matching (TAM)的方法，用于压缩推理语言模型在生成思维链（CoT）时产生的线性增长的KV缓存。该方法通过将推理轨迹分割为块、根据重要性自适应分配压缩预算以及保护关键注意力锚点，有效利用了CoT的层次结构。实验表明，在相同内存占用下，TAM比均匀压缩方法提升了准确性，并能显著降低峰值内存。

Details

Motivation: 现有的KV缓存压缩方法将推理轨迹视为平坦的token序列并进行均匀压缩，忽略了思维链推理中不同步骤重要性差异巨大的层次结构，这导致了内存瓶颈和潜在的性能损失。

Result: 在AIME 2024和MATH-500基准测试上使用Qwen3-4B模型进行实验，TAM在相同内存占用下比均匀压缩方法提高了准确性。通过周期性压缩，峰值内存被限制在3.1-3.2 GB（减少了65%），同时保持了有竞争力的准确率。

Insight: 论文的创新点在于首次明确利用思维链的层次结构进行KV缓存压缩，提出了思想分割、自适应预算分配和关键token保护三个机制。从客观角度看，其将压缩问题形式化并证明了分配规则的最优性和误差有界性，为结构化推理的优化提供了理论依据和实用框架。

Abstract: Reasoning language models generate lengthy chain-of-thought (CoT) sequences whose key-value (KV) cache grows linearly and becomes a memory bottleneck during decoding. Existing compaction methods treat reasoning trajectories as flat token sequences and apply uniform compression, ignoring the hierarchical structure of CoT reasoning where different steps vary drastically in importance. We propose \textbf{Thought-Aware Attention Matching (TAM)}, which exploits this structure through three mechanisms: (i)~~thought segmentation that decomposes the trajectory into reasoning blocks, (ii)~~adaptive budget allocation that assigns compression budget based on each segment’s importance and size, and (iii)~pivotal token protection that preserves high-attention reasoning anchors. We prove that the allocation rule is optimal under a convex error model and that cumulative error under sequential compaction remains bounded. Experiments on AIME 2024 and MATH-500 with Qwen3-4B show that TAM improves accuracy over uniform compaction at the same memory footprint, with periodic compaction bounding peak memory to 3.1–3.2,GB (a 65% reduction) while maintaining competitive accuracy.

[5] Vision-Language Models are Fragile Multilingual Associators cs.CL | cs.AI | cs.CVPDF

Ritabrata Chakraborty, Rajatsubhra Chakraborty, Shivakumara Palaiahnakote, Angelo Cangelosi, Umapada Pal

TL;DR: 该论文研究了视觉语言模型在多语言环境下的概念绑定稳定性，发现模型在跨语系和跨文字的语言切换时会出现显著的绑定崩溃现象，关联质量下降，而相近语言间的绑定保持相对较好。

Details

Motivation: 探索视觉语言模型在多语言输入变化时，其视觉实体与文本属性之间的关联（概念绑定）是否保持稳定，以评估模型在全球多语言部署中的可靠性。

Result: 在M$^2$BIND基准测试中，通过任务性能指标和因果干预进行内外评估，发现跨语系和跨文字设置导致绑定显著崩溃，模型内部绑定计算移至更晚层且因果强度减弱。

Insight: 揭示了视觉语言模型的多语言绑定脆弱性，挑战了单语评估中观察到的关联质量在多语言环境中可维持的假设，强调了需针对多语言场景优化模型设计。

Abstract: Vision-language models must associate visual entities with textual attributes. Whether these associations or concept bindings remain stable when the language of the input changes is unexplored. We introduce M$^2$BIND, a benchmark varying the language of the context and query across multiple languages. We evaluate binding both extrinsically through task performance metrics and intrinsically through causal interventions. We find that binding is not language-invariant: cross-family and cross-script settings trigger significant binding collapse, with the model’s internal binding computation shifting to later layers and losing causal strength. Closely related languages preserve associations comparatively better. In a broader sense, our findings indicate how VLMs deployed globally in multilingual settings cannot be assumed to maintain the same association quality observed in monolingual evaluation.

[6] From Refuse to Richness: Rubric Rewards for Long-Form Hallucination Reinforcement Learning cs.CLPDF

Yudong Wang, Zhe Yang, Wenhan Ma, Rang Li, Qibin Yang

TL;DR: 本文研究了长文本生成中幻觉强化学习的拒绝与丰富度权衡问题，提出使用关键点评分标准（rubric）来定义答案应覆盖的必要和可选信息，并以此作为评估和奖励信号。实验发现，严格的真实性奖励会抑制信息覆盖，而无约束的评分标准奖励则削弱真实性，而结合真实性、评分标准覆盖度和相关性的软组合方法在实验中取得了最佳平衡。

Details

Motivation: 解决长文本生成中，仅惩罚无支持声明的奖励机制可能导致模型回答内容减少（拒绝）与信息丰富度之间的权衡问题，旨在直接定义和评估答案应覆盖的信息。

Result: 在实验中，结合真实性、评分标准覆盖度和相关性的软组合奖励方法，在分布内支持度上有所提升，并且在分布外检查表任务上比仅使用真实性或仅使用评分标准的奖励具有更好的迁移性能。

Insight: 创新点在于引入关键点评分标准来直接定义答案的信息覆盖要求，用于评估和奖励；客观分析认为，该方法为长文本生成的奖励设计提供了一种更结构化、可解释的途径，以平衡真实性与信息完整性。

Abstract: Rewards that penalize unsupported claims can improve grounding in long-form generation, but they can also teach models to answer less. We study this refusal-to-richness trade-off in long-form hallucination RL. Instead of using global richness proxies such as length, claim count, detail, or pairwise relevance, we represent each question with a key-point rubric that specifies the required and optional information a useful answer should cover. These rubrics define coverage directly and are used both for evaluation and as reward signals. Across grounding-only, proxy-based, rubric-only, and combined rewards, we find a stable trade-off: strict grounding rewards improve support but suppress coverage, while unconstrained rubric rewards improve coverage but weaken grounding. A soft combination of grounding, rubric coverage, and relevance gives the best balance in our experiments, improving in-distribution support while transferring better to out-of-distribution checklist tasks than either grounding-only or rubric-only rewards.

[7] SDAM: Structure-Difference-Aware Memory Evolution for Complex Text-to-SQL cs.CLPDF

Keyan Xu, Dingzirui Wang, Xuanliang Zhang, Qingfu Zhu, Wanxiang Che

TL;DR: 本文提出了一种名为SDAM（结构差异感知记忆演化）的方法，用于改进复杂Text-to-SQL任务。SDAM通过结构差异感知推理树识别潜在错误，利用矛盾感知反思提取深层语义规则，并通过基于模式的记忆演化机制增强结构一致性，最终集成到SDAM-SQL框架中。

Details

Motivation: 现有基于记忆的Text-to-SQL代理系统忽视历史经验，存在结构分析弱、语义理解浅和模式对齐差的问题，SDAM旨在解决这些挑战。

Result: 实验表明，SDAM-SQL在BIRD-dev和Spider-test基准上分别比主流Text-to-SQL方法提升了2.0和0.4，证明了其有效性。

Insight: 创新点在于结合结构差异感知推理、矛盾反思和模式绑定的记忆演化机制，以增强对复杂SQL查询的结构分析和语义理解，可借鉴其多层次错误诊断与模式对齐策略。

Abstract: Text-to-SQL aims to convert natural language questions into executable SQL queries. While memory-based agent system improves complex SQL generation, existing memory design neglect historical experience and suffer from weak structure analysis, shallow semantic understanding, and poor schema alignment. To address these challenges, we propose SDAM. Specifically, SDAM identifies potential errors via a structure-difference aware reasoning tree, extracts deep semantic rules through contradiction-aware reflection, and enhances structural consistency using a schema-grounded memory evolution mechanism to bind memory with database schemas. We integrate SDAM into a Text-to-SQL framework named SDAM-SQL. Experiment shows that SDAM-SQL achieves 2.0 and 0.4 improvement on BIRD-dev and Spider-test compared with mainstream Text-to-SQL methods, showing the effectiveness of SDAM-SQL.

[8] Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents cs.CL | cs.LGPDF

Ying He, Zhouhong Gu, Zhecheng Hu, Yubo Zhou, Hao Shen

TL;DR: 本文提出了首个用于金融文档错误检测的公开基准测试FinED-Bench，该基准覆盖三个认知复杂度级别和九种真实金融场景，包含超过900份2025年的未见文档。作者评估了GPT-4o、Qwen3-14B等先进大语言模型在该任务上的表现，发现现有模型在处理高复杂度错误时仍存在困难，但监督微调能显著提升较弱模型的性能。

Details

Motivation: 确保金融文档的准确性对经济分析、监管合规和公司决策至关重要，但目前尚未有研究系统评估大语言模型在识别金融文档错误方面的能力。

Result: 实验结果表明，当前的大语言模型（如GPT-4o、Qwen3-14B）在此任务上表现不佳，尤其是在高复杂度案例中；但监督微调能显著提升较弱模型在该基准上的性能。

Insight: 论文的创新点在于构建了首个专注于金融文档错误检测的多复杂度基准测试FinED-Bench，为评估模型在需要金融领域知识和推理能力的任务上的可靠性提供了标准；客观来看，该工作揭示了当前大语言模型在专业细粒度错误检测任务上的局限性，并证明了领域特定微调的有效性。

Abstract: Ensuring the accuracy of financial documents is critical for economic analysis, regulatory compliance, and corporate decision-making. Several studies have shown that Large Language Models (LLMs) perform well in many financial tasks, such as stock price movements and financial analytics. However, a critical task remains unexplored: the ability of LLMs to identify errors in financial documents. In this paper, we introduce \textbf{FinED-Bench}, the first publicly \textbf{Bench}mark for \textbf{Fin}ancial \textbf{E}rror \textbf{D}etection across three levels of cognitive complexity. FinED-Bench covers nine real-world financial scenarios, and includes over 900 documents reported in 2025 that are unseen by existing language models. We detail the benchmark construction process and evaluate several advanced LLMs (e.g., GPT-4o, Qwen3-14B) on this tasks, which requires both financial domain knowledge and reasoning capabilities. Experimental results show that current LLMs still struggle with this task, especially in high-complexity cases. Besides, supervised fine-tuning can significantly improve the performance of weaker LLMs on this task. Our data and code are available at https://github.com/hedyHe/FinED-Bench.

[9] Large Language Models Pass the History Exam But Miss the <>: A Polish High School Exit Exam Matura Benchmark cs.CLPDF

Adrian Trzoss, Kacper Dudzic, Wiktor Werner, Marcin Moskalewicz

TL;DR: 该论文评估了八个主流大语言模型在波兰高中历史毕业考试（Matura）上的表现，发现所有模型在总分上都远超人类考生，但在不同任务类型、史料模态和地理范围上的能力存在显著差异，尤其不擅长波兰本土历史内容。定性错误分析揭示了模型存在‘史料混淆’和‘时间错位’两种典型失败模式。

Details

Motivation: 当前AI聊天机器人被学生广泛用作知识来源，但现有LLM基准测试很少评估其解释性历史推理能力，因此需要建立一个基于国家课程的真实历史考试基准。

Result: 在2023-2025年三份波兰高中历史毕业考试试卷（包含简答题和论述题）上，所有测试模型的总分均显著优于人类考生群体，但模型排名在不同任务和内容上不稳定。

Insight: 研究创新性地引入了首个基于波兰国家课程的真实历史考试基准，并揭示了LLM在历史推理中‘将史料内容作为推理依据而非分析对象’以及‘时间定位错误’两大系统性缺陷，这对评估和提升模型的历史素养具有重要借鉴意义。

Abstract: AI chatbots are widely used by students as knowledge sources, yet LLM benchmarks rarely assess interpretative historical reasoning. We evaluate eight leading LLMs on the Polish high school exit exams (Matura) in history - three official papers from 2023-2025, comprising short-answer questions and extended essays - comparing model performance against the human examinee population. Every model dramatically outperforms human examinees, yet aggregate scores mask distinct competency profiles: rankings are unstable across task type, source modality, and geographical scope, with a consistent penalty on Polish versus Global history content. Qualitative error analysis reveals two recurring failure modes - source conflation, in which models reason from source content rather than treating it as an object of analysis, and temporal disorientation, in which responses are historically misplaced. This study introduces the first LLM history benchmark grounded in Polish national curriculum.

[10] Predicting consumer-technology ownership without a diffusion history cs.CL | cs.CY | stat.APPDF

Irina Vartanova, Niels Selling, Jennifer Viberg Johansson, Pontus Strimling

TL;DR: 这篇论文研究是否可以通过消费者技术的感知属性来预测其普及程度，而不依赖于扩散历史。作者通过人类和前沿语言模型（Claude Opus 4.7和GPT-5.5）对65项技术进行属性评分，并基于UTAUT2接受属性建立回归模型。结果显示，属性模型相比仅使用上市时间的基线模型，在预测所有权普及率上误差降低了17%，且语言模型评分（尤其是Opus 4.7）表现更优。

Details

Motivation: 动机是探索消费者技术的感知属性（如易用性、实用性等）能否有效预测其所有权普及率，从而在没有完整扩散历史的情况下进行技术采纳预测。

Result: 在2022年的数据上，属性模型将平均绝对误差降低了17%（人类评分），而语言模型评分进一步降低了误差，其中Claude Opus 4.7表现最佳。但在2022-2025年短期窗口内，所有权变化不大，属性模型未能超越无变化基线。

Insight: 创新点在于利用人类和语言模型的属性评分来预测技术所有权，避免了依赖扩散历史；同时揭示了语言模型评分可能反映先验知识而非独立推理，这为技术采纳预测提供了新方法，但也需注意其局限性。

Abstract: We test whether the perceived attributes of a consumer technology predict how widely it is owned. In a 2022 Prolific survey of US adults (n = 678), respondents rated 65 consumer technologies on six attributes. We then elicited the same ratings from two frontier language models, Anthropic Claude Opus 4.7 and OpenAI GPT-5.5. We regress ownership prevalence on four UTAUT2 acceptance attributes plus a log-age covariate with a sign-constrained penalized regression and evaluate it by holding out one technology at a time. The attribute model improves on a baseline of years-since-launch: mean absolute error falls by 17% with the human ratings, and by more with either model, most with Opus 4.7. Over the short 2022-to-2025 window, where ownership moved little, the same attributes do not improve on a no-change baseline. We set out the limitations of the approach, including the possibility that language-model ratings reflect prior knowledge of these technologies rather than independent attribute reasoning. We include a deployment illustration: 2027 ownership predictions for eleven products launched in 2025 and 2026.

[11] Are you Talking Logic to Me? Assessing Language Models Syllogistic Reasoning Capabilities cs.CL | cs.AIPDF

Hanna Abi Akl, Fabien Gandon, Catherine Faron, Pierre Monnin

TL;DR: 本文研究了语言模型在三段论推理任务上的表现，通过扩展FOLIO和P-FOLIO数据集，探讨了不同形式化知识表示（KR）符号对推理能力的影响。实验表明，在监督微调和零样本设置下，选择合适的输入符号可以达到与自然语言相当的性能，同时实现更快的推理速度。作者还提出了三段论分类方法（SEF）并用于增强零样本提示，提升了小模型的推理能力，并开源了Common Logic Grammar Construction（CLGC）框架。

Details

Motivation: 语言模型在逻辑推理任务（如三段论）上表现不佳，而知识表示（KR）在表达输入信息以帮助模型解决任务中起关键作用，这促使研究不同形式化KR符号对三段论推理的影响。

Result: 在FOLIO和P-FOLIO数据集上的实验显示，使用形式化KR符号的输入在小语言模型的监督微调和零样本设置中，性能可与自然语言竞争，且推理速度更快；通过SEF分类方法增强提示后，小模型的推理能力得到提升。

Insight: 创新点包括提出SEF三段论分类方法以结构化逻辑定义并增强零样本提示，以及开源CLGC框架作为首个自动生成KR符号三段论并定义其SEF类别的Python库，这为逻辑推理任务提供了可扩展的工具和评估基准。

Abstract: Language models (LMs) struggle with logical tasks like reasoning on syllogisms. It has been shown that Knowledge Representation (KR) plays a crucial role in expressing input information to help models solve tasks. This observation motivates our study of the impact of different formal KR notations on syllogistic reasoning by extending the FOLIO and P-FOLIO datasets. Our experiments on Small Language Models (SLMs) in Supervised Fine-Tuning (SFT) and Zero-Shot (ZS) settings show that the choice of input notation can yield performances competitive with natural language while enabling faster inference. We also propose a syllogistic categorization method (SEF) and use it to enrich ZS prompts with logical definitions, which boost reasoning in small models. We open-source our framework, Common Logic Grammar Construction (CLGC), as the first Python library for automatically generating syllogisms in KR notations and defining their SEF categories.

[12] LLMs Are Not Good Strategists, Yet Memory-Enhanced Agency Boosts Reasoning cs.CL | cs.AI | cs.MAPDF

Yi Wu, Zhimin Hu

TL;DR: 本文提出EpicStar框架，通过增强记忆机制提升LLM在长时程环境中的战略推理能力。该框架结合历史成功经验库与工作记忆，采用动态门控机制选择执行检索动作或进行新推理，在《星际争霸II》环境中显著优于基线方法。

Details

Motivation: 解决LLM在长时程环境中因注意力资源有限导致的战略漂移问题，即局部决策难以维持跨数千步推理的战略一致性。

Result: 在《星际争霸II》测试平台上，EpicStar对不同对手风格均显著超越基线方法，以少一个数量级的token消耗获得更高胜率，且在不同难度和对手策略下保持稳定优势。

Insight: 创新点在于将结构化跨回合记忆作为策略学习机制，通过动态门控实现历史经验与实时环境的上下文融合，为LLM智能体在动态自主环境中实现鲁棒长时战略执行提供了新范式。

Abstract: Strategic reasoning in Large Language Models (LLMs) within long-horizon environments is often limited by inconsistent subgoals. In these settings, finite attention resources prevent the model from maintaining strategic coherence over thousands of steps. This limitation leads to strategic drift, where localized decisions fail to sustain a coherent trajectory across reasoning. To address this, we introduce EpicStar, a framework that enables agents to learn memory as policy to tackle long-horizon reasoning. Specifically, the agent maintains a bank of successful past episodes as a heuristic alongside a working memory to track short-term environmental changes. During inference, a dynamic gating mechanism determines whether to execute a retrieved action directly or to perform new reasoning through a contextual fusion of the retrieved episodes and current working memory. Utilizing StarCraft II as the testbed, we evaluated EpicStar against diverse opponent styles. It significantly outperforms baseline methods, achieving higher win rates while consuming an order of magnitude fewer tokens, and it maintains this advantage consistently across difficulty levels and opponent strategies. Our findings provide compelling evidence that structured cross-episode memory is essential for enabling LLM agents to perform robust, long-term strategic execution in dynamic, autonomous settings.

[13] Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models cs.CL | cs.AI | cs.LGPDF

Fali Wang, Ali Al-Lawati, Iliyas Bektas, Jinxuan Fang, Alek Melenski

TL;DR: 本文提出了一个名为GraphGym的半自动框架，用于构建复杂图推理基准测试，以评估大语言模型在图推理任务上的能力。该框架通过五个维度扩展基准覆盖范围，并自动生成任务描述、图数据、参考解决方案等，同时保留人工验证环节。基于此框架构建了一个包含202个任务的基准，并在文本、代码和增强推理设置下评估了LLMs，揭示了现有模型的局限性。

Details

Motivation: 现有图推理基准存在数据复杂度覆盖有限、严重依赖人工构建、缺乏文本与代码推理模式统一评估的问题，因此需要一个新的、更全面的基准来系统评估LLMs的复杂图推理能力。

Result: 实验表明，GraphGym的复杂度维度揭示了现有基准中不太明显的模型局限性；现有微调模型难以泛化到该基准，而检索增强方法显示出场景依赖的适应性，能改进文本推理但无法一致改进代码推理。

Insight: 创新点在于提出了一个覆盖五个维度的半自动基准构建框架，能系统生成复杂图推理任务；客观来看，该框架实现了评估的自动化与可扩展性，并为未来增强方法提供了实证指导，是一个具有挑战性和诊断性的基准。

Abstract: Graph reasoning provides a promising testbed for evaluating the reasoning ability of large language models (LLMs), as graph instances can be programmatically generated, structurally controlled, and naturally scaled to long-input settings. However, existing graph reasoning benchmarks have limited coverage of data complexity, rely heavily on manual construction, and lack unified evaluation across text-based and code-based reasoning modes. To address these limitations, we propose {\dataset}, a five-stage \textit{semi-automatic} framework for constructing complex graph reasoning benchmarks. It expands benchmark coverage along five dimensions: \textit{Graph Size}, \textit{Task Complexity}, \textit{Task Description}, \textit{Graph Loading}, and \textit{Task Source}. The framework uses an LLM-based data generator to automatically produce task descriptions, graph data, reference solutions, graph-loading scripts, question forms, and evaluation scripts, while retaining human validation at key quality-control stages. Based on it, we construct a benchmark with $202$ tasks and evaluate LLMs under text-based, code-based, and augmented reasoning settings. Experiments show that the complexity dimensions reveal model limitations that are less visible in existing benchmarks; existing fine-tuned models struggle to generalize to GraphGym, whereas retrieval-augmented methods show scenario-dependent adaptability, improving textual reasoning but not consistently improving coding reasoning. These findings suggest that ours serves as a challenging and diagnostic benchmark for graph reasoning and provides empirical guidance for future enhancement methods. Code and dataset will be published soon.

[14] DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution cs.CLPDF

Siheng Xiong, Ali Payani, Oguzhan Gungordu, Faramarz Fekri

TL;DR: 论文提出了DIVE框架，一种无需更新模型参数即可实现冻结大语言模型自我提升的方法。该方法通过从任务经验和验证器反馈中演化出多样化的自然语言技能，这些技能编码了可复用的推理过程、验证策略、常见失败模式和输出约束，并由同一底层模型执行和修订。

Details

Motivation: 解决大语言模型在部署后无法通过参数更新来保留经验的问题，旨在实现冻结模型的持续自我改进。

Result: 在六个数学和逻辑推理任务以及多个模型系列上，DIVE持续优于现有的推理方法、提示优化方法、技能开发框架和基于记忆的基线方法。它比基于参数的方法（如SFT和GRPO）以及使用GEPA的提示优化方法，能以更少的rollouts获得更大的性能提升，并且演化出的技能可跨模型规模和系列迁移，使小模型（如GPT-5-nano）在常规提示下达到或超越更大模型（如GPT-5）的性能。

Insight: 核心创新点在于通过独立演化多个技能种群、自适应多样化转换和联合选择互补技能集，来缓解自然语言技能演化这一随机非凸搜索过程中的优化方差问题，从而提供了一种有效、可解释且无需参数的LLM自我改进途径。

Abstract: Large language models (LLMs) cannot retain post-deployment experience without parameter updates. We introduce DIVE, a diversity-driven framework that enables frozen LLMs to improve by evolving persistent natural-language skills from task experience and verifier feedback. These skills encode reusable reasoning procedures, verification strategies, common failure modes, and output constraints and are both executed and revised by the same underlying model without access to a teacher model. Since natural-language skill evolution is a stochastic, non-convex search process, optimizing a single skill trajectory can overfit to sampled experience or converge to a suboptimal solution. DIVE mitigates this optimization variance by independently evolving multiple skill populations from bootstrapped experience, adaptively refining them through diverse transformations, and jointly selecting a complementary set of skills. Across six mathematical and logical reasoning tasks and multiple model families, DIVE consistently outperforms existing reasoning methods, prompt-optimization approaches, skill-development frameworks, and memory-based baselines. It achieves rapid self-improvement from accumulated experience, obtaining substantially larger performance gains with fewer rollouts than parameter-based methods such as SFT and GRPO, and prompt optimization with GEPA. Further, the resulting skills transfer across model scales and families, enabling smaller models such as GPT-5-nano to match or outperform larger counterparts, i.e., GPT-5, under conventional prompting. These results establish diversity-driven skill evolution as an effective, interpretable, and parameter-free approach to LLM self-improvement.

Chengyang He, Tahreem Arif, Marko Zivkovic, Lijing Wang, Yue Ning

TL;DR: 论文提出CRAFT框架，利用LLM生成器与基于约束的验证器配对，通过迭代反馈来生成和精炼临床叙述中的症状时间线。该方法在MedTempo基准（包含5,347份COVID-19疫苗不良事件叙述）上评估，显著提升了时间顺序准确性。

Details

Motivation: 临床叙述中症状的时间进展理解对疾病监测至关重要，但现有方法多关注多访视记录中的成对关系分类，而缺乏从锚点稀疏的单个报告中重建结构化症状轨迹的解决方案。

Result: 在MedTempo基准（3,166份专家验证报告）上，使用四种LLM骨干的实验表明，CRAFT一致提高了时间排序准确率，消融分析揭示了生成器和验证器在不同模型能力水平上的贡献。

Insight: 创新点在于结合生成与验证的迭代框架，通过约束反馈精炼时间线；客观分析认为，该方法有效解决了临床叙述中时间锚点稀疏的问题，为症状轨迹重建提供了新思路。

Abstract: Understanding the temporal progression of symptoms in clinical narratives is critical for disease monitoring, safety surveillance, and causality assessment. Clinical narratives, however, rarely provide explicit temporal anchors. Current approaches to temporal information reasoning focus predominantly on pairwise relation classification across multi-visit and timestamp-rich records, leaving the reconstruction of structured symptom trajectories from individual anchor-sparse reports largely unaddressed. We propose CRAFT, an LLM framework that pairs a generator with a constraint-based verifier to iteratively produce and refine stage-wise symptom timelines through targeted feedback. We conduct evaluation on MedTempo, a new benchmark of 5,347 vaccine adverse-event narratives spanning three COVID-19 vaccine types, with expert-validated temporal stage annotations for 3,166 reports. Experiments across four LLM backbones demonstrate that CRAFT consistently improves temporal ordering accuracy, with ablation analysis isolating the contribution of generator and verifier components across model capability levels.

[16] From Atomic Evidence to Logical Composition: Structured Compositional Reasoning over Compound Answer Options cs.CL | cs.AIPDF

Obed Junias, Maria Leonor Pacheco

TL;DR: 该论文针对大语言模型在需要结合逻辑运算符（如AND、OR、NEITHER/NOR）进行复合答案选项推理时的失败问题，提出了一种结构化组合推理框架。该框架将复合选项分解为原子答案，通过对比假设对每个原子进行评分，然后利用算子约束的整数线性规划将校准后的分数组合成单一预测。

Details

Motivation: 大语言模型即使能正确判断单个原子命题，但在需要将原子判断通过显式逻辑运算符组合成复合答案选项时仍经常失败，论文旨在解决这一组合推理的挑战。

Result: 在LOGICAL-COMMONSENSEQA和LOGICAL-SATA基准测试上，该框架将Macro-F1分别从48.3提升至77.0和从47.0提升至75.6，其中在NEITHER/NOR运算符上提升最大。

Insight: 创新点在于将复合逻辑推理问题分解为原子评分和基于约束的组合优化两个阶段，避免了模型直接处理复合结构，从而提升了逻辑组合推理能力；该方法可借鉴于需要结构化推理的NLP任务中。

Abstract: Large language models often fail when answer options require combining atomic judgments under explicit logical operators, even when they judge the individual atoms correctly. We study compound options connected by AND, OR, and NEITHER/NOR, introducing a framework that decomposes each option into atomic answers and scores contrastive hypotheses about each one, so the model never sees a compound option. An operator-constrained integer linear program then composes the calibrated scores into a single prediction. We evaluate on LOGICAL-COMMONSENSEQA and introduce LOGICAL-SATA, a reading-comprehension benchmark derived from SATA-Bench. Our framework improves Macro-F1 from 48.3 to 77.0 on the human-validated LOGICAL-COMMONSENSEQA split and from 47.0 to 75.6 on LOGICAL-SATA, with the largest gains on NEITHER/NOR.

[17] Falsehood and Impossibility Are Different Directions in an AI’s Representation of Language cs.CL | cs.AIPDF

Yoon Pyo Lee

TL;DR: 本文通过激活研究探索了Gemma 3 4B IT模型在语言表示中如何区分虚假陈述与不可能陈述。研究发现，模型在输出中混淆了偶然虚假与矛盾，但在内部激活空间中，真实、不可能和语义异常形成了接近正交的不同方向，表明不可能陈述更接近语义异常而非偶然虚假的极端情况。

Details

Motivation: 动机在于探究AI模型是否在内部表征中区分语言中可假但可能的状态（偶然虚假）与根本不可能的状态（必然虚假），这是一个古老的哲学区分在AI中的实证检验。

Result: 在Gemma 3 4B IT模型上，线性探针显示：真实探针能很好区分真实与不可能陈述（AUC 0.93），但无法区分不可能与虚假陈述（AUC 0.20）；不可能探针在留出的主题家族上能完美区分必然虚假与偶然虚假（AUC 1.00），在第15层达到最佳平衡准确率0.97。

Insight: 创新点在于通过激活几何分析揭示了模型内部表征中“真实”与“不可能”方向接近正交，而“不可能”方向部分重叠但可区分于“语义异常”方向，为理解AI的语义表示提供了新的经验证据。

Abstract: Language can describe states of affairs that are false and states of affairs that could not be the case at all. Whether an AI model internally distinguishes these failures remains unclear. I report an exploratory activation study of the multimodal open-weight model Gemma 3 4B IT using 85 prompts from 17 philosophical families and a topic-matched modality set of 15 topics, each expressed as a truth, contingent falsehood, improbable claim, semantic anomaly, and necessary falsehood. In its answers, the model conflates contingent falsehood with contradiction, labeling 12 of 15 false statements “contradiction.” Its activations show a different pattern. A linear truth probe separates impossible from true statements (AUC 0.93) but not impossible from false statements (AUC 0.20). An impossibility probe evaluated on held-out topic families separates necessary from contingent falsehood at AUC 1.00, peaking at layer 15 with balanced accuracy 0.97 (Bonferroni-adjusted P=0.018). The truth and impossibility directions are close to orthogonal, whereas the impossibility direction partially overlaps a semantic anomaly direction while remaining distinguishable from it. Sparse autoencoder features at the same layer repeat this geometry. Features selective for impossibility also fire on anomalous sentences but rarely on contingent falsehoods. In this model’s activation space, necessary falsehoods are not extreme cases of contingent falsehood but lie closer to the experimentally defined category of semantic anomaly. This representational proximity does not imply that impossible statements are intrinsically meaningless. These correlational observations from one small model offer an empirical footnote to an old philosophical distinction.

[18] The Embedder’s Dilemma: LLMs Are Better, but at What Cost? cs.CLPDF

Adnan El Assadi, Niklas Muennighoff, Jinhyuk Lee

TL;DR: 这篇论文通过一个受控的、考虑成本的基准测试，比较了大型语言模型（LLMs）和专用嵌入模型在文本嵌入任务上的表现。研究发现，在37个任务上，最佳LLM（Gemini 3.1 Pro）和最佳嵌入模型整体性能相当，但各自擅长不同任务类型，且LLM的成本和延迟远高于嵌入模型。

Details

Motivation: 解决一个实际工程问题：在文本嵌入任务中，是否应该用大型语言模型（LLMs）替换现有的专用嵌入模型管道，需要从性能和成本效益两方面进行权衡。

Result: 在37个任务（分类、语义文本相似度、聚类、对分类、检索）的聚合得分上，最佳LLM（77.6分）与最佳嵌入模型（77.2分）仅差0.4分。LLM在需要推理的检索任务上领先，嵌入模型在分类任务上领先，其他任务上表现相当。然而，LLM的成本最高可达同等质量嵌入模型的1431倍，推理速度也慢得多。帕累托前沿包含领先的嵌入模型和Gemini 3.1 Pro。

Insight: 论文的核心洞察是提出了一个“分工”建议：对于相似性、分类和聚类任务，应使用成本效益更高的专用嵌入模型；而对于推理密集型的检索任务，则可考虑使用LLM。此外，研究发现LLM推理成本中很大一部分（28%-81%）来自“推理标记”，减少这部分预算可以在大多数模型中保持甚至提升检索质量，这为LLM的成本优化提供了方向。

Abstract: Should you replace your text-embedding pipeline with a large language model? We answer this with a controlled, cost-aware comparison of ten LLMs across six families and 26 embedding models (118M to 14B parameters) on 37 tasks spanning classification, semantic textual similarity (STS), clustering, pair classification, and retrieval. In aggregate the two paradigms are effectively tied: the best LLM (Gemini 3.1 Pro, 77.6) and the best embedding model (77.2) differ by 0.4 points. Their strengths differ by task: LLMs lead on reasoning-heavy retrieval, embedding models lead on classification, and the two match on clustering, STS, and pair classification. Reaching that parity is expensive. An LLM costs up to 1,431x more than an embedding model of comparable quality (USD 154 vs. USD 0.11 per benchmark pass), and the open LLMs tested process tokens 2.5 to 736x more slowly on the same GPU. Reasoning tokens account for 28 to 81% of LLM inference cost; lower reasoning budgets preserve or improve retrieval quality for most models in our ablation. The Pareto frontier contains the leading embedding models and one LLM, Gemini 3.1 Pro. These results support a division of labour: use embedding models for similarity, classification, and clustering, and reserve LLMs for reasoning-intensive retrieval. Our code, datasets, and results are publicly available at https://github.com/embeddings-benchmark/embedders-dilemma.

[19] When Your Agent Opens the Chat App: Agent-Controlled Search over Raw Chat Logs Rivals Structured Memory cs.CLPDF

Ruizhe Li, Licheng Zhang, Benfeng Xu, Mingxuan Du, Zheren Fu

TL;DR: 本文提出了ReFind，一种基于代理控制的搜索界面，用于在原始聊天记录上进行检索。该方法不构建任何语义结构（如摘要、嵌入、树或知识图谱），而是直接对原始对话进行词法索引，并结合迭代关键词搜索循环与四种基于经验研究的聊天原生控制机制。在MemoryAgentBench的多轮增量评估中，ReFind在多种对话记忆任务上取得了最高的平均准确率（58.2），超越了基于图和树的记忆系统（如HippoRAG 2的53.2）。

Details

Motivation: 当前代理记忆系统通常通过构建结构化表示（如摘要、知识图谱）来提升检索质量，但作者质疑这种收益有多少真正源于结构本身，而非对原始历史记录的有效检索能力。本文旨在探索仅通过代理控制的搜索在原始聊天记录上能否达到甚至超越结构化方法的性能。

Result: 在MemoryAgentBench的增量多轮设置下，ReFind在单跳/多跳QA、事件排序和事实整合等任务上取得了58.2的平均准确率，高于最强的基于图和树的记忆系统（如HippoRAG 2的53.2）。在LongMemEval-S/M基准上，使用GPT-5-mini时分别达到93.2和89.3的准确率。控制实验表明，代理控制、聊天原生控制和词法检索均对性能有贡献。

Insight: 论文的创新点在于完全摒弃了基于LLM的索引构建，仅通过代理控制的词法搜索和四种聊天原生控制机制（会话感知排名融合、局部上下文扩展、时间范围缩小、跳过已检查会话）来实现高效检索。核心洞察是：对于聊天存档中的精确、证据型问题，结构化记忆系统的许多优势可以通过对原始记录的可控搜索来复现，而无需复杂的语义结构。这挑战了当前依赖预构建结构的普遍做法，为轻量级、可解释的代理记忆系统提供了新思路。

Abstract: Agent-memory systems increasingly buy retrieval quality with structure, transforming raw conversation histories into summaries, embeddings, trees, or knowledge graphs before any question is asked. We ask how much of that benefit comes from the structure itself, rather than from competent retrieval over the raw history. We present ReFind, an agent-controlled search interface that builds no semantic structure at all: it leaves the conversation archive unmodified, indexes it lexically at turn granularity, and combines a generic iterative keyword-search loop with four chat-native controls grounded in empirical refinding work: session-aware rank fusion, local context expansion, temporal narrowing, and skipping already-inspected sessions. A separate reasoning stage answers from the collected evidence. Across a broad suite of conversational-memory tasks (single- and multi-hop QA, event ordering, and fact consolidation), roughly 2,800 questions on precise-retrieval and fact-tracking capabilities evaluated under the incremental multi-turn setting of MemoryAgentBench, ReFind attains the highest mean accuracy (58.2) of any system compared, above the strongest graph- and tree-based memory systems (HippoRAG 2, 53.2), all under a GPT-4o-mini backbone matched to every reused baseline. Controlled comparisons to single-shot BM25, a matched generic-agentic BM25 control, component removals, and agentic dense/hybrid variants separately support the roles of agent control, chat-native controls, and lexical retrieval. On LongMemEval-S/M, the same interface reaches 93.2 +/- 3.3 and 89.3 +/- 6.0 with GPT-5-mini. The results indicate that for precise, evidence-grounded questions over chat archives, much of the benefit credited to elaborate memory structures is recoverable by giving an agent controllable search over the unmodified record, with no LLM-based index construction at all.

[20] LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation cs.CLPDF

Dongfang Li, Zixuan Liu, Junmai Wang, Jiahe Huang, Fuhao Li

TL;DR: LycheeMemory V2 是一个用于LLM智能体的高效长期记忆框架，它通过语义片段级整合取代了传统的逐轮次整合。该方法将多次交互批量处理为语义片段，并将每个完整的片段编码为上下文无关的、类型化的记忆记录，从而显著降低了LLM的编码频率和构建成本。

Details

Motivation: 解决现有LLM智能体记忆系统因依赖逐轮次（eager）整合（如提取、总结或更新记忆）而导致的成本随对话增长急剧增加的问题，以及粗粒度总结可能丢失细粒度上下文证据、而扩大检索上下文或多跳推理又会增加查询时间开销的矛盾。

Result: 在GPT-4.1-Mini上的实验表明，LycheeMemory在LoCoMo和LongMemEval-S基准上分别达到了89.22%和92.20%的准确率，达到了SOTA性能。与A-Mem相比，它在不增加查询时令牌使用量的情况下，在LoCoMo和LongMemEval-S上分别减少了86.0%和75.9%的构建令牌消耗。

Insight: 核心创新点在于用语义片段级整合替代逐轮次整合，结合语义边界检测来保留连贯的事件级和时间证据，并使用轻量级结构化索引进行查询规划的检索。更广泛的启示是，长期智能体记忆的准确性与成本权衡不仅取决于保留什么信息，还取决于信息整合的粒度。

Abstract: Long-horizon LLM agents must preserve information from past interactions to support future tasks. Existing memory systems typically rely on eager consolidation, invoking LLMs after each interaction to extract, summarize, or update memories. This design makes memory construction increasingly costly as conversations grow. Coarse summarization can reduce construction cost but risks discarding fine-grained contextual evidence, whereas larger retrieval contexts or multi-hop LLM reasoning shift the overhead to query time. We present LycheeMemory V2, an efficient long-term memory framework that replaces turn-level consolidation with semantic segment-level consolidation. Instead of consolidating every interaction, LycheeMemory batches multiple exchanges into segments and encodes each finalized segment into context-independent typed memory records. Segment-level batching lowers LLM encoding frequency, while semantic boundary detection helps preserve coherent event-level and temporal evidence compared with fixed-window batching. The resulting records are organized with lightweight structured indexes for query-planned evidence retrieval. Experiments using GPT-4.1-Mini show that LycheeMemory achieves state-of-the-art performance, reaching 89.22% on LoCoMo and 92.20% on LongMemEval-S. Compared with A-Mem, it reduces construction tokens by 86.0% on LoCoMo and 75.9% on LongMemEval-S without increasing query-time token usage. More broadly, our results suggest that the accuracy–cost trade-off of long-term agent memory depends not only on what information is retained, but also on the granularity at which it is consolidated.

[21] HybridRAG-BN: A Retrieval-Augmented Framework with Fine-Tuned Verification for Bangla KBQA cs.CL | cs.IRPDF

Rathijit Aich, Nirjhar Das, Mahfuzulhoq Chowdhury

TL;DR: 该论文提出了一个名为HybridRAG-BN的检索增强框架，专门用于孟加拉语知识库问答。该框架集成了BM25和BGE-M3的混合检索、基于Gemma-4-31B-Instruct模型的答案生成，以及一个经过LoRA微调的Gemma模型用于答案验证和精炼，并通过后处理阶段增强鲁棒性。

Details

Motivation: 针对孟加拉语等低资源语言，开发可靠的KBQA系统面临挑战，包括检索研究有限、语言资源稀缺以及将生成答案与外部知识关联困难。

Result: 实验结果表明，该框架在公开和私有排行榜上分别取得了0.71654和0.72912的token级F1分数，在竞赛中获得了第一名。

Insight: 创新点在于为低资源语言KBQA设计了一个集成了混合检索、生成、微调验证和增强后处理的端到端框架，特别是使用LoRA微调模型进行答案验证与精炼，以及结合传统检索和网络搜索的后处理策略，有效提升了系统性能。

Abstract: Knowledge-base question answering (KBQA) systems rely on effective retrieval and reasoning mechanisms to generate accurate answers from external knowledge sources. However, developing reliable KBQA systems for low-resource languages such as Bangla remains challenging due to limited retrieval-focused research, scarce language resources, and difficulties in grounding generated responses in external knowledge. In this work, we propose HybridRAG-BN, a retrieval-augmented framework for Bangla KBQA that integrates hybrid retrieval using BM25 and BGE-M3, answer generation using the GGUF version of Gemma-4-31B-Instruct, and a LoRA-fine-tuned Gemma-4-31B-Instruct model for answer verification and refinement. To further improve robustness, the framework incorporates a post-processing stage that addresses unresolved cases through fallback answer replacement and DuckDuckGo-assisted retrieval. Experimental results demonstrate the effectiveness of the proposed framework, achieving token-level F1 scores of 0.71654 and 0.72912 on the public and private leaderboards, respectively, securing first place in the competition.

[22] CASA: Content-Acoustic Speaking Assessment with Speech Encoder and Large Language Model cs.CL | eess.ASPDF

Nhan Phan, Ilona Lähteenmäki, Anna von Zansen, Olli-Pekka Pauna, Yaroslav Getman

TL;DR: 本文提出CASA模型，一种结合Whisper-medium语音编码器和Qwen3.5-2B大语言模型的自动口语评估架构，旨在更清晰地分离语音表达和内容信息，并在Speak & Improve Corpus 2025上实现了SOTA性能。

Details

Motivation: 现有自动口语评估研究对声学和内容信息的贡献分析不足，且性能稳定性有限，CASA旨在提供更可解释的分离并提升性能。

Result: 在Speak & Improve Corpus 2025上，CASA取得了0.358的RMSE，优于先前最佳结果，同时推理参数量减半，并通过消融实验分析了声学和内容信息的贡献。

Insight: 创新点在于采用通用架构结合预训练模型，无需结构改动即可适配其他语料库，并利用大语言模型进行无训练的内容验证，增强了可解释性。

Abstract: Research on automatic speaking assessment (ASA) has increasingly adopted multimodal speech large language models to assess learners’ speaking performance. However, existing studies provide limited analysis of how acoustic and content information contribute to predictions and how stable the resulting performance is. We propose CASA, a simpler architecture combining Whisper-medium and Qwen3.5-2B that achieves state-of-the-art performance while providing a more interpretable separation between speech delivery and content. On the Speak & Improve Corpus 2025, CASA achieves a root mean square error (RMSE) of 0.358, improving on the previous best RMSE while using approximately half the estimated inference parameters. The general-purpose architecture is designed for adaptation to other ASA corpora without structural changes and relies on three handcrafted fluency features. Through ablations and repeated runs, we analyze the individual and complementary contributions of acoustic and content information, examine performance variability, and demonstrate the potential of large language model reasoning for training-free content validation.

[23] Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering cs.CL | cs.AIPDF

Yilin Wang, Yuchun Fan, Weidong Bao, Zili Wei, Shi Feng

TL;DR: 本文提出Syfer框架，一种针对多语言多跳问答的合成器-折叠方法，通过延迟翻译而非默认应用翻译来解决现有方法的局限性。该方法首先在原始语言中生成子问题图并进行质量检查，仅在检查失败时才激活翻译路径，从而在保持准确性的同时优化计算成本。

Details

Motivation: 现有多语言检索增强生成方法存在两个问题：一是统一翻译会丢失目标语言特有的文化语言信息并引入噪声；二是贪婪分解和聚合会产生冗余子问题并放大推理错误。

Result: 在多语言实验上，Syfer在保持竞争力的准确性的同时，在性能和计算成本之间取得了良好的平衡。

Insight: 创新点在于提出延迟翻译策略和格式约束分解器，通过子问题图质量检查动态选择翻译路径，减少了翻译噪声和计算开销，同时保留了语言原生信息。

Abstract: Multilingual retrieval-augmented generation (mRAG) equips large language models with access to globally distributed external knowledge for complex multilingual question answering. Recent approaches either translate retrieved documents into English or the query language to bridge the cross-lingual semantic gap, or decompose a complex query into sub-questions and aggregate the intermediate reasoning process. However, both lines of work suffer from two limitations. First, one-size-fits-all translation alignment, blanket translation discards culturally and linguistically native information unique to the target language, introduces translation noise, and inflates system cost. Second, greedy decomposition and aggregation, uncontrolled decomposition produces redundant sub-questions that compound errors during step-wise reasoning, and the final aggregation over reasoning paths further amplifies these errors. We address both with our method Syfer, a synthesizer-folding framework for multilingual multi-hop question answering that defers translation rather than applying it by default. Syfer first invokes a format-constrained decomposer to produce a sub-question graph in the original language, followed by a decomposition-quality check; when the check passes, sub-questions are answered sequentially under a retrieve-then-answer policy in the target language, and the English translation pathway with bilingual sub-question graph alignment is activated only when the check fails. Experiments across multiple languages show that Syfer attains competitive accuracy while striking a favourable balance between performance and computational cost.

[24] GEM: A Generative Embedding Model Bridging Reasoning and Retrieval cs.CL | cs.AI | cs.IRPDF

Zhili Shen, Craig Macdonald

TL;DR: 本文提出GEM（生成式嵌入模型），通过显式推理用户意图和相关性标准，将生成与嵌入统一于单一模型中，以弥合用户表达与检索器理解之间的鸿沟。

Details

Motivation: 传统检索器主要依赖查询与文档的表面匹配，导致用户复杂多样的信息需求表达与检索器解释方式之间存在差距。

Result: 在推理密集和指令跟随检索任务上评估，GEM的推理增强检索效果显著，优于其非推理变体，并与使用更大模型的基线方法性能相当。

Insight: GEM的创新点在于将生成式推理与嵌入检索统一，通过附加嵌入令牌编码丰富上下文，并支持通过提示进行测试时计算扩展以进一步提升检索性能。

Abstract: Modern LLMs excel at reasoning and instruction following, enabling users to express complex and diverse information needs. However, conventional retrievers largely rely on surface-level matching between queries and documents, resulting in a growing gap between how users express their needs and how retrievers interpret them. In this paper, we present GEM, a generative embedding model that augments retrieval through its own knowledge by explicitly reasoning about user intent and relevance criteria. GEM unifies generation and embedding within a single model: it first reasons over the query, then appends an embedding token to encode the enriched context for retrieval. \zhili{Evaluated on reasoning-intensive and instruction-following retrieval tasks, GEM demonstrates the effectiveness of its reasoning-augmented retrieval, outperforming its non-reasoning variant and matching baselines using substantially larger models.} Furthermore, GEM’s generative nature allows test-time compute scaling via prompting to further enhance retrieval performance. Our code is available at: https://anonymous.4open.science/r/GEM.

[25] Localize, Then Reason: Visual Latent Structural Reasoning for Molecular Properties and Edits cs.CL | cs.CE | q-bio.BMPDF

Xingqiao Lin, Junmei Wang, Haocheng Tang

TL;DR: 该论文提出了一种名为视觉潜在结构推理（VLSR）的端到端框架，用于从分子图像中预测分子性质和编辑。其核心是‘先定位，后推理’的策略，即模型先学习定位分子图像中具有化学意义的区域，然后在紧凑的潜在工作空间中推理这些区域对性质的影响，最后生成答案。

Details

Motivation: 当前基于LLM的化学推理方法要么接收SMILES/分子图像及局部结构描述，要么直接从分子图像推理，都无法让模型在推理前先聚焦于化学上有意义的区域。本文旨在填补这一空白。

Result: 在相同的推理设置下，该设计实现了比可比的文本推理基线高9.6倍的吞吐量。

Insight: 创新点在于将视觉感知任务中的‘先检测后分类’思想引入分子性质推理，通过联合学习定位和推理，强制模型在潜在空间中进行结构化、基于区域的因果推理，这提高了推理效率并可能增强可解释性。

Abstract: Local chemical perception and property reasoning are both essential for understanding how molecular structure determines properties. Current LLM-based chemical reasoning methods either receive SMILES/molecular images together with descriptions of local motifs, or reason directly from molecular images. Neither approach enables the model to focus on chemically meaningful regions before reasoning. To address this gap, we propose Visual Latent Structural Reasoning (VLSR), an end-to-end framework that jointly learns localization and reasoning from molecular images. Central to our approach is a localize-then-reason strategy. VLSR first learns to locate chemically meaningful regions in a molecular image. It then reasons about their property effects in a compact latent workspace before producing the final answer. Under the same inference setup, this design achieves 9.6X higher throughput than a comparable textual-reasoning baseline.

Paul Osemudiame Oamen, Owusu-Banahene Osei, Ananya Mukherjee, Christian Greisinger, Steffen Eger

TL;DR: 本文提出了SciFigBench基准，用于评估视觉语言模型在科学图表理解中的感知、推理及不确定性下的行为可靠性，并引入A-R-I框架量化模型在证据不足、误导性上下文和部分信息下的表现。研究发现，尽管GPT-5.2在描述质量和推理准确率上表现优异，但在96%的情况下会产生幻觉内容，而Gemini 3.1 Pro在类似能力下更倾向于承认不确定性并具有更强的抗误导能力。

Details

Motivation: 现有VLM基准主要关注感知和推理准确性，而忽视了模型在视觉证据缺失或误导时的行为可靠性，这在科学工作流部署中至关重要。

Result: 在SciFigBench基准上，GPT-5.2获得最高描述质量（MQM 91.6）和较强推理准确率（78.4%），但幻觉率高；Gemini 3.1 Pro在描述质量（MQM 90.2）和推理准确率（81.0%）相当的情况下，在71%的案例中承认不确定性，并取得最强的抗误导分数（0.91）。

Insight: 创新点在于提出了首个联合评估VLM感知、推理及不确定性行为可靠性的科学图表基准，并设计了A-R-I框架来系统量化模型在证据不足、抗误导和谨慎推断方面的行为差异，揭示了高准确性并不等同于行为可靠性这一关键洞见。

Abstract: Existing vision-language model (VLM) benchmarks emphasize perception and reasoning accuracy (how well VLMs describe and reason about what they see in an image), with limited attention to behavioral reliability under uncertainty (how they behave when visual evidence is missing or misleading). We introduce SciFigBench, a diagnostic VLM benchmark for scientific figure understanding that jointly evaluates perception, reasoning, and behavioral reliability under uncertainty. It contains 250 figures with high-quality human annotations across three evaluation aspects, totaling 600+ hours of annotation effort. We further extend these figures via image transformations, reasoning questions, resistance probes, caption-bias probes, and confirmed selective-blur targets, producing over 34,000 evaluation setups for stress testing. We further propose the Admittance-Resistance-Inductance (A-R-I) framework to evaluate whether models acknowledge insufficient evidence, resist misleading context, and infer cautiously from partial information. Our results reveal substantial behavioral differences among models. GPT-5.2 achieves the highest description quality (MQM 91.6) with strong reasoning accuracy (78.4%), yet hallucinates unreadable content in 96% of cases, whereas Gemini 3.1 Pro, a comparably capable model (MQM 90.2, reasoning 81.0%), admits uncertainty in 71% of such cases and achieves the strongest resistance score (0.91). These findings show that high perception and reasoning accuracy alone do not guarantee behavioral reliability, a dimension critical for deployment in scientific workflows.

[27] Refusing Intent, Not Form: Wrapper-Based Intent-Group Supervision for LLM Safety cs.CLPDF

Ping Wu, Haibo Tong, Feifei Zhao, Han Shen, Yu Shi

TL;DR: 本文提出了一种基于包装器的意图-形式增强方法（WIFA），通过自动生成结构匹配的有害与良性包装样本对，旨在解决大语言模型安全调优中因学习表面形式捷径而导致的过度拒绝问题。论文介绍了两种互补的微调路径：WIFA-Boost（两阶段高安全配方）和锚定组一致拒绝训练（A-GCRT），后者通过正则化相同意图包装器的拒绝/遵从决策分数来改善模型行为。

Details

Motivation: 动机在于解决安全调优后模型可能学习到表面形式捷径的问题，即包装后的有害提示可能绕过安全机制，而类似包装的良性提示却被过度拒绝，从而损害模型的有用性。

Result: 在Qwen模型设置中，WIFA-Boost在转换有害拒绝方面达到最强性能；A-GCRT将OR-Bench基准上的过度拒绝率从基础模型的25.7%降低至17.4%，复现的基线方法未能达到这一性能水平。Llama模型的结果及对数据结构、两阶段顺序和A-GCRT组件的消融实验支持了意图-组解释的有效性。

Insight: 创新点在于提出了无需外部教师或手动标注的自动意图-组增强方法WIFA，以及通过锚定组一致拒绝训练（A-GCRT）来正则化决策分数，这有助于模型更关注意图而非表面形式，从而在保持安全性的同时减少过度拒绝。

Abstract: Safety tuning can improve harmful refusal, but models may learn surface-form shortcuts: wrapped harmful prompts bypass safety, while similarly wrapped benign prompts are over-refused. We propose Wrapper-Based Intent-Form Augmentation (WIFA), an automatic intent-group augmentation method that pairs wrapped harmful examples with structurally matched wrapped benign counterexamples, requiring no external teacher or manual per-wrapper intent labels. We use WIFA as a common data layer for two complementary fine-tuning routes: WIFA-Boost, a two-stage high-safety recipe, and Anchored Group-Consistent Refusal Training (A-GCRT), which regularizes refusal/compliance decision scores across same-intent wrappers and anchors harmful and benign groups on opposite sides of a margin. In the Qwen setting, WIFA-Boost reaches the strongest transformed-harmful refusal, while A-GCRT reduces OR-Bench over-refusal from 25.7% for the base model to 17.4%; reproduced baselines do not match these operating points. Llama results and ablations over data structure, two-stage order, and A-GCRT components support this intent-group interpretation without claiming universal below-base over-refusal.

[28] Beyond Local Accuracy: A Protocol-Level Identifiability Audit for Controlled LLM Reasoning Evaluation cs.CLPDF

Junhao Luo, Ning Huang, Ziqi Sha, Wenxuan Tang, Wei Deng

TL;DR: 本文提出了一种协议层面的可识别性审计方法，用于评估受控LLM推理评测的有效性。该方法在有限行为策略类上形式化地测试观测协议是否能区分不同的目标行为属性，无需调用模型即可诊断评测设计。实证表明，即使约束生成变体具有相同的配对有效性，基础准确性与选择性响应保真度也会显著差异，揭示了基础正确性不能决定干预响应保真度。

Details

Motivation: 解决LLM基准测试中观测协议可能无法有效识别其意图测量的行为属性的问题，即在评测分数精确的情况下，评测设计本身可能无效。

Result: 在诊断案例中，仅基础观测将七个确定性策略坍缩为一个等价类，而完整支持则产生七个类且无跨目标碰撞。实证上，两种约束生成变体的配对有效性均为1.0，但基础准确性与选择性响应保真度在六个平衡预言机转换方向上显著差异（0.620 vs. 0.324），该差距在第二个确定性源上重现（0.646 vs. 0.331）。审计还合成了最小识别支持O*（两个单元而非完整的36单元张量）。

Insight: 创新点在于提出了一种结构化的、无需模型推理的协议级审计框架，用于在模型推断前检查评测设计的有效性。核心洞察是基础正确性（如准确率）并不决定干预响应保真度，揭示了评测协议设计对测量目标属性的关键影响。

Abstract: LLM benchmark scores can be precise even when the observation protocol does not identify the behavioral property they are intended to measure. In a controlled, solver-grounded setting, we formalize a protocol-level identifiability audit over a finite behavioral policy class: given policies H, observation support O, and estimand $τ$, we test whether O separates every pair with different $τ$. The audit requires zero model calls and resolves our diagnostic case: base-only observation collapses seven frozen deterministic policies into one equivalence class; full support yields seven classes and no cross-estimand collisions; every leave-one-out support retains a constructive collision witness. Empirically, both constrained-generation variants have pair-validity 1.0, yet base accuracy and selective-response fidelity diverge - 0.620 versus 0.324 across six balanced oracle-transition directions (cluster-bootstrap 95% CI [0.600, 0.642] vs. [0.304, 0.345]) - and the gap recurs on a second deterministic source (0.646 vs. 0.331). The audit also synthesizes a minimum identifying support $O^*$ for the frozen policy class: two cells instead of the full 36-cell tensor. This case shows how evaluation-design validity can be checked structurally before model inference and why base correctness does not determine intervention-response fidelity.

[29] RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory cs.CLPDF

Jingbo Ji, Lingyi Li, Xilong Cheng, Yuhao Zhou, Wenji Zhang

TL;DR: 本文提出了RippleMem，一种用于基于LLM的智能体的长期记忆系统，旨在解决从大量交互历史中有效检索分布式相关信息的问题。它通过自适应关联回忆机制，将交互历史存储为富含线索的情景记忆单元，并组织成以事件为中心的记忆图。给定查询时，系统先通过混合线索召回相关记忆锚点，然后沿着语义和结构关联扩展以恢复缺失的支持证据。

Details

Motivation: 现有方法（如全上下文搜索、扁平检索、基于图的记忆系统）在处理长期交互中信息分布广泛且关联复杂的检索问题时存在不足，无法高效、完整地恢复相关证据集。

Result: 在LoCoMo和LongMemEval-S基准测试中，RippleMem取得了最佳综合性能，将LLM-as-a-Judge准确率在LoCoMo上提升了3.95%，在LongMemEval-S上最高提升了11.87%，同时将图构建成本降低了约30倍。

Insight: 核心创新在于将一次性检索转变为自适应关联回忆，受线索依赖的情景检索和关联完成启发，利用初始召回记忆作为进一步检索的线索，从而更完整地恢复分布式证据。该方法在保持高性能的同时显著降低了图构建开销。

Abstract: LLM-based agents increasingly rely on external memory to support long-horizon reasoning and interaction. However, the main bottleneck is not simply storing past experience, but recovering the right set of evidence when relevant information is distributed across many interactions. Existing approaches struggle with this access problem. Full-context methods require noisy long-context search, flat retrieval often returns isolated and incomplete records, and graph-based memory systems can be expensive to construct while compressing rich event context. We introduce RippleMem, a long-term memory system that replaces one-shot retrieval with adaptive associative recollection. Inspired by cue-dependent episodic retrieval and associative completion, RippleMem stores interaction history as cue-rich episodic memory units and organizes them in an event-centric memory graph. Given a query, it first recalls relevant memory anchors through hybrid cues, then expands from these anchors along semantic and structural associations to recover missing supporting evidence. In this way, initially recalled memories serve not only as answer context, but also as cues for completing the evidence needed to answer. Experiments on LoCoMo and LongMemEval-S show that RippleMem achieves the best overall performance across evaluated settings, improving LLM-as-a-Judge accuracy by 3.95% on LoCoMo and up to 11.87% on LongMemEval-S, while reducing graph construction cost by about 30x.

[30] CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation cs.CLPDF

Enhan Li, Junhao He, Hongyang Du

TL;DR: 本文提出CROP方法，用于改进策略蒸馏中的监督分配机制。CROP通过反事实敏感性和释义校准来量化任务相关性，从而更有效地选择有价值的监督位置，提升学生模型的性能。

Details

Motivation: 现有选择性策略蒸馏方法主要关注优化需求（如不确定性或师生分歧），而任务相关性（即监督是否与当前输入的语义内容相关）未被直接表征。CROP旨在填补这一空白，将任务相关性作为补充维度引入监督分配。

Result: 在两种师生设置下，CROP比最强的非CROP选择器在整体性能上分别提升了1.92和2.96个点。匹配选择控制实验表明，CROP能识别出比随机或最低相关性选择更有用的监督位置。

Insight: CROP的创新点在于通过反事实敏感度边界和释义校准来操作化任务相关性，提供了一种模型内部、对比特定的令牌级监督分配方法，将任务相关性确立为选择性策略蒸馏的补充标准。

Abstract: On-policy distillation (OPD) supervises a student language model on trajectories sampled from its current policy, but assigns equal credit to response tokens with unequal supervision value. Selective OPD addresses this limitation by allocating supervision non-uniformly across response tokens according to their estimated training value. Most existing criteria, however, focus primarily on optimization need, such as uncertainty or teacher-student disagreement, while task relevance, namely whether the supervision is tied to the semantic content of the current input, remains less directly characterized as a complementary dimension. To address this gap, we introduce Counterfactual Relevance for On-Policy Distillation (CROP), which operationalizes task relevance through a paraphrase-calibrated counterfactual sensitivity margin. For each source prompt, CROP constructs a validated original-paraphrase-counterfactual triplet, holds the student rollout fixed, and measures each response position by its sensitivity to a task-relevant condition change calibrated by its sensitivity to a meaning-preserving rewrite. Matched selection controls show that CROP identifies more useful supervision positions than random or lowest-relevance selection, while component comparisons confirm the value of both counterfactual sensitivity and paraphrase calibration. Across two teacher-student settings, CROP improves aggregate performance by 1.92 and 2.96 points over the strongest non-CROP selector. These results support task relevance as a complementary criterion for selective OPD and establish CROP as a model-internal, contrast-specific method for allocating token-level supervision.

[31] DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training Data cs.CL | cs.AIPDF

Peter Schneider-Kamp, Jacob Nielsen, Gianluca Barmina, Kenneth Enevoldsen, Lukas Galke Poech

TL;DR: 本文介绍了Mimir v1，一个基于分层推理模型架构的10亿参数语言模型。该模型完全从头开始训练，仅使用可许可的后期训练数据，在英语任务上表现出高度竞争力，并为丹麦语任务设定了新的最先进水平。

Details

Motivation: 当前大语言模型开发严重依赖大规模、通常不可许可的数据集，这为致力于开源和符合伦理数据来源的研究者设置了高门槛。本文旨在通过仅使用可许可数据训练模型来降低这一门槛。

Result: 在涵盖英语、数学与代码以及丹麦语的20个基准测试中，Mimir v1超越了原始的HRM-Text 1B模型，并与Qwen 3.5 4B和Gemma 4 E2B等更大的前沿模型竞争，为丹麦语任务设定了新的SOTA。

Insight: 主要创新点在于证明仅使用可许可的后期训练数据，也能从头训练出在多个领域（尤其是低资源语言如丹麦语）达到前沿性能的较小规模模型，这为符合伦理和开源要求的模型开发提供了可行路径。

Abstract: Current large language model development relies on massive, often non-permissible datasets, creating a high barrier for researchers committed to open-source and ethically sourced data. We introduce Mimir v1, a 1-billion-parameter language model based on the Hierarchical Reasoning Model (HRM) architecture, that is trained from scratch and delivers highly competitive performance for English and sets a new state of the art for Danish using only permissible post-training data. Trained on a mixture of 161 datasets, Mimir v1 outperforms the original HRM-Text 1B and competes with larger frontier models like Qwen 3.5 4B and Gemma 4 E2B, tested across 20 benchmarks for English, Math & Code and Danish. The model is available on the Hugging Face Hub: https://huggingface.co/danish-foundation-models/DFM-Mimir

cs.CV [Back]

[32] HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning cs.CVPDF

Aysha Ashraf, Shaina Ashraf, Wafaa I. M. Hussin, Ali Haider, Zhi Lu

TL;DR: 本文提出了HIMEC方法，用于遥感图像变化描述任务。该方法结合了方向性变化表示和固定接口解码，通过分离有符号差异为不同信息流并生成变化查询令牌，旨在改进解码器接口的一致性与中间变化结构建模。

Details

Motivation: 现有遥感图像变化描述方法通常直接将融合的视觉特征输入解码器，对中间变化结构以及解码器接口在训练和推理阶段的一致性研究不足。

Result: 在LEVIR-CC数据集上，HIMEC取得了142.81±0.60的CIDEr分数，优于直接使用融合特征记忆的方法（139.51±3.40）。在SECOND-CC数据集上，固定零输入和机制匹配的诊断性条件化分别达到75.67和76.99 CIDEr，远高于不匹配级联的60.77。

Insight: 创新点在于提出了方向性变化表示来结构化地建模变化，以及固定接口解码策略确保了训练与推理阶段解码器输入的一致性。此外，仅用于训练的辅助短语解码器提供了额外的监督信号。

Abstract: Remote sensing image change captioning (RSICC) converts bitemporal imagery into a sentence describing semantic changes. Most RSICC methods condition caption decoders directly on fused visual features, leaving intermediate change structure and decoder-interface consistency less studied. We present HIMEC, combining Directional Change Representation (DCR) with fixed-interface decoding. DCR separates signed differences into appearance-oriented, disappearance-oriented, and shared-context streams before fusion. A learned-query encoder converts the fused representation into visually conditioned change-query tokens that form the scene decoder’s only sample-dependent memory. A training-only auxiliary phrase decoder supplies caption-derived supervision. With a fixed zero input, the scene decoder maintains the same interface during training and inference. Separately, we evaluate a local-to-scene cascade conditioned on teacher-forced local states during training and autoregressive states at inference. On changed LEVIR-CC validation pairs, these states have a mean cosine distance of 0.69. Regime-matched conditioning recovers most of the associated deficit, whereas permuting state correspondence causes no detectable penalty. These findings are limited to the evaluated cascade. In a matched three-seed comparison, HIMEC reaches a Consensus-based Image Description Evaluation (CIDEr) score of $142.81\pm0.60$ on LEVIR-CC, versus $139.51\pm3.40$ for direct fused-feature memory. On SECOND-CC, fixed-zero and regime-matched diagnostic conditioning reach 75.67 and 76.99 CIDEr, respectively, versus 60.77 for the mismatched cascade. The source code will be made publicly available at https://github.com/ayshaashra/HIMEC upon publication.

[33] Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images? cs.CV | cs.ROPDF

Vladyslava Rudas, Dmytro Kuzmenko

TL;DR: 本文评估了三种开源视觉语言模型（InternVL、Qwen-VL和SmolVLM）在从机器人第一人称视角图像中评估近体空间风险（分为四个危险等级）的能力。研究比较了三种提示策略和两轮QLoRA微调的效果，并与分层随机基线进行了对比。结果表明，未经微调时，所有模型性能接近基线；微调仅带来有限的整体提升。然而，采用高级提示的Qwen-VL在高危险案例的召回率上显著优于其他模型。进一步分析发现，正确的危险分类并不对应更好的空间定位能力，表明模型可能在不关注场景相关区域的情况下产生有用的安全标签。

Details

Motivation: 从机器人的第一人称视角评估近体空间风险对于在人类环境中实现安全的具身导航至关重要，这需要结合视觉和上下文推理。当前视觉语言模型在此类细粒度推理任务上的能力尚不明确，因此需要系统评估。

Result: 在未微调情况下，所有模型性能接近分层随机基线。经过QLoRA微调后，整体改进有限，但采用高级提示的Qwen-VL在高危险案例的召回率上表现突出。实验表明，当前VLMs在细粒度近体推理和空间定位方面仍存在局限，但针对性的提示和微调可以提升特定模型的高危险检测能力。

Insight: 论文的创新点在于系统评估了VLMs在机器人近体风险分类任务上的表现，并揭示了模型性能与空间定位能力的不一致性（即模型可能无需精确定位即可做出有效安全判断）。从客观角度看，研究强调了针对高风险案例优化提示策略的重要性，并为VLMs在具身安全应用中的实际局限性提供了实证依据。

Abstract: Assessing proxemic danger from a robot’s egocentric perspective is critical for safe embodied navigation in human environments and requires both visual and contextual reasoning. We evaluate three opensource vision-language models (VLMs) (\textit{InternVL}, \textit{Qwen-VL}, and \textit{SmolVLM}) on the classification of egocentric robot images into four danger levels, comparing three prompting strategies and two rounds of QLoRA fine-tuning against a stratified random baseline. Without fine-tuning, all models perform near the baseline, while fine-tuning yields only modest overall improvements. However, \textit{Qwen-VL} with an advanced prompt achieves substantially higher recall for high-danger cases than the other models. An analysis of person localization further shows that correct danger classification does not correspond to better spatial grounding, indicating that a model may produce a useful safety label without attending to the relevant region of the scene. These results show that current VLMs remain limited in fine-grained proxemic reasoning and spatial grounding, although targeted prompting and fine-tuning can improve high-danger detection in selected models.

[34] Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval cs.CV | cs.IRPDF

Najmeh Forouzandehmehr, Topojoy Biswas, Evren Korpeoglu, Kannan Achan

TL;DR: 本文提出了一种名为MM-slotgate的多模态槽编码器，用于时尚检索任务。它将Fashion-CLIP的文本和图像嵌入分解为四个命名的属性槽（如类别、颜色、图案和人群），每个槽学习自己的文本-图像门控机制，以实现对不同属性的独立控制。

Details

Motivation: 现有的时尚检索方法通常将多种属性信号混合在单一的嵌入向量中，导致在检索时难以对特定属性进行精确控制。许多语义ID方法提供的离散项目代码是项目级或残差地址，并未暴露可独立控制的命名属性槽。

Result: 在H&M数据集上，MM-slotgate使用槽相似性和槽逻辑检索分数，实现了0.7566的宏观ConstraintSatisfied@10指标，优于等权重多模态融合（0.7142）和仅文本的fCLIP检索（0.4755）。其中颜色属性的提升最大，从0.321提高到0.889。

Insight: 创新点在于提出了属性条件化的多模态槽分解方法，通过为每个属性学习独立的文本-图像门控，使视觉属性（如颜色）更依赖图像证据，而分类属性（如类别）更依赖文本。这种方法实现了可解释且可控的属性槽，优于单一的全局嵌入或不透明的项目级语义ID。

Abstract: Fashion retrieval often requires satisfying multiple attributes at once, such as category, color, pattern, and demographic. Monolithic embeddings mix these signals into a single vector, making attribute-specific control difficult at retrieval time. Many existing semantic-ID methods provide discrete item codes, but these codes are typically optimized as item-level or residual addresses and do not expose named, independently controllable attribute slots. We introduce MM-slotgate, a multimodal slot encoder that factorizes Fashion-CLIP text and image embeddings into four named attribute slots. Each slot learns its own text-image gate, so visually grounded attributes such as color and pattern can rely more on image evidence, while taxonomy-oriented attributes such as category and demographic can remain more text-driven. On H&M, using a combined slot-similarity and slot-logit retrieval score, MM-slotgate achieves 0.7566 macro ConstraintSatisfied@10, outperforming equal-weight multimodal fusion (0.7142) and fCLIP text-only retrieval (0.4755). The largest gain is on color, which improves from 0.321 to 0.889 (+0.568 absolute), as the learned color gate assigns 57.4% weight to image evidence. The learned gates are interpretable without modality supervision: color is image-leaning, category is text-leaning, and pattern and demographic lie near the middle. The resulting slots also remain controllable: linear probes show no measured excess leakage beyond the label-correlation baseline, and quantized slot codes support targeted intervention, including a 15.3x lift for color. These results suggest that controllable fashion retrieval benefits from typed, attribute-conditioned multimodal slots rather than either a single global embedding or opaque item-level semantic IDs.

[35] StrAD: A Streaming Method and Benchmark for Audio Description Generation for Long-form Videos cs.CVPDF

Julian Spravil, Sebastian Houben, Sven Behnke

TL;DR: 本文提出了StrAD，一个用于长视频音频描述（AD）生成的流式方法和基准测试集。该方法将AD生成重新定义为流式密集视频字幕任务，通过滑动窗口处理全长视频，在无需真实时间戳的情况下将AD插入现有转录本中，并支持微调模型和视觉语言模型的零样本提示。

Details

Motivation: 现有自动AD生成方法通常将任务视为视频片段字幕生成，需要真实时间戳和额外上下文线索（如角色数据库），且当前基准测试集多基于短视频片段，限制了长视频AD生成的进展。本文旨在解决长视频AD生成的可扩展性问题，提升视觉内容对盲人和低视力人群的可访问性。

Result: 在给定时间戳的片段级任务上，微调的StrAD-FT在CMD-AD基准上达到36.3 CIDEr（SOTA，比Shot-by-shot高10.0），在StrAD基准上达到51.0 CIDEr，在MAD-Eval上达到24.9 CIDEr保持竞争力。在全视频流式任务上，StrAD-FT的SODA得分为2.4，零样本基线StrAD-Zero为1.1，但两者在时间定位和叙事连贯性上仍有局限。

Insight: 创新点在于将AD生成重新定义为流式密集视频字幕任务，首次实现了无需真实时间戳的在线全视频AD生成，并建立了涵盖电影、纪录片等多种类型的长视频AD基准测试集StrAD，为衡量和推进全视频AD生成的可扩展性提供了基础。

Abstract: Visual content is the dominant medium of communication, yet without audio descriptions (ADs), it remains inaccessible to blind and low-vision people. ADs narrate context-relevant visual events during natural audio pauses. Manually creating ADs is expensive, limiting coverage to a small fraction of available content. Most existing automatic AD generation methods frame the task as video clip captioning, requiring ground-truth timestamps and additional context cues such as character databases. Current benchmarks reinforce this framing, consisting of short video segments paired with automatic or task-mismatched annotations. We introduce StrAD, a benchmark for long-form AD generation on full-length videos spanning diverse genres such as movies, documentaries, short films, performances, and video games. We reformulate AD generation as streaming dense video captioning. Our approach processes full-length videos with a sliding window, inserting ADs into existing transcripts without ground-truth timestamps, and supports both fine-tuned models and zero-shot prompting of vision-language models. On the segment-level task with given timestamps, our fine-tuned StrAD-FT sets the state of the art on CMD-AD with 36.3 CIDEr (+10.0 over Shot-by-shot), establishes a reference point on StrAD (51.0 CIDEr), and remains competitive on MAD-Eval at 24.9 CIDEr. On the full-video streaming task, StrAD-FT reaches a SODA score of 2.4 against 1.1 for our zero-shot baseline StrAD-Zero, though both exhibit limitations in temporal localization and narrative coherence. While prior work has tackled full-video AD generation in an offline, multi-stage fashion, ours is the first streaming approach, generating ADs on the fly without ground-truth timestamps. StrAD makes progress on full-video AD generation measurable, a prerequisite for scaling accessibility.

[36] Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging cs.CV | cs.AIPDF

Zhi Qiao, Xintong Wu, Yichu He, Feng Shi

TL;DR: 本文提出了Mr3D-VL，一个专为多参数3D磁共振成像设计的视觉语言基础模型。该模型拥有40亿参数，通过共享的3D编码器和创新的4D旋转位置嵌入，实现了对多模态3D MRI数据的双模态-空间整合。实验表明，其在文本生成任务上超越了现有的领域特定和通用模型。

Details

Motivation: 解决多参数MRI（mpMRI）在脑肿瘤诊断中现有AI模型的局限性，即缺乏自然语言交互和可解释性，难以整合空间信息并进行跨模态推理。现有视觉语言模型主要关注2D图像，而3D模型又无法满足mpMRI所需的跨多成像模态协同推理需求。

Result: 在文本生成任务上显著优于现有的40亿/70亿/300亿参数的领域特定和通用模型。具体地，在报告生成任务上BERTScore达到0.856，问答准确率为0.713，多项选择准确率为0.912。

Insight: 创新点在于提出了一个专门针对多参数3D MRI的视觉语言基础模型架构，其核心是使用无监督预训练的共享3D编码器结合4D旋转位置嵌入进行双模态-空间整合，以及采用多分辨率特征植入策略的跨模态投影层来增强跨分辨率特征感知。

Abstract: Multi-parametric magnetic resonance imaging (mpMRI) is a cornerstone for brain tumor diagnosis and treatment, yet current AI models face critical limitations: their lack of natural language interaction and interpretability impedes spatial information integration and cross-modal reasoning required clinically. Key challenges arise from significant physical meaning differences across modalities, spatial misalignment due to scan intervals, and the need for complex multi-feature interpretation in tasks like glioma grading. While visual-language models (VLMs) show promise in cross-modal understanding, existing methods focus mainly on 2D image modeling, neglecting direct perception of 3D volumetric space. Although 3D VLMs have been proposed for report generation and feature alignment in 3D CT imaging, mpMRI applications demand collaborative inference across multiple imaging modalities-a requirement unmet by current solutions. To address this, we introduce Mr3D-VL, a dedicated visual-language foundation model for multi-parametric 3D MRI. With 4 billion parameters, it employs an unsupervised pre-trained shared 3D encoder and 4D rotational positional embedding for dual modality-spatial integration. Its cross-modal projection layer uses a multi-resolution feature implantation strategy to enhance feature perception across resolutions. Experimental results show significant improvements over existing 4B/7B/30B domain-specific and general-purpose models in text generation tasks, achieving a BERTScore of 0.856 for report generation, with question-answering accuracy at 0.713 and multiple-choice accuracy at 0.912.

[37] From Visual Widgets to UI Code: Efficient Tool-Grounded Generation cs.CV | cs.LGPDF

Houston H. Zhang, Tao Zhang, Li Gu, Linfeng Ye, Yuanhao Yu

TL;DR: 本文提出WidgetGen，一种轻量级工具接地框架，用于从视觉小部件生成UI代码，旨在平衡灵活性与可控性。该方法通过提取文本和颜色证据、执行布局和图表推理，直接生成可执行的JSX代码，避免了结构化管道的固定模式限制。

Details

Motivation: 现有截图转代码系统在灵活性与可控性之间存在权衡：直接多模态生成可能产生幻觉细节，而结构化管道虽减少错误但引入额外编排并限制输出设计。本文研究选择性工具接地是否能改善直接小部件到代码生成的保真度-效率权衡。

Result: 在六个多模态模型和1,000个保留小部件上，WidgetGen在大多数视觉重建指标上优于直接提示和结构化Widget2Code管道，在面积、可读性和样式方面获得一致增益。通过监督微调，重建衍生的图像-代码对提升了六个Qwen系列开源模型的所有报告指标。

Insight: 创新点在于选择性证据接地框架，它减少了对组件级生成的依赖，同时避免了固定UI模式，提供了一种有效的替代广泛表示约束的方法。从客观角度看，该方法通过轻量级工具整合，在保持生成灵活性的同时提高了代码生成的准确性和可控性。

Abstract: Existing screenshot-to-code systems face a trade-off between flexibility and controllability. Direct multimodal generation can hallucinate visible details, whereas structured pipelines reduce such errors through component-wise decomposition, predefined templates, and customized intermediate representations. These structures, however, introduce additional generative orchestration and restrict outputs to designs covered by the representation. We investigate whether selective tool grounding can improve the fidelity–efficiency trade-off of direct widget-to-code generation. We introduce \textbf{WidgetGen}, a lightweight tool-grounded framework that extracts observable text and color evidence, performs high-level layout and optional chart reasoning, and directly generates executable JavaScript XML (\emph{JSX}). This design reduces reliance on component-wise generation while avoiding a fixed UI schema. Across six multimodal models and (1{,}000) held-out widgets, WidgetGen outperforms direct prompting and the structured Widget2Code pipeline on most visual reconstruction metrics, with consistent gains in area, legibility, and style. Finally, reconstruction-derived image-code pairs improve six Qwen-family open-weight models across every reported metric through supervised fine-tuning. These results establish WidgetGen as a strong lightweight baseline and show that selective evidence grounding offers an effective alternative to extensive representation constraints.

[38] EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory cs.CV | cs.AI | cs.CL | cs.HCPDF

Le Zhang, Ke Sun

TL;DR: 论文提出了EgoCITE框架，旨在解决长时程第一人称记忆系统中存在的两个瓶颈：基于上下文贫乏描述的索引不可靠，以及检索过程忽略了问题的时间意图。该框架通过上下文增强的索引和时序感知的检索，将连续的第一人称视频和音频转化为可搜索的记忆记录，用于第一人称问答任务。

Details

Motivation: 现有长时程第一人称记忆系统存在两个主要瓶颈：一是基于缺乏上下文信息的描述构建的索引在智能体搜索中不可靠；二是检索过程未能充分考虑问题中蕴含的时间意图，导致检索结果不准确。

Result: 在EgoLifeQA、EgoMem和EgoR1-Bench三个基准测试上，EgoCITE在答案准确性和目标事件检索对齐方面均优于基线方法，准确率至少提升了4.4%到14.2%，同时其成本比长上下文LLM智能体降低了36倍。

Insight: 创新点在于提出了一个集成了上下文增强索引和时序感知检索的完整框架。具体包括：EgoScheme利用局部多模态上下文生成自包含的原子记忆索引；EgoIndex组织多粒度、多视角（动作、活动、话语、对话）的记忆表示；EgoRetrv结合语义搜索与问题条件化的时序相关性评分来优化证据检索。这为解决第一人称记忆中的上下文缺失和时间意图建模问题提供了系统性的方案。

Abstract: Long-horizon egocentric memory transforms continuous first-person video and audio into a searchable record of past experiences. We demonstrate two bottlenecks in existing systems: indices built from context-poor captions are unreliable for agentic search, while retrieval ignores a question’s temporal intent. To address both bottlenecks, we introduce EgoCITE (Egocentric Context-augmented Indexing and Time-aware Evidence retrieval), a long-horizon agentic memory framework for egocentric QA. EgoCITE comprises three components. EgoScheme uses local multimodal context to turn fragmentary video captions and speech transcripts into self-contained atomic memory indices. EgoIndex organizes complementary action, activity, utterance, and conversation representations into searchable multi-view memory indices at multiple granularities. EgoRetrv combines semantic search with question-conditioned temporal relevance scoring and curation of retrieved evidence. We evaluate EgoCITE on EgoLifeQA, EgoMem, and EgoR1-Bench in terms of answer accuracy and target-event retrieval alignment. EgoCITE improves accuracy over agentic memory baselines by at least 4.4–14.2% while achieving 36$\times$ lower cost than long-context LLM agents.

[39] Class Geometry as Supervision for Sample-Efficient Open-World Detection cs.CVPDF

Akash Rao, Zhou Chen, Revanth Reddy Palem, Udhav Ramachandran, Ruth Scimeca

TL;DR: 本文提出了一种名为类几何监督（CGS）的通用框架，用于提升开放世界目标检测的样本效率。该框架通过学习类原型或类表示空间，使其与从训练数据中估计出的视觉或语义类别差异保持一致，从而保留类别间的结构关系。实验表明，CGS在多个任务（如原型识别、少样本生物医学目标检测、开放集检测、新类插入和OWOD适应）中均能有效提升性能。

Details

Motivation: 开放世界目标检测需要在数据稀缺（如生物医学和科学成像）且类别细粒度差异细微的场景下，识别已知类别、拒绝未知物体并随时间纳入新类。现有的原型检测器通常将类原型作为独立锚点学习，忽略了类别间的结构关系，这是本研究的出发点。

Result: 在COCO等基准上的实验表明，CGS显著提高了识别和开放词汇检测的样本效率，大幅增强了新类插入能力，并在保持已知类别检测性能的同时，提升了未知类别的召回率。消融实验显示，有意义的视觉几何能带来最可靠的性能增益。

Insight: 论文的核心创新点在于将类别间的几何关系（视觉或语义差异）作为一种监督信号，通过距离保持目标函数约束学习到的类表示空间。这为在有限监督下构建校准良好且可扩展的开放世界检测器提供了一种有效方法，强调了利用类别间关系结构的重要性。

Abstract: Open-world object detection requires models to recognize known categories, reject unfamiliar objects, and incorporate new classes over time. This is especially challenging in scarce-data settings such as biomedical and scientific imaging, where rare categories may have only a few annotated examples and fine-grained classes differ by subtle morphology. Prototype-based detectors are natural for this regime, but they typically learn class prototypes as independent anchors, ignoring relational structure among classes. We propose class-geometry supervision (CGS), a general framework that constrains learned prototype or class-representation spaces to preserve visual or semantic class dissimilarities estimated from training data. CGS introduces a dissimilarity-preserving objective that aligns pairwise distances among learned class representations with a target class-geometry matrix while retaining the standard task loss. We instantiate the same objective across prototype recognition, few-shot biomedical object detection, open-set detection, novel-class insertion, and OWOD adaptation on COCO. Experiments show that CGS improves sample efficiency in recognition and ova detection, substantially strengthens novel-class insertion, and improves unknown recall on COCO while retaining much of the known-class detection performance. Ablations show that meaningful visual geometry provides the most reliable gains, while random geometry can help novel separation but is less consistent for few-shot detection. These results suggest that relational class geometry is an effective supervisory signal for building calibrated and extensible open-world detectors under limited supervision.

[40] VOS-Agent: The 1st Place Solution for the 8th LSVOS Challenge (MOSEv2 Track) cs.CVPDF

Canyang Wu, Jinrong Zhang, Xusheng He, Ce Bian, Xianjing Han

TL;DR: 本文提出了VOS-Agent，一个用于复杂视频目标分割的协作框架。该框架以SAM3作为共享的密集分割模块，并根据目标特性（常规、微小或语义主导）条件激活专门的代理来处理不同情况，以应对严重遮挡、消失和重现的挑战。

Details

Motivation: 解决复杂视频目标分割中，单一推理路径对于视觉证据不足的微小目标和依赖明确属性的语义主导目标不可靠的问题。

Result: 在MOSEv2测试集上，VOS-Agent在官方J&F指标上达到69.82%，并在ECCV 2026第八届LSVOS挑战赛的MOSEv2赛道中排名第一。

Insight: 创新点在于提出了一个路由和协作框架，将SAM3与专门代理（视觉跟踪代理和基于MLLM的语义代理）结合，针对不同目标类型（微小、语义主导）采用定制化处理策略，而非单一模型路径。

Abstract: Complex video object segmentation requires robust target propagation under severe occlusion, disappearance and reappearance. Although SAM3 provides strong promptable mask propagation, a uniform inference path remains unreliable for tiny targets with insufficient visual evidence and semantic-dominated targets whose identities depend on explicit attributes. To this end, we present VOS-Agent, a collaborative framework that retains SAM3 as the shared dense segmentation module and conditionally activates specialized agents according to target characteristics. A Target Perception and Routing Agent assigns each sequence to a regular, tiny, or semantic-dominated route. Tiny targets are supported by a Visual Tracking Agent through confidence-aware box prompts, while semantic-dominated targets are handled by an MLLM-based Semantic Agent through description-guided localization and candidate verification. On the MOSEv2 test set, VOS-Agent achieves 69.82% on the official $\mathcal{J}&\dot{\mathcal{F}}$ metric and ranks first in the MOSEv2 Track of the 8th LSVOS Challenge at ECCV 2026.

[41] Towards Sparsely Annotated Open-World Object Detection cs.CVPDF

HeeJu Han, AJeong Kim, Jinsun Park

TL;DR: 本文提出了一种名为稀疏标注开放世界目标检测（SA-OWOD）的新任务，旨在同时处理稀疏标注（即部分已知物体未被标注）和开放世界（即存在未知类别物体）的挑战。作者设计了一个名为双视角目标发现（DPOD）的统一框架，通过已知目标恢复模块（KTRM）和双分歧目标生成器（DDTG）来联合建模未标注的已知和未知实例，以解决由模糊未标注区域引起的矛盾监督信号。

Details

Motivation: 现实世界中的目标检测通常面临模糊的监督信号：未标注区域可能对应着已知物体的缺失标注，也可能对应着真正的未知类别物体。现有的稀疏标注目标检测（SAOD）和开放世界目标检测（OWOD）分别处理这两个挑战，但它们的共同出现仍是一个未解决的问题。

Result: 在稀疏标注的开放世界基准测试上的实验结果表明，所提出的DPOD方法优于现有的开放世界检测方法，特别是在检测未知物体方面表现突出。

Insight: 论文的核心创新在于将稀疏标注和开放世界检测这两个通常被分开处理的问题统一到一个框架（SA-OWOD）中，并提出了DPOD框架。其关键设计是KTRM模块通过恢复已知物体的监督并正则化特征空间来分离已知与未知表示，以及DDTG模块通过跨视图语义不一致性来可靠地识别未知候选，这种双机制互补的设计有效解决了监督信号的矛盾并稳定了决策边界。

Abstract: Real-world object detection operates under ambiguous supervision, where unlabeled regions may correspond to missing annotations of known objects or genuinely unknown categories. These challenges have been addressed separately in Sparsely Annotated Object Detection (SAOD) and Open-World Object Detection (OWOD). In practice, their co-occurrence remains an open problem. To address this problem, we introduce Sparsely Annotated Open-World Object Detection (SA-OWOD), a new task that jointly considers sparse supervision and the presence of unseen categories. We propose Dual-Perspective Object Discovery (DPOD), a unified framework that jointly models unlabeled known and unknown instances via two complementary mechanisms. The Known Target Recovery Module (KTRM) recovers supervision for unlabeled known instances and explicitly regularizes the feature space to separate known and unknown representations. Complementarily, the Dual-Disagreement Target Generator (DDTG) identifies reliable unknown candidates through cross-view semantic inconsistency. By integrating these modules, DPOD resolves contradictory supervision signals caused by ambiguous unlabeled regions. As a result, it prevents misclassification between known and unknown objects and stabilizes the decision boundaries. Experimental results on sparsely annotated open-world benchmarks demonstrate that the proposed method outperforms existing open-world detection methods, particularly in detecting unknown objects.

[42] A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules cs.CVPDF

Abdul Mueez, Yogesh S. Rawat, Shruti Vyas

TL;DR: 本文提出了一种名为生成式缺陷隔离（GDI）的方法，用于改进光伏组件电致发光（EL）图像中的多标签缺陷分类。该方法利用LaMa修复模型和快速傅里叶卷积，通过移除选定缺陷来生成逼真的单缺陷训练样本，从而解决多缺陷共现导致的学习模糊性问题。实验表明，GDI在多种模型架构上显著优于基线方法，尤其在数据稀缺场景下能大幅提升稀有缺陷类别的性能。

Details

Motivation: 解决光伏电池EL图像中多标签缺陷分类的挑战，特别是当多个缺陷同时出现时会导致学习模糊，难以分离特定缺陷类型的视觉特征，且单个类别的样本稀缺加剧了这一问题。

Result: 在Vision Transformer（ViT-S, ViT-L）和EfficientNetV2-L架构上的广泛实验表明，GDI显著优于基线方法。性能提升在低数据场景下最为明显，稀有缺陷类别的F1分数最高提升了63.6%，同时将共现缺陷导致的分类错误减少了26%，为该领域设定了新的性能基准。

Insight: 创新点在于利用图像修复技术（LaMa）生成单缺陷样本，以数据增强的方式解决多标签分类中的学习模糊和样本不平衡问题。从客观角度看，这是一种将生成模型创造性应用于特定领域数据增强的有效策略，能够最大化利用现有分割数据集的价值。

Abstract: This paper addresses the challenge of multi-label defect classification in electroluminescence (EL) images of photovoltaic (PV) cells. Training models on images where multiple defects co-occur creates learning ambiguity, making it difficult to disentangle visual features for specific defect types, a problem compounded by the scarcity of examples for individual classes. To tackle this, we introduce Generative Defect Isolation (GDI), utilizing the LaMa inpainting model with Fast Fourier Convolutions to remove selected defects and generate realistic, single-defect training samples. Extensive experiments on Vision Transformer (ViT-S, ViT-L) and EfficientNetV2-L architectures demonstrate that GDI significantly outperforms baselines. The performance gains are most pronounced in low-data scenarios; class-wise analysis shows substantial improvements, boosting the F1-Score for rare defect classes by up to 63.6%. Furthermore, GDI effectively resolves learning ambiguity from co-occurring defects, yielding a 26% reduction in such co-occurring classification errors. Our work establishes GDI as an effective method for maximizing the value of existing segmentation datasets and sets a new performance benchmark for multi-label classification in this domain.

[43] Dual-Manifold Geometry Guided Representation Learning: Adaptive Coupling between Kernel and Data Spaces cs.CVPDF

Wencong Zhang, Yue Zhang, Meiyan Huang, Wei Yang, Qianjin Feng

TL;DR: 本文提出了一种双流形视角下的表示学习方法，将卷积层视为由卷积核诱导的核流形和由特征表示构成的数据流形耦合而成。基于此，作者设计了核引导特征变换（KGFT）模块，该模块从核Gram矩阵中提取几何引导矩阵，用以显式地重塑特征间的协方差结构，从而将核流形的几何信息迁移到数据流形。该方法通过深度感知调度和可学习的引导强度自适应控制几何变换的贡献，在浅层促进几何对齐，在深层鼓励特征多样性。

Details

Motivation: 现有深度表示学习主要关注特征在网络层间的演变，而忽略了网络参数中蕴含的结构化几何信息。本文旨在探索并利用卷积层中核参数与数据特征之间耦合的几何空间，以参数几何为特征演化提供互补的结构信息。

Result: 在基于CNN和Transformer的多种架构（包括ResNet、ViT和LLaMA-7B）上进行的广泛实验表明，该方法在图像分类和算术推理任务上均取得了持续的性能提升，验证了其通用性和有效性。

Insight: 核心创新点在于提出了双流形几何视角，并设计了KGFT模块来显式地利用核参数几何引导特征表示学习。与传统的注意力机制仅重加权特征响应不同，KGFT通过变换特征协方差结构来重塑特征关系，实现了从参数空间到特征空间的几何信息迁移。其深度感知的自适应调度策略也颇具借鉴意义，能根据网络层次动态调整几何约束的强度。

Abstract: Deep representation learning has primarily focused on how features evolve across network layers, while largely overlooking the structured geometry embedded in network parameters. We introduce a dual-manifold perspective in which each convolutional layer contains two coupled geometric spaces: a Kernel Manifold induced by convolutional filters and a Data Manifold characterized by intermediate feature representations. Because these manifolds share the same channel space, parameter geometry can provide complementary structural information to guide feature evolution. Based on this insight, we propose Kernel-Guided Feature Transform (KGFT), a lightweight module that derives a geometric guidance matrix from the kernel Gram matrix and uses it to transform the covariance structure of feature representations. Unlike conventional attention mechanisms that reweight feature responses, KGFT explicitly reshapes feature relationships by transferring geometric information from the kernel manifold to the data manifold. To accommodate network hierarchy, we further introduce Exploit and Explore modes with a depth-aware scheduling strategy and a learnable guidance strength that adaptively controls the contribution of geometric transformation. This design promotes geometric alignment in shallow layers while encouraging feature diversity in deeper layers, without imposing excessive constraints on representation learning. Theoretical analysis establishes the validity of the proposed transformation and characterizes its effect on feature covariance. Extensive experiments across CNN- and Transformer-based architectures, including ResNet, ViT, and LLaMA-7B, demonstrate consistent improvements on image classification and arithmetic reasoning tasks, validating the generality and effectiveness of kernel-guided dual-manifold representation learning. Code will be publicly available.

[44] Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors cs.CV | cs.CLPDF

LingKai Bu

TL;DR: 本文提出了一种名为双流交叉锚点校正（DSCC）的方法，用于解决多模态大语言模型在生成长描述时出现的物体幻觉问题。该方法通过在微调过程中将物体级视觉锚点注入语言模型，结合感知流和认知流以及两阶段课程门控机制，实现了在长描述生成中显著降低幻觉并提高精度。

Details

Motivation: 多模态大语言模型中的物体幻觉源于语言先验和语料共现偏差压倒视觉证据，导致模型提及图像中不存在的物体。现有方法多在后处理阶段干预，但在统一协议下对长描述效果有限；监督微调（SFT）虽能延长描述，但仍有超过40%的物体命名错误。本文旨在通过注入视觉锚点来约束生成过程，从根本上减少幻觉。

Result: 在长描述幻觉、物体存在性判别和跨域泛化实验中，DSCC在单一骨干网络和评分协议下，实现了基线描述长度约1.9倍的增长，每个物体提及的精度达到88.19%，这是密度无关标准下的最高水平。该方法在长描述、低幻觉区域达到最优，而消融实验显示感知流和认知流之间存在协同效应。

Insight: 创新点在于首次在微调期间将物体级视觉锚点注入语言模型本身，通过感知流对齐隐藏状态和认知流交叉注意力查询锚点，结合课程门控使证据检索成为自回归步骤的结构性约束。客观分析表明，该方法通过分层注入视觉信息有效缓解了幻觉，但协同效应受锚点语义域限制，在图表和光学幻觉等域外基准上失效，揭示了方法的领域条件性。

Abstract: Object hallucination in multimodal large language models arises when language priors and corpus co-occurrence bias outweigh the visual evidence, with nothing tying an individual object mention to what the image shows. Most remedies intervene at decoding time without training, yet under a unified protocol their benefit is confined to short captions;supervised fine-tuning (SFT) on a detail- rich corpus lengthens captions, but over forty percent still name absent objects. This paper proposes Dual-Stream Cross-Anchor Correction (DSCC). Unlike work that post-processes decoding, DSCC is the first to inject object-level visual anchors into the language model itself during fine- tuning: a perception stream aligns object-level hidden states at an intermediate layer to frozen text anchors by a bidirectional contrastive objective; a cognition stream lets deeper layers query those anchors by cross-attention at every generation step; and a two-stage curriculum gate couplesthem, making evidence retrieval a structural constraint at each autoregressive step. Under one backbone and one scoring protocol, experiments span long-caption hallucination, object-existence discrimination and cross-domain generalisation, with vanilla SFT on the same corpus and schedule as a length- and density-matched control, so gains are attributed layer by layer. DSCC is the only method reaching the long-caption, low-hallucination region: captions roughly 1.9 times the baseline length at 88.19% precision per object mention, the highest under a density-independent criterion. Ablations expose a synergy: the perception stream alone degrades precision yet reverses sign when stacked on the cognition stream. No universal superiority is claimed: three out-of- domain benchmarks yield a predictable, falsifiable domain-conditionality, the synergy being bound to the anchors’ semantic domain and breaking on charts and optical illusions.

[45] Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding cs.CVPDF

Junyi Hu, Tian Bai, Fengyi Wu, Yian Huang, Wei Wen

TL;DR: 本文提出了一种面向统一开放词汇视觉定位的数据-模型协同设计框架，旨在解决指称表达理解任务中模型因数据集特定微调导致的表示退化与跨数据集泛化能力受限问题。该框架包含调制注意力对比头用于高效的词级视觉-语言对齐，以及一个文本条件JEPA辅助流来提供互补梯度支持以保留对齐活性表示，同时引入了Objects365-Caption数据集进行大规模语言监督。

Details

Motivation: 动机在于从统一开放词汇定位的视角重新审视指称表达理解任务，识别出表示退化是阻碍单一通用模型扩展的关键障碍，旨在通过保持表示多样性来提升模型的跨数据集泛化能力。

Result: 在标准REC基准测试中取得了极具竞争力的性能，同时在无需针对特定基准调整的情况下，在异构的视觉定位数据集上表现出强大的泛化能力。

Insight: 创新点包括提出调制注意力对比头实现高效对齐、引入文本条件JEPA辅助流提供互补梯度支持以保留对齐活性表示而不增加推理开销，以及通过理论分析表明互补梯度子空间能保持对齐能力从而扩展表示多样性；从数据侧引入Objects365-Caption数据集提供了大规模上下文感知的指称表达监督。

Abstract: Referring Expression Comprehension (REC) is commonly studied under dataset-specific fine-tuning, resulting in specialist models with limited cross-dataset generalization. In this work, we revisit REC from the perspective of unified open-vocabulary grounding and identify representation degeneration as a key obstacle to scaling a single generalist model. To preserve representation diversity, we propose a holistic data-model co-design framework. Architecturally, we introduce the Modulated Attention-Contrastive Head (mACH) for efficient token-level vision-language alignment and a text-conditioned JEPA auxiliary stream that provides complementary gradient support to preserve alignment-active representations without inference overhead. On the data side, we introduce Objects365-Caption, enriching Objects365 with context-aware referring expressions for large-scale language supervision. We further provide a theoretical analysis showing that complementary gradient subspaces preserve alignment capacity and thereby scale representation diversity. Extensive experiments demonstrate that our single-checkpoint framework achieves highly competitive performance on standard REC benchmarks while exhibiting strong generalization across heterogeneous grounding datasets without benchmark-specific adaptation.

[46] PatchGen: Learning Soft Intra-Image Predictive Subsets for Visual Generalization cs.CVPDF

Zhaorui Tan, Weimiao Yu, Xi Yang

TL;DR: 本文提出PatchGen方法，通过识别图像中与标签预测相关的自适应子区域来提升视觉分类器的泛化能力。该方法基于理论分析，认为每个图像存在一个足以预测标签的‘预言子集’，而其余区域为可能干扰泛化的非必要上下文。PatchGen模块学习样本依赖的软掩码来近似该子集，在多种数据偏移场景下提升性能。

Details

Motivation: 现有视觉分类方法主要关注域不变性，但忽略了图像内部预测充分性问题，即图像中可能只有部分区域对标签预测是充分且必要的，而其余上下文可能干扰模型在数据偏移下的泛化。

Result: 在涵盖自然图像和组织病理学图像的多个基准测试中，PatchGen在大多数评估配置下超越了匹配骨干网络的基线方法，提升了平均性能，增强了向未知类别的泛化能力，并且在无文本监督的情况下与视觉-语言方法保持竞争力。

Insight: 核心创新在于提出了‘图像内部预测子集’的结构性假设，并设计了任务驱动的软掩码学习模块PatchGen来近似该子集，这为提升模型在数据偏移下的鲁棒性提供了一种新思路，即通过关注图像中与任务最相关的区域来过滤可能造成虚假相关的上下文信息。

Abstract: Visual classifiers are expected to generalize under data shifts, target shifts, and their combinations, yet most existing methods focus on domain invariance while failing to address intra-image predictive sufficiency. We investigate the structural hypothesis that each image contains a sample-adaptive oracle intra-image predictive subset sufficient for label prediction, while the remaining patches form non-essential complementary context that may correlate with the label. The theoretical analysis shows that restricting prediction to this oracle subset preserves the Bayes risk achievable by the full-patch representation while admitting a complexity bound that tightens with the oracle-subset size. Based on this view, we propose PatchGen, a text-free module that learns a sample-dependent soft predictive-subset mask as a task-driven proxy for the unobserved oracle subset mask. Specifically, histopathology visualizations suggest that PatchGen assigns higher scores to tumor-consistent regions than to some frequently co-occurring inflammatory context. Extensive experiments on natural and histopathological image benchmarks spanning all three shift settings show that PatchGen improves average performance over matched-backbone baselines in most evaluated configurations, enhances generalization to unknown classes, and remains competitive with vision-language methods without text supervision.

[47] SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention cs.CVPDF

Qi Zhao, Qirui Li, Hanlin Tang, Yiduo Li, Zhen Guo

TL;DR: 本文提出了一种名为SCOPE的无训练稀疏注意力框架，用于解决视频扩散变换器（DiTs）中自注意力计算成本过高的问题。该方法通过结合3D-RoPE对齐的键子空间聚类和在线逐头Top-k估计，在保持高保真度的同时显著提升了推理速度。

Details

Motivation: 现有无训练稀疏注意力方法通常基于块级或簇级代理分数构建稀疏掩码，这可能会掩盖键之间的细粒度差异，并在高稀疏度下遗漏贡献度高的键。同时，固定的Top-k最小值无法适应不同注意力头和输入之间的变化。

Result: 在六个模型-任务配置上，SCOPE在保真度和延迟方面均优于现有无训练基线方法。在720p HunyuanVideo上，相对于稠密注意力，SCOPE实现了高达1.99倍的端到端加速，同时保持了28.46 dB的PSNR。

Insight: 创新点在于将3D-RoPE对齐的键子空间聚类与在线逐头Top-k估计相结合。具体而言，将键划分为时空子空间进行独立聚类，并通过查找表聚合中心分数以获得每个查询簇的代理分数；同时，根据每个注意力头内初始保留键数的加权平均值，在线动态确定每个头特定的Top-k值，从而自适应地选择关键键值对。

Abstract: Diffusion Transformers (DiTs) incur quadratic self-attention cost over spatiotemporal tokens. Existing training-free sparse attention methods often construct sparse masks from block-level or cluster-level proxy scores, which can obscure fine-grained differences among keys and miss high contribution keys under aggressive sparsity. Moreover, such proxy scores may yield overly concentrated softmax distributions, causing Top-$p$ to retain too few keys for some query clusters. Although a fixed Top-$k$ minimum alleviates this failure mode, a shared value cannot adapt to variations across heads and inputs. To address both limitations, we propose SCOPE, a training-free sparse attention framework that combines 3D-RoPE-aligned key subspace clustering with online per-head Top-$k$ estimation for efficient video-DiT inference. SCOPE partitions post-RoPE keys into temporal, height, and width subspaces, clusters them independently, and aggregates the corresponding centroid scores through lookup tables to obtain per key proxy scores for each query cluster. Building on existing hybrid Top-$p$/fixed Top-$k$ selection, SCOPE derives a head-specific Top-$k$ value online by averaging the initial retained key counts within each head, weighted by query cluster size, and selects additional keys only for query clusters whose initial retained key counts fall below this value. Sparse attention is then computed over the selected original keys and values. Across six model–task configurations, SCOPE consistently outperforms existing training-free baselines in both fidelity and latency, achieving up to a $1.99\times$ end-to-end speedup on 720p HunyuanVideo with $28.46$ dB PSNR relative to dense attention.

[48] Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs cs.CVPDF

Xinming Wang, Weinong Wang, Hongming Yang, Yansong Lin, Zheng Ruan

TL;DR: 本文针对混合思维多模态大语言模型（MLLMs）中思维与非思维推理模式间的响应行为不一致问题，提出了PatternEval诊断基准和PatternRL对齐框架。PatternEval通过2,415个多模态提示评估了四种常见响应模式失败，发现非思维推理模式失败率显著更高。PatternRL则通过引入模式特定的惩罚项进行强化学习，有效缓解了跨模式错位问题。

Details

Motivation: 混合思维MLLMs允许模型在深思熟虑的思维模式和低延迟的非思维推理模式间切换，但两种模式应满足相同的用户侧质量标准。仅靠正确性不足以衡量响应质量，因此需要评估任务准确性和响应模式失败作为互补指标，以解决思维与非思维接口间响应行为可能存在的系统性错位问题。

Result: 在PatternEval基准测试中，发现不同提供商的模型普遍存在响应模式失败，且非思维推理模式的失败率显著更高。在Qwen3-VL-4B和Qwen3-VL-8B模型上的实验表明，PatternRL方法（结合PatternRM奖励模型和模式特定惩罚的强化学习）能够有效缓解跨模式错位，仅带来边际的任务性能权衡。

Insight: 创新点在于提出了’响应模式对齐’这一新评估维度，并构建了专门诊断思维链泄露、响应重复、逻辑矛盾和表演性推理等四种模式失败的PatternEval基准。从客观角度看，将模式特定的惩罚项整合进强化学习目标，为解决模型不同推理模式间行为一致性提供了一个可借鉴的训练框架。

Abstract: Hybrid-thinking multimodal large language models (MLLMs) allow a single model to alternate between deliberative thinking and latency-efficient non-thinking inference. Although these modes differ in reasoning budget, their delivered responses should satisfy the same user-facing standard. Correctness alone may not characterize this response quality; we therefore evaluate task accuracy and response-pattern failures as complementary outcomes. We study this gap through \textbf{response-pattern alignment}: whether thinking and non-thinking interfaces preserve acceptable final-response behavior. We introduce \textbf{PatternEval}, a failure-enriched diagnostic benchmark comprising 2,415 multimodal prompts spanning visual perception and grounding, structured image understanding, and multimodal knowledge reasoning. PatternEval tests four recurrent failures: chain-of-thought leakage, response repetition, logical contradiction, and performative reasoning. Response-pattern failures are widespread across models from different providers, with non-thinking inference exhibiting substantially higher failure rates and thereby creating systematic misalignment between thinking and non-thinking interfaces. Motivated by this diagnosis, we develop \textbf{PatternRM}, a response-level reward model, and \textbf{PatternRL}, which introduces pattern-specific penalties during reinforcement learning. Experiments on Qwen3-VL-4B and Qwen3-VL-8B show that incorporating pattern-specific penalties into reinforcement learning can mitigate cross-mode misalignment while incurring a marginal task performance trade-off. Together, PatternEval and PatternRL provide an evaluation-and-training framework for aligning user-visible response patterns across hybrid-thinking interfaces.

[49] Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformers cs.CVPDF

Qiao Li, Xiaomeng Fu, Yuanshu Zhao, Qipeng Wang, Jiao Dai

TL;DR: 本文提出了一种无需调参的概念擦除方法，通过操纵多模态扩散变换器（MM-DiT）的内部表示来实现。该方法基于对MM-DiT中间块语义表示的分析，构建并注入一个引导向量，有效擦除敏感或不适当内容，同时保持生成质量。

Details

Motivation: 针对MM-DiT等先进大模型在生成内容时可能产生敏感或不安全内容的风险，现有概念擦除方法大多需要修改模型参数或不适用于大规模MM-DiT，因此需要一种高效、无需训练且架构无关的解决方案。

Result: 在多个MM-DiT模型上的广泛实验表明，该方法在擦除多样概念上达到了最先进的性能，能有效控制最终输出，并对抗性攻击具有鲁棒性。

Insight: 创新点在于发现MM-DiT中间块的文本条件语义表示对概念控制最为关键，并据此构建单一引导向量进行注入；该方法仅操作稀疏文本分支令牌，利用整流流的直线采样轨迹，实现了高效且无需训练的概念擦除。

Abstract: Multimodal Diffusion Transformers (MM-DiTs) have demonstrated remarkable text-to-image generation performance, surpassing traditional U-Net-based diffusion models. Nevertheless, their powerful generative capabilities also raise significant safety concerns, as they may generate sensitive or inappropriate content. While existing concept erasure methods aim to mitigate such risks, most require modifying model parameters, which are often architecture-specific and impractical for deployed larger models. Several tuning-free approaches face challenges when applied to advanced large-scale MM-DiTs due to their deeply embedded knowledge, broad semantic space, and context-dependent text encoders. To address these challenges, we propose to erase concepts by directly manipulating the model’s internal representations. Our key insight, derived from an in-depth analysis of MM-DiT’s block-wise generative roles, is that text-conditioned semantic representations are most salient in the middle blocks of MM-DiTs. Based on this, we extract representations of an unwanted concept and a desirable safe one from the middle block, construct a steering vector from their difference, and inject this single vector into consecutive early and middle blocks. By operating exclusively on the sparse text-branch tokens and leveraging the straight sampling trajectory of rectified flow, our method achieves effective concept erasure with negligible overhead and without any training. Extensive experiments across MM-DiT models demonstrate that our method achieves state-of-the-art performance in erasing diverse concepts, enables effective control over the final output, and remains robust to adversarial attacks.

[50] SPARED: Reasoning-Based AI-Generated Image Detection via Adversarially Edited Data cs.CV | cs.AIPDF

Yicheng Bao, Xiahui Guo, Xuhong Wang, Xin Tan

TL;DR: 本文提出SPARED框架，通过对抗性强化学习训练一个能检测AI生成图像并提供自由形式推理解释的模型。该框架让一个扩散图像编辑器学习将真实照片编辑成能欺骗当前检测器的伪造图像，同时让一个多模态大语言模型学习基于推理揭露这些伪造图像。

Details

Motivation: 现有AI生成图像检测器存在三个缺陷：真实与伪造图像来源不同导致模型依赖来源捷径；监督式解释语料导致模板化推理；静态伪造数据集无法跟上生成器的快速演进。需要一种能提供可靠解释并动态适应生成器进步的检测方法。

Result: 在三个外部基准测试上，通过该框架训练的检测器性能随训练轮次单调提升，表明其能有效泛化而非记忆固定伪造特征分布。

Insight: 创新性地采用异构模型对抗训练框架，通过设计防捷径奖励机制（攻击者仅在编辑忠实执行时获奖励，防御者仅在判决正确时获奖励），迫使检测器学习泛化能力；仅优化检测准确性的训练意外提升了自由形式推理解释的质量。

Abstract: Detecting AI-generated images is only half the task: a deployed detector must also justify its verdict, yet existing detectors inherit three failure modes from their training data: real and fake images collected from different sources invite provenance shortcuts, supervised explanation corpora teach templated rationales, and a static forgery corpus leaves the decision boundary standing still while generators keep moving. We introduce \methodname{}, an adversarial reinforcement learning framework that pits two heterogeneous models against each other. A diffusion image editor learns to edit real photographs into fake counterparts of those same photographs that fool the current detector, while a reasoning MLLM learns to expose them with a verdict grounded in free-form reasoning. Both rewards are shortcut-proof by design: the attacker is credited only when its edit is faithfully executed, and the defender only when its verdict is correct. As the two models alternate, each round’s attacker regenerates a harder training pool aimed at the current detector’s blind spots, so the detector must generalize rather than memorize any fixed artifact distribution. Although the explanation is never rewarded, its quality rises round over round as a side effect of accuracy-only training. A detector trained within this loop improves monotonically across rounds on each of three external benchmarks.

[51] Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval cs.CV | cs.AIPDF

Huu-An Vu, Cam Tu Tran Thi, Thanh Toan Le Ngo, Hoang Vo, Do Trung Hieu

TL;DR: 本文提出了一个用于基于文本的行人异常检索的异构视觉-语言集成框架，该框架通过分数对齐和迭代集成融合结合了多种视觉-语言嵌入模型，并采用分歧感知的VLM重排序来处理模糊查询。该方法在AI City Challenge 2026 Track 4的官方PAB基准测试中取得了优异的性能。

Details

Motivation: 基于文本的行人异常检索需要根据自然语言描述从大型图像库中检索出表现出异常行为的行人，这比传统的基于文本的行人检索更具挑战性，因为它需要对行人外观、行为、物体交互和场景上下文进行细粒度推理。

Result: 在官方的Pedestrian Anomaly Behavior (PAB)基准测试上，该方法取得了90.92%的mAP，以及85.13%的Recall@1、97.72%的Recall@5和98.68%的Recall@10，展示了其有效性。

Insight: 创新点在于通过异构视觉-语言模型的集成与融合来增强跨模态匹配的鲁棒性，并引入分歧感知的重排序机制来专门处理模糊查询，这为结合互补的视觉-语言表示与选择性多模态推理以解决大规模细粒度检索问题提供了有效方案。

Abstract: Text-based person anomaly retrieval aims to retrieve pedestrians exhibiting anomalous behaviors from a large image gallery using natural language descriptions. Compared with conventional text-based person retrieval, this task requires fine-grained reasoning over pedestrian appearance, behaviors, object interactions, and scene context, making robust cross-modal matching significantly more challenging. This paper presents the GENAI4E team’s solution to AI City Challenge 2026 Track 4. Our framework builds upon a strong retrieval backbone and progressively integrates heterogeneous vision-language embedding models through score alignment and iterative ensemble fusion, followed by disagreement-aware VLM reranking for ambiguous queries. On the official Pedestrian Anomaly Behavior (PAB) benchmark, our approach achieves 90.92% mAP, 85.13% Recall@1, 97.72% Recall@5, and 98.68% Recall@10, demonstrating the effectiveness of combining complementary vision-language representations with selective multimodal reasoning for large-scale text-based person anomaly retrieval.

[52] NaviDC-OCR: Navigating Document Parsing Across Digital and Camera-Captured Documents cs.CV | cs.AIPDF

Peng Cai, Zhaofan Zou, Shifa Liu, Yikun Wang, Jiawei Tang

TL;DR: 本文提出了NaviDC-OCR，一个用于文档解析的统一框架。它通过引入形变感知学习、自适应采样机制以及内容-结构解耦学习策略，解决了现有基于视觉语言模型（VLM）的方法在几何失真、冗余生成和结构推理不足方面的挑战。

Details

Motivation: 现有基于VLM的文档解析方法面临两大挑战：解耦方法严重依赖精确的布局分析，相机拍摄文档的几何失真会导致级联错误；端到端方法虽然减少了对显式布局检测的依赖，但在高分辨率场景下存在冗余生成、幻觉和结构推理不足的问题。

Result: 在多个文档解析基准测试中取得了SOTA性能：在OmniDocBench v1.6、Wild-OmniDocBench和PureDocBench上的总得分分别为96.87、88.53和78.41，并在ICDAR 2026 Sci-ImageMiner挑战赛中排名第一。

Insight: 创新点包括：1）将几何感知融入VLM的形变感知学习；2）用于复杂布局表示的自适应采样机制；3）显式建模公式语法和表格结构的内容-结构解耦学习策略。这些设计有效提升了模型对几何失真和复杂结构的处理能力。

Abstract: Document parsing aims to transform unstructured documents into structured and machine-readable representations. Recent advances in Vision-Language Models (VLMs) have significantly advanced document parsing. However, existing approaches still face two major challenges. First, decoupled VLM-based methods heavily rely on accurate layout analysis, where geometric distortions in camera-captured documents can introduce cascading errors. Second, although end-to-end VLM-based methods alleviate the dependence on explicit layout detection, they often suffer from redundant generation, hallucinations, and insufficient structural reasoning in high-resolution scenarios. To address these challenges, we propose NaviDC-OCR, a unified framework for document parsing. NaviDC-OCR introduces deformation-aware learning to incorporate geometric perception into VLMs and proposes an adaptive sampling mechanism for complex layout representation. Furthermore, a content-structure decoupled learning strategy is developed to explicitly model formula grammars and table structures, enabling more effective structured representation learning. Extensive experiments demonstrate that NaviDC-OCR achieves state-of-the-art performance across diverse document parsing benchmarks. It obtains overall scores of 96.87, 88.53 and 78.41 on OmniDocBench v1.6, Wild-OmniDocBench, and PureDocBench, respectively, and ranks first in the ICDAR 2026 Sci-ImageMiner Challenge. These results validate the effectiveness and generalization capability of NaviDC-OCR in complex document parsing scenarios.

[53] HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation cs.CVPDF

Yunhao Bai, Zhongwei Qiu, Guangyu Guo, Yiming Huang, Tony C. W. Mok

TL;DR: 该论文提出了HounsWorld，一个用于隐藏患者状态解读、重建和仿真的多模态世界模型。它通过联合理解-生成学习，将容积扫描和临床语言视为共享患者状态的观测，并引入HounsBench基准来统一评估解读、重建和仿真三类任务。

Details

Motivation: 临床智能需要从稀疏的临床语言和密集的医学影像等不完整观测中，推断患者的潜在状态，而非学习从扫描到答案的孤立映射。

Result: HounsWorld在HounsBench基准上，在解读（如查询回答）、重建（如报告生成）和仿真（如低剂量去噪、虚拟对比增强、文本/掩码到容积生成）三类任务家族中均表现出强大的性能，并通过临床结构化的补全持续提升了CT理解能力。

Insight: 核心创新在于将CT为中心的智能统一建模为对共享潜在患者状态的推断，并提出了一个支持多任务输出的统一世界模型架构。技术亮点包括零初始化的CT适配器以保留预训练的多模态映射，以及显式条件化的亨氏单位窗口采样以暴露有临床意义的密度观测。

Abstract: Clinical intelligence requires estimating a patient’s underlying condition from incomplete observations rather than learning isolated mappings from scans to answers. Volumetric medical images provide dense observations of anatomy, attenuation, and lesions, whereas clinical language provides sparse but complementary semantic observations. We formulate CT-centered intelligence as inference over a shared latent patient state, under which readout, reconstruction, and simulation all become state-dependent prediction problems. To operationalize this view, we introduce HounsBench, a computed tomography (CT) centric patient-state benchmark that unifies these three task families with patient-disjoint splits and per-family metrics, and HounsWorld, a 3B multimodal world model that treats volumetric scans and language as observations of the shared state through Joint Understanding-Generation Learning. A shared transformer forms an implicit patient-state estimate and supports three outputs: query-conditioned answers that read out the state, reports and captions that reconstruct it in language, and condition-specific CT volumes for low-dose denoising, virtual contrast enhancement, and anatomy-constrained text-and-mask-to-volume generation. Zero-initialized CT adapters preserve pretrained multimodal mappings, while condition-explicit Hounsfield-unit window sampling exposes clinically meaningful density observations. HounsWorld shows strong performance across all three task families while consistently improving CT understanding through clinically structured completion. Our project is available at https://github.com/byhwhite/HounsWorld.git

[54] Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs cs.CV | cs.CR | cs.MMPDF

Beining Xu, Hairui Wang, Jiaxin Wang, Changsheng Chen, Anirban Chakraborty

TL;DR: 本文聚焦于文档理解多模态大语言模型在身份证处理中的隐私风险，揭示了当输入图像缺乏足够视觉证据时，模型会依赖训练数据中记忆的字段关系来推断缺失内容，导致包含敏感个人信息的多个相关字段隐私泄露。为缓解此风险，论文提出了动态关系遗忘框架、DocPrivacyBench基准，并评估了多种遗忘方法。

Details

Motivation: 解决领域特定多模态大语言模型在关键信息提取任务中，因视觉证据不足而依赖记忆的字段关系进行推断，从而导致关联隐私泄露的独特漏洞问题。

Result: 在提出的DocPrivacyBench基准上评估，现有MLLMs在视觉证据稀缺时（尤其在噪声较大的数据集上）持续表现出隐私泄露；而提出的DRUF方法在泄漏抑制上比最强基线提升了4.8个百分点，在有效缓解隐私风险的同时保持了稳健的文档信息提取性能。

Insight: 创新点在于揭示了文档MLLMs中基于字段关系的隐私泄露新范式，并提出了动态关系遗忘框架来针对性解耦高风险字段对；同时构建了系统评估隐私泄露的基准，为领域特定模型的隐私安全研究提供了新视角和工具。

Abstract: While the privacy risks of multimodal large language models (MLLMs) have drawn significant attention, the unique vulnerabilities of domain-specific MLLMs remain largely underexplored. Focusing on document understanding MLLMs for identity document processing, this paper investigates the privacy issues inherent in Key Information Extraction (KIE) tasks. We reveal that when input images lack sufficient visual evidence, these models often rely on memorized field relations from training data to infer missing content, thereby leaking multiple correlated fields containing sensitive personal information. To mitigate this risk, we make three key contributions.First, we propose the Dynamic Relational Unlearning Framework (DRUF) which comprises a Relational Decoupling Unlearning (RDU) module and a dynamic set update mechanism. It suppresses the leakage of high-risk field pairs while preserving KIE performance.Second, we introduce DocPrivacyBench, a novel benchmark to systematically evaluate a model’s susceptibility to privacy leakage under conditions of absent or minimal visual evidence.Third, we evaluate three MLLMs and six unlearning methods using this benchmark, assessing both post-unlearning leakage suppression and utility preservation.Our results demonstrate that existing MLLMs consistently exhibit privacy leakage when visual evidence is scarce, particularly on noisier datasets. In contrast, DRUF outperforms the strongest baseline by improving leakage suppression by 4.8 percentage points, effectively mitigating privacy risks while maintaining robust document information extraction performance.

[55] A Deep RL based Framework for Targeted White Matter Tractography cs.CVPDF

Ankita Joshi

TL;DR: 本文提出了一种结合强化学习与监督学习的混合框架，专门用于针对特定白质束的纤维追踪。该框架无需依赖真实纤维数据进行训练，并避免了显式分割过程，通过多策略融合提高了追踪的鲁棒性和准确性。

Details

Motivation: 解决传统纤维追踪方法因白质结构复杂性和假阳性问题导致的路径误表征挑战，旨在提升追踪的准确性和可靠性。

Result: 在TractoInferno、HCP和ISMRM-2015等基准公共数据集上进行了广泛验证，展示了框架在不同数据源上的泛化能力和对白质束的准确重建，达到了先进水平。

Insight: 创新点包括结合强化学习与GPT-based策略学习的混合方法，以及可扩展的数据驱动多策略融合框架，减少了对真实标注的依赖，简化了流程并提升了性能。

Abstract: Fiber tractography’s ability to reconstruct the brain’s structural pathways, has made it a crucial component of modern neuroimaging, enabling detailed, non-invasive mapping of structural connectivity and supporting a wide range of neurological research and clinical applications. However, despite its importance, tractography remains a challenging task due to the inherent complexity of white matter structure and its susceptibility to false positives, which can lead to the misrepresentation of critical pathways. To overcome these limitations, in this thesis, we propose a hybrid framework that integrates reinforcement learning with supervised learning for refining RL policies, specifically tailored for tract-specific tractography. Notably, our framework does not rely on ground-truth fibers for training. Moreover, the tract-specific formulation bypasses the need for an explicit segmentation process, simplifying the overall pipeline. Our work includes two main contributions, each building upon the previous. First, we introduce a hybrid approach that combines reinforcement learning with supervised learning (specifically, GPT-based policy learning) to refine policies in a tract-specific context. Second, we propose a scalable framework for data-driven multi-policy fusion, which leverages the complementary strengths of multiple RL policies to improve tractography performance and robustness. We demonstrate the effectiveness of our framework through extensive validation on benchmark public datasets including TractoInferno, HCP, and ISMRM-2015, highlighting its ability to generalize across data sources and accurately reconstruct brain white matter tracts. We believe that these contributions represent significant advancements in the field of tractography, improving robustness, reliability, and accuracy while reducing dependence on ground-truth annotations.

[56] TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos cs.CVPDF

Yifan Mei, Qingling Shi, Changli Wu, Jiayuan Rao, Jiayi Ji

TL;DR: 该论文提出了TennisVAR，一个基于击球证据的多模态大语言模型，用于网球视频中的战术推理。论文引入了TRACE基准数据集，包含大量专家标注的集锦视频、击球事件、战术单元和问答对，以统一细粒度感知和战术理解。模型采用’事件-关系-证据-战术’推理范式，通过事件解析模块和战术图引导的时间推理器来联合建模集锦进程和决策依赖，以识别相关证据和关键动作。

Details

Motivation: 现有网球视频分析方法要么仅感知单个击球而未建模其战术依赖，要么生成高层分析而未将其锚定于底层事件，存在从感知到理解的鸿沟。论文旨在通过提出基于击球证据的战术推理任务来弥合这一差距。

Result: 论文构建了TRACE大规模专家标注基准，包含11,189个集锦视频、41,485个击球事件、25,429个战术单元和11,189个问答对，为评估提供了统一平台。所提模型在该基准上进行了验证，旨在实现细粒度事件感知与高层战术推理的联合。

Insight: 创新点在于提出了’击球证据锚定的战术推理’这一新任务定义，要求模型联合预测开放式答案、分层战术标签、有序支持击球序列和关键动作，并将证据击球锚定到球拍-球接触帧。模型架构上，通过事件解析将连续集锦转换为显式击球事件序列，并利用战术图引导的时间推理器联合建模进程和决策依赖，这是一种新颖的’事件-关系-证据-战术’推理范式。

Abstract: Sports-video understanding is moving beyond event recognition toward explaining how actions collectively shape match progression, however, existing tennis-video methods either perceive individual strokes without modeling their tactical dependencies or generate high-level analyses without grounding them in the underlying events. To bridge this perception-to-understanding gap, we formulate stroke-evidence-grounded tactical reasoning, a new rally-level task that requires models to jointly predict an open-ended answer, a hierarchical tactic label, an ordered sequence of supporting strokes, and decisive key actions, with each evidence stroke anchored to its racket-ball contact frame. We further introduce TRACE (Tactical Reasoning with Action-Chain Evidence in Tennis), a large-scale expert-annotated benchmark containing 11,189 rally videos, 41,485 stroke events, 25,429 tactical units, and 11,189 question-answer pairs, which unifies fine-grained stroke attributes, cross-stroke tactical relations, hierarchical tactic annotations, and evidence-grounded questions across factual perception, tactical understanding, and decision reasoning. Building on TRACE, we propose TennisVAR (Tennis Video Action-chain Reasoner), an evidence-grounded multimodal large language model that follows an “event-relation-evidence-tactic” reasoning paradigm, where an Event Parsing Module converts continuous rallies into explicit stroke-event sequences while a Tactical Graph-Guided Temporal Reasoner jointly models rally progression and same-player decision dependencies to identify question-relevant evidence and decisive actions.

[57] DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation cs.CVPDF

Ziyang Gao, Zhizhuo Jiang, Jingjing Chang, Yixin Yang, Yuwen Pan

TL;DR: 本文提出DiCoR框架，用于高效地解决遥感图像指代分割任务。该框架在联合融合分割（JFS）的高效流程基础上，通过解耦的指代消歧和轮廓重校准机制，提升了分割精度与效率的平衡。

Details

Motivation: 现有方法中，联合融合分割（JFS）效率高但精度受限，而解耦提示分割（DPS）精度高但计算开销大。本文旨在设计一个兼顾高精度与高效率的遥感指代分割框架。

Result: 在RefSegRS、RRSIS-D和RISBench三个基准测试上，DiCoR均取得了最佳分割精度。在RefSegRS上，mIoU和gIoU分别比竞争性JFS方法提升5.28%和2.87%，同时比代表性DPS方法运行速度快4.7%。

Insight: 创新点包括：1）消歧感知的定位引导策略，利用自适应语言线索对候选区域排序并注入定位先验；2）轻量级轮廓重校准模块，在局部轮廓监督下预测残差修正以提升掩码质量，计算开销小。

Abstract: Referring remote sensing image segmentation (RRSIS) aims to delineate targets specified by natural language expressions in remote sensing imagery. Existing methods mainly follow joint fusion segmentation (JFS) or decoupled prompt segmentation (DPS). JFS is efficient but often suffers from limited accuracy because referent localization and mask delineation are optimized under a unified objective, whereas DPS separates localization from mask generation using spatial prompts and foundation segmenters at the cost of higher memory consumption and inference latency. To bridge this gap, we propose DiCoR, a decoupled referent disambiguation and contour recalibration framework built on an efficient JFS pipeline. DiCoR addresses two key challenges: distinguishing the correct referent from ambiguous candidates and refining coarse masks after localization. A disambiguation-aware localization guidance strategy ranks salient candidate regions with adaptive linguistic cues and injects the resulting localization prior into fused features. A lightweight contour recalibration module further predicts residual corrections to coarse logits under localized contour supervision, improving mask quality with limited computational overhead. Experiments on RefSegRS, RRSIS-D, and RISBench show that DiCoR achieves the best segmentation accuracy across all three benchmarks. On RefSegRS, it improves mIoU and gIoU by 5.28% and 2.87% over a competitive JFS method while running 4.7% faster than a representative DPS method, demonstrating a favorable accuracy-efficiency trade-off. Code is available at https://github.com/zyGao1126/DiCoR.

[58] RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction cs.CV | cs.ROPDF

Tianyu Sun, Zhoujie Fu, Zihui Gao, Bang Zhang, Guosheng Lin

TL;DR: 本文提出了Hand2Bot数据集和PassGen生成框架，旨在解决人机物体交接任务中数据稀缺和仿真到现实差距的问题。Hand2Bot是一个包含身体姿态和面部表情等丰富上下文信息的RGB-D视频数据集。PassGen利用稳定视频扩散模型和意图感知时序面部编码器来合成逼真的交接序列，并通过基于形态学的深度编辑策略来弥合仿真与现实之间的差距。

Details

Motivation: 人机物体交接是协作的基础能力，但其发展受限于大规模、以人为中心的数据集稀缺以及显著的仿真到现实差距。

Result: 实验评估表明，该框架在消融实验和真实机器人平台部署中均实现了高意图识别准确率和低误触发率。与传统的以手部为中心的基线方法相比，在PassGen上训练可实现鲁棒的零样本迁移和更早的意图预测。

Insight: 创新点在于构建了专门针对交接场景的上下文丰富RGB-D数据集，并提出了一个结合生成模型和意图感知面部编码的合成流水线，同时通过深度编辑策略有效模拟了真实传感器噪声，从而提升了机器人对社会化行为的感知能力。

Abstract: Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets and the significant sim-to-real gap. To address these challenges, we introduce Hand2Bot, an RGB-D video dataset that provides rich contextual information such as body posture and facial expressions, specifically collected for handover scenarios with real-world noise patterns. We further propose PassGen, a generative pipeline that leverages stable video diffusion and an Intention-Aware Temporal Face Encoder to synthesize realistic handover sequences while ensuring hand-object consistency. To bridge the sim-to-real gap, we implement a morphology-based depth editing strategy that replicates realistic sensor noise found in physical depth maps. Experimental evaluations demonstrate that our framework achieves high intention identification accuracy and low false trigger rates in both ablation studies and real-world deployment on a physical robot platform. Our results confirm that training on PassGen allows for robust zero-shot transfer and earlier intention anticipation compared to traditional hand-centric baselines, effectively enabling socially aware robotic behavior in shared workspaces.

[59] EgoPHI: Estimating Contact and Force from Egocentric Vision cs.CV | cs.GR | cs.HC | cs.ROPDF

Andela Ilic, Rachel Schuchert, Yijing Jiang, Christian Holz

TL;DR: 本文提出了EgoPHI方法，首次从单目RGB图像和物体几何信息中联合估计手和物体网格上的密集接触图与三维力分布。为了解决缺乏真实力标注数据的问题，作者引入了一个基于物理的仿真流程来增强现有手-物体数据集，并构建了一个真实世界交互数据集进行评估。实验表明，EgoPHI在分布内、分布外和真实场景中都能恢复有意义的接触和力分布。

Details

Motivation: 从第一人称视角理解手-物体交互对于建模人与物理世界的互动至关重要，而基于物理的交互推理需要估计作用于手和物体上的力，这超出了仅定位接触的范围。现有方法缺乏对三维力分布的估计能力。

Result: 在分布内和分布外基准测试中，EgoPHI在力估计方面优于现有方法，并能泛化到未见过的数据集。在构建的真实世界交互数据集上，EgoPHI成功恢复了有意义的3D接触和力分布。

Insight: 主要创新点包括：1) 首个从单目RGB图像联合估计密集接触和3D力分布的方法；2) 提出基于物理的仿真流程，为现有数据集生成密集的逐顶点力监督信号，解决了真实标注稀缺的问题；3) 将视觉力估计从图像空间或平面设置扩展到交互的手和铰接物体网格上，推动了从接触定位到物理基础交互推理的进展。

Abstract: Understanding hand-object interaction from egocentric vision is essential for modeling how people physically engage with the surrounding world. Yet reasoning about physically grounded interaction requires estimating the forces acting on hands and objects, beyond localizing contact. We present EgoPHI, the first method that jointly estimates dense contact maps and 3D force distributions on hand and object meshes from a single monocular RGB image and object geometry. To address the lack of scalable ground-truth force annotations, we introduce a physics-based simulation pipeline that augments existing hand-object datasets with dense per-vertex force supervision. EgoPHI then learns dense 3D contact and force on interacting hand and articulated object meshes, extending vision-based force estimation beyond image-space or planar settings. Our evaluation on in-distribution and out-of-distribution benchmarks shows that EgoPHI improves force estimation over existing approaches while generalizing to unseen datasets. To evaluate sim-to-real transfer, we constructed two physical objects that capture dense object contact and force magnitude and used them to record a dataset of interactions from eight participants across diverse touch and grasp types. Our results demonstrate that EgoPHI recovers meaningful 3D contact and force distributions in simulated, out-of-distribution, and real-world settings, advancing egocentric hand-object understanding from contact localization toward physically grounded interaction reasoning.

[60] UniTraffic-Agent: Unified Traffic Video Reasoning for AI City Challenge 2026 Track 3 with Two Out-of-Domain Evaluations cs.CV | cs.AIPDF

Peng Li, Qianqian Xu, Shilong Bao, Yangbangyan Jiang, Qingming Huang

TL;DR: 本文提出了UniTraffic-Agent，一个用于交通视频理解的多模态大语言模型（MLLM）解决方案，旨在解决交通视频中事件稀疏、视角多变带来的推理难题。该系统遵循观察-推理-行动-验证的工作流程，并针对AI City Challenge 2026 Track 3中的交通异常推理任务以及两个域外评估任务进行了优化。

Details

Motivation: 交通视频理解对智能交通至关重要，但现有MLLM难以解释交通事件的发展过程、原因和交互时机，主要挑战在于交通视频包含稀疏事件和多样化的拍摄视角。

Result: 在官方公开排行榜上，该方法在交通异常推理任务上排名第16（得分0.5780），在鱼眼交通事件评估上排名第2（得分0.4884），在行人意图推理评估上排名第4（得分64.4161）。

Insight: 创新点在于提出了一个统一的观察-推理-行动-验证工作流，能够对同一视频片段的所有问题进行联合推理，并通过任务特定的行动适配器转换响应，增强了模型对稀疏、多视角交通事件的泛化能力。

Abstract: Traffic video understanding has become an important problem in intelligent transportation, as road videos provide direct evidence for accidents, violations, and interactions between vehicles and vulnerable road users. A useful system should explain how a traffic event develops, why it happens, and when the relevant interaction occurs, yet this remains difficult for multimodal large language models (MLLMs) because traffic videos contain sparse events and varied viewpoints. We introduce UniTraffic-Agent, the MR-CAS solution for Track~3 of the 10th AI City Challenge, which includes Traffic Anomaly Reasoning (TAR) and two out-of-domain evaluations: FETV for fisheye traffic events and PSI-VQA for pedestrian intention reasoning. UniTraffic-Agent follows an observe–reason–act–verify workflow that samples timestamped visual evidence, reasons over all questions from the same clip in one request, and converts responses through task-specific action adapters. On the official Public leaderboards, MR-CAS ranks 16th on TAR with a score of 0.5780, 2nd on FETV with 0.4884, and 4th on PSI-VQA with 64.4161. The code is available at https://github.com/Roclp/UniTraffic-Agent.

[61] Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization cs.CVPDF

Guillaume Jeanneret, Mathis Koroglu, Hugo Caselles-Dupré, Arnaud Dapogny, Matthieu Cord

TL;DR: 本文提出了一种名为GATO-Vid的无训练、无梯度优化方法，用于提升扩散Transformer文本到视频模型在细粒度空间可控性方面的性能。该方法通过引入替代的交叉注意力分数并解析求解，获得精确的闭式解，从而避免了传统基于梯度优化方法的高计算开销。

Details

Motivation: 现有基于梯度的免训练方法在空间定位生成（如将特定物体放置在指定位置）中虽能产生可靠结果，但其计算开销巨大，尤其在现代大规模架构中成为瓶颈。

Result: 实验表明，GATO-Vid在定位准确性上显著优于现有基线方法，同时仅引入了最小的计算开销。

Insight: 创新点在于提出了一种解析求解交叉注意力分数的闭式解，并设计了针对Transformer潜在空间拓扑流形的即时注入机制，实现了高效且精确的空间引导，避免了反向传播的计算成本。

Abstract: Diffusion Transformer Text-to-Video models have achieved remarkable synthesis quality, yet fine-grained spatial controllability remains a significant challenge. While existing training-free methods produce solid overall results in spatially grounded generation, \ie, placing a specific object in a designated location, they rely on gradient-based optimization techniques that incur prohibitive computational overhead, a bottleneck amplified in modern large-scale architectures. To address this limitation, we present Gradient-free Analytical Trajectory Optimization Video Generation (GATO-Vid), a novel training-free and gradient-free approach for precise spatial guidance. Rather than relying on costly backward passes, we introduce an alternative cross-attention score and solve it analytically to obtain an exact, closed-form solution. To use our analytical solution, we propose an on-the-fly injection mechanism tailored to the topological manifold of the transformer’s latent space. Our experiments demonstrate that GATO-Vid significantly outperforms existing baselines in localization accuracy while introducing minimal computational overhead.

[62] Learning Unified Video and Image Representation for Video Face Forgery Detection cs.CVPDF

Haotian Liu, Yang Liu, Guoying Zhao, Xiaobai Li

TL;DR: 本文提出了一种名为UVIF的新框架，用于视频人脸伪造检测，特别针对部分伪造视频（即仅部分帧被篡改）的检测挑战。该框架利用带标注的静态图像提供细粒度监督，通过统一的编码器和多任务学习联合建模视频和图像，以提升检测性能。

Details

Motivation: 现有视频人脸伪造检测方法通常假设伪造视频的所有帧都被篡改，而检测仅包含部分篡改帧的部分伪造视频仍具挑战性；本文旨在解决这一问题，通过引入图像监督来增强对部分伪造的检测能力。

Result: 在基准数据集上的大量实验表明，该框架在检测部分伪造视频方面优于现有最先进方法，且未引入额外计算开销。

Insight: 创新点包括：设计统一编码器和多任务学习范式以联合建模视频和图像；采用伪标签过程桥接视频帧与静态图像的表征；引入面向视频的特征对齐策略以减少视频与图像间的分布差距。这些方法可借鉴于多模态或跨域学习任务中。

Abstract: Face forgery detection is crucial for preserving the security and integrity of facial data given the rapid developments in face manipulation techniques and deep generative models. Existing methods for video face forgery detection typically assume that all frames in a forged video are manipulated, while detecting partially forged videos that contain only a subset of altered frames remains challenging. To address this issue, we propose a novel framework, UVIF, that utilizes additional annotated images to provide fine-grained supervision for detecting partial forgeries in videos. UVIF employs a unified encoder and a multi-task learning paradigm to jointly model facial videos and images for boosted video face forgery detection. A 2D backbone with temporal fusion modules is employed as the unified encoder. A pseudo labeling process is designed for video frames to bridge their representations with those of static images. A video-oriented feature alignment strategy is further introduced to reduce the distribution gap between videos and images. Extensive experiments on benchmark datasets demonstrate the effectiveness of our framework, which outperforms state-of-theart methods in detecting partially forged videos while introducing no additional computational overhead. Our code is available at https://github.com/haotianll/UVIF.

[63] P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation cs.CVPDF

Yi Shi, Huichao Xie, Yuqing Wang, Mingyu Wang, Kaihui Yang

TL;DR: 本文提出P2Fusion，一种基于提示和蒸馏的红外-可见光图像融合框架。它通过双内在提示（热显著性和空间质量）来引导融合过程，并设计了Teach-to-Fuse机制和门控动态专家重校准模块，以自适应地协调模态竞争，在多个主流数据集上实现了最先进的性能。

Details

Motivation: 现有基于先验引导的红外-可见光图像融合方法存在优化冲突或过度依赖外部语义先验（如CLIP/DINO），未能充分利用对高保真融合至关重要的内在模态特性。本文旨在解决这一信息差异的根本挑战。

Result: 在五个主流数据集上的大量实验表明，P2Fusion实现了最先进的性能，在5个基准测试的20个关键评估指标中，有14个达到了SOTA。此外，它有效提升了下游感知任务的鲁棒性，如在MSRS、M3FD和DroneVehicle数据集上的目标检测mAP分别提升了3.2%、0.5%和0.9%。

Insight: 创新点在于将图像内在先验（热显著性和空间质量）蒸馏为可学习的动态调节器，而非硬编码约束，并通过双粒度渐进引导和门控动态专家重校准模块实现解耦的特征细化与自适应模态协调。这是一种将提示学习与内在先验蒸馏结合用于多模态融合的新颖思路。

Abstract: Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.g., CLIP/DINO), which frequently fail to exploit the intrinsic modality characteristics essential for high-fidelity fusion. To address these issues, we propose P2Fusion, a prior-guided distillation-based framework that reformulates IVIF via dual intrinsic prompts. Instead of imposing hard-coded penalties, we distill image-intrinsic priors, thermal saliency and spatial quality, into learnable dynamic regulators. Specifically, a Teach-to-Fuse mechanism provides dual-granularity progressive guidance, coupled with a Gated Dynamic Expert Recalibration (GDER) module for decoupled feature refinement. This design enables the network to adaptively mediate modal competition through expert specialization. Extensive experiments demonstrate that P2Fusion achieves state-of-the-art performance across five mainstream datasets. Notably, our framework demonstrates consistent performance advantages in fusion quality, achieving state-of-the-art results in 14 out of 20 key evaluation metrics across 5 benchmarks. Furthermore, it effectively contributes to the robustness of downstream perception, such as +3.2% mAP on MSRS, +0.5% mAP on M3FD and +0.9% mAP on DroneVehicle for object detection. Our code will be available at https://github.com/YiShi99/P2Fusion

Yakun Huo, Yingquan Wang, Yangyang Liu, Tianyu Yan, Yunzhi Zhuge

TL;DR: 本文提出了一种名为Paths的统一框架，用于RGB-事件视频行人重识别（RE-VReID）。该框架通过记忆增强主干网络、提示感知时空Transformer和分层多模态融合模块，联合建模时空线索并充分利用细粒度判别信息，以学习鲁棒且具有判别性的表示。

Details

Motivation: 现有方法通常将空间和时间建模解耦，限制了它们的交互，并且全局级的RGB-事件融合未能充分利用细粒度的判别线索。

Result: 在EvReID、MARS和iLIDS-VID三个公开的RE-VReID基准测试上进行了广泛实验，证明了所提方法的有效性。

Insight: 创新点包括：1）设计提示感知时空Transformer，在统一Transformer内联合建模时空线索；2）提出分层多模态融合，在全局和局部层面整合RGB和事件特征；3）引入记忆增强主干网络，维护模态特定的身份原型以稳定模态内表示学习。

Abstract: RGB-Event Video Person Re-Identification (RE-VReID) aims to retrieve specific person across non-overlapping cameras with complementary RGB videos and event streams. However, existing methods often decouple spatial and temporal modeling, which limits their interaction. In addition, global-level RGB-Event fusion fails to fully exploit fine-grained discriminative cues. To address these issues, we propose Paths, a unified framework with spatio-temporal modeling and hierarchical multi-modal fusion for RE-VReID. Specifically, we first design a Memory-Augmented Backbone (MAB) to maintain modality-specific identity prototypes for stable intra-modal representation learning. Then, we propose a Prompt-aware Spatio-temporal Transformer (PST) to jointly model spatial and temporal cues within a unified Transformer. Finally, we introduce a Hierarchical Multi-modal Fusion (HMF) to integrate RGB and event features at global and local levels. With these modules, our framework can learn robust and discriminative representations for RE-VReID. Extensive experiments on three public RE-VReID benchmarks including EvReID, MARS and iLIDS-VID, demonstrate the effectiveness of our proposed method. The code is available at https://github.com/Reflection0427/Paths.

[65] RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completion cs.CVPDF

Wentao Zhao, Shouxuan Wu, Yongtao Cen, Tianchen Deng, Yuyang Zhang

TL;DR: 该论文提出了RbFT-Net，一种用于多帧4D雷达-相机深度补全的端到端先校正后融合框架。该方法将累积的雷达点视为含噪声的候选时间锚点，通过一个图像引导的校正模块联合修正其图像平面位置和度量深度，并估计逐点可靠性，然后在高层次多模态融合前进行选择性传播，以抑制不可靠测量的影响。

Details

Motivation: 解决相机与毫米波雷达融合进行密集度量深度预测时，雷达测量固有的稀疏性、噪声（如杂波、多径反射、投影误差）以及多帧聚合带来的时间错位和动态物体干扰问题，防止不可靠测量污染预测的深度图。

Result: 在ZJU-4DRadarCam数据集和新收集的4D雷达-相机-LiDAR数据集上的实验表明，RbFT-Net始终优于所评估的独立雷达-相机方法，并且与使用辅助单目深度模型的插件式流程相比保持竞争力。跨平台评估和组件分析进一步支持了所提校正和可靠性感知传播策略的有效性。

Insight: 核心创新在于将累积雷达点视为需校正的噪声锚点，而非直接假设其准确，并提出了一个联合校正位置、深度和可靠性的模块，实现了在融合前对原始雷达数据的主动净化与筛选，提升了多模态融合的鲁棒性。

Abstract: Dense metric depth prediction from cameras and millimeter-wave radar offers a cost-effective sensing solution for autonomous systems. However, radar measurements are inherently sparse and susceptible to clutter, multipath reflections, and projection errors. While aggregating multiple radar frames provides denser metric cues, it also introduces temporal misalignment and dynamic-object interference. Directly propagating such unreliable measurements can therefore corrupt large regions of the predicted depth map. To address this issue, we propose RbFT-Net, an end-to-end rectify-before-fuse framework for multi-frame 4D radar-camera depth completion. Rather than assuming accumulated radar returns to be accurate, RbFT-Net treats them as noisy temporal anchor candidates. An image-conditioned rectification module jointly corrects their image-plane locations and metric depths while estimating pointwise reliability. The rectified anchors are then selectively propagated before high-level multi-modal fusion, suppressing the influence of unreliable measurements. Experiments on ZJU-4DRadarCam and a newly collected 4D radar-camera-LiDAR dataset show that RbFT-Net consistently outperforms the evaluated independent radar-camera methods and remains competitive with plug-in pipelines using auxiliary monocular depth models. Cross-platform evaluation and component analyses further support the effectiveness of the proposed rectification and reliability-aware propagation strategy.

[66] Towards Physics-Faithful Generation of Scientific Diagrams cs.CVPDF

Minghui Zhang, Jinxin Shi, Yifan Chang, Liangliang Zhao, Yuandong Pu

TL;DR: 本文提出了Princigram，一个专注于生成物理忠实科学图表的文本到图像生成系统。针对现有通用模型生成科学图表时物理不准确的问题，该方法引入了结构化物理思维链（SP-CoT），将图表生成分解为跨六个子学科的、遵循固定模式的推理步骤，并利用该框架构建了大规模标注数据集。

Details

Motivation: 现有文本到图像生成模型在生成科学图表时，虽然外观逼真，但经常在物理忠实性（如力的方向、坐标系、热力学状态、方程匹配）上出错，这对教育和科学传播有害。

Result: 在GenExam的物理子集和作者新提出的VeriphyT2IBench基准测试上，Princigram证明了其基于明确物理结构监督的方法能有效提升生成科学图表的物理忠实性。

Insight: 核心创新是结构化物理思维链（SP-CoT），它将自由形式的思维链固定为具有严格保真度规则的模式化推理框架，将视觉事实与物理推理分离，并对所有数学符号进行类型化标注，这既作为密集的训练监督，也作为推理时的结构化提示。此外，VeriphyT2IBench基准测试的设计也很有新意，它将每个图表转化为针对其具体物理事实的二元问题库，使评估可分解且更具解释性。

Abstract: Text-to-image generation has reached photorealistic quality, yet state-of-the-art systems remain unreliable at producing scientific diagrams, whose value depends not on appearance but on physical faithfulness: correct force directions, valid coordinate systems, consistent thermodynamic states, and equations matching the depicted scenario. Trained on web imagery with physically shallow captions, generic models produce diagrams that look plausible but are physically wrong, harmful in education and scientific communication. We present Princigram, a physics-faithful scientific-diagram generator, and its data pipeline. Our central advance is Structured Physical Chain-of-Thought (SP-CoT): a per-subdiscipline schema that decomposes a physics diagram into an explicit multi-step reasoning chain across six subdisciplines, from scene identification through force or process analysis to governing laws and synthesis. Unlike free-form chain-of-thought, SP-CoT follows a fixed schema with strict fidelity rules that separate visually grounded facts from physically inferred reasoning and type all mathematics symbolically; it serves both as dense training supervision and, at inference, as a structured “thinking” prompt. With it we curate and structurally annotate 4.3 million physics images, of which 115,037 carry expert-level annotation, and adapt a unified multimodal backbone. We further introduce VeriphyT2IBench, whose questions are derived from each held-out diagram’s own structured annotation: each diagram becomes an item-specific bank of binary questions about its objects, forces, and states, so a judge model’s score decomposes into named physical facts rather than one holistic number. On the physics subset of GenExam and on VeriphyT2IBench, Princigram shows that explicit physics-structured supervision improves the physical faithfulness of generated scientific diagrams.

[67] QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing cs.CVPDF

Shubin Lu, Jiaqi Yin, Yihao Huang

TL;DR: 本文提出了QuISE，一种针对视觉语言模型（VLM）的排版攻击的防御方法。该方法通过查询无关的语义编辑，在不修改模型、无需额外训练的黑盒设置下，识别并替换图像中可能误导模型的文本区域，最终通过答案一致性来确定最终输出。

Details

Motivation: 排版攻击通过在图像中注入误导性文本，使VLM依赖对抗性文本线索而非视觉证据，构成严重威胁。现有防御方法通常需要模型特定修改、额外训练或访问模型内部组件，难以适用于现代闭源VLM。

Result: 在三个排版攻击基准、四种攻击设置和四个VLM上的广泛实验表明，QuISE能持续提升防御后的准确率，实现了67.9-75.0%的恢复率和0.5-1.1%的伤害率。

Insight: 核心创新在于提出了模型无关、无需训练的黑盒防御框架QuISE，其关键是通过影响感知的文本定位识别关键文本区域，并使用与查询和图像均无关的两种不同语义文本进行替换，利用答案一致性进行决策，增强了方法的通用性和鲁棒性。

Abstract: Typographic attacks pose a critical threat to vision-language models (VLMs) by injecting misleading text into images and causing models to rely on adversarial textual cues rather than visual evidence. Existing defenses often require model-specific modifications, additional training, or access to internal model components, limiting their applicability to modern closed-source VLMs. In this paper, we propose QuISE, a model-agnostic, training-free black-box defense based on query-irrelevant semantic editing. QuISE first identifies text regions likely to affect the current query through influence-aware text localization. QuISE then replaces these regions with two semantically distinct replacement texts that are irrelevant to both the query and the image. The final answer is determined by answer consistency across the edited images. Extensive experiments on three typographic-attack benchmarks, four attack settings, and four VLMs show that QuISE consistently improves defended accuracy. QuISE achieves a recovery rate of 67.9-75.0% with a harm rate of 0.5-1.1%.

[68] EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory cs.CV | cs.AIPDF

Weitao Chen, Hu Jiaxin, Xie Tianyidan, Yang Li, Yuyi Qian

TL;DR: 本文提出了EgoMonth，首个以月为尺度的第一人称视频理解基准，包含超过300小时、来自20位参与者长达20至120天的日常生活录像，并配有1443个人工构建的多选题对。作者设计了一个基于认知科学的14任务评估框架，分为模式巩固、情景索引和级联推理三个层次。评估发现，当前最先进的多模态大语言模型（如Gemini 2.5 Pro）在宏观平均准确率上仅为71.8%，远低于校正后的人类基线94.2%，表明模型更像是‘有损摘要器’而非‘忠实记忆器’。

Details

Motivation: 现有长视频基准多依赖网络来源视频，缺乏跨片段时空连续性，难以评估模型在数天或数周真实世界体验中保持一致性记忆的能力。因此，需要构建一个具有长期时空连续性的第一人称视频基准，以更真实地测试模型的长时记忆能力。

Result: 在EgoMonth基准上评估了开源和闭源SOTA MLLMs，最佳模型Gemini 2.5 Pro的宏观平均准确率为71.8%，比校正后的人类基线（94.2%）低22.4个百分点。部分模型在路线推理、跨视角空间推理和方向判断等任务上表现接近或低于25%的随机水平，即使最强闭源模型也显著低于人类表现。

Insight: 创新点在于构建了首个具有长期时空连续性的月级第一人称视频基准，并设计了基于认知分层的评估框架。客观来看，该工作揭示了当前MLLMs在长时记忆任务上的根本局限，强调了开发具有真正长期时空记忆架构的必要性，为未来模型设计提供了重要方向。

Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have led to substantial progress in video understanding, accompanied by a growing number of long video benchmarks. However, existing benchmarks rely predominantly on web-sourced videos that lack inter-clip spatiotemporal continuity, making it difficult to assess whether models can maintain consistent memory across days or weeks of real-world experience. We introduce EgoMonth, the first month-level egocentric video understanding benchmark. EgoMonth comprises over 300 hours of first-person daily-life recordings from 20 participants spanning 20 to 120 days, paired with 1,443 human-crafted multiple-choice question-answer pairs. We design a cognitively grounded 14-task evaluation framework organized into three hierarchical cognitive levels: Schema Consolidation, Episodic Indexing, and Cascading Reasoning. Evaluation of state-of-the-art open-source and closed-source MLLMs reveals that even the best-performing model, Gemini 2.5 Pro, achieves only 71.8% macro-average accuracy, remaining 22.4 percentage points below the corrected human baseline of 94.2%. Several models perform near or below the 25% chance level on tasks such as Route Reasoning, Cross-view Spatial Reasoning, and Direction Judgement, while even the strongest closed-source model remains substantially below human performance. These results indicate that current MLLMs function as lossy summarizers rather than faithful memorizers, highlighting the need for architectures with genuine long-term spatiotemporal memory.

[69] MergeOver: Post-Training Token Merging for Recursive Vision Transformers cs.CV | cs.LGPDF

Junseo Kim, Uraz Odyurt, Amirreza Yousefzadeh

TL;DR: 本文提出了一种名为MergeOver的后训练方法，旨在将Token Merging（ToMe）技术集成到递归权重共享的Sliced Recursive Transformer（SReT）中，以解决Vision Transformers在资源受限边缘硬件上部署时面临的高参数量和二次计算复杂度问题。该方法通过引入Unmerge跟踪栈、约束安全的合并率调整以及跨空间排列的同步token质量跟踪，解决了集成过程中的空间和合并约束，并采用分阶段单次调度策略来减少token数量。

Details

Motivation: Vision Transformers（ViTs）在计算机视觉中表现出色，但其庞大的参数量和二次计算复杂度严重限制了其在资源受限边缘硬件上的部署。递归权重共享可以减少参数量，而token合并可以缓解计算和内存瓶颈，但将这两种范式集成而不进行昂贵的重新训练是一个尚未充分探索的挑战。

Result: 在ImageNet-1K基准测试中，所选配置使top-1准确率下降了1.47个百分点。在GPU上，批量大小为1和16时，峰值激活内存分别减少了37.3%和38.4%；吞吐量在批量大小为1时下降了21.7%，但在批量大小为16时增加了21.7%。在Raspberry Pi 5（ARM CPU）上，批量大小为1和16时，延迟分别降低了2.4%和17.6%。

Insight: 论文的创新点在于提出了一种无需重新训练的后训练集成方法，通过Unmerge跟踪栈和同步token质量跟踪等技术，有效解决了递归权重共享与token合并结合时的空间和合并约束。这为将token合并与分层递归transformer结合提供了基线，展示了在保持一定准确性的同时，显著降低内存和延迟的潜力。

Abstract: Vision Transformers (ViTs) demonstrate exceptional performance in computer vision but suffer from large parameter counts and quadratic computational complexity, severely limiting their deployment on resource-constrained edge hardware. While recursive weight-sharing reduces parameter counts and token merging mitigates computational and memory bottlenecks, integrating these two paradigms without costly retraining is non-trivial, leaving this intersection largely unexplored. We propose MergeOver, a post-training approach that integrates Token Merging (ToMe) into the recursively weight-shared Sliced Recursive Transformer (SReT). Through an Unmerge tracking stack, constraint-safe merge-rate adjustment, and synchronised token-mass tracking across spatial permutations, MergeOver resolves the spatial and merging constraints of this integration. We further employ a stage-wise single-shot schedule that performs token reduction at the first block of each stage and maintains a fixed sequence length throughout its subsequent recursive iterations. Benchmarked on ImageNet-1K, our selected configuration reduces top-1 accuracy by 1.47 percentage points. On the GPU, it reduces peak activation memory by 37.3% and 38.4% at batch sizes 1 and 16, while throughput decreases by 21.7% at batch size 1 but increases by 21.7% at batch size 16. On a Raspberry Pi 5 (ARM CPU), it reduces latency by 2.4% and 17.6% at batch sizes 1 and 16. These results show that MergeOver can recover a meaningful part of the throughput and memory cost that recursive weight-sharing introduces, without retraining, and provides a baseline for combining token merging with hierarchical recursive transformers.

[70] Less Annotation, More Interpretation: Prior-Guided Concept Bottleneck Models for Interpretable Cancer Imaging Diagnosis cs.CVPDF

Baoqiang Ma, Kenneth Gilhuijs

TL;DR: 本文提出了一种先验引导的混合概念瓶颈模型，用于可解释的癌症影像诊断。该方法通过整合有限的概念标注、未标注患者的类条件概念分布匹配以及概念到诊断头的先验初始化，显著降低了对实例级概念标注的依赖。在乳腺肿块、钙化和肺结节的三个数据集上，该方法在0-20%的低标注比例下，概念检测性能显著优于标准概念瓶颈模型，同时保持了接近黑盒模型的诊断性能。

Details

Motivation: 概念瓶颈模型通过放射学概念表达预测，可提高癌症影像诊断的透明度，但其对实例级概念标注的依赖限制了实际应用。本文旨在减少标注需求，提升模型在低标注场景下的实用性和可解释性。

Result: 在CBIS-DDSM（乳腺肿块和钙化）和LIDC-IDRI（肺结节）数据集上，在0-100%概念标注比例范围内进行评估。在临床相关的0-20%低标注比例下，混合CBM在概念检测的AUC上持续优于标准CBM，同时诊断性能接近黑盒模型。具体在10%标注时，肿块的概念AUC从0.619提升至0.741，钙化从0.650提升至0.787，肺结节从0.597提升至0.642。

Insight: 主要创新点在于提出了一种结合先验知识的混合CBM框架，通过先验初始化概念到诊断头来稳定训练，并利用类条件分布匹配利用未标注数据。这为构建低标注需求的可解释医学影像模型提供了有效路径，表明结构化先验能显著降低标注负担。同时，研究发现零样本视觉语言模型尚不足以进行可靠的细粒度肿瘤级概念预测。

Abstract: Concept bottleneck models (CBMs) can improve the transparency of cancer image diagnostic prediction by expressing predictions through radiological concepts. However, their dependence on instance-level concept annotations limits practical applicability. We propose a prior-guided hybrid CBM that integrates limited concept annotations, class-conditional concept distribution matching on unannotated patients, and prior initialization of the concept-to-diagnosis head. We evaluate the method on CBIS-DDSM mammographic masses and calcifications and LIDC-IDRI pulmonary nodules across 0-100% concept annotation. In the clinically relevant 0-20% annotation regime, the hybrid CBM consistently improves mean concept AUC over a matched standard CBM, while maintaining diagnostic performance close to black-box models. At 10% annotation specifically, concept AUC increases from 0.619 to 0.741 for masses, from 0.650 to 0.787 for calcifications, and from 0.597 to 0.642 for pulmonary nodules. Ablation experiments identify prior initialization as the main component contributing to improved concept detection, likely by stabilizing the concept-to-diagnosis head. Zero-shot VLMs remain insufficient for reliable fine-grained tumor-level concept prediction. These findings suggest that structured priors can substantially reduce the annotation burden of interpretable cancer imaging models.

[71] TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint cs.CV | cs.AI | cs.CL | cs.LGPDF

Fnu Pramono, John Cai, Sourabh Kulkarni

TL;DR: 本文提出TRAPSBench基准测试，用于评估视觉语言模型在视觉证据不足时是否能够主动表达‘无法确定’的认知克制能力。研究发现，尽管模型内部能够区分何时应弃答，但在输出层面却无法有效表达这种克制，且视觉不确定性比文本不确定性更难被模型识别。

Details

Motivation: 解决视觉语言模型在视觉证据被遮挡或混乱时，无法在输出中表达‘弃答’的认知克制问题，即模型虽能内部感知不确定性，但输出行为不符合要求。

Result: 在涵盖五个家族的16个视觉语言模型上，自发克制能力普遍较差，最佳惩罚认知校准分数仅为0.292；线性探针分析显示模型隐藏状态可高精度解码可答性（AUROC达0.91），但输出表达存在瓶颈；视觉不确定性检测能力比文本差约4倍。

Insight: 创新点在于提出了TRAPSBench基准和PECS评估指标，揭示了视觉语言模型中‘表征-输出’的差距；客观分析表明，改进需集中在输出阶段的干预，而非感知能力本身。

Abstract: When visual evidence is occluded or chaotic, models should abstain. In this paper, we show that Vision-Language Models (VLMs) can internally distinguish when abstention is required, but fail to express it anyway. We introduce TRAPSBench, a procedurally generated video benchmark of 1,404 matched physics pairs in which a single targeted change renders the outcome undeterminable from the visual evidence. Furthermore, we introduce Penalized Epistemic Calibration Score (PECS), a new robust metric that requires models to both answer correctly when the outcome is knowable, and abstain when the outcome is not. Across 16 VLMs spanning five families, spontaneous restraint is poor: the best PECS is 0.292. The bottleneck is expression, not perception: linear probes decode answerability from hidden states at up to 0.91 AUROC across physics domains; steering a single-layer void direction causally induces or suppresses abstention. Our results replicate across three open-weight families (Qwen, Gemma, LLaVA). The failure is also more pronounced in visual than textual uncertainty: models detect textual impossibility about 4x more readily than missing visual evidence. Closing this representation–output gap likely requires output-stage interventions.

[72] A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources cs.CVPDF

Brunó B. Englert, Gijs Dubbelman

TL;DR: 本文在有限资源条件下，对图像和视频的自监督学习（SSL）目标进行了对照研究，比较了对比学习、重建、特征预测和扩散等目标，评估了单独和联合训练的图像-视频SSL方法。研究发现，DINOv2风格的预训练在资源受限时表现最佳，而将其与VideoMAE等视频SSL目标结合能提升图像分类和分割性能，但会降低视频跟踪和相机姿态估计性能，揭示了语义与几何表示学习之间的权衡。

Details

Motivation: 视觉基础模型通常需要大量数据和计算，但在资源有限时，研究如何通过自监督学习有效获取模型具有重要意义，以探索不同SSL目标在匹配数据、架构和计算预算下的行为。

Result: 在多种图像和视频理解任务上，DINOv2预训练在有限资源下始终提供最强的整体性能；结合DINOv2与VideoMAE能显著提升图像分类和分割性能，但会降低视频跟踪和相机姿态估计性能，表明存在语义与几何表示学习的权衡。

Insight: 创新点在于通过对照实验揭示了图像和视频SSL目标结合在资源受限时的益处与局限性，强调了需要改进方法来平衡语义、时间和几何监督，为资源有限场景下的模型设计提供了实证指导。

Abstract: Visual foundation models are a cornerstone of image and video understanding but typically require large amounts of data and computation. The current scale required for pretraining visual foundation models may be unsustainable or unnecessary, and significant benefits arise when effective models can be obtained with fewer resources. To better understand how self-supervised learning (SSL) objectives behave under resource constraints, we conduct a controlled study of image and video SSL objectives under matched data, architecture, and compute budgets. We compare contrastive, reconstruction, feature-prediction, and diffusion objectives and evaluate both standalone and jointly trained image-video SSL formulations across a diverse set of image and video understanding tasks. Our results show that DINOv2-style pretraining consistently provides the strongest overall performance under limited resources. Furthermore, combining DINOv2 with video SSL objectives such as VideoMAE substantially improves image classification and segmentation performance, but degrades video tracking and camera-pose estimation performance, revealing an important tradeoff between semantic and geometric representation learning. These findings suggest that combining image and video SSL objectives can be beneficial in resource-limited settings, while highlighting the need for improved methods that better balance semantic, temporal, and geometric supervision.

[73] HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models cs.CVPDF

Jiazi Bu, Pengyang Ling, Yujie Zhou, Yibin Wang, Yuhang Zang

TL;DR: 本文提出了一种名为混合策略自蒸馏（HPSD）的新框架，用于提升文本-图像到视频（TI2V）扩散模型的基础文本到视频（T2V）生成能力。该方法通过让同一个模型在高质量第一帧（教师模式）和普通提示（学生模式）下分别运行，结合离策略轨迹锚点和策略内局部精炼，实现了对模型自身生成能力的有效增强。

Details

Motivation: 动机在于解决TI2V模型在拥有高质量第一帧或详细文本提示时表现优异，但其基础T2V生成能力相对较弱的问题。现有自蒸馏方法（如监督微调）存在离策略监督不精确或条件-状态不匹配的缺陷，无法有效将特权条件下的能力内化到基础生成中。

Result: 大量实验表明，HPSD显著提升了模型在T2V任务上的性能，同时在TI2V任务上也带来了可观的增益，有效强化了模型的基础生成能力。

Insight: 创新点在于提出了混合策略自蒸馏框架，通过让模型在两种不同条件下（特权条件与基础条件）分别作为教师和学生，结合离策略锚点继承与策略内局部精炼，实现了既吸收教师先验知识又保留精确策略校正的自蒸馏。这为解决条件生成模型中能力内化问题提供了新思路。

Abstract: Text-Image-to-Video (TI2V) models are an emerging unified architecture, where a single model simultaneously supports text-to-video (T2V) and image-to-video (I2V) generation. Given a high-quality first frame or a detailed textual prompt, TI2V models unlock substantially better visual quality than their T2V mode, raising a natural question: can the capability elicited by such privileged conditions be internalized into the model’s own base generation ability? A common approach toward this goal is model self-distillation. However, the most straightforward solution, supervised fine-tuning, follows an off-policy strategy: its supervision is confined to teacher-generated endpoints from a fixed offline distribution rather than student-visited states, lacking precise correction tailored to the evolving policy. Recent on-policy distillation methods instead suffer from condition-state mismatch, where supervision is steered toward the given first frame instead of the student’s actual content, misleading the correction. To achieve self-distillation that absorbs the teacher’s privileged prior while retaining precise policy correction, in this work, we propose Hybrid-Policy Self-Distillation (HPSD), a novel self-distillation framework where a single TI2V model acts as both teacher and student under different conditions: the teacher operates in TI2V mode with a high-quality first frame and an enhanced prompt, while the student runs in the base T2V mode with only the vanilla prompt. Specifically, the student inherits off-policy teacher trajectory points as anchors, locally refines them toward its own policy, and finally receives velocity-level supervision on these self-generated roll-outs. Extensive experiments demonstrate that HPSD significantly improves T2V performance while also delivering notable TI2V gains, effectively strengthening the model’s base generation ability.

[74] CoverPrune: Coverage-Driven Token Pruning for 3D VLMs via Optimal Transport cs.CV | cs.AIPDF

Peng Ling, Yingda Yin, Lingting Zhu, Weikai Chen, Shengju Qian

TL;DR: 本文提出CoverPrune，一种用于3D视觉语言模型的无训练令牌剪枝框架。它通过将推理时的令牌剪枝问题建模为最优传输问题，旨在保留视觉证据的覆盖范围而非最大化多样性，从而克服现有方法破坏多视图一致性和几何结构的缺点。

Details

Motivation: 现有3D VLM的令牌剪枝方法主要依赖基于多样性的选择，会丢弃相似令牌以最大化分散度，但这在3D环境中经常丢弃具有代表性的原型令牌而保留异常值，破坏了空间推理所必需的多视图一致性和几何结构。

Result: 在多个3D视觉空间推理基准测试上的广泛实验表明，该方法实现了最先进的令牌效率，即使在高度激进的剪枝预算下也能保持稳健的推理性能。

Insight: 核心创新点是将令牌剪枝的范式从最大化多样性转变为保留视觉证据覆盖，并利用最优传输理论进行形式化。具体技术贡献包括设计了特征-空间-时间传输成本和目标容量，以及高效的SGS近似算法和加速变体CoverPrune-Lite。

Abstract: While 3D Vision-Language Models (3D VLMs) have demonstrated remarkable spatial reasoning capabilities, they suffer from massive visual token counts that create severe computational bottlenecks during inference. Existing token pruning methods primarily rely on diversity-based selection, discarding similar tokens to maximize dispersion. However, in 3D environments, this approach frequently drops representative prototype tokens in favor of outliers, breaking the multi-view consistencies and geometric structures essential for spatial reasoning. In this paper, we propose a paradigm shift for 3D VLM token pruning: from maximizing diversity to preserving visual evidence coverage. We introduce CoverPrune, a training-free framework that formulates inference-time token pruning as an Optimal Transport (OT) problem. To overcome the intractable combinatorial subset selection inherent in this formulation, we design the Feature-Spatial-Temporal (FST) transport cost and target capacity, along with an efficient Spatial-Guided Greedy Selection (SGS) algorithm to approximate the OT objective. Furthermore, we propose CoverPrune-Lite, an accelerated variant utilizing spatially structured local matching for minimal overhead. Extensive experiments across multiple 3D visual-spatial reasoning benchmarks demonstrate that our methods achieve state-of-the-art token efficiency, maintaining robust reasoning performance even under highly aggressive pruning budgets. Visit our project website at https://github.com/Brucess/CoverPrune.

[75] NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video cs.CV | cs.AI | cs.MMPDF

Yuheng Huang, Jianlang Chen, Jiayang Song, Hua Qi, Aza Kai

TL;DR: 本文介绍了NARU，一个专注于评估日语超长视频中叙事演变与文化细微差别理解能力的基准。该基准包含155个视频（总计146.8小时）上的1,481个问题，涵盖四个叙事维度和五个文化维度。通过一个基于分层记忆的标注流程构建，并经过母语者验证，评估揭示了现有模型在长程叙事整合和文化推理方面的显著不足。

Details

Motivation: 现有基准很少能联合评估长视频中叙事演变追踪和隐含社会文化意义理解的能力，尤其是在高语境、非英语媒体中。为了填补这一空白，作者构建了NARU基准。

Result: 在八个模型配置上的评估结果显示，现有模型在长程叙事整合和文化基础推理方面存在显著局限性，暴露了当前多模态大语言模型（MLLMs）在可靠解释长视频方面的能力差距。

Insight: 创新点在于提出了一个专门针对高语境、非英语（日语）长视频的叙事与文化理解联合评估基准，并设计了一个包含分层记忆结构、任务导向合成和迭代捷径移除的可扩展标注流程，为开发更可靠的长视频理解MLLMs提供了系统性的测试场。

Abstract: Long-form video understanding encompasses tasks that go beyond retrieving isolated events, including tracking an evolving narrative and interpreting social meaning that may remain implicit. However, existing benchmarks rarely evaluate these capabilities jointly, particularly in high-context, non-English media. To address this gap, we introduce NARU, a benchmark designed to evaluate Narrative evolution and Reasoning on cultural Understanding in Japanese long-form video. NARU consists of 1,481 questions grounded in 155 videos totaling 146.8 hours, spanning four narrative and five cultural dimensions. To construct the benchmark at this scale, we propose a hierarchical memory-based annotation pipeline that transforms raw video into structured event, narrative, and cultural annotations, then generates questions via task-oriented synthesis and iterative shortcut removal. The construction process includes two native-speaker verification stages involving 68 annotators. Evaluations across eight model configurations reveal substantial limitations in both long-range narrative integration and culturally grounded reasoning. By exposing these persistent gaps, NARU offers a systematic testing ground for developing MLLMs capable of reliably interpreting long-form, high-context video.

[76] AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage cs.CVPDF

Christos Chatzisavvas, Stelios Alvanos, Efstratios Politis, Panagiotis Rigas, Thomas Pappas

TL;DR: 本文介绍了AmalthAI，一个专为文化遗产领域设计的开源计算机视觉平台，旨在让非机器学习专家的文化遗产研究者能够独立进行数据集管理、模型训练和推理，以生成和验证具有考古学意义的发现。平台支持分类、分割和目标检测任务，并集成了可解释性工具和视觉语言模型，同时考虑到数据敏感性，支持本地化部署。

Details

Motivation: 动机是解决文化遗产领域的专家缺乏机器学习背景，难以配置、训练和评估模型，从而无法充分利用计算机视觉和机器学习技术进行文物分析的问题。

Result: 论文在一个由粘土纺织品印记组成的自定义数据集上进行了考古学用例测试，文化遗产专家成功训练并验证了用于假设检验的分割和分类模型，展示了平台的有效性。

Insight: 创新点在于构建了一个集成的、用户友好的开源平台，将可扩展的训练流程（Kubeflow/Katib）、模型可解释性工具（Grad-CAM）和视觉语言模型（VLM）相结合，并特别设计了支持敏感数据本地化部署的方案，以适配文化遗产数据常受所有权限制的特点。

Abstract: Computer vision (CV) and machine learning (ML) offer new tools for cultural heritage (CH) artifact analysis, but the CV/ML pipeline remains largely inaccessible to CH domain experts, who lack the background to configure, train, or assess models. We present AmalthAI, an open-source CV platform that bridges this gap, enabling non-ML CH experts to independently produce and validate archaeologically meaningful findings. The interface covers dataset management, training, and inference for classification, segmentation, and object detection, with Kubeflow and Katib handling scalable training and hyperparameter search. Grad-CAM localizes the image region behind a prediction, and a vision-language model (VLM) adds a text description of it for expert review. Since archaeological data is often state-owned or rights-encumbered and cannot leave institutional custody, AmalthAI’s self-hostable deployment ensures sensitive data is kept within premises. We test the platform on an archaeological use case built on a custom dataset of clay textile imprints, where CH experts trained and validated segmentation, and classification models for hypothesis testing. We provide the implementation code at https://github.com/TEXTaiLES/AmalthAI.

Koen P. de Vries, Xavier Alameda-Pineda, Estefanía Talavera, Stéphane Lathuilière

TL;DR: 本文针对社交视听问答（Social Audio-Visual QA）中的推理方法进行了评估，发现当前主流的思维链（CoT）推理方法成本高且效果不佳。作者首先清理了基准数据集IntentBench中的噪声问题，发布了改进版IntentBench-Prime；其次，研究表明一个简单的Vanilla SFT基线模型能以极低成本达到或超越现有推理方法的性能；最后，分析揭示模型仅从文本模态就能学习到强先验，使用文本描述替代视频输入也能获得与Vanilla SFT相当的结果，这暴露了当前多模态大语言模型在社交理解上的局限性。

Details

Motivation: 训练多模态大语言模型以实现视听社交理解是迈向具身社交智能的关键步骤，但当前主流的思维链推理方法在社交视听问答任务中的有效性和效率尚未得到充分验证。

Result: 在清理后的IntentBench-Prime等三个基准测试上，简单的Vanilla SFT基线模型以极低成本匹配或超越了现有推理方法的性能，成为评估新微调技术的重要基线；同时，仅使用文本描述（而非视频）也能达到与Vanilla SFT相当的水平。

Insight: 论文的创新点在于系统性地揭示了当前社交视听问答基准（IntentBench）的数据质量问题，并提出了一个高效且有效的Vanilla SFT基线，挑战了复杂推理方法的必要性；客观分析表明，模型对文本模态的过度依赖可能掩盖了其真正的多模态理解能力，这为未来评估社交理解模型提供了关键的洞见和更干净的基准（IntentBench-Prime）。

Abstract: Training Multimodal Large Language Models for audio-visual social understanding is a crucial step toward embodied social intelligence. Chain-of-thought (CoT) reasoning has become the dominant approach, with HumanOmniV2 and its IntentBench benchmark as a prominent reference point. In this context, we report three findings. First, IntentBench is highly noisy: $\sim$7% of questions are broken and $\sim$23% are trivially answerable without the video input. We remove the affected questions and release Intentbench-Prime. Second, current reasoning approaches are expensive and surprisingly ineffective. A simple Vanilla SFT baseline matches or outperforms existing reasoning methods across three benchmarks at a fraction of the cost, establishing it as an essential baseline for evaluating novel fine-tuning techniques. Third, our analysis reveals that substantial priors can be learned solely from the text modality and that using a textual caption instead of the video yields performance on par with Vanilla SFT. These surprising findings reveal the limitations of current MLLMs when it comes to social understanding. IntentBench-Prime, Vanilla SFT model, and code are publicly available.

[78] How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning? cs.CVPDF

Wafa Al Ghallabi, Ritesh Thawkar, Sara Ghaboura, Omkar Thawakar, Numan Saeed

TL;DR: 该论文提出了一个名为’时间感知多视图MRI基准测试’的评估框架，用于评估基础模型在纵向MRI疾病进展推理任务上的能力。该基准测试整合了多视图解剖输入、跨纵向扫描的时间推理和结构化定位指导，包含来自七个临床队列的3920个专家验证的问答对。实验评估了16个视觉语言模型，揭示了它们在变化方向识别和体积量化方面的系统性不足。

Details

Motivation: 现有视觉语言基准测试局限于单时间点、单视图的解释，未能捕捉放射学实践中至关重要的时空推理能力。因此，需要一个新的基准来评估模型在整合多视图解剖平面和跨连续时间点精确定位间隔变化方面的能力。

Result: 在16个视觉语言模型上的实验表明，模型在时间对齐方面表现尚可，但在变化方向识别和体积量化方面存在系统性失败。多视图输入改善了空间定位，但在紧凑架构中损害了时间推理能力。

Insight: 创新点在于构建了一个统一评估多视图、时间推理和结构化定位的纵向MRI基准测试。从客观角度看，该研究强调了当前基础模型在临床关键的时间推理和量化任务上的局限性，为未来模型开发提供了明确的评估方向和数据资源。

Abstract: Magnetic Resonance Imaging (MRI) interpretation is fundamental to clinical decision-making, requiring radiologists to integrate multi-view anatomical planes across sequential timepoints while precisely localizing interval changes. However, existing vision-language benchmarks remain confined to single-timepoint, single-view interpretation, failing to capture the temporal-spatial reasoning essential to radiologic practice. We introduce the Time-Aware Multi-View MRI Benchmark, an evaluation framework unifying multi-view anatomical input, temporal reasoning across longitudinal scans, and structured localization guidance. The benchmark comprises 3,920 expert-verified question-answer pairs derived from 890 patients across over 3,200 longitudinal MRI timepoints, drawn from seven clinical cohorts covering glioblastoma, neurodegeneration, vestibular schwannoma, and brain metastases, in open-ended, multiple-choice, and binary formats, requiring models to identify anatomical regions of maximal change, characterize progression across sequences and views, and provide structured guidance specifying boundaries, imaging features, and confounders. Experiments across 16 vision-language models reveal moderate temporal alignment but systematic failure on change direction recognition and volumetric quantification, while multi-view inputs improve spatial localization yet degrade temporal reasoning in compact architectures. Our benchmark provides a systematic framework for evaluating progression tracking, interval change localization, and temporal ordering, which are essential for clinical deployment. Code, evaluation splits, and the dataset are available at: https://github.com/wafaAlghallabi/Time-Aware-MRI.

[79] Sign Language Video Synthesis via Loss-Guided Multi-Expert GANs cs.CV | cs.AIPDF

Dingzhan Nong, Zhihao Ren, Ziqi Li, Tim Lo

TL;DR: 本文提出了一种基于损失引导的多专家生成对抗网络（GAN）框架，用于手语视频合成，旨在改善听障人士的沟通体验。该方法采用三个专用判别器（全局、手部、头部）分别引导生成器中的对应专家分支关注不同视觉区域，实现了隐式特征专业化，无需显式的多样性损失。通过引入联合损失共识机制稳定多判别器训练，并结合卷积-Transformer双路径设计及自适应特征融合，在定制数据集上取得了较高的峰值信噪比（PSNR）结果。

Details

Motivation: 解决手语视频合成中生成细节不足和训练不稳定的问题，以增强听障人士的交流辅助技术。

Result: 在过滤掉简单和重复样本的定制156GB数据集测试集上，0.2B参数变体达到29.8 PSNR，1.3B参数变体达到30.7 PSNR，推理显存占用分别为1.5GB和8GB，可在消费级硬件上部署。

Insight: 创新点包括：通过多专家判别器实现隐式特征专业化，无需显式多样性损失；联合损失共识机制稳定多判别器训练；卷积-Transformer双路径结合自适应特征融合平衡稳定性和细节生成。

Abstract: This preliminary technical report presents a framework for sign language video synthesis using a loss-guided multi-expert Generative Adversarial Network (GAN) to enhance communication for individuals with hearing impairments. Three specialized discriminators – global, hand, and head – each guide a corresponding expert branch in the generator toward a distinct visual region, enabling implicit feature specialization without explicit diversity losses. To stabilize this multi-discriminator system, whose early-phase training otherwise exhibits chaotic dynamics, we introduce a United Loss consensus mechanism that regularizes each discriminator toward the ensemble average at a 10% weight. Each branch further adopts a dual-pathway convolutional-transformer design with learnable AdaptiveFeatureFusion, balancing the stability of convolutions against the detail of windowed self-attention. The generator is trained using an alternating three-mode schedule (discriminator, holistic generation, branch-specialized generation). On a custom 156GB dataset with a filtered test set that removes easy and repetitive samples, our 0.2B-parameter variant achieves 29.8 PSNR and the 1.3B-parameter variant achieves 30.7 PSNR, with inference VRAM footprints of 1.5 GB and 8 GB respectively, enabling deployment on consumer-grade hardware. Full ablation studies remain ongoing due to the 2-3 month training cycle on a single GPU. The system was showcased at the 2025 Hong Kong Frontier Technology Summit.

[80] When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL cs.CVPDF

Jiaqian Li

TL;DR: 本文提出’选择-实现假说’来解释隐式多模态上下文学习（ICL）中演示如何被压缩为内部干预，并实证研究了静态任务向量在何种条件下足够有效，以及何时需要更复杂的干预机制。

Details

Motivation: 现有隐式多模态ICL方法将演示压缩为内部干预（如静态任务向量、查询条件变换等），但不同方法在干预对查询的依赖性和模型修改位置上有很大差异，导致难以确定特定任务所需的额外复杂性。

Result: 通过受控多模态任务实验发现，静态任务向量的成功与演示诱导的变化在查询间的共享程度密切相关；当显式多模态ICL包含查询特定或分布式结构时，需要更复杂的干预机制。该结论在自然VQA基准测试中得到验证，并支持无需测试性能的成本感知方法选择。

Insight: 创新点在于提出统一的理论框架（选择-实现假说）来解释演示压缩机制，并通过对比正确演示与反事实示例量化显式ICL结构，为干预方法的选择提供了实证依据。这有助于根据任务特性（如查询依赖性）自适应选择简单或复杂的干预策略。

Abstract: Implicit multimodal in-context learning compresses demonstrations into internal interventions, ranging from static task vectors to query-conditioned transformations and attention routing. Despite their common goal, these methods differ substantially in how the intervention depends on the query and where it modifies the model, leaving unclear which additional complexity is necessary for a given task. We propose the Selection–Realization Hypothesis. It views demonstrations as inducing a compact family of internal changes from which the query selects, while the model’s computation constrains how the selected change can be implemented. We evaluate this account using controlled multimodal tasks in which query dependence varies without changing the underlying task primitives or prompt format. By contrasting correct demonstrations with matched counterfactuals, we measure the structure of explicit M-ICL and test whether it predicts intervention behavior. We find that the success of a static task vector is closely tied to how much of the demonstration-induced change is shared across queries. Additional intervention complexity becomes useful when explicit M-ICL contains query-specific or distributed structure that a local additive shift cannot recover. These relationships extend to natural VQA benchmarks and support cost-aware method selection without access to test performance. Our results provide a unified empirical theory of when demonstrations can be compressed into a task vector and when a more expressive intervention is warranted.

[81] Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation cs.CVPDF

Hmrishav Bandyopadhyay, Xuanchi Ren, Zijian Huang, Jay Zhangjie Wu, Tianshi Cao

TL;DR: 本文提出了上下文匹配蒸馏（CMD）方法，用于解决自回归视频生成中低延迟生成与精确在线控制之间的矛盾。该方法通过因果教师模型和前缀评分机制，确保蒸馏过程中的监督信号与学生在生成时的因果信息集对齐，从而提升生成质量和控制精度。

Details

Motivation: 现有视频分布匹配蒸馏（DMD）方法使用双向教师模型监督因果少步学生，导致教师评分可能依赖于学生生成时不可用的未来帧和控制信号，造成监督不对齐。

Result: 在短视频和长视频基准测试中，CMD在自回归方法中实现了最先进的综合性能，并在时变相机控制方面显著提高了遵循度。

Insight: 创新点在于引入因果教师模型和前缀评分机制，确保教师监督与学生的因果信息集严格对齐；通过前缀扰动策略稳定训练，同时保持目标-上下文对齐，方法可自然扩展到逐帧、分块生成、长视频蒸馏和条件控制蒸馏。

Abstract: Interactive autoregressive video generation demands both low-latency rollouts and precise online control. Few-step distillation accelerates generation by reducing denoising steps, while online control imposes a causal constraint: frames and blocks should depend on history and controls available during generation. Existing video distribution matching distillation (DMD) pipelines, however, often supervise causal few-step students using bidirectional teachers that score complete clips. The score for a target can therefore depend on future frames and controls that were unavailable when the student generated it, misaligning teacher supervision with the student’s causal information set. We introduce Context-Matched Distillation (CMD), a causal DMD framework that aligns teacher supervision with the information available when each target is generated. CMD replaces bidirectional full-clip scoring with a causal teacher that evaluates each target without access to future frames or controls. The same causal teacher initializes the few-step student, establishing a consistent causal formulation across teacher training, student distillation, and inference. Beyond aligning the temporal information boundary, Prefix Scoring matches supervision to the student’s realized rollout context by evaluating each target under the cached student-generated prefix that produced it. Prefix Corruption further stabilizes training by perturbing unreliable prefixes produced early in training while preserving this target-context alignment. With a simple causal formulation, CMD naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation. Experiments demonstrate state-of-the-art aggregate performance among autoregressive methods on both short- and long-video benchmarks, together with substantially improved adherence to time-varying camera controls.

[82] StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs cs.CVPDF

Joya Chen, Zeyun Zhong, Mike Zheng Shou

TL;DR: StreamTTT是一种流式视觉语言模型，旨在同时优化实时感知和长期记忆能力。它通过将长期历史写入在线更新的快速权重中，并保留短滑动键值缓存来处理近期证据，从而缓解注意力稀释问题。模型在离线长视频问答和新构建的实时问答语料库上联合训练，在OVO-Bench和StreamingBench的RTVU子集上表现出色。

Details

Motivation: 解决现有流式视觉语言模型在实时感知和长期记忆之间难以兼顾的问题，即缩短上下文虽能提升当前场景感知但损害长程回忆能力。

Result: 在OVO-Bench上，StreamTTT-4B在实时感知任务上比SimpleStream-4B高1.4分，在向后追踪任务上高3.7分；在StreamingBench的RTVU子集上，与更大的SimpleStream-8B保持竞争力。

Insight: 创新点在于将长期历史存储于注意力上下文之外的快速权重中，并利用短滑动缓存专注近期信息，从而在架构上分离了记忆机制，实现了感知与记忆的协同优化。

Abstract: Humans effortlessly perceive the present while remembering the past, yet streaming VLMs often trade off real-time perception against long-term memory. Prior work shows that shortening the context can sharpen current-scene perception at the expense of long-range recall. To reconcile these abilities, we introduce StreamTTT, which writes long-range history into online-updated fast weights outside the attention context. This leaves a short sliding key-value cache dedicated to recent evidence, mitigating attention dilution. We train StreamTTT jointly on offline long-video QA and a newly constructed real-time QA corpus. On OVO-Bench, StreamTTT-4B outperforms SimpleStream-4B by 1.4 points in real-time perception and 3.7 points in backward tracing. It also remains competitive with the larger SimpleStream-8B on the Real-Time Visual Understanding (RTVU) subset of StreamingBench. Our code will be released.

[83] UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Models cs.CV | cs.AIPDF

Yukun Dai, Mingzhe Dai, Tianshi Wang, Fengling Li, Jingjing Li

TL;DR: 本文提出UniTexture，一种跨任务通用对抗纹理攻击方法，通过单个纹理化3D物体诱导视觉-语言-动作模型在多任务中产生目标偏离的动作预测。该方法利用可微分渲染器将策略动作输出的梯度反向传播至表面纹理参数，并联合优化共享纹理以操纵预测动作朝向攻击者定义的目标。

Details

Motivation: 现有机器人策略攻击通常针对单一任务优化，而多任务VLA模型的跨任务脆弱性尚未充分探索，因此需要研究能系统利用共享脆弱性的通用对抗攻击方法。

Result: 在OpenVLA和π_{0.5}模型上的实验表明，攻击将平均任务成功率从90.0%降至48.4%，能诱导目标对齐的动作偏移，并展现出跨测试套件和跨模型的迁移能力。

Insight: 创新点在于通过可微分渲染实现动作空间到纹理参数的端到端优化，并首次揭示多任务VLA模型中存在可通过单一对抗表面纹理系统利用的共享跨任务脆弱性。

Abstract: Vision-Language-Action (VLA) models have emerged as generalist robotic policies capable of following diverse language instructions and performing a wide range of manipulation tasks. However, their direct control over embodied agents also exposes them to adversarial interference that may cause unsafe physical behaviors. Existing attacks on robotic policies are typically optimized for a single task or instruction, leaving the cross-task vulnerabilities of multitask VLAs largely unexplored. We introduce UniTexture, a cross-task universal adversarial texture attack that uses a single textured 3D object to induce targeted deviations in VLA action predictions across multiple tasks. UniTexture backpropagates gradients from the policy’s action outputs to surface texture parameters through a differentiable renderer. It jointly optimizes the shared texture over a distribution of tasks, instructions, states, and viewpoints using a targeted action-space objective, steering predicted actions toward attacker-defined targets without optimizing a separate texture for each task. We evaluate UniTexture on OpenVLA and $π_{0.5}$ across diverse manipulation tasks and multiple evaluation settings. UniTexture reduces the mean task success rate from 90.0% under benign conditions to 48.4% under attack, induces target-aligned action shifts, and further exhibits cross-suite and cross-model transfer without re-optimization. Together, these findings reveal shared cross-task vulnerabilities in multitask VLAs that can be systematically exploited through a single adversarial surface texture.

[84] Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ cs.CVPDF

Zongyun Zhang, Jiacheng Ruan, Xian Gao, Ruizhu Zhou, Lingcheng Meng

TL;DR: 本文提出了Edit2TikZ，一个用于评估多模态大语言模型在科学图表编辑任务上的综合性基准。该基准包含1548个多样化的样本，支持文本和视觉定位的编辑请求，并包含多步编辑。作者评估了14个主流MLLM，发现现有模型在代码编译成功率和编辑正确性上仍不可靠，并提出了基于课程学习的训练方法TikZEditMix，显著提升了紧凑模型的性能。

Details

Motivation: 现有TikZ基准主要关注图表重建与生成，缺乏对指令引导、可编译代码的科学图表编辑任务的系统性评估。本文旨在填补这一空白，解决模型在联合恢复视觉结构、定位编辑请求、生成可编译代码并保持无关内容不变这一复杂挑战。

Result: 在Edit2TikZ基准上评估14个主流MLLM，发现专有模型的平均编译成功率仅为75%，且在图表恢复和编辑正确性上仍有局限；参数小于9B的紧凑模型在指令遵循和完整图表生成上表现更差。提出的TikZEditMix训练方法在Qwen3.5-4B上将编译成功率从45.35%提升至83.40%，并在所有评估指标上平均提升18.7分。

Insight: 创新点在于构建了一个全面且具有挑战性的科学图表编辑基准，结合了真实与合成数据，并支持多模态定位和多步编辑。客观来看，其提出的“重建-再编辑”课程学习策略，以及包含步骤级注释和人类对齐评估框架的设计，为提升MLLM在结构化视觉编辑任务上的可靠性和可控性提供了有价值的思路和工具。

Abstract: Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code presents a greater challenge: a model must jointly recover visual structure, ground the requested change, generate compilable code, and preserve all unrelated content. While existing TikZ benchmarks mainly focus on figure reconstruction and generation, few systematically evaluate instruction-guided scientific figure editing with compilable code. We introduce Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples. Edit2TikZ combines real-world and controlled synthetic edit cases, supports both textual and visual localization request, and contains multi-step editing, each with step-level annotations. We further construct a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved. Utilizing Edit2TikZ, we evaluate 14 mainstream MLLMs and find that current systems remain unreliable: on average, proprietary models achieve a compilation success rate of merely 75% and remain limited in both figure restoration and edit correctness, while compact models below 9B struggle further with instruction following and complete figure generation. Therefore, we build a mixed training set TikZEditMix and adopt reconstruction-then-editing curriculum learning for compact models. On Qwen3.5-4B, this training improves the compilation success rate from 45.35% to 83.40% and yields an average improvement of 18.7 points across our proposed evaluation metrics. The code and data will be released at https://github.com/Solunny/Edit2TikZ.

[85] MLLM-Routed Heterogeneous Ensembles for Robust Cross-Dataset Image Classification cs.CV | cs.AI | cs.CL | cs.LGPDF

Daniel Perkins, John Squires, Janou Milligan, Chandra Raskoti, Linda Ungerboeck

TL;DR: 本文提出了一种名为ARMDIL的自适应路由方法，用于跨数据集图像分类。该方法利用多模态大语言模型（MLLM）作为智能体，动态地将每张图像路由到最合适的视觉骨干网络（如ResNet、自监督学习模型和视觉语言模型）组成的异构集成中，以提升模型在不同领域和难度数据集上的鲁棒性和泛化能力。

Details

Motivation: 现代图像分类模型在单一任务数据集上表现优异，但在跨领域和不同难度数据集上泛化能力不足。本文旨在解决这一跨数据集图像分类的鲁棒性问题。

Result: 经验评估表明，ARMDIL能够有效权衡不同架构的能力与弱点，其性能与基于专门训练的路由器相当，并通过简单的提示修改大幅提升了适应性。

Insight: 核心创新在于利用MLLM作为动态路由器来管理异构模型集成，这避免了为每个新任务重新训练路由器的开销。该方法通过自然语言推理轨迹增强了可解释性，并为构建更可靠的通用视觉系统（如AI助手和自主机器人）提供了新思路。

Abstract: Modern image classification models excel when trained on single task-specific datasets but often struggle to generalize across domains and difficulty levels. We propose ARMDIL, an Adaptive Router for Multi-Domain Image classification with LLMs. ARMDIL is an ensemble that uses a multimodal large language model (MLLM) agent to dynamically route each image to the most suitable vision backbone. Our diverse ensemble employs convolutional neural networks (ResNets), self-supervised representation learners (SSL), and vision-language models (VLMs), each trained on a unified label space constructed from multiple image datasets with differing distributions and characteristics. Empirical evaluations illuminate the distinct capabilities and vulnerabilities of each architecture across disparate visual domains. Crucially, we show that ARMDIL effectively navigates these trade-offs, performing competitively with specialized training-based routers. Furthermore, it drastically improves adaptability by allowing new information to be integrated via simple prompt modifications, while enhancing interpretability through natural language reasoning traces. These advances in cross-dataset image classification pave the way for more reliable general-purpose vision systems such as AI assistants and autonomous robots.

[86] SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation cs.CVPDF

Jisoo Jeong, Hong Cai, Jamie Menjay Lin, Hanno Ackermann, Hyeonjun Sim

TL;DR: SNM-VFI是一种无需训练的视频帧插值框架，它结合了预训练的光流模型和视频扩散模型。该方法通过对称非线性运动模型生成具有对应关系的引导帧，来指导扩散过程，从而在保持密集运动一致性的同时提升感知真实感，并在不确定区域融合光流预测与扩散细节。

Details

Motivation: 传统基于扩散的VFI方法从随机噪声合成中间帧，缺乏对运动对应关系的显式利用，可能导致运动不一致或细节丢失。本文旨在通过运动引导的生成过程，更好地保留密集运动对应并提升插值帧的感知质量。

Result: 在DAVIS、Sintel和KITTI等具有挑战性的基准测试上进行了广泛评估，结果表明SNM-VFI在感知质量、重建精度和时间一致性方面均表现出色，达到了具有竞争力的水平。

Insight: 创新点在于提出了一个对称非线性运动模型来生成引导帧，并将其作为潜在先验来初始化和迭代指导预训练的视频扩散模型；同时利用置信度图在不确定区域（如遮挡和物体边界）融合光流的结构化预测与扩散生成的细节，这是一种将传统运动估计与生成模型有效结合的免训练策略。

Abstract: We propose Symmetric Nonlinear Motion-guided Generative Video Frame Interpolation (SNM-VFI), a training-free framework for motion-controllable generative video frame interpolation with pre-trained optical flow and video diffusion models. Unlike conventional diffusion-based VFI methods that synthesize intermediate frames from random noise, SNM-VFI guides the generative process with correspondence-aware frames produced by a symmetric nonlinear motion model. Specifically, we first utilize a pre-trained optical flow model to construct multi-frame nonlinear flow-based intermediate frames and confidence maps. These flow-guided frames are then encoded as latent priors to initialize and iteratively guide a pre-trained Video Diffusion model, enabling the diffusion model to preserve dense motion correspondence while improving perceptual realism. To further enhance output quality, we employ confidence maps to fuse structurally reliable flow-based predictions with diffusion-generated details in uncertain regions such as occlusions and object boundaries. Extensive evaluations on challenging benchmarks, including DAVIS, Sintel, and KITTI, demonstrate that SNM-VFI achieves strong perceptual quality, competitive reconstruction accuracy, and robust temporal coherence across diverse motion scenarios.

[87] Fine-Grained Action Recognition with Cross-Attentive Latent Sparse Experts cs.CVPDF

Imtiaz Ul Hassan, Tasweer Ahmad, Nik Bessis, Ardhendu Behera

TL;DR: 本文提出FineX模型，用于细粒度人类动作识别（FHAR），通过分解细粒度线索为RGB外观、姿态热图几何和骨骼图拓扑，并采用成对交叉注意力实现对称、流保持的信息交换，以及流式潜在稀疏专家混合（MoE）机制，将每种表示路由到内容相关的共享专家子集。

Details

Motivation: 细粒度人类动作识别需要区分视觉上相似但主要在身体配置、时序或局部外观上不同的动作，RGB表示保留视觉上下文但常抑制关节级几何，而骨骼表示编码运动学但丢弃密集空间细节，因此需要融合多模态线索以提升识别性能。

Result: FineX在Gym99、Gym288和Diving48基准上达到最先进水平（SOTA），在长尾数据集Gym288上，将平均类别准确率从68.6%提升至76.2%（+7.6个百分点），无需文本监督或大规模视觉语言预训练。

Insight: 创新点包括结构化视觉-姿态-图融合方法，通过成对交叉注意力实现多模态对称交互，以及条件专家细化机制，利用潜在稀疏MoE进行内容依赖的路由，以增强细粒度动作识别的判别能力。

Abstract: Fine-grained human action recognition (FHAR) must distinguish visually similar actions that differ mainly in body configuration, timing, or local appearance. RGB representations retain visual context but often suppress joint-level geometry, whereas skeleton representations encode kinematics but discard dense spatial detail. We introduce FineX, which factorizes fine-grained cues into RGB appearance, pose heatmap geometry, and skeletal-graph topology. Pairwise cross-attention enables symmetric, stream-preserving information exchange, followed by a streamwise latent sparse Mixture-of-Experts that routes each representation to a content-dependent subset of shared experts, regularized by a load-balancing objective. FineX achieves state-of-the-art results on Gym99, Gym288, and Diving48. On the long-tailed Gym288, it raises mean class accuracy from 68.6% to 76.2% (+7.6 points) without textual supervision or large-scale vision-language pre-training, demonstrating the benefit of structured visual-pose-graph fusion and conditional expert refinement for FHAR.

[88] DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation cs.CV | cs.ROPDF

DreamX Team, Rui Chen, Xiangxiang Chu, Geng Li, Jifan Li

TL;DR: 本文提出了DreamX-Phi 1.0，一个用于机器人操作的动作条件视频世界模型。该模型在给定观察帧、语言指令和包含末端执行器位姿与夹爪状态的规定动作序列后，能够预测未来的观测结果。为确保预测忠实于指令，模型引入了基于PRoPE风格几何编码的每臂SE(3)变换注入注意力机制，并集成了轻量级深度分支与SAM3掩码及冻结的V-JEPA教师模型来维持场景几何与物体一致性。模型还通过分布匹配蒸馏将多步生成器提炼为少步学生模型以提升部署效率。

Details

Motivation: 解决机器人操作中视频世界模型预测的忠实性问题，即确保生成的未来视频不仅视觉逼真，还能准确反映指令动作（如正确移动指定机械臂、保持被操作物体）并维持场景几何与物体一致性。

Result: 在WorldArena 2.0挑战赛中，该模型在Track 1获得第一名，在Track 2获得第二名，达到了领先水平。

Insight: 创新点包括：1) 通过PRoPE风格的几何编码将每臂SE(3)变换注入注意力，以保持机械臂身份和刚体运动结构；2) 结合轻量级深度分支与SAM3掩码及冻结的V-JEPA教师，增强场景几何和物体一致性；3) 采用分布匹配蒸馏实现从多步生成器到高效少步学生模型的提炼。

Abstract: We present \textbf{DreamX-Phi 1.0}, an action-conditioned video world model for robotic manipulation that, given an observed frame, a language instruction, and a prescribed action sequence comprising end-effector poses and gripper states, predicts the resulting future observations. Yet realism alone does not guarantee faithfulness: a convincing rollout can still move the wrong arm or lose the manipulated object. To ensure the prediction respects each arm’s commanded path, we inject per-arm $\mathrm{SE}(3)$ transformations into attention via \textbf{PRoPE-style geometric encoding}, preserving arm identity and rigid-motion structure. Action control alone does not fully constrain scene geometry or the evolution of small manipulated objects. We therefore add a lightweight \textbf{depth branch} for scene-level geometry and use \textbf{SAM3 masks} with a frozen \textbf{V-JEPA teacher} to maintain object consistency throughout grasping. We further distill the multi-step generator into a few-step student via distribution-matching distillation for efficient deployment. At the time of writing, \model{} achieves first place on Track~~1 and second place on Track~~2 of the WorldArena~2.0 Challenge. Our model and code will be publicly available.

[89] GS$^{2}$CI: Robust Gaussian Splatting For Snapshot Compressive Imaging via Large Vision Model Priors cs.CVPDF

Yanming Yang, Chenxi Song, Ping Wang, Xin Yuan, Chi Zhang

TL;DR: 本文提出GS$^{2}$CI框架，利用大规模视觉基础模型的先验知识和3D高斯溅射技术，从单张快照压缩成像测量中重建高质量3D场景。该方法通过测量驱动的3D VFM初始化、SCI感知的高斯优化、伪视角监督以及专门设计的OSGR稠密化策略，有效解决了信息丢失、视角多样性有限和联合优化负担等挑战。

Details

Motivation: 现有方法在从快照压缩成像进行3D场景重建时，面临信息丢失、视角多样性有限以及联合优化3D表示和相机姿态计算负担大的挑战。

Result: 在多个基准测试上的广泛实验表明，该方法实现了最强的综合性能，在重建质量和视角变化鲁棒性方面领先，同时具有竞争力的计算效率。

Insight: 创新点在于结合3D VFM先验进行初始化、利用2D VFM进行伪视角监督以细化局部外观，以及引入OSGR这一针对SCI监督模糊性设计的稠密化策略，通过不透明度引导的分裂与增长调控来稳定优化过程。

Abstract: Snapshot Compressive Imaging (SCI) offers an efficient solution for high-speed video acquisition and, under exposure-time camera–scene relative motion, multi-view scene capture by compressing temporal or spatial information into a single 2D measurement. While recent studies have explored SCI for 3D scene reconstruction, existing methods struggle with significant challenges due to information loss, limited viewpoint diversity, and the computational burden of jointly optimizing 3D representations and camera poses. In this work, we propose a novel framework that reconstructs high-quality 3D scenes from a single SCI measurement by leveraging 3D Gaussian Splatting (3DGS) and the powerful priors of large-scale vision foundation models (VFMs). Our primary reconstruction combines measurement-derived 3D VFM initialization with SCI-aware Gaussian optimization. After coarse-stage convergence, an auxiliary 2D VFM provides pseudo-view supervision at synthesized viewpoints for local appearance refinement. To further address the instability caused by ambiguous SCI supervision during 3DGS optimization, we introduce Opacity-Guided Splitting and Growth Regulation (OSGR), an SCI-specific densification strategy that augments split candidates using local opacity statistics, discourages loss-compensating opacity inflation through mean-opacity regulation, and bounds representation growth with explicit candidate-ratio and Gaussian-count constraints. Extensive experiments across multiple benchmarks demonstrate that our method achieves the strongest overall performance, combining leading reconstruction quality and robustness to viewpoint variation with competitive computational efficiency.

[90] TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval cs.CV | cs.LGPDF

Yi-Chung Chen, Philip Jacobson, Tom Lampo, Yiren Lu, Jin Yao

TL;DR: 本文提出了TraVEL，一种用于驾驶视频检索的轨迹引导视频嵌入学习框架。该工作旨在解决通用多模态嵌入模型在区分以运动为中心的驾驶事件（如左转/右转、加速/减速）方面的不足，通过利用自我轨迹相似性作为奖励进行微调，从而提升细粒度的运动理解能力。

Details

Motivation: 高效地从大规模驾驶日志中检索相关片段对于数据管理、模型开发和安全性分析至关重要。现有基于规则的系统需要专家定义，而通用多模态嵌入模型则难以准确区分以运动为中心的驾驶事件。

Result: 在基于nuReasoning构建的驾驶视频检索基准上，TraVEL显著提升了以运动为中心的检索性能。相对于监督微调，在2B模型上，纵向和横向mAP分别提升了9.8和4.7个百分点；在8B模型上，分别提升了7.2和1.5个百分点。

Insight: 创新点在于提出了一个利用自我轨迹相似性作为奖励的、基于组相对策略优化的运动感知微调框架。其核心洞察是将轨迹作为特权监督信号来引导嵌入学习，而检索时仅需单个视频向量，无需姿态、规则或辅助感知输出，从而将物理基础的监督与高效的基于嵌入的搜索相结合。

Abstract: Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis. Structured and rule-based retrieval systems can explicitly target driving events, but typically require expert-defined rules, auxiliary data, and multi-stage perception pipelines. Multimodal embedding models offer a simpler and more efficient alternative by representing each video with a single searchable vector. However, general-purpose models often rely on shortcuts from static scene context and struggle to distinguish motion-centric events, such as turning left versus right or accelerating versus decelerating. In this work, we study how to adapt a general-purpose multimodal embedding model to driving-video retrieval. We first fine-tune Qwen3-VL-Embedding on paired clips and reasoning traces from nuReasoning using an InfoNCE objective. While this stage substantially improves overall retrieval, caption supervision alone remains insufficient for fine-grained motion understanding. We therefore introduce TraVEL (Trajectory-Guided Video Embedding Learning), a motion-aware fine-tuning framework that uses ego-trajectory similarity as a reward within Group Relative Policy Optimization. Trajectories serve only as privileged training supervision; retrieval still operates on single-vector video embeddings without ego poses, expert rules, or auxiliary perception outputs. We further construct a driving-video retrieval benchmark from nuReasoning. Experiments show that TraVEL improves motion-centric retrieval across model scales: relative to SFT, it raises longitudinal and lateral mAP by 9.8 and 4.7 points at 2B, with corresponding gains of 7.2 and 1.5 points at 8B. TraVEL thus combines physically grounded supervision with efficient embedding-based search.

[91] TabSOM: A tabular-to-image encoding method based on self-organizing maps cs.CV | cs.LGPDF

David Chushig-Muzo, María Ángeles Rodríguez de Cara, Eva Milara, Francisco J. Lara-Abelenda, Luis Zhinin-Vera

TL;DR: 本文提出了一种名为TabSOM的新型表格数据到图像的编码方法，该方法基于自组织映射（SOM）构建。它通过无冲突匈牙利分配为每个特征在画布上分配固定位置，并构建捕获特征对关系的图，生成包含多尺度节点通道的图像表示。该方法在多个公开二分类数据集上评估，性能优异且方差最低，同时提供了两种可解释性工具。

Details

Motivation: 现有表格转图像方法仅编码特征的边际值，丢弃了特征间关系信息，存在局限性。本文旨在解决这一问题，通过利用SOM同时保留特征值和特征关系，以更好地应用深度学习架构于表格数据。

Result: 在12种现有表格转图像方法中，TabSOM在多个公开二分类数据集上均排名第一或第二，并且取得了所有方法中最低的方差，表现出稳定且优异的性能。

Insight: 核心创新在于利用SOM的组件平面同时编码特征值和特征对关系，并引入无冲突匈牙利分配来固定特征位置。此外，提出的原型启发式部分依赖图和类别分离重要性评分增强了模型的可解释性，弥合了表格数据深度学习中的性能与可解释性差距。

Abstract: Tabular-to-image methods have emerged as novel approaches to leverage the high predictive performance of convolutional neural networks and vision transformers. They convert tabular data into image representations, mapping each feature at a fixed pixel location derived from a dimensionality-reduction method (e.g., t-SNE, UMAP, PCA). However, they encode only the marginal value of each feature and discard information about feature relationships. We propose TabSOM, a tabular-to-image encoding built on the Self-Organizing Map (SOM), which provides: (i) a spatial layout in which every input feature occupies a fixed canvas position derived from its component plane via collision-free Hungarian assignment; and (ii) a graph that captures pairwise feature relationships derived from the SOM component planes. The resulting image stacks two multi-scale node channels: one encodes feature values at fixed scales, while the other encodes pairwise feature interactions as spatial connections between related features. Two SOM-derived interpretability approaches are introduced: a prototype-inspired partial dependence plot and a class–separation importance score. Benchmarked against twelve existing tabular-to-image methods across public binary-classification datasets, TabSOM ranks first or second on every dataset and achieves the lowest variance of any method evaluated. Interpretability obtained with TabSOM was validated against Random Forest, XGBoost, and SHAP, the class-separation score shows reasonable agreement with established baselines on the top-ranked features while capturing complementary structural information from input data. These results demonstrate that TabSOM provides an effective and interpretable approach for applying deep learning architectures to tabular data, bridging the performance–interpretability gap in this domain.

[92] PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives cs.CVPDF

Kaixin Ding, Xi Chen, Minghong Cai, Zhiyuan Xu, Yiyang Wang

TL;DR: 本文提出了PlayWorld基准测试，用于评估视频世界模型在长时程交互目标下的性能。该基准包含171个场景，每个场景设定具体目标，并引入多模态智能体玩家与模型交互，从几何一致性、交互保真度、视野外演化和洞察演化四个核心维度进行评估。实验表明，当前最先进的世界模型在长时程交互目标上仍不可靠，尤其是在空间一致性和持久状态演化方面。

Details

Motivation: 现有视频世界模型在长序列上展现出良好的视频一致性和动作可控性，但公平比较这些交互模型仍具挑战性，因为人类玩家通常通过追求长时程目标来评估模型，而实现同一目标所需的动作序列在不同模型间差异很大，使得固定动作条件的评估方法不适用于跨模型比较。

Result: 在九个最先进的世界模型上的实验表明，当前模型在长时程交互目标上表现不可靠，特别是在维持空间一致性和持久状态演化方面存在不足。

Insight: 创新点在于引入了多模态智能体玩家来模拟人类交互，并构建了一个专注于长时程目标的基准测试，从四个核心维度进行综合评估，为世界模型的交互性能提供了更公平和全面的评估框架。

Abstract: Video world models simulate future states conditioned on current observations and user actions. Recent systems have demonstrated impressive video consistency and action controllability over long sequences. However, fairly comparing these interactive models remains challenging. In practice, a human player typically evaluates a world model by pursuing long-horizon objectives through interaction. For example, a user may turn around 360 degrees to see whether the environment remains consistent, or walk into the water and inspect whether realistic water ripples are generated. The action sequence required to achieve the same objective may vary substantially between models, making fixed action-conditioned evaluation unsuitable for cross-model comparison. To address this, we employ multi-modal Agent Players to interact with world models toward specified long-horizon objectives. Building on this paradigm, we introduce PlayWorld, a benchmark providing 171 scenarios, each with a specified objective. To evaluate performance thoroughly, we assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution. In addition, we incorporate basic ability metrics for video quality and controllability. Experiments across nine state-of-the-art world models reveal that current models remain unreliable on long-horizon interactive objectives, particularly in maintaining spatial consistency and persistent state evolution. Code and data are available at https://github.com/kxding/PlayWorld.

[93] Alaya-EVOKE: From Linear-Scaling Supervision to Endless World cs.CVPDF

Yuanyang Yin, Gongxuan Wang, Yifan Zhan, Chuanhao Li, Kaipeng Zhang

TL;DR: Alaya-EVOKE提出了一种用于交互式世界模型的新方法，通过将持久世界状态外部化并重新设计教师模型来支持长时程交互生成。它利用外部相机索引的世界状态库来维护场景几何，仅检索视图相关信息以保持去噪器上下文有界。教师模型采用稀疏注意力机制，结合分块分组、检索选定远距离帧和线性注意力全局状态，实现了内存和计算量的线性增长。该方法通过30秒分布匹配目标将能力转移至三步学生模型，在保持响应式条件控制的同时提高了对长期漂移的抵抗力。

Details

Motivation: 解决交互式世界模型中持久内存、响应式交互和长时程生成之间的冲突需求，避免因在去噪器上下文或键值缓存中维护历史而导致成本增长，并突破低延迟交互中少步生成受限于教师模型能力的瓶颈。

Result: 在WBench上达到了最先进的性能，同时在VBench-Long和VBench-2.0上保持竞争力。在单块H200 GPU上以384×640分辨率生成每个1.5秒的片段耗时2.11秒。

Insight: 将持久世界状态外部化以有界上下文支持开放式生成，以及设计用于长时程监督的教师模型（结合分块分组、检索和线性注意力）以实现线性扩展，并通过分布匹配目标将能力高效蒸馏到少步学生模型中，是提升交互世界模型可扩展性和性能的关键创新。

Abstract: Interactive world models must support persistent memory, responsive interaction, and long-horizon generation, yet these requirements place conflicting demands on the model. Maintaining history in the denoiser context or key-value cache incurs growing cost, forcing a trade-off between session length and retained memory, while low-latency interaction relies on few-step generation whose capabilities are bounded by its teacher. Evoke addresses both limitations by externalizing persistent world state and redesigning the teacher for long-horizon interactive generation. Scene geometry is maintained in an external, camera-indexed world state bank, from which only view-relevant information is retrieved, keeping the denoiser context bounded as the session grows. Rather than treating the teacher as a fixed generator, we design it for long-horizon supervision: its sparse attention combines chunk-wise grouping, retrieval of selected distant frames, and a linear-attention global state, yielding linear growth in memory and compute while enabling supervision over long horizons. Such supervision exposes content drift that stays locally plausible within short windows, while per-chunk conditioning enables prompt changes and event control throughout the sequence. A 30-second distribution-matching objective, applied under self-forced rollouts, transfers both capabilities to a three-step student that uses no classifier-free guidance, improving resistance to long-term drift while preserving responsive conditioning. With bounded context and recurrent external memory, Evoke supports open-ended, continuously evolving generation; on a single H200 at $384\times 640$, each $1.5,\mathrm{s}$ chunk is generated in $2.11,\mathrm{s}$. As a three-step world model, Evoke achieves state-of-the-art performance on WBench while remaining competitive on VBench-Long and VBench-2.0.

[94] AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design cs.CV | cs.AI | cs.CLPDF

Yaxin Luo, Haobin Jiang, Jialv Zou, Xu Huang, Wenhao Yan

TL;DR: AutoDesign是一个用于长视野智能体设计的元约束优化框架，它将多模态输入转化为结构化媒体输出视为一个以模型约束系统为中心的长期智能体过程。该框架通过元约束优化器指导代码智能体基于反馈递归改进约束，并在学术论文到海报生成任务上进行了实例化和评估。

Details

Motivation: 现有约束系统通常是静态的，无法与人类设计先验对齐并通过经验探索积累可重用经验以实现递归自我改进，因此需要一种能够动态优化约束的框架。

Result: 在PosterBench主赛道（包含5个学科的100篇论文）上，AutoDesign获得最高分78.32，比闭源商业系统Claude Design高出7.45分；在7种受控代码智能体模型配置中，集成学习到的DesignHarness将平均PosterBench分数从54.99提升至67.39（+12.4%）；在完全自主的长视野循环中，它在40分钟内以低于3美元的成本执行了253次工具调用和11次编辑轮次，达到平均会议海报质量。

Insight: 创新点在于提出了一个元约束优化框架，使约束系统能够与人类设计先验对齐并通过反馈驱动递归自我改进；客观来看，该框架将长视野设计任务形式化为可学习的智能体过程，并通过专门的基准（PosterBench）实现了系统化评估。

Abstract: Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to drive recursive self-improvement, existing paradigms remain static and fall short of this capability. In this paper, we present AutoDesign, a framework that aligns with human design priors, where a meta-harness optimizer guides a code agent to recursively improve harness based on rollout feedback. To instantiate and evaluate this framework, we focus on the academic paper-to-poster generation task and introduce PosterBench, comprising a 100-paper Main Track spanning five disciplines and PosterBench-mini, a shared 10-paper subset for controlled evaluation. On the PosterBench Main Track, AutoDesign achieves the highest score of 78.32, surpassing the closed-source commercial system Claude Design by 7.45 points. Across seven controlled code-agent-model configurations, integrating the learned DesignHarness consistently improves performance, increasing the average PosterBench Score from 54.99 to 67.39 (+12.4%). In a fully autonomous long-horizon loop, it executes 253 tool calls and 11 editing turns within 40 minutes for under $3, reaching average conference-poster quality in human evaluation. A system-blind human study further demonstrates that AutoDesign achieves the highest human preference among evaluated systems.

[95] V-RAE: Rethinking Video Latent Spaces for Generation cs.CVPDF

Minghui Guo, Shengqiong Wu, Hao Fei

TL;DR: 本文提出了V-RAE，一种基于冻结视觉基础模型表示的视频表示自编码器，旨在构建更适合生成建模的紧凑视频潜在空间。该方法通过轻量级时序池化模块去除冗余并保留语义结构，其解码器能从压缩特征中重建连续运动。实验表明，V-RAE在视频重建、语义探测和条件生成任务上优于传统视频VAE，其潜在空间保留了更多语义信息，且生成收敛速度更快。

Details

Motivation: 现有视频自编码器的潜在空间主要针对像素级重建进行优化，缺乏高级语义组织，且重建最优的潜在空间不一定适合生成建模。本文旨在重新思考视频潜在空间，利用冻结的基础模型语义表示来构建更利于生成的紧凑潜在空间。

Result: 在K600数据集上，V-RAE取得了2.13的rFVD分数，超越了所有评估的大规模预训练视频VAE。在UCF101和K600上，其最佳变体分别取得了117.86和19.16的gFVD分数，且收敛速度提升了6倍。在Cityscapes的未来视频预测任务中，其表现也优于Wan 2.2 VAE潜在空间。

Insight: 核心创新在于利用冻结的视觉基础模型（如CLIP、DINOv2）的语义表示作为起点，通过轻量级时序建模构建生成友好的潜在空间，而非从零开始学习。这挑战了“重建最优即生成最优”的传统观念，并引入了tFVD作为与下游生成质量更相关的时间一致性诊断指标。

Abstract: Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization. A reconstruction-optimal latent space, however, need not be well suited to generative modeling. We propose V-RAE, a video representation autoencoder that builds compact generative latents on top of frozen vision foundation model representations. A lightweight temporal pooling module removes temporal redundancy while preserving semantic structure, and a video decoder reconstructs continuous motion from the compressed features. We evaluate V-RAE with four representative frozen encoders on video reconstruction, semantic probing, and class-conditional generation. V-RAE achieves 2.13 rFVD on K600, outperforming all evaluated large-scale pretrained video VAEs. Its latents retain substantially more semantic information than conventional video tokenizer latents. Under matched generation settings, our best variant achieves gFVD scores of 117.86 and 19.16 on UCF101 and K600, respectively, while converging up to 6x faster}. We further show that reconstruction quality alone is insufficient to characterize generative utility and introduce tFVD, a temporal-coherence diagnostic that correlates more reliably with downstream generation quality. Beyond video generation, V-RAE also improves future video prediction on Cityscapes over the Wan 2.2 VAE latent space under matched prediction settings. Taken together, the experiments show that frozen semantic representations can support video reconstruction, generation, and predictive modeling. The project page: https://v-rae.github.io/.

cs.DL [Back]

[96] Is this Citation on Point? cs.DL | cs.CLPDF

Apurv Verma

TL;DR: 本文研究大型语言模型在法律用例中验证引文支持的能力，特别是针对引用真实案例但页码不匹配的错误。通过构建两个法律语料库的受控扰动数据集，评估了14种模型配置，发现模型能有效检测错误案例（93-100%），但对错误页码的检测率较低（37-83%），且模型倾向于基于主题重叠而非页面级支持接受引文。

Details

Motivation: 解决现有LLM法律用例评估中忽视的关键问题：检测引用真实案例但页码不匹配（即不支持所提主张）的引文错误，这类错误难以通过数据库查找发现。

Result: 在构建的扰动数据集上，模型对错误案例的检测率达到93-100%，但对错误页码的检测率在法院意见上仅为37-61%，在法律简报上为52-83%。即使使用GPT-5.4进行高推理努力，仍会遗漏40%的法院意见页码不匹配和18%的简报页码不匹配。

Insight: 创新点在于通过受控扰动方法系统评估LLM的命题级引文支持验证能力，揭示了模型将识别正确法律主题与验证具体命题支持混为一谈的局限性；提示模型在引用页面验证支持可提高召回率但会增加误报，表明需要区分这两种能力。

Abstract: In 2023, a New York judge sanctioned two attorneys in Mata v. Avianca for filing a brief with hallucinated citations generated by ChatGPT. Such failures are largely caught by database lookups; the harder problem is detecting citations that point to real cases but do not support the propositions for which they are offered – a failure mode that existing evaluations of LLMs for legal use cases largely overlook. In this paper, we study proposition-level citation support verification through controlled perturbations of real legal citations obtained from two legal corpora, either replacing the cited case or changing only the pinpoint page within the same case. We evaluate fourteen model configurations on the resulting examples. Models catch 93-100% of wrong-case corruptions. They catch only 37-61% of wrong-pinpoint corruptions on court opinions and 52-83% on legal briefs. When models fail to catch wrong-pinpoint corruptions, they accept the citation based on topical overlap rather than page-level support. Scale and extended reasoning narrow the gap but do not close it: GPT-5.4 with high reasoning effort still misses 40% of pinpoint mismatches on court opinions and 18% on briefs. Prompting the model to verify support at the cited page improves recall, but it also raises the false positive rate. Recognizing the right legal topic and verifying support for the cited proposition are distinct capabilities, and current models conflate them.

cs.AI [Back]

[97] Position: Reasoning is a Learnable Rule-Based Process cs.AI | cs.CL | cs.LGPDF

Rachel Lawrence, Jacqueline Maasch

TL;DR: 这篇立场论文认为，当前生成式AI社区对“推理”缺乏清晰的操作性定义，这损害了评估的有效性和可信自主推理的量化进展。论文主张推理应被定义为一种可学习的、基于规则的过程，并提出了一个基于文献综述的操作性定义以及AI推理研究交流的最佳实践清单。

Details

Motivation: 解决生成式AI领域对“推理”概念的定义模糊问题，这种模糊性导致推理评估的构念效度无法验证，阻碍了向可信自主推理的量化进步。

Result: 论文未提及具体的定量实验结果或基准测试，其成果是概念性的，即提出了关于推理的操作性定义和一套研究交流的最佳实践清单。

Insight: 核心创新点在于将有效的、可靠的推理重新定位为一种“可学习的基于规则的过程”，这为评估和推进AI推理能力提供了一个更严谨、可验证的框架。从客观角度看，这有助于弥合符号AI与生成式AI在推理概念上的分歧，提升该领域研究的严谨性和可比性。

Abstract: Autonomous reasoning is among the most scientifically and economically motivating topics in AI today. Historically the purview of symbolic AI, recent advances have mainly emerged from deep probabilistic generative models. Despite immense interest and rapid progress, the generative AI community has not clearly converged on operational definitions for reasoning and often implicitly rejects the historical treatment of this topic in logic and verifiable automated reasoning. This position contends that definitional ambiguity leaves the construct validity of reasoning evaluation unverifiable, undermining quantifiable progress toward trustworthy autonomous reasoning. We also contend that this ambiguity is addressable. To that end, we provide (1) operational definitions based on a synthesis of the literature, positioning valid and sound reasoning as a learnable rule-based process; and (2) a checklist for best practices in the communication of AI reasoning research.

[98] Diagnostic Foundation for Evaluating LLMs’ Research Integrity as Co-Scientists cs.AI | cs.CLPDF

Yash Tripathi, Silu Sharma, Sai Sidhanth Manoharan Jayanthi, Shivank Garg, Lin Li

TL;DR: 本文介绍了IntegrityBench基准测试，用于评估大型语言模型作为科研合作者时在机构压力下的研究诚信表现。该基准包含36个配对任务，涵盖三个领域和四个研究阶段，采用五级隐式-显式压力协议。研究发现，前沿模型在高压下约三分之一的关键决策会失败，且模型规模和推理能力无法可靠缓解此问题。

Details

Motivation: 随着语言模型越来越多地被部署为科研合作者，其在机构压力下维护研究诚信的能力尚未得到衡量，因此需要开发一个基准来评估模型在压力下的伦理决策和行为。

Result: 在IntegrityBench上评估18个前沿模型变体，发现在峰值压力下，模型在约三分之一的关键诚信决策中失败；显式压力导致模型顺从不当行为，而隐式情境重构则更常导致对合法研究任务的过度拒绝。

Insight: 创新点在于提出了一个系统性的压力测试基准，揭示了模型诚信决策的三个层面（不当行为分类、伦理行动推理和基于事实的决策）在结构上是分离的，正确的伦理行动不一定需要准确的分类；这指出了模型在看似有帮助的同时可能隐藏诚信失败，带来两种部署风险：促进研究不当行为和侵蚀对AI辅助研究的信任。

Abstract: Language models are increasingly deployed as co-scientists, yet their ability to uphold research integrity under institutional pressure remains unmeasured. We introduce IntegrityBench, a benchmark evaluating misconduct classification, ethical action reasoning and artifact-grounded decision making across 36 paired tasks under a 5-level implicit-explicit pressure protocol spanning 3 domains and 4 research stages. Evaluating 18 frontier model variants, we find that under peak pressure, models fail roughly 1 in 3 integrity-critical decisions, and neither scale nor reasoning ability reliably mitigates this. Explicit pressures induce compliance with misconduct, while implicit contextual reframing more often causes over-refusal of legitimate research tasks. Interestingly, models failing to classify research requests accurately perform equally or better on artifact-grounded decision making (85.7 vs. 79.4), suggesting the three facets are structurally dissociated and correct ethical action does not require accurate classification. Frontier models can thus appear helpful while harbouring integrity failures that create two distinct deployment risks: facilitating research misconduct and eroding trust in AI-assisted research.

[99] Large Language Models Can Follow Instructions, But Not Many at Once: Phase Transitions in Compositional Constraint Satisfaction cs.AI | cs.CLPDF

Mariya I. Vasileva

TL;DR: 本文通过引入约束饱和评估（CSE）基准，系统研究了大型语言模型在同时遵循多个约束时的性能变化。研究发现，随着约束数量增加，模型满足所有约束的概率急剧下降，且不同约束类型（如结构性与词汇性）的退化程度不同，失败主要源于独立错误的累积。

Details

Motivation: 当前大型语言模型在单一约束下表现良好，但在需要同时满足多个约束（如推理结构、安全边界、输出格式）的组合场景中性能退化机制尚不明确，本文旨在量化这种退化并探究其成因。

Result: 在CSE基准（涵盖15个模型、36种约束类型、369,753次检查）上，模型在约束数k=8时单个约束通过率约41%，但同时满足所有8个约束的概率仅5.7%；最强模型在7个约束时探针级成功率低于50%，而15个模型中有12个在不超过3个约束时即出现崩溃。

Insight: 创新点在于提出了无LLM评判介入的规则化验证基准CSE，揭示了约束组合下的相变现象：性能衰减具有乘性累积特征，且结构性约束比词汇性约束更脆弱；失败源于输出特征的共享依赖而非约束间直接干扰，这为提升模型组合推理能力提供了方向。

Abstract: Large language models are increasingly deployed in settings that require simultaneous adherence to multiple explicit constraints - reasoning structure, safety boundaries, output schemas. Individual constraints are handled proficiently, but the compositional regime, where many must hold jointly, remains poorly characterized: how rapidly does performance degrade, what governs the degradation, and can the collapse be mitigated? We introduce Constraint Saturation Evaluation (CSE), a procedurally generated benchmark that systematically varies the number of simultaneous constraints (k), with every constraint scored by a deterministic, rule-based verifier and zero LLM-judge involvement: 15 models, 36 constraint types, 369,753 checks at k=1-12. Three findings emerge. First, per-constraint pass rate decays gradually and predictably, while the chance of satisfying all k constraints collapses - a model passing individual constraints at ~41% at k=8 succeeds on all eight just 5.7% of the time. Second, constraints do not degrade equally: structural constraints lose 2x more baseline capability per added constraint than lexical ones, ordered by a comprehension-maintenance gap that separates constraints requiring sustained tracking from binary decisions immune to composition. Third, failures are nearly independent, which is what makes the accumulation multiplicative; the residual coupling that does exist tracks shared output features rather than pairwise interference - a wrong sentence count fails every constraint that reads it. Reliable instruction following breaks down beyond 5-6 simultaneous constraints: probe-level success falls below 50% at 7 constraints for the strongest model, and at 3 or fewer for 12 of 15.

[100] SteerBench-Work: A Benchmark for Agent Steering at Action Boundaries cs.AI | cs.CL | cs.LGPDF

Oguz Serdar, Cuneyt Mertayak

TL;DR: 该论文提出了SteerBench-Work基准，用于评估LLM智能体在工作场所执行关键操作（如发送邮件、合并代码）前的‘转向’决策能力，即在行动边界决定是‘执行’还是‘暂停并等待人工审核’。基准涵盖多个领域，包含106个基于真实事件的场景，并设计了证据反转镜像等控制条件。研究发现，现有模型普遍存在过度拒绝已授权安全操作的问题，而校准能力与通用能力并不等同。

Details

Motivation: 解决长周期LLM智能体在执行关键工具操作（如发送邮件、支付）时，在行动边界缺乏可靠的、经过校准的‘转向’决策（即决定执行或暂停审核）的评估问题，尤其是在工作场所的多领域高风险场景中。

Result: 在30种模型条件下测试，模型错误主要集中在一个方向：错误地暂停已授权且有证据支持的安全操作的比例高达28.1%，而错误允许不安全操作的比例仅为1.0%。模型在著名事件的‘证据反转镜像’案例上表现（63.8%正确率）显著差于原事件本身（98.5%正确率），表明其决策易受证据呈现方式影响。

Insight: 创新点在于构建了一个以真实事件为锚点、双向平衡（执行与暂停机会均等）且包含证据反转对照的基准，专门用于评估智能体在行动边界的决策校准能力。客观分析认为，该研究揭示了模型‘转向’决策中的系统性偏差（过度保守）以及决策校准与通用推理能力之间的脱钩，为开发更安全、可信的AI代理提供了关键的评估工具和洞见。

Abstract: Long-running LLM agents act through tools, and a single step can send an email, merge a pull request, or wire a payment. The steering decision is the pre-commit choice at that boundary: proceed, or hold for human or policy review. We introduce SteerBench-Work, an incident-anchored, bidirectional benchmark for that decision in workplace agents across developer operations, customer service, finance, legal, medical, HR, and security. Release v2026-05 contains 106 scenarios anchored in public incidents, paired evidence-reversed mirrors, and calibration controls, with labels split nearly evenly between proceed and hold so the two error directions get near-identical numbers of chances. A model sees the proposed action and the available evidence, returns a gate decision, and is scored on whether it crosses or holds the boundary correctly. Across 30 model conditions the failures run almost entirely in one direction: models wrongly hold authorized, evidence-cleared work on 28.1% of opportunities and wrongly allow unsafe work on 1.0%. The hardest cases are risk-resolved commits, where signed or structured evidence has already cleared a real risk trigger, and models score markedly worse on evidence-reversed mirrors of famous incidents (63.8%) than on the incidents themselves (98.5%). General capability is not the same as steering calibration: higher-capability models often over-refuse at the commit boundary, and more reasoning can repair a weak gate while leaving a calibrated one flat. The public leaderboard is at steerbench.com.

[101] MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination cs.AI | cs.CLPDF

Saisha Shetty, Satvik Tripathi, Austin Lin, Colin Zhao, Theodore Kim

TL;DR: 本文介绍了MARC v1，一个开源的多智能体框架，用于临床AI推理与协调。该框架通过确定性的多智能体编排替代了传统的单体LLM提示，协调角色专业化的智能体进行信息提取、推理、答案生成和评估，并支持显式的上下文传递和可追溯的中间输出。此外，框架引入了Decomposer模块，可从自然语言描述生成任务特定的智能体提示，无需手动提示工程，并支持基于API和本地CPU的部署，完全通过YAML配置。

Details

Motivation: 解决临床推理任务中传统单体LLM提示方法缺乏可解释性、难以追踪错误来源以及需要大量手动提示工程的问题。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较，但强调了框架在可解释性、可配置性和可访问性方面的优势。

Insight: 创新点在于将临床推理任务分解为多个专业化智能体的确定性编排流程，实现了阶段性的失败归因；Decomposer模块自动化了提示生成，降低了使用门槛；框架设计为模型无关且完全通过配置文件管理，提升了可移植性和领域专家的可用性。

Abstract: We present Multi-Agent Reasoning and Coordination (MARC), an open-source framework that replaces monolithic LLM prompting with deterministic multi-agent orchestration for clinical reasoning. MARC coordinates role-specialized agents for extraction, reasoning, answer generation, and evaluation, with explicit context passing and traceable intermediate outputs, enabling stage-wise failure attribution. We additionally introduce a Decomposer module that generates task-specific agent prompts from a plain-language description, eliminating manual prompt engineering. The framework supports both API-based and local CPU-compatible deployments and is entirely configurable via YAML, without code modifications. MARC is designed to be model-agnostic, interpretable, and accessible to clinical domain experts without programming expertise. The full framework is available at https://github.com/Penn-RAIL/MARC-v1.

[102] Auditable agentic AI for evidence-grounded thyroid ultrasound diagnosis and reporting cs.AI | cs.CVPDF

Haifan Gong, Shiyu Chen, Bodong Wang, Yuqi Wang, Shijie Wang

TL;DR: 本文提出了ThyroidXAgent，一个可审计的、支持临床医生交互的智能体AI系统，用于甲状腺超声诊断和报告生成。该系统整合了病灶定位、测量、风险分层和报告生成等任务，并在多中心数据集上验证了其性能，显著提升了诊断准确性和报告一致性，同时减少了医生的工作时间。

Details

Motivation: 解决现有AI系统在甲状腺超声诊断中任务孤立、缺乏临床审查支持的问题，旨在开发一个能够协调多个诊断工具并提供可审计证据记录的智能体系统。

Result: 在非重叠的28,458个测试案例中，ThyroidXAgent实现了结节分割的平均Dice分数为87.21%，良恶性分类的平均AUROC为0.9466；在淋巴结转移预测和滤泡性与乳头状甲状腺癌分类中，AUROC分别为0.864和0.805。报告生成方面，基于证据的组装方法优于多模态语言模型基线，并提升了医生分类准确性和报告一致性。

Insight: 创新点在于提出了一个可审计的、临床医生可交互的智能体AI框架，整合了多个诊断任务并存储证据记录；同时引入了ThyClinScore这一病灶级临床语义指标，增强了报告质量评估。该系统通过协调专用工具，实现了端到端的诊断支持，提高了临床效率和可解释性。

Abstract: Thyroid ultrasound diagnosis requires coordinated lesion localization, measurement, risk stratification and reporting, yet most AI systems address these tasks in isolation and provide limited support for clinical review. We present ThyroidXAgent, a clinician-interactive agentic AI system that coordinates specialized diagnostic tools and stores their outputs as an auditable case-level evidence record. The system was developed using OpenThyroidDB, a multicentre, multitask resource integrating approximately 0.3 million ultrasound images and 24,000 paired reports, and was evaluated on 28,458 non-overlapping test cases, including 8,721 cases from 35 centres in the private NHC-MISD-TUS cohort. Across heterogeneous datasets, ThyroidXAgent achieved a mean Dice score of 87.21 percent for nodule segmentation and a mean AUROC of 0.9466 for benign-malignant classification. The same workflow supported lymph-node metastasis prediction and follicular versus papillary thyroid carcinoma classification, with AUROCs of 0.864 and 0.805, respectively. For report generation, evidence-grounded assembly outperformed multimodal language-model baselines across three cohorts. ThyClinScore, a lesion-level clinical semantic metric introduced here, showed the strongest correlation with a location-aware language-model judge. ThyroidXAgent improved physician classification accuracy, increased report diagnostic consistency from 70.3 percent to 86.2 percent, and reduced segmentation and reporting time by 35.9 percent and 27.4 percent, respectively. These findings support auditable, clinician-correctable agentic AI for thyroid ultrasound diagnosis and reporting.

[103] The Role of Natural Language Understanding in Multimodal Video-Based Dengue Diagnosis cs.AI | cs.CVPDF

Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui, Mojtaba Mohammadi, Nouman Javed

TL;DR: 该论文提出了一种基于YOLO和CLIP的视觉-语言框架，用于从视频数据中分类未感染与登革热病毒2型（DENV2）感染的蚊子飞行帧。该方法首先使用YOLO从背景中分割出蚊子区域，然后在共享嵌入空间中将视频帧的视觉特征与具有生物学意义的文本提示对齐，并通过有监督的双向对比学习进行微调。

Details

Motivation: 从视频数据中检测蚊子感染相关的行为变化具有挑战性，因为蚊子体型小、运动快速不规则，且易受背景、光照和阴影等环境因素干扰，导致可靠特征提取困难。

Result: 该方法在帧级别分类上达到了98.54%的准确率和99.91%的灵敏度；经过帧级信息的时间聚合后，模型在视频级别实现了完美的性能。消融实验表明，微调和基于CLIP的表征对该领域至关重要。

Insight: 创新点在于将视觉-语言模型（CLIP）引入生物行为视频分析领域，利用文本提示提供语义对齐，构建了一个可解释的多模态框架。客观来看，其将通用视觉-语言预训练模型成功适配到细粒度生物医学视频分类任务，展示了跨领域迁移的潜力。

Abstract: Detecting infection-related behavioral changes in mosquitoes from video data is challenging because mosquitoes are small, move rapidly and irregularly, and are affected by environmental factors such as background, lighting, and shadows, which can make reliable feature extraction difficult. In this study, a YOLO- and Contrastive Language-Image Pre-training (CLIP)-based vision-language framework is proposed to classify mosquito flight frames of uninfected and Dengue virus serotype 2 (DENV2)-infected mosquitoes. First, YOLO is used to isolate mosquito regions from the background. Then, visual features extracted from video frames are aligned with biologically meaningful textual prompts in a shared embedding space. The multimodal model was fine-tuned using supervised bidirectional contrastive learning and evaluated through frame-level image-text similarity-based classification. The results show that the proposed method achieved 98.54% accuracy and 99.91% sensitivity at the frame level. After temporal aggregation of frame-level information, the model achieved complete video-level performance. The ablation results showed that fine-tuning and CLIP-based representations were essential for this domain, while the textual branch provided semantic image-text alignment rather than an accuracy advantage over the vision-only model. These findings suggest that vision-language models can provide a useful framework for analyzing infection-related biological behaviors from video data.

Bobo Li, Hao Fei, Tianjie Ju, Mong-Li Lee, Wynne Hsu

TL;DR: OmniScientist是一个端到端、全模态的AI科学家系统，能够直接从异构原始证据（如图像、信号、视频、3D结构等）进行多学科研究。它通过感知层和三个自主智能体（构思、实验、撰写）组成的确定性流程，完成从原始数据到完整论文的整个科研生命周期。

Details

Motivation: 现有AI科研系统通常仅基于文本、代码或预计算摘要进行推理，无法处理对科学发现至关重要的空间、时间、跨通道和程序性关系，因此需要构建一个能够直接处理原始多模态证据的端到端系统。

Result: 在涵盖5个学科家族、4类科学证据和多种模态的36个真实数据案例中，系统均完成了从原始数据到论文编译的全流程，使用参考推理主干时平均论文得分为6.3分。与仅接收预计算标量特征的盲变体相比，直接感知在所有7个评估维度上均有提升，并在85%的配对比较中胜出。

Insight: 创新点在于构建了覆盖整个科研生命周期的全模态感知层，并通过代码执行强制实施新颖性筛查、统计有效性、执行溯源和数值可追溯性，证明了全生命周期感知对于基于证据的科学发现至关重要。

Abstract: Recent advances in foundation models have enabled AI scientists to automate increasingly complete research workflows, from hypothesis generation and code execution to manuscript preparation. Yet workflow coverage alone does not provide access to the full evidence on which scientific discovery depends. Existing systems typically reason over text, code, labels, or precomputed summaries, leaving scientifically decisive spatial, temporal, cross-channel, and procedural relations unavailable to the agent. We introduce OmniScientist, an end-to-end, omni-modal AI scientist that conducts multidisciplinary research directly from heterogeneous raw evidence. A perception layer and 3 autonomous agents for ideation, experiment, and writeup operate within a deterministic pipeline, allowing observations to shape research questions, experimental decisions, and final claims throughout the research lifecycle. By running idea, rigour, and claim checks in code, the system enforces novelty screening, statistical validity, execution provenance, and numerical traceability. We evaluate OmniScientist on 36 real-data cases spanning 5 discipline families, 4 families of scientific evidence, and modalities including images, signals, audio, video, 3-D structures, trajectories, tables, formulae, and graphs. The system completes the full path from raw data to a compiled manuscript in all 36 cases and achieves a mean overall paper score of 6.3 with the reference reasoning backbone. In paired comparisons against a blind variant that receives only precomputed scalar features, direct perception improves all 7 evaluation dimensions and wins 85% of head-to-head judgments. These results show that lifecycle-wide perception is essential for evidence-grounded scientific discovery and provides a practical path toward broadly capable AI scientists.

[105] From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion cs.AI | cs.CV | cs.LGPDF

Xichen Ye, Yifan Wu, Zhikang Xie, Xiangyu Yue, Cheng Jin

TL;DR: 本文针对扩散模型推理开销大的问题，提出了一种名为GCache的全局影响缓存策略。该方法通过理论分析误差传播上界，并将缓存策略搜索重新表述为一个双层优化问题，以学习优先处理对视觉保真度影响最大的计算。实验表明，GCache在视频和图像生成任务上均优于现有缓存策略，在Wan2.1视频扩散模型上实现了2.17倍加速并显著提升了生成质量。

Details

Motivation: 现有基于缓存的扩散模型加速方法依赖局部相似性启发式策略，这与最终生成质量存在显著偏差，其根源在于去噪轨迹中误差的非均匀传播和累积。

Result: 在Wan2.1视频扩散模型上，GCache保持了2.17倍的加速比，同时显著提升了生成质量，将LPIPS指标从0.1095降低至0.0316。广泛的实验表明，GCache在视频和图像生成任务上持续优于先前的缓存策略。

Insight: 核心创新点在于将缓存策略搜索构建为双层优化问题，内层优化寻找最优重用策略，外层优化使误差加权函数与生成质量损失对齐，从而有效调和了理论严谨性与实证性能。该方法揭示了从全局生成质量影响（而非局部相似性）的角度来优化缓存策略的重要性。

Abstract: Diffusion models have achieved dominant performance in visual generation but suffer from substantial inference overhead. While cache-based acceleration has emerged as a promising solution, existing policies rely on local similarity heuristics, which we identify as being significantly misaligned with final generation quality. This discrepancy stems from the non-uniform propagation and accumulation of errors along the denoising trajectory. To address this, we propose Global-Impact Cache (GCache). We first establish a rigorous theoretical characterization of the error propagation upper bound. Recognizing that this bound can be overly conservative for complex, highly non-convex diffusion models, we further reparameterize the propagation exponent with a Bernstein form and reformulate cache policy search as a bilevel optimization problem. In detail, GCache identifies an optimal reuse policy in the inner objective while aligning the error-weighting function with generation quality loss in the outer objective. This framework effectively reconciles theoretical rigor with empirical performance, learning to prioritize computation where it most impacts visual fidelity. Extensive experiments demonstrate that GCache consistently outperforms prior caching strategies on both video and image generation. Notably, on the state-of-the-art Wan2.1 video diffusion model, GCache maintains a 2.17x speedup while significantly enhancing generation quality, reducing LPIPS from 0.1095 to 0.0316.

[106] A Unifying Perspective on Causal World Models: From Observations to Representations to Structure cs.AI | cs.CVPDF

Avinash Kori, Fabrizio Russo

TL;DR: 本文从因果视角对世界模型进行了多层次抽象研究，提出因果世界模型的形式化定义，并探讨其与因果表示学习、对象中心学习等领域的联系，旨在构建支持因果推理和决策的世界模型。

Details

Motivation: 当前世界模型仅关注生成能力，缺乏对实体属性、实体间交互及实体与环境交互的捕捉，无法解释系统动态，因此需要从因果角度构建更全面的世界模型。

Result: 论文未提及具体实验或基准测试结果，而是通过理论分析连接了因果表示学习、因果发现和结构因果模型等领域，并讨论了世界模型组件的可识别性条件。

Insight: 创新点在于将世界模型与因果理论结合，形式化定义了因果世界模型，并明确了其组件从数据中恢复的可识别性条件，为构建可解释、支持推理的智能体提供了理论基础。

Abstract: World Models (WM) are increasingly seen as a foundation for intelligent agents that can predict, plan, and act beyond their training distribution. In this paper, we study WMs from a causal perspective across multiple levels of abstraction, ranging from perceptual observations to building a conceptual representation of the structure governing the environment dynamics. We argue that useful WMs must go beyond generative capabilities alone: they should also capture entity properties, entity-to-entity interactions, and entity-to-environment interactions that determine and explain the dynamics of a system. We provide a formal definition of Causal WMs (CWMs) grounded in the tasks they are intended to support, connecting world modelling with existing work in causal representation learning, object-centric learning, causal discovery, structural causal models, and model-based decision-making. Finally, we relate CWMs to the literature on identifiability, clarifying when the components of a WM can be recovered from data and up to which equivalence. With this, we ground WMs in representations and structures that support causal reasoning and informed decision-making.

cs.LG [Back]

[107] I-SDPO: Instance-Level Adaptive Self-Distillation Policy Optimization cs.LG | cs.CLPDF

Yubo Zhang, Xinhong Ma, Zezhong Tan, Ziqiang Dong

TL;DR: 本文提出I-SDPO（实例级自适应自蒸馏策略优化），一种改进强化学习从人类反馈中学习的方法。它通过根据每个输入实例的组内响应质量，自适应地在组相对策略优化（GRPO）和特权自蒸馏目标之间进行路由，仅在组内所有响应都错误时使用自蒸馏提供密集监督，从而解决GRPO在组内无成功样本时信号无效、以及持续自蒸馏可能导致与奖励目标冲突的问题。

Details

Motivation: GRPO方法在组内所有采样响应都错误时无法提供有效的相对奖励信号，而持续使用特权自蒸馏则可能因教师模型是奖励目标的偏差代理而与奖励改进更新产生冲突，需要一种自适应机制来根据策略能力动态调整蒸馏使用。

Result: 在SciKnowEval基准测试的四个科学领域均取得最佳结果，将平均mean@16准确率从GRPO的56.67%提升至70.31%，最大领域增益达18.24个百分点。

Insight: 核心创新是实例级自适应路由机制，根据组内成功率动态选择优化目标；理论分析揭示了教师与奖励方向对齐的条件及持续蒸馏偏差的下界；该设计无需手动调度即可随策略能力提升自动减少蒸馏影响，为混合监督与强化学习提供了新思路。

Abstract: Group Relative Policy Optimization (GRPO) learns from reward differences within a rollout group, but receives no useful relative signal when every sampled response is incorrect. Privileged self-distillation can fill this gap with dense token supervision, yet applying it throughout training creates a different failure mode: the teacher is a biased, low-variance surrogate for the reward objective, so persistent imitation can oppose reward-improving updates after the policy becomes capable of producing successful trajectories. We introduce I-SDPO (Instance-Level Adaptive Self-Distillation Policy Optimization), which treats teacher reliance as capability-dependent. I-SDPO makes one routing decision per input instance and shares it across that instance’s rollout group: all-incorrect groups use a privileged self-distillation objective, whereas any-success groups remain intact for GRPO. This design uses imitation only where group-relative rewards are uninformative. A local analysis characterizes when teacher and reward directions align and shows that a non-vanishing biased distillation weight induces an optimization bias floor. The routing rule automatically reduces the expected distillation rate as success probability rises, withdrawing teacher influence without a hand-designed schedule. On SciKnowEval, I-SDPO obtains the best result in all four scientific domains and improves average mean@16 accuracy from 56.67% with GRPO to 70.31%, with a maximum domain gain of 18.24 points.

[108] Latent On-Policy Self-Distillation cs.LG | cs.CLPDF

Guibin Zhang, Jiayang Lyu, Ran Sun, Xinlei Yu, Haoyu Zhao

TL;DR: 本文提出了潜在策略内自蒸馏（LOPD）方法，旨在解决智能体持续自我改进中的可扩展性和端到端可学习性问题。该方法通过从经验中学习并组合成连续的潜在令牌来构建可学习的特权上下文，从而为智能体自身轨迹提供密集监督，避免了对手工设计特权工件的依赖。

Details

Motivation: 现有策略内自蒸馏（OPSD）方法严重依赖设计者指定的特权工件（如答案、反馈、技能或轨迹），这限制了持续自我改进所需的端到端可学习性和可扩展性。本文旨在使教师模型的特权上下文本身能够从经验中端到端地学习。

Result: 在智能体工具使用和代码生成任务上，LOPD在性能上超越了RLVR以及包括OPSD、SDPO和Skill-SD在内的代表性OPSD方法。在学习效率上，LOPD以少于GRPO和Skill-SD 30%的采样预算超越了它们。消融研究证实了使特权上下文可学习是实现这些收益的必要条件。

Insight: 核心创新在于将特权上下文本身参数化为可从经验中端到端学习的潜在表示，而非依赖手工设计。这通过从相关经验中检索并组合成连续潜在令牌来实现，并引入了特权边界目标来稳定学习过程，为智能体进化提供了一个更具可扩展性和自导向性的范式。

Abstract: Enabling agents to learn from experience and internalize it into their policy has become a central problem in self-evolving AI. On-policy self-distillation (OPSD) offers an effective pathway by using a privileged self-teacher to provide dense supervision on the student’s own trajectories; however, existing methods still rely heavily on designer-specified privileged artifacts (e.g., answers, feedback, skills, or trajectories), limiting the end-to-end learnability and scalability required for continual self-improvement. In this work, we introduce Latent On-Policy Self-Distillation (LOPD), which, rather than proposing another hand-crafted OPSD variant with a newly prescribed form of privileged context, makes the teacher’s privileged context itself learnable end-to-end from experience. Technically, LOPD retrieves relevant experiences and composes them into continuous latent tokens that condition a self-teacher, while the student generates trajectories from the task and interaction history and receives dense token-level supervision at every visited prefix. We further introduce a privileged-margin objective to stabilize and regulate the learning of latent context. Empirically, LOPD demonstrates (I) strong performance, outperforming RLVR and representative OPSD methods including OPSD, SDPO, and Skill-SD across both agentic tool use and code generation; and (II) high learning efficiency, surpassing GRPO and Skill-SD with less than 30% of their rollout budget. Ablation studies further provide direct evidence that making privileged context learnable is necessary for realizing these gains. Together, these results position LOPD as a step toward a more scalable and self-directed paradigm for agent evolution.

[109] Reduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference cs.LG | cs.AI | cs.CLPDF

Zixuan Lan, Yanhong Li, Jiawei Zhou

TL;DR: 本文提出了一种名为RMM的训练无关、输入自适应的推理方法，通过沿收缩维度选择信息丰富的切片来减少Transformer模型中的矩阵乘法计算量，从而降低大语言模型推理成本。该方法在保持模型权重不变的情况下，通过简单的保留率控制实现平滑的精度-效率权衡，适用于从10亿到700亿参数的语言模型，并在多模态视觉语言推理中同样有效。

Details

Motivation: 基于Transformer的语言模型虽然性能强大，但其推理过程中重复的高维矩阵乘法带来了巨大的计算成本。本文旨在不修改模型权重的前提下，开发一种输入自适应的推理优化方法，以降低计算开销。

Result: 在从1B到70B参数的语言模型上进行评估，RMM在适度缩减下，在判别性任务、自回归生成和长上下文设置中均保持鲁棒性。在NVIDIA A100上的实际基准测试表明，该方法能够转化为实际的运行时增益，尤其是在处理长序列时。

Insight: 论文的核心创新点是提出了一种无需训练、输入自适应的矩阵乘法缩减方法，通过选择信息切片来优化推理。客观分析发现，该方法揭示了Transformer内部的结构不对称性：注意力侧的计算比MLP组件具有更高的可缩减性，这为未来的模型优化提供了新的方向。

Abstract: Transformer-based language models achieve strong performance but incur substantial inference cost due to repeated high-dimensional matrix multiplications. We propose Reduced Matrix Multiplication (RMM), a training-free, input-adaptive inference method that reduces Transformer matrix products by selecting informative slices along their contraction dimensions, without modifying model weights. Under a simple retention-ratio control, RMM provides a smooth and predictable accuracy-efficiency trade-off. Across language models ranging from 1B to 70B parameters, we find that reduction tolerance depends on the model family, task, component, and retention ratio, although it often improves with model scale. Under moderate reduction, RMM remains robust across the evaluated discriminative, autoregressive generation, and long-context settings. We further show that the same principle extends to multimodal vision-language inference. Mechanistic ablations reveal a structural asymmetry within Transformers: attention-side computations are substantially more reducible than MLP components. Finally, wall-clock benchmarks with custom kernels on an NVIDIA A100 show that these computational savings can translate into practical runtime gains, especially at longer sequence lengths. Together, these results position RMM as a scalable direction for input-adaptive inference-time optimization.

[110] Intern-S2-Preview: Scientific Agentic Foundation Model cs.LG | cs.CL | cs.CVPDF

Lei Bai, Jiaqi Cao, Chiyu Chen, Guanzhou Chen, Kai Chen

TL;DR: 本文介绍了Intern-S2-Preview系列科学智能体基础模型，旨在支持多模态科学理解、推理、生成和长程任务。其训练流程包括科学多模态预训练和统一的后续训练，并引入了时间序列建模和内存解码器等架构创新。评估表明，该模型在多个科学、多模态和智能体基准测试中取得了有竞争力或领先的结果。

Details

Motivation: 科学发现日益需要能够对异构模态的科学证据进行推理、与科学工具和环境交互、并在长任务周期内持续取得进展的AI系统。

Result: 在科学、多模态、智能体和通用基准测试中，Intern-S2-Preview-397B在多种设定下取得了有竞争力或领先的结果。具体而言，其时间序列模块提升了在SciTS基准上的科学信号理解和预测能力，而独立的Intern-MemDec-4B扩展模块在不修改冻结的397B主干网络的情况下，将Biology-Instructions的平均得分从56.92提升至60.32。

Insight: 主要创新点包括：1）一个统一的、结合了监督微调、可扩展多任务强化学习、黑白盒智能体强化学习和在线策略蒸馏的后训练流程；2）一系列提升训练稳定性和效率的实用技术，如带离策略校正的部分展开、自适应长度正则化等；3）在架构层面，将时间序列建模从高效长序列理解扩展到数值预测，并研究了作为独立内存增强路径的Memory Decoder，以实现无需修改冻结主干网络的快速科学领域专业化。

Abstract: Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.

[111] Intervention-Aware Clinical World Model for Post-Op Outcome Forecasting in Cardiology cs.LG | cs.CVPDF

Yunsung Chung, Yingshuo Liu, Abboud F. Hassan, Han Feng, Mary M. Maleckar

TL;DR: 本文提出了一种干预感知的临床世界模型，用于预测心脏手术后（房颤消融术）的长期复发风险。该模型将患者表示为结构化潜在状态，通过时间顺序的术后事件（如临床观察、药物变化、重复干预和生理测量）来更新该状态。模型首先将基线影像编码为3D空间潜在状态，然后利用手术背景、静态协变量、经过时间和围事件生理嵌入来更新状态。在DECAAF-II数据集上的内部交叉验证中，该模型在复发预测方面取得了AUROC 0.756和AUPRC 0.777的结果，并在无需随访MRI的情况下实现了疤痕范围MAE为2.971个百分点的预测。

Details

Motivation: 解决现有临床预测模型将术后结果视为从基线测量到未来终点的单步映射的局限性，因为术后恢复通常表现为不规则的轨迹，临床观察、药物变化、重复干预和生理测量被异步记录，并可能随时间改变风险评估。

Result: 在DECAAF-II数据集上的重复内部交叉验证中，模型在复发预测方面达到AUROC 0.756和AUPRC 0.777，疤痕范围预测的MAE为2.971个百分点，且推理时无需随访MRI强度。

Insight: 创新点在于提出了一个干预感知的临床世界模型，将患者表示为结构化潜在状态，并通过时间顺序的术后事件动态更新该状态，支持不同时间范围的复发风险查询和空白期记录的回顾性输入编辑。

Abstract: Many clinical prediction models treat post-intervention outcomes as a one-step mapping from baseline measurements to a future endpoint. However, recovery after a procedure often unfolds as an irregular trajectory: clinical observations, medication changes, repeat interventions, and physiological measurements are recorded asynchronously and can change risk assessment over time. We propose an intervention-aware clinical world model that represents each patient with a structured latent state and evolves it through time-ordered post-intervention events. The model first encodes baseline imaging into a 3D spatial latent state. It then updates this state using procedural context, static covariates, elapsed time, and peri-event physiological embeddings. Follow-up imaging provides training-only supervision through a latent forecasting objective. We apply the framework to atrial fibrillation ablation. During the 90-day recovery window, irregular post-procedure records provide clinically meaningful evidence for long-term recurrence risk. In repeated internal cross-validation on DECAAF-II, our model achieves AUROC 0.756 and AUPRC 0.777 for recurrence prediction. It also achieves a scar-extent MAE of 2.971 percentage points without requiring follow-up MRI intensities at inference. The learned state supports recurrence-risk queries at different horizons and retrospective input editing of blanking-period records.

cs.RO [Back]

[112] BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving cs.RO | cs.AI | cs.CVPDF

Bing Zhan, Shuyao Shang, Jiahao Gu, Shuo Lu, Yuan Xu

TL;DR: 论文提出BrainWAM，一种用于自动驾驶的结构化动作空间协调框架，旨在统一利用语义先验和预测动力学进行规划。它通过两个专门的动作导向通路分别处理语义推理和预测世界建模，并在紧凑的动作表示层面进行对齐，同时引入异步整流流推理策略以降低延迟。该方法在NAVSIM基准测试上达到了最先进的性能。

Details

Motivation: 现有端到端自动驾驶方法通常只侧重语义推理（如VLA模型）或预测动力学（如WAM模型），而自动驾驶规划需要同时满足语义约束和预测动态。因此，需要一种能统一利用两者的规划器。

Result: BrainWAM在NAVSIM v1（89.5 PDMS）和NAVSIM v2（89.6 EPDMS）基准测试上均达到了最先进的性能，持续优于仅使用VLA或仅使用WAM的方法。

Insight: 主要创新点包括：1）提出结构化动作空间协调框架，将语义和预测建模转化为专门通路并在动作表示层对齐，避免了注意力分配不匹配问题；2）引入异步整流流推理策略，通过解耦视频和动作去噪来降低推理延迟并保留规划相关的预测上下文。这为自动驾驶系统提供了一种实用且有前景的方向。

Abstract: Autonomous driving requires planning under both semantic constraints and predictive dynamics. Existing end-to-end driving approaches, however, typically emphasize only one side of this requirement: Vision-Language-Action (VLA) models exploit VLM priors for semantic reasoning, while World Action Models (WAMs) provide future-aware prediction through generative world modeling. This naturally motivates a unified planner that can leverage both semantic priors and predictive dynamics. However, we find that a naive combination through joint token-level attention suffers from an attention-allocation mismatch, where semantic shortcuts dominate the shared attention space and suppress predictive dynamics. Inspired by neuroscience evidence that complex behavior arises from coordination among functionally specialized systems, we propose BrainWAM, a structured action-space coordination framework that converts semantic reasoning and predictive world modeling into two specialized action-oriented pathways, and aligns them at the level of compact action representations. We further introduce an asynchronous rectified-flow inference strategy with decoupled video and action denoising, which shortens inference latency while preserving planning-relevant predictive context. BrainWAM reaches state-of-the-art performance on both NAVSIM v1 (89.5 PDMS) and NAVSIM v2 (89.6 EPDMS), consistently outperforming VLA-only or WAM-only methods, highlighting BrainWAM as a practical and promising direction for autonomous driving systems.

[113] H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models cs.RO | cs.CVPDF

Dingyi Rong, Yue Shi, Chaofan Ma, Jiezhang Cao, Zongrui Wang

TL;DR: 本文提出了H2R-Bench基准，用于评估跨具身（cross-embodiment）的人到机器人操作视频生成能力。该基准要求模型将人类第一视角的操作演示视频，在指定的机器人具身约束下，合成为机器人操作视频。基准包含详细的源视频标注，并从五个维度评估生成视频的质量。

Details

Motivation: 大规模机器人操作数据收集成本高且难以扩展，而丰富的人类第一视角操作视频蕴含大量行为经验。然而，由于人手与机器人末端执行器之间的差异，跨具身迁移这些经验仍具挑战性。视频世界模型为从人类观察中合成机器人中心的操作视频提供了可能，但其跨具身迁移能力尚未得到充分探索。

Result: 研究者在H2R-Bench上对11个最先进的视频生成模型进行了评估，涵盖了六个操作任务族和两种机器人具身。评估结果表明，当前最先进的视频世界模型在人到机器人操作迁移方面仍存在局限，即使在领先的模型中也常出现具身一致性、功能交互和任务执行方面的失败。

Insight: 论文的创新点在于构建了一个系统性的诊断基准（H2R-Bench），用于评估视频世界模型能否弥合人-机器人具身鸿沟，并将人类操作观察转化为以机器人为中心的训练资源。该基准提供了包含任务目标、动作事件、功能接触和物体响应等多维度、源视频锚定的标注，以及一个全面的五维度评估框架，为未来模型改进提供了明确方向。

Abstract: Large-scale manipulation data is essential for robot learning, yet collecting robot demonstrations remains expensive and difficult to scale. Meanwhile, abundant egocentric human manipulation videos provide rich behavioral experiences, but transferring them across embodiments remains challenging due to differences between human hands and robotic end-effectors. Recent advances in video world models offer a promising pathway to synthesize robot-centric manipulation videos from human observations, while their cross-embodiment transfer capability remains largely unexplored. Therefore, we introduce H2R-Bench, a benchmark for evaluating cross-embodiment human-to-robot manipulation video generation, where models transform egocentric human demonstrations into robot manipulation videos under specified embodiments. Each benchmark instance contains a human demonstration video, target embodiment constraints, and source-grounded annotations covering task goals, action events, functional contacts, and object responses. H2R-Bench evaluates generated videos through five dimensions, including goal-state completion, action-event completion, functional contact transfer, embodiment correctness, and general video quality. We benchmark eleven state-of-the-art video generation models across six manipulation families and two robot embodiments. Our evaluation reveals that current video world models remain limited in human-to-robot manipulation transfer: even leading models often fail in embodiment consistency, functional interaction, and task execution. H2R-Bench provides a systematic diagnostic framework for evaluating whether video world models can bridge the human-to-robot embodiment gap and convert human manipulation observations into robot-centric training resources.

[114] ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models cs.RO | cs.AI | cs.CVPDF

Gehan Zheng, Matthew Johnson-Roberson, Weiming Zhi

TL;DR: ContactGuard是一种用于分块视觉运动策略的预接触执行监控系统，通过动作条件潜在世界模型预测短期视觉后果，并在预测到潜在失败时中止执行。

Details

Motivation: 解决接触丰富操作中失败检测延迟的问题，特别是在腕部摄像头设置中，传统检测器在机器人已执行接触后才反应，导致物体被推动、错过、滑动或干扰。

Result: 在真实世界接触丰富操作任务中，ContactGuard比直接和动作损坏的消融实验更准确地预测失败，并可作为预接触中止信号转移到实时机器人上，无需修改底层策略。

Insight: 创新点在于使用潜在世界模型预测紧凑多视图视觉嵌入，避免像素级视频预测，并通过小规模标记的预接触片段训练轻量级失败探测器，实现高效预接触监控。

Abstract: Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper–object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy’s planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy’s own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.

[115] Semantic Radiance Fields as Simulators for Spatial Reasoning in Real-World Scenes cs.RO | cs.CVPDF

Nico Heider, Michał Jan Włodarczyk, Katarzyna Wasielewska-Michniewska, Przemysław Hołda, Martin Schieck

TL;DR: 本文提出使用语义辐射场（SRF）作为空间推理智能体的模拟器，以解决现有模拟器在几何保真度与语义可查询性之间的权衡问题。SRF通过将预训练视觉模型的2D语义分割提升至3D辐射场，统一编码几何、外观和每类语义身份，从而支持真实场景的新视角合成、语义查询和自由空间查询。

Details

Motivation: 训练和评估具身智能体的空间推理需要几何忠实且语义可查询的多样化环境，但现有合成模拟器牺牲真实性，而基于真实场景重建的模拟器缺乏真实语义标注。

Result: 论文未在摘要中提供具体定量结果或基准测试，但通过果园苹果抓取任务的示例应用，展示了SRF能为物理引擎提供相机渲染、语义真值和占据查询，支持高效生成多样化真实世界环境。

Insight: 创新点在于将2D语义分割与3D辐射场结合，创建了统一表示，实现了真实场景中几何、外观和语义的联合编码，为空间推理模型提供了既真实又语义可查询的模拟环境。

Abstract: Training and evaluating spatial reasoning in embodied agents requires diverse environments that are both geometrically faithful and semantically queryable. Synthetic simulators offer ground truth semantics but sacrifice realism; simulators based on reconstructions of real-world environments have realistic appearance but lack ground truth semantics by default. We propose using Semantic Radiance Fields (SRF) as simulators for spatial reasoning agents. SRFs are a representation that unifies these requirements by lifting 2D semantic segmentations from pretrained vision models into a 3D radiance field that jointly encodes geometry, appearance, and per-class semantic identity. The resulting fields are reconstructed from posed RGB captures of real scenes and support novel-view synthesis, semantic and free-space queries within a single grounded representation. This enables the efficient generation of diverse real-world environments to train and evaluate spatial reasoning models. As an example application, we outline an SRF-driven simulator for an orchard apple-reaching task, in which the radiance field supplies camera rendering, semantic ground truth, and occupancy queries to a physics engine.

[116] HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark cs.RO | cs.AI | cs.CVPDF

Dairu Liu, Zekun Qi, Jiayu Zeng, Ruixi Yu, Yu Guan

TL;DR: 论文提出了HumanTracker基准和HumanScore评估指标，旨在解决人形运动跟踪评估中感知不一致和缺乏多样性测试数据的问题。HumanTracker包含约153小时的光学运动轨迹，涵盖四种运动类型，并带有文本标签用于细粒度诊断。HumanScore是基于12K运动对训练的偏好对齐指标，能更好地预测人类偏好并揭示接触和稳定性错误。

Details

Motivation: 当前人形运动跟踪评估（如运动学误差）与人类视频感知不一致，且广泛使用的测试集规模小、缺乏多样性，无法充分测试接触密集、长时程的行为。

Result: 在代表性SOTA跟踪器上，HumanScore比运动学指标能更好地预测人类偏好，并揭示其常忽略的接触和稳定性失败。

Insight: 创新点在于构建了一个大规模、多样化的感知对齐运动跟踪基准，并提出了一个基于人类偏好学习的新评估指标，使评估更贴近人类感知，尤其关注物理接触和稳定性等关键方面。

Abstract: Humanoid motion tracking is central to teleoperation and whole-body imitation, yet evaluation often disagrees with what people perceive in videos. Kinematic errors average per-frame pose differences but miss the physical artifacts that matter most, particularly unstable support and incorrect contacts such as foot skating and mistimed touch-downs. Meanwhile, widely used test suites are small and lack the diversity needed to stress contact-rich, long-horizon behaviors. We introduce HumanTracker to make humanoid tracking evaluation both perceptually aligned and scalable. The HumanTracker benchmark contains approximately 153 hours of optical motion trajectories from multiple professional performers, organized into four motion families with text labels for fine-grained diagnosis. We further propose HumanScore, a preference-aligned metric trained on 12K motion pairs containing 24K motions. Across representative state-of-the-art trackers, HumanScore better predicts human preferences and reveals contact and stability failures that kinematic metrics often miss.

cs.MM [Back]

[117] MASCOT: Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval cs.MM | cs.CV | cs.IRPDF

Aaryan Sharma, Vishak Prasad C, Virendra Singh, Ganesh Ramakrishnan

TL;DR: 本文提出了MASCOT方法，用于解决文本到图像检索中复合属性（如地理和时间）的结果多样化问题。该方法将多属性多样性建模为资源分配问题，在软分箱空间中根据查询重要性加权，以在抑制多样性的同时保持高召回率。

Details

Motivation: 现有基于流形排斥的重新排序方法（如MS-DPP）在处理复合属性的多样性抑制任务时，早期排名召回率会显著下降，因此需要一种能更精确控制多样性的方法。

Result: 在PixelProse的三个多样性抑制任务上，MASCOT的平均早期排名召回率（R@10）为88.58%，显著高于MS-DPP的67.63%。在同时抑制时间和地理多样性的复合约束任务PP_geo_hour上，MASCOT的R@10为0.9410，R@1为0.7202，而MS-DPP的召回率则大幅下降。

Insight: 创新点在于将多样性控制从基于相似性表示的流形排斥，转变为基于查询驱动重要性加权的软分箱空间中的资源分配问题，从而在复合约束下更好地平衡多样性与相关性，特别是在排名1之后的召回率上表现出优势。

Abstract: Vision-Language Models (VLMs) are highly effective in retrieving semantically relevant images. However, in practice, relevance alone is often insufficient. Systems must also achieve Result Diversification (RD) across composite attributes such as geography and time, a task for which precise control remains challenging. Current re-ranking methods, such as Multi-Source Determinantal Point Processes (MS-DPP), address this using manifold-based repulsion over similarity representations. Although this strategy is effective for broad exploration, it exposes a key limitation in manifold-based models: when subjected to diversity-decrease tasks on discrete metadata, they suffer substantial degradation in early-rank recall. To bridge this gap, we introduce MASCOT (Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval). Instead of relying on manifold repulsion, MASCOT formulates multi-attribute diversity as a resource allocation problem, projecting attributes into a soft-binning space weighted by query-driven importance. Averaged across the three PixelProse diversity-decrease tasks, MASCOT preserves an early-rank recall (R@10) of 88.58%, while MS-DPP retains 67.63%. The margin widens under composite constraints: on PP_geo_hour, where temporal and geographic diversity must be suppressed simultaneously, MS-DPP’s recall collapses from 0.9737 to 0.4931 and its top-ranked result degrades to R@1 = 0.23, while MASCOT holds R@10 = 0.9410 and R@1 = 0.7202 at a diversity metric above the unconstrained baseline. We do not claim uniform superiority: on aggregate diversity-relevance scores our own simpler ablations attain higher harmonic means on all three decrease tasks, and MASCOT’s advantage is specific to recall beyond rank 1 under composite constraints.

Table of Contents

cs.CL [Back]

[1] On Measuring Semantic Preservation in Legal Ontology Learning cs.CLPDF

[2] LLMs Know the Constraint But Do Not Use It: Activation Bottlenecks in Pragmatic Constraint Reasoning cs.CL | cs.AIPDF

[3] What Drives LLM Self-Reflection? A Controlled Ablation of Uncertainty Routing in Armed Conflict Forecasting cs.CL | cs.AIPDF

[4] Thought-Aware KV Cache Compaction for Reasoning via Adaptive Attention Matching cs.CL | cs.AIPDF

[5] Vision-Language Models are Fragile Multilingual Associators cs.CL | cs.AI | cs.CVPDF

[6] From Refuse to Richness: Rubric Rewards for Long-Form Hallucination Reinforcement Learning cs.CLPDF

[7] SDAM: Structure-Difference-Aware Memory Evolution for Complex Text-to-SQL cs.CLPDF

[8] Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents cs.CL | cs.LGPDF

[9] Large Language Models Pass the History Exam But Miss the <>: A Polish High School Exit Exam Matura Benchmark cs.CLPDF

[10] Predicting consumer-technology ownership without a diffusion history cs.CL | cs.CY | stat.APPDF

[11] Are you Talking Logic to Me? Assessing Language Models Syllogistic Reasoning Capabilities cs.CL | cs.AIPDF

[12] LLMs Are Not Good Strategists, Yet Memory-Enhanced Agency Boosts Reasoning cs.CL | cs.AI | cs.MAPDF

[13] Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models cs.CL | cs.AI | cs.LGPDF

[14] DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution cs.CLPDF

[15] CRAFT: LLM-Based Iterative Refinement for Temporal Reasoning over Clinical Narratives cs.CL | cs.AI | cs.IRPDF

[16] From Atomic Evidence to Logical Composition: Structured Compositional Reasoning over Compound Answer Options cs.CL | cs.AIPDF

[17] Falsehood and Impossibility Are Different Directions in an AI’s Representation of Language cs.CL | cs.AIPDF

[18] The Embedder’s Dilemma: LLMs Are Better, but at What Cost? cs.CLPDF

[19] When Your Agent Opens the Chat App: Agent-Controlled Search over Raw Chat Logs Rivals Structured Memory cs.CLPDF

[20] LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation cs.CLPDF

[21] HybridRAG-BN: A Retrieval-Augmented Framework with Fine-Tuned Verification for Bangla KBQA cs.CL | cs.IRPDF

[22] CASA: Content-Acoustic Speaking Assessment with Speech Encoder and Large Language Model cs.CL | eess.ASPDF

[23] Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering cs.CL | cs.AIPDF

[24] GEM: A Generative Embedding Model Bridging Reasoning and Retrieval cs.CL | cs.AI | cs.IRPDF

[25] Localize, Then Reason: Visual Latent Structural Reasoning for Molecular Properties and Edits cs.CL | cs.CE | q-bio.BMPDF

[26] How Do VLMs Behave When Blind or Misled? Behavioral Evaluation of VLMs on Scientific Figures cs.CL | cs.AI | cs.CV | cs.LGPDF

[27] Refusing Intent, Not Form: Wrapper-Based Intent-Group Supervision for LLM Safety cs.CLPDF

[28] Beyond Local Accuracy: A Protocol-Level Identifiability Audit for Controlled LLM Reasoning Evaluation cs.CLPDF

[29] RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory cs.CLPDF

[30] CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation cs.CLPDF

[31] DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training Data cs.CL | cs.AIPDF

cs.CV [Back]

[32] HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning cs.CVPDF

[33] Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images? cs.CV | cs.ROPDF

[34] Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval cs.CV | cs.IRPDF

[35] StrAD: A Streaming Method and Benchmark for Audio Description Generation for Long-form Videos cs.CVPDF

[36] Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging cs.CV | cs.AIPDF

[37] From Visual Widgets to UI Code: Efficient Tool-Grounded Generation cs.CV | cs.LGPDF

[38] EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory cs.CV | cs.AI | cs.CL | cs.HCPDF

[39] Class Geometry as Supervision for Sample-Efficient Open-World Detection cs.CVPDF

[40] VOS-Agent: The 1st Place Solution for the 8th LSVOS Challenge (MOSEv2 Track) cs.CVPDF

[41] Towards Sparsely Annotated Open-World Object Detection cs.CVPDF

[42] A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules cs.CVPDF

[43] Dual-Manifold Geometry Guided Representation Learning: Adaptive Coupling between Kernel and Data Spaces cs.CVPDF

[44] Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors cs.CV | cs.CLPDF

[45] Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding cs.CVPDF

[46] PatchGen: Learning Soft Intra-Image Predictive Subsets for Visual Generalization cs.CVPDF

[47] SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention cs.CVPDF

[48] Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs cs.CVPDF

[49] Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformers cs.CVPDF

[50] SPARED: Reasoning-Based AI-Generated Image Detection via Adversarially Edited Data cs.CV | cs.AIPDF

[51] Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval cs.CV | cs.AIPDF

[52] NaviDC-OCR: Navigating Document Parsing Across Digital and Camera-Captured Documents cs.CV | cs.AIPDF

[53] HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation cs.CVPDF

[54] Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs cs.CV | cs.CR | cs.MMPDF

[55] A Deep RL based Framework for Targeted White Matter Tractography cs.CVPDF

[56] TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos cs.CVPDF

[57] DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation cs.CVPDF

[58] RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction cs.CV | cs.ROPDF

[59] EgoPHI: Estimating Contact and Force from Egocentric Vision cs.CV | cs.GR | cs.HC | cs.ROPDF

[60] UniTraffic-Agent: Unified Traffic Video Reasoning for AI City Challenge 2026 Track 3 with Two Out-of-Domain Evaluations cs.CV | cs.AIPDF

[61] Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization cs.CVPDF

[62] Learning Unified Video and Image Representation for Video Face Forgery Detection cs.CVPDF

[63] P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation cs.CVPDF

[64] Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification cs.CVPDF

[65] RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completion cs.CVPDF

[66] Towards Physics-Faithful Generation of Scientific Diagrams cs.CVPDF

[67] QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing cs.CVPDF

[68] EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory cs.CV | cs.AIPDF

[69] MergeOver: Post-Training Token Merging for Recursive Vision Transformers cs.CV | cs.LGPDF

[70] Less Annotation, More Interpretation: Prior-Guided Concept Bottleneck Models for Interpretable Cancer Imaging Diagnosis cs.CVPDF

[71] TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint cs.CV | cs.AI | cs.CL | cs.LGPDF

[72] A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources cs.CVPDF

[73] HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models cs.CVPDF

[74] CoverPrune: Coverage-Driven Token Pruning for 3D VLMs via Optimal Transport cs.CV | cs.AIPDF

[75] NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video cs.CV | cs.AI | cs.MMPDF

[76] AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage cs.CVPDF

[77] Reasoning for Social Audio-Visual Question Answering: Where Do We Stand? cs.CVPDF