cs.CL [Total: 18]
cs.CV [Total: 50]
cs.CR [Total: 2]
cs.AI [Total: 12]
cs.SE [Total: 1]
cs.LG [Total: 4]
eess.IV [Total: 1]
cs.RO [Total: 5]
cs.HC [Total: 1]

cs.CL [Back]

[1] TEXAS: Task-Expert-Aware Supervision for Downstream Mixture-of-Experts LLM Adaptation cs.CL | cs.AIPDF

Guanzhi Deng, Haibo Wang, Kuan Wu, Xiangru Jian, Shing Yin Wong

TL;DR: 本文提出了TEXAS方法，用于改进下游任务中混合专家（MoE）语言模型的适应过程。该方法通过对比模型在成功与失败实例上的专家激活模式，识别与任务成功相关的专家，并在微调时对激活这些专家的答案令牌进行加权监督。

Details

Motivation: 现有方法在识别任务相关专家时，通常依赖反映使用频率而非任务成功关联的聚合路由统计，且未充分利用任务专家激活作为监督分配的信号。

Result: 在三个MoE模型和六个基准测试上，TEXAS在18个设置中的17个取得了最佳或并列最佳性能，平均比最强基线提升了1.3到1.5个百分点。

Insight: 创新点在于将基于正确性的任务专家发现与令牌级监督分配相结合，利用现有路由行为而不限制对固定专家子集的适应或强加明确的目标路由分布。

Abstract: Mixture-of-Experts (MoE) language models route each token through a small subset of experts, making routing patterns useful for identifying task-relevant experts during downstream adaptation. Yet current approaches have two limitations: task experts are typically identified from aggregate routing statistics that reflect usage rather than association with successful task completion, and task-expert activations remain underexplored as signals for supervision allocation. We introduce Task-Expert-Aware Supervision (TEXAS), which combines correctness-conditioned task expert discovery with token-level supervision allocation. TEXAS compares expert activations on instances that the base model solves successfully and those it fails to solve, and retains experts more strongly activated on successful instances. During fine-tuning, it upweights answer tokens in failed instances when they activate these experts. TEXAS therefore leverages existing routing behavior without restricting adaptation to a fixed expert subset or imposing an explicit target routing distribution. Across three MoE models and six benchmarks, TEXAS achieves the best or tied-best performance in 17 of 18 settings and improves over the strongest baseline by 1.3–1.5 points on average. Ablations and further analyses validate both the discovered experts and the resulting supervision strategy.

[2] NTDH: Complex Reasoning for Comprehensive Affective Analysis cs.CL | cs.LGPDF

Tianlei Zhu, Zhiwei Liu, Yuyan Wang, Xiao-Yang Liu, Sophia Ananiadou

TL;DR: 本文提出NTDH方法，将综合性情感分析重构为复杂推理问题，通过自然化、容错感知门控、领域感知策略和方向性提示四个组件解决情感推理轨迹合成中的数据对齐问题，在少量训练数据下实现了多任务情感分析的性能提升。

Details

Motivation: 现有方法直接将冲突线索映射到标签，未显式建模情感线索的调和过程，且异构标签空间（连续、序数、多标签）和上下文依赖的情感含义使得传统端到端映射方法存在局限。

Result: 在Qwen3-8B模型上使用仅16,302条训练数据（约为指令微调系统的1/14），最终策略在六个官方测试指标中五项超越SFT检查点，并在EI-reg任务上取得0.862的皮尔逊相关系数，达到对比系统中的最优结果。

Insight: 将情感分析转化为可验证奖励优化的推理轨迹问题，创新性地通过合成数据质量控制机制（自然化构造、容错门控、领域知识注入、误差方向提示）解决情感特定领域的对齐难题，为多模态异构任务提供了统一推理框架。

Abstract: Comprehensive affective analysis is challenging for two reasons: it spans heterogeneous prediction tasks with continuous, ordinal, and multi-label outputs, and affective meaning is context-dependent, requiring conflicting cues to be reconciled rather than mapped directly to labels. Existing methods learn this mapping directly and do not model the reconciliation explicitly. We recast the task as a complex-reasoning problem, which yields one output interface across heterogeneous label spaces and a trajectory over which a verifiable reward can be optimised; to our knowledge, this is the first such treatment covering both sentiment and emotion. The obstacle is on the data side: affective reasoning traces must be synthesised, and generic synthesis is misaligned with the targets, tolerances, and phenomena of affect, and discards or leaks its failure cases. We propose NTDH, which addresses these four failures. Naturalisation sets the training answer to the gold label, so it is correct by construction. A Tolerance-aware gate checks each answer against the task’s own scoring margin. Domain-aware strategies refine the reasoning using ideas from affective science. Directional Hints report only the type and direction of an error, without exposing the target. We train Qwen3-8B with SFT and then GRPO under the same tolerance used for verification (up to a more permissive construction gate on the multi-label subtask), and a component ablation quantifies the data-quality effect of each part. Using 16,302 training records, about 14x fewer than comparable instruction-tuned systems, the final policy improves over its SFT checkpoint on five of six official-test metrics and achieves the strongest EI-reg result among the compared systems, at a Pearson correlation of 0.862.

[3] GRASP: Reinforcing Language Model Anonymizers with Group Relative Policy Optimization cs.CLPDF

Sajjad Ghiasvand, Nader Sehatbakhsh

TL;DR: 本文提出GRASP方法，通过群体相对策略优化强化本地语言模型匿名化器，以保护文本隐私同时保持语义效用。该方法使用单一小型模型同时扮演匿名器、攻击者和效用评判角色，通过自生成奖励进行在线训练，有效防止奖励欺骗，并在隐私-效用权衡上优于DPO蒸馏基线。

Details

Motivation: 现有对抗匿名化方法依赖强大模型进行推理，需将私有文本发送至第三方，违背隐私保护初衷；而基于DPO的蒸馏方法仅模仿教师模型的离线选择，未直接优化隐私-效用目标。

Result: 在Llama-3.1-8B上训练，GRASP在三个独立LLM评判下均优于DPO蒸馏基线；与Gemini 2.5 Flash和Claude等前沿模型驱动的对抗匿名化相比，达到相当或更好的整体权衡，同时显著移除更多私有信息，且完全在设备端运行，成本约为GPT-4o教师的1%。

Insight: 创新点在于引入群体相对策略优化进行在线强化学习，直接优化隐私-效用目标；采用单一模型多角色自训练架构，通过自生成奖励和防奖励欺骗设计，实现高效本地化隐私保护。

Abstract: Large language models can infer sensitive personal attributes, such as age, location, and occupation, from ordinary text, turning everyday writing into a privacy risk. Adversarial anonymization defends against this by rewriting a text with a capable language model that also plays the attacker, but it needs a powerful model at inference time and thus sends private text to a third party, the very exposure anonymization should prevent. Recent work distills this behavior into a small on-device model using supervised fine-tuning and direct preference optimization (DPO), but DPO only imitates the teacher’s offline choices and never directly optimizes the privacy–utility objective we care about. We introduce \textbf{GRASP} (\textbf{G}roup-\textbf{R}elative \textbf{A}nonymization via \textbf{S}elf-refinement \textbf{P}olicy-optimization), which reinforces the local anonymizer online with Group Relative Policy Optimization. A single small model acts as anonymizer, adversary, and utility judge, trained against a self-generated reward that hides attributes while preserving meaning, with a design that guards against reward hacking. Trained on Llama-3.1-8B, \ours{} improves the privacy–utility trade-off over the DPO-distilled baseline, consistently across three independent LLM judges. Against adversarial anonymization driven by frontier models such as Gemini~~2.5~~Flash and Claude, it achieves a comparable or better overall trade-off while removing substantially more private information, and it runs entirely on-device at roughly $1%$ of the GPT-4o teacher’s cost.

[4] Confidence Estimation for Financial Vision-Language Models in Chart and Document Understanding cs.CLPDF

Reza Khanmohammadi, Simerjot Kaur, Charese H. Smiley, Ivan Brugere, Mohammad M. Ghassemi

TL;DR: 本文评估了七种置信度估计方法在金融视觉语言模型（LVLMs）图表和文档理解任务中的应用，发现训练的内部探针能提供可设定阈值的校准分数，而推理基线虽能排序但严重过度自信；可靠性随模型和任务变化，且自动化程度首先取决于模型能力而非置信度。

Details

Motivation: 解决金融场景中LVLMs输出可信度评估问题，因为单个误读可能导致决策错误，需要确定哪些答案可自动执行、哪些需人工审核，以建立操作信任。

Result: 在五个开源LVLMs和三个金融视觉问答基准的四种条件下评估，训练探针（尤其是基于接地的探针）能有效校准置信度，在5%错误预算下，最简单条件可自动化部分任务，最难条件几乎无法自动化。

Insight: 创新点在于揭示置信度校准比排序更稀缺，提出可靠性具有结构化特征（依赖模型和任务），并证明接地感知探针能区分模型是否基于图像生成答案，为实际部署提供可操作的置信度评估框架。

Abstract: LVLMs are increasingly used to read financial charts, tables, and documents, where a single misread figure can move a decision and the most authoritative-looking answer is sometimes one the model produced without reading the exhibit. The operational question is therefore trust, not accuracy: which answers can be acted on, and which escalated to a reviewer. We evaluate seven confidence estimators, three inference-only and four trained internal probes, across five open-weight LVLMs and four conditions from three financial visual question-answering benchmarks, one bilingual; every probe is trained only on natural images and applied to finance without adaptation, so the results measure out-of-distribution transfer. Three findings hold. First, the scarce property is calibration, not ranking: the inference baselines rank correct above incorrect answers competitively but are badly overconfident, calibration error far above what a threshold can tolerate, and only the trained probes produce a thresholdable score. Second, reliability is structured rather than global, along two axes a practitioner can read directly: the best estimator shifts with both model and task, none leading more than eight of twenty (model, condition) cells, and a controlled bilingual contrast exposes an apparent language robustness as a composition artifact that dissolves once models are read one at a time. Third, cast as deferral under an error budget, how much can be safely automated is set first by the model’s competence and only narrowed by its confidence, so deferral clears a real share of the easiest condition and almost none of the hardest, near zero at a strict 5% budget. Two trained probes carry the calibration a deferral policy needs, and among them only the grounding-aware one lowers its confidence on answers a model gives without using the figure, separating detected non-grounding from a fluent guess.

[5] Discovering Conceptual Metaphors Across Topics and Media Types cs.CLPDF

Alexandria Leto, Rohan Das, Juan Vásquez, Abram Handler, Maria Leonor Pacheco

TL;DR: 本文提出了一种无监督方法，用于从语料库中提取语言隐喻，并通过结构化聚类形成与概念隐喻对应的群组。该方法应用于左右倾向播客的分析，揭示了它们在主题和框架上的关键差异，例如左倾播客倾向于将媒体报道概念化为武器，而右倾来源常将经济讨论为受垂直变化的系统。

Details

Motivation: 概念隐喻通过将抽象经验（如纳税）与具体经验（如负重）联系起来，影响我们的思维和行动，不同的隐喻会导致不同的推理。识别这些隐喻有助于揭示说话者或作者对事件的框架，但隐喻无法直接观察，需通过语言中的隐喻表达作为证据。

Result: 方法应用于左右倾向播客语料库，成功提取了语言隐喻并聚类成概念隐喻群组，揭示了主题和框架上的差异，例如左倾播客将媒体故事视为武器，右倾来源将经济视为垂直变化的系统，展示了无监督方法在隐喻发现中的有效性。

Insight: 创新点在于提出无监督的结构化聚类方法，直接从语料库中提取和分组语言隐喻，以推断概念隐喻，避免了依赖标注数据；客观分析表明，该方法能自动发现不同媒体类型和主题中的隐喻模式，为自然语言处理中的隐喻识别和框架分析提供了新工具。

Abstract: Conceptual metaphors guide our thinking and actions by allowing us to reason about more abstract experiences (e.g., paying taxes) in terms of more concrete or embodied experiences (e.g., carrying a physical load) (Lakoff and Johnson, 2011). It follows that different conceptual metaphors can result in different reasoning: framing paying taxes as an investment in a community rather than a physical load leads to a very different outlook on taxation. Identifying the conceptual metaphors guiding a speaker or writer thus helps to reveal their framing of events. Though these metaphors can’t be observed directly, groups of linguistic metaphors, metaphorical expressions as they appear in language, serve as evidence for them. Motivated by this, we present an unsupervised method that extracts linguistic metaphors from a corpus and uses a structured clustering approach to form groups corresponding to conceptual metaphors. Using this method, we point to key topical and framing differences in left- vs. right-leaning podcasts. For example, left-leaning podcasts tend to conceptualize media stories as a weapon, while right-leaning sources commonly discuss the economy as a system subject to vertical changes.

[6] The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents cs.CLPDF

Mingguang Chen, Licheng Wang, Bo Qu

TL;DR: 本文提出了’视野鸿沟’概念，指出前沿语言模型虽能单次推理解决复杂问题，却在多小时级任务中表现不佳，如遗忘早期决策、过早终止任务或偏离目标。通过对1547篇arXiv论文的系统性综述，论文辨析了长期视野（任务属性）、长上下文（模型属性）与长期记忆（系统属性）三个常被混淆的概念，并按任务生命周期（规划、记忆、执行、训练、评估、基础/安全）与视野承载位置（上下文内、任务内超上下文、跨任务持久）对文献进行分类。研究发现，随着任务视野延长，仅依赖结果信号会失效，而领域通过过程奖励模型、信用分配或轨迹级诊断等方法制造了更密集的步骤级信号。

Details

Motivation: 解决前沿语言模型在长视野任务（如持续数小时的多步骤任务）中表现出的失败模式，包括跟踪早期决策困难、未完成即宣告结束以及目标漂移等问题，这些失败揭示了当前模型能力与复杂现实任务需求之间的’视野鸿沟’。

Result: 论文未报告具体定量实验结果，而是基于对1547篇论文（2024-2026年）的系统性文献综述，定性总结了长视野LLM智能体研究领域的整体模式与发现，指出跨所有研究类别，仅依赖结果信号在长视野任务中会失效，而领域普遍转向制造密集的步骤级信号作为应对策略。

Insight: 创新点在于清晰区分了长期视野、长上下文与长期记忆这三个关键但常被混淆的概念，并提出了一个按任务生命周期与视野承载位置交叉分类的文献分析框架。从客观角度看，论文将批判性与诊断性文献作为主线贯穿分析，避免了方法论述与批评的割裂，并指出了开放测量问题，如分解模型与工具能力、管理训练与评估中共用的过程级信号的相关偏差，以及长视野可靠性是否可预测等，为未来研究提供了重要方向。

Abstract: Frontier language models solve reasoning problems in a single forward pass that would have been research contributions years ago, yet fail at multi-hour tasks: losing track of earlier decisions, declaring half-finished work done, or drifting from goals. We call this the horizon gap and survey 1,547 arXiv papers (2024-2026) collected via systematic seed harvest with a disclosed 26.8% bleed filter, extended by targeted supplementation. We disambiguate three routinely conflated properties: long-horizon (task property: required steps), long-context (model property: token capacity), and long-term memory (system property: persistence across steps/sessions). We organize the corpus into six categories tracking a long-horizon task’s lifecycle – planning, memory, execution, training, evaluation, and foundations/safety – crossed with an axis capturing where horizons are carried (within-context, within-task-beyond-context, or cross-task-persistent). Across all categories, we find the same pattern: outcome-only signals grow uninformative as horizons lengthen, and the field’s response – whether process reward models, credit assignment, or trajectory-level diagnostics – manufactures denser step-level signals. We treat critical and diagnostic literature as first-class threads throughout, arguing that segregating critique from method would routinely split single papers across chapters. We close by naming open measurement problems: decomposing model versus harness capability, managing correlated bias in process-level signals used for both training and evaluation, and whether long-horizon reliability admits general predictive theory.

[7] Stockmark-Nemotron-3-Nano-Omni-JapanDocReader: Structured Document Parsing via Capability Injection and Forgetting Control cs.CLPDF

Shi Chen, Hayato Aida, Makoto Morinaga, Shohei Tanaka, Kosuke Arima

TL;DR: 本文提出了Stockmark-Nemotron-3-Nano-Omni-JapanDocReader，一个基于Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16构建的日语文档理解模型。核心目标是通过能力注入与遗忘控制实现结构化文档解析：在向一个面向推理的多模态模型中注入日语结构化文档解析能力的同时，尽可能保留其原有的文档视觉问答能力。

Details

Motivation: 解决在向多模态推理模型注入新的结构化文档解析能力时，如何避免或减轻对原有文档VQA能力的遗忘问题。

Result: 实验表明，仅使用解析数据的SFT显著提升了结构化解析性能但导致了明显的VQA遗忘；混合SFT在几乎保持相同解析性能的同时缓解了遗忘；在混合SFT基础上应用基于DAPO的解析中心RL进一步突破了SFT的性能上限，产生了最终发布的模型。

Insight: 创新点在于提出了“能力注入与遗忘控制”的训练框架，并系统研究了不同训练策略（解析中心SFT、混合SFT、解析中心RL）对性能与遗忘的影响。通过结合两种互补的合成数据流构建训练数据，并设计了针对长推理任务的连续奖励与基于方差的提示过滤，使强化学习在结构化文档解析任务中有效。

Abstract: We present Stockmark-Nemotron-3-Nano-Omni-JapanDocReader, a Japanese document understanding model built from Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16. The central goal of this work is structured document parsing via capability injection and forgetting control: we inject Japanese structured document parsing capability into a reasoning-oriented multimodal model while preserving its document VQA capability as much as possible. We study parsing-centric SFT, which uses only structured document parsing data; mixed SFT, which combines structured document parsing and VQA data; and parsing-centric RL, which optimizes structured parsing with a task-level reward. Our experiments show that parsing-centric SFT substantially improves structured document parsing performance but causes measurable VQA forgetting. Mixed SFT mitigates this forgetting while preserving nearly the same structured parsing performance. Applying DAPO-based parsing-centric RL on top of the mixed SFT checkpoint further improves structured document parsing beyond the SFT ceiling, producing the final released model. The training data is constructed with a data engine consisting of two complementary synthetic streams: a Japanese Document VQA Stream and a programmatic structured document parsing stream. We also discuss reward design and variance-based prompt filtering for continuous structured document parsing rewards, highlighting their importance for making RL effective in long-reasoning structured document parsing tasks.

[8] Multi-Perspective Triad Interaction Graph Neural Network for Cognitive Distortion Detection cs.CLPDF

Jun Seo Kim, Hye Hyeon Kim

TL;DR: 本文提出MTI-GNN（多视角三元交互图神经网络）用于认知扭曲检测，该方法基于贝克认知三元模型（自我、世界、未来的负面观点）构建多视角相似图，通过三元交互模块建模跨视角依赖，并结合原型引导的视角融合与标签扩展监督进行优化。

Details

Motivation: 现有认知扭曲检测方法常忽略扭曲思维的心理结构，本文旨在通过建模贝克认知三元模型来捕捉认知扭曲的多视角心理特征，提升检测性能。

Result: 在涵盖韩语、英语和中文的四个数据集（共9,764个样本，十个扭曲类别）上，MTI-GNN显著优于所有监督变体，并在零样本和少样本设置下超过八个提示生成模型；消融实验表明三个视角均贡献显著。

Insight: 创新点包括将认知三元结构化为多视角图神经网络、设计三元交互模块处理跨视角依赖、以及引入原型引导的视角融合与标签扩展监督机制，为计算心理健康任务提供了结构化的心理建模框架。

Abstract: Cognitive distortion detection is a key task in computational mental health, yet existing approaches often overlook the psychological structure of distorted thoughts. We propose MTI-GNN (Multi-Perspective Triad Interaction Graph Neural Network), which models Beck’s cognitive triad—negative views of the self, world, and future—as complementary perspectives for classification. An LLM decomposes each utterance into the three perspectives, from which perspective-specific similarity graphs are constructed and encoded by a Multi-Perspective GNN. A Triad Interaction module models cross-perspective dependencies through sequential source-conditioned updates and feature-wise gating, while Prototype-Guided Perspective Fusion performs label-conditioned aggregation. Label-expanded supervision incorporates all available distortion annotations during training. We evaluate MTI-GNN on 9,764 samples from four Korean, English, and Chinese datasets spanning ten distortion categories. MTI-GNN significantly outperforms all supervised variants and exceeds eight prompted generative models under zero-shot and few-shot settings. Leave-one-perspective-out ablations show that all three perspectives contribute significantly, while human expert evaluation provides preliminary evidence of their alignment with the intended cognitive dimensions.

[9] Simple-OPD: Demystifying Warm-up for On-policy Distillation cs.CLPDF

Tao Liu, Taiqiang Wu, Mao Zheng, Xuan Luo, Runming Yang

TL;DR: 本文研究了策略蒸馏（OPD）中预热阶段的作用，提出了Simple-OPD方法。研究发现，有效预热依赖于教师模型生成的思维链监督，且即使教师模型的输出有误也能提供类似益处；在训练上，使用LoRA进行接近饱和时长的训练能更好平衡领域内适应与分布外泛化。基于此，Simple-OPD作为一种即插即用的初始化方法，在OPD前使用LoRA和教师生成的思维链对学生模型进行预热，实验证明了其有效性和鲁棒性。

Details

Motivation: 策略蒸馏（OPD）的有效性严重依赖于预热阶段，但预热的作用机制尚不明确。本文旨在从数据和训练两个角度揭示预热对OPD的影响，以提升蒸馏效果。

Result: 在多种设置下的实验表明，Simple-OPD方法有效且鲁棒，但摘要未提及具体的基准测试或定量结果（如准确率提升），也未明确说明是否达到SOTA水平。

Insight: 创新点在于揭示了预热阶段的核心是传递教师兼容的思维模式而非正确答案，并提出了结合教师生成思维链和LoRA的Simple-OPD初始化方法。从客观角度看，其将预热机制理论化并提供了实用的即插即用方案，对知识蒸馏领域有借鉴意义。

Abstract: On-policy distillation (OPD) trains a student on its own rollouts with token-level supervision from teacher models, but its effectiveness can depend strongly on the warm-up stage before OPD. In this paper, we demystify warm-up for OPD from both data and training perspectives. For data, we find that effective warm-up relies on teacher-compatible chain-of-thought supervision, and that even incorrect teacher rollouts can provide comparable benefits to correct ones. This suggests that warm-up primarily transfers a teacher-compatible thinking pattern rather than merely correct answers. For training, we show that low-rank adaptation (LoRA) with a near-saturation training duration better balances in-domain adaptation and out-of-distribution generalization than full-parameter SFT. Based on these findings, we propose Simple-OPD, a plug-and-play initialization method that warms up the student on teacher-generated CoT with LoRA before OPD. Experiments across diverse settings demonstrate the effectiveness and robustness of Simple-OPD.

[10] FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding cs.CL | cs.AIPDF

Quanquan Li, Hongbo Zhang, Yihe Chi, Jingyu Li, Xidong Xi

TL;DR: 本文提出了FutureBridge方法，用于改进大语言模型（LLM）与小语言模型（SLM）在token级协作解码中的token选择策略。该方法通过评估候选token对SLM后续推理能力的支持程度进行排序，而非依赖LLM的局部偏好。在五个数学推理基准测试中，该方法显著提升了小模型的性能。

Details

Motivation: 现有token级协作方法（如使用LLM干预token或基于LLM下一个token概率排序）都依赖于LLM的局部偏好，但LLM选择的token可能不利于SLM后续的推理构建。本文旨在解决这一问题，使token选择更有利于SLM的持续推理。

Result: 在五个数学推理基准测试上，FutureBridge将Qwen3-1.7B SLM的Math Avg.分数相对于贪婪SLM解码提升了35.1%，证明了其有效性。

Insight: 核心创新在于将token选择标准从“LLM偏好什么”转变为“SLM能利用什么来继续推理”。具体实现上，通过训练一个轻量级token重排器，利用由答案验证的LLM轨迹提供的共享未来上下文，让冻结的SLM评估候选token，从而学习到基于SLM后续推理能力的反事实评分。推理时仅用LLM扩展候选池，选择后即交还SLM生成，无需生成或附加未来后缀，效率较高。

Abstract: Token-level collaboration allows a large language model (LLM) to assist a small language model (SLM) when their predictions diverge. Existing methods either use LLM-generated intervention tokens or rank candidates with the LLM’s next-token probabilities. Both rely on the LLM’s local preference, even though an LLM-selected token may be difficult for the SLM to build on. We present FutureBridge, which ranks joint LLM-SLM token candidates according to how well they support the SLM’s subsequent reasoning. During training, an answer-verified LLM trajectory supplies a fixed shared future, and a frozen SLM evaluates every candidate under this common context. The resulting counterfactual scores supervise a lightweight token reranker that observes only the current state and candidate token. At inference, FutureBridge uses the LLM only to expand the candidate pool, selects one token, and returns generation to the SLM without generating or appending a future suffix. Across five mathematical reasoning benchmarks, FutureBridge improves the Qwen3-1.7B SLM’s Math Avg. by 35.1% relative to greedy SLM decoding. These results indicate that token selection benefits from modeling whether the receiving SLM can use each candidate to continue reasoning, rather than relying on the LLM’s local preference alone.

[11] LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers cs.CLPDF

Tao Feng, Fangxu Yu, Haozhen Zhang, Zhongjie Dai, Liangqi Yuan

TL;DR: 本文提出了一个统一的LLM路由框架LLMRouter，将路由问题形式化为包含五个组件的序列决策过程，并构建了自动化评估基准xRouteBench。该框架支持多种路由任务，开源实现包含16种代表性路由器，实验表明学习型路由器在成本约束下显著优于固定模型基线。

Details

Motivation: 现有LLM路由器在制定和实现上差异较大，导致公平比较和扩展困难，且缺乏统一的评估基准。本文旨在提供一个标准化的基础设施，以促进路由器的开发、评估和部署。

Result: 在xRouteBench基准测试中，学习型路由器相对最强固定模型基线性能提升14.6%；轻量级路由器在严格成本约束下更具竞争力；用户条件路由持续提升个性化效果。

Insight: 创新点在于将LLM路由统一形式化为五组件序列决策过程，并构建了自动化监督构建与联合评估管道。该框架为不同路由方法提供了可比较的模块化基础，推动了路由技术的标准化发展。

Abstract: No single large language model (LLM) is optimal across all queries and budget constraints, making model routing essential for cost-effective deployment. Existing routers adopt diverse formulations and implementations, making fair comparison and extension difficult. We present a unified formulation of LLM routing as a sequential decision process characterized by five components: context encoders, model encoders, scoring functions, decision rules, and learning signals, covering single-turn, multi-turn, and personalized routing. Based on this formulation, we develop an automated pipeline for constructing routing supervision and evaluating routers jointly on response quality and inference cost. The resulting benchmark, xRouteBench, spans generic LLM, memory-augmented, vision, time-series, and personalized routing tasks. We further introduce LLMRouter, an open-source modular infrastructure with more than 16 representative routers. Our empirical study shows that learned routers outperform the strongest fixed-model baseline by 14.6% relatively, lightweight routers become more competitive under tight cost constraints, and user-conditioned routing consistently improves personalization.

[12] PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue cs.CL | cs.AIPDF

Bo Tang, Jianan Yang, Junyi Zhu, Yiquan Wu, Rui Zhao

TL;DR: 本文提出了PHASE-Tree模型和LongEvoRoleBench基准，用于解决长程角色扮演对话中角色状态演化的建模与评估问题。PHASE-Tree是一种多时间尺度的角色状态树结构，支持局部和跨剧集的更新；LongEvoRoleBench则是一个新的评估基准，用于衡量模型是否基于角色当前演化状态生成对话。

Details

Motivation: 现有角色扮演工作在两方面存在不足：一是角色表示通常是静态档案，局部更新会破坏未变化的特征；二是现有基准主要测试角色一致性（persona preservation）和记忆召回，而非模型是否基于角色当前演化状态说话。本文旨在同时解决这两个问题。

Result: 在LongEvoRoleBench的长对话核心测试集上，基于文本的PHASE-Tree方法在12个数据集-指标单元中的11个上优于内部变体，并在全部12个单元上优于外部文本基线，将角色级别、语义和嵌入分数分别提升了19.7%、12.4%和15.1%。人类评分与GPT-4.1评判结果显著相关（皮尔逊r=0.65）。

Insight: 主要创新点在于提出了一个分层的、多时间尺度的角色状态表示结构（PHASE-Tree），它包含不可变的身份根和可变的人设、会话及瞬间层，使得每个可变字段都能成为局部和跨剧集更新的可寻址目标。同时，构建了一个专门用于评估演化状态生成的新基准（LongEvoRoleBench），统一了评估协议。

Abstract: Long-horizon role-playing demands that characters remain recognizable as they evolve with the narrative. Yet existing work falls short on two fronts: representations are typically static profiles that cannot be updated locally without destabilizing unchanged traits, and benchmarks mainly test persona preservation and memory recall rather than whether a model speaks from a character’s currently evolved state. We address both. PHASE-Tree is a multi-timescale character-state tree with an immutable identity root and mutable persona, session, and moment layers, making each mutable field an addressable target for localized within- and cross-episode updates. It conditions generation through explicit textual provision or implicit parametric adaptation. To measure evolved-state generation, we introduce LongEvoRoleBench, which pairs four long-dialogue corpora for cross-episode evolution with four short-dialogue corpora as within-scene state-tracking checks, under a unified next-utterance protocol. On the long-dialogue core, textual PHASE-Tree ranks first in 11 of 12 dataset-metric cells against internal variants and all 12 cells against external textual baselines, improving character-level, semantic, and embedding scores by 19.7%, 12.4%, and 15.1% respectively. In a blinded 200-response study, human ratings correlate with the GPT-4.1 judge (Pearson r= 0.65); on descriptive n= 10 PT and NR prompt subsets, the Overall difference is +0.20. The long-dialogue Sem advantage persists across LLM judges and generation backbones.

[13] Confirming Our Biases? Evaluating the Capabilities, Risks, and Societal Impact of Large Language Models cs.CLPDF

Mudar Adas, Polina Tsvilodub, Michael Franke, Martin V. Butz

TL;DR: 本研究评估了大型语言模型（LLMs）对提示框架的敏感性，特别是它们如何强化用户在提示中表达的偏见，并探讨了隐性框架效应与显性提示操纵之间的界限。通过使用160个不同提示在十个主题上测试六个LLMs，研究发现LLMs会系统性地调整其回答以与提示框架对齐，即使在事实性语境中也是如此，这表明提示框架可能压倒事实一致性。

Details

Motivation: 动机是调查LLMs在多大程度上强化用户在提示中表达的偏见，并检验隐性框架效应与显性提示操纵之间的边界，以理解模型的可操纵性及其社会影响。

Result: 在涵盖意见性和事实性领域的十个主题上，对六个LLMs的评估显示，模型会系统性地适应提示框架来调整回答，即使在事实性语境中，提示框架也能超越事实一致性，这揭示了LLMs的可操纵程度和边界。

Insight: 创新点在于系统性地量化了LLMs对提示框架的敏感性，并区分了隐性偏见强化与显性操纵，客观分析表明，这突出了在事实性领域模型响应可能被框架效应主导的风险，对评估模型鲁棒性和社会影响具有借鉴意义。

Abstract: It is well established that large language models (LLMs) are sensitive to prompt framing, reflecting patterns in their training data or prior prompts. In this study, we investigate the extent to which LLMs reinforce users biases expressed in the prompts and examine the boundary between implicit framing effects and explicit prompt manipulation. Specifically, we evaluate how susceptible LLMs are to direct and suggestive prompts that encourage models to support or challenge particular positions. We evaluate six LLMs using 160 distinct prompts spanning ten topics across opinion-based and factual domains. The prompts systematically vary in prompting strategy, support versus challenge instructions, prompt polarity, users’ expressed beliefs, and topic domain, spanning both opinion-based and factual questions. Our results show that LLMs systematically adapt their responses to align with prompt framing, even in factual contexts. This suggests that prompt framing can outweigh factual consistency in model responses. Overall, our findings delineate the extent and boundaries of LLM manipulability. Furthermore, the results imply that LLMs can reinforce subtle user biases and are susceptible to explicit prompt manipulation even in domains where responses should remain factually stable.

[14] Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models? cs.CL | cs.CVPDF

Jiankun Wang, Yisen Gao, Ziwei Zhang, Xingcheng Fu, Jiaxin Bai

TL;DR: 本文研究了视觉检索增强生成（RAG）中检索证据数量对扩散语言模型（DLMs）性能的影响，发现无条件传递所有检索到的页面会因语义冲突而降低答案准确性。作者提出了无需训练的基于熵的候选过滤器（ECF）框架，通过选择性证据准入来提升性能。

Details

Motivation: 解决视觉RAG中无条件传递所有检索证据给扩散语言模型时，因证据间语义冲突导致答案准确性下降的问题。

Result: 在三个多模态DLMs和五个视觉问答基准测试上，ECF相比最强的固定top-k输入平均提升答案准确率2.62个百分点，相比各数据集上最佳的无训练竞争方法平均提升2.37个百分点。

Insight: 创新点在于揭示了扩散语言模型并行去噪中的源一致性损失问题，并提出了基于多粒度证据单元构建和空白控制块置信度的训练免费证据准入框架，实现了检索覆盖度与有害视觉暴露之间的平衡。

Abstract: Visual retrieval-augmented generation (RAG) commonly expands the retrieved evidence set to improve answer-page coverage, implicitly assuming that all available evidence should be passed to the generator. We show that this assumption does not hold for diffusion language models (DLMs): retrieving more pages increases answer-page recall, whereas unconditionally passing all retrieved pages to the generator often reduces answer accuracy, primarily because of semantic conflict. A latent-source analysis explains this mismatch through source-coherence loss in parallel denoising, where position-wise proposals can combine incompatible visual sources into unsupported answers. We further find that such interference is already visible in the first-step answer-block distribution, making it possible to assess evidence before decoding. To preserve retrieval coverage while limiting harmful visual exposure, we propose the Entropy-Based Candidate Filter (ECF), a training-free evidence-admission framework. To reduce irrelevant content within individual candidates, ECF constructs multi-granularity evidence units; to identify beneficial additional evidence, it uses blank-controlled block confidence and retrieval rank to determine whether and which candidate should enter the final context. Across three multimodal DLMs and five visual QA benchmarks, ECF improves answer accuracy by 2.62 percentage points on average over the strongest fixed top-$k$ input and, with LLaDA2.0-Uni, by 2.37 percentage points on average over the best competing training-free result for each dataset. These results show that broader retrieval benefits visual DLM-RAG through selective evidence admission rather than unconditional evidence expansion. Code is publicly available at https://github.com/wjkuser/ECF.

[15] Stoicheia: Character-Level Masked Diffusion for Ancient Greek Textual Restoration, Parsing, and Metrical Scansion cs.CLPDF

Eric Cullhed, Albin Thörn Cleland

TL;DR: Stoicheia是一个405M参数的字符级掩码扩散编码器，专门用于古希腊文本处理。它将输入分解为五个对齐且可独立掩码的平面（字母、词句边界、变音符号、大小写和标点），通过单一骨干网络实现文本修复、重分割、加注音和标点等多项任务，无需针对特定任务重新分词。

Details

Motivation: 解决古希腊文本修复、解析和韵律分析等任务中，传统方法需要针对不同任务进行特定预处理和重新分词的问题，旨在通过统一的字符级模型简化流程并提升性能。

Result: 在三个实验中，Stoicheia相比随机初始化基线分别提升了5.6个字符错误率点（CER）于铭文重建、12.9个标记准确率点（LAS）于依存句法分析、6.0个平衡准确率点于元音标记与韵律分析。在Ithaca测试集上，字符错误率从先前SOTA的24.6和23.5降至15.5，top-1准确率从63.0和64.0提升至74.5。

Insight: 创新点在于将字符级输入分解为多个对齐的平面，并结合掩码扩散预训练，使单一模型能处理多种文本处理任务，避免了任务特定的重新分词，同时通过旋转折叠的检查点发布策略确保了评估的严谨性。

Abstract: We introduce Stoicheia, a 405M-parameter character-level masked-diffusion encoder for Ancient Greek whose input factors into five aligned, independently maskable planes: letters, word and sentence boundaries, diacritics, capitalization, and punctuation. A single backbone can therefore restore lacunae, re-segment, accentuate, and punctuate unspaced text without task-specific retokenization. We pretrain it on an open, revision-pinned corpus of 380M words and release eleven checkpoints: ten rotated, decontaminated folds, guaranteeing that for any given literary passage at least one released model has never seen its text, and one with no exposure to documentary texts. Three experiments - reconstruction of damaged inscriptions and papyri, morphosyntactic tagging and dependency parsing, and macronization with metrical scansion - each carry a matched random-initialization control, isolating what character-level diffusion pretraining contributes: 5.6 CER points on inscription reconstruction, 12.9 LAS on parsing, and 6.0 points of balanced accuracy on macronization. On Ithaca’s own test split, with identical frozen samples and strict scoring, Stoicheia reduces character error relative to both prior state-of-the-art systems, from 24.6 (Ithaca) and 23.5 (its 2025 Aeneas-framework successor) to 15.5, and raises top-1 accuracy from 63.0 and 64.0 to 74.5.

[16] Why Knowing Both Hops Is Not Enough: Understanding Two-Hop Generalization in Language Models cs.CLPDF

Zili Zhang, Yilin Wang, Heng Wang, Herun Wan, Minnan Luo

TL;DR: 该论文研究了大型语言模型在简单两跳推理任务中的泛化失败现象，即在模型能正确存储单跳知识的情况下，却无法组合它们完成两跳查询。通过在受控符号环境中训练Transformer模型，作者发现模型仅在第二跳符合训练分布时能可靠泛化，而在第二跳超出分布时总是失败。

Details

Motivation: 论文的动机是探究大型语言模型在解决复杂多跳问题时，为何会在看似简单的两跳查询上失败，旨在理解其内部机制以解释这种泛化能力的不一致性。

Result: 实验结果表明，在受控环境中，当第二跳符合训练分布时，模型能成功泛化；但当第二跳超出分布时，模型总是失败。通过提出的循环式训练策略，模型在超出分布的两跳查询上的泛化能力得到了显著提升。

Insight: 论文的创新点在于通过机制分析揭示了成功泛化依赖于跨上下文一致的中间表示，而失败源于下层构建了正确中间表示但上层仅学习映射而非推理；提出的循环式训练策略通过促进推理电路的跨输入形式重用，有效改善了超出分布情况下的泛化性能。

Abstract: Large language models (LLMs) can solve complex multi-hop problems yet exhibit puzzling failures on simple two-hop queries: although a model may correctly store each individual hop, it often fails to combine them. To understand the internal mechanisms of this phenomenon, we train transformers from scratch in a controlled symbolic environment. Our experiments reveal a pattern in two-hop generalization: models generalize reliably when the second hop follows the training distribution, but always fail when it deviates. Through mechanistic analysis, we provide a complete explanation for these distinct generalization behaviors: in settings where models generalize successfully, performance is driven by the emergence of consistent intermediate representations for the same entities across contexts, whereas failures on settings where the second hop is out-of-distribution arise from a mismatch across layers: lower layers correctly construct these intermediate representations, but upper layers, while trained on corresponding atomic facts, primarily learn to map them to outputs rather than to reason over them. Driven by this insight, we propose a recurrent-style training strategy, which enables transformers to reuse their reasoning circuitry across input forms and substantially improves generalization on out-of-distribution two-hop queries.

[17] Gaze Behavior in Visual World Experiments Can be Modeled With Off-the-shelf Language-Vision Encoders cs.CL | cs.CVPDF

Rahul Murali Shankar, Titus von der Malsburg, Sebastian Padó

TL;DR: 本文提出了一种利用现成的语言-视觉编码器（如CLIP）结合双模态归因方法来预测视觉世界实验中人类注视行为的新方法。该方法无需生成式架构或微调，即可稳健地复现经典英语视觉世界研究中显示人类预测性处理的结果。

Details

Motivation: 现有计算心理语言学工作主要集中于单模态（文本或语音）语言模型，而忽略了同时呈现视觉和语言输入的多模态实验范式（如视觉世界研究）。本文旨在填补这一空白，探索多模态模型在模拟人类多模态语言处理行为方面的潜力。

Result: 该方法在经典的英语视觉世界研究基准上，成功复现了显示人类预测性处理的实验结果，证明了其稳健的预测能力。

Insight: 创新点在于将现成的CLIP类多模态双编码器模型与双模态归因方法结合，无需任务特定训练或生成架构即可模拟人类注视行为，为多模态计算心理语言学提供了一种高效、即用的建模思路。

Abstract: The recent advances in neural language models have also spurred much work in computational psycholinguistics, asking whether neural LMs are also promising models of human language processing. However, work has been overwhelmingly focused on the unimodal case of written or spoken language. In contrast, multimodal experimental paradigms, like visual world studies that present participants with both visual and linguistic input simultaneously, have been neglected. In this paper, we present a novel approach that predicts gaze behavior in visual world studies. It does so by combining a simple multi-modal bi-encoder model of the CLIP family with a bimodal attribution method. We demonstrate the ability of this approach to robustly replicate the results of a seminal English visual world study which shows hu- man predictive processing. Remarkably, it does so without a generative architecture and without the need for fine-tuning, despite not being trained for this task.

[18] CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity cs.CL | cs.AIPDF

Ananya Sahu, Mohit Bansal, Elias Stengel-Eskin

TL;DR: 本文提出CreativeInstruct，一种可扩展的指令微调方法，通过教导LLMs在生成时注入特殊的[StartCreativity]标记来引导创造性，从而在保持后训练模型质量的同时，恢复或提升输出的多样性和创造力。该方法在叙事生成任务中，在不牺牲质量或增加推理时模型数量的情况下，匹配或超越了多模型基线的多样性。此外，研究还引入了一种基于图编辑距离的结构多样性度量，以捕捉叙事层面的变化，并展示了创造性模型作为强化学习基底的益处。

Details

Motivation: 后训练虽然提升了大型语言模型的能力，但通常会降低其输出的多样性和创造力，这对明确需要创造性的任务（如故事生成）以及隐含需要创造性的任务（如强化学习）产生负面影响。

Result: 在叙事生成上，CreativeInstruct匹配或超越了多模型基线及其蒸馏变体的多样性，且不牺牲质量。人工评估中，70.3%的情况下标注者认为其生成比后训练LLMs的生成更具创造性。将GRPO应用于CreativeInstruct检查点，在AMC和MATH基准上分别比应用于后训练检查点提升了约4%和5%。

Insight: 核心创新点在于通过指令微调和可控的[StartCreativity]标记注入，可扩展地教导LLMs平衡质量与创造性。此外，提出的基于图编辑距离的结构多样性度量，能更好地评估叙事层面的变化，超越了纯词汇和语义度量。该方法为在单一模型中兼顾高质量与高创造性输出提供了新思路，并展示了创造性模型作为强化学习基底的潜力。

Abstract: While post-training improves the capabilities of large language models (LLMs), it generally lowers their output diversity and creativity, negatively impacting tasks that explicitly require creativity (e.g., story generation) as well as those that require it implicitly, e.g., reinforcement learning (RL). We instead propose CreativeInstruct, a scalable instruction-tuning method that teaches LLMs to balance creative, base-model-like generations with the quality of post-trained models, by learning to inject special [StartCreativity] spans that bias generation toward creativity. Furthermore, we introduce a structural diversity metric based on graph edit distance, which captures narrative level variation missed by purely lexical and semantic metrics. On narrative generation, CreativeInstruct matches or exceeds the diversity of both multi-model baselines and distilled variants of their outputs, without sacrificing quality or requiring multiple models at inference time. These results are mirrored in our human evaluation, where we find that annotators rate CreativeInstruct generations as more creative than the post-trained LLMs’ generations in 70.3% of cases. We also show the benefits of creative models as a substrate for RL: GRPO applied to a CreativeInstruct checkpoint improves by ~4% on AMC and ~5% points on MATH over the same training applied to the post-trained checkpoint.

cs.CV [Back]

[19] TransSLR: A Lightweight Transformer for Sign Language Recognition cs.CV | cs.AIPDF

Lucia Yen Wanchi, Samuel Johnny, Victor Tolulope Olufemi, Emmanuel Aaron, Moise Busogi

TL;DR: 本文提出TransSLR，一种用于手语识别的轻量级时序Transformer编码器。它直接在64帧归一化的姿态序列上从头训练，通过处理几何关键点而非原始RGB图像来实现独立于手语者的泛化。在CASL-W60基准测试中，TransSLR以80.39%的准确率创造了新的SOTA，比之前最佳结果提升了10.46%。

Details

Motivation: 针对中非手语（CASL）等资源匮乏语言的手语识别问题，现有方法（如微调高资源模型）因数据规模有限以及CASL与大规模语料库（如WLASL）之间存在显著的词汇和视觉领域差距而失败，需要一种能有效处理这些挑战的新方法。

Result: 在CASL-W60基准测试上，TransSLR达到了80.39%的准确率，比之前最佳报告的69.93%提升了10.46%，创造了新的SOTA。与基于RGB和多模态的基线相比，TransSLR均表现出优越性能。

Insight: 创新点在于采用仅编码器的轻量级Transformer设计，直接处理归一化的姿态序列，避免了对外观视觉信息的依赖，从而实现了更好的泛化能力和显著降低的计算开销，使其适合在资源受限环境中部署。

Abstract: Automated Sign Language Recognition for under-represented languages remains a largely unsolved problem. Central African Sign Language (CASL) exemplifies this gap: the only available bench-mark, CASL-W60, has a best reported accuracy of 69.93%, and we show that the common heuristic of fine-tuning high-resource models fails to close it. This failure stems from two compounding factors: the limited scale of available CASL data and the significant lexical and visual domain gap between CASL and large-scale corpora such as WLASL, which renders pre-trained representations largely uninformative. To address this, we propose TransSLR, a lightweight Temporal Transformer Encoder trained from scratch on 64-frame normalized pose sequences, with average pooling and a classification head. By operating on geometric keypoint representations rather than raw RGB, TransSLR achieves signer-independent generalization without relying on visual appearance. On the CASL-W60 benchmark, TransSLR establishes a new state-of-the-art accuracy of 80.39%, surpassing the prior best by +10.46%. Beyond accuracy, our encoder-only design significantly reduces computational overhead, making deployment feasible in resource-constrained environments. We conduct extensive experiments on the CASL-W60 benchmark, comparing against RGB-based and multimodal baselines, and demonstrate that TransSLR achieves state-of-the-art performance.

[20] Deep Evidential Regression for Sparse Forest Height Estimation from Multimodal Satellite Imagery cs.CV | cs.LGPDF

Laura Bader, Muhammad Ammar Ahmed, Xiao Xiang Zhu, Göran Kauermann

TL;DR: 本文提出了一种基于深度证据回归（DER）的方法，用于从多模态卫星图像（Sentinel-1/-2）中稀疏监督下估计森林高度。该方法在TreeUQ基准上，通过引入掩码证据损失来处理地理空间数据的标签稀疏问题，并使用U-Net架构单次前向传播联合预测树高及其不确定性。

Details

Motivation: 从卫星图像准确估计森林高度对于碳核算、生物多样性监测等应用至关重要，但现有深度学习方法通常不量化预测不确定性，这在监督稀疏且存在地理分布偏移的地理空间场景中是一个关键限制。

Result: 实验结果表明，深度证据回归（DER）在TreeUQ基准上的预测性能与确定性U-Net相当，同时还能提供校准良好的不确定性估计。

Insight: 主要创新点在于为密集地理空间预测引入了掩码证据损失，以处理极端稀疏的标签数据，并展示了证据学习作为从地球观测数据中进行不确定性感知森林结构估计的高效框架的潜力。

Abstract: Accurate estimation of forest height from satellite imagery is essential for applications such as carbon accounting, biodiversity monitoring, and ecosystem management. While recent deep learning approaches provide accurate predictions, they typically do not quantify predictive uncertainty. This limitation is particularly relevant in geospatial settings characterized by sparse supervision and geographic distribution shift. In this work, we investigate Deep Evidential Regression (DER) for forest height estimation on the TreeUQ benchmark, a large-scale dataset designed for the joint estimation of tree count and average tree height at 10 m resolution, based on Sentinel-1/-2 data as well as tree inventory data over the federal state of Bavaria. To account for the extreme label sparsity of the tree inventory data, we introduce a masked evidential loss for dense geospatial prediction. Using a U-Net architecture with multimodal Sentinel-1 and Sentinel-2 inputs, the proposed approach jointly predicts tree height and associated uncertainty estimates in a single forward pass. Experimental results show that DER achieves predictive performance comparable to a deterministic U-Net while additionally providing well-calibrated uncertainty estimates. These findings demonstrate the potential of evidential learning as an efficient framework for uncertainty-aware forest structure estimation from Earth observation data.

[21] InsertFuse: A Unified Framework for Multi-Category Reference-Guided Image Insertion cs.CVPDF

Guangzhao Li, Qingyan Wei, Huayu Zheng, Yige Zheng, Chaoyang Zhang

TL;DR: InsertFuse是一个用于多类别参考引导图像插入的统一框架。其核心思想是将类别特定的专业知识学习与跨类别能力整合解耦。该框架首先为不同插入类别训练专家模型，然后通过插入策略蒸馏（IOPD）将专家能力整合到一个学生模型中，同时提出了令牌对齐几何条件（TAGC）、区域平衡流匹配和参考CFG等技术来提升空间控制和生成质量。

Details

Motivation: 解决多类别参考引导图像插入任务中，直接联合训练不同类别模型会导致跨类别干扰，以及现有方法在空间控制和参考引导方面不足的问题。

Result: 在公开的AnyInsertion基准测试集和自建的多类别测试集上进行了广泛实验，在大多数指标上达到了最先进的性能（SOTA），展示了跨不同插入类别强大的参考保真度和生成质量。

Insight: 主要创新点在于通过解耦专家学习与能力整合（IOPD）来避免跨类别干扰，并提出了TAGC和区域平衡流匹配等新机制来增强空间控制与监督的鲁棒性，以及通过参考CFG来强化视觉参考的引导作用。

Abstract: We present InsertFuse, a unified framework for multi-category reference-guided image insertion. Its key idea is to decouple category-specific expertise learning from cross-category capability consolidation. InsertFuse first trains specialized experts for different insertion categories and then introduces Insertion On-Policy Distillation (IOPD) to consolidate their capabilities into a single student. By querying the matched expert at states visited by the student, IOPD preserves category-specific insertion behavior while mitigating the cross-category interference caused by direct joint training. To improve spatial control, we propose Token-Aligned Geometry Conditioning (TAGC), which maps mask-derived geometric cues to the visual token grid, and Region-Balanced Flow Matching, which separately normalizes prediction errors inside and outside the insertion region to prevent background-dominated and scale-dependent supervision. We further introduce Reference CFG to isolate and strengthen the guidance induced by the visual reference under fixed scene and geometry conditions, with IOPD transferring this enhanced supervision into the unified student. Extensive experiments on the public AnyInsertion benchmark and our multi-category test set demonstrate state-of-the-art performance on most metrics, showing strong reference fidelity and generation quality across diverse insertion categories.

[22] Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition cs.CVPDF

Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi, Alessandro Lameiras Koerich, Marco Pedersoli

TL;DR: 本文提出了一种基于能量的缓存个性化方法（EB-CaP），用于视频细粒度面部表情识别的在线测试时适应。该方法利用预训练的CLIP模型，通过能量函数从当前未标记视频中采样生成个性化的类别原型，并存储在正负缓存中，结合自适应熵门和多样性门控制更新，最终预测融合缓存分数与CLIP分数，在保持低计算和内存开销的同时提升了性能。

Details

Motivation: 解决视频面部表情识别中因个体特异性分布偏移导致的模型性能下降问题，同时避免传统测试时适应方法更新模型参数带来的计算成本和延迟，以及基于缓存的方法需要大量目标样本形成可靠原型的局限性。

Result: 在BioVid、StressID和BAH数据集上的实验表明，EB-CaP优于最先进的测试时适应方法，同时保持了较低的计算和内存开销。

Insight: 创新点在于使用轻量级能量模型从单个视频在线生成个性化原型，无需累积大量目标数据或存储多样源原型；通过自适应熵门和多样性门动态管理缓存，有效处理罕见类别和早期适应阶段的样本不足问题；仅依赖预训练CLIP的相似性进行能量建模，实现高效的原型采样与融合预测。

Abstract: Facial expression recognition (FER) in videos is challenging because models must identify subtle, temporally evolving affective states that vary across individuals. Although vision-language models provide transferable visual-semantic representations, models trained on subject-independent data often degrade under subject-specific distribution shifts at inference time. Existing test-time adaptation (TTA) methods commonly update model parameters during inference, increasing computational cost and latency. Cache-based methods avoid parameter updates, but they usually require enough target samples to form reliable class prototypes, which is difficult early in adaptation and for rarely observed classes. We introduce Energy-Based Cache Personalization (EB-CaP), a subject-based online TTA method for video FER that generates class-specific prototypes personalized to each target video. EB-CaP uses a lightweight energy-based model to sample prototypes from the current unlabeled video and populate a personalized cache online, without accumulating large amounts of target data or storing diverse source prototypes. Its energy function relies only on pretrained CLIP: similarities between the target video embedding and class text embeddings guide prototype sampling. In parallel, positive and negative caches store reliable and uncertain target embeddings. An adaptive entropy gate controls cache updates according to the evolving confidence distribution, while a diversity gate limits redundant samples. Final predictions combine cache-derived scores with the current CLIP scores. Experiments on BioVid, StressID, and BAH show that EB-CaP outperforms state-of-the-art TTA methods while maintaining low computational and memory overhead. Code is available at https://github.com/MasoumehSharafi/EB-CaP.

[23] SLED: Scalable Location Encoding via Distillation cs.CV | cs.AIPDF

Kevin Lane, Zhongying Wang, Esther Rolf, Morteza Karimzadeh

TL;DR: 本文提出了SLED（Scalable Location Encoder via Distillation），一种基于蒸馏的可扩展位置编码器，它利用地理位置作为绑定模态，能够以任意地理空间数据模态预训练位置编码器。该方法轻量、模块化，能灵活整合多模态数据，无需样本的时空配准，且在小批量（如128）下表现优异，显著降低了计算成本。

Details

Motivation: 当前最先进的位置编码器依赖于计算昂贵的CLIP风格框架，需要大批量（16K-32K），存在假阴性样本问题，且难以扩展到更多模态。SLED旨在解决这些问题，提供一种高效、可扩展的位置编码预训练方法。

Result: 在Sentinel-1、Sentinel-2和Landsat影像上预训练的单模态和多模态SLED模型，在19个以人为中心的基准任务上，表现与现有方法相当或更优，并探索了多模态预训练的益处。

Insight: 创新点在于使用地理位置作为绑定模态进行蒸馏预训练，避免了假阴性样本和时空配准需求，实现了轻量、模块化的架构，显著提升了训练效率和可扩展性。

Abstract: The plethora of readily available geospatial data offers exciting opportunities to learn high quality representations of the planet, but the sheer size of the Earth Observations (EO), differing modalities, and different sensor types pose significant challenges in doing so. Location encoders have emerged as an efficient way of compressing EOs into location-specific embeddings. However, current state-of-the-art location encoders rely on computationally expensive CLIP-style frameworks that require large batch sizes in the 16K–32K range, suffer from false negative samples, and scale poorly with additional modalities. We introduce the Scalable Location Encoder via Distillation (SLED), a distillation-based location encoder that uses geospatial location as a binding modality to pretrain location encoders with any modality of geospatial data. The resulting location encoder framework is lightweight, modular, and can flexibly incorporate multiple modes, while eliminating the need for spatiotemporal coregistration of samples. SLED is performant with batch sizes as small as 128, enabling pretraining at a fraction of the runtime and compute costs of current state-of-the-art models. We demonstrate our approach by pretraining unimodal and multimodal SLED models on Sentinel-1, Sentinel-2, and Landsat imagery. We show that both unimodal and multimodal SLED models keep pace with or outperform existing approaches on a diverse set of 19 human-centric benchmark tasks and explore the benefits of using additional modes in pretraining.

[24] CoDAT: Collaborative Dual-Attention Transformer with Low-Cost Temporal Modeling for Efficient Edge Action Recognition cs.CVPDF

Novendra Setyawan, Chi-Chia Sun, Mao-Hsiu Hsu, Wen-Kai Kuo, Jing-Ming Guo

TL;DR: 本文提出CoDAT，一种用于边缘设备实时动作识别的协作双注意力Transformer模型。该模型通过轻量级双分支模块（空间卷积注意力SCA和跨步单头注意力SSHA）替代传统多头注意力，并结合无参数时间移位模块TShift进行低成本时序建模，在保持精度的同时显著提升了计算效率。

Details

Motivation: 解决在物联网边缘设备上进行实时人体动作识别时，现有3D CNN、视频Transformer等模型计算成本过高，无法满足严格延迟、内存和功耗限制的问题。

Result: 在ImageNet-1K上，CoDAT-M在同等精度下比EfficientViT384和FastViT-S12快2倍；在Kinetics-400和MA-52等动作识别基准上，CoDAT达到了与SOTA CNN、Transformer及混合基线模型相当的Top-1精度，同时推理速度比VSwin-T快2.9倍，比ViT-Temporal-Shift变体快2倍，比UniFormer-B快5倍；在UCF-101上，CoDAT-S384精度匹配TokShift和LAPS，但速度快6倍且FLOPs减少高达13倍。

Insight: 主要创新点在于设计了轻量化的协作双注意力机制（SCA+SSHA）来高效融合局部与全局特征，并嵌入无参数的TShift模块进行低成本跨帧时序建模，从而在边缘设备上实现了精度与效率的平衡。

Abstract: Real-time human action recognition on Internet-of-Things (IoT) edge devices requires models that capture rich spatio-temporal cues within strict latency, memory, and power envelopes. Current 3D CNNs, video transformers, and shift-based ViT deliver high accuracy but come at computational costs that preclude edge IoT deployment. This paper proposes CoDAT, a Collaborative Dual-Attention Transformer that replaces conventional multi-head attention with a lightweight dual-branch module: Spatial Convolutional Attention (SCA) for local aggregation and Strided Single-Head Attention (SSHA) for global context. SSHA jointly compresses the spatial resolution and channel dimensions of the query, key, and value tensors via stride-based sparse projection, then fuses the resulting global and local features at a markedly reduced cost. To enable temporal communication across frames, a parameter-free TShift module is embedded in each block. Extensive experiments on Jetson AGX Orin and Raspberry Pi 5 demonstrate that CoDAT achieves an energy-accuracy balance in both image and action recognition. On ImageNet-1K, CoDAT-M runs 2x faster than EfficientViT384 and FastViT-S12 at comparable accuracy, and CoDAT-L matches ViT-S with 3x fewer parameters at 2x higher throughput. On Kinetics-400 and MA-52, CoDAT achieves competitive Top-1 accuracy against state-of-the-art CNN, transformer, and hybrid baselines while running up to 2.9x faster than VSwin-T, 2x faster than ViT-Temporal-Shift variants, and 5x faster than UniFormer-B. On UCF-101, CoDAT-S384 matches TokShift and LAPS while being 6x faster and requiring up to 13x fewer FLOPs, establishing an efficiency-accuracy balance for real-time action recognition in edge IoT perception systems. Code is available at https://github.com/novendrastywn/CoDAT .

[25] When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning cs.CVPDF

Wei Liu, Xing Deng, Haijian Shao

TL;DR: 本文研究了在源数据不可用的跨域小样本学习（SF-CDFSL）中，视觉模型经过目标域自适应（LoRA）前后，详细类别描述相对于基础类别名称的语义效用变化。研究发现存在两种典型模式：语义饱和（初始增益大幅收缩）和语义涌现（自适应后详细描述才变得有用）。

Details

Motivation: 动机是探究在SF-CDFSL中，基于冻结视觉-语言模型零样本准确率选择的语言描述，在目标域视觉自适应后其效用排名是否依然有效，以评估零样本提示质量能否完全代表自适应锚点的质量。

Result: 在EuroSAT、CropDisease、ISIC和ChestX数据集上的实验表明，语义饱和模式下（前两个数据集），详细描述的初始准确率增益（8.13-21.54个百分点）在LoRA后大幅收缩至0.69-2.96个百分点；语义涌现模式下（后两个数据集），详细描述仅在视觉表示更新后才变得有用（Δ_LoRA > 0）。

Insight: 创新点在于揭示了视觉自适应会显著改变语言描述的语义效用，并识别出语义饱和与语义涌现两种模式；研究主张需要评估自适应边界两侧的语言描述质量，而不仅仅是依赖零样本性能。

Abstract: Language descriptions in source-free cross-domain few-shot learning (SF-CDFSL) are often selected according to zero-shot accuracy obtained with a frozen vision–language model. This paper asks whether that ranking remains valid after target-domain visual adaptation. Under a strictly paired protocol, we compare a generic class-name template with fixed detailed class descriptions before and after visual Low-Rank Adaptation (LoRA) on EuroSAT, CropDisease, ISIC, and ChestX. Let $\deltazero$ and $\deltalora$ denote the Detailed-minus-Base accuracy before and after adaptation, respectively. Two recurring regimes emerge. In \emph{semantic saturation}, $\deltazero>0$ but $0<\deltalora\ll\deltazero$: on EuroSAT and CropDisease, initial gains of 8.13–21.54 percentage points contract to 0.69–2.96 points after LoRA. In \emph{semantic emergence}, $\deltazero\leq0$ but $\deltalora>0$: on ISIC and ChestX, detailed descriptions become more useful only after the visual representation is updated. Training trajectories and sample-level decomposition show that saturation is driven mainly by Base-LoRA recovering errors already solved by detailed semantics, whereas emergence is associated with prediction turnover and newly formed Detailed-only correct decisions. Fixed-point-free shuffled-semantic controls, a second CLIP backbone, and multiple random seeds support the broad pattern while identifying ChestX 1-shot as a weak boundary case. These findings establish that zero-shot prompt quality is an incomplete proxy for adaptation-anchor quality and motivate evaluating language on both sides of the adaptation boundary.

[26] Corrupting Attention: Evasion-Based Adversarial Attacks on Encoder Attention in Detection Transformers cs.CV | cs.LGPDF

Ridma Jayasundara, Shaheer Mohamed, Tharindu Fernando, Harshala Gammulle, Basura Fernando

TL;DR: 本文提出了首个针对检测Transformer中编码器注意力机制的对抗攻击方法，通过优化不可感知的L∞扰动直接破坏注意力结构，而非传统上针对检测输出的攻击。该方法在COCO数据集上将DETR-R50的mAP从42.1降至0.97，并推广到多种注意力变体，显著优于现有攻击。

Details

Motivation: 检测Transformer已成为主流目标检测器，但其对抗鲁棒性研究不足，现有攻击多针对检测输出而非核心的注意力机制，而注意力机制集中了模型的空间推理能力，破坏其结构可能更具破坏性。

Result: 在相同扰动预算和迭代次数下，攻击将DETR-R50在COCO上的mAP从42.1降至0.97，比现有最强攻击降低约4倍；对DINO-Swin-L的mAP从56.8降至1.44（现有攻击仅降至7.3），在密集和可变形注意力上均达到SOTA水平。

Insight: 创新点在于直接攻击编码器注意力而非检测输出，通过设计分散、重排、置换和峰值抑制等多样化目标破坏注意力结构本身；客观来看，这揭示了注意力机制在对抗攻击下的结构性脆弱，为防御提供了新方向。

Abstract: Adversarial vulnerabilities remain a major concern for the safe deployment of neural networks, particularly in object detection, a core task embedded in many safety-critical systems. Detection transformers have emerged as leading object detectors, yet their adversarial robustness remains comparatively underexplored. Most existing attacks target the detection output rather than the attention mechanism that makes these models distinctive. In this paper, we introduce the first attack that directly optimizes an encoder-attention objective under an imperceptible, bounded $\ell_\infty$ perturbation. Rather than introducing an attacker-owned sink token through a visible patch, it drives the model’s own attention toward a corrupted target. We argue that encoder attention concentrates the model’s spatial reasoning, so corrupting it propagates through the detection pipeline more disruptively than perturbing the detection output alone. Our attack reduces DETR-R50 mAP on COCO from 42.1 to 0.97, a $\sim 4\times$ reduction in resulting mAP over the strongest existing attack under an identical perturbation budget and iteration count. We further show that this vulnerability is not specific to a particular corruption objective: across four qualitatively distinct targets, dispersion, re-ranking, permutation, and peak-suppression, detection consistently drops below 3 mAP, suggesting that the weakness arises from disrupting the attention structure itself rather than from any single target. Finally, we demonstrate that the attack generalizes across attention formulations, reducing DINO-Swin-L from 56.8 to 1.44 mAP against 7.3 for the strongest prior attack, establishing state-of-the-art on both dense and deformable attention.

[27] Suppress and Diversify: Refining Robust Pathways for Corruption Robustness cs.CVPDF

Jiangang Yang, Wenhui Shi, Xiaoran Xu, Wenyue Chong, Luqing Luo

TL;DR: 本文提出了一种名为Suppress and Diversify (S&D)的非侵入式优化方法，旨在通过显式表征和动态选择网络内部的鲁棒路径来增强模型对图像损坏的鲁棒性。该方法识别了鲁棒特征在网络层中的衰减现象，并通过保持对称性的变换来多样化这些路径，从而提升模型性能。

Details

Motivation: 针对安全关键应用中对自然图像损坏的模型鲁棒性需求，现有方法主要关注隐式表征学习，而本文首次系统性地探索了用于显式表征内部鲁棒性的计算路径。

Result: 在八个基准测试上的广泛评估表明，S&D方法在多种视觉任务、不同骨干网络和复杂现实场景中都能持续提升性能，证明了其广泛的效能和可扩展性。

Insight: 创新点在于首次系统地探索了显式鲁棒路径，并提出了非侵入式、架构无关、无参数且不增加推理开销的S&D优化方法，通过抑制和多样化鲁棒路径来提升模型鲁棒性。

Abstract: Model robustness against natural image corruptions is essential for safety-critical applications. While existing methods primarily focus on implicit representation learning, we provide the first systematic exploration of computational pathways to explicitly characterize internal robustness. We identify a progressive decay of robust features across network layers and establish a functional dependency between the prevalence of these features and model performance. To exploit these insights, we propose Suppress and Diversify (S&D), a non-intrusive refinement approach that enhances robustness by dynamically selecting robust pathways and diversifying them through symmetry-preserving transformations. S&D is architecture-agnostic, parameter-free, and incurs zero test-time overhead. Extensive evaluations across eight benchmarks demonstrate that S&D consistently improves performance across multiple vision tasks, diverse backbones, and complex real-world scenarios, highlighting its broad efficacy and scalability.

[28] Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models cs.CVPDF

Renye Yan, Jikang Cheng, You Wu, Wei Peng, Zongwei Wang

TL;DR: 本文提出了一种名为阶段引导的逐步优化（SGPO）方法，用于解决扩散模型在偏好对齐任务中因奖励稀疏和时序目标不匹配而导致的奖励黑客问题。该方法通过信噪比和语义变化联合识别生成阶段，并自适应地为不同阶段分配特定目标，以优化生成过程。

Details

Motivation: 扩散模型的最大似然训练目标仅关注数据分布重建，难以与特定偏好对齐；而现有的强化学习对齐方法因奖励稀疏和时序目标不匹配（即最终奖励被回填到所有去噪步骤）易导致奖励黑客和优化过程弱化。

Result: 在16个对比实验中，SGPO方法在生成质量上实现了平均26.7%的提升，并提高了36.7%的收敛速度，验证了其有效性。

Insight: 创新点在于根据去噪过程的阶段性（早期混沌、中期稳定、晚期细节）动态分配优化目标：早期优先退出混沌状态，中期优化最终奖励并探索多样性，晚期稳定收敛以避免过拟合，从而解决了奖励稀疏和时序不匹配问题。

Abstract: Diffusion models have strong generative capabilities. However, their maximum likelihood training objective only focuses on reconstructing the data distribution, making it difficult to align with specific preferences. Reinforcement learning (RL) for preference alignment in diffusion models is promising but limited by reward sparsity. Since a single reward cannot support optimization, existing RL methods usually backpropagate the final reward to all previous steps. However, denoising is stage-wise, with distinct semantics and controllability. Repeating the final reward across all steps creates a temporal objective mismatch, encouraging reward shortcuts that lead to reward hacking. At the same time, due to reward backfilling, each time step receives the same reward, making it impossible to distinguish between actions, thereby weakening the optimization process. To resolve this issue, we propose Stage-Guided Per-Step Optimization (SGPO) for diffusion models, which jointly leverages signal-to-noise ratio and semantic changes to identify generation stages and adaptively assign stage-specific objectives. Early denoising is chaotic and far from the final reward, resulting in weak reward-behavior correlation. This stage should prioritize exiting the chaotic state. In the mid stage, the latent transitions to a stable structure, where the final reward better corresponds to generative behavior. Therefore, this stage optimizes the final reward while exploring diversity to avoid early convergence to a single mode. In the late stage, the latent’s core structure is largely fixed, and preference optimization mainly amplifies local details, risking overfitting. Therefore, stable convergence is preferred to avoid quality degradation. Results from 16 comparative experiments validate SGPO. Our method achieves 26.7% average gains in generative quality and 36.7% higher convergence speed.

[29] GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models cs.CVPDF

Yuanfu Sun, Yuanhang Ren, Kang Li, Chuanhao Ji, Jiaxi Li

TL;DR: 本文提出了GraphVerse，一个用于评估多模态大语言模型（MLLMs）视觉图推理能力的综合基准。该基准通过图中心图像编辑策略生成测试数据，并在单图和图像对两种设置下，联合评估模型的感知、视觉推理和基于文本的图推理能力。

Details

Motivation: 现有评估方法难以深入检验MLLMs是否真正具备对结构化视觉信息（如图）的推理能力，且存在任务简化、场景单一、评估指标不敏感等问题。

Result: 广泛的实验揭示了当前MLLMs在视觉图推理任务上的关键局限性，同时验证了所提出的图中心图像编辑策略的有效性，以及GraphVerse基准在更广泛多模态推理能力上的可迁移性。

Insight: 核心创新点在于提出了一个统一的、过程敏感的视觉图推理评估框架，其通过主动的图像编辑策略来测试模型对图形语义不变性的理解，并设计了超越最终答案准确率的VGR-Score评估指标。

Abstract: Recent Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse vision-language tasks, creating an urgent need for more challenging benchmarks. Yet existing evaluations still provide limited insight into whether these models can truly reason over structured visual information. Visual Graph Reasoning (VGR) offers a compelling testbed for this challenge, requiring models to integrate perception, structural understanding, and multi-step reasoning over graph-based visual inputs. However, prior VGR benchmarks often reduce the task to visual perception followed by text-based reasoning, restrict evaluation to single-image settings, rely on answer-only metrics, and underrepresent realistic graph-centric scenarios. To bridge the gap, we introduce GraphVerse, a unified benchmark that jointly evaluates perception, visual reasoning, and text-based graph reasoning in MLLMs under both single-image and paired-image settings. At its core is a suite of Graph-centric Image Editing (GIE) strategies that modify graph images while preserving their semantics, turning them into active tests of visual reasoning. We further propose VGR-Score, a process-sensitive metric that evaluates reasoning quality beyond final-answer accuracy. Extensive experiments reveal several key limitations of current MLLMs in VGR, while also validating the effectiveness of GIE strategies and the transferability of GraphVerse to broader multimodal reasoning capabilities. The code is available at https://github.com/sunyuanfu/GraphVerse.

[30] AnyTrack: Unifying Visual Object Tracking with Any Modalities cs.CVPDF

Hao Li, Yunzhi Zhuge, Wenning Hao, Pingping Zhang, Xiaoxiong Zhang

TL;DR: 本文提出了一种名为AnyTrack的统一视觉目标跟踪框架，能够处理任意模态组合的输入。该框架通过模态感知交互模块（MIM）促进跨模态动态交互，并利用上下文理解模块（CUM）增强前景-背景判别以实现精确定位。实验表明，AnyTrack在完整和缺失模态设置下均达到了最先进的性能。

Details

Motivation: 现有的多模态跟踪器通常针对固定的模态组合设计，需要为不同输入训练独立模型，导致对模态缺失或不完善的适应性差、泛化能力有限。本文旨在解决这一问题，实现一个能统一处理任意模态的跟踪框架。

Result: 在扩展后的多模态目标跟踪基准（包含灰度图像、语言描述和音频片段）上进行的大量实验表明，AnyTrack在完整和缺失模态设置下均取得了最先进的（SOTA）性能。

Insight: 创新点在于提出了一个统一的、模态无关的跟踪框架，其核心是动态处理任意模态输入的MIM模块和通过全局-局部提示建立空间对应关系的CUM模块。从客观角度看，该工作将多模态跟踪从固定组合范式推广到灵活组合，并构建了更全面的基准，对推动领域发展具有借鉴意义。

Abstract: Visual object tracking aims to continuously locate specific targets within sequential frames, evolving from single-modal methods to multi-modal ones. However, existing multi-modal trackers are typically designed for fixed modality combinations, requiring separate models for different inputs. This leads to a poor adaptability to missing or imperfect modalities, and limited generalization. To address these issues, we propose a novel unified framework called AnyTrack for object tracking with any modalities. Specifically, we design a Modality-aware Interaction Module (MIM) to facilitate dynamic interaction across diverse modalities. This module bridges modality discrepancies and aggregates temporal cues to maintain spatio-temporal consistency during cross-modal interaction. Furthermore, we introduce a Context Understanding Module (CUM) to establish spatial correspondence between visual features and target locations via global-local prompts. This module employs target-aware context modeling to enhance foreground-background discrimination for precise localization. Finally, to support the training and evaluation under diverse modalities, we extend existing multi-modal object tracking benchmarks by incorporating grayscale images, language descriptions, and audio clips. Extensive experiments with both complete and missing modality settings demonstrate that our AnyTrack achieves state-of-the-art performance, validating its effectiveness and flexibility. The source code is available at https://github.com/IdolLab/AnyTrack.

[31] UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow cs.CVPDF

Xianhao Zhou, Jianghao Wu, Shaoting Zhang, Guotai Wang

TL;DR: UniCycleFlow提出了一种基于整流流的双向无配对图像翻译框架，通过单个时间条件速度场的前向和反向积分来表示双向翻译，将两个方向组织在同一连续动力学中。该方法通过对抗匹配学习确定性源条件端点，并引入自流匹配、离散循环闭合和表示路径-速度正则化来优化轨迹。在十个翻译任务中，UniCycleFlow在七个任务上取得了最低的FID分数，平均FID为55.1。

Details

Motivation: 解决双向无配对图像翻译中现有方法通常使用两个方向特定生成器或单独训练单向模型的问题，这些方法仅通过循环一致性约束端点重建，而未要求两个方向遵循共同的局部变换规则。

Result: 在十个翻译方向上，UniCycleFlow使用单个欧拉评估在七个任务上取得了最低的FID分数，并获得了最佳平均FID为55.1，表明其在无配对图像翻译任务中达到了SOTA水平。

Insight: 创新点在于将双向翻译表示为单个时间条件速度场的积分，通过对抗匹配学习端点并引入多种正则化（如自流匹配和循环闭合）来确保轨迹一致性和局部特征控制，这为无监督图像翻译提供了统一的连续动力学框架。

Abstract: Bidirectional unpaired image translation must preserve source-specific structure while learning coherent transformations in both directions without paired supervision. Existing methods typically employ two direction-specific generators or train separate one-way models. Even when linked by cycle consistency, such models constrain only the round-trip endpoint reconstruction, without requiring the two directions to obey a common local transformation rule. We propose UniCycleFlow, a rectified-flow framework that represents bidirectional translation as forward and reverse integration of a single time-conditioned velocity field. This formulation organizes both directions within the same continuous dynamics, rather than coupling otherwise separate endpoint mappings. A key challenge is that unpaired data provide no meaningful source–target coupling from which rectified-flow trajectories can be constructed. UniCycleFlow addresses this challenge by learning deterministic source-conditioned endpoints whose marginal distributions are adversarially matched to the opposite domains. The resulting paths are regularized by stop-gradient self-flow matching for intermediate velocity supervision, discrete cycle closure for forward–reverse consistency, and representation path-velocity regularization for controlling localized feature changes along the trajectory. Across ten translation directions, UniCycleFlow achieves the lowest FID on 7 of 10 tasks using a single Euler evaluation and obtains the best average FID of 55.1.

[32] PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model cs.CVPDF

Renye Yan, Jikang Cheng, You Wu, Wei Peng, Zongwei Wang

TL;DR: 本文提出PAST方法，通过联合感知去噪进度和提示难度，为扩散模型提供差异化奖励并自适应调节训练周期长度，从而提高强化学习微调的效率和偏好优化质量。

Details

Motivation: 针对扩散模型在直接优化下游目标时的局限性，以及现有强化学习方法因低效微调和稀疏奖励而受限的问题，旨在提升优化效率和效果。

Result: 实验表明，PAST将现有RL微调方法的计算效率提升高达66.7%，并通过其双重自适应调节机制将偏好优化质量提升高达29.5%。

Insight: 创新点包括设计内在奖励范式以补偿稀疏外在奖励并引导高效探索，动态监控去噪完成度和语义对齐以自适应终止训练，以及基于预测残差噪声水平建立双重自适应协调机制来平衡奖励与探索收敛。

Abstract: While diffusion models have made significant progress in text-to-image tasks, they still exhibit limitations when directly optimizing downstream objectives. Although Reinforcement Learning (RL) enables targeted optimization, existing methods are generally constrained by low-efficiency fine-tuning and sparse rewards. To address these challenges, we propose PAST, which provides differentiated rewards while adaptively regulating training episode length by jointly perceiving denoising progress and prompt difficulty. Specifically, we design an intrinsic reward paradigm to compensate for sparse extrinsic rewards and guide the model to explore paths that diverge more efficiently from noise patterns. We further provide theoretical justification for intrinsic rewards. Then, PAST dynamically monitors denoising completion and semantic alignment between image structures and prompt semantics. When both metrics satisfy generation requirements, the system adaptively terminates training. This enables appropriate allocation of episode lengths based on prompt difficulty and the current generation process. Finally, based on the predicted residual noise level, we establish a dual adaptive coordination mechanism. Specifically, it not only balances the extrinsic and intrinsic rewards but also balances the exploration and convergence. Experimental results demonstrate that PAST enhances computational efficiency of existing RL fine-tuning methods by up to 66.7%, while improving preference optimization quality by up to 29.5% through its dual adaptive regulation mechanism.

[33] ECAD: Expanding Class-Agnostic Detection Beyond Thing-Centric Objectness cs.CVPDF

Liang Wan, Zixin Ren, Yupeng Zhang, Yuhan Wang, Fangzhuo Gao

TL;DR: 本文提出了扩展类无关检测（ECAD）的新设定，旨在发现超越传统以物体为中心的类无关视觉候选区域。作者构建了BTCO-Bench基准，并提出了基于DETR的轻量级检测器ECADet，通过几何感知专家回归（GAER）和原型引导查询调制（PGQM）来提升对多样化视觉元素的定位和物体性估计。实验表明ECADet在BTCO-Bench上优于现有类无关和基于提议的检测器。

Details

Motivation: 现有物体检测范式主要继承以物体为中心的概念，专注于定位离散可数的物体实例，导致许多对场景理解和空间推理重要的语义视觉元素（如天空、道路、草地）被吸收到背景中。本文旨在扩展类无关检测的范围，以涵盖这些非物体中心的视觉元素。

Result: 在构建的BTCO-Bench基准上，ECADet在真实世界和跨域场景中一致优于代表性的类无关和基于提议的检测器，证明了扩展物体性发现的有效性。

Insight: 创新点包括提出ECAD新设定和BTCO-Bench基准，以及ECADet检测器中的GAER和PGQM模块，分别用于改进定位和物体性估计。从客观角度看，该研究将检测范围从物体实例扩展到更广泛的视觉元素，有助于提升场景理解能力。

Abstract: Object detection is a fundamental task in visual perception, providing structured region representations for recognition, grounding, reasoning, and interaction. However, existing detection paradigms largely inherit a thing-centric notion of objectness, where detectors are mainly trained to localize discrete and countable object instances. Consequently, many semantically meaningful visual elements, such as sky, road, grassland, water, and sports courts, are often absorbed into the background despite their importance for scene understanding and spatial reasoning. In this paper, we formulate Expanded Class-Agnostic Detection (ECAD), a new setting that aims to discover category-agnostic visual candidates beyond conventional thing-centric objects. To support this setting, we construct BTCO-Bench, a Beyond Thing-Centric Objectness benchmark with category-agnostic box annotations covering both real-world and cross-domain scenarios. We further propose ECADet, a lightweight DETR-based detector built upon a frozen DINOv3 encoder, and introduce Geometry-Aware Expert Regression (GAER) and Prototype-Guided Query Modulation (PGQM) to improve localization and objectness estimation for diverse visual elements, respectively. Extensive experiments show that ECADet consistently outperforms representative class-agnostic and proposal-based detectors on BTCO-Bench, demonstrating the effectiveness of expanded objectness discovery. Code and benchmark will be released.

[34] RegionDet: A Benchmark for Region Detection Beyond Object Instances cs.CVPDF

Liang Wan, Yuhan Wang, Yupeng Zhang, Zhen Xu, Han Wang

TL;DR: 本文提出了区域检测任务，旨在超越传统物体实例检测，定位由视觉状态、场景上下文、物体关系和人类活动定义的区域（如施工区、排队区等）。为此，作者构建了RegionDet基准数据集，包含八个区域类别，并采用COCO风格的边界框标注和评估协议。

Details

Motivation: 现有检测基准主要围绕离散、边界清晰的物体实例构建，而现实世界中许多视觉目标（如施工区域、排队人群、交谈区域）是更广泛的区域，现有基准对此类目标的系统评估支持有限。

Result: 在RegionDet上系统评估了代表性的闭集检测器和零样本/开放词汇检测器。结果显示，闭集检测器在监督下能部分学习区域级模式，而零样本/开放词汇检测器表现严重不佳，揭示了当前视觉语言检测器强烈的以物体为中心的偏见。

Insight: 创新点在于定义了区域检测任务并构建了首个专门基准RegionDet，填补了评估非物体实例区域定位能力的空白。分析揭示了区域检测的关键挑战，如弱边界线索、强上下文依赖性和关系级区域理解不足，为未来研究指明了方向。

Abstract: Object detection is a fundamental task in computer vision and has achieved remarkable progress on standard benchmarks by localizing discrete and well-bounded object instances. However, many visual targets in real-world scenarios are not individual objects, but regions defined by visual states, scene context, object relations, and human activities, such as construction areas, damaged road regions, queues, group conversations, and vendor regions. Existing detection benchmarks are mainly built around object instances, providing limited support for systematically evaluating such region targets. To address this gap, we introduce Region Detection, a task that extends conventional object detection beyond object instances, and construct RegionDet, a benchmark for region target localization. RegionDet contains eight region categories, including Construction, Crossing, Damage, Queuing, Talking, Vendor, Waiting, and Walking, with COCO-style bounding-box annotations and evaluation protocols. We systematically evaluate representative closed-set and zero-shot/open-vocabulary detectors on RegionDet. Results show that closed-set detectors can partially learn region-level patterns under supervision, while zero-shot/open-vocabulary detectors struggle severely, revealing the strong object-centric bias of current vision-language detectors. Further analyses highlight key challenges in Region Detection, including weak boundary cues, strong context dependency, and insufficient relation-level region understanding. The RegionDet will be released.

[35] Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection cs.CV | cs.AI | cs.MAPDF

Xuechao Zou, Shun Zhang, Kai Li, Yi Zhou, Xinyu Sun

TL;DR: 本文提出了FaceVid-Forensics-100K大规模深度伪造视频数据集，包含10万个视频和33种合成方法，并提供细粒度文本标注。基于此，作者设计了一个多智能体法证推理框架，利用四个领域专家智能体从纹理、光照、运动和物理四个角度独立分析伪造痕迹，再由一个法官智能体整合报告进行最终预测和解释。

Details

Motivation: 现有深度伪造视频基准覆盖的合成方法有限且缺乏可靠的细粒度文本标注，而传统检测器和多模态大语言模型（MLLMs）通常依赖单一模型或单一分析视角，难以捕捉细微的伪造痕迹，导致对新兴AI生成方法的泛化能力不足。

Result: 在领域外测试集上的广泛评估表明，尽管完全由小型开源MLLMs组成，该框架的性能超过了包括闭源的GPT和Gemini模型在内的所有方法，并在该基准的所有报告指标上排名第一。

Insight: 创新点在于构建了大规模、多方法、带细粒度法证解释的数据集，并提出了一个多智能体协作推理框架，通过多视角专家分析和冲突解决机制来提升检测的鲁棒性和可解释性，为通用化深度伪造检测提供了新思路。

Abstract: The malicious use of generative artificial intelligence to create highly realistic deepfake videos raises serious ethical concerns and poses substantial challenges to AI safety. However, existing deepfake video benchmarks provide limited coverage of recent synthesis methods and generally lack reliable fine-grained textual annotations. Meanwhile, conventional detectors and multimodal large language models (MLLMs), whether operating as a single model or relying on a single analytical perspective, often fail to capture subtle forgery artifacts, limiting their generalization to emerging AI-generated methods. To address these limitations, we introduce FaceVid-Forensics-100K, a large-scale deepfake video dataset comprising 100,000 videos and spanning 33 synthesis methods across face swapping, face reenactment, and entire-face synthesis, including recent generators such as Seedance 2.0. The dataset provides fine-grained textual annotations of visual observations and verdict-consistent forensic explanations, automatically synthesized through a multi-model aggregation and conflict-resolution pipeline powered by advanced MLLMs. Building on this benchmark, we propose a multi-agent forensic reasoning framework that employs four specialized domain-expert agents to independently analyze forgery cues from four perspectives: texture, lighting, motion, and physics. A judge agent then reconciles their reports to produce a final prediction together with an explanation. Extensive evaluations on out-of-domain test sets show that, despite being composed entirely of small open-source MLLMs, our framework outperforms all methods including closed-source GPT and Gemini models and ranks first across all reported metrics on this benchmark. The project page is available at https://xavierjiezou.github.io/ARGUS/.

[36] DAEP: Difficulty-Aware Evidence Planning for Medical Video Corpus Temporal Answer Grounding cs.CV | cs.CLPDF

Tianjian He, Yujie Liu, Zhiping Huang, Changbo Xu

TL;DR: DAEP是BIGC团队为NLPCC 2026共享任务1赛道3（难度感知视频语料库时序答案定位）提出的方法。该方法通过字幕、视觉和过程上下文证据对候选视频进行排序，将高得分锚点扩展为时序片段，并重新排序以输出最终答案。其核心设计是将任务提供的简单/复杂输入标签转化为推理时的证据规划，以控制模态权重、Top-K聚合、边界阈值、扩展长度和重排序强度。

Details

Motivation: 解决医学视频语料库中难度感知的时序答案定位问题，即需要从候选视频中检索目标视频并定位支持答案的时间片段。

Result: 在官方评估中，BIGC在十个系统中排名第一，平均得分为0.2728。验证消融实验表明，视觉证据、过程上下文和难度感知规划提高了排序质量，其中对复杂问题的提升最大。

Insight: 创新点在于将任务提供的难度标签（简单/复杂）显式地转化为一个可控制多模态推理过程的证据规划策略，从而动态调整不同证据源的重要性与聚合方式，以更好地处理不同难度的问题。从客观角度看，这种将元信息（难度）直接整合到推理管道中的设计是一种有效的任务自适应方法。

Abstract: We describe DAEP, team BIGC’s submission to NLPCC 2026 Shared Task 1 Track 3: Difficulty-Aware Temporal Answer Grounding in Video Corpus (DA-TAGVC). The task requires retrieving the target video from 50 candidates and localizing the answer-supporting span. DAEP ranks videos with subtitle, visual, and procedural-context evidence, expands high-scoring anchors into temporal spans, and reranks spans for final output. Its main design is to convert the task-provided simple/complex input label into an inference-time evidence plan controlling modality weights, Top-K aggregation, boundary threshold, expansion length, and reranking strength. In the official evaluation, BIGC ranks first among ten systems with an Average score of 0.2728. Validation ablations show that visual evidence, procedural context, and difficulty-aware planning improve ranking quality, with the largest gain on complex questions.

[37] FedVAR: Prototype-Aligned Federated Framework for Video Anomaly Recognition cs.CV | cs.AI | cs.DC | cs.LGPDF

Ghani Haider, Majid Kundroo, Boyun Eom, Dong Hwan Park, Chen Chen

TL;DR: 本文提出了FedVAR，一个专为视频异常识别设计的弱监督联邦学习框架。该框架利用视觉语言模型的丰富表示，通过原型对齐机制为所有客户端创建共享的语义锚点，以重新校准和对齐其视觉与文本特征空间，从而缓解分布式数据异质性导致的语义错位问题。

Details

Motivation: 在工业物联网和网络物理系统中，联邦学习为视频异常识别提供了去中心化智能范式，但分布式边缘客户端间的数据异质性导致语义错位，即客户端对’正常’和’异常’事件学习到不同的特征表示，现有联邦方法主要关注二元异常检测，无法解决此问题，阻碍了细粒度识别。

Result: 在多种非独立同分布数据划分、未见领域和新异常类别的挑战性基准测试中，FedVAR始终优于最先进的联邦基线方法，为基于视频的网络物理系统建立了鲁棒的分布式智能框架。

Insight: 创新点在于利用视觉语言模型的原型对齐机制，创建共享语义锚点以强制去中心化网络中’正常性’表示的一致性，从而直接缓解语义错位，并以最小通信开销实现异常方向向量的鲁棒提示学习。

Abstract: In the era of Industrial Internet of Things (IIoT) and Cyber-Physical Systems (CPS), Federated Learning (FL) offers a promising decentralized intelligence paradigm for Video Anomaly Recognition (VAR). This task is vital for maintaining high-fidelity Digital Twins and ensuring safety in mission-critical environments. However, the inherent data heterogeneity across distributed edge clients leads to a fundamental challenge known as semantic misalignment, where clients learn divergent feature representations of “normal” and “abnormal” events. The problem becomes particularly pronounced in VAR, where the presence of diverse and fine-grained anomaly categories leads each client to develop distinct semantic interpretations of abnormality. Existing federated methods primarily focus on binary anomaly detection and fail to address this misalignment, preventing effective fine-grained recognition. In this paper, we introduce FedVAR, a weakly-supervised FL framework explicitly designed for VAR. Leveraging the rich representations of Vision-Language Models (VLMs), FedVAR employs a prototype-based alignment mechanism that creates a shared semantic anchor for all clients to re-center and align their visual and textual feature spaces. This process enforces a consistent representation of “normality” across the decentralized network, directly mitigating semantic misalignment and enabling robust prompt-learning of anomaly direction vectors with minimal communication overhead. We conduct extensive experiments on challenging benchmarks under various non-IID data partitioning schemes, unseen domains, and novel anomaly classes. The results demonstrate that FedVAR consistently outperforms state-of-the-art federated baselines, establishing a robust framework for distributed intelligence in video-based CPS.

[38] ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPE cs.CVPDF

Yunkai Yang, Yudong Zhang, Xinying Chen, Haoyuan Liang, Yizhuo Niu

TL;DR: ControlRef提出了一种高效的布局引导多实例生成框架，通过统一的实例-布局控制注意力掩码和锚定4D-RoPE位置编码机制，解决了现有方法在稀疏布局下计算开销大、空间-频率权衡导致绝对空间对应关系模糊的问题，实现了高精度、低延迟的多实例图像合成。

Details

Motivation: 解决多模态扩散变换器中布局引导多实例生成的计算效率低下和空间对应关系模糊问题，现有方法依赖全分辨率画布填充和Shifted-RoPE，导致稀疏布局计算开销大且破坏关键的低频RoPE特征。

Result: 在实验中，ControlRef在视觉保真度和定位精度上达到SOTA水平，同时在稀疏布局下推理延迟降低超过80%，在密集场景下内存开销减少50%。

Insight: 创新点包括：统一的实例-布局控制注意力掩码实现语义交互解耦和区域绑定；锚定4D-RoPE通过将token锚定到绝对几何中心来保持空间先验并缓解空间-频率权衡，无需有损偏移操作。

Abstract: Layout-guided multi-instance generation is essential for controllable image synthesis in Multi-Modal Diffusion Transformers (MM-DiTs). However, integrating this capability into unified architectures remains challenging. Prior frameworks rely on redundant full-resolution canvas padding and Shifted-RoPE to manage multiple reference images. This mechanism drastically inflates computational overhead for sparse layouts and disrupts critical low-frequency RoPE features, creating a severe spatial-frequency compromise that blurs absolute spatial correspondence. To overcome these limitations, we propose ControlRef, a highly efficient and precise multi-instance synthesis framework. ControlRef utilizes a Unified Instance-Layout Control (UILC) attention mask to strictly decouple inter-instance semantic interactions and enforce precise regional binding. To further promote region-level spatial alignment, we introduce Anchored 4D-RoPE, a novel positional encoding mechanism that directly anchors tokens to their absolute geometric centers. By pre-aligning reference images to their corresponding bounding box resolutions, physically anchoring both layout and reference tokens to their absolute geometric centers, and stacking the references along the z-axis, Anchored 4D-RoPE natively preserves spatial priors and mitigates the spatial-frequency compromise without lossy shifting. Extensive experiments demonstrate that ControlRef achieves state-of-the-art visual fidelity and localization accuracy, while concurrently slashing inference latency by over 80% in sparse layouts and reducing memory overhead by 50% in dense scenarios.

[39] Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models cs.CV | cs.LGPDF

Minseok Kang, Hyunwoo Kim, Chanyoung Kim, Minwoo Kim, Jaekoo Lee

TL;DR: 本文提出了一种名为PORTA的无重训练任务无关剪枝框架，用于视觉语言模型（VLM）压缩。该方法基于激活变化推导出任务和模态无关的重要性度量，并通过自适应稀疏分配机制分配层间剪枝比例，从而在高稀疏度下保持下游任务性能，无需任何重训练。

Details

Motivation: 视觉语言模型的计算和内存需求快速增长，在受限环境中部署面临挑战。现有剪枝方法通常依赖任务特定标准或面向LLM的重要性度量，不适用于任务无关剪枝场景（即剪枝时无任务特定样本可用，且剪枝后模型需保持广泛适用性）。

Result: 在CLIP、BLIP、Qwen2-VL等多种VLM架构上的大量实验表明，PORTA在高稀疏度下实现了具有竞争力的下游性能，且无需重训练，支持高效的VLM压缩。

Insight: 创新点在于提出了基于通用校准数据估计的激活变化来构建任务与模态无关的重要性公式，以及根据输出特征变异性自适应分配层间稀疏度的机制，避免了均匀稀疏度的限制，减少了高压缩率下的性能下降。

Abstract: Vision-language models (VLMs) have achieved remarkable generalization across diverse multimodal tasks through large-scale pre-training, yet their rapidly increasing computational and memory requirements pose significant challenges for deployment in constrained environments. Existing pruning strategies often depend on task-specific criteria or LLM-oriented importance measures, making them unsuitable for task-agnostic pruning, where no task-specific samples are available at pruning time and the pruned model remains broadly applicable. We introduce a retraining-free VLM pruning framework called PORTA that derives a task- and modality-agnostic importance formulation based on activation variation, estimated from generic calibration data, which reliably captures feature-level representation utility across modalities. PORTA further incorporates an adaptive sparsity allocation mechanism that assigns layer-wise pruning ratios based on output feature variability, avoiding the limitations of uniform sparsity and reducing performance degradation at high compression levels. Extensive experiments across VLM architectures, such as CLIP, BLIP, and Qwen2-VL, demonstrate that PORTA achieves competitive downstream performance under high sparsity without requiring any retraining, supporting efficient VLM compression. Code is available at https://github.com/cau-hai-lab/PORTA.git.

[40] Vernata: Self-Supervised Learning of LiDAR Point Representations cs.CV | cs.ROPDF

Oliver Lemke, Alexander Liniger, Abel Gawel, Marco Hutter

TL;DR: 本文提出了Vernata，一个用于室外LiDAR点云自监督学习的多模态、多教师蒸馏框架。该方法在Sonata架构基础上引入了稀疏视图增强、内存库机制和跨模态蒸馏三个扩展，以提升模型对点密度变化的鲁棒性、稳定资源受限的训练并利用高分辨率2D图像特征提供细粒度语义指导。

Details

Motivation: 解决室外机器人应用中LiDAR点云标注数据稀缺且成本高昂的问题，通过自监督学习从未标注数据中学习通用特征。

Result: 在GrandTour、TartanGround、Waymo及自有机器人平台数据集上评估。相比Sonata基线，在TartanGround和Waymo数据集上的mIoU分别提升5.9分（+12.1%）和7.3分（+14.7%）。在缺少颜色或法线等模态的简化设置下，仍能取得49.4和50.2的竞争性mIoU分数。

Insight: 创新点在于将稀疏视图增强、内存库和跨模态蒸馏整合到一个自监督框架中，利用2D图像特征指导3D点云学习，有效提升了特征表示能力，并在多模态缺失时仍保持鲁棒性。

Abstract: LiDAR serves as a primary sensing modality for robots operating in outdoor environments. However, the performance of deep learning models in this domain is severely limited by the scarcity of labeled data, a direct result of the high cost of 3D annotation. Self-supervised learning addresses this scarcity by learning general-purpose features from unlabeled data. In this work, we present a multi-modal, multi-teacher distillation framework for self-supervised learning on outdoor LiDAR point clouds. Building upon the Sonata architecture, we introduce Vernata, consisting of three extensions: sparse view augmentation to improve robustness against varying point densities, a memory bank mechanism to stabilize resource-constrained training, and cross-modal distillation utilizing dense, high-resolution 2D image features to enable fine-grained semantic guidance. We evaluate our method on the GrandTour, TartanGround, and Waymo datasets, as well as data collected from our own robotic platforms. Our experiments demonstrate a significant performance improvement over Sonata baselines, yielding mIoU scores of 54.7 on TartanGround (+5.9 points, +12.1%) and 57.1 on Waymo (+7.3 points, +14.7%). Finally, we show that the self-supervised approach maintains strong performance even in reduced-modality settings (lacking color or normals), achieving competitive mIoU scores of 49.4 and 50.2 on the respective datasets.

[41] MuST-VAD: Mutual Structured Learning for Video Anomaly Detection cs.CVPDF

Satoshi Hashimoto, Hitoshi Nishimura, Mori Kurokawa

TL;DR: 本文提出了MuST-VAD，一种用于弱监督视频异常检测（VAD）的互结构化学习框架。该框架通过让异常检测器与大型视觉语言模型（LVLM）相互交换知识，形成一个双向学习循环，从而超越了传统的单向特征迁移方法。

Details

Motivation: 现有弱监督VAD方法通常使用固定的、与任务无关的主干网络提取特征，这限制了检测性能的上限。虽然近期方法尝试将LVLM的语义信息单向迁移给检测器以提供更丰富的特征，但检测器从目标视频中学到的知识却无法反馈给LVLM。

Result: 在UCF-Crime数据集上，该方法的互学习机制将单向迁移基线的AUROC从88.15%提升至88.63%，平均精度（AP）从37.25%提升至42.46%，在AP指标上以4.13个百分点的优势超越了当前最先进的方法。

Insight: 核心创新在于将单向知识迁移扩展为检测器与LVLM之间的双向学习循环，通过交替更新实现知识互惠。具体技术亮点包括使用检测器选择的关键片段进行训练，以及通过置信度加权和基于标注的问答机制来确保交换监督的可靠性。

Abstract: In this paper, we propose MuST-VAD, a mutual structured learning framework for weakly supervised video anomaly detection (VAD) in which an anomaly detector and a large vision-language model (LVLM) exchange their acquired knowledge. Detectors in weakly supervised VAD learn anomaly scores from features extracted by a fixed, task-agnostic backbone. These fixed features bound the achievable detection accuracy. Recent methods therefore transfer LVLM semantics into the detector as richer features. However, this transfer is one-way: what the detector learns about the target videos never returns to the LVLM. MuST-VAD extends the one-way transfer into a bidirectional learning loop. In this loop, the latest detector predictions supervise the LVLM adaptation, and the adapted LVLM returns updated representations that retrain the detector; the two models alternate these updates over small video groups. Both models train on detector-selected key clips, while confidence weighting and annotation-anchored question answering keep the exchanged supervision reliable. On UCF-Crime, our mutual learning improves the one-pass transfer baseline from 88.15% to 88.63% AUROC and from 37.25% to 42.46% average precision (AP), outperforming the state-of-the-art method in AP by 4.13 points.

[42] AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Reward cs.CVPDF

Mingyang Wu, Kaituo Feng, Bohao Li, Kaixiong Gong, Zihao Yin

TL;DR: 本文提出了AVCap系统，旨在解决细粒度音视频联合描述任务中的三大挑战：高质量数据集稀缺、强化学习奖励信号粗糙以及缺乏原子级评估基准。为此，作者构建了包含10万条时序对齐、细节丰富的音视频描述数据集AVCap-100K，开发了基于Detail-Aware GRPO优化的AVCap模型，并设计了专门的评估基准AVCap-Bench与度量标准AVCap-Score。

Details

Motivation: 当前音视频联合描述任务面临高质量数据集不足、强化学习方法依赖粗粒度奖励信号以及缺乏原子级细节评估基准的问题，限制了细粒度多模态视频理解与生成的发展。

Result: AVCap模型在开源模型中达到SOTA性能，并在多项评估中匹配或超越了专有模型；具体结果基于新提出的AVCap-Bench基准和AVCap-Score度量进行验证。

Insight: 创新点包括构建大规模高质量音视频描述数据集、引入细粒度感知的强化学习优化方法（Da-GRPO）以及建立原子级细节评估体系，为多模态描述任务提供了数据、模型和评估的全栈解决方案。

Abstract: Detailed audio-video joint captioning is essential for multimodal video understanding and generation. However, prior works are constrained by three main limitations: (1) the scarcity of high-quality public datasets with fine-grained audio-visual joint captions; (2) reinforcement-learning methods that rely on coarse reward signals; and (3) the lack of a benchmark and metric for evaluating detailed audiovisual captions at the atomic level. To address these challenges, we propose: (1) AVCap-100K, a high-quality dataset of 100K temporally aligned, detail-rich audio-video captions; (2) AVCap, a model optimized via Detail-Aware GRPO (Da-GRPO) that achieves state-of-the-art performance among open-source models and matches or surpasses proprietary models on several evaluations; and (3) AVCap-Bench and AVCap-Score, a specialized benchmark and metric for evaluating atomic-level details in audiovisual captions. Our code, models, and datasets are available at https://huggingface.co/collections/Apryle/avcap.

Chen Ling, Hanqian Li, Dongnan Liu, Keyu Qian, Jungang Li

TL;DR: 本文提出了一种文本锚定的后训练框架TACT，用于解决多模态大语言模型在视觉反常识推理中的语言先验偏差问题。研究发现，模型失败并非源于视觉感知不足，而是共享语言解码器倾向于依赖语言先验而非视觉证据。通过构建高质量文本语料库并进行分阶段优化，TACT实现了从文本到视觉的有效跨模态迁移，显著提升了反常识推理能力。

Details

Motivation: 针对多模态大语言模型在视觉反常识推理中表现不佳的问题，现有研究通常假设失败源于视觉基础不足，但本文通过实证分析发现，瓶颈在于共享语言解码器在处理低频事实场景时，倾向于依赖主导的语言先验而非视觉证据，导致先验与证据冲突。

Result: 在多个反常识视觉基准测试中，TACT框架显著提升了视觉推理性能，同时保持了模型的通用能力，实现了有效的文本到视觉跨模态迁移。

Insight: 创新点在于揭示了视觉反常识推理的瓶颈是语言解码器的先验偏差而非视觉感知，并提出了基于文本锚定的数据构建流程（含事实频率蒸馏FFD）和后训练框架TACT，通过纯文本数据对解码器进行去偏，无需视觉训练数据即可实现跨模态能力提升。

Abstract: The visual reasoning ability of multimodal large language models (MLLMs) is crucial for downstream applications, particularly counter-commonsense reasoning, which requires models to reason beyond common assumptions. Recent studies mainly improve visual counter-commonsense reasoning by enhancing visual inputs, following the assumption that failures originate from insufficient visual grounding. However, our empirical analysis reveals that the bottleneck is not visual perception. MLLMs already capture the relevant visual evidence, and the correct answer exists in their decoding space. Instead, the shared language decoder resolves prior–evidence conflicts by favoring dominant language priors, especially for low-frequency factual scenarios. Motivated by this, we first propose a text-anchored data construction pipeline, whose core component, Fact-Frequency Distillation (FFD), estimates the prior strength of commonsense facts and distills verified counter-commonsense scenarios into a high-quality text corpus. Building upon this corpus, we introduce TACT, a text-anchored post-training framework that debiases the shared language decoder without requiring any visual training data. TACT routes evidence-following and prior-driven reasoning trajectories into different optimization stages, enabling the decoder to resolve prior–evidence conflicts. Across counter-commonsense visual benchmarks, TACT substantially improves visual reasoning while preserving general capabilities, demonstrating effective text-to-vision cross-modal transfer.

Wanshu Fan, Yunzhe Zhang, Yue Shen, Liyan Wang, Jing Qin

TL;DR: 本文提出了一种名为DCMPC-Net的退化感知跨模态提示补偿网络，用于恶劣天气下的图像复原。该方法利用预训练视觉-语言模型的跨模态退化线索，在统一骨干网络中通过生成退化感知提示、引导注意力对齐和双特征补偿，实现对多种天气退化类型的鲁棒恢复。

Details

Motivation: 现有的一体化复原模型在处理多种天气退化时，缺乏对退化特征显式的空间和语义建模，限制了其适应不同天气条件的能力。本文旨在通过引入跨模态语义指导来解决这一局限性。

Result: 大量实验表明，DCMPC-Net在特定任务和统一设置下均优于现有最先进方法，在准确性和视觉保真度上达到了SOTA水平。

Insight: 创新点在于将预训练视觉-语言模型的跨模态语义信息（文本嵌入）与视觉特征结合，生成编码退化语义的提示，并以此引导注意力对齐和结构增强。这为图像复原任务提供了一种新的、利用外部语义知识进行退化感知和条件化建模的思路。

Abstract: Adverse weather causes diverse and complex image degradations, severely compromising the reliability of computer vision systems. Existing all-in-one restoration models attempt to address multiple degradation types within a unified framework, but often lack explicit spatial and semantic modeling of degradation characteristics, limiting their adaptability to diverse weather conditions. To address this limitation, we propose a Degradation-Aware Cross-Modal Prompt Compensation Network (DCMPC-Net) that leverages cross-modal degradation cues from a pretrained vision-language model to condition restoration features within a unified backbone. Specifically, our DCMPC-Net mainly consists of the Cross-Modal Prompt Generator (CMPG), Prompt-Guided Attention Alignment Module (PGAAM), and Dual Feature Compensation Module (DFCM). The CMPG integrates textual embeddings with visual features to produce degradation-aware prompts that encode degradation-related semantic and contextual cues. These prompts are injected into the decoder via a PGAAM, which adaptively aligns semantic information with degraded regions to facilitate context-aware restoration. To further enhance structural fidelity, DFCM is introduced that disentangles degradation artifacts from scene structures, thereby improving the reconstruction of fine textures and detailed content. By integrating cross-modal semantic guidance with spatial alignment and structural enhancement, DCMPC-Net achieves robust and perceptually consistent restoration across diverse weather conditions. Extensive experiments show that DCMPC-Net outperforms state-of-the-art methods in both task-specific and unified settings, achieving superior accuracy and visual fidelity.

[45] Summarize First, Download Later: Onboard VLMs for Bandwidth-Efficient Earth Observation cs.CVPDF

Junghwan Park, Sangcheol Sim, Woojin Cho, Darongsae Kwon

TL;DR: 本文提出了一种名为’先总结后下载’的新范式，利用星载边缘计算和视觉语言模型（VLM），通过自然语言摘要和视觉问答（VQA）的交互协议，有选择性地下载高分辨率遥感图像，旨在解决卫星下行链路带宽瓶颈问题。

Details

Motivation: 现代地球观测卫星传感器产生海量高分辨率数据，但下行链路容量有限，导致数据延迟或丢失，成为关键瓶颈。

Result: 在资源受限的NVIDIA Jetson平台上实现的系统，在多样化遥感场景实验中，显著降低了带宽消耗，并加速了时间敏感任务的分析速度。

Insight: 将卫星下行链路从被动批量传输转变为主动的、语义感知的对话，利用量化星载VLM生成摘要和进行VQA验证，是系统核心创新；其工程实现（在边缘设备部署）对资源受限场景具有借鉴意义。

Abstract: Modern Earth observation (EO) satellites carry increasingly advanced sensors that produce vast volumes of high-resolution, multispectral data, yet downlink capacity remains a critical bottleneck – often causing significant latency or the loss of valuable observations within limited contact windows. We propose a “Summarize First, Download Later” paradigm that exploits recent advances in onboard edge computing and Vision-Language Models (VLMs). Rather than indiscriminately downlinking raw imagery, the system follows a three-phase interaction protocol: the satellite first transmits concise natural language summaries generated by a quantized onboard VLM; ground operators then issue targeted Visual Question Answering (VQA) queries to verify scene relevance (e.g., wildfires or maritime anomalies); and full-resolution images are downloaded only when critical information is confirmed. This transforms the downlink from passive bulk transfer into an active, semantics-aware dialogue. We implement and evaluate the system on a resource-constrained NVIDIA Jetson platform, and experiments on diverse remote sensing scenes show that the proposed strategy substantially reduces bandwidth consumption while accelerating time-to-insight for time-sensitive missions.

[46] Generative Embedding Benchmark: How Much Information Survives in a Dense Embedding? cs.CVPDF

Yun Li, Biao Yang, Peixi Wu, Yunhao Zhou, Mingzhou Jiang

TL;DR: 本文提出了生成式嵌入基准（GEB），用于评估嵌入表示中保留的生成信息量。该基准通过冻结嵌入和问题文本让解码器回答问题，衡量嵌入中可恢复的答案相关内容。研究评估了七种公开嵌入模型，发现基于视觉语言模型的联合编码表现最佳，并揭示了基于可分性的评估无法捕捉的信息瓶颈。

Details

Motivation: 现有嵌入基准主要关注判别性任务或嵌入空间可分性的几何标准，但无法评估嵌入中压缩的内容是否对下游生成器可访问。为解决这一空白，需要一种衡量嵌入中生成信息可恢复性的评估方法。

Result: 在GEB测试集上，纯视觉嵌入模型得分在28.25至33.21之间；而基于视觉语言模型的联合编码模型得分更高，最佳模型达到65.56。匹配嵌入的表现优于纯文本输入、零嵌入和随机嵌入，但低于能访问原始图像的Qwen3-VL-2B参考模型（84.30）。

Insight: 创新点在于提出了首个专注于生成信息可恢复性的嵌入评估基准GEB，通过解码器读出的范式揭示了传统可分性评估忽略的信息瓶颈。该方法能更全面地评估嵌入表示的实际效用，特别是在需要内容生成的场景中。

Abstract: Embeddings have emerged as a standard representational interface linking foundation models with downstream systems. Most embedding benchmarks assess representations through discriminative tasks or geometric criteria centered on separability in embedding space. However, strong performance on such evaluations does not establish whether content compressed into an embedding remains accessible to a downstream generator. To address this gap, we introduce the Generative Embedding Benchmark (GEB), in which a decoder answers questions using only a frozen embedding and question text, without access to the original image or intermediate visual features. Answer quality under this readout measures generative information: the answer-relevant content recoverable from an embedding. GEB includes a curated visual-question-answering dataset with a 1,800-item development split and a held-out 900-item test split covering natural images, scene text, and visual documents. Using a common decoder and training recipe, we evaluate seven public embedding models in visual-only and vision-language joint modes. On the test set, visual-only scores range from 28.25 to 33.21; with image-question joint encoding, all five VLM-based embedding models score higher, and the best reaches 65.56. Matched embeddings also outperform text-only inputs, zero embeddings, and shuffled embeddings. Natural-image information is much easier to recover than scene text or visual-document information, while a Qwen3-VL-2B reference with access to the original image reaches 84.30. Together, these results show that generative readout exposes information bottlenecks that separability-based evaluation does not capture.

[47] When One Modality Is Not Enough: Multimodal Sex and Life-Stage Classification of Red Deer from Aerial RGB-Thermal Video cs.CVPDF

Hugo Markoff, Christoph Praschl, Ivan Ludoški, Sara Beery, Michael Ørsted

TL;DR: 本文提出了一种基于RGB和热成像双模态融合的无人机航拍视频分析流程，用于对马鹿进行物种、性别和生命阶段的自动分类。该方法通过自监督DINOv3特征融合两种模态，结合跟踪、确认和投票机制，显著提升了在复杂环境下的分类准确率。

Details

Motivation: 野生动物种群调查需要超越单纯计数，获取物种组成、性别比例和年龄结构等关键种群动态信息。然而，单模态（RGB或热成像）在特定条件下（如树冠下或细节丢失）会失效，因此需要融合多模态信息以提高鲁棒性。

Result: 在覆盖鹿角季节的四次飞行数据中，融合双模态的流程正确分类了26个检测个体中的25个（7/8成年雄性，16/16成年雌性，2/2幼年），而单模态仅正确分类20个。多模态物种分类准确率达96.0%，性别分类中RGB+热成像融合模型在不同环境和季节下最为鲁棒。

Insight: 创新点在于将RGB与热成像在多个处理阶段（特征提取、跟踪确认、分类投票）进行深度融合，并利用自监督视觉特征（DINOv3）增强表征能力。客观来看，其“仅当双摄像头一致时才确认动物”的决策机制，以及将生命阶段（体型）与性别（外观）分开判读的策略，是提升系统可靠性的关键设计。

Abstract: Aerial drone surveys increasingly support wildlife population estimation, yet a useful census is more than a count: population dynamics are defined by species composition, sex ratios and age structure, that is, by which species are present and how a herd splits into adult males, adult females and juveniles. We use red deer ($\textit{Cervus elaphus}$) as a test case, because managers act on these dynamics and because the visible cue defining adult males, the antlers, is seasonally variable. Surveys are flown nadir, high enough not to disturb the animals, so each deer occupies only a small, low-resolution patch. The two recording modalities fail in opposite conditions: in color a deer under canopy blends into the ground, while in thermal it becomes a bright blob that loses fine detail. Rather than trust either modality alone, we fuse them at every stage using self-supervised DINOv3 features. Our pipeline tracks animals in both modalities, treats an animal as confirmed only when the two cameras agree, keeps only the clear, non-occluded frames, and assigns species and sex by a vote across them; life stage is read separately from geo-referenced body size, since at survey resolution a juvenile often only differs from an adult female in size. Across four flights spanning the antler season the fused pipeline correctly classifies 25 of the 26 detected individuals (7 of 8 adult males, all 16 adult females and 2 juveniles), against 20 of 26 for either sensor alone. Multimodal species classification reaches 96.0%, while for sex classification fusing the two sensors matters most: the combined RGB+thermal model is the most robust across environments and seasons. Automating the demographic classification turns a drone flight from a count into a repeatable reading of herd structure, so the sex ratios and age structure that managers already act on can be gathered as often as a survey can be flown.

[48] Scenix: Sparse-View 3D Scene Reconstruction via Executable Scene Programs cs.CVPDF

Kai Li, Lutao Jiang, Zhenyang Li, Jiayu Dong, Jierui Zhang

TL;DR: 本文提出了Scenix框架，用于从稀疏的未标定RGB图像中重建可编辑的3D室内场景。该方法通过预测可执行的场景程序（一种结构化表示），并利用基于感知的资产实例化和闭环空间优化来实现场景重建。

Details

Motivation: 现有方法主要依赖文本输入或连续视觉输入及额外先验（如人工标注掩码或精确3D布局），这导致其费力且难以通用。本文旨在解决从少量视图推断房间结构、跨不完整观测关联对象并恢复全局一致空间配置的挑战。

Result: 在构建的包含约11万合成和真实室内场景的数据集上进行了实验，并在XScene场景、真实室内图像和分布外SpatialGen案例上评估了结构化场景预测、对象定位和空间优化性能。

Insight: 创新点在于引入可执行场景程序作为结构化表示，支持直接实例化为可编辑3D场景，并提出了基于感知的资产实例化和闭环空间优化流程，以及观察一致性的监督方法，以对齐目标场景与输入视图的视觉证据。

Abstract: Synthesizing a structured and editable 3D indoor scene from a few uncalibrated RGB views requires more than generating high-quality individual assets: a system must infer the room structure, associate objects across incomplete observations, and recover a globally consistent spatial configuration. Previous methods mainly focus on 3D scene generation with text input or require continuous visual inputs with additional priors, \ e.g., human-annotated masks or accurate 3D layouts, which makes these methods labor demanding and hard to apply in general cases. We present \textsc{Scenix}, a sparse-view 3D scene reconstruction framework via executable scene programs, a structured representation that can be directly instantiated into editable 3D scenes. Given sparse views, \textsc{Scenix} predicts executable scene programs through perception-grounded asset instantiation and closed-loop spatial refinement. % We present \method, a framework that predicts an executable scene representation from sparse views and realizes it through perception-grounded asset instantiation and closed-loop spatial refinement. To support this task, we construct \dataset, a dataset of approximately 110,000 synthetic and real indoor scenes with multiview imagery, room structures, object-centric descriptions, and metric spatial annotations. We further introduce observation-consistent supervision that aligns each target scene with the visual evidence available in its input views. Experiments on held-out \textsc{XScene} scenes, real indoor images, and out-of-distribution SpatialGen cases evaluate structured scene prediction, object grounding, and spatial refinement.

[49] Stable Curves, Unstable Items: Item-Level Scaling Heterogeneity in Video LLMs cs.CVPDF

Wenzhang Sun, Chunfeng Wang, Xiangchen Yin, Yujia Chen, Hao Li

TL;DR: 本文揭示了视频大语言模型在项目级别存在显著的缩放异质性：尽管总体性能曲线随视觉预算增加而平滑提升或饱和，但单个项目的表现却可能出现大幅波动甚至倒退。研究通过分析五个开源视频大语言模型在多项任务上的响应轨迹，发现不存在单一视觉预算能优化所有项目，并量化了项目级性能互补、有害转换和文本覆盖等现象。

Details

Motivation: 动机在于挑战传统基于聚合缩放曲线的评估视角，揭示视频大语言模型在项目级别存在的性能不稳定问题，即增加视觉输入资源（如帧数、分辨率）可能导致部分项目性能下降而非提升。

Result: 在四项多选问答基准测试中，项目级理论性能提升空间达8.8-18.9个准确率点，12.5%-25.5%的项目在较低预算下正确而在较高预算下错误；在开放生成任务（MLVU和AVSD）中，Token-F1的理论差距达2.7-4.8分。提出的置信度级联方法在保持固定128帧准确率的同时，将平均共享帧成本降低了31.7%。

Insight: 创新点在于提出项目级响应轨迹分析方法，量化了视觉预算增加对单个项目的非线性影响，并开发了可复现的审计框架。研究揭示了模型架构无关的普遍异质性现象，为动态资源分配和模型优化提供了新视角。

Abstract: Aggregate scaling curves suggest that Video LLMs improve smoothly or saturate as visual budgets grow. We show that this view can conceal large, opposing changes at the item level. We represent each frozen model–item pair by its response trajectory under controlled visual budgets and derive matched-grid measures of configuration complementarity, harmful transitions, and text overwrite. Across five open Video LLMs from three architecture families, four multiple-choice benchmark splits, open-ended QA and summarization, and fixed-history dialogue generation, no single budget serves all items. On the four-model matched MCQA grid, item-level oracle headroom spans $8.8$–$18.9$ accuracy points and $12.5$–$25.5%$ of items are correct at a lower budget but wrong at a higher one. Task-appropriate continuous metrics show the same complementarity beyond multiple choice: Token-F1 oracle gaps are $2.7$–$3.7$ score points on MLVU generation and $3.8$–$4.8$ points on AVSD current-turn generation, even when mean quality improves with budget. The effect persists across frame count, spatial resolution, sampling policy, temporal–spatial allocation, and independently executed raw-video and cached pipelines, with per-item rates and membership tracking protocol choices. A controlled sampling intervention recovers $29.0%$ of terminal regressions, and a structured frame audit identifies several recurring evidence pathways. We release per-item trajectories, protocol provenance, derived annotations, and reproducible analysis code as an auditing artifact. A confidence cascade matches fixed-$128f$ accuracy while reducing average shared frame cost by $31.7%$, illustrating one operational use of the response matrix.

[50] Understand Before Detect: Vision–Language Learning for Omni-Domain Infrared Small Target Detection cs.CVPDF

Haoyang Yuan, Boyang Li, Yingqian Wang, Yimian Dai, Nuo Chen

TL;DR: 本文提出了一种名为‘理解先于检测’的新范式，用于解决全领域红外小目标检测中因成像域异质性和目标特征不一致导致的挑战。作者构建了JinSight模型，该模型通过语言监督实现整体红外目标理解，并将学习到的跨域表征迁移到精确的小目标检测任务中。同时，论文还发布了首个大规模、多样化的视觉-语言数据集OmniIRST-VL，以支持该领域的研究。

Details

Motivation: 现有深度学习方法通常遵循任务特定的监督学习范式，将全场景红外观测简化为稀疏的目标监督，丢弃了跨异质域保持不变的语义信息，导致在领域偏移下检测性能显著下降。因此，需要一种能够理解整体红外场景并实现跨域泛化的新方法。

Result: 论文构建了OmniIRST-VL数据集，包含超过39k个标注，涵盖六个互补的指令任务。JinSight模型通过语言对齐的全局语义与细粒度空间特征在紧凑低秩空间中的交互（LSI），实现了在异质红外域上的泛化能力，但摘要中未提及具体的定量结果或与现有SOTA的比较。

Insight: 创新点在于将全领域红外小目标检测重新定义为理解驱动的过程，通过语言监督学习跨域不变语义，并提出了Latent Semantic Interaction机制来融合语言语义与视觉特征。这为多模态目标检测提供了可借鉴的思路，即利用语言先验知识增强模型对复杂视觉场景的理解和泛化能力。

Abstract: Omni-domain infrared small target (IRST) detection is crucial for infrared surveillance, yet remains challenging due to heterogeneous imaging domains and inconsistent target characteristics. Previous deep learning-based methods have been developed for visual-only paradigms and achieved promising performance on domain-specific tasks. However, existing methods follow the task-specific supervised learning paradigm. This paradigm simplifies the full-scene infrared observations to sparse target supervision, discarding the semantics that remain invariant across heterogeneous domains. Consequently, detection performance suffers substantially under domain shifts. To handle this issue, we introduce \textbf{``understand before detect’’}, a paradigm that formulates omni-domain IRST detection as an understanding-driven process, where holistic infrared target understanding precedes precise detection. Building on this paradigm, we propose \textbf{JinSight}, which first develops holistic IRST understanding through language supervision and then transfers the learned cross-domain representations to precise small-target detection. By grounding infrared representations in language semantics, JinSight enables a single model to generalize across heterogeneous infrared domains. We then introduce Latent Semantic Interaction (LSI), which exchanges language-aligned global semantics with fine-grained spatial features in a compact low-rank space. To address the lack of multimodal omni-domain IRST benchmarks, we build \textbf{OmniIRST-VL}, the first large-scale, highly diverse vision–language dataset for omni-domain IRST detection. It comprises over 39k annotations across six complementary instruction tasks covering both scene-level understanding and target-centric reasoning.

[51] Explanation Stability of Test-Time Adaptation in Computational Pathology: A Large-Scale Benchmark cs.CVPDF

R. G. Bahumanya, Harshith V. M., Shreyank N. Gowda, Anala M. R

TL;DR: 本文研究了计算病理学中测试时适应（TTA）方法对模型解释稳定性的影响，通过大规模基准测试发现TTA方法在保持解释稳定性方面存在显著差异，且解释稳定性与适应质量仅弱相关，揭示了仅依赖准确性评估可能忽略的‘静默失败’风险。

Details

Motivation: 在计算病理学中，染色、扫描仪和队列偏移是常见问题，TTA被用于将已部署模型适应到未标记目标数据，但现有评估主要关注准确性，临床应用中模型解释的可靠性同样关键，而这一影响尚未被充分衡量。

Result: 在Camelyon17和NCT CRC-HE两个组织病理学基准上，使用五种架构（从卷积网络到视觉Transformer和病理学基础模型）、十七种TTA方法和四种归因家族进行了2,958次适应运行，结果显示冻结主干的方法几乎不改变归因，而CoTTA和RoTTA等持续方法导致最大漂移，卷积网络比Transformer和基础模型主干更敏感。

Insight: 创新点在于首次系统评估TTA在计算病理学中的解释稳定性，提出解释稳定性是TTA的一个独立可靠性维度，揭示了准确性评估可能掩盖模型解释漂移的‘静默失败’，为开发既准确又稳定、可临床审计的适应方法提供了新基准和协议。

Abstract: Test-time adaptation (TTA) has become a practical way to adapt deployed models to unlabeled target data, a setting that is especially relevant in computational pathology where staining, scanner, and cohort shifts are routine. While most TTA methods are evaluated by their effect on accuracy, clinical use also depends on whether the model’s explanations remain reliable after adaptation. In this paper, we take a closer look at this largely unmeasured effect. We study explanation stability under TTA across two histopathology benchmarks, Camelyon17 and NCT CRC-HE, using five architectures ranging from convolutional networks to vision transformers and a pathology foundation model, seventeen TTA methods, and four attribution families. Across 2,958 adaptation runs, we observe a clear and systematic pattern: TTA methods differ sharply in how much they move model explanations, with frozen-backbone methods leaving attributions almost unchanged and continual methods such as CoTTA and RoTTA causing the largest drift. This effect is not uniform. Convolutional networks are substantially more sensitive than transformer and foundation-model backbones, and explanation drift increases with adaptation strength while remaining largely insensitive to batch size. Surprisingly, explanation stability is only weakly coupled to adaptation quality. Some methods preserve explanations almost perfectly while degrading calibration or accuracy, producing silent failures that would be missed by accuracy-only or explanation-only evaluation. These findings show that explanation stability is a distinct reliability axis for TTA in computational pathology. We release the metric, protocol, and full benchmark to support future work on adaptation methods that are not only accurate, but also stable and clinically auditable. Code: https://github.com/bahumanyarg11/tta-explanation-stability-pipeline

[52] RoRA: Role-Oriented Regional Allocation for Visual Token Pruning in MLLMs cs.CV | cs.AIPDF

Qiyanhui Lu, Han Wu, Rongjian Xu, Tingzhang Luo, Cheng Fan

TL;DR: 本文提出RoRA，一种无需训练的视觉令牌剪枝框架，用于多模态大语言模型（MLLMs）。它将视觉令牌剪枝视为面向角色的区域证据分配，将令牌划分为受保护的语义核心、补充上下文和细粒度细节，以在固定预算下优化令牌选择。

Details

Motivation: MLLMs将图像编码为长视觉令牌序列，导致预填充和KV缓存存储成本高昂。现有无需训练的剪枝方法将保留令牌视为可互换的，且未明确跟踪已覆盖的对象相关区域，RoRA旨在解决这一问题。

Result: 在匹配的预算下，RoRA在LLaVA和Qwen-VL系列模型上始终优于强无需训练的基线方法，例如在LLaVA-1.5上以88.9%的剪枝率保留了96.5%的完整性能，在Qwen3-VL上以75-90%的剪枝率比D2Pruner提升约5%。在66.7%的剪枝率下，RoRA仅需0.7毫秒进行令牌选择，并将端到端推理时间减少24.6%，实现1.33倍的加速。

Insight: 创新点在于将视觉令牌剪枝框架化为角色导向的区域分配，引入注意力锚定区域（AARs）作为覆盖对象支持的轻量级代理，并结合位置先验和提示校准的对象先验进行文本条件注意力的校准，从而更有效地保留关键语义信息。

Abstract: Multimodal large language models (MLLMs) encode images as long visual token sequences, making prefilling and KV-cache storage expensive. Existing training-free pruning methods select tokens by importance, diversity, or spatial coverage, but treat retained tokens as interchangeable and do not explicitly track which object-related regions are already covered. We present RoRA, a training-free framework that casts visual token pruning as role-oriented regional evidence allocation. Given a fixed budget, RoRA partitions tokens into a protected semantic core, complementary context, and fine-grained detail. It first calibrates text-conditioned attention with a positional prior and a prompt-calibrated object prior, then builds Attention-Anchored Regions (AARs) from high-confidence anchors as lightweight proxies for covered object support. Context is explored mainly outside AARs, while a small AAR-guided budget restores local detail; pairwise similarity is used only for context-stage redundancy filtering. Under matched budgets, RoRA consistently outperforms strong training-free baselines across LLaVA and Qwen-VL families, retaining most of the unpruned accuracy even at aggressive pruning ratios, e.g., 96.5% of full performance at 88.9% pruning on LLaVA-1.5, and improving over D2Pruner by about 5% on Qwen3-VL at 75-90% pruning. At a 66.7% pruning ratio, RoRA requires only 0.7 ms for token selection and reduces end-to-end inference time by 24.6%, corresponding to a 1.33x speedup over unpruned inference on an NVIDIA H800.

[53] Geometry-Aware Camera Localization for Bronchoscopy cs.CV | cs.AIPDF

Lumin Chen, Qingyao Tian, Jinpeng Li, Haoyu Jiang, Huai Liao

TL;DR: 本文提出了一种几何感知的支气管镜相机定位框架（GABL），通过融合术前结构先验与术中视频来估计6自由度相机位姿。该方法采用图引导的由粗到细定位方案来处理复杂气道中的视觉模糊性，并集成了基于Transformer的跟踪模型与新颖的RGB-深度匹配目标，以减轻位姿抖动并弥合视觉-结构差距。实验表明，该方法在平移和旋转误差上显著优于现有最佳方法，并实现了实时推理速度。

Details

Motivation: 支气管镜相机定位面临精度要求高、实时性约束强以及训练数据有限等挑战，现有方法未能有效利用术前几何先验，限制了其鲁棒性和准确性。

Result: 在相关基准测试中，该方法将平移和旋转误差分别降低了8.37%和31.76%，优于先前的最先进方法（SOTA），同时推理速度达到33.6 FPS，实现了4倍的加速，满足实时定位需求。

Insight: 创新点在于提出了一个统一框架，将术前结构先验与术中视频有效融合，并通过图引导的由粗到细定位及结合Transformer的跟踪模型与RGB-深度匹配目标，增强了几何一致性，提升了定位精度和实时性。

Abstract: Camera localization in bronchoscopy remains a challenging problem due to stringent accuracy requirements, real-time constraints, and limited training data. Compared to natural scenes, the confined anatomical structures demand millimeter-level precision, while intraoperative guidance necessitates low-latency inference. However, existing methods often fail to effectively exploit preoperative geometric priors, limiting their robustness and accuracy. To address these limitations, we propose a unified geometry-aware bronchoscope localization framework (GABL) that effectively fuses preoperative structural priors with paired intraoperative video to estimate 6-DoF camera poses. Specifically, to address visual ambiguity in complex airways, we propose a graph-guided coarse-to-fine localization scheme that effectively leverages structural priors for precise pose estimation. Furthermore, to mitigate pose jitter and bridge the visual-structural gap, we integrate a Transformer-based tracking model with a novel RGB-depth matching objective, jointly enforcing spatio-temporal and geometric consistency. Extensive experiments demonstrate that our method yields remarkable reductions of 8.37% and 31.76% in translation and rotation errors over the prior state-of-the-art, alongside 4 times inference speedup (33.6 FPS) for robust real-time bronchoscope localization. Project website: https://paulili08.github.io/GABL/.

[54] Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity cs.CVPDF

Zibo Su, Jing Kong, Ruixing Wang, Zhanhe Zhang, Kun Wei

TL;DR: 本文提出了一种多假设光流估计框架来解决视频帧插值中的匹配模糊问题。该方法通过保留前K个候选匹配并使用可靠性引导的路由器选择每个位置的最佳假设，从而在模糊区域生成更准确的中间帧。

Details

Motivation: 传统基于光流的视频帧插值方法在模糊区域（如重复纹理、对称结构或快速运动）中，由于匹配证据存在多个峰值，单流估计器可能选择错误匹配，导致重影和结构失真。

Result: 在提出的MA-HD基准和公共VFI基准测试中，该方法在LPIPS和DISTS指标上达到了最佳性能，优于对比方法。

Insight: 创新点在于将单流估计扩展为多假设流估计，通过可靠性引导的路由机制动态选择最佳匹配，避免了模糊区域中软组合候选运动导致的合成伪影。

Abstract: Many flow-based video frame interpolation (VFI) methods synthesize an intermediate frame by estimating optical flow fields, warping the two input frames, and blending the warped observations. These latent flow fields are typically learned through image-level reconstruction supervision without direct flow annotations. In ambiguous regions containing repetitive or stochastic textures, rotating symmetric structures, or fast motion with blur, the matching evidence for a single query may contain multiple comparable and spatially separated peaks. Although the ground-truth intermediate frame provides indirect supervision, it may not uniquely identify the latent correspondence in ambiguous regions.When several locations provide multiple plausible matches, a single-flow estimator can retain only one displacement and discard the remaining candidates. If the selected match is incorrect or inconsistent with those of neighboring pixels, warping samples content from mismatched locations, producing ghosting, structural distortion, or blur.To address this limitation, we propose a multiple hypothesis flow estimation framework that preserves top-K candidate correspondences and selects one per location through a reliability-guided router. Each hypothesis is initialized from a coarse matching anchor and refined separately through anchor-centered local attention. Frame synthesis is thus conditioned on one selected flow-appearance hypothesis rather than a soft combination of candidate motions.Experiments on the proposed MA-HD benchmark and public VFI benchmarks show that our method achieves the best LPIPS and DISTS among the compared methods.

[55] Beyond Fluency: A Clinical Benchmark and Anomaly-Enhanced Baseline for Spine MRI Report Generation cs.CVPDF

Bruno Palau, Franziska Vogt, Daria Laslo, Haobo Li, Ender Konukoglu

TL;DR: 本文针对腰椎MRI报告生成任务，评估了现有视觉语言模型（VLMs）的表现，发现标准评估指标（如词汇和语义相似度）无法有效反映临床诊断准确性。为解决此问题，论文提出了一个与模型架构无关的框架，通过半监督U-Net++模型生成椎间盘级别的异常热图来增强VLM输入，以提高解剖结构敏感性和诊断可靠性。

Details

Motivation: 放射学报告撰写耗时且存在评估者间差异，自动化报告生成是VLMs有前景的临床应用，但现有评估指标无法捕捉临床诊断错误，需要更可靠的评估方法和模型改进。

Result: 在腰椎MRI数据集上的基准测试表明，现有SOTA VLMs在标准指标上得分高，但临床诊断准确性不足；提出的异常热图增强框架能提高解剖敏感性和诊断可靠性，为临床监督提供可解释性输出。

Insight: 创新点在于揭示了标准评估指标在临床报告生成任务中的局限性，并提出了利用半监督生成的、空间局部化的异常热图进行视觉增强的架构无关方法，以提升模型的临床诊断准确性和可解释性。

Abstract: Radiology reporting is time-consuming and subject to inter-rater variability, making automated report generation an attractive clinical application for Vision-Language Models (VLMs). We benchmark state-of-the-art VLMs on lumbar spine MRI with a focus on diagnostic accuracy and demonstrate that standard lexical and semantic metrics poorly reflect clinical correctness: fluent, well-structured reports can score highly while containing clinically meaningful diagnostic errors. To address this failure mode, we propose an architecture-agnostic framework that augments VLM inputs with spatially localized, disc-level anomaly heatmaps generated by a semi-supervised U-Net++ model. These heatmaps both improve anatomical sensitivity through explicit visual grounding and provide an independent interpretability output for clinical oversight, moving us closer to diagnostically reliable, visually grounded VLMs for lumbar spine MRI interpretation.

[56] Human-AI Perceptual Alignment by Playing Hues and Cues cs.CVPDF

Nuria Alabau-Bosque, Jorge Vila-Tomás, Paula Daudén-Oliver, Pablo Hernández-Cámara, Valero Laparra

TL;DR: 本文提出了一种基于桌游《Hues and Cues》颜色空间的评估框架，用于衡量对比视觉语言模型（CVLMs）与人类在颜色感知上的对齐程度。通过将480种颜色映射到CIE xy色度图，并基于325名人类观察者收集的数据建立人类一致性基线，评估了162个模型在七个语义类别上的表现。研究发现，CVLMs能复制人类对具体物理参照物的认知偏差，但在抽象和流行文化领域与人类基线存在系统性偏离，并揭示了严重错位的两种失败模式。

Details

Motivation: 传统评估基准忽略了细粒度的语义和文化细微差别，无法充分评估CVLMs与人类感知的对齐程度。

Result: 在精心策划的100词词汇表上评估了162个模型，发现CVLMs在具体类别（如食物、植物）上接近人类基线，但在抽象、主观和流行文化领域系统性偏离；高度策划的预训练数据集比大规模未策划语料库更能缓解严重错位。

Insight: 创新点在于利用游戏化的离散颜色空间构建细粒度评估框架，并建立人类一致性基线作为实证下界；客观来看，该方法揭示了CVLMs在捕获人类颜色记忆的局部共识方面仍存在局限，强调了游戏化任务在暴露模型偏见方面的价值。

Abstract: Evaluating the perceptual alignment between Contrastive Vision-Language Models (CVLMs) and humans is typically constrained by traditional benchmarks that overlook fine-grained semantic and cultural nuances. In this work, we propose a novel evaluation framework that leverages the gamified, discrete color space of the board game Hues and Cues. By mapping the board’s 480 color cells to the CIE xy chromaticity diagram, we calculate empirical perceptual distances across a carefully curated 100-word vocabulary spanning seven semantic categories. To properly contextualize model performance, we establish an empirical lower bound of expected error-the Human Consistency baseline-calculated via Leave-One-Out (LOO) cross-validation on a dense dataset of color associations collected from 325 human observers through a custom digital interface. We evaluate 162 models across multiple architectural families and pre-training datasets to assess their semantic color grounding. Our results demonstrate that while CVLMs successfully replicate human cognitive biases, such as idealized memory colors for concrete physical referents (e.g., food and plants), they systematically diverge from the human baseline in abstract, subjective, and pop-culture domains. We identify two distinct failure modes in severely misaligned concepts: semantic misclassification and a systematic uncertainty collapse into a default blue coordinate. Furthermore, we reveal that highly curated pre-training datasets are significantly more effective than massive, uncurated corpora in mitigating these severe misalignments. Ultimately, this work highlights that despite their broad categorization capabilities, current CVLMs still fail to capture the nuanced, localized consensus of human color memory, emphasizing the value of gamified tasks in exposing underlying model biases. The data and code are publicly available to test other metrics.

[57] Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation cs.CV | cs.AIPDF

Francisco Caetano, Tim J. M. Jaspers, Haiko Middeljans, Martijn R. Jong, Rixta A. H. van Eijck van Heslinga

TL;DR: 本文提出了REVEAL，一个用于内窥镜图像的最大生成基础模型。它通过在包含500万帧的多中心数据集GastroNet-5M上训练，将扩散模型的潜在空间与领域特定的视觉特征对齐，以生成高保真图像并作为强大的特征提取器。

Details

Motivation: 开发内窥镜基础生成模型面临两大挑战：自然图像与临床图像之间的领域鸿沟，以及训练大型扩散变换器的高昂计算成本。

Result: 在多个基准测试中，REVEAL作为特征提取器的性能与专门为分类任务调优的内窥镜基础模型（如EndoViT和Endo-FM）相当甚至超越，并在真实成像损坏下表现出强大的表征鲁棒性。

Insight: 核心创新在于不依赖域外先验，而是直接使用在内窥镜分布上预训练的编码器来对齐扩散潜在空间与领域特征，从而保留精细纹理和解剖结构。这为构建专业临床工具提供了一个开放、通用的高容量基础，降低了计算门槛。

Abstract: Developing foundation generative models for endoscopy is limited by the gap between natural and clinical images and the computational cost of training large Diffusion Transformers. Although representation alignment has improved efficiency in general computer vision, its role within the highly specialized endoscopic image space remains unclear. We introduce REVEAL (Representation-driven Endoscopic Visual Embedding Alignment), the largest generative foundation model for endoscopy to date, trained on GastroNet-5M (GN-5M), a multicenter dataset of 5 million endoscopic frames. Instead of depending on out-of-domain priors, REVEAL employs encoders pretrained directly on the endoscopic distribution to align diffusion latents with domain-specific visual features, preserving fine textures and intricate anatomical structures. Beyond image generation, REVEAL also serves as a powerful feature extractor; in multiple benchmarks, it delivers performance that is competitive with, and in several cases exceeds, endoscopic foundation models such as EndoViT and Endo-FM, specifically tuned for classification tasks, while demonstrating strong representation robustness under realistic imaging corruptions. REVEAL produces high-fidelity images and maintains robust structural coherence in latent-space edits such as inpainting and outpainting. This high-capacity backbone lowers the computational threshold for building specialized clinical tools, offering an open, versatile foundation for conditional synthesis, segmentation, and out-of-distribution detection in future intelligent gastroenterology systems.

Sina Amirrajab, Cian M Scannell, Volker Vehof, Michael Bietenbeck, Ali Yilmaz

TL;DR: 本研究探索了基础模型在心脏磁共振成像（CMR）多视图、多序列分析中的适应性与组合应用。通过微调CineMA模型完成多视图电影序列（cine）和晚期钆增强（LGE）序列的分割，并利用两个冻结的CMR基础模型提取嵌入向量，结合基于注意力的多实例学习进行左心室射血分数（LVEF）的直接回归。

Details

Motivation: 基础模型在心脏MRI中已显示出强大的可迁移性，但其在异构的多视图、多序列CMR分析中的有效性尚不明确。本研究旨在探索微调和组合不同CMR基础模型，以应对通用多序列、多中心、多视图CMR分割挑战（CMR-Multi Challenge）。

Result: 在挑战验证集上，电影序列分割在短轴、两腔和四腔视图上的Dice分数分别为0.862、0.883和0.902；LGE分割的Dice分数在0.621至0.846之间。直接LVEF回归模型的平均绝对误差（MAE）为4.96个百分点，皮尔逊相关系数为0.91。

Insight: 创新点在于将多个基础模型（包括微调和冻结模型）有效适应并组合，用于处理多视图、多模态CMR任务。具体而言，采用基于注意力的多实例学习来融合不同基础模型提取的嵌入向量，以实现端到端的LVEF直接估计，这为多模态医学图像分析提供了一种有效的模型集成策略。

Abstract: Foundation models have shown strong transferability in cardiac MRI (CMR), but their effectiveness for heterogeneous multi-view and multi-sequence CMR analysis remains unclear. In this work, we explore the effectiveness of fine-tuning and combining different CMR foundation models for the Universal Multi-Sequence, Multi-Center and Multi-View CMR Segmentation (CMR-Multi) Challenge. CineMA was fine-tuned for cine and late gadolinium enhancement (LGE) segmentation across short-axis and long-axis views. For direct left-ventricular ejection fraction (LVEF) estimation, we used two recent frozen CMR foundation models to extract embedding vectors that were then combined using attention-based multiple-instance learning for LVEF regression. In the challenge validation set, cine segmentation achieved Dice scores of 0.862, 0.883, and 0.902 for short-axis, two-chamber and four-chamber cine MRI, respectively. LGE segmentation achieved Dice scores between 0.621 and 0.846 across views. The direct LVEF regression model achieved an MAE of 4.96 percentage points and a Pearson correlation of 0.91. These results indicate that foundation models can be effectively adapted and combined for multi-view CMR analysis, while accurate LGE scar segmentation remains a challenging task.

[59] EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation cs.CV | cs.AIPDF

Chengyi Peng, Haoyu Yang, Meixing Shi, Yuxiang Cai, Yankai Jiang

TL;DR: 本文提出了EliSeg框架，用于解决放射学报告引导的异常分割任务中，报告文本存在歧义（如否定、不确定、无关发现）导致难以直接构建分割目标的问题。该框架采用“提议-验证-修订”的流程，无需预定义目标身份或空间提示，即可自动确定目标资格、数量及文本-掩码对应关系。

Details

Motivation: 现有分割方法通常在推理前需要一个明确的目标身份或空间提示作为隐藏的“目标先知”，这绕过了从原始、未经筛选的放射学报告中直接解析和构建可执行分割目标的根本挑战。论文旨在解决报告文本固有的歧义性，实现真正的报告引导分割。

Result: 在MIMIC-CXR-ILS数据集上的实验表明，EliSeg在多种异常发现上持续优于直接分割方法和先提取后分割的级联方法，并能有效抑制对不符合条件报告提及的掩码生成。在CheXlocalize数据集上的评估证明了其有效的跨数据集迁移能力。

Insight: 核心创新在于将目标构建与掩码生成集成在一个统一的框架内，通过独立的文本验证器与提议器进行交叉验证与选择性修订，解决了从非结构化文本中动态确定分割目标的难题。这种“提议-验证-修订”的机制设计，为处理文本引导视觉任务中的歧义性提供了可借鉴的思路。

Abstract: Radiology reports describe clinical observations but do not specify executable segmentation targets. They may contain present, negated, prior,uncertain, or irrelevant findings, while multiple valid abnormalities may coexist. Existing segmentation methods largely bypass this ambiguity by receiving a target identity or spatial prompt before inference, which acts as a hidden target oracle. We study report-grounded abnormality segmentation, where a model must determine target eligibility, cardinality, and finding-to-mask correspondence directly from an unfiltered report before delineating the corresponding regions. We propose \textbf{EliSeg}, an atcor–verify–revise framework that integrates target construction with mask generation. A grammar-constrained Actor proposes target slots and masks, an independent text-only Verifier reconstructs the eligible finding inventory, and Revision selectively re-executes the shared Actor when their target structures disagree. EliSeg requires no predefined target identity, finding prompt, point, or bounding box. Experiments on MIMIC-CXR-ILS show that EliSeg consistently outperforms direct segmentation methods and extract-then-segment cascades across findings, while effectively suppressing masks for ineligible report mentions. Ablation studies confirm the complementary roles of verification and revision, and evaluation on CheXlocalize demonstrates effective transfer of the EliSeg to an external dataset.Code is available at https://github.com/Maybach-dream/EliSeg.

[60] Same Attention, Different Truths: Put Logit-Lens over Visual Attention to Detect and Mitigate LVLM Object Hallucination cs.CV | cs.AIPDF

Zichuan Wang, Songlin Yang, Bo Peng, Zhenchen Tang, Yang Li

TL;DR: 本文针对大型视觉语言模型（LVLM）中的物体幻觉问题，提出了一种无需训练即可检测和缓解幻觉的框架。研究发现，幻觉物体与真实物体在模型的中后层都获得了相似的强视觉注意力，关键在于模型关注的内容而非关注强度。通过Logit Lens解码高注意力区域的特征，发现真实物体区域能被正确解码为目标物体词元，而幻觉区域则不能。基于此，作者识别了两种幻觉机制：视觉不确定性和上下文先验，并分别设计了高注意力区域掩码（HARM）和视觉证据增强解码（VEED）进行针对性缓解。

Details

Motivation: 解决LVLM中常见的物体幻觉问题，即模型生成图像中不存在的物体。先前工作多归因于视觉注意力不足，但本文发现幻觉与真实物体在注意力强度上相似，因此探究其根本原因在于模型关注的内容和机制。

Result: 在多个幻觉基准测试上取得了最先进（SOTA）的结果，表明所提出的无需训练检测-缓解框架有效。

Insight: 创新点在于通过Logit Lens解码视觉注意力区域来区分幻觉与真实物体，并识别出视觉不确定性和上下文先验两种具体幻觉机制，从而设计出针对性的无训练缓解方法（HARM和VEED）。这为理解LVLM幻觉提供了新视角，即从“关注什么”而非“关注多少”入手。

Abstract: Large Vision-Language Models (LVLMs) often suffer from object hallucination, generating objects that are absent from the image. Prior work largely attributes this to insufficient visual attention. However, we find that both real and hallucinated objects receive equally strong visual attention in the model’s mid-to-late layers, suggesting that the key issue may not be how much the model attends, but what it attends to and why. To this end, we decode the visual features of high-attention regions using Logit Lens, and observe that regions corresponding to real objects can be correctly decoded to the target object tokens, whereas those for hallucinated objects cannot. Building on this, we identify two hallucination mechanisms: (i) visual uncertainty, triggered by semantically similar or confusable regions; masking these regions eliminates the hallucination. (ii) contextual prior, triggered by strong co-occurrence priors; even when the initially attended region is masked, the hallucination persists and attention drifts to other regions. Based on these findings, we propose a simple yet effective training-free Detect-Mitigate framework comprising a Logit-Lens Consistency Check to detect hallucination and targeted remedies: High-Attention Regions Masking (HARM) for visual uncertainty hallucination, and Visual Evidence Enhanced Decoding (VEED) for contextual prior hallucination. Our approach achieves state-of-the-art results on multiple hallucination benchmarks. Code will be available.

[61] GeoDistill-Refine: Silhouette-First Geometry Distillation for Annotation-Free Spacecraft Segmentation cs.CV | cs.AIPDF

Yonglong Zhang, Zongwu Xie, Yang Liu

TL;DR: 本文提出了GeoDistill-Refine，一个两阶段的框架，用于在无需人工标注的情况下进行航天器图像分割。该方法通过融合多个固定提示来稳定基础模型（SAM 3）生成的伪掩码，并利用一个紧凑的学生网络（TinyUNet）进行学习。训练过程首先学习前景轮廓，然后通过从伪掩码导出的符号距离场、骨架和面积目标进行细化，并使用一个样本级门控机制来减少不可靠伪几何的影响。

Details

Motivation: 动机在于解决基础分割模型（如SAM）在航天器图像上预测不稳定、存在几何误差，且在蒸馏过程中误差会被放大的问题，旨在实现无需人工标注的高质量分割。

Result: 在SpaceSense-Bench HJM lockbox数据集上，该方法比普通的伪标签学生模型在图像IoU和边界F1分数上分别提升了0.0456和0.1380。在SPEED+ Lightbox、Sunlamp以及TANGO数据集的外部评估中，也取得了具有竞争力的区域重叠结果，并在边界质量或前景精度上有所提升。

Insight: 创新点在于提出了一个两阶段的几何蒸馏框架，通过融合多个提示稳定教师输出，并引入基于轮廓、符号距离场、骨架和面积的细化目标进行训练。其样本级门控机制（基于提示一致性、有效提示比和伪掩码面积合理性）能有效筛选可靠训练样本，这是一个可借鉴的鲁棒蒸馏策略。

Abstract: Foundation segmentation models can provide supervision for spacecraft imagery without manual training masks, but their predictions vary with textual prompts and may contain geometric errors that are amplified during distillation. This paper presents GeoDistill-Refine, a two-stage framework that transfers offline SAM 3 pseudo-masks to a compact segmentation network. Six fixed prompts are fused by an unweighted 50% vote to stabilize the teacher output. The student first learns the foreground silhouette and is then refined with signed-distance-field, skeleton, and area objectives derived from the pseudo-mask. A sample-level gate, computed from prompt agreement, the valid-prompt ratio, and pseudo-mask area plausibility, reduces the influence of unreliable pseudo-geometry. On the SpaceSense-Bench HJM lockbox set, GeoDistill-Refine improves Image IoU and Boundary F1 by 0.0456 and 0.1380, respectively, over a plain pseudo-label student. External evaluations on the SPEED+ Lightbox and Sunlamp domains and on TANGO show competitive regional overlap together with gains in boundary quality or foreground precision. The deployed TinyUNet contains 0.263 M parameters and requires approximately 1.1 ms per image on an RTX 4090; SAM 3 pseudo-mask construction and the auxiliary geometry branches are used only during training.

[62] Addressable Memory for Video World Models cs.CV | cs.LGPDF

Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé

TL;DR: 本文研究了交互式视频世界模型中的视觉持久性问题，发现现有模型在超出训练范围的长序列生成中难以可靠地寻址存储的视觉内容，主要原因是时间旋转位置编码（RoPE）偏移超出训练分布范围。为此，作者提出了无需训练的WorldTrace记忆框架，通过为压缩记忆槽分配虚拟位置保持可寻址性，并设计了两种记忆压缩方法：WorldTrace-Field用于时间一致性压缩，WorldTrace-Landmark用于场景转换时的片段记忆存储。

Details

Motivation: 解决视频世界模型在长序列生成中因时间旋转位置编码（RoPE）偏移超出训练范围而导致的视觉记忆寻址失效问题，以及直接压缩缓存时因位置相位不兼容造成的内存损坏。

Result: 在提出的LoopBench基准测试中，WorldTrace-Field将时间一致性提升了15.5%，WorldTrace-Landmark将片段回忆能力提升了19.5%，实现了无需重新训练的长视觉持久性生成。

Insight: 创新点在于通过分配虚拟位置保持压缩记忆的可寻址性，并针对不同需求设计了两种记忆压缩策略；从客观角度看，该方法通过解耦位置编码与记忆存储，有效缓解了分布外泛化问题，为长序列生成提供了实用的训练免费解决方案。

Abstract: We study visual persistence in interactive video world models. These models rely on a Key-Value (KV) cache as a growing visual memory to carry forward previously generated frames. However, we find that models can no longer reliably address stored content once rollouts extend beyond the training horizon, because temporal Rotary Positional Embeddings (RoPE) offsets then fall outside the range seen during training and the model struggles to retrieve the relevant visual information through attention. Moreover, naively compressing the cache in the RoPE-rotated space corrupts memory by averaging together incompatible positional phases. To address this, we propose WorldTrace, a training-free memory framework for long-horizon visual persistence. WorldTrace keeps compressed memory addressable by assigning each summary slot a distinct, in-distribution virtual position. Within this addressable cache, we study two memory compression approaches: WorldTrace-Field compresses history for temporal coherence, while WorldTrace-Landmark stores verbatim scene traces at detected transitions for episodic recall. We further introduce LoopBench, a benchmark evaluating whether a compressed cache can reconstruct a previously visited scene after a long detour. WorldTrace-Field improves temporal consistency by +15.5%, and WorldTrace-Landmark improves episodic recall by +19.5% on LoopBench, extending visually persistent generation without retraining.

[63] UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modeling cs.CVPDF

An Lanji, Dawei Liu, Jin Li, Haoran Xu, Mei Chen

TL;DR: UniJEPA提出了一种统一的联合嵌入预测架构，用于任务无关的视觉世界建模。它通过一个共享的潜在空间和单一目标函数，联合学习图像级的光度预测和视频级的时序预测，从而统一了以往分散的图像与视频世界模型方法。该模型无需EMA、停止梯度或预训练编码器，并在图像、视频和控制基准测试中达到或超越了特定任务JEPA的性能，同时实现了更快的零样本规划。

Details

Motivation: 现有联合嵌入预测架构（JEPAs）在图像级（如I-JEPA）和视频级（如V-JEPA）世界建模中采用分离的编码器、预测器和防坍塌正则化器，导致模型碎片化，无法统一处理不同层级的视觉世界建模任务。

Result: 在图像、视频和控制基准测试中，UniJEPA匹配或超越了特定任务的JEPA方法，且仅需一个损失超参数。在离线轨迹上进行动作条件后训练后，它能实现零样本规划，其规划速度比生成式世界模型快数十倍，同时保持相当的准确性。

Insight: 核心创新在于提出了一个统一的框架，通过共享潜在空间和单一目标（下一嵌入预测损失与高斯正则化器）联合学习光度不变性和时序等变性，实现了可控的抽象。这避免了复杂的训练技巧（如EMA），并支持将目标特征作为预测目标进行高效规划。

Abstract: Joint-Embedding Predictive Architectures (JEPAs) have emerged as a principled framework for self-supervised learning of world models in compact latent spaces, yet existing methods are fragmented: some predict masked parts of a single image in latent space (I-JEPA), others learn to predict global photometric transformations (Image World Models), while video-scale JEPAs predict future temporal states and are post-trained for action-conditioned planning (V-JEPA~2, DINO-World, DINO-WM). These objectives are treated as distinct recipes with separate encoders, predictors, and anti-collapse regularizers, hindering a single model from unifying image-level and video-level world modeling. We present UniJEPA, a unified JEPA that jointly learns photometric prediction (image-level transformations) and temporal prediction (video-level next-state dynamics) in one shared latent space. A single end-to-end objective, composed of a next-embedding prediction loss and a Gaussian regularizer, yields a provably anti-collapse encoder-predictor pair trainable from raw pixels without EMA, stop-gradient, or pre-trained encoders. We show that the same latent space supports controllable abstraction: photometric prediction learns invariant structure while temporal prediction learns equivariant dynamics. After action-conditioned post-training on offline trajectories, UniJEPA enables zero-shot planning by treating goal features as prediction targets. On image, video, and control benchmarks, UniJEPA matches or surpasses task-specific JEPAs while requiring a single loss hyperparameter, and plans up to tens of times faster than generative world models at comparable accuracy.

[64] I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning cs.CV | cs.AIPDF

Shibo Gao, Chongxiao Wang, Chenglong Huang, Jie Ma, Haolin Shi

TL;DR: 本文提出了身份条件查询任务，旨在解决现有视频推理任务在身份匹配和以人为中心的推理方面的局限性。为此，作者构建了ISYV系统，包括一个包含六个难度级别的评估基准、一个大规模训练集以及一个无需额外镜头级标注的模型框架。实验表明，现有主流模型在该基准上表现不佳，尤其是在跨域身份匹配和长时跟踪方面，而作者提出的模型优于强基线。

Details

Motivation: 现有视频推理任务通常简化为视频-文本设置，限制了身份匹配和以人为中心的推理能力，而现实世界的视频推理往往涉及多模态、多源输入。

Result: 主流闭源和开源MLLM在ISYV-Bench上表现不佳，尤其是在跨域身份匹配和长时跟踪方面。ISYV-Model超越了强基线，并在某些方面接近闭源模型的性能。

Insight: 创新点在于提出了统一的身份条件查询任务定义，并构建了包含可扩展数据集/基准和建模框架的系统，特别是其模型框架能够学习利用信息丰富的视频镜头而无需额外的镜头级标注。

Abstract: Real-world video reasoning often involves multimodal, multi-source inputs, whereas existing video reasoning tasks typically assume a simplified video-text setting, limiting identity matching and person-centric reasoning. To bridge this gap, we introduce the Identity-conditioned Queries (ICQ) task, in which models are required to jointly associate and interpret an input video and a reference image of a person, and leverage this conditioning to address identity grounding, behavior understanding, and temporal reasoning, among other challenges. Building on ICQ, we present ISYV (I Seek You in Videos), a systematic solution comprising three components: (1) ISYV-Bench, a challenging evaluation benchmark with 1,377 real-world complex videos and 1,377 question-answer pairs, organized into six difficulty levels spanning capabilities from identity recognition to causal reasoning; (2) ISYV-75K, a large-scale training set of 75K high-quality samples constructed via automated annotation, multi-stage verification, and manual review; and (3) ISYV-Framework, containing an ICQ-oriented model and training strategy for learning to exploit informative video shots without additional shot-level annotations. Extensive experiments show that both mainstream closed-source and open-source MLLMs struggle on ISYV-Bench, especially in cross-domain identity matching and long-horizon tracking. ISYV-Model outperforms strong baselines and in some aspects approaches closed-source performance. Overall, ISYV provides a unified task definition, scalable datasets/benchmarks, and modeling insights for person-centric video reasoning.

[65] Conformal Coverage Guarantees for Any Video Temporal Grounder cs.CV | cs.IRPDF

Aseel Mohamed, Rasul Khanbayov, Erchin Serpedin, Hasan Kurban

TL;DR: 论文提出了一种名为COVER的后处理、模型无关的包装方法，可将任何视频时序定位器（无论是训练好的定位器还是黑盒视频-语言模型）的输出转换为一个具有统计保证的时间区域，该区域以至少$1-α$的概率包含真实时刻。该方法通过在校准集上校准时序非一致性分数的分位数，并据此扩大基础预测来实现。

Details

Motivation: 连续视频中的事件边界是模糊的，真实标注是区间上的分布，而现有定位器只返回单一区间且无可靠性声明，导致部署时无法区分正确与错误结果。

Result: 在三个基准测试和五个定位器上的实验表明，实际覆盖率与目标覆盖率一致，并且校准过程揭示了传统点度量指标所隐藏的信息。

Insight: 创新点在于将保形预测框架应用于视频时序定位任务，提供有限样本且分布无关的覆盖保证，无需重新训练或白盒访问模型，并针对定位任务开发了两种分数族和特定理论分析。

Abstract: Event boundaries in continuous video are ambiguous: re-annotate the same query-video pair and independent annotators mark moments that overlap by less than half on a large fraction of samples. The ground truth for video temporal grounding is therefore a distribution over intervals, yet every grounder returns a single interval with no statement of reliability, so at deployment a wrong interval is indistinguishable from a right one. COVER changes the output object: a post-hoc, model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video–language model, into one that emits a temporal region containing the true moment with probability at least $1-α$, by calibrating the quantile of a temporal nonconformity score on held-out labels and widening the base prediction by that amount. The guarantee is finite-sample and distribution-free under exchangeability, and requires neither retraining nor white-box access. We give two score families, a two-sided boundary-widening score for grounders that emit an interval and a super-level-set score for grounders that emit a relevance signal, and develop theory specific to grounding that bounds how large the certified region becomes, when coverage survives conditioning on event length, and how it degrades when moments from one video break exchangeability. Across three benchmarks and five grounders, realized coverage tracks the target, and calibration exposes what point metrics hide.

[66] MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation cs.CV | cs.LGPDF

Youjun Zhao, Alex Warren, Gary K. L. Tam, Rynson W. H. Lau

TL;DR: 本文提出MirrorWorld框架，旨在解决视频扩散模型在生成镜面反射时内容不一致和空间错位的问题。该框架通过语义关系蒸馏（SRD）和几何变换对齐（GTA）两个互补组件，分别建模反射内容与场景的语义关联以及反射内容的空间排列。

Details

Motivation: 现有视频扩散模型未专门建模场景与镜面之间的关系，导致生成的镜面反射内容错误或空间不一致。论文观察到镜面反射生成涉及‘反射什么内容’和‘如何空间排列’两个互补挑战。

Result: 在通过重新利用四个现有视频镜面数据集构建的统一反射重建基准上，MirrorWorld在反射重建质量上优于代表性的基于图像的反射生成方法和强视频修复基线。

Insight: 创新点在于将镜面反射生成分解为语义关联和空间对齐两个子问题，并分别通过SRD（利用冻结视觉基础模型传递关系信息）和GTA（学习变换引导空间排列）进行建模；同时构建了专门的视频镜面反射生成基准以促进研究。

Abstract: Recent advances in video diffusion models (VDMs) have enabled high-fidelity video synthesis. However, generating mirror reflections remains challenging because the content within a mirror must remain consistent with the surrounding scene. Existing VDMs are not specifically designed to model scene-to-mirror relationships, which can lead to reflections with incorrect content or inconsistent spatial arrangements. We observe that mirror reflection generation involves two complementary challenges: determining what scene content should be reflected and how the reflected content should be spatially arranged within the mirror region. Motivated by this observation, we propose MirrorWorld, a reflection-aware video inpainting framework that models scene-to-mirror relationships during generation. Specifically, we introduce Semantic Relation Distillation (SRD), which transfers relational information from a frozen visual foundation model to encourage semantic associations between visible scene content and mirror regions. We further propose Geometric Transformation Alignment (GTA), which learns a transformation that guides the spatial arrangement of reflected content. The two components play complementary roles, with SRD modeling what should be reflected and GTA modeling how it should be arranged. To facilitate research on this problem, we construct a benchmark for video mirror reflection generation by repurposing four existing video mirror datasets into a unified reflection reconstruction task. Experimental results show that MirrorWorld achieves improved reflection reconstruction quality over representative image-based reflection generation methods and strong video inpainting baselines.

[67] SimWAM: A Simple World Action Model for End-to-End Autonomous Driving cs.CVPDF

Zongchuang Zhao, Xin Zhou, Tianyang Xu, Zhengyang Sun, Kaixuan Zhou

TL;DR: SimWAM是一种用于端到端自动驾驶的简单世界动作模型，它通过联合流匹配共同训练预训练的视频专家和轻量级动作专家，将视频生成仅用作训练信号。该方法在推理时丢弃视频分支，仅保留一个独立的规划器直接预测轨迹，从而降低了延迟。

Details

Motivation: 现有世界动作模型在推理时需要生成未来帧，计算成本高昂。本文旨在设计一个简单有效的模型，将视频生成仅作为训练信号，以降低推理成本并提升效率。

Result: SimWAM在NAVSIM基准上取得了91.5的PDMS分数，超越了基于WAM的最先进规划器，且延迟显著降低，并能在nuScenes数据集上实现零样本迁移。

Insight: 创新点在于通过隔离注意力掩码使动作预测独立于未来帧，允许训练后丢弃视频分支；采用无参数共享的双专家架构，便于独立扩展；并引入强化学习优化超越轨迹模仿的组合驾驶奖励。

Abstract: World-Action Models (WAMs) improve end-to-end autonomous driving by transferring video dynamics priors to action prediction, but existing methods require costly future generation at inference. We present SimWAM, a simple yet effective WAM that uses video generation purely as a training signal. It co-trains a pretrained video expert and a lightweight action expert with joint flow matching. An isolated attention mask keeps action prediction independent of future frames, allowing the video branch to be discarded after training and leaving a self-contained planner that directly predicts trajectories. Since the two experts share no parameters and interact only through a unified attention interface, the video backbone could be replaced and the action expert scaled independently without modifying the learning objective or inference pipeline. We further apply reinforcement learning to optimize a compositional driving reward beyond trajectory imitation. Our SimWAM achieves $91.5$ PDMS on NAVSIM, surpasses state-of-the-art WAM-based planners with substantially lower latency, and transfers zero-shot to nuScenes. These results position SimWAM as a simple yet solid baseline that could readily benefit from advances in video generation for efficient autonomous driving. The code and model weights are available at https://github.com/H-EmbodVis/SimWAM/

[68] SABRE: Scalable and Automated Benchmarking of VLMs under Stress cs.CV | cs.AI | cs.CLPDF

Zixuan Lan, Luzhe Sun, Matthew R. Walter, Jiawei Zhou

TL;DR: 本文提出了SABRE，一个可扩展、自动化的流程，用于构建和更新视觉语言模型（VLM）的压力测试基准。它通过将任务设计规范转换为结构化数据、生成/编辑图像以及问答对，并利用自动化过滤和人工审核来高效创建具有挑战性的测试集。论文以SABRE-Prior为例，专门测试VLM是否依赖视觉证据而非世界先验知识，并在六个VLM上展示了其有效性。

Details

Motivation: 当前视觉语言模型（VLM）发展迅速，但基准测试开发滞后，导致模型弱点难以识别。手动构建压力测试成本高昂，需要满足可控条件、保持可回答性并挑战现有模型。

Result: 在SABRE-Prior实例中，包含600张图像和1000个问题，涵盖四个类别。测试的六个VLM的宏平均准确率在17.8%到31.3%之间（平均22.6%），表明任务极具挑战性。一个真实图像的属性控制任务对过滤VLM同样困难。初步的SABRE-Counting和SABRE-Spatial项目表明该工作流支持其他压力测试场景。

Insight: 主要创新点在于提出了一个可扩展、自动化的基准构建框架（SABRE），将任务设计规范自动转化为可执行的测试，结合自动化过滤与人工审核，实现了高效、可复用的压力测试生成。这超越了单一固定基准，为持续评估VLM的鲁棒性提供了系统化工具。其具体实例SABRE-Prior系统地测试了模型对视觉证据的依赖程度，而非依赖先验知识，这是一个重要的评估维度。

Abstract: Vision-language models (VLMs) are improving rapidly, but benchmark development lags behind, making weaknesses hard to identify. Building stress tests is costly: samples must satisfy controlled conditions, remain answerable, and challenge current models. We present SABRE, a scalable, automated pipeline that converts a Test Primer (a Markdown Task Design with Data Schema) into structured specifications, generated or edited images, and question-answer pairs. Automated filtering removes candidates solved by a Filtering VLM, while human review verifies candidate validity and supports annotation correction and localized image repair. We instantiate SABRE-Prior to test whether VLMs follow visual evidence instead of relying on world priors – learned expectations about familiar objects and scenes. Its 600 images and 1,000 questions span Context (unexpected entities in familiar scenes), Texture (counterfactual materials), Attribute (noncanonical component counts), and Language Elicitation (answers suggested by language but unsupported by the image). Across six VLMs, macro-average accuracy ranges from 17.8% to 31.3% (22.6% mean). A real-image Attribute control is comparably difficult for the Filtering VLM. SABRE-Counting and SABRE-Spatial pilots show that the workflow supports other stress-test settings. These results establish SABRE as a reusable framework for constructing and refreshing VLM stress tests rather than a single fixed benchmark.

cs.CR [Back]

[69] Model Confidence Under Answer-Preserving Attacks: An Informativeness-Manipulability Frontier cs.CR | cs.CLPDF

Reza Khanmohammadi, Ivan Brugere, Simerjot Kaur, Charese H. Smiley, Kundan Thind

TL;DR: 本文研究了视觉语言模型在答案保持攻击下的置信度鲁棒性问题，发现模型置信度在对抗性扰动下容易受到操纵，导致置信度门控机制失效，从而揭示了置信度作为监督信号的脆弱性。

Details

Motivation: 部署的视觉语言系统通常基于置信度门控答案，因此置信度的鲁棒性对于系统监督至关重要；本文旨在探究在白盒、仅图像攻击且保持生成答案不变的约束下，模型置信度的可靠性。

Result: 在四个视觉语言模型、三个VQA基准测试、五个部署置信度通道和两种防御估计器的实验中，攻击在所有84种组合中均成功反驳了均匀证书；协调攻击将对抗性判别率驱动至或低于答案字符串准确率基线（0.617），在置信度门控模拟中，攻击导致高达84.8%先前被拒绝的错误答案被接受。

Insight: 创新点在于提出了‘信息性-可操纵性前沿’概念，并通过隐藏状态干预和文本模型激活空间复制实验，表明置信度操纵可在表示层面实现，而不仅限于对抗图像；研究揭示了在特定威胁模型下，置信度是完整性敏感而非本质鲁棒的监督信号。

Abstract: Deployed vision-language systems often gate their answers on confidence, making confidence robustness relevant to oversight. We study confidence readouts under white-box, image-only attacks constrained to preserve the generated answer byte-identically. Under a reachability assumption, an unmovable readout cannot outperform the answer-string accuracy prior, whose pooled value is 0.617. Independently of that assumption, a uniform amplitude certificate below a measurable threshold guarantees adversarial discrimination above the same floor. Across four vision-language models, three visual question answering benchmarks, five deployed confidence channels and two defense estimators, direct or surrogate-aimed attacks produce itemwise feasible perturbations that refute this uniform certificate in all 84 estimator-by-cell combinations. Coordinated correctness-label-aware attacks drive adversarial discrimination to or below the answer-string floor in all sixty deployed-channel cells, including all fifty-nine that begin above it. Hidden-state interventions and an open-ended text-model activation-space replication show that comparable confidence movement can be induced at the representation level rather than only through adversarial images. None of four tested defense families establishes a robust alternative under the specific evaluation applied to it. In a confidence-gated simulation, a coordinated token-probability attack transferred to a hidden-state gate causes up to 84.8% of previously rejected wrong answers to become accepted. After reweighting to each benchmark’s natural correctness prevalence, accepted accuracy falls below the no-gate baseline in eight of twelve cells under transfer and all twelve under a direct gate-aimed attack. Under the studied threat model and budget, confidence is therefore an integrity-sensitive rather than intrinsically robust oversight signal.

[70] Retrieval-Constrained Policy Optimization for Attack Technique Extraction from Cyber Threat Intelligence cs.CR | cs.CLPDF

Jiayun Zhang, Junshen Xu, Zejun Xie, Yi Fan

TL;DR: 本文提出TTP-R1框架，用于从网络威胁情报（CTI）文本中自动提取MITRE ATT&CK攻击技术。该框架采用两阶段方法：首先通过混合检索器缩小标签空间，然后利用经过监督微调（SFT）和基于可验证奖励的强化学习（RLVR）的大语言模型（LLM）进行技术选择，直接优化预测技术集的精确率、召回率和输出格式。

Details

Motivation: 手动标注CTI文本到MITRE ATT&CK技术映射成本高且难以扩展，现有自动化方法（如多标签分类器和基于LLM的生成方法）存在类别不平衡、标签空间大、缺乏对预测技术集正确性和完整性的直接监督等问题。

Result: 在四个CTI基准测试上，TTP-R1取得了最佳的平均F1分数，在子技术级别上比检索增强的Claude Sonnet 4.5提高了7.4个百分点，且当作为8B参数模型在单GPU上运行时，速度提升了28倍。

Insight: 创新点在于结合检索增强的监督微调与基于可验证奖励的强化学习（RLVR），通过分解奖励函数直接监督预测技术集的精确率、召回率和格式，将技术标注视为集合预测而非序列生成，从而更有效地处理多标签提取任务。

Abstract: Mapping cyber threat intelligence (CTI) text to MITRE ATT&CK techniques is essential for structured threat analysis, yet manual annotation is costly and does not scale. The ATT&CK taxonomy comprises several hundred attack techniques, and a single CTI passage may describe multiple techniques, making accurate and complete extraction challenging. Existing automated approaches fall short in different ways: multi-label classifiers struggle with severe class imbalance and the large label space, while LLM-based methods–retrieval pipelines and fine-tuned generators–optimize token-level objectives that treat technique annotation as sequence generation rather than set prediction, lacking direct supervision on whether the predicted technique set is correct and complete. We propose TTP-R1, a two-stage framework that combines retrieval-augmented supervised fine-tuning (SFT) with reinforcement learning using verifiable rewards (RLVR). A hybrid retriever first narrows the large label space to a candidate set, and a fine-tuned LLM learns to select the correct techniques. We then apply Group Relative Policy Optimization with a decomposed reward that directly supervises the precision, recall, and output format of the predicted technique set. Across four CTI benchmarks, TTP-R1 achieves the best average F1, improving sub-technique-level F1 by 7.4 percentage points over Claude Sonnet 4.5 with retrieval augmentation, while running 28x faster when served as an 8B-parameter model on a single GPU.

cs.AI [Back]

[71] ADIAS: Automated Design of Interactive Agentic Systems cs.AI | cs.CL | cs.MAPDF

Lekang Jiang, Bohan Tang, Stephan Goetz, Yiwen Guo

TL;DR: 本文提出ADIAS框架，通过问题中心的智能体优化方法改进自动智能体设计。该方法将修复进度显式化为持久化问题状态，指导后续的针对性全代码修改，解决了现有候选中心方法中修复目标不明确、进展整合缓慢的问题。

Details

Motivation: 现有自动智能体设计方法以候选为中心，跨轮次经验围绕候选智能体组织，导致修复进度隐式化，造成修复目标低效、部分进展整合缓慢以及无效干预跨轮传播。

Result: 在五个交互式基准测试中，ADIAS平均比最强基线提升25.2%，并在四个骨干模型上取得一致增益。消融实验显示移除持久化问题状态或替换为候选中心策略会导致性能下降高达40.7%。

Insight: 创新点在于将问题状态显式持久化以指导优化，而非每轮从候选历史重新推导；具体通过维护稳定问题身份、生命周期状态和干预结果历史，实现问题引导的联合修复目标与修订方向生成。

Abstract: Automated agent design improves agent harnesses through iterative revision, evaluation, and feedback summarization. Existing methods are largely candidate-centric: cross-round experience is organized around candidate agents, which leaves the repair progress implicit. This causes inefficient repair targeting, slow consolidation of partial progress, and propagation of ineffective interventions across rounds. Therefore, we formulate issue-centric agent optimization, in which repair progress is carried forward as an explicit persistent issue state to guide optimization, rather than re-derived from candidate history in each round. We instantiate the formulation in ADIAS, a framework for automated full-code agent design with two mechanisms. A persistent issue state maintains stable issue identities, lifecycle status, supporting evidence, and intervention-outcome histories. Issue-guided optimization uses this state to jointly propose repair targets and revision directions for subsequent focused full-code modification. Across five interactive benchmarks, ADIAS outperforms the strongest baseline by 25.2% on average and achieves consistent gains across four backbone models. Controlled ablations further show that removing persistent issue state or replacing issue-centric revision with candidate-centric policies leads to performance drops of up to 40.7%.

[72] Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding cs.AI | cs.CL | cs.MMPDF

Ming Wang, Yuqing Zhang, Tingna Xie, Xiangju Li, Xiaocui Yang

TL;DR: 本文提出了C4，一个基于中文成语的跨概念创造力评估框架，用于评估多模态大语言模型（MLLMs）的跨概念理解能力。该框架通过构建一个跨概念网络来编码和解码非显而易见的语义关系，并实例化为C4-Eval评估集。实验表明，当前MLLMs在解码创造性编码含义方面存在显著差距。

Details

Motivation: MLLMs的创造力在设计、教育、人机协作等领域至关重要，但缺乏有效的评估方法，因为与准确性任务不同，创造力任务缺乏明确的目标和奖励信号。跨概念理解是感知创造力的核心认知能力，本文旨在评估MLLMs是否具备这种能力。

Result: 在C4-Eval评估集上，最强的闭源模型在主要答案恢复任务中的准确率分别为50.7%和48.0%，开源模型则显著更低。候选约束能大幅提升准确率，但桥梁提示和解释请求的增益有限，揭示了当前MLLMs在解码跨概念关系上的不足。

Insight: 创新点在于将创造力评估操作化为跨概念编码与解码，并构建了一个结构明确、难度可量化、答案精确的评估框架C4。其核心是手动构建和审核的跨概念网络，为批量生成可控的创造力测试项目提供了系统化方法，为评估MLLMs的深层语义理解能力提供了新基准。

Abstract: Creative capabilities of MLLMs matter in design, communication, education, and human–AI collaboration, yet remain difficult to evaluate because explicit targets and reward signals are scarce compared with accuracy-oriented tasks. Cross-concept understanding is a core cognitive capacity underlying receptive creativity. It enables a perceiver to recover intended meaning from non-obvious but meaningful conceptual relations. We operationalize item construction as cross-concept encoding and model inference as cross-concept decoding. We introduce C4, a cognition-inspired evaluation framework for Chengyu (Chinese idiom)-based Cross-Concept Creativity. Its encoding component maps target slots to imageable substitute concepts along bridge paths in a manually annotated and third-party-reviewed cross-concept network, enabling batch generation with explicit structure, difficulty indexed by bridge count and depth, and exact answers. Using this framework, we instantiate the C4 Evaluation Set (C4-Eval), comprising 184 synthetic items and 37 human-created cross-concept chengyu figures collected from online sources. We manually construct and review cross-concept relations, bridge paths, and reasoning processes for the collected figures. Each C4-Eval item is instantiated in five task settings, yielding 884 primary answer-recovery cases. Across ten evaluated MLLMs, the strongest closed models reach 50.7% and 48.0% primary accuracy, while open-source models remain substantially lower. Candidate constraints improve accuracy sharply, but bridge hints and explanation requests provide only modest gains. These results expose a substantial gap in how current MLLMs decode creatively encoded meaning through cross-concept relations. The code is in the supplementary material.

[73] IB-RL: Isolated Bilateral Reinforcement Learning for Strategic Dialogue Agents cs.AI | cs.CLPDF

Senhao Wang, Chenghao Cai, Haitao Hu, Mingxing Huang, Xingguang Wang

TL;DR: 本文提出了一种名为孤立双边强化学习（IB-RL）的新方法，用于训练战略对话智能体。该方法通过让对话中的双方角色在联合推演中共同进化，同时保持各自优势、动作掩码和更新路径的完全独立，以解决传统单边RL方法因对抗固定对手而产生的静态对手不匹配问题，从而学习到更具泛化性的策略。

Details

Motivation: 当前强化学习在改进大语言模型处理具有固定、可验证奖励的任务（如数学推理和代码执行）上效果显著，但这些环境遵循固定规则且不会对智能体进行策略性适应。战略对话则不同，其环境是另一个会适应策略的智能体，成功取决于双方的互动。现有RL方法通常针对固定对手或模拟器训练目标智能体，这导致策略学习利用特定对手的规律而非泛化策略，即静态对手不匹配问题。

Result: 在Vehicle TeleSales任务上，IB-RL实现了89.6%的Success@1，优于最佳单边RL基线的84.6%。在Deal-or-NoDeal任务上，IB-RL与DeepSeek V4 Pro达成98.4%的协议率，而最佳单边基线为86.4%。这些结果表明，采用严格按智能体隔离的联合训练方法能产生对未见对手更有效泛化的策略。

Insight: 论文宣称的创新点是IB-RL框架，它通过双边角色的共同进化与完全独立的优化路径，解决了战略对话中因训练对手固定而导致的泛化能力不足问题。从客观角度看，该方法的核心创新在于将多智能体强化学习中的隔离与协同相结合，强调在交互环境中保持各智能体策略更新的独立性以避免过拟合特定对手，这为训练更具鲁棒性和泛化性的对话智能体提供了新思路。

Abstract: Reinforcement learning (RL) has achieved strong results in improving large language models (LLMs) on tasks with stationary, verifiable rewards, such as mathematical reasoning and code execution. In these settings, the environment follows fixed rules and does not adapt strategically to the agent. Strategic dialogue differs in this respect: the environment is another agent that adapts to the policy, and success depends on the interaction between the two sides. Despite this interactive nature, current RL approaches typically train a target agent against a fixed counterpart or simulator. We find that this training paradigm encourages the policy to exploit counterpart-specific regularities rather than learn strategies that generalize across counterparts. We call this problem the static-counterpart mismatch, which we quantify directly in our experiments. To address it, we propose Isolated Bilateral Reinforcement Learning (IB-RL), in which the two roles coevolve through joint rollouts while each role optimizes its own reward through fully independent advantages, action masks, and update paths. We evaluate frozen policies against fully independent held-out counterparts in both domains. On Vehicle TeleSales, IB-RL achieves 89.6% Success@1, compared to 84.6% for the best unilateral RL baseline. On Deal-or-NoDeal, it reaches 98.4% agreement against DeepSeek V4 Pro, compared to 86.4% for the best unilateral baseline. These results indicate that jointly training both roles with strict peragent isolation produces policies that generalize more effectively to unseen counterparts.

Hanshu Yao, Janfeng Zhong, Niu Lian, Jinpeng Wang

TL;DR: 本文提出了DocMemo框架，用于解决长文档理解中稀疏、异构证据定位的难题。该框架通过三层记忆结构（文档模式记忆、页面信念记忆和问题情景记忆）动态引导证据检索，并利用贝叶斯页面信念更新、空间邻近传播和结构感知自适应粒度证据访问等技术优化跨轮次页面选择。

Details

Motivation: 现有长文档理解系统受限于静态检索和脆弱的跨轮次记忆，难以处理数百页文档中稀疏且异构的证据定位问题。单轮方法因固定初始页面集而难以纠正早期检索错误，而迭代方法虽允许多轮证据获取，但未深入探究跨轮次状态的传播机制，无法有效跟踪页面相关性的动态变化。

Result: 在三个基准测试上的实验表明，DocMemo实现了最先进的性能，验证了结构化记忆和动态页面信念更新的有效性。

Insight: 创新点在于将长文档推理形式化为动态证据探索，并设计了包含三层记忆的引导框架，通过概率性记忆更新机制（如贝叶斯信念更新与Thompson采样）实现跨轮次状态的稳健传播与动态页面相关性追踪，同时结合细粒度视觉区域补充页面级证据。

Abstract: Long-document understanding requires locating sparse and heterogeneous evidence across hundreds of pages, yet existing systems remain limited by static retrieval and fragile cross-round memory. Mainstream single-round methods commit to a fixed top-$k$ page set at the outset and struggle to recover from early retrieval errors; recent iterative approaches allow multi-round evidence acquisition, but they do not investigate the propagation mechanism of cross-round states, making it difficult to track the dynamic changes in page relevance. To address these limitations, we propose DocMemo, a memory-guided framework that formulates long-document reasoning as dynamic evidence exploration. DocMemo maintains a tri-level retrieval state consisting of Document Schema Memory, Page Belief Memory, and Question Episodic Memory, which respectively capture structural priors, dynamic relevance estimation, and query-specific reasoning trajectories. During reasoning, DocMemo continuously refines cross-round page selection through Bayesian page belief updating with Thompson sampling, spatial proximity propagation, and structure-aware adaptive-granularity evidence access, while supplementing page-level evidence with fine-grained visual regions. Experiments on 3 benchmarks show that DocMemo achieves state-of-the-art performance and validate the efficacy of structured memory and dynamic page belief updating. Code is available at https://github.com/Harrygof/DocMemo.

Rodrigo Ferreira Rodrigues, Karim Radouane, Jose G Moreno, Lynda Tamine

TL;DR: 本文提出了GeoBenchLLM，一个用于评估大语言模型在地理相关任务上性能的综合基准。该基准整合了来自不同地理任务和领域的12个公开数据集，用于评估模型对地理空间和时间的理解能力。研究发现，模型的推理能力和规模对整体性能有显著影响。

Details

Motivation: 现有大语言模型在地理数据研究中通常处于同质化设置，这极大地限制了对模型泛化能力的深入理解。

Result: 在GeoBenchLLM基准上对一系列LLMs进行评估，结果表明推理能力和模型规模对整体性能有强烈影响。

Insight: 创新点在于构建了一个综合性的、多任务的地理基准，以系统评估LLMs的地理空间与时间理解能力，弥补了现有研究在异质化评估和泛化能力洞察上的不足。

Abstract: In the context of geodata, existing Large Language Models have often been studied in a homogeneous setting, which has considerably limited insights into their generalization capabilities. In this paper, we present \benchName, a comprehensive benchmark for probing LLMs on geo-related tasks. We leverage a careful selection of twelve publicly available datasets from diverse geo-related tasks and domains, and evaluate a set of LLMs on geo-spatial and temporal understanding using our benchmark. Our results show that reasoning and size have a strong impact on overall performance. GeoBenchLLM is publicly available at https://github.com/Rfr2003/GeoBenchLLM.

[76] ResidencyRL: Reinforcement Learning in Simulated Clinical Environments cs.AI | cs.CLPDF

Valentin Liévin, Samuel Schmidgall, Tim Strother, Alex Bijamov, Akshay Goel

TL;DR: 本文提出了ResidencyRL，一种在模拟临床环境中使用强化学习训练临床AI代理的方法。该方法通过多轮临床对话模拟（每轮最多60次对话和8次工具调用），结合LLM模拟器进行对抗性训练，以优化诊断准确性、管理质量、沟通、文档和安全等结构化奖励。

Details

Motivation: 解决当前大语言模型在静态医学基准测试上表现优异，但优化完整临床决策序列的方法仍不成熟的问题，旨在模拟住院医师培训过程，提升AI在不确定性下的临床推理能力。

Result: 在对抗性条件下，ResidencyRL代理将诊断准确率提高了7.0%（从81.0%提升至88.0%），并将漏报危险信号率降低了31%。在AMIE多访视基准的所有六个临床维度上均优于基础模型，并在AgentClinic和CRAFT-MD上显示出持续改进趋势，在专家盲评中87.6%的对比中更受青睐。

Insight: 创新点在于将强化学习与LLM模拟器结合，通过模拟多轮、对抗性临床对话来训练AI代理，有效缓解过早定论问题，并展示了序列临床决策能力可通过模拟强化学习有效习得，具有鲁棒性和可泛化性。

Abstract: In medical education, physicians convert academic knowledge into clinical expertise through residency: years of training across thousands of encounters, with diverse sources of feedback and progressively greater autonomy. Much of clinical reasoning relies on the patient encounter, a dialogue in which a clinician elicits history, refines diagnostic hypotheses, and decides management under uncertainty. While large language models (LLMs) excel on static medical benchmarks, methods to optimize the full sequence of clinical decisions remain underdeveloped. We present ResidencyRL, a reinforcement learning (RL) method for training clinical artificial intelligence (AI) agents through simulated multi-turn clinical encounters (up to 60 dialogue turns and 8 tool calls per trajectory). ResidencyRL pairs the policy agent with LLM simulators capable of complex, adversarial behaviors, training against a structured reward aligned to diagnostic accuracy, management quality, communication, documentation, and safety. On held-out evaluations, the ResidencyRL agent improves diagnostic accuracy by 7.0% under adversarial conditions (88.0% vs. 81.0%) and reduces missed red flag rates by 31%, demonstrating rigorous mitigation of premature closure. Blinded expert clinicians validated these gains, preferring the trained agent in 87.6% of side-by-side comparisons. The procedural competencies transfer to unseen benchmarks: the agent outperforms the base model across all six clinical axes of the AMIE multi-visit benchmark, and shows consistent directional improvements on AgentClinic and CRAFT-MD. Our findings demonstrate that sequential clinical decision-making can be effectively learned through multi-turn RL in simulation, yielding robust, generalizable capabilities, paving the way towards clinical mastery. Prospective validation with real-world workflows remains necessary to establish clinical utility.

[77] AgentPatch: Coarse-to-Fine Weak-Task Repair for Merging Agentic Multimodal Large Language Models cs.AI | cs.CVPDF

Zibo Shao, Baochen Xiong, Chengdong Xu, Linhui Xiao, Kaichen Li

TL;DR: 本文提出AgentPatch，一种无需训练的从粗到细的修复框架，用于合并具有代理能力的多模态大语言模型（MLLMs），以解决合并后产生的弱任务性能下降和关键行为遗忘问题。

Details

Motivation: 当前具有代理能力的MLLMs针对特定工具或环境进行了专门化，难以整合成一个通用的单一模型。合并时面临两个挑战：非对称能力保留导致弱任务性能下降，以及行为关键遗忘影响长视野任务执行。

Result: 在六个代理和多模态基准测试上的实验表明，AgentPatch能改善多种合并后的主干模型，缓解弱任务性能退化，并更好地平衡弱任务恢复与互补搜索、代理视觉处理能力的保留。

Insight: 创新点在于提出了一个无需训练的两阶段修复框架：通过弱任务唯一残差恢复来增强弱任务信号，并通过代理引导的行为关键补丁在明确的能力保护下恢复关键行为，最终生成单一的静态模型检查点，无需路由或集成。

Abstract: Agentic multimodal large language models (MLLMs) extend multimodal perception and reasoning with planning, tool use, and interaction in dynamic environments. Yet current models are specialized for particular tools or environments, complicating consolidation into a single generalist. We formulate Agentic MLLM Merging and identify two challenges: asymmetric capability preservation, whereby capabilities with different interaction complexity are retained unevenly, producing weak tasks after merging, and behavior-critical forgetting, whereby losing decisive actions can derail long-horizon execution. We propose AgentPatch, a training-free coarse-to-fine repair framework. It selects a stable merged backbone, restores diluted weak-task-specific signals through Weak-Task Unique Residual Recovery, and applies an Agent-Guided Behavior-Critical Patch that recovers decisive behaviors under explicit capability protection. AgentPatch produces a single static checkpoint without routing or ensembles. Experiments across six agentic and multimodal benchmarks show that AgentPatch improves diverse merged backbones, alleviates weak-task degradation, and better balances weak-task recovery with the preservation of complementary search and agentic visual processing capabilities. Code is available at https://github.com/ziboshao/AgentPatch.

[78] Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Prunin cs.AI | cs.CVPDF

Yuyao Sun, Tao Deng, Shuang Li, Deqing Wang, Hao Geng

TL;DR: 本文提出了一种名为Middle-layer Attention Prediction (MAP)的方法，用于提升多模态大语言模型（MLLMs）的效率。该方法通过预测中间层的注意力来指导视觉令牌剪枝，从而在推理早期大幅减少需要处理的视觉令牌数量，实现了显著的端到端加速。

Details

Motivation: MLLMs处理大量视觉令牌的计算成本高昂，现有视觉令牌剪枝方法依赖于从预定义中间层获取的注意力，但最优层因样本而异，且计算注意力本身已消耗大量算力。

Result: 在LLaVA-NeXT-7B模型上的十个基准测试中，MAP仅使用5.56%的视觉令牌即可保持未剪枝模型97.5%的性能，实现了3.09倍的端到端加速。

Insight: 创新点在于提出了样本自适应的教师层选择机制（Question Contrastive Teacher Selection）和将选定层注意力蒸馏到轻量级预测器中，使得剪枝决策可在第一个语言模型层之前完成，无需实际计算中间层注意力，并与现有推理加速技术兼容。

Abstract: Multimodal large language models (MLLMs) achieve strong performance across diverse vision-language tasks, but their efficiency is limited by the cost of processing numerous visual tokens. Visual token pruning can reduce this cost, but requires accurate token importance estimates. Recent studies have demonstrated that text-to-vision attention from middle language model layers can effectively guide visual token pruning, typically using attention from a predefined middle layer to select the visual tokens to retain. Two problems therefore remain. First, our analysis shows that the layer whose attention is most responsive to the question varies substantially across samples, making a fixed layer suboptimal. Second, obtaining attention from the appropriate middle layer requires processing numerous visual tokens through several language model layers, by which point considerable computation has already been spent. To address both problems, we propose Middle-layer Attention Prediction (MAP), which uses Question Contrastive Teacher Selection to identify a sample-specific teacher layer by contrasting attention under the original and reference questions, and distills attention from the selected layer into a lightweight predictor that estimates visual token importance from multi-modal input features. During inference, MAP combines the predicted importance scores with a diversity criterion to prune visual tokens before the first language model layer. Thus, MAP requires no attention maps for pruning and remains compatible with existing inference acceleration techniques. Across ten benchmarks on LLaVA-NeXT-7B, MAP retains 97.5% of the unpruned model performance with only 5.56% of the visual tokens, yielding a 3.09x end-to-end speedup.

[79] TaskSense: Focusing on What Matters in World Models cs.AI | cs.CV | cs.LGPDF

SM Mazharul Islam, Manfred Huber

TL;DR: TaskSense是一种面向任务的世界建模框架，通过可微分的随机空间注意力机制，在潜在编码前聚焦于任务相关区域，仅重构被关注的区域，从而鼓励潜在表示保留任务相关信息并丢弃无关视觉内容。

Details

Motivation: 现有视觉控制中的世界模型通常通过重构整个观测来学习紧凑潜在状态，但任务相关内容往往只占观测的一小部分，背景杂乱和干扰物会消耗宝贵的表示能力，导致潜在表示偏向于建模与任务无关的视觉内容，从而稀释了控制相关特征的学习信号，并在视觉干扰下严重降低下游性能。

Result: 在DeepMind Control Suite上，TaskSense保持了与DreamerV3基线相当的性能；在Distracting Control Suite上，TaskSense始终优于DreamerV3，显示出对视觉干扰的鲁棒性显著提升。定性分析进一步证实，在逆动力学监督引导下，学习到的注意力能持续定位控制相关区域并抑制无关视觉内容。

Insight: 创新点在于将任务相关性作为世界建模的核心，通过条件于先前潜在状态的随机空间注意力机制和辅助的逆动力学目标来引导注意力，仅重构被关注区域，从而更有效地利用表示能力并提高对视觉干扰的鲁棒性。从客观角度看，这是一种将注意力机制与基于模型强化学习相结合的新颖方法，有助于解决视觉控制中任务无关信息干扰的长期挑战。

Abstract: World models for visual control typically learn compact latent states by reconstructing observations, implicitly encouraging representations to preserve information across the entire visual input. However, task-relevant content often occupies only a small fraction of the observation, while background clutter and distractors consume valuable representational capacity. This mismatch between visual reconstruction and control objectives biases latent representations to model task-irrelevant visual content, diluting learning signals for control-relevant features and severely degrading downstream performance under visual distractions. We introduce TaskSense, a task-centric world modeling framework that enforces task relevance before latent encoding through a differentiable stochastic spatial attention mechanism conditioned on the previous latent state. To steer attention toward control-relevant regions, we augment training with an auxiliary inverse-dynamics objective. Rather than reconstructing the full observation, the world model reconstructs only the attended regions, encouraging latent representations to preserve task-relevant information while discarding irrelevant visual content. The decoder is further conditioned on the sampled attention map, enabling consistent reconstruction despite stochastic attention. Compared with the DreamerV3 baseline, TaskSense maintains competitive performance on the DeepMind Control Suite while consistently outperforming DreamerV3 on the Distracting Control Suite, demonstrating substantially improved robustness to visual distractions. Qualitative analysis further confirms that the learned attention, guided by inverse-dynamics supervision, consistently localizes control-relevant regions while suppressing irrelevant visual content.

[80] Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts cs.AI | cs.CVPDF

Rulin Zhou, Wanhao Liu, Guoheng Ma, Liangjin Shao, Qiujie Song

TL;DR: 本文提出了Surg-UniWorld，一个统一的多模态控制手术世界模型，用于生成逼真的手术器械与组织交互视频。该方法通过构建层次化手术锚点来保持场景一致性，并利用锚点相对模态专家整合边缘、深度和光流信息，最后通过多模态控制专家指导视频扩散模型生成。

Details

Motivation: 现有可控手术世界模型缺乏统一的多模态控制范式，直接融合异构视觉条件常导致解剖结构失真、器械外观漂移和时间不一致的交互问题。

Result: 在构建的Cholec80-SurgWAM基准测试上，Surg-UniWorld在生成质量、时间一致性和多模态可控性方面持续优于现有的可控视频生成方法和手术世界模型基线。

Insight: 创新点在于引入了层次化手术锚点来维持场景身份和交互边界，并设计了锚点相对模态专家来解耦和整合多模态控制信号，这为复杂手术场景的可控生成提供了统一且鲁棒的框架。

Abstract: Controllable surgical world models can provide a generative foundation for surgical artificial intelligence and simulation by synthesizing realistic instrument–tissue interactions. However, existing methods lack a unified multimodal control paradigm, while direct fusion of heterogeneous visual conditions often causes anatomical distortion, instrument appearance drift, and temporally inconsistent interactions. In this work, we propose {Surg-UniWorld}, a unified surgical world model with multimodal control experts. Surg-UniWorld first constructs a {Hierarchical Surgical Anchor} from first-frame appearance and hierarchical semantic masks to preserve persistent scene identity, anatomical organization, and interaction boundaries. {Anchor-Relative Modality Experts} then interpret edge, depth, and optical-flow evidence relative to the shared anchor, capturing complementary boundary, geometric, and motion information. A {Multimodal Control Expert} further performs contribution-preserving stage-wise composition of the activated modality increments and generates control hints for the Wan2.2 video diffusion backbone. To support multimodal surgical world modeling, we further construct Cholec80-SurgWAM, a benchmark for controllable surgical video generation. Extensive experiments demonstrate that Surg-UniWorld consistently outperforms existing controllable video generation methods and surgical world-model baselines in generation quality, temporal consistency, and multimodal controllability.

[81] From Cheap Fakes to Pure Synthesis: Addressing the New Era of T2V Fake News Videos cs.AI | cs.CV | cs.MMPDF

Yifeng Luo, Yupeng Li, Liang Lan, Tian Wang

TL;DR: 本文针对文本到视频（T2V）生成模型带来的全新威胁——从零合成的假新闻视频，提出了一个新颖的三元分类任务（真实、廉价伪造、纯合成伪造），并构建了首个纯合成假新闻视频数据集（PS-FNVD）。为了解决现有检测器面临的模态对齐陷阱和单模态捷径问题，作者提出了推理引导的T2V假新闻视频检测框架（R-T2V），该框架通过条件化原理生成和监督微调，整合高层语义逻辑与低层物理生成痕迹来进行分类。

Details

Motivation: 动机在于，随着T2V模型的发展，假新闻视频可以从头合成，超越了以往基于现有素材拼接的‘廉价伪造’，这导致现有检测器面临模态对齐陷阱。现有数据集缺乏纯合成伪造视频，且直接使用T2V模型生成对齐样本会使检测退化为利用单模态捷径，并导致语义-视觉退化。

Result: 在10个主流基线模型上进行的大量实验表明，所提出的R-T2V框架实现了最先进的性能，在准确率上超出次优基线12.20个百分点，在宏观F1分数上超出8.46个百分点。

Insight: 论文的主要创新点在于：1) 将T2V假新闻视频检测形式化为一个新颖的三元分类任务，并构建了首个包含两种欺骗类型（捏造事件与真实事件但虚假视觉来源）的纯合成假新闻视频数据集PS-FNVD，旨在防止模型利用单模态捷径；2) 提出了R-T2V框架，通过条件化原理生成来整合语义逻辑与物理生成痕迹进行推理，为检测合成媒体提供了新的思路。

Abstract: Recent text-to-video (T2V) generation models enable fake news videos to be synthesized from scratch, shifting the threat beyond cheap fakes assembled from existing footage. Such news videos can closely match fabricated narratives, creating a modality alignment trap for existing detectors. Existing datasets lack pure synthesis fake news videos. Although directly prompting T2V models with descriptions of fake news videos can yield perfectly aligned samples, it reduces the fake news video detection (FNVD) to unimodal shortcuts and causes semantic-visual degeneration. To counter this, we formulate T2V-FNVD as a novel ternary classification task with three labels (real, cheap fake, and pure synthesis fake) and construct the first pure synthesis fake news video dataset (PS-FNVD). PS-FNVD includes fabricated events with aligned deception (Type 1) and true events with false visual provenance (Type 2), preventing models from exploiting unimodal shortcuts. Furthermore, we propose the Reasoning-guided T2V-FNVD (R-T2V) framework. Trained through conditioned rationale generation and supervised fine-tuning, R-T2V integrates high-level semantic logic with low-level physical generative traces to predict the ternary veracity label. Extensive experiments across 10 prevailing baselines show that R-T2V achieves the state-of-the-art performance, outperforming the second-best baseline by 12.20 percentage points in accuracy and 8.46 percentage points in macro $F_1$.

Yuehao Huang, Yunzi Wu, Xiaotao Zhang, Xinhai Li, Jiankun Dong

TL;DR: 本文提出了WNM-3D，一种用于连续视觉语言导航（VLN）的、具有3D场景条件的世界导航模型。该模型通过一个冻结的几何编码器从单目RGB历史中提取几何感知表示，并利用一个可训练的3D场景到令牌适配器将其转换为世界-动作扩散Transformer中的固定长度前缀，从而为未来视图和动作的联合生成提供共享的几何上下文。

Details

Motivation: 现有基于视觉语言模型（VLM）的视觉语言动作（VLA）策略虽然语义能力强，但其以动作为中心的训练并未显式建模智能体预测运动下其视觉观察应如何演变。现有的生成式世界-动作模型（WAM）在连续VLN中，并未将联合的未来视图和动作生成建立在从观察历史推断出的几何感知表示上。

Result: 在GN-Bench上的实验表明，WNM-3D在闭环导航中优于强大的基于VLM的导航策略及其2D条件对应模型。在一个固定的近目标评估集上，WNM-3D也实现了更高的流-动作一致性和更低的视觉-运动误差。

Insight: 核心创新在于引入了3D场景条件，通过几何编码和适配器将历史观测的几何信息作为共享上下文注入到世界-动作扩散Transformer中，从而联合生成未来视图和动作，提高了导航的几何一致性和闭环性能。其训练流程结合了监督微调、DAgger式适应和基于DanceGRPO的闭环策略优化，也是一个值得借鉴的实践。

Abstract: Recent vision-language navigation (VLN) systems increasingly adapt pretrained vision-language models (VLMs) into vision-language-action (VLA) policies that map egocentric observations and language instructions directly to navigation actions. Although semantically capable, such action-centric training does not explicitly model how the agent’s visual observations should evolve under its predicted motion. Generative world-action models (WAMs) jointly predict future observations and actions, yet existing WAMs for continuous VLN do not condition joint future-view and action generation on geometry-aware representations inferred from the observed history. We present WNM-3D, a generative World Navigation Model with 3D scene conditioning for continuous VLN. To consolidate past observations into persistent scene context, a frozen feed-forward geometry encoder extracts geometry-aware representations from the monocular egocentric RGB history, and a trainable 3D Scene-to-Token Adapter converts them into a fixed-length prefix in the token space of the world-action Diffusion Transformer. Through block-causal attention, this prefix conditions every future video-action block, providing a shared geometric context for both future-view and action generation. We train WNM-3D through supervised world-action fine-tuning on A*-generated demonstrations, DAgger-style adaptation on policy-visited states, and DanceGRPO-based closed-loop policy optimization. Experiments on GN-Bench show that WNM-3D outperforms strong VLM-based navigation policies and its 2D-conditioned counterpart in closed-loop navigation. On a fixed near-goal evaluation set, WNM-3D also achieves higher flow-action consistency and lower visual-motion error.

cs.SE [Back]

[83] CAS2UML: A Handwritten Sketch-to-PlantUML Dataset for Class and Activity Diagrams cs.SE | cs.CVPDF

Simon Scholz, Mersedeh Sadeghi

TL;DR: 本文介绍了CAS2UML，一个公开的手绘草图到PlantUML的数据集，包含557个手绘UML图（271个类图和286个活动图），每个图都配有手动验证的PlantUML代码。该工作还提供了一个基于PlantUML的验证工具和可复用的脚本，用于检查生成的UML工件的语法正确性和可渲染性，旨在支持草图到UML方法的可复现基准测试。

Details

Motivation: 随着大语言模型和多模态AI的兴起，从草图和图像自动生成UML正重新受到关注，但由于缺乏带有可执行真实模型（groundtruth）的公开数据集，可复现的评估仍然困难。

Result: 论文构建并发布了包含557个手绘UML图的数据集，并提供了验证工具和脚本，但摘要中未提及在特定基准上的定量性能结果或与SOTA模型的比较。

Insight: 主要创新点是创建了一个公开的、带有手动验证PlantUML代码的手绘UML数据集，并配套了验证工具和脚本，这填补了草图到UML领域缺乏可执行真实模型数据集的空白，为可复现的基准测试提供了基础设施。

Abstract: Automated UML generation from sketches and images is gaining renewed attention with the rise of large language models and multimodal AI. However, reproducible evaluation remains difficult due to the lack of public datasets with executable groundtruth models. We present CAS2UML, a public dataset of 557 handdrawn UML diagrams, including 271 class diagrams and 286 activity diagrams, each paired with manually validated PlantUML code. We also provide a PlantUML-based validation tool and reusable scripts for checking the syntactic correctness and renderability of generated UML artifacts, enabling reproducible benchmarking of sketch-to-UML approaches. The dataset, validation tool, processing scripts, documentation, and demonstration video are publicly available at: Dataset: https://huggingface.co/datasets/Seym0n /cas2uml_hand-drawn_to_plantuml_dataset; Tool and Scripts: https://github.com/Seym0n/handwritten-uml-dataset; Video: https://www.youtube.com/watch?v=KQrYeGgT3hs.

cs.LG [Back]

[84] Latent Fact-Checking: Detecting Misinformation through Activation Engineering cs.LG | cs.CLPDF

Pedro Barcelos, Otávio Parraga, Marcelo M. Mussi, Lucas M. Fraga, Lucas S. Kupssinskü

TL;DR: 本文提出了一种基于激活工程的潜在事实核查方法，通过对比真实与虚假陈述的激活差异，在语言模型的表示空间中识别出一个‘虚假方向’，并利用该方向对未见声明的最后词元激活进行投影和分类，从而无需微调主干模型或外部知识检索即可检测错误信息。

Details

Motivation: 针对在线错误信息泛滥，现有方法多依赖表层语言特征或外部知识检索，本文旨在探索将真实性作为语言模型表示空间的几何属性，开发一种无需任务特定监督的检测框架。

Result: 在Gemma、Llama和Qwen家族的11个模型（参数量270M至12B）上，于LIAR和FACTors基准测试中，该方法匹配或超越了零样本和少样本提示基线，尤其在较小模型上增益显著；在AVeriTeC上性能有限，归因于其基于证据的标注方案。

Insight: 创新点在于将真实性建模为预训练语言模型潜在空间中线性可分的结构化概念，并通过对比激活加法（CAA）原理提取可解释的虚假方向，为基于检索的流程提供了可解释性驱动的实用补充。

Abstract: The proliferation of misinformation online has driven demand for scalable detection systems. While most existing approaches rely on surface-level linguistic features or external knowledge retrieval, we examine truthfulness as a geometric property of a language model’s representation space. We introduce a misinformation detection framework grounded in activation engineering, which leverages the latent geometry of transformer models. Our approach elicits a misinformation direction in the residual stream by contrasting activations from paired truthful and false statements, following the difference-in-means principle of Contrastive Activation Addition (CAA). At inference time, the last-token activation of an unseen claim is projected onto this direction, and the projected representation is fed to an Multilayer Perceptron (MLP) for classification. The procedure requires no fine-tuning of the backbone model, no external evidence retrieval, and no task-specific supervision beyond the contrastive pairs used to estimate the direction. We evaluate the method across 11 models from the Gemma, Llama, and Qwen families, ranging from 270M to 12B parameters, on three fact-checking benchmarks: AVeriTeC, LIAR, and FACTors. The falsehood direction is recoverable across model scales and architectural families, and last-token projection matches or surpasses zero-shot and few-shot prompting baselines on LIAR and FACTors, with the largest gains observed for smaller models. Performance on AVeriTeC is more limited, which we attribute to its evidence-grounded labeling scheme. These findings provide evidence that truthfulness is a structured, linearly separable concept in the latent space of pretrained language models, and point toward interpretability-driven misinformation detection as a practical complement to retrieval-based pipelines. The code is available on https://github.com/Malta-Lab/LaFaCt.

[85] Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning cs.LG | cs.CLPDF

Haoyu Zheng, Yun Zhu, Qing Wang, Wenqiao Zhang

TL;DR: 本文提出了TRIAL（轨迹相对后见蒸馏）框架，用于解决智能体强化学习中后见信号在轨迹回合间分配不明确的问题。该框架通过统一的回合对齐评分协议，提取每个决策回合已实现结果的视图，并在普通和后见条件下评估相同响应，从而生成令牌级监督信号。

Details

Motivation: 现有基于后见的智能体强化学习方法利用稀疏结果奖励，但一个完整的轨迹会产生大量此类信号，导致难以在多个决策回合间进行适当分配。本文旨在解决后见监督信号在时间步上的分配问题。

Result: 在WebShop和ALFWorld环境上使用不同骨干模型的实验表明，TRIAL在所有八种骨干模型、环境和评估指标组合中均优于GRPO方法，并在六种组合中取得最佳或并列最佳性能。例如，在WebShop上使用Qwen3-1.7B模型时，成功率从56.4%提升至75.2%，任务得分从78.7%提升至85.7%。

Insight: 创新点在于提出了轨迹相对的后见蒸馏框架和统一的回合对齐评分协议，通过计算对数概率差距来确定令牌级监督的方向和强度，并基于已实现轨迹对回合级幅度进行联合归一化。这确保了监督信号在回合间的重新分配，同时保持平均乘数不变，从而超越了仅使用密集后见蒸馏的增益。

Abstract: Recent agentic reinforcement learning methods use hindsight to complement sparse outcome rewards. However, a completed rollout can yield many such signals, leaving their appropriate allocation across turns unclear. We introduce TRIAL, a trajectory-relative hindsight distillation framework with a unified turn-aligned scoring protocol. For each decision turn, TRIAL extracts an outcome view of that decision’s realized consequence and evaluates the same response under ordinary and hindsight-conditioned contexts. The signed log-probability gap determines the direction and local strength of token-level supervision, while turn-level magnitudes are normalized jointly over the realized trajectory. The resulting allocation multipliers have an eligible-token-weighted mean of one, redistributing dense supervision across turns while fixing its average multiplier. Experiments on WebShop and ALFWorld with different backbones show that TRIAL outperforms GRPO across all eight combinations of backbone, environment, and evaluation metric, while achieving the best or tied-best performance among six methods on six of them. On WebShop with Qwen3-1.7B, TRIAL improves the success rate from 56.4% to 75.2% and the task score from 78.7% to 85.7%. Controlled ablations further show that trajectory-relative turn allocation provides substantial gains beyond those of dense hindsight distillation alone.

[86] Walkable to Whom? Capturing Subjective Variability in Walkability Perception Using Multimodal Deep Learning cs.LG | cs.CVPDF

Moloud Damandeh, Meead Saberi

TL;DR: 本文针对步行适宜性感知的主观差异性，构建了一个包含29,870个评分和1,196名受访者属性的数据集，并提出了首个用户条件多模态深度学习框架。研究发现人行道视角图像比街景图像获得更高步行性评分，且融合用户特征的模型相比仅使用图像的基线在排名一致性上提升了65%。

Details

Motivation: 现有研究常将多样化的步行性判断简化为聚合分数，并隐含地假设感知是统一的，且通常依赖不能反映行人视觉体验的车载街景图像。

Result: 在步行性感知预测任务中，用户条件模型相比仅使用图像的基线，二次加权Kappa系数从0.29提升至0.47，排名一致性提高了65%。

Insight: 创新点在于首次提出了用户条件多模态框架，将视觉特征与受访者表征融合，证明了评估者身份本身具有超越图像内容的预测价值，支持从聚合的、独立于观察者的评分转向能代表多样化用户的模型。

Abstract: Visual perception of walkability varies substantially across individuals, reflecting differences in personal characteristics, experiences, and preferences. Existing studies, however, often reduce these diverse judgements to aggregated scores, implicitly assuming uniform perception, and commonly rely on vehicle-mounted street-view imagery that does not reflect the pedestrian’s visual experience. This paper introduces a dataset of 29,870 walkability ratings from 1,196 respondents, linking sidewalk-view imagery across urban, suburban, and regional Australian environments with individual rater attributes, and proposes the first user-conditioned multimodal deep learning framework for walkability perception, fusing visual features with respondent-level representations. A viewpoint-comparison study shows that sidewalk-view images receive significantly higher walkability ratings than matched street-view images, indicating that imagery source is a substantive design decision in perception surveys. The user-conditioned model improves rank agreement with observed ratings by 65% over an image-only baseline (quadratic weighted kappa 0.47 vs. 0.29), demonstrating that who is evaluating an environment carries predictive indication beyond image content alone. These findings support moving from aggregated, observer-independent walkability scores toward models that represent diverse users, enabling more inclusive assessment of pedestrian environments.

[87] An AI4AI Framework for Visual Token Pruning cs.LG | cs.CVPDF

Zhen Liu, Wenli Huang, Wei Song, Yuhan Liu, Zhiqin Yang

TL;DR: 本文提出了一个名为AutoPrune的AI4AI框架，旨在利用大型语言模型（LLM）自动设计有效的视觉令牌剪枝策略，以减少多模态大语言模型（MLLMs）的推理成本。其核心是引入了一个包含131个可重用原子的令牌剪枝领域特定语言（TPDSL），将搜索状态表示为对强基础策略的残差修改，从而缩小搜索空间并引导LLM关注关键性能组件。实验表明，即使移除94.4%的视觉令牌，AutoPrune仍能保持超过99%的完整令牌性能，并显著降低计算开销。

Details

Motivation: 现有的视觉令牌剪枝方法主要依赖固定的手工启发式规则和昂贵的专家试错，随着剪枝目标、预算和模型架构的多样化，手动探索不断扩大的设计空间变得日益困难。本文旨在解决一个核心问题：能否利用LLM自动设计有效的视觉令牌缩减算法？

Result: 在14个多模态基准测试和三个MLLM骨干网络上进行的实验证明了AutoPrune的有效性、效率和可迁移性。具体而言，即使移除94.4%的视觉令牌，AutoPrune仍能保持超过99%的完整令牌性能，同时将FLOPs减少9.9倍，并将预填充延迟降低6.4倍，达到了SOTA水平。

Insight: 论文的创新点在于提出了一个训练无关的LLM驱动剪枝策略设计框架，其关键洞察是设计一个恰当的搜索状态表示（即TPDSL），将LLM的内部知识与视觉令牌剪枝的结构要求和约束连接起来。特别是采用残差修改的表示形式，有效缩小了搜索空间并引导LLM聚焦于对性能最关键的策略组件，这为利用LLM的通用知识解决特定领域优化问题提供了一种可借鉴的范式。

Abstract: Visual-token pruning can substantially reduce the inference cost of multimodal large language models (MLLMs), yet existing methods largely rely on fixed, handcrafted heuristics and costly expert trial and error. As pruning objectives, budgets, and model architectures diversify, manually navigating the expanding design space becomes increasingly difficult. This paper aims to build an AI4AI framework for visual-token pruning by addressing a natural question: Can large language models automatically design effective visual-token reduction algorithms? Although LLMs possess broad algorithmic knowledge and strong reasoning capabilities, translating such general knowledge into effective solutions for a specialized task remains nontrivial. We argue that the key lies in designing an appropriate search-state representation that connects the internal knowledge of LLMs with the structural requirements and constraints of visual-token pruning. Based on this insight, we propose AutoPrune, a training-free framework for LLM-driven visual-token pruning policy design. At its core, AutoPrune introduces a Token Pruning Domain-Specific Language (TPDSL) comprising 131 reusable atoms for budget control, token scoring, selection constraints, and token reassembly. A key property of TPDSL is that it represents each search state as a residual modification of a strong base policy. This residual formulation narrows the search space and directs the LLM’s attention toward the policy components that are most consequential for performance. Experiments on 14 multimodal benchmarks and three MLLM backbones demonstrate the effectiveness, efficiency, and transferability of AutoPrune. Even when removing 94.4% of visual tokens, AutoPrune preserves more than 99% of full-token performance while reducing FLOPs by 9.9x and prefill latency by 6.4x.

eess.IV [Back]

[88] IceHorizon: A Dataset for Horizon Detection in Ice-Covered Maritime Environments and Comparative Evaluation of Detection Methods eess.IV | cs.CV | cs.LGPDF

Alisa Pesotskaia, Emin Zerman

TL;DR: 本文提出了一个名为IceHorizon的新数据集，用于评估冰覆盖水域环境下的地平线检测算法。论文对六种地平线检测方法（包括四种经典计算机视觉方法和两种结合深度学习与经典线检测的混合方法）进行了比较评估。结果表明，混合方法在检测精度和可靠性方面表现最佳，而经典方法在视觉模糊场景中鲁棒性较差。

Details

Motivation: 在冰覆盖水域进行地平线检测对于海上导航至关重要，但由于水天对比度低、冰结构杂乱以及光照条件多变，这是一个具有挑战性的问题。

Result: 在IceHorizon数据集（包含30个船载和8个无人机视频）上的评估显示，混合方法实现了最高的检测精度和最可靠的地平线估计。船载图像的检测性能始终优于无人机图像，表明性能对采集特性有很强的依赖性。

Insight: 论文的主要创新点在于创建并公开了首个专门针对冰覆盖水域环境的公开地平线检测数据集（IceHorizon）。从客观角度看，将深度学习与经典线检测相结合的混合方法被证明是该特定挑战性环境下的有效策略，为相关领域提供了新的基准和工具。

Abstract: Horizon detection in images of ice-covered waters is a challenging problem for maritime navigation due to low contrast between water and sky, cluttered ice structures, and varying illumination conditions. This paper presents a comparative evaluation of six horizon detection algorithms, including four classical computer vision methods and two hybrid approaches combining deep learning with classical line detection. A new bespoke IceHorizon dataset consisting of 30 ship-based and 8 drone-based videos is used to evaluate detection accuracy, horizon coverage, and computational performance. The results show that hybrid methods achieve the highest accuracy and most reliable horizon estimates. In contrast, purely classical methods exhibit reduced robustness, particularly in visually ambiguous scenes. Performance on ship-based imagery was consistently higher than on drone-based imagery, indicating a strong dependency on acquisition characteristics. The created dataset and codes used in this study are made publicly available to support further research on this topic. The code is available at https://github.com/allythe/HorizonDetection. The dataset is available at https://doi.org/10.5281/zenodo.20411867

cs.RO [Back]

[89] AtlasVLA: Persistent World-Ego State Modeling for Vision-Language-Action Models cs.RO | cs.CVPDF

Guiyu Zhao, Longteng Guo, Yanghong Mei, Zilin Zhu, Yu Zhang

TL;DR: 本文提出了AtlasVLA框架，旨在解决视觉-语言-动作模型在部分可观测和长时程任务中的局限性。该框架通过引入持久的世界-自我状态建模，将反应式操作范式转变为主动推理范式，其核心是包含4D持久世界状态记忆和自我工作状态记忆的双记忆架构。

Details

Motivation: 现有VLA模型本质上是反应式的，在单腕戴摄像头场景下，会因物体离开视野而出现感知遗忘，并在多步执行中出现任务进度遗忘，这严重限制了其在部分可观测和长时程任务中的性能。

Result: 在LIBERO、RLBench和真实世界基准上的广泛评估表明，AtlasVLA仅使用腕戴摄像头就实现了最先进的性能。它在LIBERO-Long上绝对成功率提升9.4%，在真实世界长时程任务上提升17.5%，显著优于多视角基线模型。

Insight: 主要创新点在于提出了一个双记忆架构，将瞬态2D观测提升为全局更新的体素哈希空间状态以解决视觉盲点，并跟踪历史自我状态和任务进度。通过将扩散变换器（DiT）建立在这个联合的世界-自我状态之上，实现了鲁棒的空间推理，从而克服了感知和任务进度遗忘的瓶颈。

Abstract: While Vision-Language-Action (VLA) models have advanced embodied AI, their fundamentally reactive paradigm severely limits performance in partially observable and long-horizon tasks. When restricted to a single wrist-mounted camera, they inevitably suffer from perception forgetting as objects exit the field of view, and temporal task-progress forgetting} during multi-step execution. To overcome these bottlenecks, we propose AtlasVLA, a novel framework that transitions from direct reactive manipulation to proactive reasoning through a persistent world-ego state. AtlasVLA features a dual-memory architecture: a 4D Persistent World State Memory that lifts transient 2D observations into a globally updated, voxel-hashed spatial state to resolve visual blind spots, and an Ego-Working State Memory that tracks historical ego state and task progress. By conditioning a diffusion transformer (DiT) on this joint World-Ego state, AtlasVLA enables robust spatial reasoning. Extensive evaluations across LIBERO, RLBench, and real-world benchmarks demonstrate that AtlasVLA achieves state-of-the-art performance using solely a wrist camera. Remarkably, it decisively outperforms multi-view baselines, yielding absolute success rate improvements of 9.4% on LIBERO-Long and 17.5% in real-world long-horizon tasks.

[90] AutoIntervene: Calibrated Intervention for Action-Chunking Imitation Learning Policies cs.RO | cs.AI | cs.CV | cs.HC | cs.LGPDF

Jinhe Tang, Weiming Zhi

TL;DR: 本文提出AutoIntervene框架，用于在线校准动作分块模仿学习策略的干预。该框架通过视觉-动作支持记忆评估策略生成的动作块，在策略与操作员之间选择性切换控制，并利用保留的成功演示数据校准切换阈值，以减少操作员干预时间并提高任务成功率。

Details

Motivation: 动作分块视觉运动策略在部署时可能因感知错误和执行漂移而偏离演示分布，导致生成与观察状态不一致的平滑动作序列，需要一种自动化的干预机制来确保策略的鲁棒性。

Result: 在真实世界双手操作任务上的实验表明，相比手动干预，该方法在适应后取得了更高的任务成功率和更低的操作员控制时间。

Insight: 创新点在于结合视觉相似性与动作一致性构建支持记忆来评估动作块，并利用经验分位数自动校准双向切换阈值，避免了手动调参；同时，干预片段被保留用于后续策略更新，实现了在线纠正监督。

Abstract: Action-chunking visuomotor policies learn from demonstrations and improve temporal consistency by predicting short action sequences rather than single-step commands. Yet perception errors and execution drift can move the robot outside the demonstration distribution, while the policy continues to produce smooth action chunks that are inconsistent with the observed state. We present AutoIntervene, an online framework that selectively transfers control between an action-chunking policy and an operator during deployment. AutoIntervene evaluates proposed chunks against a visual-action support memory built from successful task executions, combining visual similarity with consistency between proposed and reference actions. Phase-local support governs policy-to-operator transfer within the current task phase, whereas global support governs the return to policy control after operator recovery. We calibrate separate switching thresholds for the two directions from empirical quantiles of evaluation-level scores on held-out expert demonstrations, avoiding direct manual tuning of score cutoffs. Intervention segments retained from successful rollouts target learner-induced states and provide corrective supervision for subsequent policy updates. Experiments on real-world bimanual manipulation tasks show higher post-adaptation task success and lower operator-control time than manual intervention. Videos and additional results are available at https://aus.bot/research/autointervene/.

[91] C2Dex: Contact-Consistent Reconstruction and Retargeting for Dexterous Manipulation from Monocular Video cs.RO | cs.CVPDF

Jie Ren, Zhehao Jiang, Yinhong Yang, Haorui Jia, Han Jiang

TL;DR: C2Dex是一个从单目视频到灵巧机器人操作的框架，旨在解决人类演示视频向机器人迁移的挑战。它通过构建一个共享的交互表示——在规范物体空间中聚合噪声帧级观测得到的稳定物体侧接触点——来同时指导人类手-物交互的重建和向机器人手的重定向。

Details

Motivation: 灵巧机器人操作的高质量演示数据收集成本高且困难，而单目人类视频提供了可扩展的多样化操作行为来源。然而，将此类演示迁移到灵巧机器人上仍面临挑战：单目手-物交互重建常产生时间上不稳定的接触和物理上不合理的交互，而传统重定向方法难以在不同手形态之间保持任务相关的接触和局部交互几何。

Result: 在DexYCB和TACO数据集上的实验表明，C2Dex分别实现了57.78%和26.67%的端到端轨迹成功率，在相同评估标准下显著优于最强的基线方法（17.78%和10.00%）。真实机器人回放实验进一步证明了其在多种接触丰富的操作任务中的物理可行性。

Insight: 核心创新在于提出了一个共享的、基于稳定物体侧接触点的交互表示，该表示同时作为重建的轨迹级约束和重定向的明确目标。方法结合了拉普拉斯交互优化来保持跨形态的局部手-物几何，以及残差强化学习在仿真中细化轨迹，实现了从单目视频到机器人操作的高质量、物理合理的迁移。

Abstract: High-quality demonstrations for dexterous robot manipulation are costly and difficult to collect, whereas monocular human videos provide a scalable source of diverse manipulation behaviors. However, transferring such demonstrations to dexterous robots remains challenging: monocular hand-object interaction (HOI) reconstruction often produces temporally unstable contacts and physically implausible interactions, while conventional retargeting methods struggle to preserve task-relevant contacts and local interaction geometry across different hand embodiments. We present C2Dex, a video-to-dexterous-manipulation framework built around a shared interaction representation: stable object-side contacts recovered by aggregating noisy frame-wise observations in the canonical object space. These stable contacts serve a dual role: as trajectory-level constraints that guide reconstruction toward temporally coherent and physically plausible human HOI trajectories, and as explicit transfer targets for the dexterous hand, where Laplacian interaction optimization preserves the local hand-object geometry across embodiments and residual reinforcement learning refines the trajectory in simulation. Experiments on DexYCB and TACO show that C2Dex achieves end-to-end trajectory success rates of 57.78% and 26.67%, respectively, substantially outperforming the strongest baselines (17.78% and 10.00%) under identical evaluation criteria. Real-robot replay experiments further demonstrate physical feasibility across diverse contact-rich manipulation tasks. Project page: https://k-jie.github.io/C2Dex/

[92] TEMPO: Semantic-Action Decoupled RL Post-Training for Vision-Language-Action Models cs.RO | cs.CVPDF

Ziheng Liu, Quantao Yang

TL;DR: 本文提出TEMPO框架，一种用于视觉-语言-动作（VLA）模型的语义-动作解耦双时间尺度强化学习后训练方法。该方法冻结预训练的视觉-语言主干以保留通用语义表示，并分别以不同频率更新语义投影层和底层动作专家，从而在保持高层语义稳定的同时高效学习控制策略。

Details

Motivation: 现有VLA模型在下游操作任务中通常采用监督微调（SFT）或在线强化学习（RL）后训练，但SFT存在分布不匹配问题，而现有RL方法对所有模型组件采用统一的更新策略，忽略了它们不同的功能角色。

Result: 在CALVIN基准测试和真实世界操作任务上的实验表明，TEMPO持续优于预训练的最先进VLA模型和RL后训练基线，并在两个真实世界任务上达到并维持更高的评估奖励。

Insight: 创新点在于将语义表示与动作学习解耦，通过冻结主干、双组件差异化更新（语义投影层低频更新以保持潜在动作稳定，动作专家高频更新以快速吸收在线交互反馈）的策略，解决了RL后训练中策略快速更新可能破坏高层语义表示稳定性的问题，实现了更高效、稳定的策略适应。

Abstract: Vision-language-action (VLA) models are commonly adapted to downstream manipulation tasks via supervised fine-tuning (SFT) or online reinforcement learning (RL) post-training. SFT is prone to distribution mismatch, and existing RL approaches typically apply a single, uniform update strategy to all model components, ignoring their distinct functional roles. We propose TEMPO, a semantic-action decoupled, two-timescale RL post-training framework for VLA models. TEMPO freezes the pretrained vision-language backbone to preserve general semantic representations, and restricts adaptation to two components with dedicated RL optimization loops: the semantic projection layer and the low-level action expert. We update them at different rates–the semantic projection layer infrequently, to keep the latent action stable, and the action expert frequently, to rapidly incorporate control feedback from online interaction. This decoupling RL fine-tuning strategy prevents fast policy updates from destabilizing high-level semantic representations while still allowing the action expert to learn efficiently from online feedback. Experiments on the CALVIN benchmark and real-world manipulation tasks demonstrate that TEMPO consistently outperforms both pretrained state-of-the-art VLA models and the RL post-training baseline, while reaching and maintaining higher evaluation rewards on two real-world tasks.

[93] Depth-Wise Probing and Pruning of the Planning Token in a Driving Vision-Language-Action Model cs.RO | cs.CVPDF

Harisankar Babu, Benjamin Coors, Christopher Lang, Hendrik Berkemeyer, Tamim Asfour

TL;DR: 本文研究了一种驾驶视觉-语言-动作（VLA）模型，该模型通过一个单一的规划令牌来承载驾驶决策。作者通过将生成式规划器作为轨迹空间的‘logit lens’，从模型的32个解码器层中逐层解码该令牌，以探究规划信息在不同网络深度中的表征方式。研究发现，导航命令的语义意图在早期层即可线性解码，而轨迹与固定规划器的兼容性则随深度逐渐改善。基于此，作者提出了一种基于规划令牌角度偏差的层剪枝方法，可在性能损失约5%的情况下移除8层，实现1.33倍的解码加速。

Details

Motivation: 动机在于探究驾驶VLA模型中，驱动最终动作的决策信息究竟需要多深的网络层来承载。具体来说，研究聚焦于一个由单一‘规划令牌’传递完整驾驶计划的模型，旨在理解规划信息在模型不同深度中的表征和演化过程。

Result: 在ORION模型检查点和Bench2Drive基准测试设置下，实验结果显示：导航命令的线性探测准确率在第一层解码器后即达到97.7%（随机基线为16.7%）；而轨迹与固定规划器的开环平均L2误差（Avg-L2）则随深度递减，仅在最后一层达到最小值2.11米。通过剪枝8个解码层，在开环误差相对增加约5%的约束下，实现了1.33倍的解码速度提升，且在评估样本量下未观察到统计显著的特定类别性能下降。

Insight: 论文的核心创新点在于提出了一种针对驾驶VLA模型中‘规划令牌’的深度诊断与剪枝框架。关键洞察是：语义意图信息在模型浅层就已完备编码，而动作规划所需的、与特定规划器兼容的表示则需要更深层的网络来‘塑造’。这启发了基于信息表征格式（而非信息存在性）的、任务感知的模型压缩方法，即通过分析中间表示与目标输出空间的兼容性来指导剪枝。

Abstract: Vision-language-action (VLA) models route driving decisions through a deep language model, but it is unclear how much of that depth the action itself requires. We study a representative driving VLA whose entire plan is carried by a single planning token that a generative planner decodes into a trajectory. Borrowing the planner as a trajectory-space logit lens, we decode the planning token from every one of the 32 decoder layers and measure two signals: the linear decodability of the navigation command and trajectory compatibility with the frozen native planner. Our diagnostic shows that semantic intent is linearly decodable early: command-probe accuracy reaches 97.7% after the first decoder layer, compared with 16.7% chance. In contrast, compatibility with the frozen native planner improves gradually across depth, with open-loop Avg-L2 reaching its minimum of 2.11,m only at the final layer. Learned readouts from the first layer recover much of this gap, indicating that planning information is already present early but is not yet represented in the format expected by the deployed planner. Ranking decoder layers by the angular deviation they induce in the planning token permits removal of 8 of 32 layers within an approximately 5% relative open-loop error increase and yields a measured 1.33$\times$ decoder speedup. At the evaluated sample size, no family-specific degradation is statistically resolved. These findings are limited to the evaluated ORION checkpoint and Bench2Drive setup.

cs.HC [Back]

[94] DREAMS: Diverse Reactions of Engagement and Attention Mind States Dataset cs.HC | cs.CVPDF

Monisha Singh, Gulshan Sharma, Ximi Hoque, Abhinav Dhall

TL;DR: 本文介绍了DREAMS数据集，该数据集包含32名用户在自然环境下观看不同刺激物时的面部视频，旨在研究用户参与度和注意力状态之间的关系。作者将问题建模为分类任务，探索了单任务、迁移学习和多任务学习设置，并发现迁移学习和多任务学习在预测参与度状态时表现更好，且更高的参与度和注意力与更低的认知负荷和更好的任务表现相关。

Details

Motivation: 研究用户参与度和注意力之间的关系，以改善学习体验，因为两者是不同但紧密相关的概念，可以相互影响。

Result: 在分类任务中，迁移学习和多任务学习在预测参与度状态时比单任务学习表现更好；更高的参与度和注意力状态与更低的认知负荷和更好的任务表现相关。

Insight: 通过构建DREAMS数据集并采用多任务学习框架，联合建模参与度和注意力，揭示了它们之间的关联及其对认知负荷和任务表现的影响，为理解用户状态提供了新的数据和方法视角。

Abstract: Active attention and engagement are important in improving users’ learning experiences. Engagement refers to the level of involvement and interest individuals show towards a particular task. Attention, on the other hand, refers to a state where someone is entirely focused on a particular task with conscious awareness. Engagement and attention are different but closely linked concepts and can influence each other bidirectionally. To explore the relationship between user engagement and attention, we introduce the Diverse Reactions of Engagement and Attention Mind States (DREAMS) dataset. The dataset includes facial video recordings of 32 users in naturalistic settings watching various stimuli to evoke diverse emotions. We then analyze user engagement and attention states in these videos by framing it as a classification problem, exploring single-task, transfer learning task, and multi-task settings. In single and transfer learning task settings, separate networks are applied to predict engagement and attention states. Whereas in multi-task settings a shared network is applied, which jointly learns to predict both engagement and attention states. Moreover, we examine participants’ performance on video-based questionnaires and evaluate their perceived cognitive workload. In our findings, we observe (a) better classification performance in predicting engagement states in both transfer and multi-task learning compared to single-task learning and (b) higher engagement and attention states correlate with lower cognitive load and improved task performance. The dataset and the code are publicly available and can be accessed through https://sites.google.com/view/dreams-dataset/dataset.

Table of Contents

cs.CL [Back]

[1] TEXAS: Task-Expert-Aware Supervision for Downstream Mixture-of-Experts LLM Adaptation cs.CL | cs.AIPDF

[2] NTDH: Complex Reasoning for Comprehensive Affective Analysis cs.CL | cs.LGPDF

[3] GRASP: Reinforcing Language Model Anonymizers with Group Relative Policy Optimization cs.CLPDF

[4] Confidence Estimation for Financial Vision-Language Models in Chart and Document Understanding cs.CLPDF

[5] Discovering Conceptual Metaphors Across Topics and Media Types cs.CLPDF

[6] The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents cs.CLPDF

[7] Stockmark-Nemotron-3-Nano-Omni-JapanDocReader: Structured Document Parsing via Capability Injection and Forgetting Control cs.CLPDF

[8] Multi-Perspective Triad Interaction Graph Neural Network for Cognitive Distortion Detection cs.CLPDF

[9] Simple-OPD: Demystifying Warm-up for On-policy Distillation cs.CLPDF

[10] FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding cs.CL | cs.AIPDF

[11] LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers cs.CLPDF

[12] PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue cs.CL | cs.AIPDF

[13] Confirming Our Biases? Evaluating the Capabilities, Risks, and Societal Impact of Large Language Models cs.CLPDF

[14] Does More Retrieved Evidence Help Visual Retrieval-Augmented Generation with Diffusion Language Models? cs.CL | cs.CVPDF

[15] Stoicheia: Character-Level Masked Diffusion for Ancient Greek Textual Restoration, Parsing, and Metrical Scansion cs.CLPDF

[16] Why Knowing Both Hops Is Not Enough: Understanding Two-Hop Generalization in Language Models cs.CLPDF

[17] Gaze Behavior in Visual World Experiments Can be Modeled With Off-the-shelf Language-Vision Encoders cs.CL | cs.CVPDF

[18] CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity cs.CL | cs.AIPDF

cs.CV [Back]

[19] TransSLR: A Lightweight Transformer for Sign Language Recognition cs.CV | cs.AIPDF

[20] Deep Evidential Regression for Sparse Forest Height Estimation from Multimodal Satellite Imagery cs.CV | cs.LGPDF

[21] InsertFuse: A Unified Framework for Multi-Category Reference-Guided Image Insertion cs.CVPDF

[22] Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition cs.CVPDF

[23] SLED: Scalable Location Encoding via Distillation cs.CV | cs.AIPDF

[24] CoDAT: Collaborative Dual-Attention Transformer with Low-Cost Temporal Modeling for Efficient Edge Action Recognition cs.CVPDF

[25] When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning cs.CVPDF

[26] Corrupting Attention: Evasion-Based Adversarial Attacks on Encoder Attention in Detection Transformers cs.CV | cs.LGPDF

[27] Suppress and Diversify: Refining Robust Pathways for Corruption Robustness cs.CVPDF

[28] Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models cs.CVPDF

[29] GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models cs.CVPDF

[30] AnyTrack: Unifying Visual Object Tracking with Any Modalities cs.CVPDF

[31] UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow cs.CVPDF

[32] PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model cs.CVPDF

[33] ECAD: Expanding Class-Agnostic Detection Beyond Thing-Centric Objectness cs.CVPDF

[34] RegionDet: A Benchmark for Region Detection Beyond Object Instances cs.CVPDF

[35] Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection cs.CV | cs.AI | cs.MAPDF

[36] DAEP: Difficulty-Aware Evidence Planning for Medical Video Corpus Temporal Answer Grounding cs.CV | cs.CLPDF

[37] FedVAR: Prototype-Aligned Federated Framework for Video Anomaly Recognition cs.CV | cs.AI | cs.DC | cs.LGPDF

[38] ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPE cs.CVPDF

[39] Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models cs.CV | cs.LGPDF

[40] Vernata: Self-Supervised Learning of LiDAR Point Representations cs.CV | cs.ROPDF

[41] MuST-VAD: Mutual Structured Learning for Video Anomaly Detection cs.CVPDF

[42] AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Reward cs.CVPDF

[43] Debias in Text, Believe Your Eyes: Text-Anchored Cross-Modal Transfer for Visual Counter-Commonsense Reasoning cs.CV | cs.AIPDF

[44] Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removal cs.CVPDF

[45] Summarize First, Download Later: Onboard VLMs for Bandwidth-Efficient Earth Observation cs.CVPDF

[46] Generative Embedding Benchmark: How Much Information Survives in a Dense Embedding? cs.CVPDF

[47] When One Modality Is Not Enough: Multimodal Sex and Life-Stage Classification of Red Deer from Aerial RGB-Thermal Video cs.CVPDF

[48] Scenix: Sparse-View 3D Scene Reconstruction via Executable Scene Programs cs.CVPDF

[49] Stable Curves, Unstable Items: Item-Level Scaling Heterogeneity in Video LLMs cs.CVPDF

[50] Understand Before Detect: Vision–Language Learning for Omni-Domain Infrared Small Target Detection cs.CVPDF

[51] Explanation Stability of Test-Time Adaptation in Computational Pathology: A Large-Scale Benchmark cs.CVPDF

[52] RoRA: Role-Oriented Regional Allocation for Visual Token Pruning in MLLMs cs.CV | cs.AIPDF

[53] Geometry-Aware Camera Localization for Bronchoscopy cs.CV | cs.AIPDF

[54] Multiple Hypothesis Flow Estimation for Video Frame Interpolation under Matching Ambiguity cs.CVPDF

[55] Beyond Fluency: A Clinical Benchmark and Anomaly-Enhanced Baseline for Spine MRI Report Generation cs.CVPDF

[56] Human-AI Perceptual Alignment by Playing Hues and Cues cs.CVPDF

[57] Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation cs.CV | cs.AIPDF

[58] Foundation Models Adaptation for Multi-View Multi-modal Cardiac MRI Segmentation and Direct Ejection Fraction Estimation cs.CVPDF

[59] EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation cs.CV | cs.AIPDF

[60] Same Attention, Different Truths: Put Logit-Lens over Visual Attention to Detect and Mitigate LVLM Object Hallucination cs.CV | cs.AIPDF

[61] GeoDistill-Refine: Silhouette-First Geometry Distillation for Annotation-Free Spacecraft Segmentation cs.CV | cs.AIPDF

[62] Addressable Memory for Video World Models cs.CV | cs.LGPDF

[63] UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modeling cs.CVPDF

[64] I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning cs.CV | cs.AIPDF

[65] Conformal Coverage Guarantees for Any Video Temporal Grounder cs.CV | cs.IRPDF

[66] MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation cs.CV | cs.LGPDF

[67] SimWAM: A Simple World Action Model for End-to-End Autonomous Driving cs.CVPDF

[68] SABRE: Scalable and Automated Benchmarking of VLMs under Stress cs.CV | cs.AI | cs.CLPDF

cs.CR [Back]

[69] Model Confidence Under Answer-Preserving Attacks: An Informativeness-Manipulability Frontier cs.CR | cs.CLPDF

[70] Retrieval-Constrained Policy Optimization for Attack Technique Extraction from Cyber Threat Intelligence cs.CR | cs.CLPDF

cs.AI [Back]

[71] ADIAS: Automated Design of Interactive Agentic Systems cs.AI | cs.CL | cs.MAPDF

[72] Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding cs.AI | cs.CL | cs.MMPDF

[73] IB-RL: Isolated Bilateral Reinforcement Learning for Strategic Dialogue Agents cs.AI | cs.CLPDF

[74] DocMemo: Dynamic Evidence Discovery via Probabilistic Memory-Guided Retrieval for Multi-Modal Document Understanding cs.AI | cs.CL | cs.IR | cs.MMPDF

[75] GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks cs.AI | cs.CL | cs.IR | cs.LGPDF