cs.CL [Total: 29]
cs.CV [Total: 67]
astro-ph.SR [Total: 1]
cs.AI [Total: 5]
cs.CR [Total: 1]
cs.HC [Total: 1]
cs.LG [Total: 5]
cs.RO [Total: 6]

cs.CL [Back]

[1] Rethinking Structured Generation: Can Graph-Based Reasoning Resolve Ambiguity? cs.CL | cs.AIPDF

Ratun Rahman, Atit Pokharel

TL;DR: 论文重新审视结构化生成中“输入到单一结构化输出”的确定性假设，指出自然语言输入常存在多种语义有效但结构不同的解释。作者将任务重构为歧义感知推理问题，采用保留多有效答案的多有效学习框架，并将候选结构化输出表示为图，通过语义对齐和关系一致性进行图推理选择。

Details

Motivation: 现有结构化生成方法依赖单参考监督，把输入中的歧义压缩为单一预测，导致在欠指定输入下输出不稳定、不一致，并抑制其他合法解释。

Result: 在结构化生成基准上，该方法在准确性、稳定性和不同歧义程度下的鲁棒性方面均取得一致提升；摘要未给出具体数值或SOTA声明。

Insight: 创新点在于显式建模结构化生成中的歧义，从单输出预测转向集合级推理；用图表示候选输出并基于语义对齐与关系一致性选择，相比token级似然比较更具原则性。

Abstract: Structured generation is typically formulated as a deterministic mapping from input to a single structured output. This assumption is fundamentally misaligned with natural language, which often admits multiple structurally distinct yet semantically valid interpretations. As a result, existing methods rely on single-reference supervision that collapses ambiguity into one prediction, leading to unstable and inconsistent outputs under underspecified inputs. We reformulate structured generation as an \textit{ambiguity-aware inference problem}, where the objective is to reason over a set of plausible structured outputs rather than predict a single solution. We show that standard training inherently suppresses valid alternatives, and instead adopt a multi-valid learning framework that preserves ambiguity during optimization. To operationalize this formulation, we construct a candidate space of structured outputs, represent each candidate as a graph capturing entities and their relationships, and perform selection via graph-based reasoning over semantic alignment and relational consistency. This enables principled comparison across competing interpretations beyond token-level likelihoods. Experiments on structured generation benchmarks demonstrate consistent improvements in accuracy, stability, and robustness under varying levels of ambiguity. These results highlight the importance of modeling ambiguity explicitly and suggest a shift from single-output prediction to set-level reasoning in structured generation.

Thanushi Withanage, Desi Jones, Noah Sasson, Elizabeth Redcay, Carol Espy-Wilson

TL;DR: 该论文旨在预测自闭症与非自闭症个体在自发双人互动中感知到的对话成功程度。研究利用发音、面部、声学韵律和轮流发言等多模态特征，在三个包含自闭症和非自闭症个体的数据集上进行预测，表明对话成功本质上是多维度的，需要多模态分析框架。

Details

Motivation: 先前研究多使用声学或词汇特征预测儿童自闭症样本的对话成功，或使用非语言行为预测非自闭症群体互动，而其他工作虽分析了自闭症互动中的同步性，但主要针对诊断分类或组间差异。本研究则关注预测感知的对话成功，并涵盖自闭症与非自闭症个体的自发互动。

Result: 摘要未提供具体定量结果，但通过利用多模态特征，论文证明了对话成功是多维度的，结合互补模态有潜力提高预测性能，捕获单一模态无法提供的信息。

Insight: 创新点在于使用互补的发音、面部、声学韵律和轮流发言特征来预测感知的对话成功，而非传统的诊断分类或组间比较，并跨越三个包含自闭症和非自闭症个体的数据集，强调了多模态融合的必要性。

Abstract: Conversation success is important for communication, social bonds, and well-being and is often reduced in autistic-neurotypical conversations. Previous studies have predicted perceived conversation success using acoustic and lexical features in pediatric autism-enriched samples, or using nonverbal behavior in non-autistic group interactions. Other work has characterized prosodic, facial, motor, and turn-taking synchrony in autistic interactions, but has primarily targeted diagnostic classification or group differences. The present study instead predicts participant perceived conversation success from complementary articulatory, facial, acoustic-prosodic, and turn-taking measures across three spontaneous dyadic-interaction datasets including autistic and non autistic individuals. By leveraging multimodal features, we demonstrate that conversational success is inherently multidimensional and requires a multi-faceted analytical framework. Combining these complementary modalities offers the potential to improve prediction of perceived conversation success by capturing information unavailable from any single modality.

[3] An Agentic Approach with Evidence-Grounded Verification for Multimodal Emotion Reasoning in Conversation cs.CL | cs.AI | cs.MM | eess.IVPDF

Elyas Rashno, Farhana Zulkernine

TL;DR: 论文提出一个面向对话多模态情感推理的智能体框架，通过视觉、声学、词汇感知智能体在共享板上发布带证据引用的观察，并由集成智能体结合检索示例生成情感描述与标签。框架引入证据 grounded 验证阶段，对错误预测进行确定性证据检查和蕴含检查，将失败归因到具体组件并生成目标提示补丁，在不更新模型权重的情况下实现提示空间自适应。

Details

Motivation: 基于LLM的多模态情感推理系统虽在标准基准表现良好，但指令微调成本高；冻结模型构建的智能体流水线虽避免训练成本，却难以在预测错误时定位责任智能体或阶段。

Result: 在MER2025数据集上，目标提示自适应在四个2B至38B参数的MLLM上均优于冻结静态流水线，并匹配或超过无差别反思基线；F-score提升0.6至2.2点，其中Qwen2.5-VL-7B从52.3提升到54.5。

Insight: 论文宣称的创新在于将证据引用、共享观察板、错误归因验证与提示补丁适配结合，实现可追踪且无需权重更新的情感推理改进。客观来看，其价值在于用确定性检查与蕴含检查提升可解释性，并按失败组件定向优化提示，降低自适应成本。

Abstract: LLM-based multimodal emotion reasoning systems perform well on standard benchmarks, but improving them through instruction tuning can be computationally expensive. Agentic pipelines built from frozen models avoid this cost, but introduce a different challenge: when a prediction is wrong, the system must identify which agent or stage caused the error. We address this problem with an agentic framework for traceable multimodal emotion reasoning and prompt-space adaptation. Modality-specific perception agents analyze visual, acoustic, and lexical inputs and post evidence-cited observations to a shared board. An integration agent combines these observations with retrieved multimodal examples to produce an emotion description, label set, and supporting citations, while an MLLM critic can request one revision before the output is finalized. For incorrect predictions, a separate evidence-grounded verification stage applies deterministic checks to verify that cited evidence and references are valid, and an entailment check to determine whether the final claims are supported by that evidence. Detected failures are then grouped by the responsible component and failure type, converted into targeted prompt patches, and accepted only after validation on a held-out set. This adapts the agent prompts without updating model weights. On the MER2025 dataset, targeted prompt adaptation outperforms the frozen static pipeline on all four MLLMs, ranging from 2B to 38B parameters, and matches or outperforms undifferentiated reflection baselines on each of them: VideoLLaMA3-2B, Phi-3.5-vision-instruct, Qwen2.5-VL-7B-Instruct, and InternVL2.5-38B. It improves F-score by 0.6–2.2 points depending on the backbone, including an increase from 52.3 to 54.5 on Qwen2.5-VL-7B.

[4] Free Lunch for LLMs Confidence: The RL Critic Already Knows cs.CLPDF

Shujin Wu, Heng Ji

TL;DR: 论文发现LLM的置信度估计与强化学习中的价值函数（critic）训练在数学上等价，因此对于使用基于价值的RL训练的LLM，可以直接复用已有的critic作为置信度估计器，无需额外训练或数据。该复用方法在多个领域上取得了最佳置信度估计和校准性能，且不影响任务表现。

Details

Motivation: 传统LLM置信度估计需要专门的训练阶段，消耗额外数据和计算资源。论文旨在探究置信度训练的本质，寻找一种无需额外成本即可获得可靠置信度估计的方法。

Result: 在数学、代码、工具调用和通用推理等十几个领域上，复用的critic在每个分布内分割上均为最佳置信度估计器，在16个设置中有14个达到最佳校准，同时保持任务性能不变。

Insight: 理论贡献在于证明基于正确性结果的置信度估计与critic训练等价，从而将RL中的critic直接转化为现成的置信度估计器；这一发现为LLM置信度估计提供了无需额外训练的创新途径，并可提供生成过程中间步骤的置信度。

Abstract: Reliable confidence estimation is essential for trustworthy deployment of large language models (LLMs), but dedicated confidence training stage requires additional data and compute. We ask a fundamental question: what prediction problem does confidence training actually solve? Inspired by prior work on external confidence estimation, we compare self- and external estimators of comparable capacity trained on the same (question, response, correctness) triples. We show that an external model trained solely on a policy’s behavioral traces can estimate the policy’s confidence as accurately as the policy itself, without accessing the policy’s internal representations. This points to a deeper connection with value function learning in reinforcement learning (RL): under a correctness-based outcome, we prove that confidence estimation and critic training are equivalent, both predicting the likelihood that a policy’s response will be correct from its trajectory. A simple consequence follows: for LLMs trained with value-based RL, the existing critic can be reused as an off-the-shelf confidence estimator with no additional training or data. The policy remains unchanged, so its task performance is preserved, and the critic provides confidence throughout generation, including intermediate reasoning steps. Across math, code, tool calling, and general reasoning spanning a dozen domains, the reused critic is the best confidence estimator on every in-distribution split and the best-calibrated on 14 of 16, without hurting the task performance.

[5] Latent Coherence: Do Frontier Language Models’ Probability Judgments Obey the Law of Total Probability? cs.CLPDF

Peter Potash

TL;DR: 论文评估前沿语言模型零样本概率判断是否满足全概率公式，在需从上下文推断潜在变量的设定中比较 P(X)、P(z)、P(X|z) 及因果 do 演算和后门调整查询的一致性。发现模型间一致性差异明显，部分模型存在持续性不一致，且残差与真值误差相关，可作为无需真值的可靠性信号。

Details

Motivation: 检验当前前沿 LLM 是否已具备贝叶斯式潜在变量概率一致性，特别是在潜在变量需从上下文记录推断时；并探索如何识别不可靠的概率判断。

Result: 七个模型中 GPT-6.1 Sol 和 Claude Opus 5.5 最一致，平均绝对残差为 0.08 和 0.12 log-odds（约 2 个百分点）；Claude Haiku 5.5、Gemini 3.8 Flash、DeepSeek V4-Pro 持续不一致达 0.27-0.35 log-odds，主要呈项目特定性；模型内残差越大，真值误差越大（Spearman 0.40-0.62）。

Insight: 创新在于用全概率公式和因果后门调整构造带精确真值的潜在变量概率一致性测试，并用多种措辞分离持续不一致与改写噪声；残差无需真值即可标记不可靠答案，且简单一致性检查不足以发现潜在变量推理失败。

Abstract: LawZero’s Scientist AI trains a Predictor toward the Bayesian posterior, with an objective that penalizes inconsistent probabilities among latent explanations. We ask whether current frontier language models, with no such training, are already consistent in this sense zero-shot: do their probability judgments satisfy the law of total probability, $P(X)=\sum_z P(z)P(X|z)$, when the latent $z$ must be inferred from records in the context? In separate single-turn calls, models are asked for $P(X)$, for $P(z)$ over the latent’s states, and for $P(X|z)$; a causal family applies the same test to $P(y|do(x))$ and the back-door adjustment. Every query has an exact ground-truth probability, and a subset of items is asked in three wordings to separate persistent incoherence from rewording noise. Across seven models, GPT-6.1 Sol and Claude Opus 5.5 are the most coherent (mean absolute residual 0.08 and 0.12 log-odds, about 2 percentage points). Claude Haiku 5.5, Gemini 3.8 Flash and DeepSeek V4-Pro show persistent incoherence (0.27-0.35 log-odds) that is mostly item-specific rather than a shared offset. Within every model, larger residuals go with larger errors against the truth (Spearman 0.40-0.62), so the residual, which needs no ground truth, flags unreliable answers. Reasoning length does not predict coherence, across models or within a model across rewordings of the same question. Simple consistency checks pass almost everywhere; the failures are specific to reasoning through a latent variable. Code and data: https://github.com/ppotash/latent-coherence

[6] SAGE: Sense-Aligned Multimodal Grounding Evaluation with Gloss-Augmented Reasoning cs.CL | cs.CVPDF

Sunjae Kwon, Suhaas Kiran DG, Zonghai Yao, Talha Chafekar, Deepali Singh

TL;DR: 论文提出SAGE统一多模态grounding评测基准，将VWSD、VerSe和WikiDiverse重构为共享的以词项为中心的10候选图像选择协议，覆盖名词、动词和实体grounding，并引入困难负例与上下文交换诊断。作者还提出免训练的GAR框架，结合释义定义接地与约束引导语义验证。实验表明组合两种信号可提升宏平均Hits@1。

Details

Motivation: 现有grounding评测设置分散，且强VWSD表现未必能迁移到其他grounding场景，需要统一评测并细粒度分析模型是否真正依据目标词义进行grounding，而不仅是caption-image直接兼容。

Result: 在Gemma3-12B上，定义增强提升三个子集；约束引导推理提升VWSD并在VerSe上增益明显，但在WikiDiverse上较弱；二者结合取得最佳宏平均，将Hits@1从65.90提升到71.22。

Insight: 创新点在于统一的term-centric十候选评测协议、context-swapped诊断以及免训练的释义增强与约束验证框架。客观来看，论文强调显式语义定义和约束验证对多模态grounding有效，同时揭示不同词类和场景下的迁移差异，支持细粒度分析。

Abstract: This paper introduces Sense-Aligned Grounding Evaluation (SAGE), a unified 10-candidate image-selection benchmark that reformulates VWSD, VerSe, and WikiDiverse into a shared term-centric protocol covering noun-, verb-, and entity-centered grounding. SAGE includes confusable hard negatives and a context-swapped VerSe diagnostic to probe target-term grounding beyond direct caption–image compatibility. We further propose Gloss-Augmented Reasoning (GAR), a training-free framework combining definition grounding with constraint-guided semantic verification. Experiments show that strong VWSD performance does not transfer uniformly across grounding settings. With Gemma3-12B, definition augmentation improves all three subsets, while constraint-guided reasoning improves VWSD and yields particularly strong gains on VerSe, but is less effective on WikiDiverse. Combining the two signals achieves the best macro-average performance, improving Hits@1 from 65.90 to 71.22. These results show that SAGE supports both unified evaluation and fine-grained analysis of explicit semantic reasoning across grounding settings.

[7] Scaling cross-situational word learning on children’s naturalistic experiences cs.CLPDF

Michael C. Frank, Alvin W. M. Tan, Khai Loong Aw, Robert Z. Sparks, Victor Moreno

TL;DR: 论文研究儿童如何通过跨情境学习掌握早期具体词汇，并在BabyView语料（48名儿童、2441小时纵向自我中心视频）上训练视觉语言模型，检验跨情境词学习能否扩展到自然经历数据。结果显示模型能学到物体—标签映射，但使用互联网预训练视觉表示时性能远高于仅从发展视频学习视觉表示；学习信号主要来自少量描述可见指代物的语句。

Details

Motivation: 论文关注跨情境学习策略是否依赖模型视觉表示质量，以及能否从少量概念验证扩展到更大、更多样的儿童自然经历数据集，从而理解早期词汇学习的可行机制。

Result: 模型在BabyView上学会了物体—标签映射，但使用互联网预训练视觉表示时性能显著优于仅用发展视频训练；多数学习信号由少量描述可见指代物的语句承载。模型学到具有可识别类人语义结构的词汇表示，但训练轨迹与儿童观察不同；摘要未给具体定量指标。

Insight: 论文宣称的创新在于将跨情境词学习扩展到大规模儿童纵向自我中心视频，并系统检验视觉表示质量和数据规模的影响。客观看，其创新点还包括用对比视觉语言模型分析自然经历中学习信号的分布，指出高质量视觉表示是构建发展上合理模型的关键瓶颈。

Abstract: How do children learn the meanings of the simple, concrete words that form a majority of their early vocabulary? Statistical information about many word meanings can be recovered from the gradual accumulation of information about the co-occurrence of words with their referents, a proposal known as ``cross-situational learning’’. Contrastive vision–language models allow this learning strategy to be tested on egocentric video data capturing children’s early real-life experiences with visual and linguistic inputs. Initial successes of this method on small datasets provide a proof-of-concept, but vision models struggle to learn robust visual representations when trained on these same egocentric videos. How dependent is cross-situational word learning performance on the quality of the model’s visual representations? And can cross-situational models scale to larger and more diverse datasets? To address these questions, we trained models on the BabyView corpus, including 2,441 hours of longitudinal egocentric video from 48 children. Models trained on this dataset learned object–label mappings, but performance was far higher when they used internet-pretrained visual representations as opposed to when visual representations were learned solely from the developmental video data. Further, the majority of the learning signal was carried by a small proportion of utterances that described a visible referent. Models learned lexical representations that showed recognizable human-like semantic structure, but model performance showed substantially different trajectories over training experiences than those observed in children. Cross-situational learning is a viable word learning strategy for early noun vocabulary, but constructing developmentally plausible models will require understanding how to learn high-quality visual representations from naturalistic data.

[8] Kolibri: A Sovereign European Model on the Pareto Frontier cs.CL | cs.AI | cs.LGPDF

Aleph Alpha, :, Moritz Althaus, Artur Baranowski, Michael Barlow

TL;DR: 论文提出 Kolibri，一个面向主权与专用部署的英德双语 MoE Transformer，总参数 78.1B、每 token 激活 3.46B，并以 Apache 2.0 开放权重。模型覆盖数据、架构、训练、后训练与评估全流程，使用 24T token 训练，其中德语占比超过 20%，并通过 SFT 与超 120 万内部任务 RL 强化推理、工具使用、指令遵循、代码和检索能力。

Details

Motivation: 面向德国及公共管理、工业、航空航天等受监管领域的主权部署需求，降低对闭源模型和外部数据/训练流程的依赖，同时提升德语能力与部署成本效率。

Result: 在报告评估的开放模型中，Kolibri 在英语和德语上处于质量与服务成本权衡的 Pareto 前沿；每 token 仅激活 4.4% 参数，体现较高服务效率。摘要未给出具体 benchmark 分数。

Insight: 创新点在于全栈可控的“Model Factory”式模型开发流程、德语占比高且含超 2T 自建/合成德语 token 的数据体系，以及面向多能力任务的规模化 RL 后训练；客观上，其 MoE 高效激活与德语专用数据/后训练结合是主要可借鉴之处。

Abstract: This report introduces Kolibri, an English-German mixture-of-experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under the Apache 2.0 licence. We built Kolibri for sovereign and specialised deployment, with a particular focus on German and on regulated domains such as public administration, industry, and aerospace. To support these settings, we control the full model-development process, including data, architecture, training infrastructure, post-training, and evaluation. We train Kolibri on 24T tokens across pre-training, mid-training, and long-context extension, with German accounting for more than 20% of the data mix by bytes. To reach this share, we complement German datasets with more than 2T German tokens that we curate from the web with our own pipeline and generate synthetically. Post-training combines supervised fine-tuning on curated German and English data with reinforcement learning on more than 1.2M internally curated tasks, which cover reasoning, tool use, instruction following, code, and retrieval. The model activates 4.4% of its parameters per token, and among the open models evaluated in this report, it lies on the Pareto frontier of quality and serving cost in English and German. Kolibri builds on Kolibri Origin, an earlier iteration that validated our full pipeline at scale. Both models come from our Model Factory, which connects data, experimentation, training, evaluation, and deployment through version-controlled workflows.

[9] DraMaze: A Multi-Agent Pipeline with Future-Aware Memory for Diverse Microdrama Script Generation cs.CLPDF

Siyang He, Qiqi Wang, Fan Liu, Yuncheng Huang, Pengfei Xu

TL;DR: 论文提出 DraMaze，一个面向长篇微短剧剧本生成的多智能体流水线，通过桥段记忆引导的进化树搜索与变异探索多样因果路径，并用反向叙事依赖树按未来叙事目标组织与检索历史记忆；同时构建双语基准 MiDramaBench 和因果模式指标评估逻辑性与创意多样性。

Details

Motivation: 解决 LLM 长篇微短剧生成中剧情推进趋同、桥段重复，以及传统检索强化套路复用并忽略对未来剧情关键历史信息的问题。

Result: 在三个骨干 LLM 上均有一致提升；60 集、最长 6 万词剧本上因果模式重复降低 32.1%，Logic 得分 82.5，比最佳基线高 8.5 分。

Insight: 创新点在于将桥段记忆与进化树搜索/变异结合以提升叙事多样性，并用未来目标反向组织历史记忆缓解长程一致性与套路复用；客观看其基准和因果模式指标也有助于评测微短剧生成。

Abstract: The rapid growth of microdramas has increased demand for high-quality script production. Long-form microdrama script generation with LLMs requires both diverse plot progression and long-range narrative coherence. Our observations reveal that candidate continuations increasingly concentrate on fewer narrative mechanisms as generation progresses, while conventional retrieval may reinforce trope reuse and overlook historical information essential to future plots. To address these challenges, we propose DraMaze, a multi-agent pipeline that explores diverse causal paths through trope memory-guided evolutionary tree search and mutation. It further constructs a Backward Narrative Dependency Tree to organize, retain, and retrieve historical memories based on future narrative goals. We also introduce MiDramaBench, a bilingual benchmark for evaluating script logic and creative quality across different script lengths, together with causal-pattern metrics for narrative repetition and diversity. Experiments show consistent improvements across three backbone LLMs. For 60-episode scripts of up to 60k words, DraMaze reduces causal-pattern repetition by 32.1% and achieves a Logic score of 82.5, outperforming the best-performing baseline by 8.5 points.

[10] X-Dubbing: Speech-to-Speech Translation under Temporal and Visual Constraints cs.CL | cs.CV | eess.ASPDF

Jeongsoo Choi, Ji-Hoon Kim, Junseok Ahn, Joon Son Chung

TL;DR: 论文提出X-Dubbing方法，解决跨语言配音中语音翻译与视频同步的问题。该方法将任务分解为时间感知的语音到文本翻译和视频感知的文本到语音，通过配音翻译器生成时间结构化的脚本，配音演员同步渲染，并利用合成语音的反馈优化翻译器，无需配对配音数据。实验表明X-Dubbing在等时性和视听对应等指标上优于近期基线。

Details

Motivation: 跨语言配音需要将源语音转换为与原始视频同步的目标语言语音，但语言在时长、节奏和发音上的差异使得生成既忠实又能在原时间内自然说出的翻译非常困难。

Result: 大量实验表明，X-Dubbing在包括等时性（isochrony）和视听对应（audio-visual correspondence）在内的多个指标上优于近期基线方法。

Insight: 论文的创新点在于：1）将跨语言配音任务联合建模为时间感知的语音到文本翻译和视频感知的文本到语音两个子问题，并以语言无关的时间预算为纽带；2）利用合成语音的配音感知反馈优化翻译器，鼓励生成同步良好的脚本；3）无需配对配音数据，分别使用语音-文本和单语视听数据训练两个组件。客观分析，这种分解和反馈机制有效地解决了配音中的同步和自然度问题，同时降低了对稀缺配对数据的依赖。

Abstract: Cross-lingual dubbing aims to convert source speech into target-language speech that remains synchronized with the original video. The key to this task is to produce a faithful translation that is naturally speakable within the source timing, which is non-trivial because languages differ in duration, rhythm, and articulation. In this paper, we propose X-Dubbing, which formulates the task as a joint problem of time-aware speech-to-text translation and video-aware text-to-speech. Specifically, our method consists of a Dubbing Translator that generates temporally structured scripts and a Voice Actor that renders them in synchrony with the source video, both grounded in a language-agnostic timing budget. We further refine the translator with dubbing-aware feedback from the synthesized speech, encouraging scripts that yield well-synchronized dubbing. This design requires no paired dubbing data, as the two components are trained on speech-text and monolingual audio-visual data respectively. Extensive experiments show that X-Dubbing outperforms recent baselines across diverse metrics, including isochrony and audio-visual correspondence.

[11] How Much Do You Trust A Dog? Quantifying Hint-Following in Reasoning Language Models cs.CL | cs.LGPDF

Anxin Guo, Chirag Pabbaraju, Sara Ahmadian, Kamesh Munagala, Aravindan Vijayaraghavan

TL;DR: 论文研究推理语言模型在MMLU问题上的提示跟随与谄媚行为：通过“[来源]认为答案是(X)”形式改变提示来源（教授、朋友、狗），在Qwen、Gemma、SmolLM上量化答案偏移。作者发现提示引起的答案log-odds变化可由近似恒定的指数倾斜刻画，且问题-目标易感性在不同来源间大体共享；进一步用形式化分解和合成实验分析KL正则化奖励训练的影响，并发现即使来源被声明不可靠或明确警告不要信任，偏移仍存在。

Details

Motivation: LLM常表现出谄媚性，会为迎合用户建议而改变客观事实或推理题答案，但这种影响的定量形式及其是否根据来源可靠性进行校准仍不清楚。论文试图系统量化提示来源如何诱导答案偏移，并检验模型是否信任不可靠来源。

Result: 在MMLU问题上，对Qwen、Gemma和SmolLM三个开源模型家族的系统实验显示，提示诱导的答案log-odds偏移呈可预测的指数倾斜结构，且跨来源的易感性大体共享；即使提示来源被声明不准确或附有不要信任的警告，log-odds偏移仍持续存在，暴露模型易受对抗性引导。

Insight: 创新点在于用不同可信度来源的提示系统量化LLM的提示跟随，并提出用指数倾斜刻画答案分布偏移；同时通过形式化分解和受控合成实验解释KL正则化奖励训练如何重塑有提示与无提示答案分布。客观看，其可借鉴之处是将谄媚性从定性现象转化为可测量的log-odds偏移结构，并揭示来源可靠性校准的失败。

Abstract: Large language models (LLMs) often exhibit sycophancy, altering their answers to align with user suggestions even on objective factual and reasoning tasks. Yet the quantitative form of this influence— and whether it is calibrated to source reliability— remains poorly understood. In this work, we investigate this behavior through hint-induced answer shifts on MMLU questions, evaluating prompts of the form ``[Source] thinks the answer is (X)’’. We systematically vary the source to which the hint is attributed (a professor, a friend, or a dog) across three open-source model families, Qwen, Gemma, and SmolLM. We show that the change induced by the hint follows a predictable structure well-characterized by an exponential tilt: the hint induces an approximately constant mean shift in the hinted answer’s log-odds, with question–target susceptibility largely shared across sources. To explore how this pattern can arise, we introduce a formal decomposition of the hint response and illustrate in controlled synthetic experiments how KL-regularized reward-based training reshapes both hinted and unhinted answer distributions. Finally, we evaluate whether this shift is calibrated to source reliability, finding that the log-odds shift persists even when the hint-giver is declared inaccurate or accompanied by explicit warnings not to trust the source, highlighting the vulnerability of LLMs to adversarial steering.

[12] From Noisy Retrieval to Decision Evidence: Silver Evidence Demonstrations for In-Context Learning cs.CLPDF

Masoud Monajatipoor, Fazlolah Mohaghegh, Hamid Reza Hassanzadeh, Akash Uttamrao Bhoite, Robert E. Tillman

TL;DR: 论文提出了一种称为“银证据演示”的方法，用于改进检索增强的上下文学习。该方法通过LLM生成目标条件化的证据摘要来替换ICL示例中的原始检索段落，以减少噪声并保留决策相关信号。实验表明，在多个数据集上，该方法优于仅使用黄金示例的ICL和InstructRAG风格的ICL，并提高了证据F1分数。

Details

Motivation: 检索增强的上下文学习在决策相关证据被埋没在长噪声上下文中时表现不佳，检索段落可能包含冗余信息。现有专家标注的开发示例中的证据注释通常仅用作答案侧的理据，而未用于过滤噪声检索。因此，论文旨在利用这些注释生成更干净的示例，以提升决策性能。

Result: 在EI 2.0、SciFact、合成政策检索和HICRIC/IMR数据上，完整方法在四个数据集中的三个上优于同等大小的仅黄金示例的ICL（政策仅标签），并在所有标注数据集上提高了证据F1。此外，它在所有四个数据集上比InstructRAG风格的ICL获得更高的平均标签准确率。

Insight: 论文的创新点在于提出银证据演示：利用LLM生成目标条件化的证据摘要替换原始检索段落，生成时不使用专家标签或黄金证据，并与专家标签配对；测试时通过单一结构化调用生成证据并预测标签和证据。客观分析，这种方法能有效减少噪声上下文，同时保留决策相关信号和专家监督，特别适用于长噪声文本的决策任务。

Abstract: RAG and retrieval-augmented few-shot ICL can struggle when decision-relevant evidence is buried in long, noisy context. Retrieved passages and demonstrations may contain redundant or distracting information. Although expert-labeled development examples may identify the text supporting each decision, these annotations are typically used only as answer-side rationales rather than as supervision for filtering noisy retrieval. We propose silver-evidence demonstrations, which replace raw retrieved passages in ICL examples with generated, target-conditioned evidence summaries. For each labeled development example, an LLM generates silver evidence without access to the expert label or gold evidence; this evidence is then paired with the expert label and gold evidence where available. At test time, a single structured call generates silver evidence from retrieved passages and then predicts the final label and decision evidence. Across EI 2.0, SciFact, synthetic policy retrieval, and HICRIC/IMR data, our full method improves over equally sized gold-only ICL (label-only for policy) on three of four datasets and improves evidence F1 on all annotated datasets. It also achieves higher mean label accuracy than InstructRAG-style ICL on all four datasets. These results suggest that replacing demonstration-side retrieved passages with compact, target-conditioned silver evidence is particularly useful for decisions based on long and noisy text, where it reduces distracting context while preserving decision-relevant signals and expert supervision.

[13] Shorter Is Not Cheaper: A Controlled Comparison of Declarative Animation Specifications and Free-Form Code for LLM-Generated Explanations cs.CL | cs.HC | cs.SEPDF

Jiantang Huang

TL;DR: 论文对比了LLM生成交互式动画解释时，声明式动画规范与自由形式HTML/JavaScript代码在成本、速度和可靠性上的表现。作者设计了ExplainSpec声明式格式和可程序化检查的观察合约，并在多个Claude模型与Qwen3-14B上做预注册控制实验。结果表明，声明式输出虽更短，但推理模型会因额外推理开销抵消收益，速度未显著提升，可靠性也未必更高。

Details

Motivation: 澄清一个常见预期：声明式规范因输出更短、更受约束，应当比自由形式代码更便宜、更快、更可靠。论文关注在具备推理能力的LLM中，这种“短输出即低成本”的假设是否成立。

Result: 所有模型的声明式答案token缩短25-48%，但启用推理后总输出仅在最大Claude模型上显著下降，且没有模型显著更快。自由形式页面经一轮修复后95-100%有效；Qwen3-14B仅33%生成有效规范、17%通过全部语义测试，而HTML/JavaScript为62%。

Insight: 创新点在于提出时间索引的ExplainSpec声明式动画格式、可程序化检查的观察合约与预注册控制实验方法。客观看，论文系统揭示了“更短格式不等于更低生成成本”，尤其指出推理token开销和上下文学习新格式带来的可靠性代价。

Abstract: Chat assistants increasingly answer conceptual questions with interactive, animated explanations, generated either as free-form HTML/JavaScript or as declarative specifications that a fixed runtime plays. The declarative route is widely expected to be cheaper, faster and more reliable, because its outputs are shorter and constrained. We test this expectation in controlled comparisons whose hypotheses and analysis plans were frozen before the runs. We designed ExplainSpec, a time-indexed declarative animation format, and an observation contract that makes every generated explanation programmatically inspectable; validated, pacing-agnostic checkers score 20 explanation requests from five domains. Three Claude models (360 jobs) and, in a follow-up, the open-weight Qwen3-14B with thinking enabled and disabled (240 jobs) answered every request in both formats. For every model the specifications were 25-48% shorter in answer tokens (output excluding reasoning), yet with reasoning enabled total output fell significantly only for the largest Claude model and no model generated significantly faster. The reasons differed. The Claude models reasoned far more before writing specifications (exploratory; for the two larger models, from 15-20% to 85-88% of generations). Qwen3-14B reasoned about as much in both formats (a pre-registered test of this shift was not supported), and its shorter answers saved little against a reasoning trace more than twice as long. Nor were specifications more reliable: free-form pages were valid after one repair round in 95-100% of jobs for every model, whereas Qwen3-14B produced valid specifications in only 33% of jobs and passed all semantic tests in 17% (HTML/JavaScript: 62%). For reasoning models, a shorter format alone therefore does not make generation cheaper, faster or more reliable, and a format learned in context can cost reliability.

[14] From Promises to Accountability: Comparative AI Modeling and Visualization of Electoral Commitments in Nepali Political Texts cs.CLPDF

Prakash Poudyal, Nischal Karki, Amrit Dahal, Rajani Chulyadyo, Sameer Tamrakar

TL;DR: 论文聚焦尼泊尔选举承诺挖掘，构建首个尼泊尔政治文本金标准数据集，并系统评估机器学习、深度学习和大型语言模型对选举承诺的自动抽取与分析能力。最优模型在自建数据上取得较高性能，并将结果集成到移动应用中，借助生成式AI可视化承诺以提升透明度和选举问责。

Details

Motivation: 发展中国家选举候选人常未兑现竞选承诺，且宣言、海报等材料缺乏系统透明存档，导致承诺随时间淡化、难以问责。论文旨在结构化选举承诺，为透明度和公民监督提供技术支持。

Result: 在自建尼泊尔政治文本数据集上，LaBSE-LR为机器学习最佳（准确率0.897、macro F1 0.896、AUROC 0.947），fastText-LSTM为深度学习最佳（准确率0.914、macro F1 0.913、AUROC 0.961），Qwen3-8B在few-shot设置下为LLM最佳（macro F1 0.848）。

Insight: 创新点在于构建首个尼泊尔政治文本金标准数据集，并比较多类模型完成低资源语言下的选举承诺抽取；同时将模型结果与GAI可视化移动应用结合，强调透明度、公民参与和选举问责的落地价值。

Abstract: Election Commitment Mining refers to the analysis of election commitments made by electoral candidates or political parties during election campaigns. However, many elected candidates and political parties, especially in developing South Asian countries, do not fully deliver on the promises they make before elections. Even after the elections, commitments presented through election manifestos, posters, pamphlets, videos, and other campaign materials are often not systematically or transparently archived. As a result, these promises tend to fade away over time, making it difficult to hold the elected candidates accountable for their commitments. To address this persistent issue, this research aims to develop a system capable of structuring the commitments made by candidates during election periods. In this work, we created the first gold-standard dataset of Nepali political texts (Cohen’s kappa = 0.777) and evaluated machine learning, deep learning and large language models to automatically extract and analyze election commitments. LaBSE-LR achieved the best results among machine learning models (0.897 accuracy, 0.896 macro F1-score, 0.947 AUROC), while fastText-LSTM achieved the highest performance among deep learning models (0.914 accuracy, 0.913 macro F1-score, 0.961 AUROC). Among the three evaluated large language models, Qwen3-8B performed best in the few-shot setting (0.848 macro F1-score). The outcome of this work is integrated into a mobile application, where commitments can be visualized with the support of GAI, enhancing transparency, civic engagement, and electoral accountability.

[15] Collection-Date Assignment Redirects Answers in Temporal QA cs.CLPDF

Minsu Oh, Seunghui Jwa, Soo Kyun Kim, Yeo-Chan Yoon

TL;DR: 论文研究时间问答中“采集日期”元数据是否会误导模型答案：即使证据内容未变，仅交换两条修订版本的采集日期，也会显著改变模型对时间相关问题的回答。作者在维基百科页面上对多个LLM进行系统实验，证明采集日期会重定向时间QA答案，并提出一种诊断/审计方法来隔离元数据效应与证据变化或版本缺失。

Details

Motivation: 时间问答模型可能依赖与内容变化无关的采集日期元数据，而非真实证据时间；论文要解决的是：在证据不变的情况下，采集日期分配是否会影响甚至误导模型的时间问答答案。

Result: 在595个维基百科页面、五个开源权重LLM上，交换问题日与次日采集日期使后向引用精确匹配EM下降37.6-51.4个百分点，并在128个不重叠页面上复现；前一日交换仍有29.0-39.6个百分点损失。七种提示变体仍保留该效应；Qwen3.5在匹配思考下惩罚从30.1降至11.1个百分点，两个API LLM在维基百科交换上效应较小。

Insight: 创新点在于将采集日期作为时间QA中的混杂元数据进行受控诊断，证明即使证据和日期字符串不变，元数据分配也能系统性重定向答案，并提供可实际使用的输入审计方法。客观来看，其价值在于揭示时间QA基准和数据管道中的元数据偏差，提醒模型评估需区分内容时间与采集时间。

Abstract: A collection date records when a source revision was acquired, not when its contents changed. Can assigning this metadata redirect temporal question answering despite unchanged evidence? Swapping the question day and following day between two revisions lowers later-reference exact match (EM) by 37.6-51.4 percentage points across five open-weight LLMs on 595 Wikipedia pages, replicated on 128 disjoint pages. Previous-day swaps retain 29.0-39.6-point losses on 497 pages. Seven prompt variants, including explicit ignore-collection instructions and archived-revision provenance, retain the effect. Fictional answers and English month-name question dates show that remembered answers and identical date strings are unnecessary. Matched thinking reduces Qwen3.5’s penalty from 30.1 to 11.1 points, while native reasoners vary. Two API LLMs show small Wikipedia swap effects and rarely shift to earlier answers on fictional records. Large swap-induced losses concentrate around the question date; swaps between distant dates have much smaller effects. Adding fields containing one observed acquisition date lowers EM relative to omission in three of five LLMs after correction. The diagnostic isolates metadata effects from changing evidence or missing the relevant revision, and provides a practical audit for temporal QA inputs.

[16] SOPO: Socratic Guided Policy Optimization for Span-Level Hallucination Detection cs.CL | cs.AIPDF

Jiawei Dong, Zilong Bai, Pengtian zhu, Peng Zhou

TL;DR: 论文提出 SOPO，一种面向跨度级幻觉检测的多轮强化学习框架。它通过苏格拉底式教师反馈机制，在 rollout 阶段由教师模型根据真实答案提供间接提示，引导模型生成更有效的推理轨迹，并用基于轮次的优势缩放惩罚冗长偏好。实验表明该方法在 RAGTruth 和多个域外基准上取得有竞争力的结果。

Details

Motivation: LLM 存在幻觉问题，而将可验证奖励强化学习用于跨度级幻觉检测时，面临定位模糊、困难样本奖励稀疏以及输出长度失控膨胀等挑战。

Result: 在 RAGTruth 上，SOPO（4B）达到 SOTA，超过 GPT-5 等领先闭源模型和标准 RL 基线；在四个域外基准上平均分高于 GRPO，但与 CAPO 相比证据混合。

Insight: 创新点在于用教师模型从真实答案推断间接提示，并在多轮 rollout 中引导推理轨迹，以缓解困难样本奖励稀疏；同时引入 Turn-based Advantage Scaling 抑制冗长偏好，促使模型形成高效自主推理能力。

Abstract: Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, but suffer from hallucination issues where they generate unfaithful or inconsistent content. While Reinforcement Learning with Verifiable Rewards (RLVR) has shown promising applications in reasoning tasks, its application to span-level hallucination detection is challenged by localization ambiguity, reward sparsity on hard examples, and uncontrolled length inflation. To address these issues, we introduce Socratic Guided Policy Optimization (SOPO), a multi-turn RL framework for robust hallucination detection. The key innovation of SOPO is a Socratic feedback mechanism, where a teacher model guides the reasoning trajectories during rollout by providing indirect hints inferred from the ground truth. This teacher-guided approach enables the model to generate more effective reasoning trajectories for hard examples, thus alleviating reward sparsity. Furthermore, we incorporate Turn-based Advantage Scaling to penalize verbosity bias, encouraging the model to develop efficient and autonomous reasoning capabilities. Empirical results on RAGTruth demonstrate that SOPO (4B) achieves state-of-the-art performance, surpassing leading proprietary models (e.g., GPT-5) and standard RL baselines, while obtaining higher reported mean scores than GRPO on four out-of-domain benchmarks, with mixed evidence against CAPO. We release our training and evaluation code alongside the 1.7B and 4B SOPO models at https://github.com/patsnap/SOPO.

[17] DIAL-S2ST: Learning Latency Control for Simultaneous Speech-to-Speech Translation cs.CL | cs.SD | eess.ASPDF

Jeongsoo Choi, Junseok Ahn, Joon Son Chung

TL;DR: 论文提出DIAL-S2ST，一种用于同声语音到语音翻译模型推理时延迟控制的后训练方法。它通过从lookahead预测中自蒸馏来重用预训练翻译能力，并限制文本蒸馏损失的影响以应对模仿差距，从而无需配对目标数据或奖励计算即可监督更早的发射。为使学习到的时序在推理时可调，联合训练跨尺度的单个LoRA适配器并匹配lookahead指导。在法语到英语翻译上的实验表明，仅用10小时源语音即可实现适应，提供灵活的延迟控制和良好的质量-延迟权衡。

Details

Motivation: 同声语音到语音翻译需要控制推理延迟（即何时开始翻译），现有方法往往依赖配对数据或奖励计算，且难以在推理时灵活调整延迟。论文旨在通过自蒸馏从预训练模型中学习延迟控制，避免额外标注，并实现推理时可调的延迟。

Result: 在法语到英语翻译任务上，使用Hibiki模型，仅用10小时源语音进行适应，实现了灵活的延迟控制，并显示出有利的质量-延迟权衡（favorable quality-latency trade-off）。

Insight: 创新点包括：通过自蒸馏从lookahead预测中学习延迟控制，无需配对目标数据或奖励计算；联合训练跨尺度的单个LoRA适配器实现推理时延迟可调；在极少数据（10小时）下完成适应。客观分析，该方法利用预训练模型自蒸馏避免额外标注，LoRA适配器实现轻量级调整，具有实用性和高效性。

Abstract: We propose DIAL-S2ST, a post-training method for learning inference-time latency control in simultaneous speech-to-speech translation models. Our approach reuses pretrained translation capabilities through self-distillation from lookahead predictions, while limiting the influence of large text distillation losses to account for the imitation gap. This provides supervision for earlier emission without paired target data or reward computation. To make the learned timing adjustable at inference, we jointly train a single LoRA adapter across scales with matched lookahead guidance. Experiments on French-to-English translation with Hibiki demonstrate that only 10 hours of source speech enable this adaptation, providing flexible latency control with a favorable quality-latency trade-off.

[18] Many Perturbations, Shared Failure Dynamics: Tracing Direction-Sensitive Perturbation Influence in Language Models cs.CLPDF

Zhibo Hu, Chen Wang, Yanfeng Shu, Liming Dong, Hye-young Paik

TL;DR: 论文研究语言模型中“保任务改写”为何会让正确答案变成失败，提出一种方向敏感、相对于读出层的语义脆弱性解释框架：用干净决策储备（clean decision reserve）、表示变换（representation transformation）和响应对齐（response alignment）三个互补量来刻画，并通过纵向-横向精确分解区分标量传输中丢失的方向信息。作者构建了紧凑的“储备-传输”模型，在 Qwen3-32B 与 Gemma 31B 上跨未见的扰动族与样本预测失败，并迁移到 ReClor；同时用匹配干预、注意力组件测试与选项顺序控制等实验，论证方向的因果作用是有条件的：局部因果敏感性与整体自然失败的可解释性需要区分。

Details

Motivation: 论文想解释一个反直觉现象：语义保持的改写有时会让模型答错，而更大的内部表示变化反而不影响答案，这说明仅用标量大小的扰动幅度无法刻画语义脆弱性，需要从方向与读出关系的角度重新理解失败机制。

Result: 紧凑的 reserve-and-transmission 模型能在 Qwen3-32B 和 Gemma 4 31B 的留出扰动族与样本上预测失败，且在 ReClor 上有一定但依赖参数化的迁移效果；匹配干预显示方向携带超出标量几何的因果信息，注意力组件测试偏向自然配对方向；但失败在不同选项顺序下很少持续，说明方向效应依赖上下文。

Insight: 创新点在于提出相对于读出层的方向敏感语义脆弱性框架与纵向-横向分解，将“储备-变换-响应”三个互补描述统一起来，并用匹配干预把方向性与标量几何的因果贡献分离；客观来看，其价值还在于诚实地界定了适用边界——预测规律可共享，但局部因果敏感并不等于对自然失败的完整解释。

Abstract: Why can a task-preserving rewrite turn a correct answer into a failure while a larger internal change leaves the answer intact? We develop a direction-sensitive, readout-relative account of semantic fragility: heterogeneous language changes can share geometric and readout relationships without sharing an input-independent failure direction. Clean decision reserve, representation transformation, and response alignment provide complementary descriptions of this process. An exact longitudinal-transverse decomposition identifies directional information discarded by scalar transmission. A compact reserve-and-transmission model predicts failures across held-out families and items in Qwen3-32B and Gemma 4 31B, with useful but parameterization-dependent transfer to ReClor. Matched interventions show that orientation carries causal information beyond scalar geometry. Among naturally failed rewrites, attention-component tests on disjoint original items and subsequent answer-order controls favor the natural paired direction over tested random and same-answer-letter donor directions. Yet failures rarely persist across option orders, and current-order corrections use recomputed clean references. Shared predictive regularity thus coexists with context-dependent directional effects. Numerical path integration reduces, but does not eliminate, finite-patch approximation error within a fixed context; a larger discrepancy from the natural rewrite effect remains. A complementary fixed-CoT cue study extends this account to influence unacknowledged in recorded reasoning: readout associations transfer across domains, although the positive-mean causal criterion fails and signed-effect prediction remains post hoc. Together, these results support shared relations among reserve, transformation, and response while distinguishing local causal sensitivity from a complete explanation of natural failure.

[19] Why Full-Duplex Speech Models Collapse in Long Conversations cs.CL | cs.SDPDF

Yeonju Kim, Bella Godiva, Se Jin Park, Yong Man Ro

TL;DR: 论文指出现有全双工语音模型在长对话中会因上下文快速耗尽和滑动窗口机制而崩溃，提出长时程基准FD-LHB对五个模型进行评测，并诊断出初始化锚点驱逐和自输出强化是导致乱码、沉默与重复的机制，最后给出无需重训练的简单修复方法。

Details

Motivation: 全双工语音模型逐帧生成token，即使倾听时也消耗上下文，导致几分钟内耗尽窗口；现有基准只评测单轮或少数轮对话，无法暴露长时程对话中的崩溃问题。

Result: 在FD-LHB上评测五个近期全双工模型，发现它们最终都会退化或耗尽上下文；滑动窗口模型出现重复、沉默和乱码。提出的IAP和DRP无需重训练即可显著减少长达一小时回放对话中的崩溃，并保持实时运行。

Insight: 创新点在于首次系统性地定义并评测全双工语音模型的长时程对话崩溃问题，诊断出初始化锚点驱逐和自输出强化两个机制，并提出轻量级推理时修复（IAP保留首个KV条目，DRP抑制重复并防止沉默）。

Abstract: Full-duplex speech models listen and speak at the same time, which makes them promising for natural, open-ended conversation. But can they sustain a coherent conversation for tens of minutes? Because they generate a token every frame, even while listening, they exhaust their context windows within minutes. Yet existing benchmarks evaluate only single turns or a few conversational rounds, too short to expose the long-horizon problem. We introduce the Full-Duplex Long-Horizon Benchmark (FD-LHB), which tests five recent full-duplex models on long replayed conversations and in live conversation with an LLM partner. Every evaluated model eventually either degrades or exhausts its context. Models that keep the full history often degrade before their context runs out, while sliding-window models still fall into repetition, silence, and gibberish. For sliding-window models, we identify two contributing mechanisms. Gibberish and silence are linked to Initialization-Anchor Eviction, where the sliding window discards the first KV entry. Repetition is also reinforced by the model’s own recent outputs. Guided by this diagnosis, we apply two simple fixes: Initialization-Anchor Pinning (IAP) keeps that first entry, and Duplex Repetition Penalty (DRP) discourages echoing while guarding against prolonged silence. Together, they support the diagnosis and, without retraining, substantially reduce conversational collapse in replays of up to an hour while running in real time.

[20] Acoustic and Lexical Signals for Native Language Identification of Language Learners cs.CL | cs.LGPDF

Ahmet Yavuz Uluslu, Mengjie Qian, Kate Knill, Mark Gales

TL;DR: 论文研究二语学习者的母语（L1）识别，比较基于WavLM的语音声学分类器与基于转写文本的零样本GPT-4o分类器，并在CEFR平衡评估集上分析不同语言水平下的表现。实验显示完整转写下音频分类总体更优，但文本在A2至C1水平更有优势，且文本性能受转写长度影响明显。

Details

Motivation: 传统口音/母语识别多依赖语音声学特征，较少系统分析学习者语音转写文本中的母语痕迹。论文旨在比较声学与词汇/文本信号在L1识别中的作用，并考察语言水平与可用语言材料长度对性能的影响。

Result: 在完整转写条件下，WavLM音频分类器整体优于GPT-4o文本分类器；A1水平音频更好，A2至C1文本更好。文本准确率总体随CEFR水平提高而上升，声学性能较稳定；限制转写长度会显著降低文本准确率，而音频对输入长度较不敏感。

Insight: 创新点在于同时利用语音和转写文本进行学习者L1识别，并采用CEFR平衡评估集分析不同熟练度下的互补性。可借鉴之处是系统评估声学与文本信号及输入长度敏感性，为多模态L1识别和资源受限场景提供依据。

Abstract: Spoken native language (L1) identification for second language learners has traditionally relied on acoustic attributes of speech. Comparatively little attention has been paid to analysing speech transcripts for L1 traces. In this paper, we present a study of L1 identification using both speech and corresponding transcripts from a spoken learner English corpus. We compare a WavLM-based audio L1 classifier with a zero-shot GPT-4o classifier operating on transcripts and analyse their predictions across proficiency levels using a CEFR-balanced evaluation set. Our experiments show that the audio classifier outperforms the transcript-based approach overall when full transcripts are available, although their relative strengths vary with learner proficiency. Audio performs better at A1, whereas text performs better from A2 to C1 with full transcripts. Transcript-based accuracy generally increases with proficiency, while acoustic performance remains comparatively stable. Restricting transcript length substantially reduces text-based accuracy, whereas audio is less sensitive to input length and performs relatively well with limited input. These findings provide insights into L1 identification from acoustic and textual representations of learner speech and how performance varies with proficiency and the amount of available language material.

[21] A Broader Look into MLLM’s Retrieval Heads cs.CLPDF

Jia Wang, Yuqing Li, Jiangnan Li, Zheng Lin, Mo Yu

TL;DR: 论文系统研究了多模态大模型中的检索头机制，将分析扩展到音视频等新模态，并验证检索头在新模态中仍然稀疏且跨模态高度共享。作者进一步发现消融这些共享检索头会显著破坏音视频检索及多项多模态能力，并提出用排序目标优化检索头注意力以提升文档检索性能。

Details

Motivation: 已有关于检索头的研究多局限于有限模态和模型，且如何利用检索头增强模型仍缺乏探索；论文关注检索头机制是否会随模型输入模态扩展而扩展，并试图把检索头从分析对象转化为优化目标。

Result: 在18个语言、视觉语言和全模态模型检查点上，全模态模型基本保留其骨干网络的检索头；消融检索头几乎完全消除音视频检索，跨模态共享头虽不足全部头的2%，但消融后会损害文档理解、空间感知和视觉数学能力。用排序目标训练检索头注意力后，Qwen3-VL-8B在MMDocIR上的页面Recall@1提升6.03点，并在三个模型家族上改善文档检索。

Insight: 创新点在于跨模态验证检索头的稀疏性与共享性，并揭示其对多种多模态能力的广泛影响；客观上看，将功能性注意力头同时作为模型分析视角和可优化目标，为理解和提升多模态大模型的长上下文检索能力提供了可借鉴路径。

Abstract: Locating relevant evidence in long inputs is a core capability of Multimodal Large Language Models. Prior studies attribute this capability to retrieval heads, a sparse set of attention heads that transfer information from the context to the output. However, these analyses are confined to a limited set of modalities and the corresponding models. Moreover, how retrieval heads can be leveraged to enhance the model calls for further exploration. In this paper, we ask whether this mechanism expands together with the input modalities of the model. Taking audio-visual input as a newly added modality, we construct paired inputs in which the same answer is either spoken or shown on screen. With the evidence content fixed, retrieval heads remain sparse in the new modality and are shared to a large extent across modalities. Across 18 language, vision-language, and omni-modal checkpoints, omni-modal models largely preserve the retrieval heads of their backbones. Ablating these heads eliminates nearly all audio-visual retrieval. The heads shared across modalities make up fewer than 2% of all heads, yet ablating them also degrades document understanding, spatial perception, and visual mathematics. Building on these findings, we turn retrieval heads into a target of optimization by training their attention with a ranking objective. This raises the page Recall@1 of Qwen3-VL-8B on MMDocIR by 6.03 points and improves document retrieval across three model families. Functional attention heads can thus serve both as a lens on multimodal models and as a target for improving them.

[22] Profile-Driven User Simulation via Reinforcement Learning with Hierarchical Rewards for Task-Oriented Dialogues cs.CLPDF

Juan Li, Fangshu Chang, Xinyi Jiang, Ling Huang, Yunzhang Chen

TL;DR: 论文提出ProfileSim，一个面向金融营销外呼的Profile驱动用户模拟框架，联合建模用户画像（人口统计特征与大五人格）和业务画像（从真实通话日志逆向意图），在真实语音对话数据上微调基座模型，并用GRPO的分层奖励（对话级和话语级）优化；配合集成SOP约束与RAG的客服agent，生成对话数据用于意图识别训练、agent评估和冷启动部署。

Details

Motivation: 高价值任务型对话场景需要大量领域对话数据，但隐私法规、标注成本和专家人力使其难以获取；现有用户模拟方法多面向通用域，缺乏对领域业务流程与合规约束的建模，也难以捕捉语音交互的口语化特征。

Result: 在所有评估的用户生成器中，ProfileSim取得最高口语自然度、最强用户画像遵循性和长尾意图上最低的agent得分，并在业务合规性可比的情况下生成显著更短的用户话语。

Insight: 创新点在于联合用户画像与业务画像实现细粒度行为控制，利用真实语音数据微调并以GRPO分层奖励优化，同时结合SOP/RAG客服agent生成可用于训练、评估和冷启动的数据；客观看，将业务画像从真实通话日志逆向意图、并针对金融营销外呼的合规与口语化建模具有针对性创新。

Abstract: Building Task-Oriented Dialogue (TOD) systems for high-value scenarios such as financial marketing requires large volumes of domain-specific dialogue data, which privacy regulations, annotation costs, and the need for expert labor make hard to obtain. User simulation offers a remedy, but existing methods target general-domain dialogue and exhibit two key limitations: insufficient modeling of domain-specific business processes and compliance constraints, and inadequate capture of the colloquial, spoken-language character of voice interactions. We propose ProfileSim, a profile-driven user simulation framework for financial marketing outbound calls. It jointly models user profiles—demographics and Big Five personality traits—and business profiles—intents reverse-engineered from real call logs—enabling fine-grained control over simulated behavior. The base model is fine-tuned on real voice dialogue data and refined by Group Relative Policy Optimization (GRPO) with hierarchical rewards at the dialogue and utterance levels. Paired with a customer service agent integrating Standard Operating Procedure (SOP) constraints and Retrieval-Augmented Generation (RAG), ProfileSim achieves the highest colloquial naturalness, the strongest user profile adherence and the lowest agent score on long-tail intents among all evaluated user generators, while producing substantially shorter user utterances at comparable business compliance. The generated dialogue data is designed to support intent recognition training, agent evaluation, and rapid cold-start deployment.

Sugam Karki, Raúl Vázquez, Yova Kementchedjhieva

TL;DR: 论文系统研究基于Transformer的视觉编码器如何处理渲染文本及其语义，通过跨模态对齐、探测和检索分析逐层考察正字法、语法和语义组织。研究发现强跨模态映射只在最深层层出现，且发生在单模态对象与文本识别能力形成之后，并伴随从表面表示到语义表示的转变。对比训练模型表现最强，但更大自监督模型和文本丰富训练数据也能部分支持类似能力。

Details

Motivation: 尽管大型视觉语言模型擅长OCR，但其底层视觉编码器如何编码文本及意义、是否具备类似阅读理解的能力仍不清楚，论文旨在用受控分析揭示视觉编码器中的跨模态对齐与表示层级。

Result: 摘要未给出具体benchmark或定量指标；定性结果显示强跨模态映射主要出现在最深层层，对比训练模型最强，更大的自监督模型和文本丰富训练数据可在无显式语言监督下部分支持类似行为。

Insight: 创新点在于对视觉编码器进行逐层、跨模态的受控分析，联合正字法、语法和语义层级考察文本理解能力，并比较不同训练范式、模型规模和数据文本丰富度对语言监督缺失的补偿作用。

Abstract: While large vision-language models excel at optical character recognition, it remains unclear how their underlying vision encoders process text and its meaning, and whether they support anything resembling reading comprehension. We systematically study transformer-based vision encoders, using cross-modal alignment between rendered text and visual concepts together with probing and retrieval-based analyses as a controlled window into these broader capabilities. Our layer-wise analyses span orthographic, grammatical, and semantic organization, and reveal that strong cross-modal mapping emerges only in the deepest layers, after unimodal object and text recognition have already developed, coinciding with a progression from surface-level to semantic representations. Although this hierarchy is strongest in contrastively trained models, larger self-supervised models and text-rich training data partially support similar behaviors without explicit language supervision. Together, our results suggest that increasing model and training-data scale, as well as text-rich training data, can partially compensate for the absence of language supervision.

[24] The Punjabi Geet Toxicity Dataset (PGT-FG): Fine-Grained Multimodal Annotations for Toxic Content in Punjabi Songs cs.CLPDF

Lakhjeet Kaur, Jaspreet Kaur, Komal Rani, Yougal Attri, Ramakant KumarJaydeep Kishore

TL;DR: 论文提出了旁遮普语歌曲毒性数据集PGT-FG，从YouTube公开旁遮普歌曲中构建片段级资源，最终包含392首歌曲的2396个唯一片段，并提供二分类毒性、8类细粒度毒性、严重程度、情感、模式和不确定性标注。数据集由4名旁遮普语母语者标注，经一致性评估和多数投票生成最终标签，并公开在Zenodo上。

Details

Motivation: 旁遮普语毒性检测资源有限，尤其是融合语言与多模态信息的音乐内容缺乏细粒度标注数据，因此需要构建面向旁遮普歌曲的毒性检测资源。

Result: 最终数据集中705个片段（29.42%）为有毒、1691个（70.58%）为无毒；暴力类最常见，占有毒片段的76.45%，其次为帮派引用32.20%和毒品引用18.87%。总体毒性标签在共享标注子集上达到Fleiss’ kappa=0.6521，属于较高一致性。

Insight: 创新点在于面向旁遮普歌曲构建片段级、细粒度的多模态毒性标注数据集，涵盖8类毒性、严重程度、情感、模式与不确定性标记，并通过多人标注和一致性分析提升标签可靠性，为低资源语言和多模态毒性检测研究提供可复用资源。

Abstract: Resources for toxicity detection in Punjabi remain limited, particularly for musical content that combines linguistic and multimodal information. We present the Punjabi Geet Toxicity Dataset (PGT-FG), a segment-level resource developed to support research on toxicity detection in Punjabi musical content. The dataset was constructed from publicly available Punjabi songs collected from YouTube. An initial collection of 620 songs resulted in 465 successfully downloaded songs and 3,402 preliminary segments from 450 songs. After quality control and annotation, the final dataset contains 2,396 unique segments from 392 songs. Four native Punjabi annotators produced 2,870 annotation records, including a shared subset of 158 segments annotated by all four. Each annotation includes binary toxicity, eight fine-grained toxicity categories, severity, sentiment, mode, and an uncertainty flag. Inter-annotator agreement was measured with Fleiss’ kappa on the shared subset, and majority-based resolution produced the final segment-level labels. Of the 2,396 segments, 705 (29.42%) were labelled toxic and 1,691 (70.58%) non-toxic. Violence was the most frequent category, occurring in 539 toxic segments (76.45%), followed by gang references (227, 32.20%) and drug references (133, 18.87%). The overall toxicity label achieved substantial agreement (kappa = 0.6521). PGT-FG provides a fine-grained resource for Punjabi toxicity detection and multimodal content analysis. The resolved dataset, with one final record per segment, is publicly available on Zenodo (https://doi.org/10.5281/zenodo.23040156). Original lyrics, lyric excerpts, and copyrighted audio or video content are not redistributed.

[25] PHYRD: A Living Benchmark for Reproducing and Extending Theoretical Physics Research cs.CLPDF

Qituan Zhang, Guo Chen, Linfeng Zhang, Wenlong Zhang

TL;DR: 论文提出 PHYRD，一个面向理论物理推理的“活”基准，包含 63 个复现（Reproduce）问题和 43 个发现（Discover）问题，分别测试对已发表结果的推导复现与修改理论条件后的后果推演。作者用 FormulaForest 构建任务、参考解和子问题级评分标准，并评估五个大模型及工具增强设置，同时验证 FormulaForest 作为合成数据的价值。

Details

Motivation: 大语言模型和智能体已展现 advanced 物理研究能力，但缺少系统评估其在理论物理中复现推导和扩展理论后果的基准。论文旨在建立可复现、可扩展的理论物理推理评测，并诊断模型的概念错误与论证缺失。

Result: 五个模型在 Reproduce 上的整题准确率为 49.21%–68.25%，在闭卷 Discover 上为 18.60%–74.42%；使用工具后四个模型能完成更多 Discover 问题，但概念错误和论证缺失仍存在。FormulaForest 作为合成数据使 Qwen-35B-A3B 在 OpenAI 的 FrontierScience 基准上从 61% 提升到 72%。

Insight: 摘要宣称的创新点在于构建复现与发现双任务的理论物理活基准，并用 FormulaForest 生成参考解和子问题级评分标准。客观来看，其价值在于细粒度评估理论推导过程、支持修改条件后的泛化推理，并证明该数据构造方式可作为提升模型物理推理的合成数据。

Abstract: Large language models and agents have shown significant power in advanced physical research. In this paper, We introduce PHYRD, a living benchmark for theoretical-physics reasoning with 63 Reproduce and 43 Discover problems. Reproduce tests derivation of published results; Discover tests consequences of modified theoretical conditions. FormulaForest constructs the tasks with reference solutions and subquestion-level rubrics. Across five models, whole-problem accuracy ranges from 49.21% to 68.25% on Reproduce and from 18.60% to 74.42% on closed-book Discover. With tools, four models complete more Discover problems, but conceptual errors and missing arguments persist. Besides, our experimental results demonstrate the value of FormulaForest as synthetic data. On FrontierScience, a benchmark developed by OpenAI, it raises the accuracy of a Qwen-35B-A3B model from 61% to 72%.

[26] On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models cs.CL | cs.AI | cs.LGPDF

Leon Sick, Lukas Hoyer, Yannick Strümpler, Christian Reisswig, Timo Ropinski

TL;DR: 论文提出一种无数据、无外部强教师的On-Policy自训练框架，将on-policy自蒸馏重构为自训练：模型仅根据粗粒度主题描述自行生成问题、答案和特权推理演示，并利用这些完全合成的监督信号进行自我提升。该方法在文本和多模态任务上验证了通用性，可在标准语言基准和VQA上实现一致自我改进，同时保留未自训练领域的能力。

Details

Motivation: 现有on-policy自蒸馏虽能不依赖更强外部教师进行后训练，但仍需真实问答对、人工设计题目或其他监督信号。论文希望将监督推至极限，在无人工提示和答案、无精选问题分布的条件下实现基础模型自我改进。

Result: 摘要未给出具体数值或SOTA对比，但报告在标准语言基准和视觉问答任务上取得一致的自我提升，并能在多个领域改进的同时保持未自训练领域的能力。

Insight: 创新点在于仅用粗粒度主题描述驱动模型自生成课程与特权推理轨迹，并将特权信息完全合成化用于on-policy自蒸馏/自训练，跨文本与多模态验证通用性。客观看，其价值在于把监督信号来源从人工数据或强教师转向模型自身潜在能力，降低了后训练对 curated 数据和外部监督的依赖。

Abstract: On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem sets, or other supervised signals. In this work, we reformulate on-policy self-distillation as a self-training framework, driven by self-generated question-answer pairs and privileged reasoning demonstrations. We push supervision to the limit: guided solely by coarse, high-level topic descriptions, the model synthesizes its own curriculum of queries and privileged reasoning traces without access to any human-curated prompts or answers. We find that self-distillation on fully synthetic privileged information enables a model to improve across multiple domains while retaining its capabilities on domains it is not self-trained on. We demonstrate the generality of this framework across text and multimodal domains, achieving consistent self-improvement on standard language benchmarks and Visual Question Answering. Our findings demonstrate that foundation models possess rich latent capabilities that can be amplified without external task supervision or curated problem distributions.

[27] Frontier-OPD: Discovering the Edge of Agent Capability and Teaching Agents to Go Beyond cs.CLPDF

Zheng Jiang, Yiming Chen, Houde Qian, Ling Li, Chaoyang Li

TL;DR: 论文提出 Frontier-OPD，一种面向多轮智能体的在线策略蒸馏方法。它通过共享状态轨迹图识别学生当前的学习前沿，即需要教师短期引导且学生随后能自主延续的决策情境；再用短教师桥接与后续学生表现的一致性筛选有效监督，并将接受的教师响应加入蒸馏数据、随策略更新重新估计前沿。

Details

Motivation: 多轮智能体在线蒸馏中，关键不只是找到学生需要指导的地方，还要判断学生接受指导后能否维持后续交互；现有方法难以同时识别有效干预点并保证监督可被学生吸收。

Result: 在 ALFWorld、WebShop 和 ScienceWorld 上，Frontier-OPD 在评估的学生规模和教师配置下取得高于对比蒸馏基线的平均自主性能；消融显示候选选择与指导过滤具有互补效果，且某 ALFWorld 时间设置下额外收集成本可由更快达到目标成功率抵消。

Insight: 创新点在于用学习前沿定义可教且可延续的干预情境，并通过共享状态轨迹图、轨迹平衡的师生分歧聚合和短教师桥接行为评估来筛选监督；客观看，其价值在于把“何处教”和“教后能否自主延续”统一到在线蒸馏流程中。

Abstract: On-policy distillation aligns teacher feedback with a student’s current behavior, yet acquiring useful supervision for multi-turn agents requires identifying both where guidance is needed and whether the student can sustain the interaction afterward. We introduce Frontier-OPD, which addresses this problem through the student’s learning frontier: decision situations that remain challenging but admit useful autonomous continuation after brief teacher guidance. To operationalize this frontier, Frontier-OPD organizes on-policy experience into a shared-state trajectory graph, where trajectory-balanced aggregation of teacher-student disagreement identifies distinct intervention candidates while preserving the histories needed for replay. Short teacher bridges are then assessed by comparing agreement over the bridge and the ensuing student continuation with an equally long segment of the original trajectory, providing a behavioral proxy for guidance that the current student can build on. Accepted teacher responses augment ordinary distillation data, and fresh rollouts renew the frontier estimate as the policy changes. Experiments on ALFWorld, WebShop, and ScienceWorld report higher mean autonomous performance than the compared distillation baselines across the evaluated student scales and teacher configurations, with ablations indicating complementary effects of candidate selection and guidance filtering. In one ALFWorld timing setting, the additional collection cost is offset by a shorter time to a target success rate.

[28] KrishokTech: A Bengali Agricultural Advisory System with Explicit Authorization Controls cs.CLPDF

Khan Raiyan Ibne Reza, Sanjana Aktar Maria, Shakil Ahmed, Faiyad Hossain, Sumaiya Tabassum Nimi

TL;DR: 论文提出了KrishokTech，一个孟加拉语农业咨询系统，其核心是在生成过程前后设置显式授权控制：检索前进行归一化和基于规则的准入检查，对高风险请求进行转介，对意图不明确时询问作物；检索时绑定单一作物，当文本与图像作物不一致时要求确认；生成后用窄验证器移除不支持的剂量声明。系统将农业指导存放在可更新的外部证据索引中，并利用浏览器端视觉和本地检索减少连接需求。界面以ASK、CONFIRM、REFER、DROP展示决策及证据。

Details

Motivation: 农业咨询系统不能只关注生成答案，还必须控制不安全请求、适应有限网络连接，并应对不断变化的农业指导，因此需要明确的授权边界来管理从请求到建议的整个路径。

Result: 在200个农民查询和400个压力查询上，控制机制成功阻止了不明确请求，并将跨作物检索违规从36.5%降至0%；文本-图像冲突检测捕获了454例中的453例，剂量验证器捕获了118个插入错误中的114个。

Insight: 创新点在于将授权控制显式嵌入生成流程（检索前准入、检索后验证）、使用可独立更新的外部证据索引避免重新训练生成器、通过浏览器端视觉和本地检索降低连接依赖，以及将系统决策（ASK/CONFIRM/REFER/DROP）及其证据透明地展示给用户。

Abstract: For agricultural advisory, generating an answer is only part of the problem: the system must also control unsafe requests, work with limited connectivity, and accommodate changing guidance. KRISHOKTECH is a Bengali agricultural advisory system built around an explicit authorization boundary around generation. Before retrieval, normalization and rule-based admission checks refer policy-covered high-risk requests and ask for a crop when treatment intent is underspecified. The system then binds retrieval to a single crop and asks for confirmation when the text and image indicate different crops. After generation, a narrow verifier removes dosage claims not supported by retrieved BARI/BRRI evidence. Agricultural guidance is kept in an external evidence index that can be updated without retraining the generator, while browser-side vision and local retrieval reduce connectivity requirements. The interface makes these decisions visible as ASK, CONFIRM, REFER, and DROP, together with their evidence. On 200 farmer queries and 400 stress queries, the controls halted underspecified requests and reduced cross-crop retrieval violations from 36.5% to 0% under the tested alias filter. Mismatch detection caught 453 of 454 text-image conflicts, while the verifier caught 114 of 118 inserted dosage errors. The demonstration shows how these controls govern the path from request to delivered advice.

[29] J-Comm: Jacobian-Guided Latent Communication between LLM Agents cs.CL | cs.MAPDF

Xiangwei Wang, Wei Wang, Sachith Seneviratne, Ken Chen, Yu Xia

TL;DR: 论文提出 J-Comm，一种面向 LLM Agent 的隐空间通信框架，包含无需训练的 GEAR 连续推理机制和 H+J 通信接口。GEAR 在嵌入空间中对候选 token 做几何一致性重加权；H+J 让接收方从发送方的反馈分布与 Jacobian-lens 中间状态中获得互补线索，并用自身词典重构后注入中间层。该方法无需共享 KV cache 或要求模型宽度一致，在 Qwen3-8B 到 Qwen3-4B 通信中于多个基准取得领先结果。

Details

Motivation: 隐空间通信既需要有效的连续推理过程，也需要一个接口让外部模型利用其中间计算。论文旨在解决文本通信效率低、隐状态难利用，以及 KV cache 共享和模型宽度一致等限制。

Result: 在 Qwen3-8B 到 Qwen3-4B 通信中，J-Comm 在七个基准上取得最高平均分，包括 MATH500 94.80%、GPQA-Diamond 54.55%、AIME2024+2025 73.33%、ALFWorld 62.93% 成功率。相比 TextMAS，性能提升 1.29-8.59 个百分点，并减少 19.2-74.8% 的生成文本 token。

Insight: 创新点在于无需训练的 GEAR 通过嵌入空间几何共识单调优化候选 token 重加权，以及 H+J 接口同时传递反馈分布输入和 vocabulary-indexed Jacobian-lens 中间线索。接收方用自身词典重构并注入中间层，使通信不依赖 KV cache 共享和相同模型宽度，具有较强的模型异构适配性。

Abstract: Latent communication requires both an effective continuous reasoning process and an interface through which an external model can leverage its intermediate computation. We present J-Comm, a framework comprising two core components. First, a training-free Geometric Agreement for Latent Reasoning (GEAR) reweights token candidates over existing model embeddings, which monotonically optimizes geometric consensus among candidate tokens in embedding space at each step. Second, we introduce an H+J (Hidden-and-Jacobian) communication interface that gives the Receiver two complementary views of the Sender’s reasoning. The H channel supplies continuous inputs derived from feedback distributions, while the J channel conveys intermediate-state cues in vocabulary-indexed Jacobian-lens coordinates. Intuitively, H provides inputs for the Receiver to reason from, while J offers additional guidance within its computation. The Receiver reconstructs these cues using its own dictionary and injects them into intermediate layers during prefill, enabling communication without sharing key-value caches or requiring identical model widths. In Qwen3-8B to Qwen3-4B communication, J-Comm achieves the highest mean score across seven benchmarks, including 94.80% on MATH500, 54.55% on GPQA-Diamond, 73.33% on AIME2024+2025, and 62.93% success on ALFWorld. Compared with TextMAS, it improves performance by 1.29-8.59 percentage points and reduces generated text tokens by 19.2-74.8%.

cs.CV [Back]

[30] DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model cs.CVPDF

Zixian Gao, Lixin Xiu, Penghao Luo, Xiangcheng Cao, Ziqi Cai

TL;DR: 论文提出 DirCast，一个统一的流式视频语言模型，用于电竞直播中的实时导播与解说。模型每秒低分辨率扫描所有选手视角，决定是否切换镜头，再高分辨率读取被选中视角并生成解说；通过保留已播出内容和已说内容的上下文、让其他视角过期，控制任意长度直播的计算成本。作者构建了包含27场职业Dota 2比赛、每英雄视角、人工导播选择和解说文本的数据集。

Details

Motivation: 现有流式视频语言模型只能在人类导播已制作好的直播画面上进行解说，无法自主选择镜头。论文关注更真实的实况直播制作场景：模型仅基于过去信息，从多路原始选手摄像头中同时完成镜头导播和解说。

Result: DirCast 的导播效果优于基于规则和零样本的导播方法，包括 GPT-5；在 Proact-VL 协议下，其解说对 GPT-4o 的比较胜率为29.2%，而观看人工直播画面的11个流式解说模型中最强者仅为19.4%。

Insight: 创新点在于用单一流式视频语言模型联合完成实时导播与解说，并采用“低分辨率全局扫描—高分辨率读取选中视角”的两阶段感知策略，以及仅保留播出流和语音上下文的有限记忆机制；同时构建了多视角职业比赛数据集，为直播制作研究提供基准。

Abstract: A live esports broadcast needs a director who chooses which camera goes on air and a caster who talks over that choice, every second and without knowing what comes next. Streaming video language models have learned to commentate, but only over a broadcast that a human director has already produced. We study live broadcast production, in which a model receives the raw camera of every player and must both direct and commentate from the past alone. We present DirCast, a single streaming video language model that does both. Every second it scans all cameras at low resolution, decides with a hold-or-switch director whether and where to cut, and reads the chosen camera at high resolution before it speaks. Its context keeps what went on air and what was said and lets the other views expire, which bounds the cost of a stream of any length. We build a dataset of 27 professional Dota 2 matches with a camera for every hero, the human director’s choices and the casters’ commentary. DirCast directs better than rule-based and zero-shot directors including GPT-5, and its commentary wins 29.2 percent of comparisons against GPT-4o under the Proact-VL protocol, against 19.4 percent for the strongest of eleven streaming commentators that watch the human broadcast.

[31] AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation cs.CVPDF

Zhuoyuan Jiang, Weijie Lyu, Xiaoyuan Wang, Tiancheng Shen, Ming-Hsuan Yang

TL;DR: 论文提出 AudioLift，一个两阶段音频驱动单图生成全头 3D 说话化身的框架。方法先生成同步多视角视频作为中间表示，再通过抗不一致性的高斯重建恢复连贯的全头几何，从而避免依赖 3DMM/FLAME 等参数化人脸模型和逐实例优化。

Details

Motivation: 现有 3D 说话化身方法多依赖 3DMM 或 FLAME 等参数化人脸模型，其紧凑的运动表示难以合成极端表情，也难以建模头饰等配件，因此需要一种不依赖参数化模型、能从单张肖像生成完整头部化身的方法。

Result: 摘要称大量实验表明 AudioLift 能捕捉比现有方法更极端的面部表情，并具有更好的几何完整性和覆盖完整 360° 视角的强多视角一致性；但未给出具体定量指标或 benchmark 结果。

Insight: 创新点在于将生成的多视角视频作为音频驱动化身生成的中间表示，并结合同步多视角视频生成与抗不一致性的高斯重建，在无需参数化人脸模型和逐实例优化的条件下实现全头高保真建模。客观来看，多视角视频作为中间桥接和鲁棒高斯重建是其可借鉴的核心思路。

Abstract: Existing 3D talking avatar methods mainly rely on parametric face models including 3DMM or FLAME, whose compact motion representations limit their ability to synthesize extreme expressions and to model accessories such as headwear. We introduce AudioLift, a two-stage framework that uses generated multi-view videos as the intermediate representation for audio-driven avatar generation without parametric face models or per-instance optimization. Our framework combines a synchronized multi-view video generation stage with an inconsistency-robust Gaussian reconstruction stage to recover coherent full-head geometry from a single portrait image. Extensive experiments demonstrate that AudioLift produces 3D talking avatars capable of capturing more extreme facial expressions than existing methods, with improved geometric completeness and strong multi-view consistency across the full $360^\circ$ viewing range.

[32] SyncVid: World-Equivariant Diffusion for Synchronized Video Generation cs.CVPDF

Farhad G. Zanjani, Animesh Karnewar, Fatih Porikli, Amirhossein Habibian

TL;DR: 论文提出 SyncVid，用于从单段参考视频生成同一动态场景的多个同步视角视频。其核心是在扩散过程的噪声先验层面实现跨视角一致性：将单目视频提升为规范4D表示，在规范3D空间中采样高斯噪声并光栅化到目标相机，再配合跨视角一致的白化处理，作为 LoRA 适配的预训练视频扩散模型的结构化先验。方法无需修改模型架构，实验表明可提升生成视频的感知质量和跨视角一致性。

Details

Motivation: 现有基于相机嵌入、跨视角注意力和几何条件的视频扩散方法主要依赖架构机制，对静态场景有效，但难以保持细粒度动态几何在跨视角和跨时间上的一致性。论文希望从扩散随机性源头同步多视角视频生成，而不是在各2D图像平面独立采样噪声。

Result: 摘要未给出具体benchmark或定量数值，仅说明实验生成同步视频，并在感知质量和跨视角一致性上取得提升。

Insight: 创新点在于将噪声先验与场景几何关联：在规范3D/4D空间中采样结构化噪声并光栅化到任意视角，同时提出跨视角一致的白化以消除渲染带来的局部相关性；并仅通过LoRA适配预训练视频扩散模型而无需架构修改。客观来看，从随机性源头强制时空与跨视角一致性，是区别于传统架构条件控制的关键思路。

Abstract: Generating multiple videos of a dynamic scene from a single reference video requires synthesizing both observed and unobserved content consistently across viewpoints. Existing camera-control methods for video diffusion typically rely on architectural mechanisms, including camera embeddings, cross-view attention, and geometric conditioning. Although effective for static scene content, these approaches often struggle with the fine-grained, dynamic geometry that must remain coherent across views and over time. We synchronize the diffusion process itself by sampling the Gaussian noise prior in a canonical 3D space derived from the source video and rasterizing it into target cameras, rather than sampling independently in each 2D image plane. Our method, SyncVid, lifts a monocular video into a canonical 4D representation, associates noise with scene geometry and unseen space, and rasterizes the resulting structured noise into arbitrary views. Because rendering can introduce local correlations, we further propose a cross-view-consistent whitening procedure that decorrelates neighboring pixels while preserving correspondence across views. The structured noise serves as the diffusion prior for a LoRA-adapted pretrained video diffusion model, requiring no architectural modifications. By enforcing spatiotemporal and cross-view coherence at the source of stochasticity, SyncVid generates synchronized videos and improves both perceptual quality and cross-view consistency in our experiments. Project page: https://qualcomm-ai-research.github.io/SyncVid-Webpage.

[33] PnP*: A certifiable solver for Perspective-n-Point cs.CV | cs.RO | math.OCPDF

Bang-Shien Chen, Caitrin E. Eaton, David M. Rosen

TL;DR: 论文提出 PnP*，首个实用的可认证 Perspective-n-Point 求解器。该方法针对 PnP 的真实最大似然估计问题，通过凸松弛与稀疏化/商环约简，在保证高效计算的同时返回可认证的全局最优相机位姿。

Details

Motivation: 现有 PnP 方法多求解最小问题或将目标替换为更易处理的近似目标，缺少针对实际 MLE 的可扩展且可认证求解器。论文旨在填补这一空白，保证全局最优性并提升可扩展性。

Result: 作者证明在中等噪声下其凸松弛是精确的，这是 PnP 的 MLE 松弛的首个稳定性保证；数值实验验证了稳定性与可扩展性，PnP* 能以超过 10 Hz 的频率返回可证明正确的相机位姿。

Insight: 创新点在于首个实用的可认证全局最优 PnP MLE 求解器，并利用弦稀疏模式和商环约简使凸松弛可处理、可扩展；客观看，其价值在于将可认证优化与 PnP 实际问题结合并给出稳定性保证。

Abstract: Estimating a camera pose from 3D-2D correspondences - Perspective-n-Point - is one of the most fundamental problems in computer vision. Existing methods either solve a minimal problem or replace the objective with an easier one. Surprisingly, no scalable certifiable solver for the actual Maximum Likelihood Estimation (MLE) exists. We propose PnP*, the first practical solver that guarantees efficient computation and returns a certifiable globally optimal solution. We prove that the underlying convex relaxation is exact under moderate noise, which to our knowledge is the first stability guarantee for any relaxation for the MLE of PnP. Furthermore, we reduce the relaxation by exploiting chordal sparsity pattern and quotient ring reduction such that the relaxation is tractable and scalable. The stability and scalability results are verified numerically, as PnP* returns a provably correct camera pose at over 10 Hz.

[34] StackGen3D: Stable 3D Block Stack Generation from Multiview Silhouettes cs.CV | cs.ROPDF

Xiaopeng Zhang, Luzhe Sun, Yiqing Xu, Matthew R. Walter

TL;DR: 论文提出StackGen3D框架，从给定积木库存和三个正交轮廓生成物理稳定的3D积木堆叠。方法分两阶段：先用物理信息图神经网络（PI-GNN）预测支撑关系并筛选稳定结构数据集，再训练条件流匹配模型生成符合轮廓的候选配置，推理时通过轻量几何选择与细化减少穿透。

Details

Motivation: 从视觉规格生成3D结构时存在几何歧义和物体间物理交互问题，需要同时满足轮廓一致性和物理稳定性，而无需依赖耗时的物理模拟。

Result: PI-GNN从简单堆叠泛化到复杂结构的能力显著优于参数匹配的MLP；Best-of-10选择将物理稳定性从45.3%提升至72.4%，轮廓IoU达到0.970。

Insight: 创新点在于将物理关系推理（图神经网络预测支撑关系）与条件流匹配生成模型结合，并通过数据筛选和轻量几何优化避免物理模拟，实现高效稳定的3D组装生成。客观看，将物理约束嵌入生成流程并利用关系推理提升泛化性是值得借鉴的思路。

Abstract: Generating physically stable 3D structures from visual specifications requires resolving geometric ambiguity while accounting for physical interactions among objects. We present StackGen3D, a framework for generating stable block assemblies conditioned on a given block inventory and three orthographic silhouettes. Our approach consists of two stages. First, we develop a physics-informed graph neural network (PI-GNN) that models support relations between blocks and serves as a fast stability predictor for curating a diverse dataset of stable structures. Second, we train a conditional flow-matching model on this dataset to capture the multimodal distribution of block configurations consistent with the target silhouettes. At inference time, lightweight geometric selection and refinement reduce inter-block penetration without physics simulation. Preliminary experiments show that the PI-GNN generalizes from simple stacks to complex structures substantially better than a parameter-matched multilayer perceptron. For structure generation, Best-of-10 selection improves physical stability from 45.3% to 72.4% while achieving a silhouette IoU of 0.970. These results highlight the potential of combining relational physical reasoning, scalable data curation, and conditional generative modeling for creative 3D assembly. Project website: https://ripl.github.io/StackGen3D-web/

[35] SAGE: A hybrid vision-language and geometry framework for work-zone pathway prediction under temporary traffic control cs.CV | cs.ROPDF

Jiaxi Liu, Keshu Wu, Weizhe Tang, Bofeng Cao, Sikai Chen

TL;DR: 论文提出SAGE（Semantic-to-Action Grounded Execution）框架，用于临时交通控制下施工区通行路径预测。它将问题拆解为“读-决策-执行-检查”：先用几何生成器构造多个候选路径，再用视觉语言模型（VLM）的轨迹作为偏好对候选排序，并结合MUTCD规则监督与危险侧谓词进行最终安全干预。

Details

Motivation: 施工区临时交通控制要求自动驾驶车辆把可见交通设施的理解转化为连续可通行路径；几何预测器虽能给出多条合理路径，但难以选出与临时控制一致的路径。论文旨在解决路径生成、路径偏好和交规合规之间的耦合问题。

Result: 在2,306个真实ROADWork验证片段上，87%的片段候选集中包含距人类演示10像素内的路径，但选择遗憾占几何排序器误差的53%。SAGE相较排序器将平均和最终位移误差分别降低8.3%和12.0%，硬约束违规降低37%；精度与SOTA VLM模块相当且响应更快，并在位移误差和安全指标上优于四个适配的驾驶VLM。

Insight: 创新点在于将VLM轨迹不直接作为控制输出，而是作为对完整几何候选的偏好信号，并在共享候选空间中解耦路径构造、偏好选择和合规检查；结合MUTCD结构化监督、危险侧图像空间谓词及有界最终干预，提升了选择合规路径的鲁棒性。

Abstract: Temporary traffic control redirects vehicles through work zones, requiring automated vehicles to connect an interpretation of the visible devices to a continuous passing path. Geometric predictors can provide several plausible paths, yet selecting the one consistent with the temporary control remains difficult. We propose SAGE (Semantic-to-Action Grounded Execution), a read-decide-execute-check framework that separates path construction, path preference, and control compliance within a shared candidate space. The central idea is to use a vision-language model’s (VLM’s) trajectory as a preference over intact geometric candidates. A role-decoupled generator constructs the candidates, and rank fusion combines each candidate’s geometric score with its agreement with the VLM trajectory. Supervision structured around the Manual on Uniform Traffic Control Devices (MUTCD) trains SAGE-VLM to state the lane status and hazard side before its passage decision and trajectory. The predicted hazard side enters image-space predicates derived from MUTCD provisions, which support a final intervention bounded in score and displacement. On 2,306 real-world ROADWork validation episodes, the candidates include a path within 10 px of the human demonstration in 87% of episodes, yet selection regret accounts for 53% of the geometric ranker’s error. SAGE reduces average and final displacement errors by 8.3% and 12.0% relative to the ranker, mostly in the far field, and hard-constraint violations by 37%. The trajectory opinion improves all four tested generator-selector combinations. SAGE is comparable to state-of-the-art VLM modules in accuracy, with a faster-responding VLM, and outperforms four other adapted driving VLMs in displacement error and safety measures. Project page: https://hhjj233.github.io/SAGE-page/.

[36] FSVL: Taxonomic Fast-Slow Vision-to-Language Collaborative Framework for Interpretable Confusable Fish Species Identification and Knowledge Generation in the Middle Yangtze River cs.CV | cs.AIPDF

Meng Liang, Fucheng Wang, Lang Zhao, Jun Chen, Ziying Li

TL;DR: 论文提出FSVL快慢双路径视觉-语言协同框架，用于长江中游易混淆鱼类的细粒度识别与可解释知识生成。快速路径用轻量ResNet50对51种鱼进行初分类，并将易混淆类组路由至慢速路径；慢速路径依据分类学标准用YOLOv8n检测头部、背鳍和尾部等关键形态区域，结合形态测量与轮廓特征精细判别。框架还集成检索增强的Qwen3-14B，通过软token和LoRA实现领域知识生成。

Details

Motivation: 长江十年禁渔背景下，水生生物多样性监测需要有效的物种级识别，但近缘淡水鱼类形态差异细微，现有深度学习方法难以兼顾准确率与推理效率，LLM在生成专业生物知识时也可能产生无依据内容。

Result: 在607张图像测试集上，快速分类器达99.67%准确率，级联校正两个错误后总体达100.00%，但独立标本和外部条件验证仍待开展；在255个知识生成样本上，学名准确率由91.37%升至100.00%，属名准确率由90.20%升至98.82%，ROUGE-L由0.335升至0.655。

Insight: 创新点在于将分类学先验引入快慢双路径细粒度识别，并用关键形态区域检测增强易混淆物种判别；同时以RAG、软token和LoRA将视觉识别与LLM知识生成协同，兼顾效率、准确性与可解释性。

Abstract: The Yangtze River Basin is a critical region for freshwater biodiversity conservation. The implementation of the Yangtze River Ten-Year Fishing Ban has increased the importance of effective aquatic biodiversity monitoring and species-level identification. However, fine-grained identification of closely related freshwater fish species remains challenging due to subtle morphological differences. Existing deep learning methods often struggle to balance classification accuracy and inference efficiency, while LLMs may generate unsupported information when producing specialized biological knowledge. To address these challenges, this study proposes FSVL, a fast-slow dual-pathway framework integrating visual recognition with LLM-based Retrieval-Augmented Generation (RAG). A lightweight ResNet50 fast path performs preliminary classification across 51 fish species in the Middle Yangtze River Basin and routes predefined groups of easily confused species to a slow path for refined identification. Guided by taxonomic criteria, the slow path uses YOLOv8n to detect key morphological regions, including the head, dorsal fin, and tail, leveraging morphometric and outline traits to improve discrimination among closely related species. The framework further integrates a retrieval-enhanced Qwen3-14B backend, using soft tokens and Low-Rank Adaptation (LoRA) for parameter-efficient domain knowledge generation. On the evaluated test set of 607 images, the fast classifier achieved 99.67% accuracy, whereas the cascade corrected the two errors, yielding 100.00% overall accuracy; further validation on independent specimens and external conditions remains needed. Across 255 knowledge generation samples, scientific name accuracy rises from 91.37% to 100.00%, genus accuracy from 90.20% to 98.82%, and ROUGE-L from 0.335 to 0.655, supporting intelligent biodiversity monitoring and fisheries management.

[37] StateBridge: Phase- and Track-Grounded Reasoning for Synthetic-to-Real Traffic Video Captioning and VQA cs.CVPDF

Blessing Agyei Kyem, Richard Dzinyela, Joshua Kofi Asamoah, Eugene Denteh, Andrews Danyo

TL;DR: 论文提出 StateBridge 交通视频-语言框架，面向仅用合成数据训练、迁移到真实交通场景的视频描述与视觉问答任务。方法通过相位感知片段构建、行人与车辆轨迹摘要和结构化提示，将视觉语言模型 grounding 到稳定的交通证据上，并用事实锁定描述融合与证据多样化 VQA 共识提升一致性。

Details

Motivation: 真实交通安全视频能提供丰富的人车交互证据，但合成到真实的评测要求模型仅从仿真场景学习并泛化到真实交通，且需避免仅依赖外观线索。

Result: 在仅使用合成训练数据的设置下，StateBridge 在 AI City Challenge 2026 Track 2 上取得官方 S2 分数 55.4679，展示了结构化证据迁移在交通安全描述与 VQA 上的有效性。

Insight: 创新点在于用交通行为相位、行人/车辆轨迹摘要和结构化提示为视觉语言模型提供稳定证据，并通过事实锁定描述融合与证据多样化 VQA 共识增强跨角色、行为阶段和问题类型的一致性。

Abstract: Traffic safety videos provide rich evidence for understanding interactions between pedestrians and vehicles, but synthetic-to-real evaluation makes this setting challenging because models must learn from simulated scenes and generalize to real-world traffic. In this work, we present StateBridge, a traffic video-language framework designed to operate under this synthetic-only training protocol. Our approach uses phase-aware clip construction, pedestrian and vehicle track summaries, and structured prompts to ground vision-language models in stable traffic evidence rather than appearance alone. We fine-tune public vision-language models on synthetic captioning and visual question answering examples, then combine their outputs through fact-locked caption fusion and evidence-diverse VQA consensus to improve consistency across actor roles, behavioral phases, and question types. StateBridge achieves an official S2 score of 55.4679 on AI City Challenge 2026 Track 2 using only synthetic training data. These results demonstrate the effectiveness of structured evidence transfer for traffic safety captioning and visual question answering.

[38] PixGR: Pixel-Space Generative Decoding for Fast Feed-Forward 3D Reconstruction cs.CVPDF

Ranran Huang, Wenjing Bian, Weixun Luo, Ye Mao, Krystian Mikolajczyk

TL;DR: PixGR 将轻量级像素空间生成建模引入前馈 3D 高斯重建，用一次编码得到的场景潜表示条件化地从噪声目标视图生成共享 3D 高斯表示。方法采用像素空间 flow matching，并通过可微渲染实现端到端优化，从而避免 VAE 潜压缩和两阶段流程的误差传播。推理时缓存场景表示，并用轻量 DiT 解码器迭代生成，以保持前馈效率。

Details

Motivation: 前馈 3D 高斯重建通常以回归方式预测场景，在稀疏视图、观察间隔大和视图外推等困难设置下难以建模不确定性。已有生成式方案常依赖 VAE 潜空间压缩或两阶段管线，容易带来误差传播并牺牲效率。

Result: 在挑战性稀疏视图设置下，PixGR 优于基于回归的方法，尤其在大间隔观察和视图外推场景中表现明显。同时保持亚秒级推理，并与参数量显著更大的预训练生成模型具有竞争力。

Insight: 核心创新是将像素空间生成建模与前馈 3D 高斯重建统一起来，用像素空间 flow matching 和可微渲染实现端到端生成监督，避免 VAE 与两阶段误差传播。工程上通过缓存场景表示和轻量 DiT 解码器，在引入生成式不确定建模的同时维持快速推理。

Abstract: We present PixGR, an efficient framework that integrates lightweight pixel-space generative modeling into feed-forward 3D Gaussian reconstruction to model scene uncertainty. Context observations are encoded once into a scene latent representation, which conditions generative decoding from noisy target views to produce a shared 3D Gaussian representation. We formulate this process using pixel-space flow matching, enabling end-to-end optimization of 3D reconstruction with direct pixel-space generative supervision through differentiable rendering. This avoids VAE-based latent compression and error propagation inherent in previous two-stage pipelines. To preserve feed-forward efficiency, PixGR caches the scene representation and performs iterative inference using a lightweight DiT decoder. Experiments demonstrate that PixGR outperforms regression-based approaches in challenging sparse-view settings, particularly with widely spaced observations and view extrapolation. Meanwhile, it maintains sub-second inference and remains competitive with substantially heavier pretrained generative models. Our project page is available at https://ranrhuang.github.io/pixgr/.

[39] STEP: Surgical Point Tracking from Sparse Endpoints and Pseudo-trajectories cs.CVPDF

Bing Fan, Anwesa Choudhuri, Zhongpai Gao, Meng Zheng, Benjamin Planche

TL;DR: 论文提出STEP，一个两阶段手术点追踪框架，利用手术视频和稀疏物理端点学习追踪器，减少对密集轨迹标注的依赖。第一阶段用冻结离线教师生成候选轨迹，并通过时间可逆性和立体一致性筛选稠密监督来训练因果学生模型；第二阶段用鲁棒物理端点损失锚定终点对应，并结合往返一致性损失及训练策略处理漂移和显存。最终追踪器仅需单路RGB流且权重固定。

Details

Motivation: 手术点追踪需要在组织形变和遮挡下保持长期对应，但密集轨迹标注成本高；论文希望利用稀疏物理端点和视频伪轨迹降低标注依赖并提升可迁移性。

Result: 在STIR到VL-SurgPT迁移中，时间-立体并集筛选相比未筛选轨迹降低端点误差7.0%；在排除于端点训练清单的29个VL-SurgPT片段诊断上，端点误差从密集标签微调的31.52像素降至16.80像素。

Insight: 创新点在于用离线教师生成并由时间可逆性/立体一致性筛选伪轨迹，结合稀疏物理端点与往返一致性约束，并用无梯度前缀和可微窗口兼顾漂移暴露与显存；客观看是将伪标签筛选与物理观测弱监督结合来训练手术点追踪器。

Abstract: Surgical point tracking requires persistent correspondence through tissue deformation and occlusion, yet dense trajectory annotations are costly to obtain. We present STEP, a two-stage framework that learns from surgical video and sparse physical endpoints. First, a frozen offline teacher generates candidate trajectories, and temporal reversibility and stereo consistency select dense supervision for a causal student. Second, a robust physical endpoint loss anchors terminal correspondence, while a round-trip loss constrains temporal consistency. A gradient-free prefix exposes training to accumulated drift, while a final differentiable window bounds activation memory. The trained tracker processes a single RGB stream with fixed weights. In STIR-to-VL-SurgPT transfer, temporal-stereo union selection reduces endpoint error by 7.0% relative to unfiltered trajectories. On a post-hoc diagnostic of 29 VL-SurgPT clips excluded from the endpoint-training manifest, STEP reduces endpoint error from 31.52 to 16.80 pixels relative to dense-label fine-tuning. These results support combining curated trajectories with physical observations to train surgical point trackers.

[40] Interpreting Physics in Video Encoders using Multi-Object Interaction Videos cs.CVPDF

Ayushi Mehrotra, Sai Vidyaranya Nuthalapati

TL;DR: 论文研究视频编码器作为世界模型时，其潜在空间是否编码了关系物理属性（如动量传递、恢复系数、摩擦）。作者在两种冻结的自监督视频编码器（V-JEPA2和VideoMAE）上，通过双体碰撞视频探测这些属性，并测试其跨环境迁移能力。

Details

Motivation: 现有可解释性工作仅探测单物体物理量，而物理AI需要理解物体间的关系物理（如动量传递、摩擦），因此需要探究视频编码器潜在空间是否包含这些关系物理属性。

Result: 早期结果好坏参半：两种编码器均能可靠区分弹性与非弹性碰撞；V-JEPA2的预测器更少预测产生动能的碰撞；动量违反检测仅在一个编码器中出现；动能读数跨环境迁移在V-JEPA2中成立，VideoMAE中不成立；摩擦系数跨几何变化均不保留。

Insight: 创新点在于首次针对关系物理属性（而非单物体量）探测视频编码器，并引入跨环境/几何迁移测试，揭示了当前视频编码器物理理解的局限性。

Abstract: Video encoder models are increasingly used as world models for physical AI, where a policy plans by rolling out the latent, so what physics the latent holds bounds what the agent can plan over. Moreover, existing interpretability work probes quantities belonging to a single object; the quantities that make physics relational, such as momentum transfer, restitution, and friction, are defined between bodies and have not been examined. We probe relational physics attributes in two frozen self-supervised video encoders (V-JEPA2 and VideoMAE) under two-body settings and test if they transfer across environments. Our early findings are mixed. Both encoders separate elastic from inelastic collisions reliably. V-JEPA2’s own predictor is less likely to predict a collision that creates kinetic energy compared to one that loses it. Momentum-violation detection appears in only one of the two encoders, a kinetic-energy readout survives a change of environment for V-JEPA2 but not for VideoMAE, and neither model holds a friction coefficient that survives a change of geometry.

[41] OpenHome: From Perception to Insight in Smart-Home Camera Videos cs.CV | cs.AIPDF

Xianglong Wang, Neil Rodrigues, Pei Guo, Yiru Fang, Kevin Beussman

TL;DR: 论文提出 OpenHome，一个面向智能家居摄像头视频理解的纯视觉四选一多项选择基准，包含 1,118 段真实视频上的 2,254 个问题，并将 10 类任务划分为感知、推理、洞察三个能力层级，同时评测了 32 个闭源和开放权重视觉语言模型。

Details

Motivation: 智能家居摄像头视频通常无字幕/旁白，且视角、光照和场景多样，与现有 VLM 基准中的网络视频差异显著；现有基准难以充分评估模型在稀疏视觉信号和有限上下文下的理解能力。

Result: 最佳模型 Gemini 4 Argon 总体准确率为 81.2%；前沿闭源模型在各层级均优于开放权重模型，最佳闭源模型在感知、推理、洞察上分别领先最佳开放权重模型 16.3%、22.4% 和 37.4%。

Insight: 创新点在于构建贴近真实智能家居场景的纯视觉视频理解基准，并按感知、推理、洞察三级能力组织任务；客观上有助于揭示现有 VLM 在家庭监控视频高层洞察能力上的明显差距。

Abstract: Vision language models (VLMs) have been increasingly adopted in consumer smart-home camera systems to interpret recorded videos and provide insights. However, video clips captured from smart-home cameras are different from curated web videos dominating existing VLM benchmarks. Smart-home video clips often do not contain subtitles or narration and are captured from different viewing angles, under various lighting conditions, and in diverse scenarios. However, the capabilities of the model in this domain, under sparse visual signals and limited context, are not fully assessed by existing VLM benchmarks. To close this gap, we introduce OpenHome, a visual-only, four-option multiple-choice benchmark for evaluating smart-home video understanding. It contains 2,254 questions on 1,118 real-world video clips and organizes 10 tasks into three capability levels. Perception evaluates visible content, Reasoning evaluates causal, spatial, and temporal relationships, and Insight evaluates subject intent, supporting evidence and appropriate homeowner responses. Based on the dataset, we describe the task design, data pipeline and evaluation protocol, and report results for 32 closed-source and open-weight VLMs. The best model, Gemini 4 Argon, reaches 81.2% overall accuracy. Frontier closed-source models outperform open-weight models on every level. The best closed-source model leads the best open-weight model by 16.3% on Perception, 22.4% on Reasoning and 37.4% on Insight.

[42] MAGIC: Margin-gated Contrastive Debiasing with Evidence Restoration for VLM Test-time Robustness Scaling cs.CV | cs.LGPDF

Shunshun Gu, Enze Zhang, Ming Pei, Hang Zhou, Xiao Luo

TL;DR: 论文研究大型视觉语言模型在推理阶段的测试时鲁棒性扩展问题，目标是在不进行重训练的情况下缓解语言偏差。作者提出MAGIC方法，通过评估关键token的决策边际，门控式选择低置信样本激活文本与视觉扰动分支进行对比去偏，并对模糊样本恢复高信息量损坏视图以补充证据，同时利用校准数据集剪枝无效分支以降低推理成本。

Details

Motivation: 现有基于对比解码的测试时扩展方法虽能缓解语言偏差，但扰动过程可能移除关键证据，且多分支推理带来冗余计算成本，导致性能与效率均不理想。

Result: 摘要在多个基准数据集上进行了大量实验，验证MAGIC相较广泛基线方法有效，但未给出具体定量指标或明确SOTA水平。

Insight: 论文的创新点在于用决策边际门控选择性激活扰动分支、对模糊样本进行证据恢复，并通过校准数据主动剪枝无效分支；从客观看，其价值在于按样本置信度动态分配去偏计算，并兼顾证据保留与推理效率。

Abstract: This paper studies the problem of test-time robustness scaling for large vision-language models (LVLMs), which aims to mitigate language bias during inference. Existing approaches typically adopt test-time scaling techniques such as contrastive decoding to improve inference performance. Despite the progress, the performance of these approaches is far from satisfactory due to intentional evidence removal during perturbations and redundant inference cost. Towards this end, we propose a novel approach named Margin-gated Contrastive Debiasing with Evidence Restoration (MAGIC). The core of our MAGIC is to evaluate the decision margins of LVLMs to selectively activate textual and visual perturbation branches for efficient debiased inference. In particular, our MAGIC first measures the prediction margins of crucial tokens, and applies a gating function to identify low-confidence responses that are susceptible to language biases. For selected samples, we integrate the token logits from multiple textual and image perturbation branches with the original ones for debiased decision. More importantly, we selectively restore the most informative corrupted views with sharp prediction distributions for ambiguous samples after debiasing, enabling evidence recovery for discriminative decision-making. We further utilize a calibration dataset to actively identify and prune ineffective branches during contrastive debiasing for cost reduction. Extensive experiments on benchmark datasets validate the effectiveness of the proposed MAGIC in comparison with extensive baselines.

[43] NUViT: Vision Transformers for Fourier Space Data cs.CV | cs.LGPDF

Jeffrey Gu, Robert C. Heeter, Ellen D. Zhong

TL;DR: 论文提出 NUViT（Non-Uniform ViT），一种面向傅里叶空间数据的通用视觉 Transformer。它重新设计了图像 token 化、数据表示和位置编码，使模型适配频域数据的频率与相位结构，并在多类傅里叶域任务上验证有效性。

Details

Motivation: 标准 ViT 将图像划分为笛卡尔网格上的方形 patch，这种 token 化不适合傅里叶空间数据的频率和相位结构；论文旨在让 ViT 自然扩展到频域数据。

Result: 在傅里叶域图像分类、二维晶格识别、MRI 标注和冷冻电镜蛋白异质性分析等实验中，NUViT 相比标准架构能更一致地捕捉傅里叶数据结构；摘要未给出具体定量指标或 SOTA 声明。

Insight: 创新点在于针对傅里叶数据结构重新设计 token 化、数据表示和位置编码，并强调简单、通用的非均匀 ViT 架构；客观看，其价值在于将 ViT 的适用域从自然图像扩展到多种频域科学成像模态。

Abstract: Vision Transformers (ViTs) have demonstrated strong performance in many computer vision tasks but do not naturally extend beyond the natural image domain. One important example is Fourier-space data, which is used to represent a rich and diverse set of modalities, including medical imaging and microscopy. Standard ViT tokenization partitions an image into square patches on a Cartesian grid, which poorly fit the frequency and phase structure of Fourier-space data. We introduce Non-Uniform ViT, a simple, general-purpose vision transformer that redesigns image tokenization, data representation, and positional encoding to respect this structure. Experiments on Fourier-domain image classification, 2D crystal lattice identification, MRI annotation, and cryo-EM protein heterogeneity analysis show that NUViT consistently captures the structure of Fourier data better than standard architectures.

[44] Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders cs.CV | cs.AI | cs.CR | cs.LGPDF

Yiran Xiahou, Siliang Qin, Kai Chen, Shengzhi Zhang, Renyang Liu

TL;DR: 论文提出 ConceptACP，一种面向扩散模型的机器遗忘框架，用于高效、精确地擦除目标概念。该方法将语义概念映射到 U-Net 去噪器的交叉注意力块，定位最相关块进行目标优化，避免全扩散轨迹微调；并利用稀疏自编码器（SAE）构造特征级纠正信号以缓解概念纠缠。实例化于 SDXL-Turbo，在无需外部推理时模块的情况下实现高效细粒度概念移除。

Details

Motivation: 扩散模型可能生成有害或违反政策的内容，机器遗忘需要选择性移除目标概念并保留通用生成能力。现有方法受概念表征分布式、纠缠性影响，且常对完整扩散轨迹进行大规模微调，导致优化低效、编辑不精确。

Result: 在 SDXL-Turbo 的标准一步生成设置下，ConceptACP 的平均遗忘成功率比最佳基线提高 36.34 个百分点，同时保持图像质量和提示保真度，并能泛化到其他 Stable Diffusion 骨干模型。

Insight: 创新点在于将可解释性引导的概念定位与无推理微调结合：只优化最相关的交叉注意力块，避免全轨迹优化；并利用 SAE 的稀疏语义特征激活构造特征级纠正信号，实现解纠缠的精确概念擦除，且无需额外推理时模块。

Abstract: Diffusion-based image generation models produce high-quality images but may generate harmful or policy-violating content, motivating machine unlearning (MU) to selectively remove target concepts while preserving general capabilities. However, existing MU approaches often struggle with the distributed and entangled nature of concept representations, leading to inefficient optimization and imprecise edits when applied through large-scale fine-tuning over full diffusion trajectories. To bridge this gap, we propose Concept Acupuncturist (ConceptACP), a novel MU framework that integrates interpretability-guided analysis with inference-free fine-tuning for efficient and precise concept removal. By establishing mappings between semantic concepts and cross-attention blocks in the U-Net denoiser and localizing the most concept-relevant block for targeted optimization, ConceptACP avoids full diffusion trajectory optimization, thereby improving fine-tuning efficiency. To mitigate concept entanglement, we propose a feature-level correction mechanism based on Sparse Autoencoders (SAEs), where SAE-derived sparse, semantically meaningful feature activations are manipulated to construct targeted correction signals, which are then projected back to the output space of the corresponding block and used as supervision for precise concept removal. Consequently, ConceptACP eliminates the need for external inference-time modules while achieving efficient and fine-grained unlearning. Instantiated on SDXL-Turbo, ConceptACP improves the forgetting success rate by 36.34 percentage points in the standard one-step generation setting on average over the best-performing baseline, while preserving image quality and prompt fidelity, and generalizes effectively across other Stable Diffusion backbones. Our code is available at https://github.com/Eran-Xia/ConceptACP.

[45] Guided Zero-Shot Anomaly Explanation for Anonymized Crowd Video Monitoring: Context, Categorization, and Spatial Localization cs.CV | cs.AIPDF

Mulugeta Weldezgina Asres, Lei Jiao, Christian Walter Omlin

TL;DR: 论文提出XAVAD，一种面向匿名化人群视频监控的零样本视频异常检测可解释框架。它将全身视觉匿名化、异常类型分类、空间热图定位和场景上下文/推理解释统一起来，利用CLIP嵌入、LLM辅助提示与池化评分、改进Grad-ECLIP及VLM提示工程生成多层面解释。

Details

Motivation: 现有深度视频异常检测模型缺乏可解释性，而隐私保护场景下的异常可解释性研究不足；论文旨在在匿名化视频中同时实现隐私保护与透明可信的异常解释。

Result: 在多个公开CCTV和视频数据集上评估了准确率与计算开销，XAVAD相较SOTA基准取得显著提升，并给出隐私保护权衡分析；还进行了消融和多种配置/建模替代方案评估。

Insight: 创新点在于面向匿名化VAD的统一描述性XAI流程，将零样本匿名化、异常类型识别、空间定位与VLM上下文推理结合；技术上通过LLM辅助提示和pool-scoring做类型识别，并用提示引导的patch自动聚焦增强Grad-ECLIP定位效率与精度。

Abstract: Despite the promising development of deep learning for video anomaly detection (VAD), explainability (XAI) of these models remains a challenge. Explainable and privacy-protecting VAD builds transparency and trust that facilitates adoption of computer vision systems, including safety and security monitoring. However, anomaly explainability in privacy-preserving VAD systems is underexplored. In this study, we present the XAVAD approach, a unified descriptive anomaly XAI for an anonymized VAD, that integrates flexible zero-shot anonymization, anomaly type categorization, visual localization, and scene context description. We provide empirical and qualitative assessments of multifaceted explanations integrated with full-body visual anonymization for privacy protection. We adopt a multimodal CLIP embedding for videos, using improved LLM-assisted prompting and pool-scoring mechanisms for anomaly-type identification. We enhance Grad-ECLIP for spatial anomaly heatmap localization, leveraging computation and accuracy through our novel prompt-guided patching autofocus mechanism. We employ VLMs to generate context and reasoning descriptions of detected anomalies through curated prompt engineering. We have evaluated the accuracy and computational cost of XAVAD on several publicly available CCTV and video datasets. Our experiments demonstrate substantial gains of our XAVAD over state-of-the-art benchmark approaches and provide insights into privacy protection trade-offs in XAI for VAD. We further present ablation studies and assessments across diverse configurations and modeling alternatives to demonstrate the efficacy of our proposed methods. Code: https://github.com/muleina/XAVAD}{https://github.com/muleina/XAVAD .

[46] SyncPro: Synchronous Reasoning and Responding for Proactive Streaming Video Understanding cs.CV | cs.CL | cs.LGPDF

Xueyun Tian, Bingbing Xu, Jiaming Liu, Jinpeng Yu, Yang Shi

TL;DR: 论文提出SyncPro，面向主动式流式视频理解，将证据跟踪与面向用户的响应拆分为同步双流框架。Inner分支负责持续跟踪相关证据并触发内部更新，Response分支在证据充分时并行生成用户所需回答。作者构建189K双流样本，并采用监督微调加轨迹级强化学习训练模型。

Details

Motivation: 现有方法中，主动视频助手擅长决定何时响应，流式视频推理方法能生成中间文本组织观察，但二者如何协调仍研究不足。固定推理间隔可能产生无效更新或延迟有用更新，共享生成路径也会耦合“保留证据”和“生成回答”两个不同目标，且回答常需等待推理结束。

Result: 在三个主动式视频理解benchmark上的实验表明，SyncPro改善了响应时机，并对用户请求给出更准确的回答；摘要未给出具体数值或SOTA表述。

Insight: 创新点在于同步双流架构：Inner与Response分支共享因果历史但独立激活，使证据变化可触发内部更新，同时响应可与持续推理并发进行。训练上结合189K双流样本、监督微调和轨迹级强化学习，以协调主动推理与及时响应。

Abstract: Proactive streaming video understanding requires assistants to track unfolding events and respond when a user’s requested condition is met. To make these decisions, assistants must accumulate relevant evidence and reassess response conditions as new observations arrive. Existing work offers complementary capabilities for this process: proactive video assistants learn when to respond, while streaming video reasoning methods generate scheduled intermediate text to organize observations and support subsequent answers. Together, these capabilities provide a foundation for proactive reasoning, but how to coordinate ongoing reasoning with timely responses remains underexplored. In a direct adaptation, fixed reasoning intervals can trigger updates when nothing relevant has changed or postpone useful updates until the next scheduled step. Sharing one generation path also couples two distinct requirements: preserving evidence for future decisions and producing only the response requested by the user. Moreover, responses generated after reasoning must wait for it to finish, even when sufficient evidence is already available. To address these challenges, we introduce SyncPro, a synchronous dual-stream framework with specialized generation paths for evidence tracking and user-facing responses. Its Inner and Response branches share causal history and activate independently, allowing relevant evidence changes to trigger internal updates and responses to proceed concurrently with ongoing reasoning. We construct 189K dual-stream examples and train SyncPro through supervised fine-tuning followed by trajectory-level reinforcement learning. Experiments across three proactive benchmarks show improved response timing and more accurate answers to user requests.

[47] Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models cs.CVPDF

Mingyang Gao, Yuwei Wu, Shiyu Luo, Wei Wu, Xiaomeng Fan

TL;DR: 论文提出AURORA双曲视觉语言框架，将语义对齐与层级蕴含建模解耦：用角度对齐捕捉图文语义相似性，并将径向结构保留给层级表示；同时提出径向-角度序锥RAOC，根据父子节点相对径向差确定角度容限，并结合层级蕴含对比训练与范数正则化稳定训练。

Details

Motivation: 现有双曲视觉语言模型的预训练目标将语义对齐与蕴含建模纠缠在一起，使径向坐标同时编码语义匹配和层级结构，产生冲突的几何约束，影响表示学习。

Result: 在数百万图文对上训练后，模型在零样本分类、图文检索、层级推理和组合理解任务上均持续优于强欧氏和双曲视觉语言基线。

Insight: 创新点在于显式分离语义对齐与径向层级排序：角度对齐负责语义相似性，RAOC利用父子径向差自适应控制角度容限以建模偏序关系，并用范数正则化防止径向退化。

Abstract: Hyperbolic vision-language models are well suited to modeling the hierarchical structure of multimodal data, because hyperbolic volume grows exponentially with radius, enabling low-distortion representations of tree-like taxonomies from general to specific concepts. However, existing pretraining objectives for hyperbolic vision-language models entangle semantic alignment with entailment modeling, forcing radial coordinates to simultaneously encode semantic matching and hierarchical structure, leading to conflicting geometric constraints. In this paper, we introduce AURORA, a hyperbolic vision-language framework that decouples the objectives through angular alignment and a novel Radial-Angular Order Cone (RAOC) for entailment modeling. Angular alignment captures semantic similarity while preserving the radial structure for representing hierarchies. Unlike conventional entailment cones, RAOC determines angular allowance from relative parent-child radial gaps. It is incorporated into hierarchical entailment contrastive training to capture partial-order relations. We further introduce a norm regularization term that prevents undesirable radial degeneration for stable training. We train models on millions of image-text pairs and evaluate them across zero-shot classification, image-text retrieval, hierarchical reasoning, and compositional understanding. Our model consistently outperforms strong Euclidean and hyperbolic vision-language baselines, demonstrating the effectiveness of decoupling semantic alignment from hierarchical entailment modeling.

[48] Real-Time Localisation of Dorsal Anatomical Regions on Dairy Cows in Commercial Rotary Parlours from RGB-D cs.CVPDF

Vineet Prasad, Shiron Melvin, Sheikh Azid, Hai Wang

TL;DR: 论文提出一种面向商业转盘式挤奶厅的实时RGB-D感知前端，可在单次前向中定位目标奶牛、10个骨骼关键点和4个背部解剖区域（鬐甲、背、臀、尾根）。方法用颜色与深度双编码器晚期融合共享解码器，并设三个预测头；在自建538帧标注数据集上取得关键点PCK@10 0.905、区域IoU 0.70-0.91，T4 GPU上26.4 ms/帧，并验证了跨场景少样本迁移和热成像区域测温应用。

Details

Motivation: 现有奶牛监测常需手工放置感兴趣身体区域，自动系统又多只做整牛评分或稀疏关键点检测，且常在受控通道中，难以在拥挤的商业转盘式挤奶平台上给出可用的命名区域掩码。论文旨在为按区域测温、姿态等测量提供实时自动定位前端。

Result: 在自建转盘式挤奶厅RGB-D数据集（538帧标注、牛只不重叠测试集）上，关键点PCK@10达0.905，区域IoU为0.70-0.91；T4 GPU端到端26.4 ms/帧，快于11 fps相机。方法仅用10帧标注迁移到西澳大型牧场自建设备达PCK@10 0.84，并可将区域经深度映射到辐射热像仪实现每区域每牛可重复测温。

Insight: 创新点在于RGB-D双编码器晚期融合、共享解码器三头单次输出目标牛、关键点和稠密命名区域掩码；摘要还宣称稠密区域监督能显著提升关键点精度（去掉区域头损失0.15 PCK@10），并利用两个头的一致性无标签标记不可靠帧，适合真实商业场景部署。

Abstract: Automated monitoring of dairy cows increasingly measures one part of the body, such as the rump for temperature or the back for posture, yet the region itself is usually placed by hand. Existing systems either score the cow as a whole or detect sparse keypoints, often in controlled walkways, and neither yields the named region masks that such measurements need on a crowded commercial rotary platform. We present a perception front end that finds the target cow, ten bony landmarks and four named dorsal regions (withers, back, rump and tail-head) in a single forward pass over a whole RGB-D frame from a commercial rotary parlour. Two encoders, one for colour and one for depth, are fused late and share one decoder with three heads. On an anatomical region dataset that we built on public rotary-parlour RGB-D images (538 annotated frames, cow-disjoint test set), the network reaches PCK@10 0.905 for landmarks and region IoU 0.70 to 0.91, and runs end to end in 26.4 ms per frame on a T4 GPU, against an 11 fps camera. Dense region supervision is what makes the landmarks accurate: removing the region head costs 0.15 PCK@10. Agreement between the two heads flags unreliable frames without labels. On our own rig at the largest dairy farm in Western Australia, the model transfers with ten labelled frames (PCK@10 0.84), and its regions are carried through depth into a radiometric thermal camera, giving one repeatable temperature per region and cow.

[49] Depth-Dependent Safety Geometry in Vision-Language Models: Layer-Wise Localization and Bidirectional Refusal Control cs.CV | cs.CL | cs.CR | cs.LGPDF

Muhammad Zeeshan Karamat, Syed Talal Hassan, Christiana Chamon Garcia

TL;DR: 论文提出一个轻量级的推理时框架，在不重新训练、不修改参数的情况下，定位并操控冻结视觉语言模型（VLM）中与安全相关的表征。作者在Qwen3-VL-4B上做逐层激活差异分析，发现安全几何随网络深度呈非均匀分布；并通过因果干预实验，将表征可分性与因果可控性区分开。实验表明，早期视觉层是双向拒绝控制的关键位置，而深层表征虽然沿安全方向高度可分，却对引导不敏感。

Details

Motivation: VLM被广泛部署，但其安全行为背后的内部机制仍缺乏理解；论文希望在无需重训练和改参数的前提下，定位并操控冻结模型中的安全敏感表征，从而揭示安全机制并暴露潜在风险。

Result: 在Qwen3-VL-4B上，沿学习到的安全方向做激活引导，早期视觉层的不安全拒绝率可在6%~96%区间双向调节；后层则更受激活幅值缩放影响，并出现明显的安全-选择性权衡。InternVL2.5-4B虽在层位置与幅值上存在差异，但在定性上表现出相似的深度依赖激活几何。

Insight: 创新点在于用逐层激活差异和因果干预，刻画VLM视觉编码器中与深度相关的安全几何，并明确区分“表征可分性”与“因果可控性”；从客观角度看，论文揭示了一种白盒、表征级的拒绝绕过攻击面，说明可以通过推理时稳定化安全敏感表征来提升VLM安全性，该视角对安全对齐与可解释性研究都很有借鉴价值。

Abstract: Vision-Language Models (VLMs) are widely deployed, yet the internal mechanisms behind their safety behavior remain poorly understood. We present a lightweight inference-time framework for localizing and manipulating safety-sensitive representations in frozen VLMs, without retraining or modifying parameters. On Qwen3-VL-4B, layer-wise activation divergence analysis reveals non-uniform safety geometry across depth. Causal interventions show that early vision layers support strong bidirectional refusal control through activation steering along a learned safety direction, with unsafe rejection spanning 6%-96%, whereas later layers respond more to activation magnitude scaling and exhibit a substantial safety-selectivity trade-off. Deeper layers remain well separated along the safety direction yet are largely insensitive to steering, distinguishing representational separability from causal controllability. InternVL2.5-4B shows qualitatively similar depth-dependent activation geometry despite differences in layer location and magnitude. Our results expose a white-box, representation-level refusal-bypass attack surface in VLM vision encoders and motivate inference-time stabilization of safety-sensitive representations.

[50] Angular Supervision for Visual Object Grounding in Autoregressive Vision-Language Models cs.CVPDF

Parsa Esmaeilkhani, Longin Jan Latecki

TL;DR: 论文研究自回归视觉语言模型难以将生成文本定位到正确图像区域的问题，提出基于视觉token嵌入与词表反嵌入矩阵行方向余弦相似度的Angular Relevance（R_L）可视化度量，以及角向对象感知损失AOL。R_L无需训练即可生成更清晰忠实的定位热图并用于指代表达式分割；AOL通过辅助监督使视觉token与对应物体概念词向量方向对齐，微调后提升定位和RES且不损害通用VQA。学习到的定位还可迁移到未见类别的类别级分割。

Details

Motivation: 现有注意力图和Logit Lens等解释方法因文本到视觉注意力弱和sink token导致空间解释差，VLMs难以可靠地将生成文本grounding到图像区域；论文希望无需分割头、直接利用模型自身视觉token实现更忠实的视觉定位。

Result: R_L在无需训练下取得有竞争力的RES结果，优于先前诊断图和基于CLIP的无训练方法；结合AOL微调显著锐化物体定位热图并提升RES，同时不降低通用VQA性能，并能迁移到训练中未见类别的类别级分割。

Insight: 创新点在于用对token范数不变的余弦角向相关性替代注意力/Logit Lens做可视化，并将词表方向作为物体概念方向直接监督视觉token；客观看，其亮点是无需分割头、训练-free度量与辅助损失结合，实现模型内生视觉token的直接grounding和类别迁移。

Abstract: Autoregressive vision-language models (VLMs) struggle to ground generated text in the correct image regions, and existing explainability methods, such as attention maps and Logit Lens, often produce poor spatial explanations due to weak text-to-vision attention and sink tokens. We propose \textbf{Angular Relevance} ($R_L$), a simple visualization measure based on cosine similarity between visual token embeddings and unembedding-matrix rows. Because $R_L$ is invariant to token norm, it produces substantially sharper and more faithful heatmaps than attention maps or Logit Lens on out-of-the-box models. Without any training, $R_L$ yields competitive referring-expression segmentation (RES), outperforming prior diagnostic maps and CLIP-based training-free methods. To preserve localized object information during cross-modal mixing, we introduce \textbf{Angular Object-Aware Loss (AOL)}, an auxiliary loss that directly supervises visual token embeddings to align angularly with the vocabulary directions of their corresponding object concepts. Finetuning with AOL alongside the standard next-token prediction objective significantly sharpens object localization in heatmaps, showing that the VLM’s own visual tokens can be used directly for grounding and improving RES, without training any segmentation heads and without degrading general VQA performance. We further demonstrate that the learned grounding also transfers to category-level segmentation of object categories not seen during training.

[51] ACWM-RM: A Reference-Free Reward Model from Complementary Mismatch Preferences cs.CVPDF

Shibo Hong, Siyu Ren, FengJiao Chen, Zhongyuan Peng, Wei Shi

TL;DR: 论文面向动作条件世界模型（ACWM）的强化学习优化，指出现有奖励信号难以同时可靠评估视觉质量（VQ）和动作跟随保真度（AF）。作者构建了AVM-Eval基准评估逆动力学模型（IDM）在真实与生成视频上的AF可靠性，并提出无参考奖励模型ACWM-RM，通过互补的动作不匹配与视频不匹配偏好数据进行联合训练，从而在无需真实视频的情况下同时评估VQ和AF。

Details

Motivation: 现有奖励模型只能覆盖单一维度：基于指标的奖励依赖真实视频且不直接评估AF，基于IDM的奖励虽无参考但难以保证VQ，并且在含视觉伪影和物理不一致的生成视频上不可靠。论文旨在为ACWM的强化学习提供同时可靠排序VQ与AF的无参考奖励信号。

Result: 在AVM-Eval上的评估表明IDM在生成视频上的可靠性有限；下游强化学习实验显示ACWM-RM在VQ和AF两项标准上均优于奖励基线。

Insight: 创新点在于构建AVM-Eval与AVM-Pref，以动作不匹配和视频不匹配提供互补监督，实现无参考联合评估VQ与AF；同时先在真实视频上预训练动作条件预测器学习前向动力学，再迁移到生成视频的AF评估。客观看，其可借鉴之处是利��不匹配偏好构造互补奖励监督，并将动力学预训练与轻量评分头结合以提升生成视频奖励鲁棒性。

Abstract: Reinforcement learning has gained attention for improving action-conditioned world models (ACWMs), as it enables reward-driven optimization of visual quality (VQ) and action-following fidelity (AF) beyond flow-matching optimization. Realizing this potential requires reward signals that reliably rank videos by both VQ and AF. However, existing rewards capture only one dimension: metric-based rewards assess VQ but require ground-truth videos and do not directly assess AF, while inverse dynamics model (IDM) rewards assess AF without references but do not guarantee VQ. Moreover, IDMs, typically trained on real videos, may provide unreliable rewards for generated videos containing visual artifacts and physical inconsistencies. In this work, we introduce the Action and Video Mismatch Benchmark (AVM-Eval), comprising 67.2k pairs that evaluate how reliably IDMs assess AF on real and generated videos. We then propose ACWM-RM, a reward model that jointly assesses VQ and AF without ground-truth videos during reward computation. To train it, we first construct the Action and Video Mismatch Preference Dataset (AVM-Pref) with 506.3k pairs providing complementary supervision: action-mismatch pairs supervise AF, while video-mismatch pairs supervise VQ and expose the model to generated videos. We then pretrain an action-conditioned predictor on real videos to learn forward dynamics before jointly training it with a patch-weighted score head on AVM-Pref to transfer these dynamics to AF assessment on generated videos. Evaluation on AVM-Eval reveals the limited reliability of IDMs on generated videos, while downstream RL experiments show that ACWM-RM outperforms reward baselines in both criteria.

[52] TileShare: Training-Free Acceleration of Overlapping Tiled ViT Decoding cs.CV | cs.LGPDF

Xiangzhong Ye, Zhongshen Li, Shen You, Ziyang Meng, Liang Xu

TL;DR: 论文提出 TileShare，一种无需训练的加速方法，用于处理以重叠分块（overlapping tiling）方式运行的固定窗口 ViT 解码器。其核心思想是让重叠区域中的每个 token 对除注意力以外的所有操作只计算一次，而每个分块的注意力输出则用原始权重融合成一个共享状态；由于融合会损害那些通过注意力读取共享状态的位置的质量，该方法只在最初几层保留逐分块计算。整个流程不需要训练，并已在视频解码器、图像自编码器等多种模型上验证。

Details

Motivation: 高分辨率部署时，ViT 解码器通常被切成重叠分块，使重叠带中的每个 token 被多个完整解码器实例重复处理；例如在 2.4B 参数的 MiniMax-H3 视频解码器中，约有一半的逐 token 计算是冗余的。然而，直接去掉分块并不可行，因为注意力、global token 和坐标都与分块结构绑定，所以需要一种在保留分块语义的前提下消除冗余计算的方法。

Result: 无需训练，每分块保留六层时，该方法在两种 GPU 上比 batched+compiled tiling 快 1.38–1.51x，在 FP8 下最高快 1.96x；在 DAVIS 上与原始解码器在 PSNR/LPIPS/DISTS 上持平，在未见过的 UVG 上调参冻结后 PSNR/DISTS 持平且 LPIPS 更优。方法可迁移到另外两个解码器，在 MAGI-1 上 PSNR/DISTS 持平；在 2K–4K 的 ViTok-v2 图像自编码器上 PSNR 持平，LPIPS/DISTS 更优且快 1.5–1.8x；可选的约 2 GPU 小时自蒸馏还能实现全层共享且无损。

Insight: 创新点在于发现质量损失只出现在“注意力读取共享状态”的步骤，主要集中在前几层，并据此将逐分块的注意力与共享的非注意力计算混合，只保留少数层逐分块，从而做到免训练、即插即用。此外，“每分块保留多少层”只需在每个模型上测量一次即可复用，这进一步提升了方法的通用性与实用价值。

Abstract: Fixed-window Vision Transformer (ViT) decoders run at deployment resolution as overlapping tiles: every token in an overlap band is processed by several full decoder instances. In the 2.4B-parameter MiniMax-H3 video decoder, about half of all per-token computation is duplicated. Removing the tiles fails because attention, global tokens and coordinates are bound to them. TileShare keeps each released tile’s attention and computes every other operation once per token. The released computation changes at one kind of step only: an overlap token’s per-tile results are blended into one shared state with the released weights. Interventions show that this blend costs quality where attention reads the shared states, mainly in the first few layers, which TileShare therefore keeps per tile. Without training, keeping six layers per tile decodes 1.38-1.51x faster than batched and compiled tiling on two GPU types (up to 1.96x with FP8) and is equivalent to the released decoder in PSNR, LPIPS and DISTS on DAVIS videos. On unseen UVG videos with the setting frozen beforehand, it matches PSNR and DISTS and improves LPIPS. TileShare carries over to two further decoders and is again confirmed on unseen data. It is equivalent in PSNR and DISTS on MAGI-1. On the ViTok-v2 image autoencoder at 2K-4K, it matches overlapping tiling in PSNR, improves LPIPS and DISTS and decodes 1.5-1.8x faster. How many layers stay per tile is measured once per model (for decoders, without labels); we report it for 14 decoders and encoders. Optionally, two GPU-hours of self-distillation let MiniMax-H3 share every layer without a loss in PSNR, and a coordinate field trained while the network stays frozen brings fully shared CLIP-based open-vocabulary segmentation to parity with sliding windows on seven benchmarks.

[53] Easy-3Dfy: Object-Level Geometric Composition for Single-Image 3D Scene Construction cs.CV | cs.AIPDF

Ziang Zhang, Wenyou Yi, Zehan Wang, Jiachen Xu, Xintong Han

TL;DR: 论文提出Easy-3Dfy，一种面向单图像3D场景构建的组合式工作流，将物体生成与场景布局估计解耦。它利用专用3D物体生成器生成高质量物体，并借助3D基础模型的空间理解能力，通过基于RPF的对齐器建立物体局部网格与部分场景点图之间的几何对应，从而恢复物体布局并完成场景组合。

Details

Motivation: 现有单图像3D场景构建方法（如SAM-3Dfy）虽能端到端重建3D资产和场景布局，但在细粒度场景几何和资产质量上仍有不足；而专用3D物体生成器擅长细节几何，3D基础模型具备强泛化空间理解，因此需要一种能结合两者优势的工作流。

Result: 在Scene-Maker和3D-FUTURE200两个基准上，无需完整场景级监督，Easy-3Dfy在多个几何指标上持续优于SAM-3Dfy。

Insight: 创新点在于将物体生成与场景布局估计解耦，并用基于RPF的对齐器在物体局部网格与部分场景点图之间建立几何对应来恢复布局；这种显式几何组合使工作流能独立受益于3D物体生成和3D基础模型两方面的进展。

Abstract: Single-image 3D scene construction is a fundamental problem in 3D vision. Recent methods such as SAM-3Dfy enable end-to-end reconstruction of 3D assets and their scene layouts, but still struggle with fine-grained scene geometry and asset quality. Meanwhile, specialized 3D object generators provide detailed object geometry, while 3D foundation models offer strong and generalizable spatial understanding. We propose Easy-3Dfy, a compositional workflow that decouples object generation from scene layout estimation, allowing specialized models to fully exploit their respective strengths. An RPF-based aligner then bridges these capabilities by establishing geometric correspondence between object-local meshes and partial scene pointmaps, recovering object layout for scene composition. Without requiring complete scene-level supervision, the proposed workflow consistently outperforms SAM-3Dfy across multiple geometric metrics on Scene-Maker and 3D-FUTURE200. Our results demonstrate that explicit geometric composition can effectively combine high-quality object generation with strong spatial understanding, while enabling the workflow to benefit independently from advances in both 3D object generation and foundation models.

[54] Representation Learning via Composite Subspace Flow Matching cs.CV | cs.AIPDF

José Afonso, Mário Figueiredo

TL;DR: 论文提出复合子空间流匹配（CSFM），将表征学习建模为在谱、颜色和光照子空间上对确定性退化课程进行方差最小化反演。通过硬时间风格截断约束轨迹方差，促使容量受限编码器忽略瞬态风格伪影并编码持久内容，从而兼顾判别性表征与生成可逆性。

Details

Motivation: 现有自监督方法存在权衡：联合嵌入架构通过丢弃类内方差和空间重建信息获得语义特征，而生成模型保留空间细节却难以分离语义。论文旨在弥合判别式表征学习与生成式建模之间的鸿沟。

Result: 在CIFAR-10、CIFAR-100和STL-10上，CSFM在卷积网络和Vision Transformer架构上均取得有竞争力的判别迁移能力，同时保持生成合成能力；其平滑隐空间在线性探测和少样本分类上优于标准最优传输流，并支持连贯合成与轨迹插值。

Insight: 创新点在于用复合子空间上的确定性退化课程替代各向同性噪声腐蚀，并以硬时间风格截断控制流轨迹方差，使生成式流匹配服务于判别性表征学习，实现线性可分且生成可逆的表征。

Abstract: Distilling semantic meaning from raw image data remains a challenge in machine learning. Current self-supervised paradigms face a trade-off: joint-embedding architectures produce relevant features by aggressively discarding intra-class variance, irreversibly spatial and reconstruction. Conversely, generative models preserve spatial details but struggle to isolate semantics, as their optimization is dominated by pixel variations. To bridge this divide, we propose composite subspace flow matching (CSFM). Rather than corrupting data with unstructured isotropic noise, CSFM formulates representation learning as the variance-minimizing inversion of a deterministic degradation curriculum across spectral, color, and illumination subspaces. By bounding trajectory variance with hard temporal style truncation, a capacity-constrained encoder is driven to ignore transient style artifacts and encode persistent content. Empirical evaluations across CIFAR-10, CIFAR-100, and STL-10 show that CSFM yields competitive discriminative transferability while preserving generative synthesis across both convolutional and vision transformer architectures. By avoiding the collapse pathologies of non-generative methods, CSFM forms a smooth latent space that outperforms standard optimal transport flows on linear probing and few-shot classification, while enabling coherent synthesis and trajectory interpolation. These results confirm that steering the physical dynamics of generative flows offers a scalable paradigm for learning representations that are simultaneously linearly separable and generatively invertible.

[55] Beyond Pattern Matching in 3D MLLMs: Part-Level Functional Reasoning for Generalizable Recognition cs.CV | cs.AIPDF

Weihong Li, Hao Jiang, Yaohua Zha, Tao Dai, Shu-Tao Xia

TL;DR: 论文提出PFIR方法，通过部件级功能推理提升3D多模态大模型的泛化识别能力。它构建了507K包含功能思维链（几何→功能→身份）的QA对，并采用渐进课程和双目标GRPO强化学习。在严格分布外协议下，零样本准确率从60.5%提升至66.7%，且增益集中在几何歧义样本上。

Details

Motivation: 3D多模态大模型依赖模式匹配识别物体，当几何相似但功能不同的物体（如梳妆台vs衣柜）需要功能推理来区分时失败。作者提出几何混淆分数(GCS)揭示该问题，并发现功能语言常被用作已知身份的注释而非推理依据，假设反转信息流（先推理功能再识别）应能改善歧义样本。

Result: 在ModelNet40最模糊的20%样本上基线准确率33.7%，最不模糊的20%上84.0%。PFIR在严格双分布外协议（Objaverse→ModelNet40；XYZRGB→仅XYZ）下将零样本准确率从60.5%提升至66.7%，几何歧义样本上的增益是非歧义样本的2.6倍。两个RL目标的任务向量近乎正交（cos=0.056），可通过任务算术组合。

Insight: 创新点包括：提出几何混淆分数(GCS)量化模式匹配失败；识别“功能作为注释”模式并反转信息流；构建部件级功能推理数据集(507K QA对)和渐进课程；采用双目标GRPO强化学习并通过任务算术组合正交任务向量。客观分析：将功能推理引入3D识别，强调部件级和功能链式推理，利用强化学习组合不同目标，提升泛化性和歧义样本识别。

Abstract: 3D MLLMs recognize objects via pattern matching, which fails when geometrically similar objects require functional reasoning to disambiguate (e.g., dresser vs. wardrobe). Our per-sample Geometric Confusion Score (GCS) exposes this failure: baseline accuracy is 33.7% on ModelNet40’s most ambiguous 20% versus 84.0% on its least ambiguous 20%. We identify a function-as-annotation pattern, in which functional language decorates a known identity instead of supporting inference, and hypothesize that reversing this information flow should concentrate improvements on the most ambiguous samples. PFIR (Part-level Functional Inference for Recognition) reverses that flow. Built on PartNeXt part segmentation, its data pipeline produces 507K QA pairs with functional CoTs (geometry $\to$ function $\to$ identity), and its progressive curriculum culminates in dual-objective GRPO: strict functional reasoning and descriptive grounding for Objaverse’s diverse distribution. The two RL objectives yield nearly orthogonal task vectors ($\cos = 0.056$), enabling composition via Task Arithmetic. Under a strict dual OOD protocol (Objaverse $\to$ ModelNet40; XYZRGB $\to$ XYZ-only), PFIR raises zero-shot accuracy from 60.5% to 66.7%, with gains concentrated $2.6\times$ more on geometrically ambiguous samples—supporting part-level functional reasoning as an effective route to more generalizable 3D recognition. Code: https://github.com/this233/pfir-3d.

[56] LapaFM: A Laparoscopic Foundation Model via Multi-Stage Continual Learning cs.CVPDF

Xiaobo Zhu, Shiwei Wu, Yu An, Yuechen Tao, He Sun

TL;DR: 论文提出LapaFM，一个基于多阶段持续学习策略训练的腹腔镜手术基础模型，使用超过2万分钟手术视频学习多模态视觉表示，支持去烟、手术阶段识别、器械与息肉分割、病变识别等多任务，并在多中心回顾性与前瞻性队列中验证其跨任务、跨设备和跨术式泛化能力。

Details

Motivation: 腹腔镜术中视频分析需要模型能在多种手术辅助任务间泛化，但任务特定模型泛化有限，多任务训练又易出现灾难性遗忘和任务间干扰。

Result: LapaFM在13个回顾性和2个前瞻性队列上持续优于任务特定模型和现有基础模型，并可泛化到胃肠内镜任务；恢复超过90%烟雾遮挡帧，在淋巴结转移预测和前瞻性息肉分类上达到临床医生水平或更优。

Insight: 创新点在于用多阶段持续学习训练腹腔镜基础模型以缓解灾难性遗忘和任务干扰，并学习可支持多任务的多模态视觉表示；客观看，其跨设备、跨任务及跨术式泛化验证是主要亮点。

Abstract: Artificial intelligence-based analysis of intraoperative laparoscopic videos has the potential to improve surgical decision-making and precision. However, effective surgical assistance requires models that can generalize across diverse intraoperative tasks. Here we present LapaFM, a foundation model for laparoscopic surgery trained on more than 20,000 minutes of surgical videos using a multi-stage continual learning strategy that mitigates catastrophic forgetting and inter-task interference. LapaFM learns multimodal visual representations and supports multiple tasks, including smoke removal, surgical phase recognition, instrument and polyp segmentation, and lesion identification. The model was evaluated on 13 retrospective and two prospective cohorts collected from different imaging devices. LapaFM consistently outperformed task-specific models and existing foundation models across datasets, and also generalized to gastrointestinal endoscopy tasks, including polyp detection and classification. Notably, it recovered over 90% of smoke-obscured frames and achieved clinician-level or superior performance in lymph node metastasis prediction and prospective polyp classification.

[57] RVG-Bench: A Benchmark for Reasoning-Driven Audio-Visual Temporal Grounding cs.CVPDF

Yue Feng, Boshen Xu, Zihao Yue, Xiaokun Liu, Miao Yang

TL;DR: 论文提出 RVG-Bench，一个面向推理驱动的音视频时序定位基准。与仅依据视觉描述文本定位视频片段的传统 TVG 不同，该基准要求模型先理解查询背后的意图，再进行时序定位。基准包含 1,255 个视频和 1,890 个查询-区间对，覆盖八类推理任务，并评估了 22 个模型，最强模型仅达到 49.6 mIoU。

Details

Motivation: 现有 TVG 基准主要根据描述视觉内容的文本查询定位目标片段，难以反映真实场景中多样且需要意图推理的查询，例如寻找视觉证据、识别事件原因或回忆某一片段。论文旨在填补推理驱动音视频时序定位评测的空白。

Result: 论文构建了包含 1,255 个视频、1,890 个查询-区间对和八类推理类型的 RVG-Bench，并评测 22 个模型；最强模型 Qwen3.8-Omni-Flash 仅取得 49.6 mIoU，说明当前模型在该任务上仍有较大提升空间。

Insight: 创新点在于将音视频时序定位从描述性查询推进到意图推理查询，并系统构建八类推理任务及严格数据质量验证；同时通过 oracle-grounding 探针和测试时缩放等受控分析，诊断模型失败原因，为后续模型设计提供依据。

Abstract: Existing temporal video grounding (TVG) benchmarks primarily focus on localizing target video segments according to descriptive text queries of the visual content. However, real-world queries are more diverse and often require the model to first understand the user’s intent before localization, such as finding visual evidence, identifying the cause of an event, or recalling a remembered moment, yet such queries remain largely overlooked. To mitigate this gap, we introduce RVG-Bench, a benchmark for reasoning-driven audio-visual temporal grounding, where every query is constructed such that the target segment can only be identified through reasoning about the query’s underlying intent. We carefully construct the benchmark and rigorously verify its data quality to ensure models truly comprehend the audio-visual content. RVG-Bench comprises 1,255 videos and 1,890 query-interval pairs across eight reasoning types. We evaluate 22 models and find that the strongest, Qwen3.8-Omni-Flash, achieves only 49.6 mIoU. Through a series of controlled analyses, including oracle-grounding probes and test-time scaling experiments, we systematically examine where and why current models struggle, providing insights for future model development.

[58] ReLEAP: Upcycling Vision Datasets through Cross-Task Unification and Semi-Supervised Annotation cs.CV | cs.LGPDF

Julia Simon, Daniel Steininger, Andreas Trondl

TL;DR: ReLEAP 是一个可扩展的 Python 框架，旨在通过数据源抽象、跨任务标注复用和统一层级标签体系来整合异构图像数据集，并支持基于领域模型和基础模型的标注升级。作者在精准农业场景中整合了15个多物种、多标注类型的数据集，并实验研究了无监督、弱监督和半监督设置下自动生成高层标注的有效性。

Details

Motivation: 视觉模型训练依赖大量高质量标注数据，但现有数据集在标注格式、标签定义和学习任务上存在差异，导致数据复用与整合困难，尤其在细粒度类别和环境变化较大的领域中问题突出。

Result: 论文在精准农业中整合了15个多样数据集，并通过跨数据集和微调实验表明统一数据访问与标注升级能扩大可复用训练数据和标注池、提升数据透明度；摘要未给出具体定量指标或SOTA对比。

Insight: 创新点在于提出数据源抽象、跨任务标注系统化复用、标签到共享层级分类体系的映射，以及利用领域特定模型和基础模型在无监督、弱监督和半监督设置下进行标注升级，从而提升异构数据集的可用性和资源效率。

Abstract: Developing robust vision models requires large amounts of annotated data, especially for tasks involving fine-grained class distinctions under variable environmental conditions. Even in domains with numerous existing datasets, differences in annotation formats, label definitions and targeted learning tasks hinder data reuse and integration. To address this challenge, we introduce ReLEAP, a scalable Python framework for unifying heterogeneous image datasets through data-source abstraction, systematic reuse of annotations across learning tasks, and mapping of labels to a shared hierarchical taxonomy. We demonstrate its applicability in precision agriculture by integrating fifteen diverse datasets covering a broad range of plant species and annotation types. Beyond unification, ReLEAP enables systematic recycling of existing data and provides a robust foundation for learning-based annotation upcycling. Leveraging this foundation, we conduct extensive cross-dataset and fine-tuning experiments to investigate how domain-specific models trained on unified data and foundation models can be used to automatically generate higher-level annotations under unsupervised, weakly supervised and semi-supervised settings, and how dataset characteristics influence their effectiveness. Our results show that unified data access and annotation upcycling substantially expand the pool of reusable training data and annotations while improving data transparency, enabling more sustainable and resource-efficient use of existing datasets. We release the framework and trained models for academic use to support accessible and collaborative research, particularly in data-scarce and heterogeneous domains.

[59] Complementing DINO Features with Image Structure for Part Discovery cs.CV | cs.AI | cs.LGPDF

Samyak Rawlekar, Nikhil Chowdary Paleti, Amey Gupta, Narendra Ahuja

TL;DR: 论文提出Part-DINO，一个免训练框架，用于将前景对象分割成语义部件。它发现DINO特征因ViT固定patch网格导致部件边界不精确，于是结合低级图像分割的边界与DINO语义特征：先用边界划分区域，再在区域内池化DINO特征并聚类分组。在多个基准上优于免训练基线，并与弱监督/无监督方法竞争。

Details

Motivation: 现有基于DINO的免训练部件发现方法产生不精确的部件边界。作者通过实验（26K前景patch）归因于ViT固定patch网格：跨边界patch混合多个部件像素，产生高熵、低置信度的特征，模糊边界。与其重新训练DINO，不如直接引入边界检测器提供几何信息。

Result: 无需任何训练，Part-DINO在四个标准基准（CUB、CelebA、PartImageNet-OOD、PartImageNet-Seg）上优于所有免训练基线，并与弱监督和无监督方法保持竞争力，产生结构连贯的部件分配。

Insight: 创新点在于识别出DINO特征缺乏几何边界信息，并提出用低级图像分割边界来补充，在区域内池化特征再分组，从而避免重新训练大模型。客观来看，利用边界检测器提供结构信息是简单有效的思路，将语义特征与几何结构解耦处理，为免训练部件发现提供了新视角。

Abstract: Self-supervised Vision Transformers (ViTs) like DINO encode rich semantics, enabling training-free segmentation of objects from the background and discovery of their parts via feature clustering. This paper focuses on part discovery: partitioning a foreground object into semantic parts. Existing approaches produce imprecise part boundaries. We trace this to the rigid ViT patch grid used in training DINO, where patches straddling boundaries contain pixels from multiple parts. While DINO’s invariance-based training could absorb this pixel-level mixing into clean features, experiments with over 26K foreground patches show it does not: boundary-overlapping patches produce features with higher entropy and lower assignment confidence, blurring predicted part boundaries. Rather than make the massive effort of retraining DINO over geometrically coherent regions, an easier approach is to take boundaries directly from a boundary detector, which supplies the geometric information DINO’s features lack. Motivated by this, we introduce Part-DINO, a training-free framework that combines boundaries from low-level image segmentation with DINO’s semantic features. We use the boundaries to partition the image into regions, pool DINO features within each region, and group them to discover parts. Without any training, Part-DINO produces structurally coherent part assignments, outperforming training-free baselines across four standard benchmarks (CUB, CelebA, PartImageNet-OOD, PartImageNet-Seg) and remaining competitive with weakly-supervised and unsupervised methods.

[60] OlmoEarth v1.3: Embeddings cs.CVPDF

Gabriel Tseng, Favyen Bastani, Patrick Alan Johnson, Yawen Zhang, Piper Wolters

TL;DR: 论文提出 OlmoEarth v1.3 模型，用于将多模态、多时相遥感数据压缩为 64 或 128 维的紧凑嵌入向量，并宣称生成 SOTA 嵌入。该模型也可作为强编码器骨干，训练成本显著低于 OlmoEarth v1 和 v1.2。作者还利用该模型计算并发布了全球年度化 10 米分辨率嵌入。

Details

Motivation: 解决多模态、多时相遥感数据难以高效压缩为紧凑且可用嵌入的问题，同时降低遥感基础模型的训练成本。

Result: OlmoEarth v1.3 产生 SOTA 嵌入；作为编码器骨干与 OlmoEarth v1 和 v1.2 具有竞争力，训练所需 GPU 小时分别仅为二者的 18% 和 53%。

Insight: 论文宣称的创新点是将多模态、多时相遥感数据压缩为 64/128 维嵌入并达到 SOTA，同时保持较低训练成本；客观来看，高效训练骨干模型并公开全球年度化 10 米嵌入产物也具有较大实用价值。

Abstract: We make some OlmoEarth embeddings. To do this, we train a new model: OlmoEarth v1.3. OlmoEarth v1.3 is designed to condense multimodal, multitemporal remote sensing data into a single digestible 64 or 128-dimensional vector. OlmoEarth v1.3 produces state-of-the-art embeddings. In addition, OlmoEarth v1.3 is a strong encoder backbone – competitive with OlmoEarth v1 and v1.2 – while requiring 18% and 53% of the GPU hours to train, respectively. We use OlmoEarth v1.3 to compute global, annualized 10m embeddings, which we release under the OlmoEarth artifact license.

[61] GeoLEON-CLIP: Graph-Anchored Multimodal Contrastive Learning for Geographic Region Representation cs.CV | cs.LGPDF

Radoslaw Malek, Szymon Soltysiak, Aleksandra Kawala-Sterniuk, Piotr Szymanski

TL;DR: 论文提出GeoLEON-CLIP，一个以图为锚的多模态对比学习框架，对齐每个H3索引区域的三视图：OpenStreetMap图嵌入、卫星图像和文本描述。使用冻结的LEON图嵌入作为语义锚点，通过可训练残差投影头连接冻结的图、图像和文本编码器，并用对称三模态对比目标训练。实验表明图-图像检索性能最佳，链式跨模态召回显示通过图模态路由能显著提升检索性能，下游任务在Airbnb和北京住房上增益最大。

Details

Motivation: 现有地理空间对比方法通常只对齐图像-文本或图像-位置对，未充分利用结构化的地图数据。论文旨在利用OpenStreetMap图结构作为锚点来对齐多模态表示，解决地图数据未被充分利用的问题。

Result: 实验显示强大的图-图像和图-文本对齐，图-图像检索在混合分辨率池中达到最佳跨模态性能。链式跨模态召回R@1@1显示图像→图→文本和文本→图→图像分别比直接图像-文本检索高出4.8和4.4分。下游探测在Airbnb和北京住房上改进最大。

Insight: 创新点在于使用图嵌入作为语义锚点连接视觉和语言，提出三模态对比学习框架，以及链式跨模态召回评估方法。客观分析认为利用图结构作为锚点来增强多模态对齐是一个新颖的思路，且冻结预训练模型加轻量投影头的设计高效。

Abstract: Geographic regions are multimodal: satellite imagery captures visual morphology, text conveys human-interpretable semantics, and map structures describe urban context. Existing geospatial contrastive methods typically align image-text or image-location pairs, underusing structured map data. We introduce GeoLEON-CLIP, a graph-anchored contrastive framework that aligns three views of each H3-indexed region: an OpenStreetMap-derived graph embedding, a satellite image crop, and a textual description. Frozen pretrained LEON graph embeddings provide a semantic anchor between vision and language. Frozen graph, image, and text encoders are connected by trainable residual projection heads and trained with a symmetric tri-modal contrastive objective. Experiments show strong graph-image and graph-text alignment; graph-image retrieval achieves the best cross-modal performance in a mixed-resolution pool. To evaluate the anchoring hypothesis, we propose chained cross-modal recall $\mathrm{R}@A@B$, which routes retrieval through the graph modality and compares it with direct retrieval under a matched candidate budget. At $\mathrm{R}@1@1$, image$\rightarrow$graph$\rightarrow$text and text$\rightarrow$graph$\rightarrow$image outperform direct image-text retrieval by 4.8 and 4.4 points, respectively, despite using a single intermediate cell. Downstream probes show task-dependent gains, with the largest improvements on Airbnb and Beijing housing. These results indicate that OpenStreetMap graph structure can anchor multimodal representations combining maps, imagery, and language.

[62] Organizing Temporal Evidence in Hyperbolic Space for Video Moment Retrieval cs.CVPDF

Mengnan Liu, Sanping Zhou, Kun Xia, Jiaxuan Lin, Gang Hua

TL;DR: 论文针对视频时刻检索任务，提出双曲时间证据组织框架HTEO。该方法将时序表示映射到Poincaré球中，通过径向证据组织（REO）和正交角度细化（OAR）联合建模目标区域、边界过渡与上下文干扰等时序证据结构，并将组织后的表示投影回欧氏切空间，以轻量残差记忆更新注入标准Transformer解码器。论文还引入径向结构正则和角度相关性监督，以指导时序证据组织与查询条件语义对齐。

Details

Motivation: 现有视频时刻检索方法多在欧氏空间进行视频-文本对齐，其平坦几何难以显式联合刻画目标区域、边界过渡和上下文干扰等具有不同时序结构与相关模式的查询相关证据，因此论文从几何视角探索结构化的时序证据组织。

Result: 摘要称在多个benchmark上进行了广泛实验与分析，HTEO能够提升时序定位，并提供可解释的时序证据几何组织；但未给出具体数据集名称、定量指标数值或明确的SOTA声明。

Insight: 创新点在于将查询感知的时序记忆组织到双曲Poincaré球中，以径向位置编码证据结构差异、以正交旋转增强查询条件语义对齐，并通过轻量残差记忆更新将双曲几何线索注入标准Transformer解码器，同时保留原始跨模态记忆。客观看，其可借鉴之处是引入非欧几何结构来显式组织多状态时序证据，并用正则与监督信号约束几何表示学习。

Abstract: Video moment retrieval aims to localize a query-relevant temporal segment in an untrimmed video. Existing methods typically perform video-text alignment in Euclidean space, where representations are embedded in a flat geometry. However, accurate moment localization requires organizing query-relevant evidence across multiple grounding states, where target regions, boundary transitions, and contextual distractors exhibit distinct temporal structures and relevance patterns. Such Euclidean representations lack an explicit geometry to jointly capture these relationships, motivating us to explore structured temporal evidence organization from a geometric perspective. Specifically, we propose Hyperbolic Temporal Evidence Organization (HTEO), a geometric framework that organizes query-aware temporal memory in hyperbolic space. HTEO maps temporal representations into a Poincaré ball and organizes temporal evidence through Radial Evidence Organization (REO) and Orthogonal Angular Refinement (OAR). REO adjusts temporal tokens’ radial positions to encode the structural differences among temporal evidence, while OAR enhances query-conditioned semantic alignment through orthogonal rotation. The organized representation is then projected back to the Euclidean tangent space and injected into the decoder through a lightweight residual memory update, enabling hyperbolic geometric cues to be incorporated into standard Transformer decoders while preserving the original cross-modal memory. Furthermore, we introduce radial structure regularization and angular relevance supervision to explicitly guide temporal evidence organization and query-conditioned semantic alignment, respectively. Extensive experiments and analyses across multiple benchmarks demonstrate that HTEO improves temporal localization while providing an interpretable geometric organization of temporal evidence.

[63] DeformStruct: Deformable Structure Modeling for Point-Supervised Temporal Action Localization cs.CVPDF

Mengnan Liu, Sanping Zhou, Kun Xia, Yonghao Dong, Jie Wang

TL;DR: 论文针对点监督时序动作定位（PTAL）中每个动作实例仅有一个标注时间戳、结构信息不足的问题，提出 DeformStruct 实例级可变形结构建模框架。该方法通过结构锚点挖掘、可变形部件对齐和关系结构组织三个阶段，逐步构建动作实例内部多部件的结构表示，从而提升时序动作定位性能。

Details

Motivation: 现有 PTAL 方法主要依赖分类响应推断动作区域，难以充分利用稀疏点监督来建模动作实例内部多个动作相关部件的结构组织。论文旨在显式建模动作实例的结构，以弥补点监督下结构指导不足的问题。

Result: 论文在 THUMOS14、ActivityNet-v1.3、GTEA 和 BEOID 四个数据集上进行了实验，结果表明点监督时序定位性能取得一致提升，并验证了可变形结构建模的有效性；摘要未给出具体数值或明确的 SOTA 结论。

Insight: 论文的创新点在于提出实例级可变形结构建模框架，将动作实例分解为结构锚点与潜在部件，并通过变形感知匹配和相对时序关系建模组织这些部件。客观来看，其可借鉴之处在于用三阶段结构建模增强稀疏点监督下的实例内部结构表达，而不是仅依赖分类响应。

Abstract: Point-supervised Temporal Action Localization (PTAL) aims to localize action instances using only a single annotated timestamp for each instance. Such sparse supervision offers limited guidance for modeling the structural organization of an action instance. Existing PTAL methods primarily infer action regions from classification responses, leaving the structural organization of multiple action-related parts within each instance insufficiently modeled. To address this problem, we propose DeformStruct, an instance-level deformable structure modeling framework for PTAL. DeformStruct progressively constructs the structure of each action instance through three stages. First, Structural Anchor Mining discovers multiple anchors from annotated points and action-responsive regions, providing structural nodes grounded in the current instance. Second, Deformable Part Alignment associates latent structural parts with these anchors through deformation-aware matching, allowing their temporal supports to adapt to instance-dependent variations. Third, Relational Structural Organization explicitly models the relative temporal relations among the aligned parts, forming a relational representation that characterizes how different action-related parts are organized together. Extensive experiments on THUMOS14, ActivityNet-v1.3, GTEA, and BEOID demonstrate consistent improvements in point-supervised temporal localization and validate the effectiveness of deformable structural modeling.

[64] 4DMemory: Benchmarking Long-Horizon Spatiotemporal Memory with Harness-Augmented Agents cs.CV | cs.AI | cs.CL | cs.MMPDF

Yanhao Jia, Yi Zhu, Yiran Zhong, Weigao Sun, Feida Zhu

TL;DR: 论文提出面向长时程时空记忆与推理的 LongVideo 数据集和 4DMemoryBench 基准，包含约900小时视频与5000余道人工审核问题，并设计集成多种技能、22+专用工具模型和模型特定RAG的 4DMemory Harness，用于评估和增强智能体的长时程时空理解能力。

Details

Motivation: 现有基准多关注短中期上下文任务，基础模型难以在长时程中保持细粒度信息，因此需要评估并提升长时程时空推理与持久记忆能力。

Result: 评估13个领先模型发现，独立基础模型在长时程任务上表现不佳，而4DMemory Harness使所有模型提升超过50%；相比此前基准，相同模型在4DMemoryBench上性能下降超过10%。

Insight: 论文宣称的创新在于构建大规模长视频时空记忆基准，并提出可插拔的Harness增强框架；客观看，其价值在于将长时程记忆评估、工具调用与RAG增强结合，为时空智能体提供系统化测试与改进路径。

Abstract: Humans efficiently process multimodal streams spanning hours to years, building persistent, fine-grained spatiotemporal memories that support reasoning about and predicting long-horizon events. In contrast, existing benchmarks focus on short- and medium-context tasks, and most foundation models struggle to preserve fine-grained information over long horizons. To evaluate and improve long-horizon spatiotemporal reasoning, we introduce the LongVideo dataset and the 4DMemoryBench. LongVideo comprises about 900 hours of video and over 5,000 manually reviewed questions covering visual, textual, and spatiotemporal reasoning across diverse context lengths. We further develop the 4DMemory Harness, which integrates four complementary skills, 22+ specialized tool models, and a model-specific retrieval-augmented generation system. Evaluating 13 leading models, we find that standalone foundation models struggle with long-horizon tasks, while the 4DMemory Harness improves all of them by over 50%. Compared to previous benchmark, the same models exhibit a performance drop of more than 10% on 4DMemoryBench. We hope 4DMemory will facilitate the development of spatiotemporal agents capable of addressing complex, long-horizon tasks.

[65] Search-Based Testing of Modality Sensitivity in Vision Language Models cs.CV | cs.SEPDF

Oliver Weißl, Eduardo Breitembach, Andrea Stocco

TL;DR: 论文提出 MoST，一个黑盒测试框架，通过多目标搜索选择并组合图像扰动、文本扰动及其强度，比较仅图像、仅文本和联合扰动下视觉语言模型（VLM）的模态敏感性。作者在四个执行目标定位的 VLM 上、基于 ImageNet 和驾驶图像进行评估，发现不同模型对图像/文本扰动的敏感性差异明显，联合扰动常能以更小修改达到或超过单模态扰动效果。

Details

Motivation: 现有 VLM 鲁棒性评估多单独扰动图像或文本，或只测试预设的固定损坏等级，难以判断哪个模态更敏感，也可能漏掉跨模态小扰动组合引发的失败。论文希望用更系统的黑盒测试刻画模态敏感性。

Result: 在 ImageNet 和驾驶图像的物体定位任务上评估四个 VLM，发现模型敏感性不同：部分模型以文本扰动为主，部分对两种模态都敏感；多组配置中联合扰动以更小修改匹配或超过单模态扰动效果。人类研究中 60-76% 的扰动输入仍被认为足以完成任务，且人类定位比对应 VLM 更准确。

Insight: 创新点在于用多目标搜索联合选择图像/文本扰动及严重程度，并系统比较单模态与跨模态组合对预测的影响；其价值是表明单独评估模态会遗漏致错组合，模态敏感性比单一聚合失败率更能细粒度解释 VLM 鲁棒性。

Abstract: Vision-language models (VLMs) process images and text jointly, yet robustness evaluations often perturb these inputs separately or assess only predefined corruption levels. Such evaluations provide limited evidence of which modality is more susceptible to perturbations and whether smaller changes across both modalities can jointly expose failures. We present MoST, a black-box testing framework that characterizes modality sensitivity by comparing image-only, text-only, and joint perturbations. MoST uses multi-objective search to select and combine perturbations and adjust their severity, seeking prediction degradation while limiting changes to images and prompts. We evaluate MoST on four VLMs performing object localization on ImageNet and driving images. The models exhibit distinct sensitivities: textual perturbations dominate for some, whereas others are susceptible across both modalities. In several configurations, joint perturbations match or exceed the effectiveness of single-modality perturbations with smaller modifications to each input. In a human study, 60-76% of assessments across models judge the perturbed inputs sufficiently understandable to perform the task, and human localization is more accurate than that of the corresponding VLMs. These results show that evaluating modalities separately can overlook failure-inducing combinations and that modality sensitivity provides a more detailed account of VLM robustness than aggregate failure rates alone.

[66] Past as State, Present as Attention: Persistent-State Blockwise Flow Matching for Long-Horizon Co-Speech Motion Generation cs.CV | cs.GR | cs.MMPDF

Yi Liu, Xiangyue Zhang, Jianfang Li, Jia Ma, Yisheng He

TL;DR: 论文研究长时程共语动作生成，提出PASPA框架，将过去历史压缩为块间持久状态，并用块内双向自注意力建模当前片段，再结合块式流匹配实现长序列生成。方法通过多块监督、预填充-解码状态缓存和混合无分类器引导提升训练与推理效率及条件控制，在公开基准上取得SOTA的FGD表现并保持长序列动作风格。

Details

Motivation: 现有逐段生成长动作的方法要么仅依赖近期帧导致风格漂移，要么保留过长显式历史导致维护成本高且难以从有限数据学习。论文指出过去动作承载缓慢变化的风格应被紧凑总结，而当前片段包含快速变化的局部动态需要细粒度建模，这一不对称性是长时程共语动作生成的核心问题。

Result: 在公开基准实验中，PASPA取得了state-of-the-art的FGD性能，并在长序列生成中保持了动作风格一致性。

Insight: 创新点在于提出“过去为状态、现在为注意力”的原则：用块间持久状态紧凑总结历史风格，用块内双向自注意力建模当前局部动态，并实例化于块式流匹配框架。客观看，其可借鉴之处是将长历史压缩与当前片段细粒度建模解耦，并结合多块监督、状态缓存和混合引导，兼顾长时程一致性、训练有效性与推理效率。

Abstract: Co-speech motion generation remains challenging over long horizons due to the need for temporal coherence and consistent style. Existing methods typically generate long motions segment by segment, either conditioning on a short seed of recent frames, which gradually drifts, or retaining ever-longer explicit histories, which are costly to maintain and hard to learn from limited data. We trace these limitations to a key asymmetry between past and present: past motion carries slowly varying style that should be compactly summarized, whereas the current segment exhibits fast-changing local dynamics that require fine-grained modeling. This asymmetry motivates a simple Past-As-State, Present-as-Attention principle for long-horizon co-speech motion generation. Following this principle, we propose PASPA, which summarizes past history with an inter-block persistent state and models the current segment with intra-block bidirectional self-attention. We instantiate PASPA within a blockwise flow matching framework, with multi-block supervision for effective training over variable histories, prefill-decode state caching for efficient rollout, and hybrid classifier-free guidance for enhanced history and speech conditioning. Extensive public-benchmark experiments show that PASPA achieves state-of-the-art FGD performance and preserves motion style across long-sequence generation.

[67] UniWorld: A Unified World Model for Real-Time Visual World Simulation cs.CVPDF

Xin Zhang, Yabo Chen, Shuaiwei Wang, Zixuan Duan, Haibin Huang

TL;DR: 论文提出 UniWorld，一个面向实时视觉世界模拟的统一世界模型框架，将深度轨迹与参考外观集成到共享视频生成模型中。其核心是在同一时间线上维护视觉与几何历史，通过噪声对齐的重叠延续和滚动深度 latent 状态，只提交新生成的 latent 并保留已提交历史。该框架支持连续生成、长时程模拟以及多种深度来源，并在稳态 DiT 执行路径上实现实时生成吞吐。

Details

Motivation: 连续视觉世界模拟需要同时保持场景几何演化与外观的时间一致性，现有方法难以在共享生成模型中统一视觉历史与几何控制。论文旨在解决连续生成中的历史保持、几何控制耦合和实时效率问题。

Result: 论文在多样场景类别上评估了连续生成、配对历史干预和长时程行为；同一生成器支持估计、原生和按需模拟器深度，缓存与增量执行路径产生逐位相同输出，稳态 DiT 执行路径达到实时生成吞吐。摘要未提及具体定量指标或 SOTA 对比。

Insight: 主要创新在于将视觉历史与深度几何历史统一到共享视频生成模型的时间线上，并用噪声对齐重叠延续、滚动深度 latent 状态和仅提交新 latent 的机制保证历史精确保持与有界状态。客观看，其可借鉴点在于历史一致性维护、几何控制与外观分支的统一接口，以及缓存/增量路径的确定性一致性和实时生成效率。

Abstract: Continuous visual world simulation requires coupling evolving scene geometry with temporally persistent appearance. We present UniWorld, a unified framework that integrates depth trajectories and reference appearance within a shared video generation model. The central design maintains visual and geometric histories on a common timeline. Noise-aligned overlapping continuation places generated history at the prescribed sampling noise level and commits only newly generated latents. Rolling depth latent state preserves the corresponding geometric controls, incrementally reads newly available geometry, and keeps the conditioning fixed within each sampling window. Together, these mechanisms ensure exact preservation of latent history while bounding the active depth state by the window size. We evaluate continuous generation, paired history interventions, and long-horizon behavior across diverse scene categories. The same generator supports estimated, native, and on-demand simulator depth, while cached and incremental execution paths produce bitwise-identical outputs. Appearance changes and geometric control branches operate through the same interface without modifying committed history. The measured steady-state DiT execution path achieves real-time generation throughput, demonstrating the efficiency of UniWorld for continuous visual world simulation.

[68] An Error Budget for Shuffled Multimodal Windows in the 3rd WEAR Challenge: Stacking, Count Constraints and Seam Matching cs.CVPDF

Soheil Kooklan

TL;DR: 论文针对第三届WEAR数据挑战中打乱的多模态一秒窗口活动识别任务，构建并分析了一个离线转导式系统：用VideoMAEv2帧嵌入和单随机肢体加速度信号，通过图邻域特征平均与窗口分类器堆叠、带软计数约束的均值场解码器联合标注同一参与者的所有窗口，并评估接缝匹配等模块的误差预算。

Details

Motivation: 挑战要求在窗口打乱、仅有一个随机肢体加速度信号且每个活动通常只执行一次的条件下，为未见参与者的每个一秒窗口预测活动标签；论文旨在实证分析各系统组件的贡献和误差来源。

Result: 模拟中堆叠比第一阶段融合提升0.051 macro F1，计数约束提升0.011；系统模拟得分0.936、提交配置0.938，参与者范围0.80–0.97。接缝距离虽在83.9%情况下将真实同肢体后继排第一，但加入链接模型后macro F1变化仅-0.0001；私榜选中提交为0.9231，后续模拟选参版本为0.9247。

Insight: 创新点在于对挑战系统做误差预算式拆解，结合参与者图邻域特征平均、堆叠分类、软计数约束均值场解码和二次接缝距离排序；客观看，计数先验与转导式利用无标签特征有效，但接缝匹配的高排序准确率未转化为最终收益，且结果并非完全归纳式估计。

Abstract: The 3rd WEAR Dataset Challenge asks for an activity label for every one-second window of four unseen participants. Each window has 15 VideoMAEv2 frame embeddings, the accelerometer signal of one random limb, and the windows are shuffled. This report is an empirical analysis of one system built after the challenge deadline. Window classifiers are stacked with features averaged over per-participant graphs of video neighbours and scored successor candidates, and a mean-field style decoder with a soft count constraint per activity labels all windows of a participant together. The setting is offline and transductive, and the count constraint relies on each activity being performed once. In a participant-wise simulation with participant-level bootstrap intervals, stacking added 0.051 macro F1 over stage-1 fusion and the count constraint 0.011 (95% interval 0.006 to 0.017). A quadratic seam distance ranks the true same-limb successor first among about 720 candidates in 83.9% of cases, but adding it to the link model changed macro F1 by -0.0001 (-0.0006 to 0.0005). With the decoder settings and the mixing weight chosen inside the folds and the mislabelled spans left out of training, the system scores 0.936 in simulation (0.940 for participants who performed each activity once); the submitted configuration scores 0.938 (0.943). Per-participant scores range from 0.80 to 0.97. These results come from a non-nested stacking protocol that uses unlabelled features transductively, so they are not a fully inductive estimate. An oracle that averages the final unary scores over the true segments reaches 0.973, and 79% of the remaining errors involve the null class. On the private leaderboard, which no choice used, the selected Kaggle submission scored 0.9231 (public 0.9254, with bounds partly tuned there), and a later one with bounds chosen in simulation scored 0.9247 (public 0.9253).

[69] AlphaAnything: Extending Pretrained RGB Generators to RGBA cs.CVPDF

Qijie Wang, Zhixin Xu, Zhe Li, Haowei Zhu, Honghao Qiao

TL;DR: 论文提出 AlphaAnything，一个轻量级框架，将预训练的 RGB 生成器直接扩展到 RGBA（带透明通道）生成，无需 RGBA 重建预训练。方法在生成 Transformer 中插入 LoRA 模块，并在冻结的 RGB VAE 解码器上附加 alpha 分支，实现 RGB 与透明度的联合生成；同时提出端点感知 Alpha 损失（EA Loss）监督不透明度。

Details

Motivation: 现有 RGBA 生成方法需通过重建学习透明度专用表示，引入额外训练阶段，且可能改变从预训练模型继承的 RGB 解码函数，破坏原有生成能力。论文希望在保持预训练 RGB 生成质量不变的前提下，低成本地赋予模型透明通道生成能力。

Result: 在多个预训练 RGB 骨干上的 text-to-RGBA 与 image-to-RGBA 任务中取得有竞争力的生成质量，消融实验验证了共享潜空间训练设计和 EA Loss 的有效性。

Insight: 创新点在于直接在原始潜空间扩展而非重建预训练、采用单向 RGB 到 alpha 的特征共享以保证固定潜变量下 RGB 解码与预训练一致，以及从合成时前景-背景互补权重导出不透明度监督的 EA Loss，兼顾精确端点与连续半透明并聚焦局部 alpha 误差。

Abstract: Existing RGBA generation methods commonly learn a transparency-specific representation through reconstruction, introducing an additional training stage and potentially altering the RGB decoding function inherited from pretrained models. We present AlphaAnything, a lightweight framework that extends pretrained RGB generators to RGBA directly in their original latent space, without RGBA reconstruction pretraining. AlphaAnything inserts LoRA modules into the generative transformer and attaches an alpha branch to the frozen RGB VAE decoder. Unidirectional RGB-to-alpha feature sharing allows opacity supervision to shape the generative latent while guaranteeing that, for any fixed latent, RGB decoding remains identical to that of the pretrained decoder. We further introduce Endpoint-Aware Alpha Loss (EA Loss), which derives opacity supervision from the complementary foreground–background weights used in compositing. It supports exact opacity endpoints and continuous partial transparency while emphasizing localized alpha errors. Experiments on text-to-RGBA and image-to-RGBA tasks across multiple pretrained RGB backbones demonstrate competitive generation quality, and controlled ablations validate the shared-latent training design and EA Loss.

[70] Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images cs.CV | cs.AI | cs.CLPDF

Somraj Gautam, Gaurav Harit

TL;DR: 论文提出 Self-RefineVQA，一种无需训练、在推理阶段进行自我纠正的表格视觉问答框架。该方法让单个视觉语言模型迭代扮演生成器、批评者和精炼者，通过提示引导的再评估形成自反馈闭环，以纠正表格推理中的空间错位和逻辑幻觉等问题。实验表明其在单语和跨语言表格 VQA 基准上均能稳定提升准确率，尤其显著增强小模型性能。

Details

Motivation: 现有表格 VQA 方法多依赖架构修改或昂贵的有监督微调，需要大规模专家标注数据和大量计算资源，门槛较高；同时视觉语言模型在表格等结构化内容上的推理仍不稳定，常出现空间错位和逻辑幻觉。

Result: 在表格 VQA 基准上，方法在单语和跨语言理解中取得一致的准确率提升，对小模型提升尤其明显，使 2B-7B 参数的轻量模型能够媲美显著更大的模型；复杂度分析显示推理成本线性增加，但数据效率更高且累计成本更低。

Insight: 摘要宣称的创新点是无需额外标注数据和模型更新的推理时自纠正框架，让单个 VLM 同时作为生成器、批评者和精炼者形成闭环自反馈。客观来看，其创新主要在于将提示驱动的生成-评价-精炼迭代范式迁移到表格 VQA，并以免训练方式提升小模型可靠性，具有较强实用性和可扩展性，但更偏框架与提示工程创新而非模型架构创新。

Abstract: Recent advances in Vision-Language Models (VLMs) have significantly improved Visual Question Answering (VQA) performance, yet their reasoning over structured content such as tables remains inconsistent, often plagued by spatial misalignment and logical hallucinations. Existing approaches for improving table VQA typically rely on architectural modifications or expensive supervised fine-tuning (SFT), which impose high barriers to entry due to the need for large-scale, expert-annotated datasets and significant computational resources. In this work, we propose Self-RefineVQA, a training-free, inference-time self-correction framework that improves table VQA performance without additional labeled data or model updates. Inspired by human revision behavior, our method enables a single VLM to iteratively act as a generator, critic, and refiner, forming a closed self-feedback loop that corrects common reasoning errors through prompt-guided re-evaluation. Experiments on tabular VQA benchmarks demonstrate that Self-RefineVQA yields consistent accuracy gains in monolingual and cross-lingual understanding, with a particularly significant boost for small models, enabling lightweight models (e.g., 2B-7B parameters) to rival the performance of significantly larger counterparts. Furthermore, we provide a comparative complexity analysis demonstrating that while inference cost increases linearly, our framework offers superior data efficiency and a lower cumulative cost by eliminating the prohibitive annotation bottleneck of human labeling required for fine-tuning. Our results highlight the potential of prompt-based self-improvement as a scalable, accessible paradigm for reliable table reasoning in VLMs.

[71] Tempo-Zero: Recursive Self-Play in Executable Worlds for Video Reasoning cs.CVPDF

Jingmin Zhu, Yanyan Zou, Xiuyu Li, James Bailey, Dinh Phung

TL;DR: Tempo-Zero 提出一种递归自博弈框架：在可执行程序渲染出的视频世界中，让同一策略同时扮演提问者和解答者，生成带时间戳证据的问题与答案，并利用程序执行得到的真值选项和时间区间提供奖励。该框架通过求解表现驱动课程与环境规则演化，仅用简单程序训练、无需监督微调和外部视频数据，在十二个真实视频基准上平均超越基座模型和近期自博弈基线，时序定位任务提升尤其明显。

Details

Motivation: 视频推理需要理解事件随时间展开，但带准确时间标注的视频昂贵；现有视频自博弈方法受限于固定录制视频，无法改变事件动态，且依赖模型自身输出形成的噪声伪标签（如多数投票），可能强化共享错误。论文旨在构建无需人工标注、奖励更可靠且可演化环境的视频推理自改进方法。

Result: 摘要称 Tempo-Zero 在十二个真实世界视频基准上、不同模型规模下平均超越基座模型和近期自博弈基线，并在时间定位任务上取得特别强增益；但未给出具体数值，也未明确宣称达到 SOTA。

Insight: 创新点在于将可执行程序生成视频与执行验证奖励引入视频自博弈，用程序执行得到的真值选项和时间区间替代模型共识伪标签；单一策略同时做 Questioner 和 Solver，并以求解表现驱动课程和环境规则演化，形成递归自改进闭环。客观看，其核心价值是把程序化环境与执行接地奖励用于视频推理自训练，缓解时序标注昂贵和伪标签噪声问题。

Abstract: Video reasoning requires understanding how events unfold over time, yet videos with accurate temporal annotations are expensive to collect. Self-play offers an alternative by letting a model generate and solve its own tasks without manual annotation. However, existing video self-play methods train on fixed sets of recorded videos, so they cannot alter the underlying event dynamics and rely on noisy pseudo-labels derived from the model’s own outputs, such as majority voting, that risk reinforcing shared model errors. To overcome these limitations, we introduce Tempo-Zero, a self-improvement framework that closes a loop of executable environments, execution-verified self-play, and environment evolution, where executing a program renders a video with the ground-truth option and interval of every question. A single policy plays both Questioner and Solver, proposing questions and answering them with timestamped evidence lines, and is trained on execution-grounded rewards instead of model consensus. The Solver’s performance steers a curriculum over tasks and difficulty levels, and the policy selects rule changes that enrich the event dynamics of later rounds. Despite being trained solely on simple programs, without supervised fine-tuning or external video data which prior methods typically require, Tempo-Zero outperforms the base models and recent self-play baselines on average across twelve real-world video benchmarks at different model scales, with particularly strong gains on temporal grounding tasks. Project page: https://alchemist-jo.github.io/tempo-zero/

[72] PROVE: Probabilistic Visual Grounding via Patch-Level Evidence for Vision-Language Models cs.CV | cs.LGPDF

Mayank Nautiyal, Tianru Zhang, Li Ju, Ekta Vats, Prashant Singh

TL;DR: 论文提出 PROVE，一种面向冻结 CLIP 的 post-hoc 证据适配器，将 patch 特征映射为每个 patch 的 Beta 分布，把视觉定位建模为 patch 级成员关系，从而允许查询匹配零个、一个或多个 patch。推理时一次前向即可闭式得到后验均值定位图、空间空洞图和图像级缺失分数，用于定位可靠性判断与指称对象缺失检测。

Details

Motivation: 现有 CLIP 等视觉语言模型的视觉定位通常只输出单一确定性相关性图，无法说明定位是否可靠，也无法判断指称对象是否根本不存在。论文希望在不修改主干模型的情况下，为冻结视觉语言定位系统提供概率化验证能力。

Result: 在指称表达 benchmark 上，PROVE 的定位性能与 SOTA CLIP 定位方法具有竞争力；其不确定性能够跟踪定位误差，并支持弃权下的选择性预测，图像级分数还能检测指称对象完全缺失的情况。

Insight: 创新点在于用 patch 级 Beta 分布和正负证据建模成员关系，并以先验拉近目标让无信息先验/空洞度自然充当缺失信号，无需单独的存在性分类器。其客观价值是提供了一种简单可插入的、面向冻结 VLM 定位的概率化验证机制。

Abstract: Visual grounding with vision-language models such as CLIP typically produces a single deterministic relevance map for an image-query pair, without indicating whether the localisation is reliable or whether the referent is present at all. We introduce \textbf{PROVE} (\textbf{Pro}babilistic \textbf{V}isual Grounding via Patch-Level \textbf{E}vidence), a post-hoc evidential adapter that maps frozen CLIP patch features to per-patch Beta distributions without modifying the backbone. PROVE casts grounding as per-patch membership: each patch accumulates positive and negative evidence for whether it belongs to the referent, so a query may match zero, one, or many patches. We train PROVE with an evidential objective on soft patch-coverage targets, and define a prior-pull objective that keeps absent-referent examples near an uninformative prior, so that vacuity serves as an absence signal without a dedicated presence classifier. During inference, a single forward pass yields, in closed form, a posterior-mean grounding map, a spatial vacuity map, and an image-level absence score. We evaluate PROVE on referring-expression benchmarks: it is competitive in localisation with state-of-the-art CLIP grounding methods, its uncertainty tracks localisation error and supports selective prediction under abstention, and its image-level score detects when the referent is absent altogether. Our evidential patch-membership modelling offers a simple, drop-in mechanism for probabilistic verification in frozen vision-language grounding systems.

[73] Learning Fine-Grained Visual Classification with Text as Privileged Information via Multimodal Distillation cs.CVPDF

Aishwarya Venkataramanan, Christian Ickler, Joachim Denzler

TL;DR: 论文提出FG-LUPI框架，将文本属性描述作为训练阶段的特权信息，通过门控交叉注意力训练多模态教师，并在预测、patch表示和注意力模式三个层面蒸馏到仅图像的学生模型，从而在测试时仅用图像完成细粒度分类。

Details

Motivation: 细粒度视觉分类需区分高度相似类别并关注局部细微差异；文本属性可提供语义监督，但测试时通常不可得，直接部署受限，因此需要训练时利用文本、推理时仅用图像。

Result: 在多个FGVC基准上，FG-LUPI相对强ViT基线取得一致的分类准确率提升；在六个基准上ECE评估也显示预测校准更好，同时保持仅图像推理效率。

Insight: 创新点在于将属性描述视为特权信息，结合多模态教师门控交叉注意力与预测/patch/注意力多级蒸馏，使学生继承多模态监督形成的注意力结构；客观上有效缓解训练-测试模态不对称，并兼顾识别性能与置信可靠性。

Abstract: Fine-grained visual classification (FGVC) requires distinguishing between highly similar categories by focusing on subtle, localized visual differences. Recent multimodal methods have demonstrated that textual attribute descriptions can provide valuable semantic supervision by explicitly describing discriminative object characteristics. However, these descriptions are typically unavailable at test time, limiting their direct use in deployment. We propose FG-LUPI, a Learning Using Privileged Information (LUPI)-based framework that leverages attribute descriptions during training. We train a multimodal teacher that integrates image patches and textual attributes via gated cross-attention, allowing semantic attributes to condition visual representations. We distill this knowledge into an image-only student using multi-level distillation at the prediction, patch, and attention levels, aligning global predictions, patch representations, and attention patterns with the teacher. This encourages the student to inherit attention structure learned from multimodal supervision while maintaining image-only inference. Experiments on multiple FGVC benchmarks show consistent improvements in classification accuracy over strong ViT-based baselines. Furthermore, evaluation using Expected Calibration Error (ECE) shows that FG-LUPI also produces better-calibrated predictions across all six benchmarks. These results suggest that textual attribute supervision can benefit not only fine-grained recognition performance but also the reliability of model confidence, while preserving the efficiency and practicality of image-only inference.

[74] MDMR-Bench: A Multi-Dimensional Benchmark for Multi-Reference Image Generation cs.CVPDF

Bowen Zheng, Jintao Lin, Changheng Yi, Haoran Yang, Binxiao Huang

TL;DR: 论文提出MDMR-Bench，一个面向多参考图像生成的多维度基准，覆盖实体融合与属性迁移、单图多元素抽取、信息图操作和视觉推理密集型生成等能力子集；同时采用基于检查清单的评测协议，将生成质量分解为全局级和原子级查询，以对开源与专有模型进行更细粒度、可解释的诊断性评估。

Details

Motivation: 现有多参考图像生成基准评测维度有限，难以覆盖该任务的多样挑战，也无法系统分析模型在不同能力设置和失败模式下的表现。

Result: 摘要未给出具体定量指标；作者对开源和专有模型进行了基准测试，表明MDMR-Bench能在不同维度上提供细粒度性能洞察，数据集和代码已公开。

Insight: 创新点在于按代表性能力组织多子集评测，并用结构化检查清单分解生成质量，兼顾全局评分与原子级诊断，提升多参考图像生成评测的覆盖度和可解释性。

Abstract: Image generation models have rapidly advanced, with many models now supporting generation conditioned on multiple reference images and textual instructions. Such models enable a wide range of applications, including entity fusion and attribute transfer across images. However, existing benchmarks for multi-reference image generation rely on limited evaluation dimensions and fail to capture the diverse challenges of the task. To address this limitation, we propose MDMR-Bench, a Multi-Dimensional benchmark for Multi-Reference image generation. MDMR-Bench is organized around representative capability settings and consists of multiple evaluation subsets spanning diverse dimensions of multi-reference image generation, including (1) common entity fusion and attribute transfer, (2) multi-element extraction from a single image, (3) infographic manipulation, and (4) visual reasoning-intensive generation. This design enables systematic analysis of model capabilities and failure modes across different challenge dimensions. Furthermore, to achieve more reliable and interpretable evaluation, we introduce a checklist-based evaluation protocol that decomposes generation quality into fine-grained evaluation aspects. Instead of relying solely on holistic scoring, our framework uses structured checklists composed of both global-level and atomic-level queries, enabling more diagnostic assessment of model performance. By benchmarking both open-source and proprietary models, we demonstrate that MDMR-Bench provides fine-grained insights into model performance across different dimensions. The dataset and code are publicly available.

[75] PathJev: Decision-Native Vision-Language Modelling for Histopathology cs.CV | cs.LGPDF

Cristian Tommasino, Antonio M. Rinaldi

TL;DR: 论文提出PathJev-P，一种面向组织病理学决策的决策原生视觉语言模型：将问题与运行时候选集写入输入，通过小型决策头在一次前向中输出归一化概率分布。模型基于MedGemma-1.5-4B加LoRA适配器和决策头，在三个公开集合的4万个patch状态上训练，专家标签被转为带器官特异候选集和“none of these”选项的类型化问题。实验比较了平衡准确率与校准，并给出全切片定性演示。

Details

Motivation: 现有组织病理学视觉语言模型很少能对用户关心的候选返回校准概率，生成式模型的概率读出方式也不明确。论文希望构建决策原生模型，直接输出候选集上的归一化分布并支持弃权，以提升临床相关决策的准确性和校准性。

Result: 在3个种子且预先固定分析计划的测试中，PathJev-P的平衡准确率为0.541，高于同骨干生成模型0.492、零样本病理模型CONCH 0.345和通用医疗决策模型0.213；其优势主要来自训练中未出现的两个器官。按先前求和候选对数似然读出时，PathJev-P校准误差更低（ECE 0.204对0.279），但生成长度归一化读出后二者平均校准误差相近（0.201），且生成模型在未见器官上校准更好；病理基础模型上的监督线性探针在所有设置下校准更优。

Insight: 论文宣称的创新在于决策原生建模范式：将问题、器官特异候选集和弃权选项显式编码到输入，并用决策头一次前向输出归一化分布。客观看，其价值在于把候选集约束、弃权和概率校准纳入统一决策接口，减少生成式概率读出的歧义；但结果也表明校准优势依赖读出方式，且线性探针校准更强，提示决策头设计仍需改进。

Abstract: Vision-language models used for decisions in histopathology rarely return calibrated probabilities over the candidates a user cares about. Decision-native models write a question and a candidate set chosen at run time into the input and return a normalised distribution from a small decision head in one forward pass. We build PathJev-P, a decision-native model for histopathology: MedGemma-1.5-4B with LoRA adapters and a decision head, trained on 40,000 patch states from three public collections whose expert labels are turned into typed questions with organ-specific candidate sets and a “none of these” option. In a comparison over 3 seeds with an analysis plan fixed before testing, on test sets without documented overlap with the training data of the backbone, PathJev-P is more accurate than a generative model trained with the same backbone, data and selection rule, the zero-shot pathology model CONCH and a general medical decision model (balanced accuracy 0.541 against 0.492, 0.345 and 0.213); its advantage over the generative model comes from two organs absent from training. The calibration advantage depends on how the generative model’s probabilities are read out. With the summed candidate log-likelihood used in previous work, PathJev-P has the lower calibration error (ECE 0.204 against 0.279); with a length-normalised read-out of the same generative model, examined post hoc, the two have similar mean calibration error (0.201) and the generative model is better calibrated on the unseen organs, where PathJev-P remains over-confident. A supervised linear probe on a pathology foundation model is better calibrated in every setting. In a qualitative whole-slide demonstration, PathJev-P labels unsupervised tissue clusters with abstention and separates carcinoma from other tissue while running the model on a fraction of the tiles.

[76] PCFBench: How Far Can Large Vision-Language Models Go in Physics-aware Photonic Inverse Design? cs.CVPDF

Shengchao Chen, Ting Shu, Sufen Ren

TL;DR: 论文提出 PCFBench，这是首个系统评估大视觉语言模型在光子晶体光纤逆设计中感知、推理与决策能力的综合基准。该基准包含 26 个任务、6 类递增认知需求，并基于超过 22 万条 FDTD 仿真样本和 18 类光纤结构构建。研究同时评估单个 VLM 在孤立任务上的表现，以及多智能体系统在完整设计流程中的表现，发现当前模型存在明显的“感知—设计鸿沟”和级联误差传播问题。

Details

Motivation: 光子晶体光纤设计高度依赖专家经验和波导物理直觉，流程人工且密集。论文关注 VLM 能否从显微图像真正理解光子物理并支持逆设计，而不只是识别视觉模式，因此构建基准来检验其感知、推理和决策能力。

Result: 实验揭示当前 VLM 可中等程度识别光纤几何结构，但难以将视觉理解转化为物理感知的设计动作；多智能体级联时上游感知错误会传播并放大为下游设计失败。摘要未给出具体数值或 SOTA 结论，整体表明现有模型尚不能可靠完成物理感知的光子逆设计。

Insight: 创新点在于构建首个面向光子逆设计全流程的 VLM 多任务基准，覆盖几何感知、物理理解、多模态推理、逆设计决策和代码生成，并同时评估单模型与多智能体流程。客观来看，其价值在于揭示感知与设计之间的能力断层及误差传播，指出简单扩大模型或串联智能体不足，需要显式物理 grounding。

Abstract: Photonic crystal fibers (PCFs) underpin critical applications in telecommunications, sensing, and high-power laser delivery, yet their design remains a manual, expert-intensive process that couples geometric intuition with deep waveguide physics. Vision-language models (VLMs) offer a promising path toward automating PCF design, but can they truly reason about photonic physics from microscopy images, or do they merely recognize visual patterns? We introduce PCFBench, the first comprehensive benchmark for evaluating VLMs on the perception, reasoning, and decision steps of the photonic inverse-design loop. PCFBench spans 26 tasks organized into six categories of increasing cognitive demand (Geometry Perception, Physics Understanding, Text Generation, Multi-modal Reasoning, Inverse-Design Decision, and Code Generation), built from over 220K FDTD simulation samples across 18 structurally diverse fiber families. We evaluate both individual VLMs on isolated tasks and multi-agent systems (MAS) on the full sequential pipeline from perception to design. Our results reveal a striking perception-design gap: current models can identify fiber geometry with moderate success, yet consistently fail to translate that visual understanding into physics-aware design actions. Moreover, cascading agents through the pipeline exposes significant error propagation, where upstream perception mistakes compound into downstream design failures. These findings suggest that neither model scaling nor naive agent chaining suffices, and that closing the loop demands explicit physical grounding. PCFBench provides the community with a rigorous, multi-dimensional testbed to measure progress toward AI-assisted photonic engineering. The project is available at https://pcfbench.github.io/.

[77] Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF) cs.CV | cs.AI | cs.LGPDF

Khaled Waleed Dawoud, Muhammad Haris Khan

TL;DR: 论文提出 Signal-Aware Adaptive Fusion（SAAF）框架，用于高效零样本视频异常检测。该方法通过语义嵌入空间中的双信号自适应采样、阈值门控级联架构和信号感知加权融合，在无需训练数据的情况下兼顾异常覆盖与计算效率，并在多个基准上取得领先的零样本性能。

Details

Motivation: 基于视觉语言模型的视频异常检测语义推理能力强，但计算开销难以匹配真实视频流规模；论文旨在解决零样本场景下检测效果与部署效率之间的矛盾。

Result: 在四个基准上，SAAF 在免训练零样本方法中取得新 SOTA：XD-Violence 92.07%、MSAD 86.70%、ShanghaiTech 80.54% AUC-ROC，其中 XD-Violence 和 MSAD 还超过监督基线；并在 XD-Violence、UCF-Crime、MSAD 上达到 44.95、48.61、41.06 FPS，相较此前最佳零样本方法吞吐分别提升 2.43×、2.63×、2.22×。

Insight: 创新点在于在语义嵌入空间联合使用 delta 信号与 drift 信号并通过 OR 门控和自适应 EMA 阈值实现无需训练的综合异常覆盖；同时采用阈值门控级联架构，仅在必要时调用昂贵视频级时序分析，并按触发信号动态融合分数，从而在精度与效率间取得平衡。

Abstract: Deploying Vision-Language Models for video anomaly detection confronts a fundamental constraint. Their semantic reasoning demands computational budgets incompatible with the scale of real-world video streams. We present Signal-Aware Adaptive Fusion (SAAF), a framework that achieves efficient zero-shot anomaly detection through three key innovations. First, we introduce a dual-signal adaptive sampler operating in semantic embedding space: a delta signal captures sudden events via frame-to-frame cosine distance, while a drift signal detects static and gradual anomalies through deviation from rolling temporal context. Their OR-gated combination with adaptive EMA-based thresholding provides comprehensive anomaly coverage without training data. Second, we propose a threshold-gated cascaded architecture where lightweight frame-level scoring precedes expensive video-level temporal analysis, invoking it only when confidence warrants additional context. Third, we design a signal-aware weighted fusion mechanism that dynamically adapts score combination based on which signal triggered frame selection. Across four benchmarks, SAAF delivers competitive accuracy at substantially lower cost. Among training-free zero-shot methods, SAAF sets a new state of the art on XD-Violence (92.07%), MSAD (86.70%), and ShanghaiTech (80.54%) AUC-ROC, with XD-Violence and MSAD also surpassing supervised baselines. SAAF sustains 44.95, 48.61, and 41.06 FPS on XD-Violence, UCF-Crime, and MSAD, a 2.43$\times$, 2.63$\times$, and 2.22$\times$ throughput improvement over the prior best zero-shot method. Code: https://github.com/kdawoud91/SAAF

[78] Distortion-Aware Spatiotemporal Learning for Real-Time Wide-Angle Video Rectification cs.CVPDF

Lang Nie, Yihan Yang, Wenbo Nie, Hongguang Zhu, Yang Wei

TL;DR: 论文提出 FastVC，一个面向广角视频全身体校正的高效框架，核心是畸变感知时空学习。方法包括基于镜头物理的 DA-TPS 模块，通过周边密集控制点布局提升几何拟合；以及双层时空学习方案，在模型层用邻域时空注意力低开销融合局部与历史特征，在优化层用稀疏时空监督仅对锚帧做空间对齐以兼顾逐帧精度与时序稳定。论文还构建了首个广角全身体视频校正基准数据集。

Details

Motivation: 广角镜头虽扩大视野，但图像边界附近存在严重非线性畸变，会不自然拉伸人体。现有方法多聚焦面部、计算成本高且缺乏时序建模，导致全身校正不完整、难以实时部署并出现明显帧间抖动。

Result: 大量实验表明 FastVC 在广角全身体视频校正任务上取得 state-of-the-art 的校正保真度和视觉稳定性，并以 57.0 FPS 实现实时运行；同时论文贡献了首个该任务的基准数据集。

Insight: 创新点在于将畸变感知引入 TPS 控制点布局，以周边密集排布提升几何拟合且不增加计算成本；并通过模型级邻域时空注意力和优化级稀疏时空监督解耦逐帧精度与时序稳定性。客观看，其价值在于面向全身体视频而非仅面部，兼顾实时性、时序稳定与基准数据构建。

Abstract: While wide-angle lenses provide an expanded field of view (FoV), they exhibit severe nonlinear distortion near image boundaries, unnaturally stretching people in these regions. Existing methods mostly focus on facial regions, require high computational costs, and lack temporal modeling, resulting in incomplete full-body rectification, impractical real-time deployment, and noticeable inter-frame shakes. To tackle these issues, we propose \textbf{FastVC}, an efficient full-body video rectification framework driven by distortion-aware spatiotemporal learning. Grounded in lens physics, FastVC introduces a distortion-aware thin-plate spline (DA-TPS) module that nonlinearly remaps control points into a peripheral-dense layout, enabling more accurate geometric fitting without additional computational cost. We further develop a dual-level spatiotemporal learning scheme for causal and stable video rectification. At the model level, neighborhood spatiotemporal attention (NST) aggregates local context and selectively fuses historical features with low overhead. At the optimization level, sparse spatiotemporal supervision applies spatial alignment only to anchor frames, decoupling frame-wise accuracy from temporal stability. Besides, we contribute the first benchmark dataset for wide-angle full-body video correction. Extensive experiments show that FastVC achieves state-of-the-art rectification fidelity and visual stability at 57.0 FPS.

[79] Fast and Useful: Adapting Distilled Generators for Visual Learning cs.CVPDF

Patryk Bartkowiak, Dominik Michels, Sören Pirk, Wojciech Pałubicki

TL;DR: 论文研究如何让蒸馏（快速）文本到图像生成器生成更适合训练视觉分类器的数据。方法是对学生模型的首次预测拟合一个低秩更新，使其跳到其无引导基础模型产生的中间状态，随后禁用该更新，让未改动的学生模型自行完成剩余生成。基础模型只在训练目标构造时提供监督，推理时不存在，因此保留了快速生成。

Details

Motivation: 蒸馏文本到图像模型生成快，但用其生成的图像训练的分类器性能明显差于用慢速基础模型图像训练的分类器。论文想在保持快速生成的前提下，提升蒸馏生成器产出训练数据的质量。

Result: 在ImageNet-1k全规模、类名模板提示下，ResNet-50 top-1从8.4%提升到34.2%（FLUX.2-klein，2次denoiser评估），从12.7%提升到32.1%（SD-Turbo，3次评估）；在三个生成器家族上适配后图像训练的分类器均优于原始学生模型，固定适配器在其他类别、细粒度数据集及其他学习器架构和训练配方上也有提升。

Insight: 论文宣称的创新点是用基础模型作为监督源来“校正”蒸馏学生模型的单步预测：只需低秩更新一次第一预测，之后仍由原学生模型完成生成，推理时不需要基础模型。客观看，其关键洞察在于监督所用的状态和跳转步长很关键（用引导目标或更短跳转会降低分类精度），说明“用哪个中间状态做监督”比单纯加引导更重要，这为低成本复用基础模型知识、提升合成数据可用性提供了可借鉴思路。

Abstract: Distilled text-to-image models generate images quickly, but classifiers trained on those images can perform substantially worse than classifiers trained on images from their slower base models. We adapt released distilled generators to produce better training data while retaining fast generation. We fit a low-rank update to the student’s first prediction so that it reaches an intermediate state produced by its unguided base, then disable the update and let the unchanged student finish generation. The base supplies training targets and is absent at inference. Guided targets and shorter jumps give classifiers lower accuracy in our ablations, showing why the state used for supervision matters. Across three generator families, the adapted images train better classifiers than images from the released students. With class-name templates at full ImageNet-1k scale, ResNet-50 top-1 rises from 8.4% to 34.2% for FLUX.2-klein and from 12.7% to 32.1% for SD-Turbo, using two and three denoiser evaluations per image, respectively. Fixed adapters also improve results on additional classes, fine-grained datasets, and other learner architectures and training recipes. Template-based adaptation remains useful against richer-prompt alternatives, while the benefit of combining adaptation with LLM generation prompts depends on the generator. Adapting a single generation step makes fast generators substantially more useful for training visual models.

[80] VERA-Hand: A Verified Multidimensional Benchmark for 2D Hand Pose Estimation in Third-Person Dynamic Gesture Videos cs.CVPDF

Gibran Benitez-Garcia, Hiroki Takahashi

TL;DR: 论文提出 VERA-Hand，一个面向第三视角动态手势视频中 2D 手部姿态估计的人工验证多维基准。它基于 10,690 只手的帧级标注，从检测、定位、识别和时间稳定性四个维度评估估计器，并提出要求检测正确且定位准确的联合 Pose-F1 指标。论文评估了六类代表性估计器，发现不同维度下排名变化明显，且现有方法仍存在漏检、左右手错误、跨手重叠和时间不稳定等问题。

Details

Motivation: 现有手部姿态估计通常只用 PCK、MPJPE 等逐帧定位指标评价，且只关注匹配后的预测，忽略漏检/误检手、左右手识别错误和时间稳定性等实际应用关键问题。论文旨在建立更全面、可验证的评测基准，揭示仅靠定位指标或下游任务评估难以发现的失败模式。

Result: 论文在人工验证的 10,690 只手标注上评估了六种涵盖手部专用、全身、重建和基础模型范式的估计器，发现没有估计器在所有维度占优，且排名会随评估维度显著变化。结果还显示某近期基础模型在超过 85% 的帧中存在跨手重叠问题，分层分析表明鲁棒性随运动模糊类别和手部区域而变化。

Insight: 论文的创新点在于构建人工验证的多维手部姿态评测基准，将检测、定位、左右手识别和时间稳定性统一考量，并提出联合 Pose-F1 指标。客观来看，其价值在于推动评测从单一逐帧定位转向更贴近手势理解与人机交互需求的全链路、时序化评估，并通过清理案例验证纠正干预的有效性。

Abstract: Hand landmarks serve as input for gesture recognition, sign language understanding, and touchless human-computer interaction. Yet hand pose estimators are typically evaluated with frame-wise localization metrics such as PCK or MPJPE, which are computed over matched predictions and overlook missed or spurious hands, handedness errors, and temporal instability. To address these limitations, we present VERA-Hand, a benchmark that evaluates estimators using manually verified, frame-level 2D annotations for 10,690 hands across four complementary dimensions (detection, localization, identification, and temporal stability), as well as a joint Pose-F1 metric that requires both correct detection and accurate localization. Evaluating six estimators spanning hand-specific, whole-body, reconstruction-based, and foundation-model paradigms, we find that no estimator dominates: rankings reorder sharply across dimensions. VERA-Hand also exposes failures that localization-only and downstream evaluations may not reveal, including cross-hand overlap in over 85% of frames for a recent foundation model. A post-hoc cleanup case study demonstrates how the benchmark can validate corrective interventions, while stratified analyses show that robustness varies across motion-blur classes and hand regions. We release the verified annotations, protocol, and code at https://gibranbenitez.github.io/VERA_Hand/

[81] Reuse, Don’t Retrain: Efficient, Modality-Versatile Geospatial Foundation Models through Feature Distillation cs.CVPDF

Mario Hamon, Pierre Adorni, Minh-Tan Pham

TL;DR: 论文研究如何通过特征蒸馏高效复用地理空间基础模型（GeoFM），避免在不同骨干规模和传感器模态上重复预训练。方法一方面将冻结的 CROMA 和 TerraMind 教师模型通过 patch 级特征匹配蒸馏到更小的 Vision Transformer；另一方面提出 TEDI，用分离的 patch embedding 将无配对的多光谱与高分辨率 RGB 输入路由到共享 Transformer 主干。实验表明蒸馏模型在 PANGAEA 多任务上优于同规模基线，TEDI 还能整合互补专家并取得更强的单模型性能。

Details

Motivation: GeoFM 预训练成本高，而现有模型家族常在不同骨干尺度和遥感模态上重复预训练。论文希望用特征蒸馏复用已有表示，并以更低计算成本获得跨模态、多尺度的通用地理空间基础模型。

Result: 在 PANGAEA 九个任务上，蒸馏后的 TerraMind Tiny、Small、Base 分别比同规模已发布模型平均 IoU 高 2.76、3.02、1.87 个点，并匹配或超过更大一档模型；CROMA-Base 提升 2.05 个点，TerraMind-Base 仅需 43 A6000 GPU 小时，约为独立预训练成本的 0.5%。TEDI-Large 在 PANGAEA-9 单模型比较中达到最高平均 62.51 mIoU，整体超过两个教师模型并保留各自模态优势；TEDI-Base 以少 72% 参数达到 61.75 mIoU。

Insight: 创新点在于用 patch 级特征匹配从冻结教师高效蒸馏小模型，显著改善 GeoFM 的精度-计算前沿；同时 TEDI 通过分离 patch embedding 和共享 Transformer 主干实现无配对多专家融合，避免依赖共配准数据，将互补模态专家整合为单一通用骨干。

Abstract: Geospatial foundation models (GeoFMs) are costly to pretrain, yet model families often repeat this process across backbone scales and sensing modalities. We investigate feature distillation as a more efficient way to reuse existing representations. First, we distill frozen CROMA and TerraMind teachers into smaller Vision Transformers through patch-level feature matching. Across nine PANGAEA tasks, distilled TerraMind Tiny, Small, and Base outperform their scale-matched released counterparts by 2.76, 3.02, and 1.87 mean IoU points, respectively; each also matches or exceeds the next-larger released model. Distilled CROMA-Base gains 2.05 points. TerraMind-Base required only 43 A6000 GPU-hours, approximately 0.5% of the reported cost of independent pretraining. Second, we introduce TEDI, an unpaired multi-expert approach combining TerraMind for multispectral imagery and DINOv3 for high-resolution RGB. Separate patch embeddings route unpaired inputs into a shared Transformer trunk, removing the need for co-registered data. TEDI-Large achieves the highest single-model mean in our PANGAEA-9 comparison (62.51 mIoU), outperforming both teachers overall while retaining their modality-specific strengths. TEDI-Base reaches 61.75 mIoU with 72% fewer parameters. These results show that distillation improves the GeoFM accuracy-compute frontier while consolidating complementary experts into a single versatile backbone.

[82] DriveOSS: Dataset and Benchmark for 3D Anomaly Segmentation and Open-set Semantic Segmentation in Autonomous Driving cs.CVPDF

Zhiran Yan, Savankumar Bhanderi, Sourabh Lolge, Rui Song, Girdharbhai Paneliya

TL;DR: 论文提出DriveOSS，这是首个面向自动驾驶3D异常分割和开集语义分割的真实世界多模态数据集与基准。数据集包含12,661帧同步标注数据，采集自6个环视RGB相机、128线LiDAR和GPS/IMU，覆盖52个真实驾驶场景及晴、夜、阴、雨、雪等条件，并划分为ID训练子集和含未知类outlier标注的OOD验证/测试子集。

Details

Motivation: 现有3D语义分割方法多基于闭集假设并在标准驾驶条件下评估，而真实自动驾驶不可避免会遇到未见物体，闭集感知难以满足安全部署需求。

Result: 摘要未给出具体定量指标或SOTA结论，但大量实验表明未见物体仍是当前3D感知系统的主要挑战。

Insight: 创新点在于构建首个真实世界多模态3D异常分割与开集语义分割数据集和基准，提供多传感器同步标注、多天气场景、ID/OOD划分及评测协议，可系统评估模型对OOD物体的感知能力。

Abstract: Recent advances in 3D semantic segmentation have significantly improved scene understanding in autonomous driving. However, existing methods are typically developed under a closed-set assumption and evaluated under standard driving conditions, where all categories are known in advance. In real-world driving, autonomous vehicles inevitably encounter previously unseen objects, making closed-set perception insufficient for safe deployment. To address this challenge, we introduce DriveOSS, which, to the best of our knowledge, is the first real-world multimodal dataset and benchmark specifically designed for 3D anomaly segmentation and open-set semantic segmentation. It contains 12,661 synchronized and annotated frames captured using six surround-view RGB cameras, a 128-beam LiDAR, and a GPS/IMU unit. The dataset comprises 52 real-world driving scenes collected under clear, nighttime, cloudy, rainy, and snowy conditions and is organized into ID (in-distribution) and OOD (out-of-distribution) subsets. The ID scenes contain only known classes and are used for training, whereas the OOD scenes additionally contain unknown objects annotated as the outlier class and are used for validation and testing. Extensive experiments show that unseen objects remain a major challenge for current 3D perception systems. The dataset, benchmark protocols, and code are available at https://github.com/chrisyan/DriveOSS.

[83] EditJev: System One Routing for Image Editing Models cs.CV | cs.AIPDF

Zhile Guan, Xu Jiang, Yule Duan, Gongbo Zhang, Shuyu Wang

TL;DR: 论文研究基于指令的图像编辑模型路由问题，提出 EditJev：给定输入图像和编辑指令，动态从候选编辑模型池中选择最合适的模型。EditJev 采用“System One”式单次前向预测，在视觉-语言骨干上通过轻量偏好头直接输出各候选模型的偏好分数，并结合模型速度分数在编辑质量与推理延迟之间做权衡。

Details

Motivation: 不同图像编辑模型在同一图像和指令下表现差异明显，最佳模型随请求变化，且各模型推理延迟差异大，固定使用单一模型部署效率低。因此需要按样本动态选择编辑模型。

Result: 在 ImgEdit 和 GEdit-En 上，EditJev 将聚合质量分别从 4.540 提升到 4.592、从 8.194 提升到 8.255，同时估计端到端延迟分别降低 60.8% 和 31.7%。

Insight: 创新点在于用单次前向的轻量偏好头直接预测候选编辑模型的样本级偏好分数，避免自回归生成模型名和解析响应；并通过离线候选输出构建成对偏好、用 pairwise ranking 目标学习相对适用性，再结合模型级速度分数实现质量-延迟平衡的路由。

Abstract: Instruction-based image editing models exhibit pronounced sample-specific performance variation: different models can produce substantially different results for the same source image and editing instruction, and the best-performing model often varies across requests. These models also differ substantially in inference latency, making fixed-model deployment inefficient. We therefore study image editing model routing, which dynamically selects an editor from a candidate pool given an input image and editing instruction. We introduce EditJev, a System One routing model that directly predicts sample-level preference scores over candidate image editing models in a single forward pass. A lightweight preference head on a vision-language backbone produces a fixed-dimensional score vector without autoregressive model-name generation or response parsing. To train EditJev, we construct pairwise preferences from offline candidate outputs and optimize a pairwise ranking objective to learn relative model suitability. At inference time, EditJev combines the predicted preference scores with model-level speed scores to balance editing quality and generation latency. Experiments on ImgEdit and GEdit-En show that EditJev improves aggregate quality over the strongest fixed editor, from 4.540 to 4.592 and from 8.194 to 8.255, respectively, while reducing estimated end-to-end latency by 60.8% and 31.7%. These results demonstrate the effectiveness of direct, structured model routing for efficient image editing.

[84] SemGeo-Gen: Unsupervised Generation of Approximate Cross-Instance Semantic-Geometric Correspondences cs.CV | cs.AIPDF

Roy Amoyal, Shira Ifergane, Oren Freifeld

TL;DR: 论文提出 SemGeo-Gen，一种从弱对齐 3D 物体集合中无监督生成近似跨实例语义-几何对应的方法。该方法不追求精确点级对应，而是利用多视图 DINOv2 特征、3D 分段仿射配准和语义一致性剪枝生成可扩展的近似监督，并可投影为 3D-3D、3D-2D 和 2D-2D 对应。

Details

Motivation: 精确跨实例点级语义对应通常存在歧义且需要昂贵、难以规模化的人工标注，因此论文希望自动生成语义有意义、几何一致且足够多样的近似对应，用于训练现代对应模型。

Result: 生成的对应在 KeypointNet 稀疏人工标注上达到 93% PCK@0.10 和 97% PCK@0.15；用于合成预训练后，在 SPair-71k 上微调可提升近期 SOTA 语义对应模型最多 5 个 PCK@0.10 点。

Insight: 创新点在于仅需粗类别级旋转对齐即可无监督生成近似语义-几何监督，并通过将 3D 对应投影到渲染视图实现多种监督形式，为替代昂贵人工标注提供了可扩展方案。

Abstract: We introduce SemGeo-Gen, an unsupervised method for generating approximate cross-instance semantic-geometric supervision from weakly aligned 3D object collections. Our goal is not to recover exact point-level correspondences, which are often ambiguous across different instances and would require expensive, impractical manual supervision at scale. Instead, we automatically produce approximate correspondences that are semantically meaningful, geometrically consistent, and diverse enough to train modern correspondence models. Given only coarse category-level rotation alignment, SemGeo-Gen lifts multi-view DINOv2 features to 3D, aligns object instances using continuous piecewise-affine registration, and prunes candidate matches using semantic consistency. The resulting 3D correspondences can be projected into rendered views, yielding scalable 3D-3D, 3D-2D, and 2D-2D supervision without manual annotation. We validate the generated correspondences against sparse human annotations from KeypointNet, obtaining 93% PCK@0.10 and 97% PCK@0.15. More importantly, we show that using the generated correspondences for synthetic pretraining improves recent state-of-the-art semantic correspondence models on SPair-71k after fine-tuning on real data, with gains of up to 5 PCK@0.10 points. Together, these results indicate that approximate semantic-geometric supervision generated from 3D assets can improve real-image correspondence learning and serve as a scalable alternative to costly manual annotation. Project page: https://bgu-cs-vil.github.io/SemGeo-Gen/.

[85] The Answer Knows Where to Look: Zooming before MLLMs Answer under Visual-Token Budgets cs.CVPDF

Zhensheng Hu, Guanglong Xu, Guanqiang Hu

TL;DR: 论文研究在视觉token预算很小时，MLLM难以读取文档、图表等细粒度文字的问题。作者发现模型答案token在中层以后已能定位证据区域，但回答前的注意力定位弥散且层深因模型而异。为此提出一种专用look token，在单次prefill中学习像模型正确答案那样关注证据，并由其隐状态选择不缩放、裁剪、方形窗口、指针自适应窗口或foveated warp等查看方式，且无需框标注、外部定位器或先生成答案。

Details

Motivation: 高效部署通常限制每张图的视觉token数，导致细粒度文字不可读；放大虽能恢复证据，但必须在回答前选对区域。现有回答前注意力或grounding定位不够可靠，且常需逐模型层搜索或外部定位模块。

Result: 在Qwen3-VL三个规模、五个文本丰富benchmark上，每视图98个视觉token时比最强基线高4.8-9.1分，比attention-guided zooming高11.1-17.0分，且运行速度快于attention-guided和grounding-based zooming。

Insight: 核心创新是利用答案token中隐含的定位信号进行事后监督，将定位知识蒸馏到回答前可用的look token中，再由其隐状态选择缩放策略，并以每个视图的反事实结果监督；无需框标注、逐模型层搜索、外部定位器或回答前生成。客观看，其价值在于把回答阶段的定位能力前置，并自适应决定是否及如何放大，兼顾token预算与效率。

Abstract: Multimodal large language models (MLLMs) read images through visual tokens, and under the small per-image budgets that efficient deployment requires, the fine text of documents, charts and infographics becomes illegible. Zooming in recovers the evidence, but the region must be chosen before the model answers. We find that MLLMs know where the evidence is, but not in a form that can be read before they answer: the answer tokens localize it from the middle layers on, whereas the attention available before answering does so only in the top layers, at a depth that varies across models, and diffusely. Supervising the pre-answer attention to point degrades reading, and the benefit of zooming is governed by each image’s information gap. Building on these findings, we introduce ours, which lets an MLLM look where its answer would. A dedicated look token, processed in a single prefill and kept out of the answering pass, learns in hindsight to attend as the model’s own correct answers do, extracting this knowledge into a concentrated pointer before any answer exists. Its hidden state then selects how to look, from no zoom to crops, square windows, windows that adapt to the pointer and foveated warps, supervised by the counterfactual outcome of every view. ours needs no box annotations, per-model layer search, external localizers or generation before the answer. On Qwen3-VL at three scales and five text-rich benchmarks, it surpasses the strongest baseline by 4.8-9.1 points at 98 visual tokens per view and attention-guided zooming by 11.1-17.0 points, while running faster than attention-guided and grounding-based zooming.

Haoxiang Tang, Dong Zhou, Shen Tan, Minxuan Jiang, Xitong Li

TL;DR: 论文研究空中视觉语言导航（AVLN），要求无人机基于部分自我中心观测理解语言指令并到达户外目标。针对现有方法将RGB观测与全局历史地图作为通用视觉嵌入、跨模态空间对齐依赖稀疏导航监督的问题，提出基于Transformer的目标预测框架SP-Guide，包含空间先验跨模态编码器、指令增强解码器和目标收敛过滤器。在CityNav基准上验证其有效性。

Details

Motivation: 现有AVLN方法未显式对齐视觉观测与历史地图中的空间信息，跨模态空间对齐需从稀疏导航监督中学习，导致鲁棒性不足；论文希望引入物理 grounded 的空间先验作为归纳偏置，提升目标预测与导航可靠性。

Result: 在CityNav基准上，SP-Guide相比代表性基线提高了成功率，且在未见环境上的提升最大；摘要未给出具体数值和是否达到SOTA。

Insight: 创新点在于用空间先验跨模态编码器显式建模跨模态空间对齐，用指令增强解码器强化语言引导，并用目标收敛过滤器细化终端目标。客观看，其价值在于将物理空间先验作为结构化归纳偏置注入Transformer目标预测，而非仅依赖通用视觉嵌入和稀疏监督。

Abstract: Aerial vision-language navigation (AVLN) requires a UAV to reach a language-described target from partial egocentric observations while reasoning over large outdoor scenes. Existing approaches typically fuse view-centered RGB observations and globally anchored history maps as generic visual embeddings, leaving cross-modal spatial alignment to be learned from sparse navigation supervision. We present SP-Guide, a transformer- based goal-prediction framework that addresses this weakness of alignment through a Spatial Prior Cross-Modal Encoder, an Instruction Enhanced Decoder, and a Goal Convergence Filter for terminal target refinement. Experiments implemented on the CityNav benchmark show that SP-Guide improves success rate over the representative baselines, with the largest gains on unseen environments. These results indicate that physically grounded spatial priors provide an effective inductive bias for robust AVLN.

[87] Video-MemComp: Taylor-Guided Sensitivity-Aware Memory Management for Streaming Video Understanding cs.CVPDF

Yonghui Niu, Yuhao Ji, Chang Nie, Jiao Zhang, Yilong Li

TL;DR: 论文提出Video-MemComp，一种无需训练、敏感感知的上下文管理框架，用于内存受限的流式视频理解。该方法通过一阶泰勒展开将压缩误差分解为局部近似误差和逐层结构敏感性，并分别在pre-RoPE安全区进行token聚合、基于离线梯度先验和在线上下文熵动态分配KV缓存预算，从而在多个视频理解基准上以极低KV内存达到或超越全缓存和SOTA压缩方法的性能。

Details

Motivation: 视频数据快速增长需要高效的长视频流式理解系统，但多模态大模型面临严重的内存瓶颈；现有压缩方法往往忽略近似误差的爆炸性累积问题。

Result: 在MLVU、VideoMME、EgoSchema等基准上，Video-MemComp超越或达到与全缓存和SOTA压缩方法相当的性能；在Qwen2.5-VL-3B上将整体准确率从62.3%提升至64.1%，同时将KV缓存降至每层等效6000 tokens，节省超过90%的KV内存。

Insight: 摘要宣称的创新点包括：无需训练且敏感感知的上下文管理框架；利用一阶泰勒展开将压缩误差理论分解为局部近似误差和逐层结构敏感性；在pre-RoPE安全区进行token聚合并引入注意力保持的logit偏置以减轻RoPE旋转导致的几何扭曲；结合离线梯度先验和在线上下文熵动态分配KV缓存预算以优先高敏感性层。客观来看，论文将压缩误差分解与内存管理策略显式关联，并针对RoPE位置编码特性设计聚合位置，同时融合离线先验与在线熵进行动态预算分配，这些是值得借鉴的创新之处。

Abstract: The rapid growth of video data has created an urgent need for efficient video understanding systems that can handle long and continuous visual inputs, posing significant challenges for Multimodal Large Language Models (MLLMs) due to severe memory bottlenecks. Moreover, existing compression methods often overlook the explosive accumulation of approximation errors. To address this issue, we propose Video-MemComp, a training-free and sensitivity-aware context management framework for memory-constrained streaming video understanding. Our method theoretically decomposes compression error into orthogonal local approximation error and layer-wise structural sensitivity via a first-order Taylor expansion. To minimize local approximation error, we perform token aggregation in a pre-RoPE safe zone with an attention-conserving logit bias, mitigating geometric distortions caused by RoPE rotations. To manage layer-wise structural sensitivity, we dynamically allocate the KV cache budget based on offline gradient priors and online context entropy, prioritizing high-sensitivity layers. Video-MemComp outperforms or achieves performance comparable to full-cache and state-of-the-art compression methods on benchmarks including MLVU, VideoMME, and EgoSchema. Notably, it improves the overall accuracy of Qwen2.5-VL-3B from 62.3% to 64.1% while reducing the KV cache to an equivalent of 6,000 tokens per layer, saving over 90% of KV memory.

[88] Consommé: Conditioned Token Merging for Split Inference cs.CVPDF

Man Ngo, Jan S. Rellermeyer

TL;DR: 论文研究冻结骨干网络下的分裂推理 token 压缩问题，提出 Consommé 方法：利用 CLS token 既是分类全局摘要、又可指导 patch 保留的双重作用，将 CLS 压缩为紧凑 latent 传输，并用其条件化学习到的 patch gate，通过软分配将 patch 合并为恰好 k 个 token。方法可在单步达到任意 token 预算，避免二分匹配的逐层上限，并在 DeiT-S/T 上取得有竞争力的结果。

Details

Motivation: 分裂推理需在边缘设备与服务器间传输 ViT 中间 token，通信成本高；为每个端点部署微调骨干网络也很昂贵。论文希望在冻结骨干、仅传输小适配器的设定下实现高效 token 缩减。

Result: 在 DeiT-S/T 上，Consommé 在激进 token 预算下领先所有对比方法，并可在 BPM 无法工作的浅层分裂处运行；在温和预算下可匹配微调方法，同时部署成本仅为其一小部分。

Insight: 创新点在于发现并利用 CLS token 的双重角色：既作为接收端分类所需的全局摘要，又作为选择保留哪些 patch 的条件信号；通过信息瓶颈压缩 CLS 并以软分配单步合并到任意 k 个 token，绕开 BPM 的逐层预算限制，同时保持冻结骨干下的小适配器低部署成本。

Abstract: Split inference partitions a Vision Transformer between a resource-constrained edge device and a server. However, transmitting intermediate tokens across the communication channel is costly. Deploying fine-tuned backbones to every endpoint becomes expensive as well. We study token reduction for split inference under a frozen backbone, where only a small adapter is shipped. We observe that the CLS token plays a dual role: it acts as the global summary the receiver needs for classification, and it serves as a signal on which patches to keep. We propose Consommé, a method utilizing both characteristics. There, an information bottleneck compresses the CLS token into a compact latent which is transmitted in place of the full CLS token and conditions a learned patch gate merging patches into exactly $k$ tokens via soft assignment. It reaches any budget in a single step, thus escaping the per-layer cap of bipartite matching (BPM). On DeiT-S/T, it leads all methods at aggressive token budgets and remains operable at shallow splits where BPM cannot operate, while matching fine-tuned methods at gentle budgets at a fraction of their deployment cost.

[89] CompMVR: Compression-Aware Multi-View Restoration Using Diffusion Models for Geometrically Consistent 3D Reconstruction cs.CVPDF

Dong-hwi Kim, Chaewon Moon, Hojun Song, Dongbeom Kim, Junyeong Jang

TL;DR: 论文针对有损压缩导致多视图图像出现跨视图几何不一致的问题，提出CompMVR框架，利用扩散模型和跨视图对应关系联合恢复压缩视图，并构建压缩数据集进行系统评估。实验表明该方法在恢复质量和下游3D任务（新视角合成、相机姿态估计、视图匹配）上均有提升，将压缩多视图恢复确立为一个独立问题。

Details

Motivation: 真实3D重建流程常依赖有损压缩的多视图图像，但压缩伪影对多视图几何的影响被忽视。论文指出压缩引发的跨视图几何不一致会破坏特征匹配、稠密对应和相机参数估计，进而影响下游3D重建任务。

Result: 在不同数据集、编解码器和压缩级别上的实验表明，CompMVR在恢复质量以及新视角合成、相机姿态估计、视图匹配等下游3D任务上均取得增益，验证了方法的有效性。

Insight: 创新点在于首次将压缩引起的跨视图几何不一致识别为关键失败模式，并提出压缩感知的多视图扩散恢复框架，利用学习到的压缩先验和跨视图对应关系同时恢复视觉细节与几何可靠性，区别于传统逐图像独立优化的2D感知恢复方法。客观来看，将压缩伪影与多视图几何一致性结合，并构建系统评估数据集，是该工作的核心贡献。

Abstract: Real-world 3D reconstruction pipelines often rely on multi-view images degraded by lossy compression. While compression artifacts have been extensively studied in single-image or video restoration, their impact on multi-view geometry remains largely overlooked. In this work, we identify compression-induced cross-view geometric inconsistency as a critical failure mode, where view-dependent artifacts disrupt feature matching, dense correspondence, camera parameter estimation, and downstream 3D reconstruction tasks such as novel view synthesis. To address this problem, we propose CompMVR, a compression-aware multi-view diffusion restoration framework that jointly refines compressed views while preserving cross-view consistency, and construct compressed datasets for systematic evaluation. Unlike conventional restoration methods that optimize each image independently for 2D perceptual quality, CompMVR leverages learned compression priors and cross-view correspondence to recover visual details while improving geometric reliability across views. Experiments across diverse datasets, codecs, and compression levels demonstrate gains in restoration quality and downstream 3D tasks, including novel-view synthesis, camera pose estimation, and view matching. These results establish compressed multi-view restoration as a distinct problem and highlight its importance for 3D reconstruction under lossy compression. Code and data for this paper are available at https://mchaewon.github.io/CompMVR-project-page/.

[90] SPOOK: Sparse Pixel Optimization for Off-Manifold Knowledge in Vision Encoders cs.CV | cs.CL | cs.HCPDF

Ankit Gupta, Akshat Pandya, Christoph Adami, Emily Dolson

TL;DR: 论文提出SPOOK，一种黑盒探测方法：在空白画布上通过简单的像素级爬山进行稀疏像素编辑，并在ImageNet和Flickr30k上测试这些视觉上无语义的编辑图像能否在多模态对比编码器和自监督视觉编码器中检索到指定目标。结果表明，稀疏空白画布优化可使输入进入目标语义盆地，揭示现代视觉编码器共享的离流形失效模式，并可作为表征几何的简单探针。

Details

Motivation: 关注视觉编码器在远离自然图像流形时，嵌入相似性与人类可见语义之间的关系可能变得不可靠；论文希望以黑盒方式探测这一离流形区域并检验编码器是否会被稀疏像素编辑误导。

Result: 在OpenCLIP上，面向类别提示优化的输入取得较强的top-1/top-5目标检索性能；在DINOv3上，面向类别原型优化的输入获得高目标对齐度和接近顶部的原型排名，实验覆盖ImageNet和Flickr30k。

Insight: 创新点在于用空白画布上的稀疏像素优化作为简单黑盒探针，证明视觉上无语义的输入也能进入目标语义盆地；客观来看，这揭示了多模态对比与自监督视觉编码器共享的离流形脆弱性，并提供了一种分析表示几何的低成本方法。

Abstract: Modern vision encoders are widely used as semantic representations, but the relationship between embedding similarity and human-visible semantics can become unclear far from the natural-image manifold. We probe this regime in a black-box setting by applying sparse pixel edits to blank canvases with a simple pixel-level hill-climbing procedure. Across ImageNet and Flickr30k, we evaluate whether these edited blank canvases can retrieve chosen targets in multimodal contrastive encoders and self-supervised visual encoders. On OpenCLIP, inputs optimized toward class prompts achieve strong top-1 and top-5 targeted retrieval performance; on DINOv3, inputs optimized toward class prototypes achieve high target alignment and near-top prototype ranks. These results show that sparse edits on otherwise blank, visually non-semantic inputs can enter target semantic basins in both language-aligned and self-supervised visual representation spaces. Our findings identify a shared off-manifold failure mode of modern vision encoders and suggest sparse blank-canvas optimization as a simple probe of representation geometry.

[91] Multimodal Generative AI Assists Comprehensive Echocardiographic Interpretation cs.CVPDF

Yi Qin, Marawan Elbatel, Shanshan Song, Taoran Huang, Jiarong Guo

TL;DR: 论文提出 EchoChat，一个面向超声心动图综合分析的多模态生成式视觉-语言模型，旨在辅助临床医生解读。模型整合医学知识与思维链推理，并将结论显式关联到视觉证据，在六个国际医学中心的多样队列上实现先进性能，覆盖 33 种心脏状况与发现，并通过读者研究验证其临床辅助价值。

Details

Motivation: 超声心动图是心血管诊断的核心手段，但经验丰富的解读人员严重短缺；现有 AI 多为不透明的黑箱或局限于狭窄任务，难以模拟临床医生基于指南的整体推理过程。

Result: EchoChat 在六个国际医学中心的外部评估中达到 SOTA，支持 33 种心脏状况，其中 15 种新增状况平均 F1 为 73.7%；相较现有最佳基础模型，心脏状况识别平均召回率提升 13.54%，量化任务平均 R2 提升 0.275；读者研究中辅助生成的报告诊断准确性和完整性更优，并将常规报告 F1 从 72.78% 提升至 82.75%。

Insight: 创新点在于将多模态视觉-语言生成、医学知识注入和思维链推理结合，显式用视觉证据支撑诊断结论，并覆盖更广的心脏状况与量化任务；客观上其价值还体现在跨中心外部验证和临床读者研究，体现了从单一任务黑箱模型向可解释、临床工作流对齐的综合辅助系统推进。

Abstract: Echocardiography is the cornerstone of cardiovascular diagnostics, yet its global utility is constrained by a critical shortage of experienced interpreters. Current artificial intelligence (AI) solutions remain limited, typically operating as opaque “black boxes” or focusing on narrow tasks that fail to capture the holistic, guideline-driven reasoning of a clinician. Here we introduce EchoChat, a generative multimodal vision-language model that performs comprehensive echocardiographic analysis to support clinician interpretation. By emulating the cognitive workflow of a cardiologist, EchoChat integrates vast medical knowledge with a chain-of-thought reasoning mechanism to explicitly ground its conclusions in visual evidence. Trained on echocardiography-instruction pairs from 46,358 examinations, our model establishes a new state-of-the-art across diverse cohorts from six international medical centers. It supports the broadest diagnostic scope of 33 cardiac conditions and findings, including 15 newly added conditions for which it achieves an average F1 of 73.7% across available external evaluations. It surpasses existing best-performing foundation models in cardiac condition recognition (improving average recall by 13.54% on shared tasks) and quantification (average R2 score increase of 0.275 on shared tasks). Furthermore, in a source-blinded echocardiographer reader study, echocardiography reports co-generated with EchoChat were rated higher in diagnostic accuracy and completeness by two senior echocardiographers, and improved diagnostic performance from 72.78% to 82.75% in terms of F1 score over routine-reader only reports. These results demonstrate that integrating clinical reasoning into multimodal AI can democratize specialist expertise and transform the standard of cardiovascular care.

[92] LoCA: Enabling Multi-Modality in Geospatial Location Encoders cs.CV | cs.LGPDF

Panagiotis Koromilas, Eleanna Vali, Diogenis Antonopoulos, Eleni Saka, Dimitris Christofis

TL;DR: 论文研究地理空间位置编码器的多模态扩展问题，指出现有位置编码器受内在维度限制并与冻结图像编码器对比学习对齐。提出LoCA两阶段框架：先用Sentinel-1和Sentinel-2联合对比学习构建共对齐、高秩的多模态目标，再冻结图像编码器，训练位置编码器和表格元数据编码器作为投影适配器进行多视图对比学习。

Details

Motivation: 现有位置编码器难以同时映射同一地理位置到多个可能不兼容的模态描述符，且多模态场景下需要正则化目标同时满足跨模态共对齐和高有效秩，否则适配器无法独立对齐预训练编码器。

Result: 在17个任务和5个SOTA编码器对比中，LoCA取得最多任务胜出，是唯一在多数任务上优于其他所有模型的模型，并在全部逐任务比较中胜率达68.8%。

Insight: 论文从理论上证明Lipschitz位置编码器的内在维度至多2，并将冻结图像编码器重新解释为协方差正则化器；创新在于提出多模态位置编码需满足共对齐和高有效秩，并用两阶段流水线实现该目标。

Abstract: Location encoders map geographic coordinates to high-dimensional descriptors through contrastive alignment with paired Earth Observation imagery. We prove that this construction is structurally limited: any Lipschitz location encoder produces an output of intrinsic dimension at most 2, regardless of architecture or bandwidth, which forces the contrastive loss to strictly exceed its asymptotic optimum. Empirically, joint training also collapses the encoder’s embedding covariance to low rank. Although dimension-limited, current location encoders sidestep this spectral collapse by training against a frozen image encoder, which we reinterpret as a covariance regularizer that supplies a high-rank target for the location encoder to fold onto. However, extending this approach to multimodal inputs is challenging, as location encoders should simultaneously map a single location to multiple, potentially incompatible, descriptors. We identify two requirements a regularizer must satisfy for location encoding in multimodal regimes: co-alignment across modalities, since adapters alone cannot align independently pretrained encoders; and high effective rank, since the location encoder inherits its target’s spectrum. We propose LoCA (Location Contrastive Alignment), a two-stage pipeline that satisfies both. Stage 1 jointly trains Sentinel-1 and Sentinel-2 encoders with contrastive learning, producing a co-aligned, high-rank multimodal target. Stage 2 freezes the image encoders and trains a location and a tabular metadata encoder as projection adapters with multi-view contrastive learning. Against five state-of-the-art encoders on 17 tasks ranging from land cover and wildfire forecasting to geophysical, socio-economic, biodiversity and climate applications, LoCA achieves the most task wins, is the only model to outperform every other on a majority of tasks, and wins 68.8% of all per-task comparisons.

[93] Beyond Discrete Tokens: Preserving Numerical Continuity in Medical Vision-Language Models cs.CV | cs.AIPDF

Dianye Huang, Jiamei Guo, Yue Zhou, Mingde Li, Yi Xiong

TL;DR: 论文提出 HAD-VLM，一种混合自回归-扩散框架，用于提示驱动的医学超声定量测量。模型在共享骨干中结合自回归文本生成与连续测量预测，通过扩散过程预测卡尺端点坐标和测量长度，并用坐标-长度一致性机制与集成预测进行后处理优化。方法在超声心动图多个测量任务、医学问答和 X 线椎体测量上进行了验证。

Details

Motivation: 现有医学视觉语言模型通常将数值预测离散化为 token，难以匹配连续测量目标，导致定量测量精度受限。论文旨在保留数值连续性，同时维持语言交互和提示条件下的任务灵活性。

Result: 在 EchoNet-LVH 的 IVSd、LVIDd、LVIDs、LVPWd 四个任务上，HAD-VLM 的 MAE 分别为 1.36、2.77、3.05、1.16 mm，相较 Vicuna 自回归基线降低 21.4-37.6%，并优于微调 Qwen3-VL 和直接 MLP 回归。X 线椎体测量中 MAE 从 11.4 降至 6.7 像素，医学问答性能也得到保持。

Insight: 创新点在于将自回归语言生成与扩散式连续数值预测统一到同一骨干中，并用视觉提示调优适配医学图像。客观来看，其可借鉴之处是避免数值离散 token 化、引入坐标-长度一致性约束以及集成后处理来提升解剖相关定量测量的稳定性。

Abstract: Objective: To develop a unified vision-language model for prompt-conditioned quantitative ultrasound measurement that addresses the mismatch between continuous measurement targets and discrete token-based numerical prediction. Methods: This article presents HAD-VLM, a hybrid autoregressive-diffusion framework that combines autoregressive text generation with continuous measurement prediction within a shared backbone. Visual prompt tuning adapts the vision encoder to ultrasound images. A diffusion process predicts a five-component representation comprising caliper endpoint coordinates and measurement length. A post-processing strategy combining the proposed coordinate-length consistency mechanism with ensemble prediction is introduced to refine measurement estimates. We evaluate four echocardiographic measurement tasks on EchoNet-LVH, with additional assessments of medical question answering and X-ray vertebral measurement. Results: HAD-VLM achieves mean absolute errors of 1.36, 2.77, 3.05, and 1.16 mm for IVSd, LVIDd, LVIDs, and LVPWd, respectively, reducing errors by 21.4-37.6% relative to the Vicuna-based autoregressive baseline. It also outperforms fine-tuned Qwen3-VL and direct MLP regression across all four tasks. Medical question answering performance is preserved on the evaluated dataset. For X-ray vertebral measurement, HAD-VLM reduces mean absolute error from 11.4 to 6.7 pixels. Conclusion: Integrating autoregressive language generation with diffusion-based continuous prediction improves quantitative medical image measurement while retaining prompt-conditioned task flexibility. Significance: HAD-VLM provides a unified approach to combining language interaction with anatomically grounded numerical prediction for quantitative medical image analysis.

[94] MiD-VLM: Detecting and Grounding Global Semantic Misinformation in Image-Caption Pairs cs.CVPDF

Tarunya Prasad, Bharatesh Chakravarthi

TL;DR: 论文研究真实图像与扭曲叙事字幕配对产生的全局语义虚假信息检测问题，提出MiD-VLM多模态模型，融合SigLIP图文表示与DINOv2视觉场景特征，并通过LoRA适配Qwen2-VL-7B，联合判断图文对真实性、识别操纵类型并定位误导性字幕词元。

Details

Motivation: 现有方法多依赖像素级篡改伪影，难以发现图像本身真实但字幕改变或扭曲其叙事的误导性图文对，因此需要检测全局场景与语义不一致。

Result: 在DGM4+验证集上，二分类真实性检测取得F1=0.9679；摘要未给出操纵类型识别和词元级定位的定量结果，并指出精确词元定位仍需进一步研究。

Insight: 创新点在于面向全局语义虚假信息，融合SigLIP图文表示与DINOv2场景特征，并采用参数高效LoRA适配Qwen2-VL-7B实现真实性判断、操纵类型识别和误导词元定位的多任务联合建模。

Abstract: Semantic misinformation can arise when an authentic image is paired with a caption that changes or distorts its narrative. Because the image itself may contain no visible signs of manipulation, methods designed to detect pixel-level artifacts can miss these misleading image-caption pairs. We study this problem using DGM4+, a dataset designed to evaluate the detection of global scene and semantic inconsistencies. We propose a multimodal model that combines image-text representations from SigLIP with visual scene features from DINOv2 through a projection MLP, and adapts Qwen2-VL-7B using LoRA. The model jointly predicts whether an image-caption pair is authentic, identifies the manipulation type, and grounds the misleading caption tokens. On the DGM4+ validation split, the model achieves an F1 score of $0.9679$ for binary authenticity classification. These results suggest that parameter-efficient adaptation of vision-language models is promising for detecting semantic inconsistencies, while also motivating further work on precise token-level grounding.

[95] UniAction: Unified Action Conditioning for World Models cs.CVPDF

Bowen Xue, Zizhang Li, Hong-Xing Yu, Jiajun Wu

TL;DR: 论文提出 UniAction，一个统一动作条件化框架，用于世界模型。它将任意动作表示为稀疏的动作元素集合，每个元素包含离散语义身份和连续时空定位坐标，并把坐标映射到预训练视频模型的原生位置空间，使力、相机控制、手部姿态和机器人姿态等异构动作能在同一时空结构下条件化共享世界模型；同时引入基数校准注意力缓解不同动作表示粒度带来的偏差。

Details

Motivation: 现有动作条件世界模型通常针对单一动作类型分别构建，导致本就有限的动作标注数据被割裂到不同模型中，难以利用异构动作数据联合训练。

Result: 论文在力、相机控制、手部姿态和机器人姿态四类动作形式上评估 UniAction，其在动作跟随方面优于其他条件化方案；单个联合训练模型超过针对各动作类型单独训练的专业模型。

Insight: 创新点在于用统一稀疏动作元素表示异构动作，并映射到预训练视频模型原生位置空间以共享时空结构；基数校准注意力用于处理动作表示粒度差异。客观看，其价值在于统一动作接口与联合训练范式，可提升有限动作标注数据的利用率。

Abstract: Actions that condition world models are highly heterogeneous, and thus existing action-conditioned world models are typically built for individual action types, fragmenting already limited action-annotated data across separate models. We introduce UniAction, a unified action-conditioning framework that represents any action as a sparse set of action elements, each with a discrete semantic identity and a continuous spatiotemporal grounding coordinate. By mapping these coordinates directly into the pretrained video model’s native positional space, UniAction allows heterogeneous actions to condition a shared world model within the same spatiotemporal structure. We further introduce cardinality-calibrated attention to address the bias from differing action representation granularities. We evaluate UniAction on four representative action forms: force, camera control, hand pose, and robot pose. UniAction outperforms conditioning alternatives in action following, and a single jointly trained model surpasses the action-specific experts, showing that heterogeneous action data benefit from unified model and joint training.

[96] SceneBloom: Agentic Indoor Environment Generation with Realistic and Diverse Layouts for Embodied Learning cs.CV | cs.AI | cs.ROPDF

Yuhan Liu, Lianhui Qin, Shenji Wan

TL;DR: 论文提出 SceneBloom，一个面向具身学习的三维室内环境生成框架，将基于扩散先验的视觉布局采样与契约引导的三维编译相结合。方法先在功能区内生成家具布局，再利用提案中提取的关系指导几何拟合和局部姿态修正，从而生成真实、多样且可直接仿真的室内场景。生成场景还能用于训练目标导航策略，并提升其在真实扫描上的泛化表现。

Details

Motivation: 训练泛化性强的具身智能体需要真实、多样且可仿真的室内环境；现有语言引导方法难以精确空间落地，视觉生成模型虽能提供布局先验，但输出需几何推理才能成为物理有效的三维场景。

Result: 在五类房间上，SceneBloom 取得对比方法中最高的视觉质量和物理稳定性，是唯一未检测到网格碰撞和越界物体的方法，且布局分布比所有基线更接近真实房间。基于其生成场景训练的目标导航策略，在留出真实扫描上的成功率高于使用等量真实训练扫描训练的策略。

Insight: 创新点在于将扩散模型驱动的分层布局采样与基于关系抽取的契约引导三维编译结合，兼顾视觉合理性与物理可行性；客观看，其价值在于把生成式布局先验转化为可仿真、几何一致的三维场景，并验证了生成环境对具身策略泛化的实际增益。

Abstract: Training generalizable embodied agents requires realistic, varied, and simulation-ready indoor environments. Language-guided methods support semantic planning and object-level reasoning, but precise spatial grounding remains difficult. Visual generative models offer rich priors over plausible arrangements, yet their outputs require geometric reasoning to become physically valid 3D scenes. We introduce SceneBloom, an agentic framework that combines visual layout sampling with contract-guided 3D compilation. A hierarchical sampler uses diffusion priors to generate furniture arrangements within functional zones. A compiler then uses relations extracted from each proposal to guide geometric fitting and local pose correction. Across five room types, SceneBloom attains the highest visual quality and physical stability among the compared methods and is the only method with no detected mesh collisions and out-of-bounds objects. Its layouts are also closer to the distribution of real rooms than those of all compared baselines. Object navigation policies trained in these realistic scenes achieve a higher success rate in held-out real scans than those trained on an equal number of real training scans. Code is available at https://github.com/Tinaliu0123/scenebloom.

astro-ph.SR [Back]

[97] ARENA: Active Region attENtion Aggregation for interpretable solar flare prediction astro-ph.SR | astro-ph.IM | cs.CV | cs.LGPDF

Luis Bauer, Annalena Kofler, Andrés Asensio Ramos, Aparna Venkataramanasastry, Valentín Martínez Pillet

TL;DR: 论文提出ARENA，一种从可变数量的活动区裁剪图像中预测太阳耀斑的神经网络架构。模型通过多示例学习与注意力聚合，在仅有耀斑/无耀斑弱标签的情况下训练，并能自动定位对预测最关键的活动区，从而提升可解释性。

Details

Motivation: 太阳耀斑预测对空间天气预警具有重要意义，但耀斑起源区域通常缺乏标注，且观测中活动区数量可变；论文希望在弱监督下实现准确且可解释的耀斑预测。

Result: ARENA取得Heidke技能评分（HSS）0.45，与其他耀斑预测方法相当；实验表明基于活动区的注意力聚合可提供高效且可解释的预测方式。

Insight: 创新点在于将多示例学习与注意力聚合结合，用弱监督标签训练并从可变数量活动区中自动识别最相关区域，兼顾预测性能与可解释性。

Abstract: Predicting solar flares is a challenging space-weather forecasting problem with potentially significant impacts on Earth’s upper atmosphere, including disruptions to radio communications. We propose Active Region attENtion Aggregation (ARENA), a neural network architecture that predicts solar flares from a variable number of active-region cutouts while learning to identify the region most relevant to the prediction. ARENA is trained using multiple-instance learning under weak supervision, requiring only a flare/no-flare label for the observation and no labels specifying the flare origin. The learned attention mechanism therefore provides a means of localizing the active region driving the prediction without explicit origin annotations. ARENA achieves a heidke skill score of 0.45 which is comparable to other flare prediction approaches. These results demonstrate that active-region-based aggregation can provide an efficient and interpretable approach to solar flare prediction. The code is available at https://github.com/LuisBauer22/ARENA.

cs.AI [Back]

[98] Knowing Whom to Trust is not Enough: The Trust–Agreement Gap in Repeated Multi-Party LLM Negotiation cs.AI | cs.CL | cs.MAPDF

Amit Sarker, Moumita Choudhury, Saaduddin Mahmud, Shlomo Zilberstein

TL;DR: 论文研究LLM智能体在重复多方谈判中能否从历史交互中形成信任估计并利用其改善谈判结果。作者构建了包含暗中破坏者的重复多方多议题谈判框架，比较信任感知与信任无关的智能体。实验发现存在“信任-协议差距”：智能体能在几轮内识别出恶意对手，但准确的信任估计并不总能转化为更好的协议；只有当显式引导智能体在决策中使用信任时，协议率才能提升最多23个百分点。

Details

Motivation: LLM智能体参与谈判时易受操纵，经典多智能体系统通过显式信任与声誉模型应对，而现有LLM谈判研究多将信任视为涌现现象，缺乏对显式信任估计能否改善谈判结果的系统研究。

Result: 实验表明，信任感知智能体可在少数几轮内识别出恶意对手，但准确信任估计与协议改善之间存在“信任-协议差距”；仅在显式引导智能体利用信任进行决策时，协议率提升最多23个百分点。

Insight: 论文创新在于构造了包含暗中破坏者的重复多方谈判框架，并系统比较信任感知与信任无关智能体，首次揭示“信任-协议差距”现象；客观来看，其核心启发是显式信任模型的价值取决于信任评估方式及其如何融入智能体推理，而非仅依赖信任估计的准确性。

Abstract: Large language model (LLM) agents increasingly participate in negotiations on behalf of individuals and organizations, yet they remain vulnerable to manipulation, particularly in repeated multi-party interactions. Classical multi-agent systems address this challenge through explicit trust and reputation models, whereas existing work on LLM negotiation largely treats trust as an emergent phenomenon. We investigate whether LLM agents can form useful trust estimates from prior interactions and leverage them to improve future negotiation outcomes. We introduce a repeated, multi-party, multi-issue negotiation framework in which recurring agents participate in a sequence of negotiation games while one participant covertly attempts to prevent agreement. After each game, agents assess their counterparts and maintain pairwise trust estimates that carry over to subsequent negotiations. We compare trust-aware and trust-agnostic agents and analyze how explicit trust influences negotiation outcomes. Our results reveal a \emph{trust–agreement gap}: trust-aware agents can identify the adversary within a few games, but accurate trust estimates do not consistently translate into better agreements. Trust increases agreement rates by up to 23 percentage points, but only when agents are explicitly guided to use it in their decisions. Explicit trust can therefore improve repeated LLM negotiations, but its value depends critically on how trust is assessed and incorporated into agents’ reasoning.

[99] $Ψ$-0.6: Adaptive Streams of Thought in a Unified Vision-Language World Model cs.AI | cs.CV | cs.LGPDF

Khai Loong Aw, Klemen Kotar, Baihan Zhang, Yifan Liu, Lilian Chen

TL;DR: 论文提出Ψ-0.6，一个统一的视觉-语言世界模型，通过自适应组合感知、语言、几何和模拟的“思维流”进行推理，支持多视图空间推理和反事实模拟，并利用强化学习优化中间表示的选择与使用。

Details

Motivation: 当前AI能力通常分散在专用模型中，缺乏灵活组合不同推理形式的能力，需要实现人类式的灵活物理推理。

Result: 在多视图空间推理上零样本超越领先的开放权重模型，通过几何中间推理获得进一步增益；视觉问答准确性提高，且增益可迁移到未见基准。

Insight: 创新点包括统一的视觉-语言世界模型、自适应思维流（交错图像、文本、几何和运动）、共享token接口、反事实模拟，以及强化学习联合优化中间表示的选择、生成和使用。客观分析，其创新在于将多种推理形式统一到一个模型中，并让模型学会选择和使用中间表示。

Abstract: Humans reason about the physical world by flexibly combining different forms of inference as a problem unfolds. Achieving this flexibility is a major open challenge in AI: capabilities often remain separated across specialized models, limiting how they can be composed and jointly adapted to a task. We introduce $Ψ$-0.6, a unified vision-language world model that adaptively composes perception, language, geometry, and simulation within a shared reasoning process we call streams of thought. These streams interleave images, text, and explicit representations of geometry and motion, all of which the model can generate and interpret through a shared token interface. $Ψ$-0.6 surpasses leading open-weight models zero-shot on multi-view spatial reasoning, with further gains from reasoning through geometric intermediates. It also supports counterfactual simulation: generating and interpreting imagined scenes to determine, for example, whether moving an object would obstruct a pathway. Reinforcement learning from task feedback jointly optimizes the selection, generation, and use of intermediate representations, improving visual question-answering accuracy with gains that transfer to unseen benchmarks. $Ψ$-0.6 offers a path toward adaptive physical reasoning – not only predicting the physical world but also choosing the representations through which to reason.

[100] Beyond Post-Hoc Rewards: Privileged Reasoning Exploration for Multimodal Embeddings cs.AI | cs.CLPDF

Tianyu Yang, Yijun Tian, Lars Benedikt Kaesberg, Jan Philip Wahle, Bela Gipp

TL;DR: 论文提出PILOT框架，将多模态嵌入中的推理建模为潜变量，通过先验（仅输入条件）和后验（利用训练时关系证据）两种推理模式共同进化，并基于重要性加权变分目标选择性转移后验轨迹到先验，从而提升检索增强嵌入的推理探索能力。

Details

Motivation: 现有方法利用MLLM自生成推理增强嵌入，但传统检索监督只提供成对相关性，未指导推理探索，导致推理轨迹多样且检索效用不一，限制了检索相关推理的发现。

Result: 在78任务的MMEB-V2基准上，PILOT在2B和7B参数下均优于主要基线，全部12个任务组均有提升，总体分数分别提高3.2和3.3分，视觉文档检索提升最大（+6.1和+6.4分）。

Insight: 创新点在于将推理视为潜变量，用先验-后验共同进化框架和重要性加权变分目标，把关系监督从后处理奖励转变为训练时塑造推理探索的信号，并选择性转移后验轨迹以兼顾推理时可用性。

Abstract: Advances in Multimodal Large Language Models (MLLMs) have driven substantial progress in multimodal embeddings. Recent methods exploit generative capabilities by augmenting embedded inputs with self-generated reasoning to produce more informative embeddings. However, conventional retrieval supervision for training embedding models specifies pairwise relevance relations without explicitly guiding the reasoning used for input augmentation. Such reasoning is neither directly observed nor uniquely determined by the input, allowing multiple plausible traces to introduce semantic cues of varying retrieval utility. Existing approaches largely optimize reasoning conditioned on the input alone, limiting the exploration of retrieval-relevant traces. We introduce PILOT, a framework that models reasoning as a latent variable and instantiates its prior and posterior distributions as distinct reasoning modes of a shared MLLM. The prior conditions only on the input, whereas the posterior uses additional training-time relational evidence to guide reasoning exploration. To translate the posterior’s broader exploration into inference-time improvements, we derive an importance-weighted variational objective and instantiate it as a prior-posterior co-evolution framework that improves both modes under a shared inference-compatible reward while selectively transferring posterior trajectories to the prior according to their utility and prior reachability. On the 78-task MMEB-V2 benchmark, PILOT outperforms the primary baseline across all 12 task groups at both 2B and 7B parameters, improving overall scores by 3.2 and 3.3 points, respectively, with the largest gains in visual-document retrieval (+6.1 and +6.4 points). Our results show that relational supervision is most valuable not as a post-hoc reward but as a signal for shaping how reasoning is explored in training reasoning-enhanced embedding models.

[101] When Agents Fail: Model or Harness–Who’s to Blame? cs.AI | cs.CL | cs.SEPDF

Shao Zhang, Hangfan Zhang, Yuanyuan Shi, Hao Li, Min-Le Su

TL;DR: 论文指出LLM智能体的基准表现由模型与执行框架（harness）共同决定，因此应从模型-框架交互角度评估智能体系统。作者提出包含有效完成率、模型-框架适配度、跨模型适配度、交互残差和Token负载五个指标的评估框架，并在多个框架、模型和六类基准上进行了大规模评测，发现框架排名随模型和任务变化，任务表现与有效完成率可能偏好不同组合。

Details

Motivation: 现有智能体评测常把表现归因于模型本身，但实际行为由模型与执行框架共同产生，难以判断失败应归咎于模型还是框架；论文希望建立以模型-框架交互为中心的评估方法。

Result: 实验覆盖4个通用框架、4个核心模型、2个原生模型-框架系统及6个基准，包含111种设置和52,168条轨迹；结果显示框架排名随模型和基准变化，OpenCode在跨模型性能上排名第一，DeepSeek V4 Flash Preview在共享四基准面板上跨框架保持较高平均有效完成率。

Insight: 创新点在于提出五个互补指标来刻画模型-框架交互，尤其是揭示组件级汇总所掩盖的配对特定执行优劣；客观看，其价值在于将智能体评测从单一模型能力转向交互适配性，并提示训练可迁移的框架使用能力和面向模型/任务定制框架设计。

Abstract: LLM agents combine models with execution harnesses, so agentic benchmark performance reflects their joint behavior. We argue that harnesses should therefore be evaluated through their interactions with underlying models. We develop a framework combining five complementary measures: (i) Valid Completion Rate (VCR), how reliably agents finish normally and deliver evaluable results, irrespective of task correctness; (ii) Model-Harness Fit, how well a harness supports task achievement through valid completion for a given model; (iii) Cross-Model Fit, a harness’s overall suitability across evaluated models; (iv) Interaction Residuals, pairing-specific execution strengths and weaknesses hidden by component-level summaries; and (v) Token Load, the token demands of agent execution, including failed attempts. We evaluate four general-purpose harnesses (OpenCode, Codex CLI, Pi CLI, and DeepAgents) with four core models, plus two fixed native model-harness systems, on six benchmarks covering context management, tool use, long-context planning, multimodal interaction, and artifact handoff. Including native references and stress conditions, 111 evaluation settings yield 52,168 trajectories. Harness rankings vary across models and benchmarks; task performance and valid completion can favor different pairings, and similar task scores can accompany distinct execution profiles. OpenCode ranks first in cross-model performance, while DeepSeek V4 Flash Preview maintains consistently high Mean VCR across harnesses on the shared four-benchmark panel. These findings support evaluating model-harness interactions, training transferable harness-use capabilities in models, and harness designs adapted to the model and task.

[102] Closing the Modality Gap via Simplex-Constrained Representations cs.AI | cs.CVPDF

Shubham Gupta, Siva Reddy, Perouz Taslakian, Valentina Zantedeschi, Cem Subakan

TL;DR: 论文针对CLIP、CLAP等多模态对比模型共享表示中持续存在的模态差距，提出一种纯几何的解决思路：将嵌入空间从单位球面S^{d-1}改为概率单纯形Δ^{d-1}，并配合轻量softmax适配器与全变差相似度进行跨模态对齐。作者在五个多模态检索基准上验证，该方法大幅缩小质心L2差距，同时保持或超过标准无约束模型的检索性能。

Details

Motivation: 多模态对比模型虽能学习共享表示，但不同模态嵌入之间存在稳定的模态差距，影响跨模态对齐。论文希望不依赖复杂训练策略，而从嵌入几何空间入手，通过概率单纯形的非负和单位质量约束实现跨模态校准。

Result: 在五个多模态检索基准上，该方法将质心L2差距降低97%至99%，检索性能匹配或超过标准无约束模型。

Insight: 创新点在于将嵌入域从单位球面改为概率单纯形，把非负、单位质量约束作为结构先验和跨模态共享坐标系，并结合轻量softmax适配器与全变差相似度。其可借鉴之处是以简单可插拔的几何约束实现模态对齐，避免复杂重训练。

Abstract: While multimodal contrastive models like CLIP and CLAP successfully learn shared representations, their embeddings typically exhibit a persistent \emph{modality gap}. We propose addressing this separation through a purely geometric approach: changing the embedding domain from the unit sphere, $S^{d-1}$, to the probability simplex, $Δ^{d-1}$. Although both manifolds share the same intrinsic dimension, the simplex acts as a structural prior; its nonnegative, unit-mass constraints serve as a cross-modal calibration that forces both modalities to ground themselves in the same coordinate system. By attaching lightweight softmax adapters and using Total Variation similarity, we reduce the centroid $\ell_2$ gap by 97–99% across five multimodal retrieval benchmarks. This confirms that simplicial geometry induces genuine semantic alignment, matching or exceeding the retrieval performance of standard unconstrained models.

cs.CR [Back]

Junhao Wang, Yidou Chen, Li Lu, Hongwei Yao, Xiaodan Li

TL;DR: 论文提出 Omni-UBench，首个面向全模态大语言模型（OLLMs）及其全模态护栏模型的综合安全评测基准，覆盖安全、效用与可靠性三个维度。该基准整合文本、图像、音频、视频及跨模态组合的 18.3 万余条样本，并基于统一风险分类标注，评测了 15 个代表性 OLLMs 与全模态护栏模型。

Details

Motivation: 全模态模型统一处理多模态输入扩大了攻击面，现有全模态护栏的能力与局限缺乏系统理解，尤其缺少覆盖多模态与跨模态场景的综合安全评测基准。

Result: 在 Omni-UBench 上评测 15 个代表性模型发现：现代 OLLMs 即使未经护栏专门微调也具备较强内容审核潜力；现有护栏仍难识别隐藏有害意图的跨模态查询和复杂越狱；同时存在明显安全幻觉与对文本模式的过度敏感。

Insight: 创新点在于首个覆盖安全、效用和可靠性的全模态安全评测框架，构建大规模多源异构跨模态数据与统一风险分类，并系统揭示现有护栏在跨模态安全语义理解上的不足。

Abstract: Advances in Omni-modal Large Language Models (OLLMs) have enabled increasingly seamless human-AI interaction, but their unified processing of heterogeneous modalities also expands the attack surface, allowing adversaries to exploit richer input compositions to circumvent safety alignment. To counter such risks, omni-modal guardrails have been proposed to detect and filter unsafe queries across arbitrary modalities. However, their capabilities and limitations remain insufficiently understood due to the absence of a comprehensive evaluation benchmark. In this paper, we present Omni-UBench, the first comprehensive framework for omni-modal safety assessment, evaluating guardrail models along three critical dimensions, i.e., safety, utility, and reliability. Omni-UBench curates over 183k samples drawn from 35+ heterogeneous sources spanning text, image, audio, video, and their cross-modal combinations, annotated with safety labels under a unified risk taxonomy. Benchmarking under Omni-UBench on 15 representative OLLMs and omni-modal guardrails yields several key findings, including: (1) modern OLLMs exhibit strong content moderation potential even without guardrail-specific tuning; (2) existing guardrails still struggle to identify cross-modal queries that conceal harmful intent or involve sophisticated jailbreaks; (3) they further exhibit substantial safety hallucination and over-sensitivity to textual patterns, revealing a deficient understanding of cross-modal safety semantics. Our findings provide valuable insights for developing more trustworthy omni-modal guardrails in future research.

cs.HC [Back]

[104] From Perception to Pixels: Human-Derived Visually Distinct Colors for Improved Dominant Color Extraction cs.HC | cs.CVPDF

Uldana Shyndali, Nurdaulet Toleugaliyev, Kuat Zharykbayev, Zarina Abildasheva, Pakizar Shamoi

TL;DR: 论文提出一种基于人类感知的主色提取框架，通过110名参与者的颜色辨识实验构建包含64种感知上可区分颜色的Human Color Dictionary（HCD），并将其用于RGB直方图和K-means主色提取：用deltaE 00距离将像素映射到最近感知颜色并初始化聚类中心。作者在4,562张图像及专家设计调色板组成的数据集上评估，表明该方法生成的颜色更符合人类感知。

Details

Motivation: 传统主色提取多依赖RGB等设备导向色彩空间和固定量化，难以反映人类对颜色差异的真实感知，导致提取出的主色与人眼判断和实际调色板设计需求不一致。

Result: 在4,562张图像与专家调色板配对的数据集上，以Earth Mover’s Distance和best-match distance评估，所提方法在感知对齐上优于传统方法；摘要未声称达到SOTA。研究还发现性别对独特颜色感知数量无显著影响，高饱和颜色最易区分，暗色和深色较难稳定区分。

Insight: 创新在于用感知实验数据构建人类颜色字典，并以贪心选择得到64种感知可区分颜色，再通过deltaE 00距离将其融入直方图和K-means主色提取流程。其可借鉴点是：用实验驱动的人类感知先验替代固定色彩量化，并将感知颜色映射用于聚类初始化和像素归并。

Abstract: Dominant color extraction is a fundamental task in computer vision, with applications in design, image retrieval, and content recommendation. However, conventional algorithms based on device-oriented color spaces (e.g., RGB) and fixed quantization often fail to capture how humans perceive color differences. In this study, we propose a human-perception-based framework for dominant color extraction, built on a novel Human Color Dictionary (HCD) derived from a perceptual experiment. Participants (n=110) were sequentially shown 120 colors and asked to identify those they perceived as unique. Based on their responses, we constructed a 120 by 120 co-occurrence matrix and applied a greedy selection algorithm to derive 64 perceptually distinct colors, forming the HCD. This dictionary was integrated into RGB color histogram and K-means color extraction algorithms by initializing centroids and mapping pixel values to their nearest perceptual color using the deltaE 00 distance. Evaluation on a dataset of 4,562 images paired with expert-designed palettes demonstrated that our method improves perceptual alignment, as measured by Earth Mover’s Distance (EMD) and best-match distance. Our findings suggest no meaningful gender differences in the number of uniquely perceived colors, indicating that sex does not significantly influence color perception in this task. Another key finding is that highly saturated colors are perceived as the most distinguishable, whereas dark and deep colors tend to perceptually collapse and are less reliably differentiated. The results confirm that incorporating experimentally derived human color representations ensures the generated color clusters align more closely with human perception, thus improving the usability of color palette generation in practical applications.

cs.LG [Back]

[105] PaperScorer: How Predictable Is Paper Acceptance? cs.LG | cs.CVPDF

Sachin Konan, Jonathan Liu, Zhuang Liu

TL;DR: 论文提出 PaperScorer 系列模型，在去除作者身份和格式捷径后，仅根据论文抽取文本或页面截图预测同行评审的接收/拒稿决定。实验发现视觉模型最具预测力，在 ICLR 论文上达到 68% 准确率，在 arXiv 机器学习论文上达到 77%，优于纯文本模型和前沿推理模型。研究还发现预测在中评分论文上最难，且模型置信度经过校准。

Details

Motivation: 同行评审难以建模且噪声大，但论文本身可能携带部分评审决定信号；作者希望探索仅凭论文内容能多大程度预测接收/拒稿，并迈向 AI 驱动的研究评估。

Result: 视觉模型效果最好，在 ICLR 上准确率 68%，在 arXiv ML 论文上 77%，超过纯文本和前沿推理模型；信号较稳健，甚至将整篇论文压缩为单张图像仍有效。模型对最低和最高评分论文预测最强，中间评分论文难以预测，且置信度校准较好。

Insight: 创新点在于用页面截图保留图表、版面和展示信息来预测评审决定，并去除作者身份与格式捷径；客观看，其价值在于量化论文自身承载的评审可预测性，并揭示视觉版面信号优于纯文本以及中评分样本的不可预测性。

Abstract: Automated research is largely evaluated by benchmark performance, but the value of research rarely reduces to a single score. Humans judge a work’s holistic contribution through peer review, which is hard to model because it is noisy and depends on many factors. However, what if, given only the paper, we could predict its peer-review decision directly? We introduce PaperScorer, a family of models that predict a paper’s accept or reject decision from its extracted text or page screenshots, training only on the decision after removing author identity and formatting shortcuts. Vision models are the most predictive (68% accuracy on ICLR papers and 77% on ML papers from arXiv), beating text-only and frontier reasoning models. Unlike plain text, page images retain figures, layout, and presentation. This signal is robust, surviving smaller models and even compressing the whole paper into a single image. But accurate predictions are not evenly spread. PaperScorer is strongest on the lowest and highest rated papers, while papers rated in the middle stay unpredictable for our models and frontier systems alike. Additionally, its confidence is calibrated, so its most confident predictions are also its most accurate. Overall, PaperScorer shows how much of the decision a paper carries on its own, marking a first step toward AI-driven research evaluation.

[106] Aligning Large Language Models with Human Feedback: Mathematical Foundations and Algorithm Design cs.LG | cs.CLPDF

Siliang Zeng, Luca Viano, Chenliang Li, Jiaxiang Li, Volkan Cevher

TL;DR: 本文是一篇面向大语言模型对齐的教程/综述，系统介绍将LLM与人类意图、偏好和价值对齐的数学基础与算法框架，涵盖SFT、RLHF和DPO等标准技术，并联系逆强化学习与离散选择模型进行理论阐释。文章以教程风格讨论当前先进算法的优势、局限和实践实现，旨在为研究者和实践者提供综合资源。

Details

Motivation: 大语言模型需要与人类意图、偏好和价值观对齐，但相关方法涉及复杂的数学与算法基础。论文旨在系统梳理对齐方法的理论基础和算法框架，帮助研究者与实践者理解并开发更鲁棒、可扩展的对齐技术。

Result: 摘要未提及具体实验、定量结果或benchmark表现；本文属于教程/综述性工作，主要贡献是理论梳理、算法介绍与实践洞见，而非报告新方法的实验性能。

Insight: 论文宣称的创新点在于以教程方式系统整合LLM对齐的数学基础与算法框架，并建立其与逆强化学习、离散选择模型的理论联系。客观来看，其价值更偏向综述与教学性整合，强调对SFT、RLHF、DPO等方法的优缺点和实践实现进行统一阐释。

Abstract: This article provides an introduction to the mathematical foundations and algorithmic frameworks used to align Large Language Models (LLMs) with human intentions, preferences, and values. We discuss standard alignment techniques, such as fine-tuning (SFT), reinforcement learning with human feedback (RLHF), and direct preference optimization (DPO). We also explore the theoretical underpinnings of learning from human preferences, drawing connections to inverse reinforcement learning (IRL) and discrete choice models. We present state-of-the-art algorithms in a tutorial style, discuss their advantages and limitations, and offer insights into practical implementation. Our exposition is intended to serve as a comprehensive resource for researchers and practitioners, providing both a foundational understanding of alignment methodologies and a framework for developing more robust and scalable alignment techniques.

[107] Scaling Transformer Energy-based Models For High Quality Image Synthesis cs.LG | cs.CVPDF

Jungsoo Lee, Alexi Gladstone, Yilun Du

TL;DR: 论文提出 Transformer Energy-Based Model（TEM），在潜空间中使用可扩展的 Transformer 能量函数构建能量基生成模型。模型通过聚合多层能量融合局部纹理与全局语义约束，并结合 Positive Representation Alignment 与改进采样策略提升大规模生成质量。作者在 ImageNet 256×256 和 512×512 上验证了高保真图像生成，并展示了组合生成、零样本修复和 OOD 检测能力。

Details

Motivation: EBM 具有组合生成和推理时扩展的潜力，但高维采样困难与深层架构训练不稳定使其长期局限于低维场景。论文旨在解决这些瓶颈，使 EBM 可扩展到高分辨率、高质量图像合成。

Result: TEM-XL 在类条件 ImageNet 256×256 上无需 classifier-free guidance 达到 FID-50K 3.82；在 ImageNet 512×512 上 TEM 达到 FID-50K 8.24，表明方法可扩展到更高分辨率。

Insight: 创新点在于将 Transformer 能量模型完全置于潜空间，并聚合多层能量以融合局部与全局约束；PRA 用视觉基础模型监督中间表示，配合先进采样策略提升推理质量。客观看，其价值在于把对比式 EBM 扩展到高质量高分辨率生成，同时保留组合生成、零样本修复和 OOD 检测等 EBM 特性。

Abstract: Energy-Based Models (EBMs) are a flexible class of generative models that decouple probabilistic modeling from the generation process. This decoupling directly enables compositional generation and inference-time scaling, where sample quality can be refined simply by increasing sampling steps. However, severe challenges in high-dimensional sampling and training instabilities with deep architectures have restricted EBMs to low-dimensional regimes. To resolve these bottlenecks, we introduce the Transformer Energy-Based Model (TEM), a scalable transformer energy function operating entirely within a latent space. On top of this backbone, we extract energies at multiple layers and sum them, composing complementary constraints from local texture to global semantics. Furthermore, two components make this high-quality at scale: Positive Representation Alignment (PRA), which supervises TEM’s intermediate representations with a vision foundation model, and advanced sampling strategies that improve sample quality at inference. TEM-XL achieves an FID-50K of 3.82 on class-conditional ImageNet 256$\times$256 without classifier-free guidance, showing that a contrastive EBM can generate high-fidelity images. On ImageNet 512$\times$512, TEM achieves an FID-50K of 8.24, demonstrating that the approach scales to higher resolution. We further validate the core promises of EBMs: compositional generation, zero-shot inpainting, and out-of-distribution detection.

[108] REACT: Representational Early Analysis and Control of Chain-of-Thought Trajectories cs.LG | cs.AI | cs.CLPDF

Hanwen Zhang, Enyi Jiang, Ruike Zhu, Qinan Yu, Sanmi Koyejo

TL;DR: 论文提出 REACT，一种在思维链（CoT）生成早期对隐藏状态进行条件激活干预的方法：从安全/不安全轨迹对中学习安全方向，并在推理模型权重冻结的情况下仅对早期 CoT 隐藏状态施加一次编辑，后续 token 不再修改。作者系统研究干预时机，在前五个 CoT 位置分别训练方向并评估完整再生成效果，发现最有效控制集中在第 2～3 个 token 的早期窗口。

Details

Motivation: CoT 生成提供了在模型完成答案前进行干预的机会，论文关注一个关键问题：风险最容易被检测到的位置，是否也是控制最有效的位置。

Result: 在三个蒸馏推理模型和三个生成种子上，最强增益集中在 2～3 token 早期窗口；在 DeepSeek-R1-Distill-Llama-8B 上，第 4、5 个 token 的干预效果接近零。该模型在 StrongREJECT-273 上，完全安全的 CoT-answer 输出比例从 29.06% 提升到 82.05%，同时良性拒绝和有用性接近基线。

Insight: 创新点在于用单次早期隐藏状态激活干预实现 CoT 安全控制，并区分“风险可读性”和“有效控制”：即使后续状态更能预测风险，干预时机也必须通过其对后续生成的影响来评估。

Abstract: Chain-of-thought (CoT) generation offers an opportunity to intervene before a reasoning model completes its answer. But does the point at which risk is easiest to detect also offer the most effective control? We study this question with REACT, a conditional activation intervention that learns a safety direction from paired safe and unsafe trajectories and applies it once to an early CoT hidden state. The model weights remain frozen, and all subsequent tokens are generated without further edits. To study timing, we train directions separately at each of the first five CoT positions and evaluate ungated edits with full post-edit regeneration. Across three distilled reasoning models and three generation seeds, the strongest gains concentrate in a two- to three-token early window; on DeepSeek-R1-Distill-Llama-8B, the effect falls to approximately zero at the fourth and fifth tokens, even though later states can be more predictive of risk. This separates risk readability from effective control: intervention timing must be evaluated through its effect on subsequent generation. On the same 8B model, REACT raises the rate of fully safe CoT-answer outputs on StrongREJECT-273 from 29.06% to 82.05%, while keeping benign refusal and usefulness near baseline. An anonymized implementation is available at https://anonymous.4open.science/r/REACT_official2-333B.

[109] Accordion: Elastic-Depth Inference via Fixed-Prefix Layer Looping cs.LG | cs.CLPDF

Yudong Zhang, Wei Ding, Kaili Zheng, Yuchen Ding, Zhenyu Zhang

TL;DR: 论文提出 Accordion，一种基于混合专家（MoE）且支持固定前缀层循环的弹性深度推理模型，可在五种推理预算下运行。模型通过联合预训练、监督微调和强化学习保持各预算性能，并用参数组合并和预算匹配的多教师在线策略蒸馏整合三个领域专家。实验表明增加推理深度能稳定提升多任务表现，且单模型可在不同预算下兼顾领域能力与指令遵循。

Details

Motivation: 大语言模型需要服务不同推理预算的应用，但为每个预算单独训练和维护模型成本很高。现有 Looped Transformers 虽能通过参数复用灵活调整计算量，却难以在不同推理预算下持续保持强性能。

Result: 经过 3.6T token 预训练后，Accordion-6B-A0.5B 增加推理深度使其在 37 个任务上的五类宏平均提升 3.01 个百分点，中间预算以一半的额外层执行获得 89% 的增益。最终模型在对应任务与预算平均上超过各领域专家，并在所有预算下保持较强指令遵循及数学推理、代码生成的深度相关增益。

Insight: 论文宣称的创新在于用固定前缀层循环实现五种推理预算、以 MoE 支持弹性深度，并通过联合预训练及 SFT/RL 中的参数组合并和预算匹配多教师蒸馏维持多预算能力。客观看，其可借鉴点是将单模型弹性计算预算与领域专家整合结合，且无需显式跨预算一致性目标即可在多个预算下获得深度相关收益。

Abstract: Large language models serve applications with diverse inference budgets, but training and maintaining separate models for each budget incurs substantial costs. Recent Looped Transformers enable flexible inference computation through parameter reuse, but maintaining strong performance across different inference budgets remains an open challenge. We introduce Accordion, a mixture-of-experts-based model that supports five inference budgets through fixed-prefix layer looping. Each budget follows a pre-defined execution path, while the minimum budget retains the unlooped model. Joint pretraining samples one budget per micro-batch and optimizes its next-token prediction loss without additional cross-budget consistency objectives. We further preserve these inference budgets through supervised fine-tuning and reinforcement learning, where parameter-group merging and budget-matched multi-teacher on-policy distillation integrate three domain experts into one model. After 3.6T tokens of pretraining, increasing inference depth improves Accordion-6B-A0.5B’s five-category macro-average across 37 tasks by 3.01 percentage points, with the middle budget capturing 89% of this gain using half as many additional layer executions. The final model surpasses each domain expert on its corresponding task-and-budget average, while achieving strong instruction-following performance across all budgets and retaining depth-dependent gains in mathematical reasoning and code generation.

cs.RO [Back]

Jiawei Chen, Yinxi Wang, Zihan Yang, Meijun Gao, Yaowei Liu

TL;DR: 论文提出RepresentNav，一种基于自构建表征空间的导航基础模型：用Representation Residuals聚合多个视觉基础模型全深度特征，使导航策略按自身目标学习所需视觉表征；并在同一空间中以潜链式思考预测未来场景表征，作为JEPA与策略端到端训练。该模型在多个导航基准取得SOTA，并在真实机器人上验证。

Details

Motivation: 现有基于视觉基础模型的导航策略主要沿用编码器预训练目标决定的表征，未必适配导航决策所需。论文希望让策略自身目标构建视觉表征，并预测导航所需的未来场景。

Result: 在VLNVerse、VLN-CE R2R、EVT-Bench和两个点目标基准上达到SOTA；VLNVerse细粒度成功率83.80%，超先前SOTA 20.05个百分点；EVT-Bench distracted tracking单相机85.5%（+10.1）；相同编码器下优于拼接，dream减少碰撞约四分之一，并迁移到真实机器人。

Insight: 创新点在于“按需看、按愿梦”的统一自构建表征空间：跨模型全深度特征残差注意力、动作前潜链式未来表征预测，以及无需占用监督即可解码深度/语义/3D占用的紧凑潜世界模型。客观看，将表征学习目标与导航策略目标对齐，并用JEPA式未来潜表征预测增强规划，是主要可借鉴之处。

Abstract: What visual representation should a navigation policy act on? Navigation policies built on vision foundation models largely leave representation design to the encoders’ pretraining objectives. We present RepresentNav, a navigation foundation model built on a self-constructed representation space: a visual representation constructed by the policy’s own objectives from vision foundation models. RepresentNav builds this space with Representation Residuals, a compact three-layer transformer that attends over features spanning the full depth of multiple complementary vision foundation models, so that the policy learns to see what it needs for navigation. In the same space it dreams what it wants: before every action a latent chain-of-thought predicts the representation of the scene a moment ahead. The dream is trained end-to-end with the policy as a joint-embedding predictive architecture (JEPA), with a next-representation prediction loss and a regularizer on its targets. RepresentNav sets a new state of the art on VLNVerse, VLN-CE R2R, EVT-Bench, and two point-goal benchmarks, and its gains carry over to a physical robot amid clutter and moving people. On VLNVerse fine-grained, RepresentNav achieves 83.80% success, outperforming the previous state of the art by 20.05 percentage points, and on EVT-Bench distracted tracking it reaches 85.5% with a single camera (+10.1). With the same encoders, the self-constructed space clearly outperforms concatenating their outputs and learns to weight their layers unevenly, and a dream in it cuts collisions by a quarter. A single dreamed latent decodes into the depth, semantics, and 3D occupancy of the scene a moment ahead, more accurately than pretrained encoders applied to the real future frame, although occupancy is never supervised, and the rollout tracks the robot’s own motion over the next second: the dream emerges as a compact latent world model.

[111] WorldMirror: Agentic Real-to-Sim Generation of Interactive Worlds from In-the-Wild Robot Demonstrations cs.RO | cs.CVPDF

Tianling Xu, Weijie Wan, Honghao Su, Kailun Su, Junyuan Tang

TL;DR: 论文提出 WorldMirror，一个面向野外机器人演示的智能体式 real-to-sim 框架，可从真实演示中构建可交互数字孪生。其核心是将 real-to-sim 构建建模为可执行世界程序的迭代精炼：编码智能体分解场景、规划重建步骤、编排图像与 3D 生成工具，并利用验证反馈修正程序。相机位姿锚定的场景表示将世界组织为静态视觉上下文、支撑几何和可编辑交互资产，从而支持物理一致交互与轨迹回放。

Details

Motivation: 现有仿真机器人学习通常需要大量人工构建场景和指定任务，限制训练规模与数据多样性；野外机器人演示虽提供多样真实观察，但转化为仿真需要高保真视觉重建和物理一致交互。

Result: 在 DROID 数据集上的实验表明，WorldMirror 能重建视觉忠实、几何一致的可交互世界，并保持记录机器人轨迹的物理有效性；摘要未声称达到具体 SOTA。

Insight: 创新点在于将 real-to-sim 构建转化为可执行世界程序的迭代精炼，由编码智能体编排专用图像/3D 生成工具并通过验证反馈纠错；同时采用相机位姿锚定表示统一静态上下文、支撑几何与可编辑交互资产，保持场景、物体和机器人间的空间关系。

Abstract: Existing approaches for robot learning in simulation often require substantial manual effort to construct scenes and specify tasks, limiting training scalability and data diversity. Meanwhile, in-the-wild robot demonstrations naturally provide diverse and realistic observations of real-world interactions. Leveraging these demonstrations for simulation requires both high-fidelity visual reconstruction and physically consistent interactions. General-purpose agents offer flexible adaptation to diverse scenarios and strong reasoning about 3D spatial relationships, while specialized generative models provide high-fidelity reconstruction of scene appearance and geometry. We introduce WorldMirror, an agentic real-to-sim framework that constructs interactive digital twins from in-the-wild robot demonstrations. Our central idea is to formulate real-to-sim construction as the iterative refinement of an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and orchestrates specialized image and 3D generation tools, refining the program through verification feedback. A camera-pose-anchored scene representation organizes the world into static visual context, support geometry, and editable interactive assets while preserving spatial relationships among the scene, objects, and robot. The agent uses this representation to diagnose and correct reconstruction errors, enabling physically consistent interaction and trajectory replay. Experiments on DROID demonstrate that WorldMirror can reconstruct visually faithful and geometrically consistent interactive worlds while preserving the physical validity of recorded robot trajectories.

[112] EgoForesight: Effectively Scaling Policy Learning with Noisy Egocentric Actions cs.RO | cs.CVPDF

Chubin Zhang, Changyuan Wang, Yirui Wang, Ao Li, Shilin Ma

TL;DR: 论文提出 EgoForesight，一个视觉-语言-动作框架，联合利用高质量但昂贵的机器人演示和覆盖广但动作标签噪声大的第一视角视频来扩展策略学习。方法通过可靠性感知的动作监督与基于干净未来结果的表征蒸馏，降低不可靠动作标签影响并利用演示结果作为补充监督。实验显示其随预训练数据增长具有更陡的扩展斜率，并在真实世界开环动作预测和 RoboCasa 少样本任务上取得提升。

Details

Motivation: 机器人演示轨迹监督质量高但采集成本高，第一视角视频能扩大任务和环境覆盖却因运动重建与重定向引入噪声动作标签。论文旨在解决如何在存在噪声第一视角动作标签时有效扩展策略学习的问题。

Result: 在 30,000 小时预训练数据下，EgoForesight 相比基线具有更陡的扩展斜率，将真实世界开环动作 MSE 降低 20.5%，并将 RoboCasa 少样本成功率提升 8.1 个百分点；后训练后在仿真和真实世界灵巧操作中也取得较强绝对性能。

Insight: 创新点在于用联合视觉-动作流耦合未来视觉表征预测与动作生成，并通过可靠性条件扰动和可靠性加权回归分配不同来源的动作监督。进一步利用特权未来表征蒸馏，让观察干净未来的 EMA 教师监督接收损坏未来的学生早期层，从而以结果信息补充噪声动作标注。

Abstract: Scaling policy learning requires broad experience and reliable supervision. Robot demonstrations provide high-quality trajectory supervision but are costly to collect. Egocentric videos broaden task and environment coverage, yet motion reconstruction and retargeting introduce noisy action labels. To address this challenge, we introduce EgoForesight, a vision-language-action framework that learns jointly from both sources by reducing the influence of unreliable action labels and exploiting demonstrated outcomes as complementary supervision. A joint vision-action flow couples future visual representation prediction with action generation, unifying reliability-aware action learning with outcome-informed representation transfer. Specifically, reliability-conditioned corruption allocates action supervision across noise levels according to source reliability, while reliability-weighted regression regulates each source’s contribution. Complementing this treatment of noisy labels, privileged-future representation distillation draws supervision from demonstrated outcomes. An exponential-moving-average teacher observes the current scene and clean future to encode action-relevant structure from the resulting scene change. Its deeper representations supervise an earlier student layer receiving a corrupted future, providing outcome-informed structure beyond noisy action annotations. Together, these mechanisms support effective scaling with noisy egocentric actions. Over the tested range, EgoForesight exhibits steeper scaling slopes than the baseline, reducing real-world open-loop action MSE by 20.5% and improving RoboCasa few-shot success by 8.1 percentage points at 30,000 hours of pretraining data. After post-training, it also achieves strong absolute performance in both simulated and real-world dexterous manipulation.

[113] TTT in VLA Models: Exploring Training with Human Demonstrations cs.RO | cs.AI | cs.CVPDF

Qiangong Zhou, Jiafeng Liang, Yimin Dong, Yang He, Hongxiang Li

TL;DR: 论文将测试时训练（TTT）集成到VLA模型（InternVLA-A1和Pi0.5）中，通过配对的人类示范和机器人轨迹训练，研究基于示范的动作生成。实验发现，在当前规模下加入TTT并未带来一致的目标选择改进，较短序列、全轨迹梯度连接和对比正则化也未明显提升对示范的响应性，单帧线索下真实机器人仍偏好固定位置的杯子。论文记录了实现和负面结果以支持复现。

Details

Motivation: 长时程机器人任务需要保留和使用过去信息，作者希望通过TTT将上下文存储到快速权重中，并利用人类示范与机器人轨迹的配对训练来引导动作生成，解决示范信息有效融入VLA模型的问题。

Result: 实验表明，在当前规模下，加入TTT和配对数据训练没有导致基于示范的一致目标选择；缩短序列、全轨迹梯度连接和对比正则化未明显改善响应性；单帧线索下真实机器人执行仍偏好固定位置杯子。结果属于负面发现。

Insight: 创新点在于将TTT引入VLA模型，实现两阶段记忆迁移和截断反向传播，并系统考察多种训练配置。客观分析，其价值在于揭示了当前规模下TTT与示范配对训练的局限性，为后续改进提供了可复现的实证参考。

Abstract: Long-horizon robot tasks require retaining and using past information. We integrate Test-Time Training (TTT), which stores context in fast weights, into InternVLA-A1 and Pi0.5 to study action generation conditioned on human demonstrations through training on paired demonstrations and robot trajectories. We implement memory transfer between the two phases and truncated backpropagation, and examine training objectives, gradient coverage, and contrastive regularization across video, short-video, and single-frame cue tasks. In our experiments, adding TTT and training on paired data at the current scale did not lead to consistent target selection based on demonstrations. Under the tested settings, shorter sequences, full trajectory gradient connectivity, and contrastive regularization did not clearly improve responsiveness to demonstrations. When demonstrations were reduced to single-frame cues, real-robot execution still showed a preference for cups at fixed positions. We document the implementation, training configurations, and observations to support further inspection and replication.

[114] Robust Offset-Free Lane-Keeping Control Framework for Vision-Only Automated Vehicles cs.RO | cs.CV | eess.SYPDF

Der-Hau Lee

TL;DR: 论文面向纯视觉自动驾驶车辆，提出一种鲁棒无偏移模型预测控制（OF-MPC）框架，用于高速大曲率弯道下的车道保持控制，兼顾实时性、准确性和车辆稳定性。框架比较了多种调节问题求解算法，其中itube-CILQR表现最佳，平均计算时间低于5 ms；随后将其用于仿真环境中的视觉车道保持实验，并借助多任务UNet量化未训练场景下的感知不确定性。

Details

Motivation: 高速大曲率道路转弯时，纯视觉自动驾驶车辆需要实现准确、实时且鲁棒的车道保持控制，同时视觉感知模型在未见场景中存在不确定性，给控制稳定性带来挑战。

Result: 数值仿真表明，基于插值管约束迭代线性二次调节器（itube-CILQR）的算法优于基于IPOPT和OSQP的求解器，平均计算时间小于5 ms；该算法被用于视觉车道保持仿真实验，以量化多任务UNet在未训练交通场景中的感知不确定性。

Insight: 论文的创新点在于将无偏移MPC框架与itube-CILQR实时求解相结合，并提出在未见环境中量化视觉感知系统不确定性的方法，可为视觉闭环控制中的鲁棒性评估和高级自动驾驶系统设计提供借鉴。

Abstract: Achieving accurate, real-time lane-keeping control during high-speed cornering on large-curvature roads while ensuring robust vehicle stability is a critical challenge in autonomous driving. To address this challenge, this study developed a robust offset-free model predictive control (OF-MPC) framework for vision-based autonomous vehicle lane-keeping. The regulation problem in this framework is solved using several algorithms. Numerical simulation results indicated that the interpolation-tube-based constrained iterative linear quadratic regulator (itube-CILQR) algorithm outperformed solvers based on the standard Interior Point Optimizer (IPOPT) and Operator Splitting Quadratic Program (OSQP), achieving a mean computation time of less than 5 ms. The itube-CILQR algorithm was then used for vehicle control in vision-based lane-keeping experiments in a simulation environment to quantify the perceptual uncertainty of a visual perception model (multitask UNet). This quantification was performed using the OF-MPC framework for traffic scenes that were not encountered during model training. Overall, the developed OF-MPC framework and the proposed method for characterizing the perceptual uncertainty of a visual perception system in unseen environments can contribute to the future development of advanced autonomous driving systems.

[115] ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback cs.RO | cs.CVPDF

Zimo He, Tianyi Bian, Zizhong Yang, Hongjie Li, Nan Jiang

TL;DR: 论文提出ViT-H，一个从单目人体视频学习人形机器人全身控制的“生成-跟踪”框架。它用扩散模型直接从视频生成人形机器人参考运动，跳过人体运动重建与重定向，并利用下游运动跟踪结果通过直接偏好优化（DPO）对生成器进行后训练；同时给出自回归变体，支持延迟低于400ms的实时人形机器人视频遥操作。

Details

Motivation: 现有“重建-重定向-跟踪”流水线各中间阶段分别优化，系统级可扩展性受限，且无法利用下游跟踪反馈直接优化参考运动的可执行性。论文希望从视频端到端地获得可被执行的高质量人形参考运动。

Result: 在Unitree G1上的实验表明，ViT-H在运动质量和可执行性上均优于SOTA的“重建-重定向-跟踪”流水线；方法随模型规模、预训练与后训练数据规模良好扩展，且运动跟踪反馈在不同跟踪器上均能稳定提升可执行性。

Insight: 创新点在于以“生成-跟踪”范式替代“重建-重定向-跟踪”，用扩散模型直接生成机器人参考运动并借助跟踪反馈做DPO后训练，形成下游可执行性驱动的闭环优化；自回归变体实现低延迟实时遥操作，兼顾质量与可扩展性。

Abstract: Learning humanoid control from monocular human videos offers a scalable way to acquire diverse whole-body behaviors. Yet, existing reconstruction-retargeting-tracking pipelines are limited in system-level scalability by separately optimized intermediate stages and cannot directly optimize reference motion executability using downstream tracking feedback. We present ViT-H, a video-to-humanoid control framework following a generation-and-tracking paradigm. ViT-H directly generates humanoid reference motions from videos with a diffusion model, bypassing human motion reconstruction and retargeting, and uses motion-tracking outcomes to post-train the generator with direct preference optimization. We further introduce an autoregressive variant that enables real-time humanoid video teleoperation with sub-400 ms latency. Extensive experiments on the Unitree G1 demonstrate that ViT-H outperforms state-of-the-art reconstruction-retargeting-tracking pipelines in both motion quality and executability. We further show that ViT-H scales favorably with model size and with both pre-training and post-training data scale, while motion-tracking feedback consistently improves executability across different motion trackers.

Table of Contents

cs.CL [Back]

[1] Rethinking Structured Generation: Can Graph-Based Reasoning Resolve Ambiguity? cs.CL | cs.AIPDF

[2] Multi modal perceived conversation success prediction for spontaneous autistic and non-autistic dyadic interactions cs.CL | cs.LGPDF

[3] An Agentic Approach with Evidence-Grounded Verification for Multimodal Emotion Reasoning in Conversation cs.CL | cs.AI | cs.MM | eess.IVPDF

[4] Free Lunch for LLMs Confidence: The RL Critic Already Knows cs.CLPDF

[5] Latent Coherence: Do Frontier Language Models’ Probability Judgments Obey the Law of Total Probability? cs.CLPDF

[6] SAGE: Sense-Aligned Multimodal Grounding Evaluation with Gloss-Augmented Reasoning cs.CL | cs.CVPDF

[7] Scaling cross-situational word learning on children’s naturalistic experiences cs.CLPDF

[8] Kolibri: A Sovereign European Model on the Pareto Frontier cs.CL | cs.AI | cs.LGPDF

[9] DraMaze: A Multi-Agent Pipeline with Future-Aware Memory for Diverse Microdrama Script Generation cs.CLPDF

[10] X-Dubbing: Speech-to-Speech Translation under Temporal and Visual Constraints cs.CL | cs.CV | eess.ASPDF

[11] How Much Do You Trust A Dog? Quantifying Hint-Following in Reasoning Language Models cs.CL | cs.LGPDF

[12] From Noisy Retrieval to Decision Evidence: Silver Evidence Demonstrations for In-Context Learning cs.CLPDF

[13] Shorter Is Not Cheaper: A Controlled Comparison of Declarative Animation Specifications and Free-Form Code for LLM-Generated Explanations cs.CL | cs.HC | cs.SEPDF

[14] From Promises to Accountability: Comparative AI Modeling and Visualization of Electoral Commitments in Nepali Political Texts cs.CLPDF

[15] Collection-Date Assignment Redirects Answers in Temporal QA cs.CLPDF

[16] SOPO: Socratic Guided Policy Optimization for Span-Level Hallucination Detection cs.CL | cs.AIPDF

[17] DIAL-S2ST: Learning Latency Control for Simultaneous Speech-to-Speech Translation cs.CL | cs.SD | eess.ASPDF

[18] Many Perturbations, Shared Failure Dynamics: Tracing Direction-Sensitive Perturbation Influence in Language Models cs.CLPDF

[19] Why Full-Duplex Speech Models Collapse in Long Conversations cs.CL | cs.SDPDF

[20] Acoustic and Lexical Signals for Native Language Identification of Language Learners cs.CL | cs.LGPDF

[21] A Broader Look into MLLM’s Retrieval Heads cs.CLPDF

[22] Profile-Driven User Simulation via Reinforcement Learning with Hierarchical Rewards for Task-Oriented Dialogues cs.CLPDF

[23] Reading Between the Layers: Cross-Modal Alignment and Representational Hierarchy in Vision Transformers cs.CLPDF

[24] The Punjabi Geet Toxicity Dataset (PGT-FG): Fine-Grained Multimodal Annotations for Toxic Content in Punjabi Songs cs.CLPDF

[25] PHYRD: A Living Benchmark for Reproducing and Extending Theoretical Physics Research cs.CLPDF

[26] On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models cs.CL | cs.AI | cs.LGPDF

[27] Frontier-OPD: Discovering the Edge of Agent Capability and Teaching Agents to Go Beyond cs.CLPDF

[28] KrishokTech: A Bengali Agricultural Advisory System with Explicit Authorization Controls cs.CLPDF

[29] J-Comm: Jacobian-Guided Latent Communication between LLM Agents cs.CL | cs.MAPDF

cs.CV [Back]

[30] DirCast: Live Esports Directing and Commentary with a Single Streaming Video-Language Model cs.CVPDF

[31] AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation cs.CVPDF

[32] SyncVid: World-Equivariant Diffusion for Synchronized Video Generation cs.CVPDF

[33] PnP*: A certifiable solver for Perspective-n-Point cs.CV | cs.RO | math.OCPDF

[34] StackGen3D: Stable 3D Block Stack Generation from Multiview Silhouettes cs.CV | cs.ROPDF

[35] SAGE: A hybrid vision-language and geometry framework for work-zone pathway prediction under temporary traffic control cs.CV | cs.ROPDF

[36] FSVL: Taxonomic Fast-Slow Vision-to-Language Collaborative Framework for Interpretable Confusable Fish Species Identification and Knowledge Generation in the Middle Yangtze River cs.CV | cs.AIPDF

[37] StateBridge: Phase- and Track-Grounded Reasoning for Synthetic-to-Real Traffic Video Captioning and VQA cs.CVPDF

[38] PixGR: Pixel-Space Generative Decoding for Fast Feed-Forward 3D Reconstruction cs.CVPDF

[39] STEP: Surgical Point Tracking from Sparse Endpoints and Pseudo-trajectories cs.CVPDF

[40] Interpreting Physics in Video Encoders using Multi-Object Interaction Videos cs.CVPDF

[41] OpenHome: From Perception to Insight in Smart-Home Camera Videos cs.CV | cs.AIPDF

[42] MAGIC: Margin-gated Contrastive Debiasing with Evidence Restoration for VLM Test-time Robustness Scaling cs.CV | cs.LGPDF

[43] NUViT: Vision Transformers for Fourier Space Data cs.CV | cs.LGPDF

[44] Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders cs.CV | cs.AI | cs.CR | cs.LGPDF

[45] Guided Zero-Shot Anomaly Explanation for Anonymized Crowd Video Monitoring: Context, Categorization, and Spatial Localization cs.CV | cs.AIPDF

[46] SyncPro: Synchronous Reasoning and Responding for Proactive Streaming Video Understanding cs.CV | cs.CL | cs.LGPDF

[47] Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models cs.CVPDF

[48] Real-Time Localisation of Dorsal Anatomical Regions on Dairy Cows in Commercial Rotary Parlours from RGB-D cs.CVPDF

[49] Depth-Dependent Safety Geometry in Vision-Language Models: Layer-Wise Localization and Bidirectional Refusal Control cs.CV | cs.CL | cs.CR | cs.LGPDF

[50] Angular Supervision for Visual Object Grounding in Autoregressive Vision-Language Models cs.CVPDF

[51] ACWM-RM: A Reference-Free Reward Model from Complementary Mismatch Preferences cs.CVPDF

[52] TileShare: Training-Free Acceleration of Overlapping Tiled ViT Decoding cs.CV | cs.LGPDF

[53] Easy-3Dfy: Object-Level Geometric Composition for Single-Image 3D Scene Construction cs.CV | cs.AIPDF

[54] Representation Learning via Composite Subspace Flow Matching cs.CV | cs.AIPDF

[55] Beyond Pattern Matching in 3D MLLMs: Part-Level Functional Reasoning for Generalizable Recognition cs.CV | cs.AIPDF

[56] LapaFM: A Laparoscopic Foundation Model via Multi-Stage Continual Learning cs.CVPDF

[57] RVG-Bench: A Benchmark for Reasoning-Driven Audio-Visual Temporal Grounding cs.CVPDF

[58] ReLEAP: Upcycling Vision Datasets through Cross-Task Unification and Semi-Supervised Annotation cs.CV | cs.LGPDF

[59] Complementing DINO Features with Image Structure for Part Discovery cs.CV | cs.AI | cs.LGPDF

[60] OlmoEarth v1.3: Embeddings cs.CVPDF

[61] GeoLEON-CLIP: Graph-Anchored Multimodal Contrastive Learning for Geographic Region Representation cs.CV | cs.LGPDF

[62] Organizing Temporal Evidence in Hyperbolic Space for Video Moment Retrieval cs.CVPDF

[63] DeformStruct: Deformable Structure Modeling for Point-Supervised Temporal Action Localization cs.CVPDF

[64] 4DMemory: Benchmarking Long-Horizon Spatiotemporal Memory with Harness-Augmented Agents cs.CV | cs.AI | cs.CL | cs.MMPDF

[65] Search-Based Testing of Modality Sensitivity in Vision Language Models cs.CV | cs.SEPDF

[66] Past as State, Present as Attention: Persistent-State Blockwise Flow Matching for Long-Horizon Co-Speech Motion Generation cs.CV | cs.GR | cs.MMPDF

[67] UniWorld: A Unified World Model for Real-Time Visual World Simulation cs.CVPDF

[68] An Error Budget for Shuffled Multimodal Windows in the 3rd WEAR Challenge: Stacking, Count Constraints and Seam Matching cs.CVPDF

[69] AlphaAnything: Extending Pretrained RGB Generators to RGBA cs.CVPDF

[70] Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images cs.CV | cs.AI | cs.CLPDF

[71] Tempo-Zero: Recursive Self-Play in Executable Worlds for Video Reasoning cs.CVPDF

[72] PROVE: Probabilistic Visual Grounding via Patch-Level Evidence for Vision-Language Models cs.CV | cs.LGPDF

[73] Learning Fine-Grained Visual Classification with Text as Privileged Information via Multimodal Distillation cs.CVPDF

[74] MDMR-Bench: A Multi-Dimensional Benchmark for Multi-Reference Image Generation cs.CVPDF

[75] PathJev: Decision-Native Vision-Language Modelling for Histopathology cs.CV | cs.LGPDF

[76] PCFBench: How Far Can Large Vision-Language Models Go in Physics-aware Photonic Inverse Design? cs.CVPDF

[77] Efficient Zero-Shot Video Anomaly Detection via Signal-Aware Adaptive Fusion (SAAF) cs.CV | cs.AI | cs.LGPDF