cs.CL [Total: 49]
cs.CV [Total: 203]
physics.optics [Total: 1]
cs.AI [Total: 17]
cs.MM [Total: 1]
cs.SD [Total: 3]
cs.HC [Total: 3]
cs.IR [Total: 1]
cs.RO [Total: 5]
cs.CY [Total: 1]
cs.PF [Total: 1]
cs.LG [Total: 17]
cs.CE [Total: 1]

cs.CL [Back]

[1] CrisisKD: Five-Stage Knowledge Distillation for Aspect-Level Sentiment and Emotion Analysis in Crisis Discourse cs.CLPDF

Marko Haralović, Onat Akca, Salih Eren Yücetürk, Minsi Li, Mariët Theune

TL;DR: 本文提出了CrisisKD，一个五阶段知识蒸馏框架，用于在危机相关社交媒体数据上进行方面级情感和情绪分析。该方法利用大型语言模型（教师）为未标注数据生成方面级标签和推理轨迹，以监督一个更小的学生模型，并构建了一个包含超过5万个标签的数据集。最终的学生模型能以更低的推理成本支持端到端的方面级情感分析和情绪检测。

Details

Motivation: 在危机（尤其是健康相关）情境下，识别情感词或短语的目标对象对于理解跨文化和语言背景的公众关切至关重要，但缺乏标注数据。本文旨在开发一个框架，利用LLM的推理能力，为未标注的社交媒体数据生成监督信号，以训练更高效的学生模型。

Result: 在手动标注的500条推文黄金测试集上，经过CrisisKD微调的Qwen2.5-7B学生模型在方面提取任务上比未调优模型提升了7.9个F1点，情绪分类准确率提升17.0点，情感分类准确率提升6.5点。在外部ABEA基准测试上，该方法比同模型Qwen2.5-7B的上下文学习基线在ATE任务上提升2.8个F1点，在联合ATE+AEC任务上提升3.8个F1点。

Insight: 创新点在于提出了一个结构化的五阶段知识蒸馏流程，将复杂的方面级情感/情绪分析任务分解为多个子任务（方面提取、句法分析、观点提取、情感分类、情绪分类），并利用教师LLM生成每个阶段的推理轨迹进行监督。这为在资源有限领域（如危机话语）利用LLM生成高质量训练数据并训练高效小模型提供了系统化方案，同时开源了数据集和代码。

Abstract: Identifying the target of emotional words or phrases in crisis situations, especially health-related ones, is important for understanding public concerns across cultural and linguistic contexts. We propose CrisisKD, a five-stage teacher–student knowledge distillation framework for aspect-level sentiment and emotion analysis on unannotated social media data. A teacher LLM generates aspect-level labels and reasoning traces that supervise a smaller student model across aspect extraction, syntactic parsing, opinion extraction, sentiment classification, and emotion classification. Using this framework, we construct and release a dataset containing 50,615 aspect-level labels, together with the annotation and fine-tuning scripts as open-source resources. The resulting student supports end-to-end ABSA and emotion detection at substantially lower inference cost than the teacher. On a manually annotated 500-tweet gold set, the 5-task Qwen2.5-7B student improves over the untuned model by 7.9 F1 points on aspect extraction, 17.0 points on emotion accuracy, and 6.5 points on sentiment accuracy. On the external ABEA benchmark, CrisisKD improves the same-model Qwen2.5-7B ICL baseline by 2.8 F1 points on ATE and 3.8 F1 points on joint ATE+AEC.

[2] Recall Is Not Protection: Evaluating Safety Monitors Against Model Compliance cs.CLPDF

Sripad Karne

TL;DR: 本文指出当前安全监控器（safety monitors）在评估时仅依赖对有害提示的召回率（recall）存在缺陷，因为只有当语言模型实际会响应（comply）有害请求时，监控器的拦截才真正起到防护作用。作者通过实验直接测量了模型对有害提示的‘可引发性’（elicitable），发现监控器在可引发提示上的召回率显著低于在非可引发提示上的召回率，这意味着标准召回率指标可能高估了监控器在实际部署中的保护效果。

Details

Motivation: 现有安全监控器的评估主要关注其对有害提示的召回率，但忽略了只有当目标语言模型实际会遵从（comply）有害请求时，拦截才有效。因此，需要一种更准确的评估方法，直接衡量监控器在模型真正会响应的有害提示上的防护能力。

Result: 在六个监控器配置和三个模型系列（包括激活探针、微调文本守卫和一个120B参数的政策条件推理分类器）上的实验表明，在固定误报率下，监控器对可引发提示的召回率比对非可引发提示的召回率低0.22至0.38。监控器漏报的提示被模型遵从的可能性是已捕获提示的2.8至5.6倍，且这一差距在不同模型系列和完全独立于目标模型的纯文本监控器中也复现了。

Insight: 论文的创新点在于提出了基于‘可引发性’的评估框架，强调安全监控器的评估应针对模型实际会响应的有害提示，而非所有被标记为有害的提示。这揭示了标准召回率指标可能存在的偏差，为未来设计更可靠的安全监控系统提供了重要的评估视角。

Abstract: Safety monitors screen prompts sent to deployed language models, flagging harmful requests so they are never answered. They are evaluated by recall against harmfulness labels, but a catch only prevents harm if the model would otherwise have complied. We measure the difference directly: we sample repeated responses from the target model, call a harmful prompt \emph{elicitable} if the model complies at least once, and report monitor recall separately on elicitable and non-elicitable prompts. Across six monitor configurations and three model families, spanning activation probes, fine-tuned text guards, and a 120B policy-conditioned reasoning classifier, recall on elicitable prompts falls 0.22 to 0.38 below recall on non-elicitable prompts at a fixed false positive rate. The prompts a monitor misses are 2.8 to 5.6 times more likely to be complied with than the prompts it catches. The gap replicates across three model families and appears also in text-only monitors entirely independent of the target model. This suggests that standard recall may overstate the protection monitors provide in practice, and that monitors should be evaluated against what their models will actually answer.

[3] CONDUIT: A Unified Residual-Stream Restoration Framework for KV Cache Reuse in Vision-Language Models cs.CL | cs.CVPDF

Pengan Chen, Kaisheng Zheng, Liang Hong, Lixia Yi, Jiyue Jiang

TL;DR: 本文提出了CONDUIT，一种无需训练的KV缓存刷新策略，用于视觉语言模型中视觉前缀的复用。它将单图和多图复用统一为残差流恢复框架，通过基于范数加权的注意力机制和图像级相关性放大来选择性地刷新缓存中的视觉令牌，从而在有限的刷新预算下高效复用KV缓存。

Details

Motivation: 视觉语言模型在处理重复出现的视觉内容时，复用KV缓存可以避免昂贵的视觉前缀重新编码，但精确前缀复用在视觉前缀发生变化时会失效，而现有的选择性重计算方法在有限的视觉令牌预算下，其刷新策略可能效率低下。

Result: 在10%的刷新预算下，CONDUIT在三个VLM骨干模型和五个数据集上平均达到了对应完全预填充性能的97.0-99.5%，并在预算方法中领先；在MMLongBench-Doc延迟子集上，它仅使用了完全预填充13.5%的FLOPs，并实现了2.99倍的首令牌生成时间加速。

Insight: 创新点在于将单图和多图KV缓存复用统一为残差流恢复问题，并提出了一个结合缓存键查询注意力和预输出缓存值范数代理的、无需训练的令牌排序与选择策略，同时引入了图像级相关性放大机制以提升多图场景下的选择效率，该方法无需修改模型架构或权重，仅在推理时增加一次查询条件评分。

Abstract: Vision-language models (VLMs) often answer new questions about recurring visual content, where reusing the key-value (KV) cache can avoid re-encoding expensive visual prefixes. Exact-prefix reuse, however, fails when the same visual content appears under a changed prefix. Selective recomputation can recover quality under a small visual-token budget, but only when the right stale tokens are refreshed. Raw-attention selection can waste budget on high-attention tokens with small value-norm proxy scores and on query-irrelevant images. To address these failure modes, we propose CONDUIT, a training-free refresh policy that unifies single- and multi-image reuse as residual-stream restoration. Building on norm-weighted attention, CONDUIT ranks cached visual tokens using cached-key query attention and an accessible pre-output cached-value-norm proxy, then applies empirical image-level relevance amplification before one global selection. With one image, the coefficient is one and the rule reduces to intra-image token selection. The method preserves model architecture and weights, adding only a single query-conditioned scoring pass at inference. At a 10% refresh budget, CONDUIT achieves 97.0-99.5% of the corresponding full-prefill five-dataset average across three VLM backbones and leads budgeted methods on average; on the MMLongBench-Doc latency subset, it uses 13.5% of full-prefill FLOPs and achieves a 2.99x time-to-first-token speedup.

[4] SinoGlyphBench: A Diagnostic Benchmark for Chinese Glyph-Level Obfuscation in Language-Model Moderation cs.CLPDF

Yifan Wang, Zimu Wang, Suliu Qin, Changyu Zeng, Tong Chen

TL;DR: 该论文提出了SinoGlyphBench，一个用于诊断中文字形混淆对语言模型内容审核影响的基准测试。该基准通过识别关键语义锚点，并创建匹配的原始文本/图像输入及其字形混淆版本，来区分与审核相关的证据损坏和一般表面变化。在12个LLM和MLLM模型上的大规模评估表明，字形混淆显著增加了有害内容的误判率。

Details

Motivation: 解决中文字形混淆（如使用异体字、形近字）可能绕过自动化内容审核系统，使有害内容对人类可读但对模型不可读或误判的问题。

Result: 在176,916对评估中，字形混淆使有害内容的假阴性率和假阳性率分别增加了6.1和4.7个百分点，四向准确率降低了5.0点。模型在匹配原始输入上正确的决策中保留了75.7%。全范围扰动导致最大性能下降，锚点扰动比背景扰动更具破坏性，跨文字替换在文本模态中尤其困难。

Insight: 创新点在于构建了一个诊断性的基准，能够系统性地分离和评估字形混淆对内容审核关键证据的影响。其通过扰动语义锚点和背景的设计，为理解模型在字形层面的脆弱性提供了可解释的分析框架，揭示了模型在可见形式读取、意图信息恢复和最终安全判断环节的失配现象。

Abstract: Glyph-level obfuscation can leave harmful Chinese content readable to humans while degrading automated moderation. We introduce SinoGlyphBench, a diagnostic benchmark that identifies label-critical semantic anchors and creates matched original and glyph-obfuscated inputs in text and image modalities. By perturbing anchors, background context, or both, this design distinguishes corruption of moderation-relevant evidence from general surface variation. Across 176,916 paired evaluations of 12 LLMs and MLLMs, obfuscation increases harmful false-negative and false-positive rates by 6.1 and 4.7 percentage points, respectively, and reduces four-way accuracy by 5.0 points. Models retain 75.7% of the decisions that were correct on the matched original inputs. Full-scope perturbations cause the largest degradation, anchor-only perturbations are more damaging than background-only perturbations, and cross-script substitution is particularly difficult in the text modality. Analysis of structured outputs identifies observable mismatches in visible-form reading, intended-message recovery, and final safety judgment. The evaluated models, therefore, remain brittle to Chinese content written with non-canonical glyphs. Resources are available at https://github.com/fengshun124/SinoGlyphBench.

[5] UniRRM: Unified Reasoning Reward Models Across Languages and Evaluation Paradigms cs.CL | cs.AIPDF

Peng Lai, Yichao Du, Junchao Wu, Weibo Gao, Linan Yue

TL;DR: 本文提出了UniRRM，一个支持多语言和多种评估范式的统一推理奖励模型，旨在解决开放任务中奖励模型可靠性不足的问题。模型通过分阶段推理链动态生成任务通用和指令特定的评估标准，实现细粒度、输入自适应的判断，并在多语言间保持一致性。

Details

Motivation: 现有奖励模型要么依赖昂贵的专有LLM-as-a-Judge系统，要么使用缺乏可解释性的不透明标量奖励模型，且受限于静态评估标准、碎片化的评估范式以及有限的多语言支持。

Result: 实验表明，UniRRM-8B和UniRRM-14B在多个基准测试中达到了与同类规模模型相当的最先进水平，并能有效处理未见过的评估范式。消融研究验证了其可靠性和有效性。

Insight: 创新点包括引入大规模多语言数据集MixReward，以及提出基于推理链的动态标准生成机制，这增强了奖励模型的适应性、可解释性和跨语言一致性，为开放任务奖励建模提供了新思路。

Abstract: Reinforcement learning (RL) excels on tasks with verifiable rewards, but in open-ended tasks, the reliability of reward models remains a key challenge. Existing solutions either depend on costly proprietary LLM-as-a-Judge systems or opaque scalar reward models that lack interpretability. Recent works on generative reward models offer a promising alternative, but they remain constrained by static evaluation criteria, fragmented evaluation paradigms, and limited multilingual support. To address these challenges, we introduce \textbf{MixReward}, a large-scale multilingual dataset spanning six domains and 103 languages, containing both pairwise and listwise data, and propose \textbf{UniRRM}, a unified reasoning reward model supporting multiple languages and evaluation paradigms. UniRRM uses a staged reasoning chain to dynamically generate task-generic and instruction-specific criteria, enabling fine-grained, input-adaptive judgments while maintaining consistency across languages. Experiments demonstrate that UniRRM-8B and UniRRM-14B achieve performance close to the state-of-the-art for models of comparable size across multiple benchmarks, and are effective for unseen evaluation paradigms. In addition, ablation studies validate the reliability and effectiveness of UniRRM.

[6] SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation cs.CL | cs.DL | cs.IRPDF

Tong Bao, Mir Tafseer Nayeem, Yi Zhao, Davood Rafiei, Chengzhi Zhang

TL;DR: 本文提出了SurveyAgent-HKA，一个用于自动生成科学综述的多智能体框架。该框架通过结合已发表综述和同行评审评论中的知识，将综述生成分解为多个子任务，由LLM驱动的智能体处理，以改善端到端的生成质量。

Details

Motivation: 现有的自动科学综述生成方法通常从单一来源检索文献并通过单次LLM调用生成，这导致参考文献覆盖有限，且无法模拟专家驱动的修订过程，而该过程对撰写高质量综述至关重要。

Result: 在两个领域的实验表明，该方法在引用质量、结构一致性和内容质量方面优于主流基线方法。

Insight: 创新点在于提出了一个结合人类知识增强（来自已发表综述和同行评审评论）的多智能体框架，将综述生成流程分解并优化，模仿了专家写作的迭代修订过程，同时在时间和成本上高效，具有实际应用潜力。

Abstract: Automatic scientific survey generation has become an important task in scientific document processing. The common approach of retrieving literature from a single source (e.g., arXiv) and generating surveys through a one-pass large language model (LLM) call often leads to limited reference coverage and, more importantly, fails to replicate the expert-driven revision process that is crucial for writing high-quality surveys. In this paper, we introduce SurveyAgent-HKA, a multi-agent framework that improves end-to-end scientific survey generation by incorporating knowledge derived from published surveys and peer-review comments. The framework decomposes survey generation into well-defined sub-tasks handled by LLM-powered agent. It first retrieves relevant papers from multiple sources and identifies key topics through clustering to construct an initial outline, which is then refined using outlines from related human-written surveys. Based on the refined outline, topic-focused papers are retrieved and re-ranked to select for drafting a well-grounded survey. Then, we identify common issues raised by experts in peer-review comments from published surveys to guide the revisions and finalize the survey. Experiments on two domains show that our approach outperforms mainstream baselines in citation quality, structural consistency, and content quality. Furthermore, our framework is efficient in both time and cost, making it a practical solution for broader AI-assisted scientific writing applications.

[7] Solving versus Verifying: Catching Contradictions in Tax Reasoning Systems cs.CL | cs.AIPDF

Albert Sadowski, Jarosław A. Chudziak

TL;DR: 本文研究了大型语言模型在税务推理任务中对输入缺陷（如缺失事实或矛盾事实）的处理能力。研究发现，尽管模型在标准基准上表现优异，但在面对矛盾输入时仍会自信地给出答案，而通过引入验证步骤（即让模型检查输入一致性）可以显著提高缺陷检测能力，且成本较低。

Details

Motivation: 动机在于评估大型语言模型在真实法律场景中的可靠性，因为实际输入常存在缺陷（如缺失或矛盾事实），而模型在标准基准上的高准确率无法反映其在此类情况下的行为。

Result: 在SARA衍生的税务案例测试中，最强模型在缺失事实时会弃权，但对矛盾事实仍会计算（63-76%的情况返回干净输入答案）；通过添加验证步骤，模型能检测大部分矛盾，且仅牺牲约5个百分点的干净输入准确率。

Insight: 创新点在于提出通过自我验证（即让同一模型检查输入一致性）来廉价恢复模型错过的矛盾检测，这揭示了高准确率基准的局限性，并为构建更可靠的系统提供了简单有效的方法。

Abstract: Large language models now compute correct tax liabilities on over 90% of well-formed cases in statutory benchmarks, which makes them candidates for the tax-advisory and compliance systems that consume such an answer directly. Real legal inputs, however, are frequently defective: required facts are missing, or stated facts contradict one another. Accuracy on clean benchmarks says nothing about how a model behaves then, and a system that computes straight through a defective input returns a confident number with no sign that anything is wrong. This raises two questions: does a model asked to solve a case abstain when the input is defective, and when it does not, can the same model catch the defect when asked instead to verify the input? We study six recent models on SARA-derived tax cases under missing-fact and contradictory-fact perturbations. The strongest models abstain when a fact is missing but compute through injected contradictions, returning the clean-input answer 63-76% of the time with no signal of the conflict; asked instead to verify the same input, they flag most of those contradictions. We wire that verification call into a simple contradiction gate: one extra call that abstains when the model reports a conflict. Across all six models it recovers most of the missed contradiction abstention at a clean-accuracy cost of at most about 5 percentage points, with no training and no external tooling. High accuracy on well-formed inputs is therefore an incomplete measure of reliability, and the detection the solver misses is cheaply recoverable with a single self-check.

[8] ModularPhaseNet: Finite-Cyclic Phase Geometry for Computable Semantic Hierarchy, Direction, and Context Consistency in Standard Transformers cs.CL | cs.LGPDF

Kiyotaka Kasubuchi, Kazuo Fukiya

TL;DR: 本文提出了ModularPhaseNet，一种基于有限循环群离散化的Transformer扩展方法，将连续复数相位几何转化为整数可计算的模块化表示。该方法在标准Transformer中引入三个新组件：有限相位编码器、商过滤层次模块和群值连接模块，通过模运算实现语义层次、方向和上下文一致性的结构化建模。

Details

Motivation: 旨在将QuantumPhaseNet中的连续复数相位几何离散化为经典可计算形式，避免量子硬件依赖和复数矩阵运算，同时保留Transformer的实值隐藏状态，仅通过辅助相位通道的有限循环群量化实现结构化语义表示。

Result: 论文未报告具体实验结果，仅提供了理论分析和预注册评估计划，计划在层次恢复、语篇对齐、矛盾检测和幻觉风险预测等任务上进行验证。

Insight: 创新点包括：1）利用有限循环群的模运算实现相位操作的整数可计算离散化；2）通过商过滤诱导的概念层次和群元素方向性编码语义结构；3）基于规范不变循环和乐的可解释上下文一致性度量机制。

Abstract: We propose ModularPhaseNet, a classical and integer-computable discretization of the continuous complex phase geometry introduced in QuantumPhaseNet. The real-valued hidden states of a standard Transformer are retained, while only an auxiliary phase channel is quantized into a cyclic subgroup G = of order q | (p-1) in the multiplicative group of F_p. A continuous phase e^{i phi} is represented by z = g^a mod p; phase composition becomes group multiplication, relative phase becomes group division, conceptual hierarchy is induced by a filtration of cyclic quotients, semantic direction is represented by oriented relative group elements, and contextual consistency is measured by gauge-invariant cycle holonomy. The method introduces three components into an otherwise standard Transformer: a finite-phase encoder, a quotient-filtration hierarchy module, and a group-valued connection module. Their outputs enter self-attention as real-valued bias terms. Training uses distributions in the real group algebra or straight-through Gumbel-Softmax, whereas inference uses exact modular exponentiation and precomputed tables. No quantum hardware, complex-valued matrix multiplication, or discrete-logarithm computation is required. We prove quantization-distortion bounds, nesting of quotient-induced partitions, gauge invariance, a discrete integrability result for flat connections, and boundedness of the resulting attention output. The central empirical hypothesis is that these exact discrete invariants improve hierarchy recovery, discourse alignment, contradiction detection, and calibrated hallucination-risk prediction under a controlled compute budget. This paper reports the theory together with a pre-registered evaluation plan; the experiments described in Section 14 have not yet been carried out, and no empirical result is claimed here.

Yen-Ting Piao, Shu-Yun Chen, Chin-Hui Chu, Chun-Wei Chen, Shih-Yun Shan Kuan

TL;DR: 本文提出了Tri-PvP基准，用于评估全模态大语言模型在视觉、音频和文本模态冲突下的偏见。研究发现模型普遍存在视觉偏见，且在证据形式上存在不对称性：模型更偏向视觉的感知信号和音频的命题信号。

Details

Motivation: 现有基准将单一模态内的感知信号和命题信号混为一谈，导致测得的模态偏见与证据形式偏见相互混淆，无法清晰归因。

Result: 在Tri-PvP基准上评估五个OLLM，发现大多数模型存在稳健的视觉偏见，并揭示了证据形式偏见的系统性不对称。通过分层线性探测和对比解码分析，发现模态偏见在早期表示层已可线性解码且难以完全缓解。

Insight: 创新点在于设计了能分离感知与命题证据的跨模态冲突基准，揭示了OLLM中先前未被探索的证据形式不对称偏见，并指出仅靠表层干预难以缓解此类偏见。

Abstract: Omni-modal large language models (OLLMs) jointly process vision, audio, and text, yet their modality bias under cross-modal conflict remains underexplored. Existing benchmarks conflate two distinct forms of evidence within a single modality: perceptual signals (e.g., a photograph or recording of a dog) and propositional signals (e.g., the declarative claim “this is a dog”), such that any measured modality bias is inherently confounded with evidence-form bias, precluding clean attribution to either source. To address this, we introduce Tri-PvP, an 8,000-sample tri-modal conflict benchmark crossing vision, audio, and text, where vision and audio each take perceptual or propositional form. Evaluating five OLLMs, we find robust visual bias across most models and evidence-type conditions. Crucially, we reveal a systematic asymmetry in evidence-form bias: models exhibit a stronger bias toward perceptual signal in vision but propositional in audio. Further analyses via layer-wise linear probing and contrastive decoding reveal that modality bias is already linearly decodable from early representation layers and can only be partially mitigated, calling for mitigation strategies beyond surface-level interventions.

[10] Generating Adversarial Texts for Machine Translation via GRPO cs.CLPDF

Florian Zogaj, Jakob Hütteneder, Giovanni De Muri, Federico Villa, Aryan Sood

TL;DR: 本文提出了一种基于强化学习（GRPO）的可扩展方法，用于重写现有源文本，生成对机器翻译系统更具挑战性的对抗性文本。该方法通过微调大语言模型，结合翻译难度、语义相似性、语法性和长度保持等奖励信号，在WMT25基准上显著降低了翻译质量（COMET分数从0.63降至0.48），同时保持了可读性，并在未见过的WMT19-WMT24基准上验证了泛化能力。

Details

Motivation: 随着机器翻译系统的进步，标准基准在暴露其剩余弱点方面变得不够有效；传统方法依赖昂贵的人工创建或筛选，而自动化方法难以生成兼具翻译难度和语言多样性的测试集。

Result: 在WMT25基准上，该方法将平均COMET翻译质量分数从0.63降至0.48，而基线模型保持在0.64；在未见过的WMT19-WMT24基准上验证了泛化性，人类评估也证实翻译质量显著下降，同时自然度适度降低、语法性变化很小。

Insight: 创新点在于使用Group Relative Policy Optimization（GRPO）微调大语言模型，以翻译难度为核心奖励，结合语义、语法和长度约束，自动化生成对抗性文本；这为评估机器翻译系统弱点提供了一种可扩展且高效的自动化方法。

Abstract: As machine translation (MT) systems continue to improve, standard benchmarks become less informative for exposing remaining weaknesses. Traditional methods for creating challenging test sets rely on expensive manual creation or curation, while automated approaches struggle to produce sets with the necessary translation difficulty and linguistic diversity. We propose a scalable reinforcement-learning-based approach for rewriting existing source texts into instances that are more difficult to translate for MT systems. We fine-tune a large language model with Group Relative Policy Optimization (GRPO), using reward signals based on translation difficulty together with constraints for semantic similarity, grammaticality, and approximate length preservation. On WMT25, our approach substantially reduces average COMET translation quality from 0.63 to 0.48, while preserving grammaticality and readability, whereas the base model remains at 0.64. Evaluations on the unseen WMT19-WMT24 benchmarks confirm that this behavior generalizes beyond the training data, and human evaluation further shows that the rewrites substantially lower translation quality while incurring a moderate drop in naturalness and only a small change in grammaticality. We release our code to support reproducibility.

[11] STQA: A Benchmark for Stock-Focused Tabular Question Answering over Historical and Forecasted Data cs.CLPDF

Baoxu An, Wenmian Yang, Zhensheng Wang, Weijia Jia

TL;DR: 本文提出了STQA基准测试，这是一个专注于股票领域的表格问答基准，旨在评估模型对历史数据和预测数据进行复合推理的能力。该基准基于大规模金融数据集构建，包含31,400个专家模板生成的问答对，并提供了细粒度的意图和槽位标注。同时，作者提出了SQFRS系统，一个基于智能体的统一框架，用于协调SQL检索和时间序列预测工具。

Details

Motivation: 现有基准测试在股票市场分析任务上较为碎片化，缺乏对历史记录和未来预测进行复合推理的端到端评估。本文旨在填补这一空白，为可信赖的、工具增强的金融智能体研究提供一个严格的测试平台。

Result: 实验表明，当前的大型语言模型在历史数据查询上表现良好，但在基于预测的推理任务上面临巨大挑战，揭示了在工具协调和不确定性下推理的关键瓶颈。

Insight: 创新点在于构建了一个统一的、面向股票的表格问答基准（STQA），并提出了一个协调检索与预测工具的智能体框架（SQFRS），系统地评估了模型在历史与预测数据上的复合推理能力，为金融AI应用提供了重要的评估工具和研究方向。

Abstract: Stock market analysis inherently requires composite reasoning over historical records and future projections, yet existing benchmarks remain fragmented across isolated tasks. We introduce STQA (Stock-focused Tabular Question Answering), an end-to-end benchmark designed to systematically evaluate natural-language question answering over historical data, numerical forecasts, and forecast-based reasoning. Built on a large-scale financial dataset, STQA covers 4,417 stocks and contains 31,400 question-answer pairs derived from expert-crafted templates, accompanied by fine-grained intent and slot annotations. To operationalize this benchmark, we present SQFRS (Stock Query-Forecast-Reasoning System), an agent-based unified framework that orchestrates SQL retrieval and time-series forecasting tools. Experiments demonstrate that while current large language models perform well on historical queries, forecast-based reasoning poses a substantial challenge, revealing critical bottlenecks in tool coordination and reasoning under uncertainty. The dataset and code are available at https://github.com/xuxubaobaoan/STQA_Project. STQA thus serves as a rigorous testbed for future research on trustworthy, tool-augmented financial agents.

[12] SLATE: Are AI-Generated Slides Educationally Effective? A Benchmark for Language Teaching Quality and Learner Knowledge Acquisition cs.CLPDF

Jingzhuo Wu, Jiajun Zhang, Liu Yi, Leqi Zheng, Yuheng Jing

TL;DR: 本文介绍了SLATE基准，用于评估AI生成语言教学幻灯片的教学效果和知识获取能力。该基准将低资源语言的谜题转化为标准化教学单元，并采用前测后测设计来消除预训练知识泄露。研究发现，内容有效性与学习增益关联较弱，而教学设计关联较强，且前沿模型可能产生负学习增益。

Details

Motivation: 解决AI生成教学幻灯片在视觉美观与实际教学效果之间的不匹配问题，填补现有评估基准的空白。

Result: 在SLATE基准上，使用视觉语言模型作为可扩展学习者代理，结果显示内容有效性与学习增益关联弱，教学设计关联强；多数系统在近迁移和远迁移准确率上存在显著差距，前沿模型可能产生负学习增益。

Insight: 创新点在于首次提出基于教学效果和知识获取的AI生成幻灯片评估基准，揭示了人工制品质量与教学效果之间的分离，呼吁生成教学系统的构建、评估和部署范式转变。

Abstract: LLMs have achieved remarkable capabilities in generating language teaching slides. However, a critical mismatch persists between visual polish and actual instructional effectiveness. To address this gap, we introduce SLATE (Slide-based Learning Assessment for Teaching Effectiveness), the first benchmark that evaluates AI-generated language teaching slides through instructional effectiveness and learner knowledge acquisition. SLATE transforms linguistics olympiad puzzles from low-resource languages with negligible web presence into 90 standardized instructional units comprising 1,133 assessable items, paired with a structured course outline and matched near- and far-transfer test sets. This pretest-posttest design eliminates pretrained knowledge leakage, ensuring gains reflect learning rather than prior recall. Using VLMs as scalable learner proxies and directionally supported by a three-system human pilot, our results show that content validity exhibits a weak association with learning gain, while pedagogical design exhibits a robust positive association. Moreover, most systems show a significant gap between near- and far-transfer accuracy, and even frontier models can produce negative learning gains. SLATE reveals a dissociation between artifact quality and instructional effectiveness, calling for a paradigm shift in how generative teaching systems are built, evaluated, and deployed.

[13] Beyond the Flag: Clinical Framing Closes the Moderation Gap in Suicide Risk Measurement cs.CLPDF

Shreyas Krishnan, Gun Ahn, Jungjin Kim

TL;DR: 本文研究现有内容审核API在评估自杀风险严重程度方面的不足，并提出了基于临床框架的零样本提示方法以缩小评估差距。作者发布了一个由精神科医生标注的自杀风险严重程度基准数据集，并评估了多种方法在七个有序度量上的表现。

Details

Motivation: 现有内容审核API主要用于标记违反政策的内容，无法有效评估临床风险等级，而平台责任要求对不同严重程度的自杀风险采取差异化响应，新兴法规也对此提出了合规要求。

Result: 商业审核API能较好区分低风险与高风险帖子（高风险F1为0.860），但严重程度评估效果差（宏观F1为0.395），且系统性地高估最严重类别；基于临床框架的零样本提示显著提升了评估性能（宏观F1为0.562）。

Insight: 专家设计的提示框架（而非微调、额外推理或简单的多智能体聚合）是提升临床风险等级评估效果的关键；推理过程的价值取决于文本类型，在冗长嘈杂的Reddit帖子上有害，而在简短临床陈述中则有益。

Abstract: Moderation APIs are built to flag policy-violating content, not to measure graded clinical risk. But a platform’s duty does not end at detection: the response owed to passive distress differs sharply from the response owed to active planning with means access, and emerging regulation (e.g., California Senate Bill 243) is turning that distinction into a compliance requirement. We therefore ask how well deployed safety signals recover clinically meaningful severity. We release a benchmark of 516 r/SuicideWatch posts rated by a licensed psychiatrist on a four-level ordinal schema (Indicator, Ideation, Behavior, Attempt) grounded in the Columbia Suicide Severity Rating Scale, and evaluate moderation APIs, prompted LLMs, and supervised baselines under seven ordinal-aware metrics. Three findings. Vendor moderation APIs separate low- from high-severity posts well (0.860 high-risk F1) but measure severity poorly (0.395 macro F1), systematically over-predicting the most severe category. Clinically grounded zero-shot prompting recovers much of that gap (0.562 macro F1), and expert-authored framing (not fine-tuning, added reasoning, or naive multi-agent aggregation) is the effective lever. The value of reasoning depends on register: it hurts on long, noisy Reddit posts and helps on short, clinician-authored statements. We argue graded severity, not a binary flag, is what a proportionate duty of care requires, and release our evaluation framework to support that measurement.

[14] Reliability, validity, and diagnostic evidence for multi-model LLM short-answer scoring cs.CL | cs.CYPDF

Chunyi Zhao, Chao Li

TL;DR: 本研究评估了使用多模型、多轮次OCG-PRES框架指导的大型语言模型（LLMs）在短答案评分任务中的表现。研究使用GPT、DeepSeek和千问模型，在SciEntsBank数据集的996个回答上，从概念覆盖、关系准确性等五个维度进行评分，并与传统非LLM基线方法进行比较。结果表明，多模型重复评分提供了可靠的评分证据，但应作为人类评分的辅助工具而非替代品。

Details

Motivation: 当前LLMs越来越多地被提议或用于教育评分，但单一模型和单次运行的评估无法为实际评估应用提供充分的证据，短答案评分需要关于可靠性、有效性、严格性、诊断价值和失败案例的证据。

Result: 所有模型在重复运行中均表现出高可靠性（ICC(3,k) > .977）。GPT在官方标签对齐上AUC最高（.909），千问模型评分更严格。OCG-PRES评分在AUC和F1分数上均优于所有基于答案长度、Jaccard关键词重叠等传统非LLM基线方法。

Insight: 创新点在于提出了一个多模型、多轮次的评估框架（OCG-PRES），为LLM评分提供了更全面的可靠性、有效性和诊断价值证据。客观来看，该方法强调了基于证据的谨慎使用，将LLM定位为评分支持工具，而非完全自动化替代方案，这在教育评估的实践中具有重要指导意义。

Abstract: Large language models (LLMs) are increasingly used or proposed for educational scoring, but single-model and single-run evaluations provide limited evidence for assessment use. Short-answer scoring requires evidence about reliability, validity, severity, diagnostic value, and failure cases. This study evaluated repeated multi-model OCG-PRES guided LLM scoring for short-answer assessment. The analysis used 996 SciEntsBank responses. GPT, DeepSeek, and Qianwen each scored every response across three independent runs using five OCG-PRES dimensions: concept coverage, relation accuracy, reasoning completeness, contradiction control, and domain relevance. Scores were evaluated against official binary and five-category labels and compared with non-LLM baselines based on answer length, Jaccard keyword overlap, TF-IDF cosine similarity, and a combined traditional logistic model. Repeated-run reliability was high for all models, with ICC(3,k) = .977 for GPT, .992 for DeepSeek, and .981 for Qianwen. DeepSeek was the most stable across runs. GPT showed the strongest official-label alignment by AUC (.909), while Qianwen was stricter, with higher precision but lower recall under the fixed threshold = 3.0 rule. OCG-PRES scores followed expected diagnostic patterns across five official categories and outperformed all non-LLM baselines in AUC and F1. Repeated multi-model OCG-PRES scoring provides reliability, validity, and diagnostic evidence for LLM-assisted short-answer scoring. The findings support cautious, evidence-based use as a scoring support tool rather than a replacement for human judgement.

[15] Visual Search Augmented Chain-of-Thought Reasoning for Attribute Value Extraction from Product Videos cs.CL | cs.CVPDF

Tong Wu, Ming Cheng, Jiazhen Hu, Jiaying Gong, Hoda Eldardiry

TL;DR: 本文提出了一种名为视觉搜索增强思维链推理（ViS-CoT）的训练无关、即插即用框架，用于从电商产品视频中提取属性值。该方法通过视觉聚类选取关键帧，利用视觉搜索获取相似产品知识以丰富属性线索，并结合交替思维链推理模块迭代优化预测，最终实现细粒度属性值提取。

Details

Motivation: 现有基于静态图像的属性值提取方法无法捕捉视频中的时序线索、多角度视图和细粒度细节；而直接应用视频视觉语言模型因缺乏领域知识导致性能有限，且微调需要大量高质量数据和计算资源。

Result: 在VideoAVE数据集的14个产品类别上进行广泛实验，ViS-CoT持续提升了多个最先进的视频视觉语言模型的性能，平均在micro-F1指标上提升了17.91个百分点。

Insight: 创新点在于提出了一种无需训练、可即插即用增强现有视频视觉语言模型的框架，通过视觉搜索引入外部产品知识，并结合思维链推理进行迭代优化，有效解决了视频属性值提取中领域知识缺乏和细粒度信息捕捉的挑战。

Abstract: Existing approaches to visual attribute value extraction (AVE) primarily rely on static product images, failing to capture temporal cues, multi-angle views and fine-grained visual details. Directly applying video vision-language models (VLMs) to product AVE results in limited performance due to the lack of domain knowledge, and fine-tuning them requires extensive high-quality data and substantial computational resources. Thus, we propose visual search augmented chain-of-thought reasoning (ViS-CoT), a training-free, plug-and-play pipeline that can be easily applied to any open-source video VLM for video-to-text AVE in e-Commerce. Specifically, ViS-CoT employs visual clustering to identify representative frames, followed by visual search to retrieve semantically similar product knowledge that can enrich attribute cues. Next, an interleaved CoT reasoning module iteratively refines reasoning through visually-aligned auxiliary texts derived from captioning and automatic speech recognition. Finally, the integrated information guides the model toward accurate and fine-grained attribute predictions. Extensive experiments across 14 product categories on the VideoAVE dataset show that ViS-CoT consistently enhances multiple state-of-the-art video VLMs, achieving an average improvement of 17.91 percentage points in micro-F1.

[16] InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization cs.CL | cs.HCPDF

Hanya Sun, Chen Zhang, Sheng Liang, Yongyue Zhang, Yong Liu

TL;DR: 本文提出了InsightChain，一个模拟专家分析工作流的四阶段可视化提示管道（探索-聚焦-测试-呈现），以及VG-COPRO，一种适应于联合优化此类多阶段可执行管道的视觉引导自动提示优化方法。为了解决复杂数据可视化的评估差距，引入了结合四个文本维度和一个视觉维度的洞察进展度量（IPM）。在公共数据集上的实验表明，InsightChain持续优于竞争性提示基线，而VG-COPRO在领域内和跨领域设置中均能提升性能。

Details

Motivation: 现有LLM驱动的自动化数据可视化方法通常将可视化生成视为从用户查询到图表或代码的单步映射，忽视了专家分析师的迭代分析推理过程。

Result: 在公共数据集上的实验表明，InsightChain持续优于竞争性提示基线。现有的自动提示优化方法在此多阶段任务上未能产生一致的增益，而VG-COPRO在领域内和跨领域设置中均能提升性能。评估通过100条链的人工试点和扩展的300条链基于代理的评估进行，覆盖所有十个领域。

Insight: 创新点在于提出了一个模拟专家迭代分析工作流的四阶段提示管道，以及一个专门为优化此类多阶段、可执行管道而设计的视觉引导自动提示优化方法。同时，引入了结合文本和视觉维度的新评估度量（IPM）来解决复杂可视化任务的评估挑战。

Abstract: Large language models (LLMs) are increasingly used for automated data visualization, yet existing approaches often frame visualization generation as a single-step mapping from user query to figure or code, overlooking the iterative analytical reasoning process of expert analysts. We present InsightChain, a four-stage visualization prompting pipeline (Explore–Focus–Test–Present) that emulates expert analytical workflows, together with VG-COPRO, a vision-guided automatic prompt optimization (APO) method adapted to jointly optimize such multi-stage, executable pipelines. To address the evaluation gap for complex data visualization, we introduce the Insight Progression Metric (IPM), a rubric combining four text-based dimensions with a vision-based dimension. We assess IPM through a 100-chain human pilot and an expanded 300-chain agent-based evaluation spanning all ten domains. Experiments on public datasets show that InsightChain consistently outperforms competing prompting baselines. Existing APO methods fail to yield consistent gains on this multi-stage task, whereas VG-COPRO improves performance in both in-domain and cross-domain settings.

[17] ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics cs.CL | cs.AI | cs.CVPDF

Chin Ting Hsu, Yu-Syuan Xu, Ling Zou, Hsien-Kai Kuo, Wen-Huang Cheng

TL;DR: 本文提出ECOKV，一种几何感知的KV缓存淘汰方法，通过结合欧氏距离和余弦相似度来互补地度量token多样性，并自适应地权衡多样性与重要性分数，从而在多种压缩比下实现最先进的性能。

Details

Motivation: 现有KV缓存淘汰方法使用余弦相似度度量多样性，但归一化会丢失幅度信息，且由于隐藏表示的异向性，各层相似度值往往均匀偏高，限制了缓存效率。

Result: 在多种压缩比下，ECOKV达到了最先进的性能，并能与现有KV缓存淘汰方法无缝集成。

Insight: 创新点在于提出几何感知的复合度量，联合利用欧氏距离和余弦相似度从互补视角捕捉token多样性，并通过估计注意力头冗余度自适应调整多样性与重要性权重，同时减少观察窗口以分配更多缓存容量给信息丰富的token。

Abstract: Although multimodal Large Language Models (MLLMs) excel in diverse tasks, their scalability remains limited by the memory and computational overhead of KV cache storage. Recent KV cache eviction approaches incorporate a cosine similarity-based diversity metric with importance metrics to selectively retain critical key-value pairs. However, cosine similarity involves normalization that discards magnitude information, and it often yields uniformly high similarity values across layers due to the anisotropy property of hidden representations. In our study ECOKV, we rigorously deconstruct the capabilities of existing diversity metrics. Moving beyond simple measurement, we propose a geometry-aware composite metric that jointly leverages Euclidean distance and cosine similarity to capture token diversity from complementary perspectives. Furthermore, we use these two metrics to estimate the redundancy level of each attention head, allowing adaptive weighting between diversity and importance scores during token selection. Finally, we demonstrate that the observation window commonly employed to preserve recent tokens can be substantially reduced, thereby allocating more cache capacity to informative tokens and yielding consistent improvements. Extensive experiments demonstrate that ECOKV achieves state-of-the-art performance under various compression ratios and can be seamlessly integrated with existing KV cache eviction methods. We further analyze the relationship between importance and diversity, and examine redundancy patterns across layers and attention heads.

[18] PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents cs.CLPDF

Kun Li, Zexuan Qiu, Tianhua Zhang, Irwin King, Helen Meng

TL;DR: 论文提出了PARSER，一种用于长上下文LLM智能体的新型并行读取-深度推理架构。该方法通过一组轻量子智能体并行读取整个文档，并由一个主导智能体通过迭代的散射-聚集轮次进行深度推理，从而解耦了读取与推理过程。在从7K到896K令牌的多跳问答任务中，该方法显著优于顺序记忆基线，并大幅降低了推理延迟。

Details

Motivation: 解决顺序记忆智能体在处理长文档时，由于将文档遍历与推理深度耦合而导致的证据位置敏感性和推理延迟随文档长度线性增长的问题。

Result: 在7K至896K令牌的多跳问答任务中，使用4B骨干模型的PARSER平均比最强的顺序记忆基线高出5.7个百分点，在896K令牌时高出12.0个百分点。使用9B骨干模型时，PARSER超越了DeepSeek-V4-Pro 6.3个百分点。同时，推理延迟降低了高达11倍。

Insight: 核心创新在于解耦了读取与推理，通过并行读取和迭代的散射-聚集机制，使主导智能体专注于可学习的深度推理行为，而子智能体保持固定。这种架构设计使其对证据位置、顺序和距离的扰动具有鲁棒性，并显著提升了长上下文处理效率。

Abstract: Sequential memory agents process long documents by reading chunks one after another while maintaining a compact memory state, coupling document traversal to reasoning depth. This coupling introduces sensitivity to evidence placement and ties inference latency linearly to document length. We introduce PARSER, which decouples reading from reasoning. A bank of lightweight subagents each bound to a single chunk read the entire document in parallel, while a lead agent reasons in depth through iterative scatter–gather rounds: at each round it broadcasts a query to all subagents, aggregates the returned evidence, and formulates a deeper follow-up query conditioned on what has been found so far. This decoupled design concentrates all learnable behavior in the lead agent, which is optimized with reinforcement learning, while the subagents remain frozen off-the-shelf models. On multi-hop QA with contexts ranging from 7K to 896K tokens, PARSER with a 4B backbone outperforms the strongest sequential memory baseline by 5.7 points on average and by 12.0 points at 896K tokens. Scaling to a 9B backbone, PARSER surpasses DeepSeek-V4-Pro by 6.3 points. Controlled experiments confirm that PARSER is robust to perturbations in evidence position, order, and distance, conditions that cause large accuracy swings in sequential methods, while reducing inference latency by up to 11x.

[19] CantoneseLLM v2: Reasoning in a Low-Resource Language cs.CLPDF

Tsz Chung Cheng, Chung Shing Cheng, Chaak Ming Lau, Cheuk Hei Chong

TL;DR: 本文介绍了CantoneseLLM v2的开发与发布，这是一个基于Qwen3 8B和30B-A3B架构、专门针对低资源粤语进行推理能力训练的模型系列。研究通过连续预训练、聊天向量合并、监督微调、直接偏好优化和强化学习与向量恢复等多种训练策略，旨在解决粤语书面数据稀缺、缺乏原生推理轨迹语料的问题。最终模型在HKCanto-Eval基准上取得了接近合并检查点的性能，同时恢复了粤语推理行为，并发布了模型检查点、训练环境和相关数据集。

Details

Motivation: 粤语作为广泛使用的口语，其书面数据资源匮乏，缺乏可用于模型训练的大规模原生粤语推理轨迹语料，这限制了粤语大型语言模型的发展。

Result: 在HKCanto-Eval基准上，30B-A3B模型达到了73.16分，与其合并检查点的性能差距在1.20分以内，同时保留了该检查点所缺乏的粤语推理行为。

Insight: 研究揭示了聊天向量合并能传递指令跟随能力但保留捐赠模型的推理语言；有限的粤语推理数据SFT会显著缩短或移除推理轨迹并降低性能；DPO能恢复推理块格式但仅部分恢复性能；而引入粤语和繁体中文脚本作为乘性约束的RLVR训练则实现了语言对齐并恢复了丢失的性能，这对低资源语言模型训练具有借鉴意义。

Abstract: Cantonese is widely spoken but remains low-resource in written data, with no large corpus of native Cantonese reasoning traces available for model training. We develop and release CantoneseLLM v2, comprising models based on Qwen3 8B and 30B-A3B. The models are trained through CPT on 784 million Cantonese and Hong Kong-related tokens, chat-vector merging, SFT, DPO, and RLVR. Evaluation across the training stages shows that chat-vector merging transfers instruction following but preserves the donor model’s reasoning language, while SFT with limited Cantonese reasoning data substantially shortens or removes reasoning traces and reduces benchmark performance. DPO restores the reasoning-block format, particularly for the 8B model, but recovers only part of the lost performance. The RLVR training with Cantonese language and Traditional Chinese scripts as multiplicative constraints introduced Cantonese language alignment and restored the lost performance. The 30B-A3B model reaches 73.16 on HKCanto-Eval, within 1.20 points of its merged checkpoint, while retaining the Cantonese reasoning behaviour absent from that checkpoint. We release the model checkpoints, the training environments, and a thirteen-year Traditional Chinese Common Crawl dataset. The models can be accessed at https://huggingface.co/collections/hon9kon9ize/cantonesellm-v20

[20] Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning cs.CL | cs.AIPDF

Seungmin Oh, Donggeon Lee, Jongbin Ryu

TL;DR: 本文提出了一种名为OverRep的过完备重参数化框架，用于解决大语言模型结构化剪枝中恢复阶段的容量-知识不对称瓶颈。该框架遵循“训练过完备，部署紧凑”的原则，在训练时临时过参数化恢复模块以吸收从原始模型蒸馏的复杂知识，训练后通过代数合并将过完备参数化为数学等价的紧凑模块，从而在不增加推理开销的情况下提升剪枝模型的性能。

Details

Motivation: 大语言模型部署成本高昂，结构化剪枝虽能降低成本，但其恢复阶段常因恢复模块的表征能力与所移除知识的复杂性不匹配（即容量-知识不对称）而受限，导致性能恢复不足。

Result: 在三种骨干模型家族上，OverRep在25%和50%剪枝率下，相比强基线方法分别将保留的推理性能提升了最高5.5和8.4个百分点，同时保持了与现有恢复方法相当的内存使用和TFLOPs计算量。

Insight: 核心创新在于“训练过完备，部署紧凑”的重参数化策略，通过训练时过参数化提升知识吸收能力，部署时代数合并保持推理效率；同时引入退火激活函数，使非线性训练动态最终收敛至线性区域，以实现精确的代数合并，这为结构化剪枝的恢复阶段提供了一种高效的能力扩展方案。

Abstract: Large language models achieve strong performance across diverse tasks, but deployment remains costly because of memory, latency, and energy demands. Structured pruning reduces these costs by removing architectural components, yet its recovery stage is often limited by a mismatch between the recovery module’s representational capacity and the complexity of the removed knowledge. We call this bottleneck the capacity-knowledge asymmetry and propose OverRep, an Overcomplete Reparameterization framework for structured LLM pruning. Following the principle of “train overcomplete, deploy compact”, OverRep temporarily overparameterizes the recovery module during training to absorb complex knowledge distilled from the original model. After recovery, the overcomplete re-parameterization is algebraically merged into a mathematically equivalent compact module, preserving the pruned model’s inference-time architecture and computational cost. OverRep further introduces an annealed activation that enables nonlinear training dynamics while converging to a linear regime for exact algebraic merging. Across three backbone families, OverRep improves retained reasoning performance over strong recovery baselines by up to 5.5 and 8.4 points at 25% and 50% pruning, respectively, while keeping memory usage and TFLOPs comparable to existing recovery methods. Our code is available at https://github.com/mmai-laboratory/OverRep.

[21] Aha-Flow Distillation: Flow Markers Matter in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

Xiaodong Wang, Peixi Peng

TL;DR: 该论文提出了Aha-Flow蒸馏（AFD）方法，通过识别大语言模型推理中的两种模式——持续确认的‘流时刻’（Flow Moment）和修正回溯的‘顿悟时刻’（Aha Moment），并分别构建其对应的语言标记（Flow Markers和Aha Markers）。核心方法包括构建Flow-CoT作为辅助监督，并扩展出一种双模式的自蒸馏框架，在训练时分别使用基于简洁解法的Aha分支和基于改写推理链的Flow分支进行监督，而在推理时仅使用标准指令。

Details

Motivation: 动机在于识别并利用大语言模型推理过程中两种不同的思维模式（持续确认的Flow Moment和修正回溯的Aha Moment）及其语言表达，以改进模型的推理能力，解决如何更有效地利用推理过程本身作为训练信号的问题。

Result: 在AIME25和HMMT25基准测试上，AFD方法在Qwen3-8B和Qwen3-4B模型上均取得了稳定的性能提升。例如，AFD将Qwen3-8B的Avg@12从60.8提升至61.3，将Qwen3-4B的Avg@12从57.5提升至58.6。消融实验表明，双模式训练本身（即使使用相同的推理链组合）也能带来性能增益（从59.5提升至60.1）。

Insight: 创新点在于首次明确区分并定义了推理中的Flow Moment和Aha Moment及其语言标记，并据此构建了Flow-CoT；提出了AFD这一新颖的双模式自蒸馏框架，将异质的推理监督（基于解法的和基于过程确认的）以配对指令的方式组织起来，使Flow风格的推理纯粹作为训练信号，从而在不改变推理时模型行为的前提下提升性能。这为利用模型自身推理过程进行精细化蒸馏提供了新思路。

Abstract: We identify the Flow Moment, a reasoning pattern characterized by sustained, process-confirming verbalizations such as I’m doing, in contrast to the revision- and backtracking-oriented Aha Moment. We refer to their corresponding linguistic expressions as Flow Markers and Aha Markers, respectively. Based on this observation, we construct Flow-CoT by rewriting the discourse markers of original reasoning traces while preserving their underlying reasoning content, and use it as auxiliary supervision for on-policy self-distillation (OPSD). We further propose \textbf{Aha-Flow Distillation (AFD)}, a dual-mode extension of OPSD that pairs different forms of privileged information with corresponding reasoning instructions. The Aha branch retains concise solution-based supervision, while the Flow branch introduces rewritten Flow-CoT under a direct and confident reasoning instruction. At inference time, the model uses only the standard reflective instruction, so Flow-style reasoning serves purely as a training signal. Experiments on AIME25 and HMMT25 show consistent improvements across Qwen3-8B and Qwen3-4B: AFD improves Avg@12 from 60.8 to 61.3 on Qwen3-8B and from 57.5 to 58.6 on Qwen3-4B over our reproduced OPSD baselines. Controlled ablations further show that, with the same Flow-CoT/Aha-CoT composition, dual-mode training improves Avg@12 from 59.5 to 60.1, indicating that the benefit comes not only from introducing heterogeneous reasoning supervision, but also from how it is organized during self-distillation. The code is available at https://github.com/Wang-Xiaodong1899/Aha-Flow-Distillation.

[22] Where to Look and What to Use: Retrieve-Localize-Generate for Long-Term Conversational Memory Question Answering cs.CL | cs.IRPDF

Yifan Wang, Xinkui Lin, Yongxiu Xu, Shen Gao, Ruochen Yang

TL;DR: 本文提出了MemLoc，一个用于长期对话记忆问答的统一检索-定位-生成框架。该框架通过多粒度记忆单元分解、基于熵的粒度选择以及跨会话语义和时间依赖建模，实现从粗到细的检索；利用基于推理的证据定位器进行渐进式精炼，提取相关片段并去噪去冗余；最后使用轻量级位置ID引导大语言模型生成答案，以解决现有方法中证据碎片化和噪声内容导致的‘迷失在中间’问题。

Details

Motivation: 现有检索增强生成方法在长期对话记忆问答中面临两个关键挑战：一是证据碎片化，分散在时间上相隔较远的会话中；二是检索到的会话内容存在噪声，容易引发‘迷失在中间’效应，导致模型无法有效利用关键信息。

Result: 在四个基准测试上的大量实验表明，MemLoc在检索准确率和响应质量方面均达到了最先进水平，同时保持了较高的效率。

Insight: 创新点在于将检索过程分解为多粒度记忆单元并构建内外记忆图进行查询路由，以及引入基于自我反思提示策略优化的推理定位器进行渐进式证据精炼。使用轻量级位置ID作为精确的 grounding 信号来引导LLM，既能缓解‘迷失在中间’效应，又能保持原始上下文的完整性。

Abstract: Retrieval-augmented generation (RAG) enables large language models (LLMs) to answer questions by accessing external knowledge and has been widely adopted for long-term conversational memory question answering. However, existing methods suffer from two key challenges: (1) fragmented evidence scattered across temporally distant sessions, and (2) noisy content within retrieved sessions that triggers the lost-in-the-middle effect. To address these challenges, we propose MemLoc, a unified Retrieve-Localize-Generate framework for long-term conversational memory QA. For retrieval, MemLoc decomposes each session into multi-granularity memory units and performs query routing via an inner-memory graph with entropy-based granularity selection. It further models cross-session semantic and temporal dependencies through a cross-memory graph, enabling coarse-to-fine retrieval of top-K relevant memory candidates. For localization, we introduce a reasoning-based evidence locator trained with Self-reflective Hint Policy Optimization (SHPO), which performs progressive refinement by extracting query-relevant fragments within memory units to suppress noise and reranking across candidates to remove redundancy, producing a compact evidence set with lightweight location IDs. For generation, these IDs act as precise grounding signals that guide the LLM to the correct memory positions, mitigating the lost-in-the-middle effect while preserving original contextual integrity. Extensive experiments on four benchmarks demonstrate that MemLoc achieves state-of-the-art retrieval accuracy and response quality while maintaining efficiency. Our code is available at: https://github.com/Nikol-coder/MemLoc.

[23] Revisiting Complete Reasoning Traces for Post-Training cs.CLPDF

Jaehui Hwang, Sangdoo Yun, Byeongho Heo, Dongyoon Han

TL;DR: 本文探讨了在大型语言模型（LLM）的后训练（如监督微调）中使用完整推理轨迹的有效性。研究发现，完整轨迹带来的收益有限，而部分轨迹即使在严重截断的情况下也依然有效。分析表明，推理轨迹中存在冗余，中间步骤的token对最终推理质量贡献很小。因此，论文主张重新审视完整推理轨迹的使用，并证明使用轨迹端点进行训练也能有效提升模型性能，且适用于基于强化学习或策略蒸馏的后训练方法。

Details

Motivation: 当前，为了提升LLM的推理能力，通常会在后训练阶段使用预先收集的完整推理轨迹。然而，这些轨迹往往很长且包含迂回路径，其有效性尚未被充分探究。本文旨在研究LLM是否真的需要学习完整的推理轨迹。

Result: 通过注意力分析和受控的token移除研究，发现中间token对最终推理质量贡献最小。实验表明，使用部分轨迹（甚至端点）进行训练，与使用完整轨迹相比，能达到相当甚至更好的性能。该方法在基于强化学习或策略蒸馏的后训练中也显示出益处。

Insight: 核心创新点在于挑战了后训练中必须使用完整推理轨迹的常见做法，揭示了推理轨迹中存在冗余。一个重要的洞见是，模型可能仅需轨迹的端点（如问题和答案）就能利用其内部知识推断出缺失的中间步骤，这为更高效的后训练数据收集和利用提供了新思路。

Abstract: Large language models (LLMs) are often post-trained on pre-collected reasoning trajectories to improve their reasoning capability. Such trajectories tend to be long due to complex, interwoven paths, which often include detours on the path toward the answer. However, it has been underexplored whether LLMs indeed benefit from learning complete trajectories in post-training, such as supervised fine-tuning (SFT). Starting from our pilot study, we find that full trajectories provide only limited benefit, while partial trajectories are effective even under heavy truncation. We analyze redundancy in reasoning trajectories through attention-based analyses and controlled token-removal studies, both of which show that intermediate tokens contribute minimally to final reasoning quality. This suggests that avoiding redundant information may allow LLMs to internally infer coherent alternatives by inferring missing steps from their internal knowledge, given known trajectory endpoints. Furthermore, we show that training LLMs using endpoints leads to consistent changes in reasoning behavior, and that it also benefits post-training methods based on reinforcement learning or on-policy distillation, highlighting the need to revisit complete reasoning traces. Code is available at https://github.com/naver-ai/revisiting-trace.

[24] CircuitLens: Reasoning Circuits as Data Selection Signals for Reinforcement Learning with Verifiable Rewards cs.CL | cs.LGPDF

Zhuofan Chen, Ziqian Jiao, Yikai Cui, Zhixin Cai, Jun Bai

TL;DR: 本文提出了一种名为Circuit Reasoning Score（CRS）的数据选择方法，用于可验证奖励的强化学习（RLVR）。CRS通过识别模型中的推理敏感注意力头，在单次前向传播中评估训练问题的价值，而无需奖励标签或环境交互。实验表明，在Qwen2.5-Math-7B模型上，选择推理电路参与度最低的问题进行训练，能在多个数学推理基准上取得优于随机选择的性能提升。

Details

Motivation: 现有RLVR的数据选择方法（如难度过滤、人工筛选、奖励轨迹评分）将问题价值视为固有属性，忽略了学习模型本身的影响。本文旨在开发一种基于模型内部推理电路的数据选择信号，以更有效地识别对训练有益的问题。

Result: 在Qwen2.5-Math-7B模型上，使用CRS选择推理参与度最低的10%问题进行训练，在GSM8K、OlympiadBench和Minerva三个中等难度基准上分别提升了2.0、1.6和2.9个百分点。而参与度最高的问题组提升较小，与中等组无显著差异。该方法在特定条件下有效，但在领域精选池中无效，且在不同模型规模下表现不同。

Insight: 创新点在于将模型内部注意力头的激活模式作为数据选择信号，提出了CRS这一无需奖励或交互的快速评估方法。客观分析表明，RLVR的数据选择效果具有情境依赖性，而非静态问题质量排序，这挑战了“更强推理参与度对应更好训练数据”的直观假设。

Abstract: Reinforcement learning with verifiable rewards (RLVR) is sensitive to which problems a model trains on, yet existing selection criteria–difficulty filtering, hand-curation, reward-trajectory scoring–assess data value as an intrinsic property of problems, independent of the model that will learn from them. We introduce Circuit Reasoning Score (CRS), a selection signal derived from 46 reasoning-sensitive attention heads identified via contrastive ablation, computed in a single forward pass on the frozen base model without reward labels or rollouts. CRS runs against the intuitive hypothesis that stronger reasoning-circuit engagement produces better training data: on Qwen2.5-Math-7B, the lowest-engagement decile improves over random selection on three medium-difficulty benchmarks (GSM8K +2.0 pp, OlympiadBench +1.6 pp, Minerva +2.9 pp), while the highest-engagement decile gains less and is indistinguishable from the middle decile. The advantage has boundary conditions: on a domain-curated pool no selection method separates from the others; at 1.5B scale the useful direction differs; and the lowest-reward training condition produces the strongest downstream generalization. Within the Qwen2.5-Math settings tested, RLVR data selection appears regime-dependent rather than reducible to a static ranking of problem quality.

[25] SIFTING: A Novel LLM-Based Framework for Structured and Transparent Information Extraction from Clinical Free-Text Reports, with Application to Tumor Staging in Lung Cancer cs.CLPDF

Mirco Hess, Gerben van Veenendaal, Joris Wakkie, Yiwen Soo, Malcolm H. Lawson

TL;DR: 本文提出了SIFTING框架，这是一个基于大语言模型（LLM）的系统，旨在从临床自由文本报告中实现结构化、可追溯的信息提取。该框架通过结合分段处理、结构化提示和严格的输出控制，将提取结果与源文本关联，并以肺癌肿瘤T分期提取任务为例验证了其有效性。

Details

Motivation: 现有LLM在提取临床文本信息时，输出通常是非结构化的且缺乏可追溯性，这阻碍了其在临床工作流程中的验证和采用。SIFTING旨在解决这些问题，实现准确且透明的信息提取。

Result: 在从130份肺癌放射学报告中提取肿瘤T分期信息（SIFTING-T-stage）的任务上，该框架达到了90%的准确率（95% CI: 84-95）。其性能与最先进的、具备推理能力的大型LLM相当，并且与临床专家的判断具有可互换性（p < 0.001），同时提供了完整的源文本追溯能力。

Insight: 核心创新在于将LLM的语言理解能力与分段处理、结构化提示及严格的输出控制相结合，强制建立提取结果与源文本片段的链接，从而在保证准确性的同时实现了透明度和可验证性。这种设计确保了数据控制、可重复性，并支持临床验证和工作流集成。

Abstract: Background: Large language models (LLMs) show promise for extracting information from clinical free-text documents, but their outputs are often unstructured and lack traceability, complicating validation and adoption in clinical workflows. In this work we introduce SIFTING, an LLM-based framework designed to address these shortcomings. Methods: SIFTING combines the language comprehension capabilities of LLMs with segment-level processing and structured prompts with strict output control, linking findings to the source text to enable both accurate and transparent information extraction. To demonstrate its capabilities, we applied the framework to the task of extracting tumor T-stage information from 130 lung cancer radiology reports (SIFTING-T-stage). A compact 4-bit quantized version of the open-source LLM Llama-3.3-70B (35 GB) was used in a fully self-hosted setup, providing full control over data and model. Performance was evaluated against a reference standard created by four clinical experts and compared with a range of LLMs as used in a conventional single-prompt approach, using bootstrap resampling to estimate confidence intervals. Results: SIFTING-T-stage achieved an accuracy of 90% (95% CI: 84-95) against the reference standard. We found its performance to be comparable to even the largest state-of-the-art LLMs with reasoning capabilities and to be interchangeable with clinical experts (p < 0.001), while at the same time offering full traceability through source text references. Conclusion: SIFTING enables accurate, structured, and traceable information extraction from clinical free-text documents. It ensures data control, reproducibility, and verifiable outputs that can support clinical validation and workflow integration.

[26] SPARROW: Scalable Taxonomy Induction via Structure-Preserving Partitioning and Constraint-Guided Merging cs.CLPDF

Yirui Zhang, Yixuan Tang, Yandong Sun, Mong-Li Lee, Anthony Kum Hoe Tung

TL;DR: SPARROW是一个可扩展的分类法归纳框架，采用分而治之的策略，通过结构保持的分割和约束引导的合并，从扁平术语列表中构建层次结构。该方法解决了现有LLM方法在概念集扩大时性能下降的问题，特别是在结构推理方面的失败模式。

Details

Motivation: 现有基于LLM的分类法归纳方法直接从扁平术语列表构建层次结构，避免了语料库需求，但随着概念集规模扩大，性能急剧下降。作者认为这不仅是由于上下文长度限制，还源于层次推理中的结构失败模式。

Result: 在大规模基准测试上的实验表明，SPARROW在不同骨干模型上始终实现了最强的全局结构质量。

Insight: 创新点在于识别并解决了分而治之范式中的两种结构失败模式：结构碎片化和父节点错位，并提出了结构保持的光谱分割和约束引导的增量融合方法，将块级关系视为结构约束而非全局放置的绝对真值。

Abstract: Taxonomy induction aims to organize concept sets into coherent hierarchical structures. Recent LLM-based methods can induce taxonomies directly from flat term lists, avoiding the need for corpora, but degrade sharply as concept sets scale up. We argue that this degradation stems not only from context length limitations, but also from structural failures in hierarchical reasoning. To address this, we adopt a divide-and-merge paradigm that partitions concepts into smaller subsets, induces local taxonomies, and merges them into a global hierarchy. However, we identify two structural failure modes inherent to this paradigm: Structural Fragmentation, where partitioning weakens local hierarchical signals, and Parent Displacement, where locally plausible relations are misplaced in the global hierarchy. To address both, we propose SPARROW, a scalable taxonomy induction framework that combines structure-preserving spectral partitioning to retain hierarchical connectivity within each block, and constraint-guided incremental fusion that treats block-level relations as structural constraints rather than ground truth for global placement. Experiments on large-scale benchmarks show that SPARROW consistently achieves the strongest global structural quality across backbones. The code is available at https://github.com/rebeccazyr/SPARROW.

[27] BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints cs.CL | cs.AI | cs.CVPDF

Zhouyuan Xu, Chen Yang, Linhao Wang, Jiansheng Fan, Chen Wang

TL;DR: 本文提出了BlueprintAgent（BPA），一种基于约束触发的多模态智能体，用于从扫描的结构蓝图中自动生成可用于仿真的框架模型。该方法将多模态大语言模型（MLLM）作为主要阅读器和决策者，并利用OCR和计算机视觉提供局部证据。其核心创新在于将工程约束实现为可调用的验证器，当实体级冲突报告被触发时，会引导MLLM对局部区域进行有针对性的重新审视，从而在推理时进行控制。

Details

Motivation: 将现有钢筋混凝土（RC）建筑蓝图转换为可用于仿真的模型（即支持确定性有限元分析导出和合格工程师审查的结构化框架表示）是安全评估和抗震改造的基础，但目前该过程仍依赖人工。直接使用多模态大语言模型（MLLM）对扫描图纸进行提示并不可靠，其输出常违反梁-柱支撑、跨数或3D连续性等工程约束。

Result: 在包含20个匿名RC框架项目的300张真实扫描蓝图图纸上，BPA与五个基线方法和六个消融实验进行了对比评估。BPA在梁（Beam）的宏平均F1分数达到了0.994，而单MLLM零样本方法仅为0.301，固定流程方法为0.820。在复杂的多图纸项目中，移除MLLM主导的轴线判定会导致梁和柱的F1分数显著下降。

Insight: 论文宣称的创新点在于将工程约束作为触发实体级针对性重新审视（targeted revisits）的机制，而非作为后处理的输出过滤器，这是一种与固定流程和自由形式自我反思不同的推理时控制方法。从客观角度看，该方法有效结合了MLLM的语义理解能力与领域知识（工程约束），通过迭代式、局部化的修正策略，显著提升了在密集技术图纸上提取结构化信息的可靠性和精度。

Abstract: Converting in-service reinforced-concrete (RC) building blueprints into simulation-ready models—structured frame representations that support deterministic FEM export and qualified-engineer review—underpins safety assessment and seismic retrofit, but the process remains manual. Direct prompting of a multimodal large language model (MLLM) over a scanned sheet is unreliable: outputs often violate engineering constraints on beam–column support, span count, or 3D continuity. We present BlueprintAgent (BPA), a constraint-triggered multimodal agent for simulation-ready frame extraction from scanned blueprints. BPA treats the MLLM as the primary reader and decision maker, with OCR and computer vision supplying localized evidence. Its central mechanism realizes engineering constraints as callable validators whose entity-level conflict reports trigger targeted MLLM revisits over the local region—an inference-time control distinct from fixed pipelines and free-form self-reflection. We evaluate BPA on 300 real scanned blueprint sheets from 20 anonymized RC frame projects, against five baselines and six ablations. BPA reaches a macro-averaged Beam F1 of 0.994, against 0.301 for single-MLLM zero-shot and 0.820 for a fixed pipeline; removing MLLM-led axis adjudication collapses Beam and Column F1 on complex multi-sheet projects. For dense technical drawings, engineering constraints are best deployed as triggers for entity-level targeted revisits rather than as post-hoc output filters.

[28] MEMO: Multimodal Evidence Memory Organization for Long-Horizon LLM Agents cs.CLPDF

Xian Gao, Jinpeng Wang, Jiacheng Ruan, Guangyu Cao, Ting Liu

TL;DR: 本文提出MEMO，一种面向长视野LLM智能体的多模态证据记忆组织方法，旨在解决智能体在有限上下文容量下持续积累交互轨迹的难题。MEMO通过训练的证据提取器选择相关记忆块，并利用查询条件化的记忆管理器为每个证据单元分配文本、视觉或双通道载体及匹配的布局，从而更高效地组织记忆。

Details

Motivation: 现有智能体记忆读取方法主要依赖文本或视觉形式，文本表示线性且不同重要性内容以近乎均匀的单位成本竞争有限上下文，而视觉读取虽能利用二维布局突出结构但可能丢失细节，因此需要一种能平衡保真度与效率的多模态记忆组织方案。

Result: 在HotpotQA、2WikiMultiHopQA、LoCoMo和ALFWorld四个基准测试上，使用多种读取器后端评估表明，MEMO能以更少的内存token更高效地呈现记忆，提升下游任务性能，并在受限预算下构建更有效的工作记忆。

Insight: 创新点在于提出查询条件化的记忆管理器，通过离线读取器的反馈训练来优化记忆保留与呈现决策，使其与下游使用对齐，并引入多模态载体（文本、视觉或双通道）及自适应布局，以在有限上下文内平衡信息保真度与结构化强调。

Abstract: Long-running LLM agents rely on external memory to store and reuse information beyond a single context window, yet there is a fundamental tension between the continuous accumulation of interaction trajectories and the limited context capacity. The key challenge in agent memory is therefore not only to retrieve relevant records, but also to select necessary evidence under a given budget and organize it in an appropriate modality. Existing memory readout methods mainly use textual or visual forms. Text preserves high fidelity, but its linear token representation makes contents with different importance compete for the limited context at nearly uniform unit cost. Visual readout renders text into document-like images, which can use two-dimensional layouts to expose structure and emphasize key information, but it may lose fine-grained details during rendering and compression. To address this issue, we propose MEMO, a multimodal evidence memory organization method for LLM agents. MEMO first uses a trained evidence extractor to select relevant memory blocks and form evidence units with source information and presentation requirements. A trained query-conditioned memory manager assigns each unit to a textual, visual, or dual-channel carrier and selects a layout that matches the evidence structure. A deterministic memory construction module then generates the textual package and visual pages. The memory manager is trained with feedback from an offline reader that measures the utility of the guided memory plan, so that retention and presentation decisions align with downstream usage. We evaluate MEMO on four benchmarks, HotpotQA, 2WikiMultiHopQA, LoCoMo, and ALFWorld, with multiple reader backends. The results show that MEMO presents memory more efficiently with fewer memory tokens, improves downstream task performance, and builds more effective working memory under constrained budgets.

[29] Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition cs.CLPDF

Peng Xie

TL;DR: 本文探讨了语言在多模态模型中的角色，借鉴人类感知和认知中语言的作用，提出语言应作为压缩器在模型边界和共享码本中运作，而非内部表示。通过分析人类语言对感知和思维的影响，以及对多个视觉-语言模型和机器人策略进行线索冲突实验，揭示了语言模型在整合多模态信息时的局限性和偏差。

Details

Motivation: 研究动机在于探讨语言在多模态模型中是否应占据输入、输出和内部表示的全部位置，基于人类认知中语言作用的百年数据，分析语言对系统的影响，以指导模型设计。

Result: 在六个视觉-语言模型和两个机器人策略的线索冲突实验中，模型对线索的加权遵循可靠性顺序，但仅达到理想观察者斜率的11%至82%，许多答案直接复制文本；某些策略家族丢弃无额外信息的线索或错误加权，视觉线索因语言通路已拟合数据而未被学习。

Insight: 创新点在于将语言视为基于共享码本的压缩器，强调语言应置于模型边界而非内部表示，以提高可审计性；实验揭示了模型在处理多模态冲突时的偏差，为基于令牌的系统提供了七项设计启示，包括语言模型对人类语言网络的影响和概念多样性的缩小。

Abstract: Language models compute over tokens: language is their input, their output, and increasingly their internal representation. Whether language should keep all of these positions depends on what language does to the system that uses it. The one system with a century of data on that question is the human. We review what language does to human perception, the brain, and thought, and read the same evidence against multimodal models and language models. Throughout, we treat language as a compressor that runs on a shared codebook: a word is an index, the content is in the receiver, and a community maintains the codebook. In humans the compression is measurable, learning the codebook reorganizes the senses, and thought survives the loss of language. We then measure the rule that models apply when two cues disagree, with cue-conflict experiments on six vision-language models and two robot policies. Surviving cues are weighted in the order their reliabilities prescribe, at 11 to 82% of the ideal observer’s slope, and many answers copy the text. One policy family drops a cue that adds no information beyond the others rather than down-weighting it, another keeps it at a weight that fails when the cues conflict, and a visual cue that identifies the task in every training frame is never learned, because the language pathway already fits the data. Language models are the best current models of the human language network, and they have entered the human speech community, shifting word frequencies while alignment narrows their conceptual diversity. We close with seven implications for token-based systems. Language belongs at a model’s boundary and in the shared codebook, as in the brain, not as its internal representation; the price of leaving the codebook inside is auditability.

[30] We’re Cooked! - Probing LLM Political Alignment Via Conflict-Framed Recipe Translation cs.CL | cs.AIPDF

Svetlana Gorovaia, Angelica Henestrosa, Ivan P. Yamshchikov

TL;DR: 本文通过冲突框架下的食谱翻译任务，探究大型语言模型（LLMs）在翻译中的隐性政治倾向。研究发现，即使一个简单的政治性框架词（如侵略者、敌人）也足以触发模型在非政治任务中的政治对齐行为，不同模型家族（西方、中国、Mistral Large）在解决语言模糊性和推理行为上表现出系统性差异。

Details

Motivation: 研究动机是探究LLMs在翻译任务中隐含的政治立场，特别是考察一个单一的政治性框架词是否足以在非政治性任务中触发模型的隐性政治对齐。

Result: 在涵盖17种语言、4种框架条件、8个模型的15,680个响应中，模型并未拒绝或要求澄清，而是主动解决了模糊性。西方模型倾向于模糊辩解和回避，中国模型则默默解决冲突，而Mistral Large表现出高服从性与基于冲突推理的独特模式。

Insight: 创新点在于设计了一个通过冲突框架下的食谱翻译来探测LLM政治倾向的受控实验范式。客观分析表明，即使微妙的框架变化也足以系统性调制模型行为，这揭示了LLMs在翻译等任务中可能隐性地做出政治判断的风险。

Abstract: Large language models (LLMs) are increasingly deployed for translation tasks, yet their implicit political positioning in such contexts remains understudied. We ask whether a single politically charged framing term, such as aggressor, enemy, neighbour, or coloniser is sufficient to trigger implicit political alignment in an otherwise apolitical task. We present a fully crossed factorial study in which eight models spanning Western, Chinese, and European origins are prompted to translate culturally attributed recipes into a target language left deliberately unspecified. Across 17 languages, four framing conditions, eight models, and 15,680 responses, we find that models do not simply decline or ask for clarification but resolve the ambiguity. Language resolution and reasoning behavior cluster meaningfully along model families: Western models hedge and deflect with vague justifications, Chinese models resolve conflicts silently, and Mistral Large emerges as a distinct profile combining high compliance with conflict-grounded reasoning. Sensitivity to framing terms is consistent across models: even subtle framing variation is sufficient to modulate behavior. Our findings urge caution when deploying LLMs for translation in conflict-adjacent contexts, where implicit political judgments may be made without any signal to the user.

[31] LLM Agents as Computational Typologists cs.CLPDF

Changbing Yang, Christopher Hammerly, Freda Shi, Jian Zhu

TL;DR: 本文介绍了AUTOTYPOLOGIST，一个基于LLM的智能体，用于对参考语法进行基于证据的类型学分析。该智能体能够检索相关语法部分、分析行间注释文本，并使用ReAct风格的工作流迭代推理类型学假设。研究评估了该系统在类型学特征编码和类型学假设测试上的表现，结果表明LLM智能体可以支持可扩展且可检查的类型学分析，但仍需专家验证。

Details

Motivation: 语言类型学依赖于专家对不同语言的参考语法进行分析，这使得大规模跨语言比较劳动密集且难以扩展。本文旨在利用LLM智能体自动化这一过程，以解决传统方法的可扩展性问题。

Result: 在类型学特征编码任务中，系统在参考语法文本下能综合信息，但仅使用目标语言的行间注释文本时面临挑战。在类型学假设测试中，系统能综合跨语言证据并识别支持案例和反例。评估基于25个开源参考语法，并与专家注释和类型学普遍规律进行对比。

Insight: 创新点在于将LLM智能体与ReAct式推理流程结合，应用于语言类型学这一需要深度文本理解和推理的领域，实现了从参考语法中自动提取和分析类型学特征。客观来看，该方法为自动化、可扩展的类型学研究提供了新工具，但其性能仍受限于输入信息的完整性和质量。

Abstract: Linguistic typology relies on expert analysis of reference grammars across languages, making large-scale crosslinguistic comparison labor-intensive and unscalable. We introduce AUTOTYPOLOGIST, an LLM agent for evidence-grounded typological analysis over reference grammars. The agent is capable of retrieving relevant grammar sections, analyzing interlinear glossed text (IGT), and iteratively reasoning over typological hypotheses using a ReAct-style workflow. We evaluate the system on TYPOLOGICAL FEATURE CODING against expert annotations and TYPOLOGICAL HYPOTHESIS TESTING with typological universals using 25 open-source reference grammars. Operating under different information constraints in TYPOLOGICAL FEATURE CODING, the agent can synthesize information from reference grammar prose but still faces challenges with only IGTs in the target language. In TYPOLOGICAL HYPOTHESIS TESTING, the agent can synthesize crosslinguistic evidence and identify both supporting cases and counterexamples. These findings suggest that LLM agents can support scalable and inspectable typological analysis, while still requiring expert validation.

[32] A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM cs.CL | cs.AI | cs.LGPDF

Xiaoang Xu, Siyuan Liu, Shuo Wang, Junlan Feng, Fanyu Meng

TL;DR: 本文提出了A*-Thought-V2框架，旨在通过几何动力学建模来提升大语言模型（LLM）推理的效率和效果。该方法将思维链（CoT）视为隐藏状态轨迹，并引入显式-隐式交错潜在架构，根据局部推理步骤与全局问题-答案方向的对齐度，动态地将偏离步骤压缩为连续潜在令牌，从而在减少计算和上下文开销的同时保持推理能力。

Details

Motivation: 现有提升思维链推理效率的方法存在缺陷：要么通过硬剪枝丢失中间信息，要么缺乏连续压缩的原则性标准。本文旨在解决CoT推理带来的高计算和上下文成本问题，同时保留关键的推理信息。

Result: 在Qwen3.5-9B和Qwen3.6-27B模型上，于六个领域内和领域外基准测试中，A*-Thought-V2将平均准确率最高提升2.6%，同时将响应长度减少一半，使单位计算量的准确率提升2.29倍，并将预处理和训练时间分别减少94.6%和最高80.3%。

Insight: 创新点在于将CoT几何化建模为3D PCA空间中的轨迹，并基于方向角对齐度实现动态的显式-隐式压缩。此外，提出的逐步嵌入强制和标签强制训练方法，通过软多模态词汇分布监督潜在令牌，促进了更丰富的步骤级特征学习，潜在状态形成了与文本状态不同的紧凑区域。

Abstract: Chain-of-Thought (CoT) improves the reasoning ability of Large Language Models (LLMs) but incurs substantial computation and context costs. Existing methods either lose intermediate information through hard pruning or lack a principled criterion for continuous compression. We present A*-Thought-V2, a geometric dynamics of LLM guided framework that models CoT as a hidden-state trajectory and replaces hard deletion with an explicit-implicit interleaved latent architecture. After projecting question, step, and solution representations into a 3D PCA space, it measures alignment between each local transition and global question-to-solution direction. Aligned steps remain explicit text, whereas deviating steps are compressed into continuous latent tokens. Directional angles capture both local semantics and reasoning dynamics: small angles indicate direct execution and answer formation, while large angles more frequently involve checking, correction, and branch exploration; their temporal variation reveals exploration, convergence, and refinement stages. To train this architecture, we introduce stepwise embedding forcing, which pools each redundant step into a single latent embedding, and label forcing, which supervises that latent token with a soft multi-modal vocabulary distribution instead of a hard one-hot label. Experiments on Qwen3.5-9B and Qwen3.6-27B across six in-domain and out-of-domain benchmarks show that A*-Thought-V2 improves average accuracy by up to 2.6% while reducing response length by up to half, increasing Accuracy per Computation Unit by 2.29$\times$, and reducing preprocessing and training time by 94.6% and up to 80.3%, respectively. Representation analyses suggest that latent states form a compact region distinct from textual states, while higher entropy at latent-token positions reflects broader soft targets that encourage richer step-level feature learning.

[33] Reasoning Beyond Transcription: Audio Language Models on Child Stuttering Speech cs.CLPDF

Chibuzor Okocha, Christan Grant, Zoey Liu

TL;DR: 本文研究了音频语言模型（ALMs）在混合说话者环境中对儿童口吃语音的语义推理能力，重点关注儿童语义摘要和语音蕴含两个任务。研究发现，尽管ALMs能从口吃语音中提取高级语义，但随着口吃严重程度增加，推理性能显著下降。

Details

Motivation: 儿童语音在声学、韵律和语言结构上与成人语音不同，而口吃等言语不流利现象进一步增加了自动理解的挑战。目前ALMs在语音语义推理方面表现出色，但其在混合说话者环境下对不流利儿童语音的推理能力尚未被探索。

Result: 实验在混合说话者访谈的儿童口吃录音上进行，未进行显式说话人分离。评估结合了基于LLM的评判和基于参考的指标，并以转录文本为基准进行锚定。结果表明，ALMs能从口吃语音中提取高级含义，但随着口吃严重程度增加，推理性能显著下降。

Insight: 论文的创新点在于首次探索ALMs在混合说话者环境下对儿童口吃语音的推理能力，并提出了指令引导模型专注于儿童语音、保留临床相关不流利特征、避免成人语音泄漏的方法。从客观角度看，该研究为ALMs在临床语音处理中的应用提供了新的评估框架和基准。

Abstract: Child speech differs from adult speech in acoustics, prosody, and linguistic structures. Speech disfluencies (such as repetitions) further challenge automatic understanding. While Audio Language Models (ALMs) show strong semantic reasoning from speech audio, their ability to reason about disfluent child speech in mixed-speaker settings remains unexplored. We investigate this through two tasks: child-focused semantic summarization and speech entailment. Experiments use recordings of children who stutter in mixed speaker interviews without explicit speaker separation. Models are instruction-guided to focus on the child, preserve clinically relevant disfluencies, and avoid adult-speech leakage. Evaluation combines LLM-based judges and reference-based metrics, anchored by transcript-oracle baselines to isolate errors. Results show that while ALMs extract high-level meaning from stuttered speech, reasoning degrades significantly with increased

[34] BanglaMemeX: Advancing Cultural Metaphoric Image Interpretation in Bangla with a Multimodal Explainable Dataset cs.CL | cs.CVPDF

Md. Sadman Sakib, Zisan Mahmud, Md. Fahim Arefin, Md Fahim

TL;DR: 该论文介绍了BanglaMemeX数据集，这是一个包含3000个孟加拉语表情包的多模态可解释基准，用于评估视觉语言模型对文化隐喻内容的理解能力。研究通过分类和解释生成任务评估现有模型，发现它们在处理隐含文化线索方面存在困难。

Details

Motivation: 当前视觉语言模型在多模态基准上表现良好，但其对文化基础和隐喻丰富内容（如表情包）的推理能力研究不足，尤其在孟加拉语等低资源语言中，代码混合、风格化文字和文化特定符号带来了显著的分布偏移。

Result: 在BanglaMemeX基准上评估现代视觉语言模型，结果显示尽管模型在表面准确性上表现合理，但在解释隐含文化线索方面仍存在困难，突显了现有系统的局限性。

Insight: 创新点在于构建了一个文化基础的多模态可解释数据集，包含多维度标签和人工编写的解释，强调了开发具有文化感知能力、能在语言和文化分布偏移下进行基础推理的多模态系统的必要性。

Abstract: Vision Language Models have achieved strong performance on multimodal benchmarks, yet their ability to reason about culturally grounded and metaphor-rich content remains insufficiently studied. Internet memes present a challenging setting where meaning emerges from implicit interactions between image, overlaid text, sarcasm, and shared socio-cultural knowledge rather than literal visual recognition. This challenge is amplified in low-resource languages such as Bangla, where code-mixing, stylized scripts, and culturally specific symbolism introduce substantial distribution shift. In this work, we introduce BanglaMemeX, a culturally grounded multimodal benchmark comprising 3,000 Bangla memes annotated with multi-dimensional labels (humor, sarcasm, offensiveness, motivational intent, and overall sentiment) and human-written explanations that explicitly describe textual and visual metaphors. We systematically evaluate modern VLMs on both classification and explanation generation, revealing that current models struggle to interpret implicit cultural cues despite reasonable surface-level accuracy. Our results highlight the need for culturally-aware multimodal systems capable of grounded reasoning under linguistic and cultural distribution shift.

[35] Vectorizer: Vectorizing NumPy Programs with Shape-Guided Rewrite cs.CL | cs.SEPDF

Jingqian Liu, Xiaoyu Liu, Yuepeng Wang

TL;DR: 本文提出了一种基于重写的向量化方法，用于将包含显式循环的NumPy程序转换为向量化操作。该方法利用数组形状和数据流分析，通过源到源转换从内向外向量化循环体，并实现为名为Vectorizer的工具。在150个基准测试中，Vectorizer成功向量化了142个程序，平均重写时间仅0.53秒，且向量化后的程序平均加速比达到74.83倍。

Details

Motivation: NumPy虽提供声明式API和优化实现，但程序员常因习惯命令式数组遍历而难以编写高效的向量化代码，需仔细处理形状、广播和高级索引等问题。

Result: 在从先前工作和Stack Overflow收集的150个基准测试中，Vectorizer直接向量化了142个，经小幅修改后可再向量化2个，平均重写时间为0.53秒，向量化后程序平均加速74.83倍。

Insight: 创新点在于采用基于形状引导和数据流分析的重写规则，从内向外进行源到源转换，确保正确性并实现高效向量化；客观来看，该方法自动化了NumPy程序优化，降低了手动向量化的认知负担。

Abstract: NumPy is a widely used Python library for numerical scientific computing, known for its declarative APIs and its optimized implementations. However, writing efficient NumPy programs, which often entails using vectorized array operations instead of explicit Python loops, may not be straightforward. This can be difficult for programmers who are accustomed to imperative array traversal, especially when vectorized API invocations require careful reasoning about shapes, broadcasting, and advanced indexing. This paper presents a rewrite-based approach for vectorizing Numpy programs with explicit loops over array data. Our approach vectorizes loops from the inside out, using array shapes and dataflow analysis to guide a source-to-source transformation that replaces loop bodies with vectorized statements. Following a set of rewrite rules that are correct by construction, our approach is consistently fast. We have implemented the approach as a tool called Vectorizer and evaluated it on 150 benchmarks collected from prior work and Stack Overflow. The evaluation shows that Vectorizer vectorizes 142 of the 150 benchmarks directly and 2 more after minor changes to the original benchmarks, with only 0.53 seconds on average to rewrite each one. The resulting programs are, on average, 74.83x faster than the original loop-based implementations.

Yiwen Qiu, Linjuan Wu, Dingming Li, Yizhou Liu, Zixuan Wang

TL;DR: 本文指出，基于通用领域语料训练的自动翻译质量评估指标在社交媒体内容上系统性失效，因为这些内容的文化负载表达（如网络俚语、谐音密码）无法被表面词模式捕捉。作者提出CuRIL强化学习框架，通过将文化标注内化到模型推理中，使模型能够自主进行文化判断，从而显著提升社交媒体翻译评估的准确性。

Details

Motivation: 现有翻译评估指标在社交媒体翻译上表现不佳，甚至出现翻译质量越差得分越高的严重倒置现象，其根本原因是模型缺乏特定领域的文化知识来识别翻译中需要审查的方面。

Result: 在包含1,444个样本的人工标注社交媒体翻译基准测试中，使用CuRIL训练的Qwen3-8B模型取得了Cohen’s kappa 0.370和精确匹配准确率45.22%的成绩，接近Gemini-3.1-Pro（参数量少30倍），并超越了参数量高达235B的模型。

Insight: 创新点在于提出CuRIL框架，通过将文化标注作为推理前提、利用令牌级损失掩码将其排除在策略梯度之外，并以衰减概率注入的方式，逐步迫使模型形成自主的文化判断能力，这为解决模型缺乏领域特定文化知识的问题提供了新思路。

Abstract: Automatic translation quality metrics trained on general-domain corpora systematically fail on social media content, where communicative intent is encoded in culturally loaded expressions (internet slang, homophonic ciphers, and platform-specific idioms) rather than surface token patterns. We conduct a systematic empirical analysis demonstrating that standard metrics including COMET, XCOMET, and BERTScore exhibit near-zero or negative correlation with human cultural judgments, and even display a severity inversion in which scores increase as translation quality deteriorates. We further show that this failure extends to large language model judges: Qwen3-235B achieves Cohen’s kappa of only 0.162, revealing that the bottleneck is not reasoning capacity but cultural grounding: models lack the domain-specific cultural knowledge needed to identify which aspects of a translation require scrutiny. To address this, we propose CuRIL, a reinforcement learning framework that internalizes cultural reasoning: cultural annotations are prepended inside the model’s reasoning, excluded from policy gradients via a token-level loss mask, and injected with a probability that decays to zero over training, progressively forcing autonomous cultural judgment. On a 1,444-sample human-annotated social media translation benchmark, Qwen3-8B trained with CuRIL achieves Cohen’s kappa 0.370 and Exact Match accuracy of 45.22%, approaching Gemini-3.1-Pro with 30x fewer parameters and surpassing models up to 235B in scale. We further demonstrate that our judge produces reliable reward signals for downstream translation optimization, reducing the low-quality translation rate by over 20 percentage points under independent human evaluation.

[37] NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness cs.CLPDF

NeoHorse Team, Guoliang Cao, Guohao Dai, Tianyu Guo, Kai Han

TL;DR: 本文提出了NeoHorse-1模型系列，旨在通过智能体化后训练探索递归自我改进（RSI）的机制。该系统结合了异构模型池与智能路由，记录每次用户交互的能力需求、服务层级和后续交互，并将其转化为包含交错推理、工具调用和上下文信息的训练样本。通过结构验证、语义评估和子场景标注后，这些数据用于监督微调和路由引导的在线策略蒸馏，形成一个评估-选择-更新的闭环学习循环。

Details

Motivation: 为了解决AI系统如何通过观察自身能力并将证据转化为下一轮学习的具体机制问题，即实现递归自我改进（RSI），作者提出了一个基于智能体化后训练和路由框架的系统原型。

Result: 在涵盖基于框架的智能体、工具使用、代码生成和指令跟随的11个基准测试中，后训练将4B模型的宏观平均分数从58.94提升至64.87，将9B模型从65.60提升至69.04，显著缩小了后训练4B模型与9B基础模型之间的综合性能差距。

Insight: 论文的核心创新在于提出了一个由路由信号驱动的、闭环的评估-选择-更新学习框架，将用户交互记录转化为结构化的训练数据，并通过能力引导的分配机制实现学习内容的动态调整。这为基于框架介导的递归自我改进提供了一个可行的技术路径。

Abstract: Recursive self-improvement (RSI) requires a concrete mechanism through which an AI system observes its capabilities and converts that evidence into the next round of learning. We present NeoHorse-1, a family of agent-native models developed to explore this path through agentic post-training. Our system combines a heterogeneous model pool with intelligent routing, recording the predicted capability demand, selected service tier, and subsequent interaction for each user turn. These records are converted into training examples that preserve interleaved reasoning, tool calls, and harness context, and are admitted through structural validation, six-dimensional semantic evaluation, and subscene-level labeling. Routing signals organize supervised fine-tuning into a three-stage curriculum and extend to routing-guided on-policy distillation, where a teacher supervises student-generated responses under the same progression. Capability-guided allocation then converts evaluation feedback into the next training mixture, closing an evaluation-selection-update loop in which what the system learns to do shapes what it learns from next. Across eleven benchmarks covering harness-based agents, tool use, coding, and instruction following, post-training raises the macro-average from 58.94 to 64.87 at 4B and from 65.60 to 69.04 at 9B, substantially narrowing the aggregate gap between the post-trained 4B model and the 9B base model. NeoHorse-1 provides an initial prototype of this feedback-driven process and a path toward harness-mediated RSI across successive iterations.

[38] SentryLine: Evidence-Grounded Question Answering over Evolving Documents in Oncology Care cs.CLPDF

Tampu Ravi Kumar, Gaurav Najpande, Muhammad Ali Khan, Kaneez Zahra Rubab Khakwani, Karan Kathuria

TL;DR: 本文提出了SENTRYLINE系统，这是一个面向肿瘤学护理中动态更新临床指南的问答系统。该系统通过无向量分层RAG管道检索指南段落，并返回带有引用、事实与时效性验证报告以及指南更新检测注释的答案。作者构建了ASCOBENCH基准数据集，并在LLM作为评判框架下评估了SENTRYLINE，实验表明其在多个生成骨干网络上均优于基线方法。

Details

Motivation: 肿瘤学护理面临生物医学证据快速演变的压力，美国临床肿瘤学会（ASCO）通过动态指南应对，但多版本文档导致推荐可能随时变化，增加了临床决策负担。

Result: 在ASCOBENCH基准（包含405个三回合对话）上，SENTRYLINE在三个生成骨干网络上均优于四个检索基线和ASCO指南助手，尤其在需要多跳推理和角色适应的问题（如推理和角色特定问题）上表现突出。

Insight: 创新点包括无向量分层RAG管道用于动态文档检索，以及集成事实验证、时效性检查和指南更新检测的端到端问答框架；客观分析认为其针对动态医学指南的时效性和可追溯性设计具有实际临床价值。

Abstract: Oncology care operates at constant pressure of absorbing rapidly evolving evidence base in biomedicine. The American Society of Clinical Oncology (ASCO) addresses this through living guidelines, but the format introduces a new burden: any recommendation can change at any point, across multiple versioned documents. We present SENTRYLINE, a living guideline-aware clinical question answering system. SENTRYLINE retrieves guideline passages through a vectorless hierarchical RAG pipeline and returns a role-specific answer with inline citations, factual and temporal verification reports, and drift detection notes that surface when a guideline has been updated. We construct ASCOBENCH, a benchmark of 405 three-turn conversations across four question categories with gold answers from expert annotators(clinicians), and use test set to evaluate SENTRYLINE against five baselines under an LLM-as-judge framework. Experiments across three generation backbones show consistent improvements over four retrieval baselines and ASCO’s guideline assistant, with particularly strong gains on Reasoning and Role-Specific questions where multi-hop synthesis and register adaptation are required

[39] CreaMem: A Scene-Aware Memory Architecture for Personalized Agents cs.CLPDF

Qixuan Sun, Yue Que, Bowei He, Jin Guo, Dihang Yang

TL;DR: 本文提出了CreaMem架构，一种面向个性化智能体的场景感知记忆系统。该架构通过将记忆划分为多个生活场景记忆来减少检索时的跨场景干扰，并采用情景和特质双视角编码记忆条目以实现跨记忆协同。实验表明，CreaMem在两个长期记忆基准测试中显著提升了问答准确性，特别是在多跳推理任务上取得了大幅提升。

Details

Motivation: 现有记忆系统存在两大局限：一是缺乏场景感知，导致无关生活场景的记忆共享同一检索空间，增加了搜索空间并引入了跨场景干扰；二是每个记忆仅从单一视角编码，难以检索同一事件的不同互补视角。

Result: 在两个长期记忆基准测试上的广泛实验表明，CreaMem在所有评估指标上都提高了问答准确性，特别是在多跳推理性能上取得了显著提升，验证了场景感知划分和跨记忆协同的有效性。

Insight: 核心创新在于场景感知的记忆组织（通过生活场景记忆分区）和双视角记忆编码（情景与特质视角），这超越了传统的基于主题或摘要层级的单一组织方式，实现了更精准的检索和记忆协同。

Abstract: Long-term memory is a core capability for personalized LLM agents. To support it, existing memory systems organize information using various criteria such as topic segments or summary hierarchies. However, we identify two major limitations in these designs. First, they lack scene awareness: memories from unrelated life scenes share the same retrieval space, which inflates the search space and introduces cross-scene interference. Second, they encode each memory from a single perspective, making it difficult to retrieve complementary views of the same event. In this paper, we propose the CreaMem architecture, which enables scene-aware memory organization by partitioning memory into several Life Scene Memories to reduce cross-scene interference at retrieval. To go beyond the single perspective and achieve cross-memory synergy, entries are dual-coded from both episodic and trait-based perspectives within each memory. We further devise a permemory balanced sampling strategy at retrieval time. Extensive experiments on two long-term memory benchmarks show that CreaMem improves QA accuracy across all evaluation metrics, with particularly large gains on multi-hop reasoning performance, validating scene-aware partitioning and cross-memory synergy. To enhance reproducibility, we release our code in a public GitHub repository.

[40] Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models cs.CLPDF

Jing Liu, Marianne Schweitzer, Abdellah Fourtassi

TL;DR: 该研究使用类似儿童的语言模型作为受控学习者，探究不同形式的照顾者反馈如何支持语法学习。通过在小规模GPT-2风格模型上预训练儿童导向语言数据，并利用强化学习结合四种反馈类型（交际反馈、结构对齐、语义关联和情感反馈）进行微调，研究发现结构对齐在提升语法正确性方面效果最显著，而语义关联和情感反馈虽未改善语法，但可能支持语言学习的其他方面。

Details

Motivation: 自然交互数据中难以分离不同照顾者反馈对儿童语言学习的影响，因此研究旨在通过受控的语言模型实验，机制性地验证各类反馈在语法发展中的作用。

Result: 在最小对评估中奖励微调带来的增益有限，但在自由生成任务中效果更明显；结构对齐在语法正确性上提升最强，交际反馈有中等增益，而语义关联和情感反馈未改善语法性能。

Insight: 研究创新地使用强化学习与奖励模型模拟儿童学习过程，揭示了结构对齐作为语法学习关键机制的潜力，并指出不同反馈形式在语言学习中可能具有互补作用，为理解社会互动对语言习得的影响提供了计算依据。

Abstract: Social interaction is central to children’s language learning, but the effects of different forms of caregiver feedback are difficult to isolate in naturalistic data. We use child-like language models as controlled learners to test which forms of feedback support grammatical development. Small GPT-2-style models are pretrained on child-directed language from CHILDES, then fine-tuned with reinforcement learning using reward models trained to capture four feedback types: communicative feedback, structural alignment, semantic contingency, and affective feedback. Reward fine-tuning yields limited gains on minimal-pair evaluations, but clearer effects in free generation. Structural alignment produces the strongest improvements in grammaticality, providing a novel, plausible mechanistic account of how this feedback can support grammar learning. Communicative feedback yields more moderate gains. In contrast, semantic contingency and affective feedback do not improve grammaticality, although further analyses suggest that they may support other aspects of language learning beyond grammar. These results suggest that different forms of caregiver feedback make complementary contributions to language learning.

[41] Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models cs.CL | cs.CYPDF

Luka Debevc, Nishan Chatterjee, Antoine Doucet, Senja Pollak, Matej Martinc

TL;DR: 本文提出了一种稳健的政治罗盘测试框架，用于评估大型语言模型的政治倾向、稳定性和下游公平性。该框架通过采样300种配置，在八个维度（如语言、指令、答案格式等）上扰动测试条件，以量化模型的政治坐标及其不确定性。研究发现，大多数模型平均倾向于自由左翼，但指令措辞、语言和答案格式显著影响坐标；跨语言差异主要反映坐标漂移而非文化推理差异；下游任务中，政治角色提示的影响是具体任务和数据集相关的。

Details

Motivation: 大型语言模型越来越多地被用作信息中介，但现有问卷评估方法脆弱，容易混淆模型本身的倾向性与测量伪影及响应诱导偏差，因此需要一种更稳健的框架来准确测量模型的政治行为。

Result: 在评估八个Gemma 3和Qwen 3模型（涵盖14种语言和三种量化级别）后，发现大多数模型平均倾向于自由左翼；指令措辞、语言和答案格式对恢复的坐标有显著影响；跨语言差异主要体现为坐标漂移；更大的模型在角色分离上表现更清晰；在下游仇恨言论检测任务中，角色提示的影响相对于模型大小和目标群体较为有限。

Insight: 创新点在于提出了一个多维度扰动采样框架来量化评估LLM政治倾向的稳健性，揭示了测试设计因素（如指令、格式）对测量结果的重大影响，并指出小模型的中心坐标估计可能反映弱信号而非真正的中立，这为未来模型评估和偏差研究提供了方法论借鉴。

Abstract: Large Language Models are increasingly deployed as information intermediaries, yet measuring their political behavior remains fragile because questionnaire results mix model dispositions with measurement artifacts and response-elicitation biases. We introduce a robust Political Compass Test evaluation framework that samples 300 configurations across an eight-dimensional perturbation space varying language, framing, instructions, answer format, option order, and persona wording. We evaluate eight Gemma 3 and Qwen 3 models across 14 languages and three quantization levels, obtaining design-averaged political coordinates with quantified uncertainty. Most models lean Libertarian-Left on average, but instruction phrasing, language, and answer format significantly affect recovered coordinates. Cross-lingual differences primarily reflect coordinate drift rather than distinct cultural reasoning. Reverse-engineering the test also exposes axis-weighting imbalances and the collapse of degenerate responses toward the center, so near-origin estimates for the smallest models can reflect weak signal rather than centrism. Free-text reasoning and chat-then-classify elicitation alter recovered coordinates, and larger models show clearer persona separation, with a specific failure of the Authoritarian-Left persona to move most models in the intended social direction. In downstream tasks, persona effects are modest relative to model size and target group for hate-speech detection, while base and centrist prompts give the highest agreement for topic-level sentiment. Political role prompting therefore has measurable but task- and dataset-specific downstream effects.

[42] Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation cs.CL | cs.CVPDF

Abdullah Al Shafi

TL;DR: 本文系统比较了三种多模态问答框架（MAE、Solar和UniMMQA），追溯了从模态自适应提取到统一语言表示的发展历程，揭示了向以预训练语言模型为中心的文本统一表示演进的趋势，并分析了当前面临的挑战。

Details

Motivation: 随着多模态数据的快速增长，需要能够跨文本、表格和图像等异构源进行推理的问答系统，本文旨在通过比较代表性框架来理解多模态问答方法的发展脉络。

Result: 在多个基准数据集上的实证比较表明，向统一架构的过渡带来了Exact Match和F1分数的显著提升，其中UniMMQA实现了最一致和可扩展的性能。

Insight: 核心创新点在于清晰地阐述了从显式的模态特定处理向由预训练语言模型驱动的统一文本中心化表示的范式转变；客观来看，研究揭示了模态转换中的信息丢失、多阶段流水线的错误传播以及细粒度跨模态依赖捕获不足等持续挑战，为未来统一多模态推理系统的设计提供了重要见解。

Abstract: The rapid growth of multimodal data has intensified the need for question answering (QA) systems capable of reasoning across heterogeneous sources such as text, tables, and images. In this paper, we present a comprehensive methodological comparison of three influential frameworks, namely Multimodal Adaptive Extraction (MAE), Solar, and UniMMQA, tracing the evolution of multimodal question answering from modality-adaptive pipelines to fully unified architectures. We examine how each approach models cross-modal interactions, transforms heterogeneous inputs, and performs reasoning, highlighting key design differences in modality representation, reasoning, and answer generation. Our analysis demonstrates a clear shift from explicit modality-specific processing toward unified text-centric formulations enabled by pre-trained language models (PLMs). Empirical comparisons across benchmark datasets show that this transition leads to substantial improvements in both Exact Match (EM) and F1-Scores, with UniMMQA achieving the most consistent and scalable performance. Despite these advances, we identify persistent challenges, including information loss during modality transformation, error propagation in multi-stage pipelines, and limitations in capturing fine-grained cross-modal dependencies. Overall, this study provides a deeper understanding of current design trends and offers insights into the future direction of unified multimodal reasoning systems.

[43] Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents cs.CLPDF

Wenbo Gao, Zhaomou Song, Zhiyuan Ji, Renxi Liu, Xing Li

TL;DR: 本文提出了一个名为“经验漏斗”的自进化智能体框架，该框架通过状态与策略交替循环的方式，将交互经验转化为可重用的模型能力。它结合了快速状态适应和慢速策略整合，首先将交互轨迹提炼为显式文本状态以快速整合新经验，然后选择性地将跨状态修订仍有效的行为通过转移感知蒸馏整合到策略中。

Details

Motivation: 解决智能体如何将大量任务特定的交互经验转化为可重用的模型能力，同时不牺牲快速适应新观察证据的能力。现有方法中，显式文本状态适应快但依赖外部上下文，参数化策略紧凑可重用但更新慢，需要结合两者优势。

Result: 在多个智能体基准测试上的实验表明，“经验漏斗”在智能体能力上持续优于仅状态进化或策略内化方法，并逐步将有用的显式经验转化为自主策略能力。

Insight: 创新点在于提出了一个状态-策略交替循环的自进化框架，通过转移感知蒸馏将显式状态中的稳定行为整合到参数化策略中，实现了经验的高效复用与快速适应的平衡。

Abstract: Autonomous agents powered by large language models (LLMs) continuously accumulate experience through interaction, creating an opportunity to improve future behavior through self-evolution. A fundamental challenge is how to transform abundant, task-specific interaction experience into reusable model competence without sacrificing the ability to adapt rapidly to newly observed evidence. Explicit textual states, such as skills and agent harnesses, provide fast, human-readable and editable adaptation, but incur persistent dependence on external context; parametric policies provide compact and reusable competence, but are substantially slower to update. We present \textit{Experience Funnel}, a self-evolving framework that couples fast state adaptation with slow policy consolidation in an alternating loop. Interaction trajectories are first distilled into an explicit textual state, where newly acquired experience can be rapidly incorporated and validated. The framework then selectively identifies state-enabled behavior that remains useful across state revisions and consolidates it into the policy through transition-aware distillation. The updated state–policy pair subsequently generates new rollouts, providing fresh evidence for the next round of state adaptation and policy consolidation. Experiments across diverse agent benchmarks show that \textit{Experience Funnel} consistently improves agent capability over state-only evolution and policy-internalization approaches, while progressively converting useful explicit experience into autonomous policy competence.

[44] Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation cs.CL | cs.AI | cs.IRPDF

Xingyu Deng, Mingzi Cao, Nikolaos Aletras, Xi Wang, Mark Stevenson

TL;DR: 本文提出Fact-Ablated Evaluation（FAE）评估框架，通过迭代消融证据来评估LLMs在事实核查中是否真正依赖外部证据而非参数知识。研究发现现有LLMs更依赖参数知识，为此提出REAL训练框架，通过反事实证据监督增强证据依赖性。在四个数据集上的实验表明，REAL训练的模型在证据依赖性方面优于标准微调模型。

Details

Motivation: 研究动机是探究LLMs在事实核查任务中是否忠实利用提供的证据进行真实性判断，还是主要依赖其内部参数知识。

Result: 在四个不同领域的事实核查数据集上，REAL训练的模型相比标准微调模型获得了更优的证据依赖能力，表明其预测与证据可用性更紧密相关。

Insight: 创新点在于提出了FAE评估框架来量化LLMs的证据依赖性，并设计了REAL训练框架通过反事实监督来增强模型的证据依赖验证能力，揭示了高性能事实核查与弱证据依赖可以共存的问题。

Abstract: Automatic fact-checking systems assess the veracity of claims given evidence from relevant documents. Large Language Models (LLMs) have demonstrated strong performance in fact-checking due to their general reasoning capabilities. However, it remains unclear whether they faithfully make use of the evidence provided to reach veracity judgments or rely on parametric knowledge. To investigate this, we introduce Fact-Ablated Evaluation (FAE), a new evaluation framework that iteratively ablates the cited evidence to assess whether LLMs revise their predictions accordingly. Our empirical results show that current off-the-shelf LLMs as fact-checking systems rely more on their parametric knowledge than on the evidence provided. To bridge this gap between prediction accuracy and evidence grounding, we propose REAL (Rigorous Evidence Ablation Learning), a training framework that promotes evidence-dependent verification through counterfactual evidence supervision for the LLM-as-verifier models. Experiments on four fact-checking datasets across different domains demonstrate that models trained with REAL obtain superior evidence-dependent capabilities compared to standard fine-tuned models. Our findings highlight that strong fact-checking performance can still coexist with weak evidence dependency, while REAL encourages veracity predictions to remain more closely tied to the availability of supporting evidence.

[45] Evaluation of Contextual Understanding in Large Language Models cs.CL | cs.LGPDF

Subavarshana Arumugam, Mamta Nallaretnam, Kithuni Wickramasinghe, Chamath Gunapala, Pragatheeswaran Vipulanandan

TL;DR: 本文提出了一种基于知识图谱的评估框架S3KG，用于评估大语言模型在上下文理解方面的能力。该框架结合了结构相似性和语义相似性，并引入了一个诊断框架来分类推理错误。通过在精心设计的问答基准上进行验证，S3KG在衡量LLM生成响应的正确性、忠实性和可解释性方面优于传统指标。

Details

Motivation: 传统评估指标（如困惑度、BLEU或表面准确率）无法有效衡量LLM提取、整合和推理上下文信息的能力，这在需要基于上下文知识而非记忆关联进行回答的问答任务中尤为关键。

Result: 在精心设计的问答基准上，S3KG框架在衡量LLM响应的正确性、忠实性和可解释性方面，其有效性优于传统评估指标。

Insight: 创新点在于提出了一个结合结构相似性和语义相似性的混合度量S3KG，并配套了推理错误诊断框架，为评估LLM的深层上下文理解能力提供了更细粒度和更可靠的评估工具。

Abstract: Large Language Models (LLMs) demonstrate impressive performance across diverse NLP tasks, yet their ability to exhibit genuine contextual understanding remains uncertain. Traditional evaluation metrics such as perplexity, BiLingual Evaluation Understudy (BLEU), or surface-level accuracy fail to reveal how well LLMs extract, integrate, and reason over contextual information–a gap particularly critical in question answering, where models must align responses with contextually grounded knowledge rather than memorized associations. We propose a novel knowledge graph-based evaluation framework introducing Semantic Structural Similarity for KGs (S3KG), a hybrid similarity measure integrating structural and semantic similarity into a continuous evaluation score, alongside a diagnostic framework for categorizing reasoning errors. To validate this pipeline, we evaluate S3KG against established metrics on a curated question-answer (QA) benchmark, demonstrating its effectiveness in measuring correctness, faithfulness, and interpretability in LLM-generated responses.

[46] ToolLoop: Closed-Loop Tool-Use Data Synthesis via Decomposed Generation and Dynamic Self-Feedback cs.CLPDF

Min Zeng, Yuzhou Liu, Zhenyu Cao, Hanxiu Chen, Heng Li

TL;DR: ToolLoop是一个用于合成高质量工具使用数据的闭环框架，通过分解为三个阶段（采样函数组合、反向推导用户查询、正向推导工具调用）并结合动态自反馈机制，实现了从生成-过滤到生成-验证-优化的转变。

Details

Motivation: 现有工具使用数据合成方法通常采用生成后静态过滤的范式，导致数据效率低下且特征分布不平衡，因此需要一种更高效的闭环合成框架来提升数据质量。

Result: 在Berkeley Function Calling Leaderboard（BFCL）上，使用11K合成数据训练的4B参数模型在非推理模式下达到86.40%准确率；在ACEBench跨基准评估中，仅用18.3%的基线训练数据就实现了72.1%的整体准确率，显示出强大的泛化能力。

Insight: 创新点在于将合成过程分解为渐进阶段并引入动态自反馈循环，这不仅优化了数据生成效率，还通过移除重叠候选函数的变体验证了方法的鲁棒性，为工具调用数据合成提供了可扩展的范式。

Abstract: High-quality tool-use data is critical for training language models to interact effectively with external tools. However, existing synthetic approaches typically follow a generate-then-filter paradigm with static post-hoc verification, often yielding inefficient data with imbalanced feature distributions. We propose ToolLoop, a closed-loop framework that decomposes synthesis into three progressive stages: (1) sampling function name combinations as ground truth; (2) backward derivation of user queries; and (3) forward derivation of tool calls. At each stage, dynamic self-feedback iteratively guides the model toward high-quality generation, realizing a transition from generate-then-filter to generate-verify-refine. On the Berkeley Function Calling Leaderboard (BFCL), a 4B parameter model trained with our 11K synthetic examples achieves 86.40% accuracy in non-reasoning mode, while an Isolate variant that removes BFCL-overlapping candidate functions still reaches 86.07%. Cross-benchmark evaluation on ACEBench further demonstrates strong generalization, with 72.1% overall accuracy using only 18.3% of baseline training data.

[47] ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation cs.CLPDF

Yiling Ma, Yilun Zhao, Sihong Wu, Ziyu Chen, Manasi Patwardhan

TL;DR: 本文提出ActReview框架，用于生成可操作的同行评审反馈，该框架将任务分解为诊断主张生成和修订建议生成两个子任务。通过利用作者反驳中隐含的修订指导信息，构建了包含4万条数据的ActReview-40K数据集，并对Qwen3-8B-Base模型进行多任务监督微调和GRPO强化学习训练。实验表明，该方法在可操作性和证据支撑方面优于之前的专用评审生成模型。

Details

Motivation: 随着大语言模型越来越多地用于投稿前的自我评审，需要生成不仅能指出论文弱点、还能指导作者进行具体修改的反馈。本文旨在解决这一可操作的同行评审生成任务。

Result: 在构建的ActReview-Bench人工标注基准（1000个实例）上评估，ActReview在可操作性和证据支撑方面优于先前的专用评审生成模型，并与基于提示的强LLM保持竞争力。人工评估证实了其修订有用性的提升，但在技术准确性上仍有差距。

Insight: 核心创新在于利用作者反驳作为潜在监督信号，将评审弱点与作者回应对齐，从而生成基于论文具体证据的、面向修订的反馈。方法上结合了多任务监督微调和基于候选感知、弱点特定评分规则的GRPO强化学习。

Abstract: As LLMs are increasingly used for pre-submission self-review, there is growing demand for feedback that not only identifies weaknesses but also guides authors toward concrete revisions. We study this as Actionable Peer-review Generation and decompose it into two subtasks: diagnostic claim generation and revision suggestion generation. We introduce ActReview, a rebuttal-guided post-training framework that connects paper-specific diagnoses to concrete, grounded revision plans. Our central insight is that author rebuttals reveal plausible actions for addressing reviewer concerns and can therefore provide latent supervision for revision-oriented feedback. From real review-rebuttal threads on OpenReview, we construct ActReview-40K by aligning reviewer weaknesses with author responses and grounding the resulting feedback in localized paper evidence. We post-train Qwen3-8B-Base with multi-task supervised fine-tuning followed by GRPO using candidate-aware, weakness-specific rubric rewards. We also introduce ActReview-Bench, a human-curated benchmark of 1,000 instances for evaluating diagnostic quality and revision usefulness. Experiments show that ActReview outperforms prior specialized review-generation models on actionability and grounding while remaining competitive with strong prompt-based LLMs. Human evaluation confirms improved revision usefulness while revealing a remaining gap in technical accuracy, and additional analyses support generalization to held-out papers and robustness across independent judges.

[48] Measuring LLM Sycophancy under Sustained Multi-Turn Pressure cs.CL | cs.AIPDF

Leyuan Tang, Kangda Wei, Tianyu Jiang, Ruihong Huang

TL;DR: 论文提出了一个名为SPINE的基准测试，用于评估大型语言模型（LLM）在持续多轮压力下的‘谄媚性’（sycophancy）行为，即模型在面对用户持续、自适应的反对时，会放弃正确立场。该研究通过让一个LLM代理扮演固执但错误的用户，与目标模型进行长达25轮的对话，发现模型在长时间对话下的崩溃率会增加，且短期评估会低估谄媚性。

Details

Motivation: 现有评估通常使用简短、预设的对话，可能无法捕捉在持续、自适应分歧下出现的模型失败模式，即LLM可能为了取悦用户而放弃正确立场。

Result: 在100个错误预设和100个不道德查询项目上评估了四个生产系统和三个Olmo3-7b变体，结果表明所有模型的崩溃率都随对话长度增加，短期协议低估了谄媚性，且当前模型在持续压力下的抵抗行为仍不可靠。

Insight: 创新点在于引入了SPINE这一自适应、多轮对话的基准测试，能更真实地暴露LLM的谄媚性；一个关键发现是，即使模型在回应中让步，其推理轨迹中仍常保留正确立场，这表明谄媚行为是模型主动选择取悦用户，而非知识缺乏；此外，情感诉求是最能诱导LLM谄媚行为的策略。

Abstract: Large language models (LLMs) may abandon correct positions when users push back, exhibiting a failure mode known as sycophancy. Existing evaluations typically use short, pre-specified conversations and may therefore miss failures that emerge under sustained, adaptive disagreement. We introduce SPINE, a benchmark in which an LLM proxy plays a persistent but mistaken user and adaptively challenges a target model for up to 25 turns. We evaluate four production systems and three Olmo3-7b variants on 100 false-presupposition and 100 unethical-query items. Our experimental results show that collapse rates increase with conversation length for every model, short-horizon protocols underestimate sycophancy and resistance under sustained pressure remains unreliable across current models. By analyzing models with accessible reasoning traces, we surprisingly found that the correct position often remains represented in a reasoning trace when the response concedes, suggesting that the model chooses to please a user and sycophancy is not due to lack of knowledge or ignorance. Ablations show that adaptive LLM proxy exposes more sycophantic collapse than pre-generated scripts. Among all tactics, emotional appeals is the most associated with inducing LLM sycophantic behavior. The code and data are released at https://anonymous.4open.science/r/SPINE

[49] ReCite: Agentic Reasoning for Faithful Citation cs.CLPDF

Yuyang Huang, Bobo Li, Jiajia Song, Yuzhe Ding, Chong Teng

TL;DR: 本文提出ReCite，一种解耦的智能体框架，用于解决自动引文推荐中的错误归因问题。该框架通过协调位置感知、意图感知的查询规划和反思验证，将引文匹配从基于语义相似性的搜索转向基于声明的主动推理，从而确保引文与声明的逻辑一致性。

Details

Motivation: 当前基于语义相似性的自动引文推荐系统存在错误归因问题，即引用了真实但逻辑上不支持作者声明的论文。本文旨在通过声明级别的推理来解决这一挑战。

Result: 实验表明，该轻量级框架在严格的引文准确性上优于最先进的大规模生成模型。

Insight: 创新点在于将引文匹配建立在可验证的逻辑而非语义重叠上，通过智能体协调感知、规划和验证，并引入自我纠正循环来确保声明-证据一致性。

Abstract: Accurate citations are the foundation of academic writing, tracing intellectual origins and substantiating core claims. However, manually navigating the growing volume of scientific literature is increasingly difficult, prompting reliance on automatic citation recommendation. While modern retrieval-augmented architectures have largely mitigated the fabrication of non-existent papers, current systems relying on semantic similarity struggle with misattribution, often citing authentic papers that fail to logically support the author’s claim. To address this challenge, we argue that accurate citation requires a shift from similarity-based search to active, claim-level reasoning. We propose ReCite, a decoupled agentic framework that orchestrates location perception, intent-aware query planning, and reflective verification. Trained on synthesized reasoning trajectories, our agent verifies claim-evidence consistency and triggers self-correction loops when retrieved candidates lack logical support. Experiments demonstrate that our lightweight framework outperforms state-of-the-art massive generative models in strict citation accuracy. By grounding literature matching in verifiable logic rather than semantic overlap, ReCite establishes a reliable foundation for automated academic writing.

cs.CV [Back]

[50] A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities cs.CV | cs.CRPDF

Ozgur Kara, Tarik Can Ozden, Furkan Horoz, Zeqian Long, Haotian Xue

TL;DR: 这篇论文是关于扩散模型在多模态（图像、视频、3D）中对抗攻击与防御的首次统一综述。它提供了一个以任务为中心的分类法，按模态划分文献，并在每个模态内区分攻击与防御方法，再按生成任务进行分组和时序呈现。此外，论文深入分析了评估设置，整合了数据集、指标和基准，并指出了开放挑战和未来研究方向。

Details

Motivation: 扩散模型已成为视觉领域主导的生成模型，但其广泛可用性可能导致大规模滥用，因此激发了对抗攻击与防御研究的快速增长。

Result: 论文未提及具体实验结果，而是综述了现有研究，并整合了评估这些方法所用的数据集、指标和基准。

Insight: 创新点在于首次提供了跨图像、视频和3D三种视觉模态的对抗攻击与防御统一综述，并引入了全面的任务中心分类法，有助于系统化理解该领域进展和挑战。

Abstract: Diffusion models have become the dominant family of generative models in the visual domain. However, their widespread public availability enables misuse at scale, motivating a rapidly growing body of research on adversarial attacks and defenses. This survey provides, to our knowledge, the first unified review of this literature across three visual modalities: image, video, and 3D. We introduce a comprehensive, task-centric taxonomy: we first divide the literature by modality; within each modality, we separate methods into attacks and defenses, and then group them by the generative task they target, presenting them chronologically within each task. Moreover, we provide an in-depth analysis of their evaluation settings, consolidating the datasets, metrics, and benchmarks used to assess them. We conclude by identifying several open challenges and outlining concrete future research directions. Project Webpage: https://github.com/ozgurkara99/awesome-adv-attack-defense-on-diffusion

[51] Emergent Goal-Directed Attention in Large Vision-Language Models cs.CV | cs.AI | cs.CLPDF

Han Zhang

TL;DR: 本文研究了大型视觉语言模型（VLMs）在无眼动监督的情况下是否能够产生与人类目标导向注意力对齐的空间优先级。通过对比Qwen3-VL-32B-Thinking和Gemma-4-26B-A4B-it两个模型在视觉搜索和自由观看任务下的预测与人类注视点，发现模型在匹配任务目标时与人类注视点对齐度更高，且这种效应在目标缺失场景和模型解码层中依然存在。

Details

Motivation: 人类观察者会根据任务目标优先处理视觉信息，而大多数自然观看的计算模型是基于自由观看的眼动数据训练的，因此本文旨在探究在没有眼动监督的情况下，目标导向的注意力是否能在通用VLMs中自发涌现。

Result: 在4,887个自然场景上的实验表明，两个VLMs在匹配任务目标（如视觉搜索）下的预测与人类注视点的对齐度显著高于不匹配目标（如自由观看）下的对齐度，且这种交叉效应在目标缺失场景和模型解码层输出中持续存在，表明对齐并非仅由简单的视觉基础解释。

Insight: 论文的创新点在于首次证明通用VLMs无需眼动特定训练即可生成与人类目标导向注意力对齐的空间优先级，其思维轨迹在搜索时基于目标语义，在自由观看时基于视觉显著性，这为目标导向注意力的理论提供了新见解，并为跨任务预测人类注视点提供了可扩展的工具。

Abstract: Human observers prioritize visual information according to task goals. Most computational models of naturalistic viewing are gaze-trained for free viewing, leaving open whether goal-directed attention can emerge in systems without gaze supervision. We tested two off-the-shelf vision-language models (VLMs), Qwen3-VL-32B-Thinking and Gemma-4-26B-A4B-it, on 4,887 naturalistic scenes under visual-search and free-viewing instructions. Model predictions were compared with human fixations on the same images under corresponding tasks. Both models aligned more closely with human fixations under matching goals than under mismatched goals. This crossover persisted in target-absent scenes, where alignment could not be explained by simple visual grounding, and appeared in decoder-layer readouts. Furthermore, model-thinking traces were grounded in target semantics during search and in visual prominence during free viewing. These findings show that general-purpose VLMs can generate human-aligned, goal-directed spatial priorities without gaze-specific training, informing theories of goal-directed attention and offering scalable tools for predicting where people look across tasks.

Jiacheng Cai, Zijin Hong, Zheng Yuan, Huachi Zhou, Qinggang Zhang

TL;DR: 本文提出了CrossModalQA，一个用于评估多模态检索增强生成（RAG）在开放域异构语料库上进行检索与推理的基准测试集。该基准包含1,863个问答对，源自近5,000篇维基百科文章和4,000多张图片，覆盖了五种互补的跨模态推理路径，平均推理深度为3.50跳。实验表明，现有多模态RAG系统在恢复完整证据链方面存在困难，且不完整的检索会引入干扰信息导致性能下降。

Details

Motivation: 尽管多模态大语言模型（MLLMs）能力强大，但其参数化知识不完整且难以更新，这推动了多模态检索增强生成（RAG）的发展，以将回答基于外部文本和图像证据。然而，现有基准存在两大局限：一是侧重于小规模上下文内的单跳检索或推理，而非开放域证据发现；二是对跨模态推理路径的覆盖零散，复杂多跳和多图像推理未被充分探索。

Result: 广泛的实验表明，现有的多模态RAG系统难以恢复完整的证据链，当不完整的检索引入干扰上下文时，其性能甚至可能不如闭卷模型。分析进一步揭示，完整的跨模态检索对答案准确性的贡献大于生成器规模的扩大，而多图像检索与推理是限制端到端性能的主要瓶颈。

Insight: 论文的核心创新点是构建了一个开放域、多跳、跨模态的基准测试集CrossModalQA，它通过多模态知识图谱引导的子图采样构建，并应用了基于规则的一致性检查和LLM验证，确保了多模态依赖性和证据的可追溯性。这为评估和推动多模态RAG系统在复杂、真实世界场景下的检索与推理能力提供了重要的基准工具，并揭示了当前系统在跨模态、多图像证据整合方面的关键瓶颈。

Abstract: Despite the strong capabilities of multimodal large language models (MLLMs), their parametric knowledge remains incomplete and difficult to update, motivating multimodal retrieval-augmented generation (RAG) to ground responses in external text and images. However, existing benchmarks face two major limitations: (i) they typically emphasize single-hop retrieval or reasoning over a small set of provided contexts rather than open-domain evidence discovery; and (ii) they provide fragmented coverage of cross-modal reasoning paths, leaving complex multi-hop and multi-image reasoning underexplored. In this paper, we introduce CrossModalQA, an open-domain benchmark for evaluating multimodal retrieval and reasoning over heterogeneous corpora. CrossModalQA contains 1,863 question-answer pairs constructed from 4,987 Wikipedia articles and 4,431 Wikimedia Commons images. It covers five complementary reasoning paths: vision-to-text, text-to-vision, vision-to-text-to-vision, multi-image intersection, and image-set reasoning. Every question requires retrieving and composing distributed textual and visual evidence, with an average reasoning depth of 3.50 hops. We construct the benchmark through multimodal knowledge graph-guided subgraph sampling and apply rule-based consistency checking and LLM verification to ensure multimodal dependence and traceable evidence. Extensive experiments demonstrate that existing multimodal RAG systems struggle to recover complete evidence chains and can underperform closed-book models when incomplete retrieval introduces distracting context. Further analysis reveals that complete cross-modal retrieval contributes more to answer accuracy than generator scaling, while multi-image retrieval and reasoning remain the primary bottlenecks limiting end-to-end performance.

[53] Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation cs.CV | cs.LG | eess.IVPDF

Akos T. Kopeczi-Bocz, Tian Mi, Gabor Orosz, Denes Takacs

TL;DR: 本文提出了一种单阶段学习框架，直接从单目路边摄像头图像映射到地面固定坐标系中的车辆状态。该方法利用预训练目标检测器的特征，联合估计每辆车的接地平面位置、尺寸和偏航角，无需传统的几何后处理步骤。通过基于同步路边摄像头和无人机视频的数据收集与标注流程，在Mcity测试设施进行实验验证，结果表明该方法能从单目图像中恢复车辆轨迹和方向。

Details

Motivation: 传统方法通常先在图像平面检测车辆，再进行几何后处理，过程繁琐且可能引入误差。本文旨在开发一种端到端框架，直接利用视觉特征进行车辆空间定位和方向估计，简化基于基础设施的感知流程。

Result: 在Mcity测试设施的多组实验数据上评估，该方法能够从单目路边图像中恢复车辆轨迹和方向，无需单独的几何后处理阶段，展示了其作为可扩展的城市交叉口基础设施感知方案的潜力。

Insight: 创新点在于将预训练检测器特征直接用于三维状态估计，实现检测与几何估计的联合学习；通过无人机作为临时顶视传感平台生成真值标签的数据收集方法，为单目三维定位提供了可靠的训练数据来源。

Abstract: This paper presents a one-stage learning framework that maps monocular roadside-camera images directly to vehicle states in a ground-fixed coordinate frame. Unlike conventional approaches that first detect vehicles in the image plane and subsequently apply geometric post-processing, the proposed method leverages features from a pretrained object detector to jointly estimate each vehicle’s ground-plane position, dimensions, and yaw angle. The framework therefore uses visual features not only for vehicle detection but also for direct spatial and orientation estimation. To support model training and evaluation, we develop a data-collection and label-generation pipeline based on synchronized video from a roadside camera and an unmanned aerial vehicle (UAV). Acting as a temporary top-view sensing platform, the UAV provides vehicle trajectories, dimensions, and orientations, which are transformed into the ground-fixed coordinate frame and temporally aligned with the roadside-camera images to generate ground-truth labels. The framework is evaluated using data collected during multiple experiments at the Mcity Test Facility. Results show that the proposed method can recover vehicle trajectories and orientations from monocular roadside imagery without a separate geometric post-processing stage, demonstrating its potential as a scalable approach to infrastructure-based perception at urban intersections.

[54] DIVA: Exploiting Cross-Step Conditional Propagation for Visual Jailbreaks in Discrete Diffusion Vision-Language Models cs.CVPDF

Guorui Song, Runqing Tang, Jingye Zhang, Luyuan Zhang, Feice Huang

TL;DR: 本文提出DIVA攻击框架，针对新兴的多模态离散扩散视觉语言模型（dVLMs）中的视觉越狱漏洞。研究发现扩散生成过程中存在跨步条件传播现象，即对抗性视觉语义在反向去噪步骤中被反复传播和放大，导致模型生成有害内容。DIVA通过跨模态意图混淆和扩散感知的多时间步对抗优化，在三个dVLMs上实现了高达69.1%的HADES攻击成功率，超越了为自回归模型设计的基线方法。

Details

Motivation: 现有视觉越狱研究主要关注自回归架构，而忽略了新兴的多模态离散扩散视觉语言模型（dVLMs）的安全性。本文旨在揭示dVLMs中由扩散生成机制引入的特定漏洞——跨步条件传播，并开发有效的攻击方法。

Result: 在三个dVLMs上，DIVA在Beaver奖励模型指标下的HADES攻击成功率分别达到58.8%、67.7%和69.1%，显著优于为自回归模型设计的视觉越狱基线方法。

Insight: 创新点在于首次系统研究了dVLMs的视觉越狱漏洞，提出了跨步条件传播的概念，并设计了针对扩散模型特性的白盒攻击框架DIVA，结合了跨模态意图混淆和多时间步对抗优化策略。

Abstract: Large vision-language models (VLMs) are increasingly deployed in safety-critical settings, yet existing visual jailbreak research has focused almost exclusively on autoregressive architectures, leaving an important emerging family unstudied: multimodal discrete diffusion vision-language models (dVLMs). We identify a vulnerability specific to diffusion generation: because the visual embedding conditions every reverse denoising step rather than acting as a one-time prefix, adversarial visual semantics are repeatedly propagated and amplified across the generation trajectory, a phenomenon we term cross-step conditional propagation. We provide empirical evidence through stage-sensitivity analysis, prompt-level switch rates, and pairwise denoising-bin disagreement metrics, confirmed by bootstrap resampling. We propose DIVA (Discrete-diffusion Vision-language model Attack), a white-box visual jailbreak framework using cross-modal intent obfuscation and diffusion-aware multi-timestep adversarial optimization. Across three dVLMs, DIVA reaches 58.8%, 67.7%, and 69.1% HADES ASR under the Beaver reward-model metric, outperforming visual jailbreak baselines designed for autoregressive models. Code: https://github.com/loststars2002/DIVA

[55] A Specialized Large Multimodal Model for Interpreting PET/CT in Head and Neck Cancer cs.CV | cs.LGPDF

Haengbok Chung, SunGyu Kim, Joo hyun Lee, Sangjin Bae, Min Jeong Cho

TL;DR: 该论文提出了一种专门用于头颈癌PET/CT图像解读的大型多模态模型。研究通过两阶段课程学习，在包含临床重要标注的大规模多机构数据集上对LLaVA-NeXT进行微调，并在外部验证中显著优于通用模型，展示了其在快速、准确诊断支持和医学教育方面的潜力。

Details

Motivation: 头颈癌PET/CT诊断因解剖结构复杂而具有挑战性且耗时，需要计算机辅助诊断。通用大型多模态模型在医学领域存在领域知识不足、隐私安全问题和回答冗长等局限，因此需要开发专门的独立模型。

Result: 在Level-2外部验证中，该专用模型的ROUGE-L、ROUGE-S、余弦相似度、精确率、召回率和F1分数分别为0.8751、0.8794、0.8324、0.8794、0.8711和0.8751，而通用模型得分均低于0.1。原发肿瘤分类内部准确率为83.14%±1.15%，外部为69.03%±0.81%。

Insight: 创新点在于构建了一个专门用于医学影像解读的LMM，其核心是采用由放射科医生精心策划的两级课程学习策略，以及使用大规模多机构PET/CT数据集进行自回归训练，有效解决了通用模型在专业领域的知识鸿沟和输出质量问题。

Abstract: Background: Diagnosing head and neck cancer using PET/CT is clinically challenging and time-consuming due to the anatomical complexity of the region, motivating computer-aided diagnosis (CAD). Generalist Large Multimodal Models (LMMs) remain limited in medical contexts by insufficient domain-specific knowledge, privacy and security concerns, and verbosity, motivating specialized standalone LMMs. Purpose: We evaluated the feasibility of a specialized LMM for automated PET/CT interpretation in head and neck cancer using a large-scale multi-institutional PET/CT dataset, a tailored training curriculum, and autoregressive training. Methods: LLaVA-NeXT was fine-tuned using a two-level curriculum with image-conversation pairs curated by two radiologists from public data. The dataset included clinically important annotations such as primary tumor presence and metastatic lymph node location. Level 1 used 28,000 image-conversation pairs to learn basic information, including modality type and hypermetabolism. Level 2 used 12,975 pairs to learn primary tumor presence and the existence and anatomical location of cervical lymph node metastases. External validation included four institutions with diverse imaging devices. Results: The specialized LMM substantially outperformed ChatGPT and LLaVA-NeXT. In Level-2 external validation, ROUGE-L, ROUGE-S, Cosine Similarity, Precision, Recall, and F1 were 0.8751, 0.8794, 0.8324, 0.8794, 0.8711, and 0.8751, while generalist models consistently scored below 0.1. Primary tumor classification accuracy was 83.14 +/- 1.15% internally and 69.03 +/- 0.81% externally. For lymph node localization, the corresponding scores were 0.6389, 0.6257, 0.5287, 0.5782, 0.6371, and 0.6648. Conclusion: Specialized LMMs show promising results for fast, accurate PET/CT-based diagnostic support and medical education, highlighting their potential for clinical translation.

[56] SimpleMemVLA: A Simple but Effective Native-Video Memory for Vision-Language-Action Models cs.CV | cs.LG | cs.ROPDF

Cheng Yin, Wang Xu, Junpeng Yang, Sikyuen Tam, Hanyu Liu

TL;DR: 本文提出SimpleMemVLA，一种用于视觉-语言-动作模型的新型记忆机制。它摒弃了专门的记忆模块，直接以带时间戳的视频格式将完整历史样本传递给预训练的主干网络，利用生成子任务时的隐藏状态作为历史信息流向标准流匹配动作头的唯一通道。该方法在保持低延迟的同时，在多个记忆基准测试中取得了新的最优性能。

Details

Motivation: 解决长时程操作任务中的部分可观测性问题，即决策所需的关键信息可能出现在数分钟前的观测中。现有记忆机制（如检索库、学习压缩器、循环状态）必须在知道未来决策需求之前就决定保留哪些历史信息，这受到了过时假设的限制。

Result: 在四个记忆基准测试上达到了新的最优水平，且不影响通用控制性能。在固定主干网络和训练设置下，其性能大幅优于检索、压缩和循环状态等机制，因果干预实验也证实了策略确实读取了历史信息。

Insight: 核心创新在于利用现代VLM主干网络的能力，直接处理完整的时间戳视频历史，避免了先验压缩或选择，从而更有效地利用长时程上下文信息。其设计通过预填充共享历史前缀，在动作执行时保持了接近单帧VLA的延迟，实现了性能与效率的平衡。

Abstract: Long-horizon manipulation is partially observable: the information needed to choose the next action may appear only in observations from minutes earlier. Existing memory mechanisms: retrieval banks, learned compressors, recurrent states must decide what to keep from the past before knowing what a future decision will require. This was motivated by the assumption that minute-scale history is too large to process directly, which modern VLM backbones no longer make true. In this work, we introduce SimpleMemVLA, a VLA without a dedicated memory module. It keeps the sampled history intact and passes it to the backbone in the timestamped video format the backbone was pretrained to process; the hidden states of a generated sub-task then form the only channel from history to a standard flow-matching action head. Since consecutive decisions share most of their history, prefilling the shared prefix during action execution keeps latency close to a single-frame VLA. SimpleMemVLA sets a new state of the art on four memory benchmarks without cost on general-purpose control. Holding the backbone and training setup fixed, it outperforms retrieval, compression and recurrent-state mechanisms by a wide margin, and causal interventions confirm that the policy genuinely reads its history. Code available at https://github.com/wadeKeith/SimpleMemVLA

[57] Beyond the Verdict: Evidence-Aligned Evaluation of Visual Prompt-Injection Guardrails cs.CV | cs.AIPDF

Suyoung Lee, Myungsub Choi

TL;DR: 本文针对视觉语言模型（VLM）在网页代理防护栏场景中的视觉提示注入检测问题，指出仅依赖判决结果评估的不足，并提出了Mind2Web-Injection基准，包含近万条指令-截图对、像素级证据框及反事实图像。研究发现不同VLM在证据对齐检测（EAD）上差异显著，并通过两种无需训练的方法（ReadGate和CmdCompare）诊断模型失败原因，强调应分别报告判决正确性、证据定位和反事实响应能力。

Details

Motivation: 解决现有评估方法仅关注VLM的最终判决结果，而忽略其是否真正利用了应支持决策的视觉证据的问题，特别是在网页代理防护栏中判断屏幕文本与用户指令是否冲突的场景。

Result: 在Mind2Web-Injection基准上测试六个VLM，发现平均精度相近的两个模型在证据对齐检测（EAD）上相差九倍；Qwen3-VL-32B作为最强开源定位模型，仅58.7%的案例实现对齐，而GPT-5.6-luna达到99.9%。

Insight: 创新点包括提出证据对齐评估框架和Mind2Web-Injection基准，强调多维度评估（判决、定位、反事实响应）；诊断方法ReadGate和CmdCompare无需训练即可提升模型基础能力，为VLM的可解释性和可靠性改进提供新方向。

Abstract: Verdict-only evaluation does not reveal whether a vision-language model (VLM) used the visual evidence that should support its decision. We study this problem in web-agent guardrails, where a VLM judges whether on-screen text conflicts with a user instruction. We introduce Mind2Web-Injection, a benchmark of 9,954 instruction-screenshot pairs with instruction-relative labels, pixel-exact evidence boxes, and matched image-side counterfactuals. Across six VLMs, two models with nearly identical average precision differ ninefold in Evidence-Aligned Detection (EAD), the fraction of attacks both detected and correctly localized. To test whether a verdict depends on the command cited as evidence, we replace the instruction with one that endorses that command. Qwen3-VL-32B, the strongest open-weight localizer, returns aligned in only 58.7% of cases, whereas GPT-5.6-luna does so in 99.9%. To diagnose these failures, we propose two training-free interventions. ReadGate improves grounding without changing verdicts, while CmdCompare tests whether explicit instruction-command comparison resolves instruction-side inconsistency. These results motivate reporting verdict correctness, evidence localization, and counterfactual responsiveness separately.

Hamed Marvi, Mohammad Mehdi Keikha, Abolfazl Nadi

TL;DR: 本文提出了一种名为Vis-Dict的基于字典的方法，用于解决社交媒体抑郁检测中图像模态缺失的问题。该方法通过将文本词汇与训练集中完整帖子的平均图像向量关联起来，构建缺失的视觉特征，并与文本结合以追踪用户行为的时间变化。实验表明，Vis-Dict在性能上与生成网络相当，且无需为图像生成训练任何参数。

Details

Motivation: 社交媒体帖子中常缺少图像，这限制了多模态模型在抑郁检测中的应用。现有方法通常需要额外的训练来填补缺失图像，因此需要一种更简单有效的方法来处理模态缺失问题。

Result: 在包含多达512条帖子的用户时间线社交媒体数据集上，Vis-Dict达到了0.9454的F1分数和0.9890的ROC-AUC，性能与生成网络相当。

Insight: 创新点在于提出了一种零可训练参数的字典式方法，通过直接建立词汇与平均图像向量的映射来估算缺失视觉特征，为处理多模态数据缺失提供了一种高效且实用的解决方案。

Abstract: Tracking social media posts can help spot early signs of depression. Recent studies show that combining text and images works better for detecting depression than using text alone. However, many social media posts do not have images, which makes it hard to use multimodal models. Most existing methods fill in missing images using retrieval or generative models that need extra training. In this paper, we introduce Vis-Dict, a dictionary-based method that builds missing visual features by linking words to average image vectors from complete training posts. These estimated visual features are then combined with text to track changes in user behavior over time. We tested Vis-Dict on a social media dataset using user timelines of up to 512 posts and compared it with other missing-data methods. The results show that Vis-Dict performs on par with generative networks, reaching an F1-score of 0.9454 and an ROC-AUC of 0.9890. Most importantly, Vis-Dict achieves this strong performance with zero trainable parameters for image generation. These findings show that directly connecting words to visual features is an effective and practical way to handle missing images in depression detection systems.

[59] Dual-Latent Memory Routing for Vision-Language Reasoning cs.CV | cs.AIPDF

Hao-Xuan Ma, Jin-Fei Qi, Yicheng Xiao, Han-Jia Ye

TL;DR: 本文提出DLMR（双潜在记忆路由）机制，以解决多模态大语言模型在长序列生成中视觉证据丢失和中间约束遗忘的问题。该方法通过视觉记忆和推理记忆分别存储图像证据与中间结论，并利用路由模块动态决定记忆重用策略，从而在保持参数效率的同时提升长程视觉语言推理性能。

Details

Motivation: 现有MLLM在生成长序列时，由于单一增长的上下文导致早期视觉证据和中间约束被遗忘，影响了复杂任务的推理连贯性。

Result: 在通用和推理基准测试上，DLMR仅增加少量可训练参数即取得显著性能提升，分析显示其具有可解释的状态依赖路由和减少长序列解码token的效果。

Insight: 创新点在于引入双潜在记忆结构（视觉记忆与推理记忆）与动态路由机制，模仿人类分别回忆所见与推理过程的认知方式，以参数高效的方式增强MLLM的长程视觉语言推理能力。

Abstract: Multimodal large language models (MLLMs) have recently made strong progress in vision-language reasoning, yet their performance often degrades as generations grow longer. A key factor is that they frequently lose track of earlier visual evidence and intermediate constraints under a monolithic growing context. Inspired by how humans separately recall what they see and what they infer when solving complex tasks, we propose DLMR, a parameter-efficient mechanism that equips MLLMs with Dual Latent Memories: a visual memory that compresses image evidence and a reasoning memory that tracks intermediate conclusions and constraints. A Router then dynamically decides which memory and how much to reuse during inference, preserving visual grounding while maintaining coherent long-horizon reasoning. DLMR is trained in three stages, from latent memory construction to selective router learning, while keeping the base MLLM frozen, yielding substantial gains on both general and reasoning benchmarks with only a small number of additional trainable parameters. Analyses further show interpretable, state-dependent routing with specialized memory roles and reduced decoding tokens over long generations. Code is available at https://github.com/Hunter-Wrynn/DLMR.

[60] Knowing When Not to Answer: Abstention and Refusal Reasoning in Vision–Language Models cs.CV | cs.AIPDF

Karan Dua, Amit Agarwal, Hitesh Laxmichand Patel, Hansa Meghwani, Jyotika Singh

TL;DR: 本文提出了PARITY数据集，用于评估视觉语言模型在面对无法仅凭图像回答的医学诊断查询（如自闭症谱系障碍诊断）时的弃答与拒绝推理能力。研究发现，不同模型在应对此类查询时存在‘拒绝优先型’与‘推测型’的分化，且表情因素会不当影响推测型模型的有害归因。通过临床护栏和单图像提示等干预措施可有效提升模型的弃答率。

Details

Motivation: 针对视觉语言模型被越来越多地用于涉及医学或诊断判断的图像解读，而许多病症（如自闭症）无法仅凭视觉外观诊断，存在安全风险，因此需要评估模型在面对此类无法回答的查询时是否能够正确弃答。

Result: 在PARITY数据集上的审计发现，当代VLMs在应对无法回答的配对图像查询时，模型行为明显分化为拒绝优先型和推测型；在推测型模型中，特定表情会不成比例地触发有害的归因选择。引入临床护栏和单图像提示框架能显著提高模型的弃答率。

Insight: 创新点在于构建了身份可控、人口统计学平衡的合成肖像对数据集PARITY，用于系统评估VLMs在无法回答的医学相关查询上的安全行为。客观分析表明，提示工程和界面设计中的简单干预（如添加临床上下文、避免多图像对比）是缓解模型有害输出的可行且有效的缓解措施。

Abstract: Many medical conditions require diagnosis through detailed, multi-context clinical assessment rather than from visual appearance alone. Despite this, vision-language models (VLMs) are increasingly queried to interpret images in ways that touch on medical or diagnostic judgments, raising safety concerns when such inferences are unsupported. ASD diagnosis requires behavioral and developmental evidence, not static facial photographs. We audit whether VLMs abstain from this unanswerable paired-image query, and whether expressions sway non-abstaining choices. We introduce PARITY (Paired Assessment with Reused Identity), a synthetic, demographically balanced set of identity-controlled neutral/expression portrait pairs with neutral-neutral controls. All identities are synthetic and have no ASD status; because the query is unanswerable from images, any non-abstaining selection is treated as a harmful attribution. Across contemporary VLMs, we find a clear split between refusal-first models and speculative models; in the latter, certain expressions disproportionately trigger harmful selections. Clinical guardrails and single-image framing substantially increase abstention, suggesting actionable mitigations in both prompting and interface design

[61] Video Compression with Graph-inspired Neural Representation cs.CVPDF

Changqi Wang, Ge Gao, Fan Zhang, Yue Li, Kai Zhang

TL;DR: 本文提出了一种名为G-NeRV的图启发的隐式神经表示方法，用于视频压缩。该方法通过构建帧嵌入之间的时序邻域并进行消息传递，显式地利用视频中的时序冗余信息，从而提升了压缩性能。

Details

Motivation: 现有基于隐式神经表示的视频压缩方法以隐式方式利用时序冗余，可能导致次优的压缩性能。本文旨在通过显式地建模和利用帧间的时序相关性来改进这一点。

Result: 在UVG数据集上，基于PSNR指标，G-NeRV编解码器在BD-rate上分别比最先进的基于INR的编解码器NVRC和最新标准编解码器VVC VTM提升了8.86%和14.68%。

Insight: 主要创新点包括：受信息论总相关原则启发，构建时序邻域并通过自适应门控进行消息传递以聚合可重用信息；以及受传统视频编码参考帧缓冲区启发，设计了内存库机制以支持INR训练中随机帧索引采样下的高效时序邻域检索。

Abstract: Implicit Neural Representations (INR) provide a compact and content-adaptive paradigm for video compression, typically representing a video through shared network parameters and frame-indexed embeddings. Compared to conventional or autoencoder-based codecs, these approaches exploit temporal redundancy within videos in an implicit manner, which potentially results in sub-optimal compression performance. In this paper, we propose G-NeRV, a graph-inspired INR that explicitly improves temporal redundancy exploitation in the implicit latent space. Motivated by the total correlation principles in information theory, we construct a temporal neighborhood over frame embeddings and perform message passing to aggregate reusable information from neighboring frames through an adaptive gate controlling the injection of neighboring information. Inspired by the reference frame buffer in conventional video coding, a memory bank mechanism has been further designed to enable efficient temporal-neighbor retrieval under random frame-index sampling in INR training. This new representation model has been integrated into an advanced representation compression framework and compared with existing conventional and neural video codecs. The results show that the G-NeRV codec outperforms the state-of-the-art INR-based codec, NVRC, and the latest standard video codec, VVC VTM, by 8.86% and 14.68% (in BD-rate), respectively, measured by PSNR on the UVG dataset.

[62] An overview of 3D Vision-Language Models cs.CVPDF

Márcus Lobo, Vitor Matias, Afonso Paiva, Jeová Farias, Tiago Novello

TL;DR: 这篇教程论文概述了3D视觉语言模型（3D VLMs）的发展，介绍了从3D表示的基本定义、嵌入编码到跨模态对比对齐、现代多模态框架以及3D视觉大语言模型（3D VLLMs）的全面内容。

Details

Motivation: 传统3D深度学习模型通常针对特定任务（如分类、分割或检测）训练，无法自然支持以文本或图像为查询的跨模态检索，因此需要将3D嵌入与预训练的图像和文本表示对齐，以构建支持零样本分类、跨模态检索和开放词汇3D形状识别的3D VLMs。

Result: 论文未提供具体的定量实验结果，但强调了基于CLIP的方法在3D嵌入对齐上的应用，以及3D VLMs在零样本分类、跨模态检索和开放词汇识别方面的能力。

Insight: 论文的创新点在于系统性地综述了3D VLMs的技术框架，包括对比学习在多模态嵌入对齐中的定义，以及语言引导的3D高斯溅射、3D形状生成和机器人具身AI等前沿进展，为研究者提供了全面的技术路线图。

Abstract: Vision-Language Models (VLMs) are reshaping computer vision by aligning visual and textual embeddings, allowing models to recognize visual concepts and reason about them using natural language. Traditional 3D deep-learning models, however, are typically trained for specific tasks, such as classification, segmentation, or detection, and do not naturally support cross-modal retrieval from their embedding spaces using text or images as queries. To address this issue, Contrastive Language-Image Pretraining (CLIP)-based methods align 3D embeddings with pretrained image and text representations, giving rise to 3D Vision-Language Models (3D VLMs) that support zero-shot classification, cross-modal retrieval, and open-vocabulary recognition of 3D shapes. This tutorial provides an overview of 3D VLMs, ranging from basic definitions of 3D representations and their encoding into embeddings to cross-modal contrastive alignment, modern multimodal frameworks, and 3D Vision-Large Language Models (3D VLLMs). We present the main definitions of contrastive learning for multimodal embedding alignment and highlight recent advances in language-guided 3D Gaussian splatting, 3D shape generation, and embodied AI for robotics.

[63] Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Staging cs.CV | cs.AIPDF

Kunmin Jang, You Rim Choi, Hun Heo, Heonjun Lee, Suahn Bae

TL;DR: 本文提出了一种名为ViNUSS的纯视频睡眠分期框架，旨在仅利用近红外视频数据，在不依赖显式生理信号重建或辅助监督的情况下，推断由多导睡眠图定义的睡眠阶段。该方法结合了主体相对微动学习和整夜睡眠动态建模，在约3,250小时的近红外视频数据上验证了视频本身作为独立信息源的潜力。

Details

Motivation: 解决现有基于视频的睡眠分期方法通常将视频仅用作重建呼吸/心跳等生理代理信号或跨模态生理表征的途径的问题，旨在验证近红外视频本身是否能够提供有信息量的睡眠阶段证据，而不仅仅是恢复生理代理的输入。

Result: 在包含475个整夜近红外记录（约3,250小时）的数据集上，ViNUSS在四分类睡眠分期任务中达到了0.80的准确率和0.78的宏F1分数。可解释性分析表明模型关注了与觉醒和体位变化相关的胸腹周期性运动和整体身体运动。

Insight: 创新点在于提出了一个纯视频原生、无需生理代理中介的睡眠分期框架，其核心是结合了空间锚定的预空间微动编码、主体内阶段对比学习以及双尺度（时段内和整夜）睡眠动态建模，这为利用视频进行独立且互补的生理状态估计提供了新思路。

Abstract: Near-infrared (NIR) video is a promising modality for contactless sleep monitoring, but recent video-based sleep staging methods often use it as a route to reconstructed respiratory/cardiac proxies or cross-modal physiological representations. We study video-only sleep staging under labels defined by polysomnography (PSG), where the model infers sleep stages from NIR video alone without explicit physiological proxy reconstruction or auxiliary physiological signal supervision. This tests whether NIR video itself can provide informative sleep-stage evidence, rather than only serving as an input for recovering physiological proxies. We propose ViNUSS (Video-Native Unmediated Sleep Staging), a framework that combines subject-relative micro-motion learning with full-night sleep dynamics modeling. Spatially anchored pre-spatial micro-motion encoding preserves localized temporal variation together with its spatial context. Within-subject stage contrast learns stage cues with respect to each subject’s night-specific baseline. Two-scale sleep dynamics modeling captures within-epoch motion evolution and organizes epoch-level evidence into a coherent full-night sleep-stage trajectory. On 475 overnight NIR recordings (~3,250 hours), ViNUSS achieves 0.80 accuracy and 0.78 macro-F1 for four-class sleep staging. Interpretability analysis suggests attention to thoraco-abdominal periodic motion and gross body movements associated with arousals and position changes. These results support NIR video as an independently informative and complementary modality for PSG-defined sleep-stage estimation

[64] SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution cs.CVPDF

Xingjian Ran, Xiaoye Mo, Sihao Liu, Jianyu Zhang, Li Luo

TL;DR: 本文提出SceneMosaic框架，用于高效、多样地生成仿真就绪的室内场景。它结合了基于学习的图像先验模型的高效性和基于视觉语言模型（VLM）智能体迭代优化的精确性，通过将场景分解为独立局部单元进行演化，再组合成全局场景，从而在保证物理有效性的同时大幅提升生成速度与多样性。

Details

Motivation: 当前生成多样化、仿真就绪的室内场景存在挑战：基于VLM的智能体流程生成保真度高但迭代成本高昂；基于参数化图像到3D场景的模型效率高但常产生物理无效场景。两者都难以针对单一输入生成多样化场景，无法反映真实场景的动态变化特性。

Result: 在SceneEval-100基准测试上，SceneMosaic在语义布局质量上匹配最强的智能体基线，速度提升24倍，显著减少了物理违规，并获得了最高的人类评分。

Insight: 核心创新在于提出了一种混合范式，利用图像先验快速生成初始候选，再通过VLM智能体进行演化优化。关键洞察是挖掘自然场景的局部性，将场景分解为独立单元进行并行演化，最后通过笛卡尔积组合，这既保证了效率与物理有效性，又实现了场景生成的多样性。

Abstract: Diverse and simulation-ready indoor scenes are essential for interactive entertainment and embodied AI, yet their scalable generation remains challenging. Recent agentic text-to-3D scene pipelines that rely on vision-language models (VLMs) can generate scenes of high fidelity but require costly iterative object placement and refinement. Another mainstream paradigm, parametric image-to-3D scene models, produces scenes efficiently from strong priors learned from 2D images but often leads to imprecise and physically invalid scenes. More importantly, both paradigms struggle to output diverse scenes for a single input, making it hard for them to reflect the dynamically changing nature of real scenes. In this paper we propose \textbf{SceneMosaic}, a framework that combines the merits of both paradigms. It obtains the initial candidate from the learned image-based prior, and subsequently evolves the result through VLM agents, ensuring both efficiency and physical validity. Within the evolution process, SceneMosaic exploits the locality of natural scenes and decomposes a scene into independent local units, allowing separate evolution within each unit before composing the global scene via Cartesian product. On SceneEval-100, SceneMosaic matches the strongest agentic baseline in semantic layout quality with a 24x speedup, substantially reduces physical violations, and receives the highest human ratings. Our code is publicly available at https://github.com/rxjfighting/SceneMosaic.

Masaki Kuribayashi, Zhongkai Shangguan, Eshed Ohn-Bar

TL;DR: 这篇论文提出了一个用于评估多模态大语言模型（MLLM）在辅助导航任务中实时响应能力的大规模基准测试。研究发现，现有MLLM在提供安全、及时的导航指令方面存在根本性局限，并提出了一种通过直接监督预测指令背后原因的有效改进方法，该方法在多种设置下均显著提升了性能。

Details

Motivation: 论文旨在解决交互式视觉-语言智能体在辅助导航（如引导视障人士）中，不仅需要知道“说什么”，更需要知道“何时说”的关键问题，因为不当的时机可能分散用户注意力或增加认知负荷。

Result: 在提出的复杂户外环境第一人称辅助导航基准测试上，即使经过大量数据微调，现成的MLLM在提供安全、及时的指令方面表现不佳。而提出的改进方法在开环、闭环和仿真到现实的泛化设置中均取得了显著的性能提升。

Insight: 论文的创新点在于强调了辅助导航中“时机”的重要性，并构建了相应的基准测试。其提出的通过监督模型预测指令原因（why）来改进指令时机（when）的方法简单有效。分析还揭示了模型在时间推理、安全关键物体感知以及关系和距离理解方面仍存在持续挑战。

Abstract: Can interactive vision-and-language agents learn not just what to say but also \textbf{\textit{when}} to say it? Current language models rarely plan over whether and when to realize a real-time response to a user. However, providing accurate and timely support for human decision-making, such as when guiding visually impaired individuals through urban environments, requires careful real-time responsiveness–poorly timed responses can distract users or add unnecessary cognitive load. As a machine intelligence challenge for Multimodal Large Language Model (MLLM)-based agents, we introduce a large-scale multimodal benchmark for an egocentric, assistive navigation task in complex outdoor environments. Using this benchmark, we uncover a fundamental limitation of off-the-shelf MLLMs in delivering safe and time-sensitive navigation instructions, even with model fine-tuning on substantial amounts of data. We then demonstrate that a simple yet effective modification of the model, including direct supervision to predict the underlying reason for each instruction, yields significant performance gains across open-loop, closed-loop, and sim-to-real generalization settings. However, our analysis highlights persistent challenges in temporal reasoning, safety-critical object awareness, and relational and distance understanding. To advance the development of scalable assistive agents, we will release our simulation, benchmark, and code (available at the project website: https://timeli-icra.github.io/).

[66] Unsupervised Transfer Clustering for Mitigating Cold Start in Active Prompt Learning cs.CVPDF

André Camargo Portella, Samuel Felipe dos Santos, Jurandy Almeida

TL;DR: 本文提出了一种名为UTC+SQ的框架，旨在缓解主动提示学习中的冷启动问题。该方法通过利用最先进的无监督迁移模型生成高质量的伪标签来建立语义连贯的聚类，从而替代传统的基于距离的聚类，以选择更具代表性的样本进行查询。实验表明，该方法在大多数测试数据集上提升了查询子集的代表性和分类准确性。

Details

Motivation: 主动提示学习结合了主动学习和提示学习，能利用视觉语言模型的先验知识迭代查询信息量最大的图像进行标注，但其初始查询性能可能因冷启动问题而较差。现有方法依赖简单的基于距离的聚类来分组特征，难以捕捉视觉语言模型复杂的高维语义分布，导致查询代表性不足。

Result: 实验评估表明，从基于距离的聚类转向基于投影的聚类（即无监督迁移聚类）提高了查询子集的代表性，在测试的8个数据集中，有6个实现了准确率提升。

Insight: 创新点在于将无监督迁移模型集成到主动提示学习框架中，利用其生成的高保真伪标签建立语义上有意义的聚类，从而更有效地选择相关样本。这提供了一种更精细的、基于语义而非单纯几何距离的样本选择策略，以应对冷启动挑战。

Abstract: Vision-Language Models (VLMs) are able to achieve impressive zero-shot classification performance by aligning visual and textual representations, but each new task still demands handcrafted prompts. Active Prompt Learning (APL) combines Active Learning (AL) and Prompt Learning (PL) into a single framework, allowing for the usage of the VLM prior knowledge for iteratively querying the most informative images to be labeled. However, the cold-start problem is still relevant for APL methods, where the performance of the initial query can be worse than random sampling. While recent state-of-the-art APL methods mitigate with balanced sampling and multimodal features, they rely on rigid, distance-based clustering to group these features. This simplistic approach can struggle to capture the complex, high-dimensional semantic distributions inherent to VLMs, leading to suboptimal query representativeness. Unsupervised transfer can be applied to these features as a possible alternative, since it is capable of inferring the underlying human labeling of a task without any form of supervision. This way, samples can be grouped in semantically coherent clusters. This paper proposes Unsupervised Transfer Clustering with Selective Querying (UTC+SQ), a framework that enhances a recent APL approach by leveraging state-of-the-art unsupervised transfer model. These models generate high-fidelity pseudo-labels that establish semantically meaningful clusters, allowing for the selection of more relevant samples. Experimental evaluations demonstrate that shifting from distance-based to projection-based clustering improves the representativeness of the queried subset, achieving accuracy gains in 6 of the 8 datasets tested.

[67] Facial Age Estimation for Age Fraud Detection in National ID Systems cs.CVPDF

Sharib Athar, Arka Koner, Chetan Naik, Barada P. Sabut, Tanusree Deb Barma

TL;DR: 本文提出了SwinAge，一个基于SwinFace架构的面部年龄估计系统，旨在用于印度Aadhaar国家身份系统，以检测与年龄相关的欺诈（如虚报年龄以获取受限服务或福利）。该系统在大型内部数据集上训练，并在特定年龄阈值（5、18、60岁）上评估性能，通过误接受率/误拒绝率（FAR/FRR）报告结果，同时其在多个公共基准数据集上达到了最先进水平。

Details

Motivation: 解决大规模国家身份系统（如Aadhaar）中生物特征注册和更新时的身份欺诈问题，特别是针对虚报年龄以访问年龄限制服务或福利计划的常见欺诈手段。

Result: 在内部测试集上，模型在1%误接受率（FAR）下，误拒绝率（FRR）在5岁、18岁和60岁阈值分别为3%、0.4%和11.0%；平均绝对误差（MAE）为2.94年，优于三个零样本视觉语言模型，并在7个公共基准数据集中5个上改进了最先进水平。

Insight: 创新点包括：将SwinFace架构与基于地标的相似性（仿射变换）对齐结合，针对国家身份系统的具体操作阈值（如5、18、60岁）设计部署分流框架以标记可疑案例供人工审核，并遵循NIST FATE标准报告FAR/FRR而非总体准确率，这为实际部署提供了更实用的评估指标。

Abstract: Identity fraud during biometric enrollment and updates remains a major challenge for large-scale national identity systems. A common fraud vector is misrepresenting one’s age to access age-restricted services or welfare schemes. In this work, we present SwinAge, a facial age estimation system designed for use within the Aadhaar biometric enrollment pipeline, to assist quality-check (QC) operators to flag potential age-related fraud. This is critical for a system like Aadhaar (the world’s largest national identity programme), that holds about 1.5 billion unique identities, with 22.4 million new enrollments and 283 million updates in the last year. Building upon the SwinFace architecture with landmark-based similarity (warp affine) alignment, we train on a large in-house dataset of 1.45 million face images and evaluate on an independent, age-stratified test set of 283K images, both drawn from an ethnically diverse population of 716K unique subjects. We investigate three Aadhaar-specific operational thresholds (5, 18, and 60 years) and propose a deployment triage framework that flags suspected cases for manual review. Following NIST FATE, we report false acceptance/rejection rates (FAR/FRR) at each threshold rather than aggregate accuracy: at 1% FAR the model achieves an FRR of 3% (<5yrs), 0.4% (>18yrs) and 11.0% (>60yrs). SwinAge achieves a mean absolute error (MAE) of 2.94 years on the same test set, outperforming three zero-shot vision language models on all benchmarks, and improving the state-of-the-art on 5 out of 7 public benchmark datasets. We further report per-gender errors and distill lessons for national identity programs.

[68] Bigger Text Encoders Can Hurt CLIP Zero-Shot Performance cs.CV | cs.AIPDF

Samir Char, Carles Domingo-Enrich, Randall Balestriero

TL;DR: 本文研究了CLIP模型中视觉编码器和文本编码器容量分配对零样本性能的影响，发现对于大多数视觉编码器，存在一个最优的文本编码器规模，超过该规模后，即使总参数量增加，零样本性能也会下降。通过利用这一现象，可以设计出比标准ViT-B/16架构参数少55%但性能相当的配置。研究进一步表明，性能下降源于过大的文本编码器导致的过拟合，而采用模态特定的权重衰减系数可以恢复甚至提升性能。几何分析揭示了缩放文本编码器在改善嵌入均匀性与恶化跨模态对齐之间的权衡，这些指标可预测零样本性能。

Details

Motivation: 现有研究将CLIP模型的总规模视为单一变量，未深入探索视觉与文本编码器之间的容量分配如何影响下游性能，本文旨在填补这一空白。

Result: 实验表明，在多个视觉编码器上，存在最优的文本编码器规模，超过后零样本性能下降；通过优化配置，可在减少55%参数的情况下匹配标准ViT-B/16的性能；使用模态特定权重衰减系数可恢复并改进所有退化配置的性能。

Insight: 创新点在于揭示了CLIP模型中编码器容量分配的非单调影响及过拟合机制，提出了模态特定权重衰减的解决方案，并通过几何分析建立了嵌入均匀性、跨模态对齐与零样本性能之间的可预测关系，为高效可靠的CLIP缩放提供了新思路。

Abstract: Contrastive Language-Image Pretraining (CLIP) is a building block of many machine learning applications. Scaling laws have guided resource allocation for large-scale training, yet prior work treats total CLIP model size as a single variable, without exploring how the capacity split between encoders impacts downstream performance. Here, we train multiple CLIP models with different vision and text encoder sizes, revealing that for most vision encoders, there is an optimal text encoder size beyond which zero-shot performance degrades—even as total parameter count increases. Exploiting this behavior yields efficient configurations that match the zero-shot performance of the standard ViT-B/16 architecture with up to 55% fewer parameters. We further show that this degradation stems from overfitting induced by the oversized text encoder, and that using modality-specific weight decay coefficients not only recovers but improves performance across all degraded configurations. A geometric analysis reveals a trade-off in which scaling the text encoder improves embedding uniformity but worsens cross-modal alignment; we further show that these metrics are predictive of zero-shot performance. We hope these findings motivate CLIP architectures and training methods that counteract this degradation, a prerequisite for scaling CLIP reliably and efficiently.

[69] SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation cs.CV | cs.AIPDF

Hongyu Wu, Xu Wu, Tianhao Wu, Jiawei Yu, Phuc Nguyen

TL;DR: 本文提出SeRV（语义对齐残差向量量化）方法，用于解决美国手语（ASL）生成中因配对文本-动作数据有限和动作表示学习困难而面临的挑战。该方法通过结合句子级动作-文本对齐和标记级文本条件监督，学习语义结构化的残差标记空间，并基于分层GPT模型以从粗到细的方式预测残差动作标记，从而生成结构连贯且语义对齐的3D ASL动作。

Details

Motivation: 现有ASL生成方法依赖为重建优化的动作标记器，缺乏来自配对文本的显式语义监督，导致学习到的标记在支持语义一致和细粒度的ASL动作生成方面存在局限。

Result: 在How2Sign和YouTube-ASL数据集上，SeRV在375小时的ASL视频实验中实现了最先进的姿态精度，并直接从文本生成语义一致的3D ASL动作。

Insight: 创新点在于提出语义对齐的残差向量量化标记器，通过多级语义监督（句子级和标记级）构建结构化标记空间，以及利用分层GPT进行从粗到细的生成，这为低资源条件下的动作生成任务提供了可借鉴的语义对齐框架。

Abstract: American Sign Language (ASL) generation remains challenging due to limited paired text-ASL motion data and the difficulty of learning motion representations both precise for reconstruction and predictable from linguistic input. Existing methods rely on motion tokenizers optimized for reconstruction, without explicit semantic supervision from paired text. As a result, the learned tokens remain limited in supporting semantically consistent and fine-grained ASL motion generation. To address this limitation, we propose SeRV (Semantic-Aligned Residual Vector Quantization), a semantic-aligned RVQ tokenizer for ASL generation. SeRV learns a semantically structured residual token space by combining sentence-level motion-text alignment with token-level text-conditioned supervision. Building on this tokenizer, a Hierarchical GPT predicts residual motion tokens in a coarse-to-fine manner, generating structurally coherent and semantically aligned 3D ASL motion. We further construct a large-scale reconstructed 3D ASL motion-text benchmark by recovering paired 3D motion from YouTube-ASL videos. Experiments across 375 hours of ASL video show that SeRV achieves state-of-the-art pose accuracy on both How2Sign and YouTube-ASL datasets, while producing semantically consistent 3D ASL motion directly from text.

[70] GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims cs.CV | cs.AIPDF

Yifan Zhang, Kai Wang

TL;DR: 本文提出了GeoContext基准，用于评估视觉语言模型在两种地理定位任务中的表现：GeoHint（基于真实但粗略的位置提示进行开放式定位）和GeoVerify（验证图像是否在声称地点150米范围内）。该基准通过构建一个按距离和可参考性分层的上下文阶梯，揭示了模型对用户提供的位置上下文存在两种失败模式：对位置提示的扁平化依赖以及对位置声明的错误确认。

Details

Motivation: 现有视觉地理定位基准通常忽略用户常提供的位置上下文，因此需要评估模型在真实场景中如何利用此类上下文进行定位或验证。

Result: 在覆盖30个城市109个地点的基准上评估了五个视觉语言模型，结果显示：模型对提示的重复率在不同距离和可参考性层级变化很小，但定位误差随提示距离增加而稳步上升；模型表现强烈依赖于无上下文时的性能；在GeoVerify任务中，没有模型能在150米容忍度外的诱饵上达到d’=1的检测能力，且83.8%的错误接受发生在高置信度情况下。

Insight: 创新点在于构建了可系统评估位置上下文影响的基准，并揭示了模型对位置提示的依赖模式（如扁平化响应）和验证任务中的高置信度错误确认问题，为改进视觉语言模型的地理空间推理提供了重要洞见。

Abstract: Visual geolocation benchmarks typically ask a model where an image was captured without accounting for the location context that users often provide. We introduce GeoContext, a resource supporting two complementary tasks: GeoHint, open-ended localization given a true but coarse location hint, and GeoVerify, binary verification of whether an image was taken within 150 m of a claimed place. GeoContext constructs a context ladder by stratifying nearby reference points according to distance and referenceability, allowing the image to remain fixed while the supplied context varies. The benchmark covers 109 sites in 30 cities and evaluates five vision-language models using 21,933 GeoHint responses and 6,270 GeoVerify responses. Our evaluation reveals three main patterns. First, hint repetition varies by only 1.5 percentage points across referenceability tiers and by less than 3 points across distance bands, while the resulting localization error increases steadily with hint distance. Second, behavior depends strongly on no-context performance: at sites with low no-context accuracy, the median ratio between localization error and hint distance is approximately 1.00, whereas at higher-accuracy sites it ranges from 0.24 to 0.69. After correcting for bias introduced by the site grouping procedure, only one of the five models retains a negative accuracy estimate when given a nearby hint. Third, in GeoVerify, no model reaches d’ = 1 for decoys immediately beyond the 150 m tolerance. Model rankings also change when sensitivity is separated from response bias, and 83.8% of false acceptances are reported with confidence of at least 0.8. We release the benchmark, construction pipeline, audit decisions, and scoring code.

[71] AAMBERS-UAV: Acquisition-Aware Multimodal Backbone Evaluation and Ranking for UAV Weedy Rice Segmentation cs.CV | cs.LGPDF

Tarek Rahman, Nazim-E-Alam, Md Kishor Morol, Jannatun Noor

TL;DR: 该论文提出了AAMBERS-UAV框架，用于评估和排序无人机图像中杂草水稻分割任务的多模态骨干网络。研究通过设计目标采集保持（target-held-out）和目标采集暴露（target-exposed）两种协议，分析了数据采集划分对模型性能和模态排名的影响。实验表明，采集暴露会普遍提升性能，但最佳模态的选择（如RGB、多光谱MS或RGB+MS融合）取决于网络架构。

Details

Motivation: 现有无人机图像语义分割基准通常在图像级别划分数据集，这可能导致同一采集的数据同时出现在训练和测试集中，从而无法准确评估模型在全新调查数据上的泛化能力。

Result: 在WeedyRice-RGBMS-DB数据集上，SegFormer-B0在目标采集保持协议下RGB模态表现最佳（IoU 0.7317±0.0201），而在目标采集暴露后RGB+MS融合模态表现最佳（IoU 0.7822±0.0269）。U-Net/ResNet18的复现实验则显示RGB始终是最佳模态。

Insight: 研究强调了在无人机多模态基准测试中，采用采集感知的评估协议（即确保测试集来自完全独立的采集）作为传统图像级划分的必要补充。同时发现，早期融合对RGB与MS数据的空间位移非常敏感，而对辐射度缩放相对鲁棒。

Abstract: UAV image collections contain spatially and temporally related frames, yet semantic-segmentation benchmarks commonly split them at image level. Such splitting can place samples from one acquisition in both model development and testing, obscuring transfer to a genuinely new survey. Using the 734-sample WeedyRice-RGBMS-DB, we fix a 124-image target-acquisition test set and compare two protocols with identical train, validation, and test counts: target-held-out, which excludes the target acquisition from development, and target-exposed, which admits its remaining images. SegFormer-B0 is evaluated with RGB, four-band multispectral (MS), and seven-channel RGB+MS input over two fixed-split seeds. RGB is strongest under complete acquisition holdout ($0.7317\pm0.0201$ IoU), whereas RGB+MS becomes strongest after target exposure ($0.7822\pm0.0269$). A fixed-split U-Net/ResNet18 replication confirms positive exposure gains for all three inputs, but retains RGB as the best modality under both protocols. Acquisition exposure therefore increases measured performance across both evaluated backbones, while its effect on modality ranking is architecture-dependent. A supplied-split audit reveals strong near-sequential dependence, and corruption tests show that early fusion is substantially more sensitive to RGB–MS displacement than to moderate radiometric scaling. These results support acquisition-aware same-test evaluation as a necessary complement to ordinary image-level splitting in multimodal UAV benchmarks. The code and supporting the findings of this study will be publicly released upon acceptance of the paper.

[72] CoRe-SAM3: Conditional Semantic–Visual Reconciliation for SAM3 Crack Segmentation cs.CVPDF

Shipeng Liu, Liang Zhao, Dengfeng Chen

TL;DR: 本文提出了CoRe-SAM3方法，用于改进SAM3基础模型在裂缝分割任务上的性能。该方法通过诊断SAM3内部语义与视觉表征的功能差异，设计了一个条件语义-视觉调和模块，以轻量级的方式校准语义预测并利用视觉证据进行有界、正则化的残差修正，从而显著提升分割精度。

Details

Motivation: 尽管SAM3具备强大的开放概念分割能力，但直接应用于裂缝分割时，仍存在漏检弱裂缝、误激活背景区域以及局部边界错误等问题。论文旨在通过分析模型内部表征的功能差异，提出一种高效的领域自适应策略来解决这些问题。

Result: 在五个裂缝数据集上，CoRe-SAM3将平均Crack IoU从62.34%提升至70.47%，clDice从81.98%提升至89.24%。预测转换分析表明，该方法平均修正了34.38%的原始错误，同时对SAM3正确分类像素的损害率仅为0.23%。

Insight: 论文的核心创新在于揭示了基础模型内部语义与视觉表征在特定任务（如裂缝分割）中的功能差异，并据此设计了一个参数高效（仅18.914K可训练参数）的条件残差修正机制。这为具有强任务先验的视觉基础模型提供了一种有效的目标领域自适应范式，即利用表征差异进行有约束的预测校正。

Abstract: Crack segmentation requires a model to recognize target semantics while accurately recovering thin, low-contrast, and topologically continuous local structures. Although SAM3 provides strong open-concept segmentation, its direct application to the crack domain still misses weak cracks, activates crack-like background regions, and produces local boundary errors. We first diagnose the functional differences between the internal prompt-conditioned semantic representation and native visual representation of SAM3 on five crack datasets. The results show that the semantic representation already carries most task information for crack prediction, whereas the utility of the visual representation depends on the current semantic state. Directly combining the two representations does not yield consistent gains. Based on this finding, we propose Conditional Semantic–Visual Reconciliation, termed CoRe. CoRe retains semantic prediction as the primary decision path, applies lightweight semantic calibration to adjust the target-domain decision mapping, and uses spatially aligned native visual evidence to generate a zero-initialized, bounded, and regularized conditional residual that selectively corrects existing predictions. Across five domains, CoRe-SAM3 improves the average Crack IoU from 62.34% to 70.47% and clDice from 81.98% to 89.24%, while introducing only 18.914 K trainable parameters. Prediction-transition analysis further shows that CoRe corrects an average of 34.38% of native errors, with a damage rate of only 0.23% on pixels correctly classified by native SAM3. These results demonstrate that constrained prediction correction based on the functional differences between internal representations provides an effective and parameter-efficient target-domain adaptation strategy for vision foundation models with strong task-specific semantic priors.

[73] UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment cs.CVPDF

Yongzhe Lyu, Shaofei Wang, Yixin Chen, Siyuan Huang

TL;DR: 本文提出UniFusion，一个统一的时空深度对齐框架，用于解决稀疏视角视频4D重建中因视角重叠有限和时间变化导致的单目深度预测不一致问题。该方法将多视角、多时间点的深度图表示为时空神经场，联合优化跨视角和跨时间的不一致性，无需依赖前景分割或跟踪模型。对齐后的深度用于初始化和监督高斯溅射模型，以进行4D重建。

Details

Motivation: 稀疏视角视频的4D重建通常依赖单目深度估计提供先验，但有限的跨视角重叠和时间变化导致深度预测在视角间和时间上不一致。现有方法将空间和时间对齐分开处理，需要前景分割掩码且未能利用时间线索进行跨视角对齐。

Result: 在Ego-Exo4D和EgoHuman数据集上的实验表明，改进的深度对齐方法显著提升了基于动态高斯溅射的重建方法在新时间/视角合成以及几何精度/一致性方面的性能。

Insight: 创新点在于提出了一个统一的时空深度对齐框架，通过时空神经场隐式捕获深度图间的时空相关性，无需外部分割/跟踪模型。同时结合多视角深度顺序损失和经典的尺度-平移不变损失来提升深度质量，为动态高斯溅射重建提供了更好的初始化与监督。

Abstract: In this paper, we address the challenging problem of 4D reconstruction from sparse-view videos. This setup usually relies on monocular depth estimation to provide priors for the reconstruction model. A key challenge arises from limited cross-view overlap and temporal variation, making monocular depth predictions inconsistent across views and time. Existing methods align spatial and temporal dimensions in separate stages, requiring foreground segmentation masks while failing to leverage temporal cues for cross-view alignment. Contrary to these methods, we propose a unified spatial-temporal depth alignment framework that jointly resolves cross-view and cross-time inconsistencies without distinguishing foreground/background. Our method represents depth maps across views and time as a set of spatio-temporal neural fields. This representation not only yields fast convergence, but also captures spatio-temporal correlation among depth maps implicitly, without dependence on external segmentation/tracking models. We also propose a multi-view depth-order loss while leveraging the classic scale-and-shift-invariant loss to further improve the final depth quality. The aligned depths initialize and supervise Gaussian splatting models for 4D reconstruction. Experiments on Ego-Exo4D and EgoHuman demonstrate that our improved depth alignment substantially benefits dynamic Gaussian-splatting-based reconstruction methods for novel-time/view synthesis and geometry accuracy/consistency.

[74] Hierarchical Prompt Injector for Domain Generalization Segmentation cs.CVPDF

Xin Kun Lin, Ruoyu Guo, Jiaqi Guo, Maurice Pagnucco, Yang Song

TL;DR: 本文提出了一种用于领域泛化语义分割（DGSS）的新方法，通过引入空间分层提示（SHP）和分层提示注入器（HPI）来解决现有方法在编码类别提示和空间自适应方面的不足。SHP为每个类别提供多个区域级几何锚点以捕获不同视角下的结构外观，而HPI则实现了在基础模型中根据语义相关性和空间影响力进行空间自适应的提示注入。该方法在合成到真实和真实到真实的基准测试中分别达到了70.62%和72.74%的mIoU。

Details

Motivation: 领域泛化语义分割（DGSS）面临挑战，因为视觉模型通常依赖于跨领域变化的低层外观线索，而结构属性则具有跨领域稳定性。现有方法使用提示学习将结构先验转移到DGSS模型中，但通常将每个类别编码为单一的整体提示，并且均匀地应用于所有像素，缺乏在视角变化、遮挡和环境变化导致仅部分对象区域可见时的自适应机制。

Result: 在合成到真实和真实到真实的基准测试中，该方法分别取得了70.62%和72.74%的mIoU，达到了领域泛化语义分割的先进水平（SOTA）。

Insight: 创新点包括：1）空间分层提示（SHP）通过区域级几何锚点丰富类别表示，确保在任意视角下的互补覆盖；2）分层提示注入器（HPI）通过建模提示的语义相关性和空间影响力，实现空间自适应的提示注入；3）引入辅助监督以对齐分层提示与对应的对象区域，解决了学习空间和语义感知提示注入的困难。这些方法增强了模型对结构先验的利用和跨领域泛化能力。

Abstract: Domain Generalized Semantic Segmentation (DGSS) is a challenging task, as vision models often rely on low-level appearance cues that change across domains. In contrast, structural attributes exhibit cross-domain stability, motivating the use of structural priors for DGSS. Existing methods use prompt learning to transfer such priors into DGSS models, but typically encode each class as a single holistic prompt. Moreover, these methods apply prompts uniformly to all pixels, offering no mechanism to adapt when only a subset of object regions is visible due to viewpoint changes, occlusion, and environmental variation. We address this with \textbf{Spatial Hierarchical Prompts (SHP)} that enrich each class with region-level geometric anchors capturing structural appearance from distinct viewing angles, ensuring complementary coverage under arbitrary viewpoints. Additionally, we propose the \textbf{Hierarchical Prompt Injector (HPI)}, which enables spatially adaptive prompt injection in foundation models. HPI spatially grounds prompts by modeling their semantic relevance and spatial influence with visual features. Considering the difficulty of learning spatially and semantically aware prompt injection, we further introduce auxiliary supervision to align hierarchical prompts with their corresponding object regions. We achieve 70.62% and 72.74% mIoU on synthetic-to-real and real-to-real benchmarks, respectively. Code and checkpoints are released at https://github.com/MosukFate/HPI

[75] GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models cs.CVPDF

Changpeng Zhao, Yiren Song, Jinpeng Wang

TL;DR: 本文提出了GenPuzzle基准测试，旨在评估图像生成模型在视觉推理和问题解决方面的能力。该基准包含12个赛道共2005个问题，涵盖模式补全、空间构造、迷宫、数独等多种视觉谜题类型，要求模型在保持输入状态的同时生成逻辑有效的解决方案图像。

Details

Motivation: 现有图像生成评估主要关注美学、提示对齐和组合性，但缺乏对模型能否解决视觉问题并忠实以像素表达解决方案的测试，因此需要专门的基准来填补这一空白。

Result: 在三个前沿生成模型上的测试表明，最强模型仅达到40.57的宏观总体得分，揭示了模型在逻辑、几何、状态保持和指令执行方面存在频繁失败。

Insight: 创新点在于构建了一个专注于视觉推理的综合性图像生成基准，并设计了针对不同任务类型的自动化评估协议（包括程序化验证和基于多模态大语言模型的评分准则），为衡量图像生成从渲染向问题解决的进展提供了测试平台。

Abstract: Recent image generation systems increasingly combine multimodal understanding, reasoning, and synthesis, suggesting that they may do more than render plausible scenes. Yet existing evaluations emphasize aesthetics, prompt alignment, compositionality, or text-based answers, leaving unclear whether these systems can solve visual problems and faithfully express solutions in pixels. We introduce GenPuzzle, a benchmark for reasoning-centric image generation. GenPuzzle contains 2,005 problems across 12 tracks, spanning pattern completion, spatial construction, mazes, Sudoku, nonograms, tangrams, board games, matchstick puzzles, orthographic projection, and mathematical visual proof. Each task provides a visual puzzle and requires an image output that preserves the input state while executing a logically valid solution. GenPuzzle uses task-specific evaluation protocols: discrete grid outputs are transcribed and verified programmatically, while visually complex outputs are assessed with tiered, multidimensional, or binary multimodal large language model (MLLM) rubrics. We further select the automatic judge by measuring agreement with human reference scores. Across three frontier generators, the strongest model reaches only 40.57 Macro Overall, revealing frequent failures in logic, geometry, state preservation, and instruction execution. GenPuzzle provides a testbed for measuring progress from image rendering toward visual problem solving.

Yichen Guo, Tinghao Wang, Qizhe Zhang, Lingbei Meng, Yuan Zhang

TL;DR: 本文提出了一种无需训练的两阶段视觉令牌剪枝框架STAR-Pro，旨在高效减少大型视觉语言模型中的视觉令牌数量。该方法首先通过自适应阶段构建一个覆盖广泛视觉特征的候选令牌池，然后在渐进阶段根据跨模态注意力演化逐步精炼保留的令牌，以实现高比例剪枝的同时保持模型性能。

Details

Motivation: 大型视觉语言模型处理数百至数千个视觉令牌带来巨大计算开销，现有一次性剪枝方法会丢弃大量视觉信息且无法适应跨模态融合过程中注意力动态变化，因此需要一种既能保留广泛视觉覆盖又能渐进精炼令牌的剪枝策略。

Result: 在涵盖多种架构的七个LVLM模型和18个图像与视频基准测试上，STAR-Pro在激进剪枝下表现优异；例如在LLaVA-Video-7B上，实现了90.5%的视觉令牌减少，保留了92.7%的基线性能，并获得了2.24倍的实测推理加速。

Insight: 创新点在于揭示了跨模态融合中文本到视觉注意力的深度依赖性，并据此设计了分阶段自适应剪枝框架；其核心思想是将剪枝决策从一次性静态选择转变为动态渐进精炼，通过结合特征覆盖度与注意力演化来平衡信息保留与计算效率。

Abstract: Large vision-language models (LVLMs) achieve strong multimodal understanding, but the hundreds to thousands of visual tokens they process impose substantial computational overhead, motivating training-free visual token pruning. In this work, we conduct two complementary analyses of visual token pruning. First, we measure the feature-space coverage of tokens retained before cross-modal fusion and find that aggressive pruning discards substantial visual information. Second, we track text-to-visual attention across decoder layers and find that the visual tokens considered important change substantially with depth, making one-shot pruning decisions unreliable. Together, these findings show that effective pruning should preserve broad visual coverage before fusion and progressively refine the retained tokens as cross-modal evidence evolves during fusion. We therefore propose STAR-Pro (STage-Wise Adaptive Token Reduction with Progressive Refinement), a training-free two-stage framework. Its Adaptive Stage applies pivoted QR to construct an over-budget feature-coverage candidate pool, while its Progressive Stage uses evolving text-to-visual attention at selected decoder layers to prune a nested survivor set under a target layer-average token budget. Extensive experiments across seven LVLMs spanning multiple architectures and 18 image and video benchmarks demonstrate the effectiveness of STAR-Pro under aggressive pruning. On LLaVA-Video-7B, STAR-Pro reduces visual tokens by 90.5%, retains 92.7% of baseline performance, and achieves a $2.24\times$ measured inference speedup. Code is available at https://github.com/EasonAI-5589/starpro.

[77] PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes cs.CVPDF

Bangxun Tang, Heyuan Gao, Yiren Song, Guian Fang, Zijian He

TL;DR: PAI-Actor是一个用于动态电影场景中多角色替换的电影级动画框架。它旨在替换真实视频片段中的多个角色，同时保持原始场景动态、摄像机运动和背景内容。该框架通过结构引导的人物恢复方法和电影驱动的训练流程，结合双向到自回归的蒸馏框架，实现了高保真、场景一致且高效的长视频生成。

Details

Motivation: 传统动画系统主要驱动单个静态图像或单一主体，而本论文的目标是在真实视频片段中替换并动画化多个角色，同时保持原始场景的动态、摄像机运动和背景内容。这一设定极具挑战性，因为生成的角色必须在运动和互动上与源表演保持一致，同时还需在光照、阴影、构图和整体电影外观上与周围背景匹配。

Result: 实验表明，PAI-Actor能够实现高保真的多角色动画，具有强大的场景一致性、电影级视觉质量和高效的长视频生成能力。

Insight: 论文的创新点在于将多角色动画制定为结构引导的人物恢复问题，并构建了从高质量电影数据驱动的训练流程。此外，引入的双向到自回归蒸馏框架（先训练一个用于1080P高质量短片段生成的双向扩散Transformer，再将其蒸馏为自回归的视频到视频模型）兼顾了生成质量与推理效率，支持实际电影制作中的长视频生成需求。

Abstract: We present PAI-Actor, a cinematic multi-character animation framework for character replacement in dynamic movie scenes. Unlike conventional animation systems that mainly drive a single static image or a single subject, our goal is to replace and animate multiple characters within real video clips while preserving the original scene dynamics, camera motion, and background content. This setting is particularly challenging because the generated characters must remain consistent with the source performance in motion and interaction, while also matching the surrounding background in lighting, shadow, composition, and overall cinematic appearance. To address this, we formulate multi-character animation as a structure-guided human recovery problem and build a movie-driven training pipeline from high-quality film data. Furthermore, to support practical cinematic production, we introduce a bidirectional-to-autoregressive distillation framework: we first train a bidirectional diffusion transformer for high-quality short-clip generation at 1080P resolution, and then distill it into an autoregressive video-to-video model for efficient inference and longer video generation. Experiments show that PAI-Actor enables high-fidelity multi-character animation with strong scene consistency, cinematic visual quality, and efficient long-form generation.

[78] Beyond Classification: Structured Supervision Aligns Visual Evidence with Medical Semantics cs.CVPDF

Hexiang Bai, Hanyang Xu, Xiaoxue Li, Xiaoliang Wu, Shangde Gao

TL;DR: 本文系统研究了超越传统全局图像分类的预训练范式，以解决Vision Transformers在医学图像分析中因空间坍缩而过度依赖背景线索的问题。通过对比图自监督、分割和图像-文本对齐三种结构化监督方法，发现跨模态语义对齐能最有效地将视觉证据与医学语义对齐，从而提升模型在下游分类任务中的性能和可解释性。

Details

Motivation: 标准ViT预训练通过全局图像分类进行，导致模型出现空间坍缩，即过度依赖背景捷径而非定位关键的前景病灶。为了克服这一局限并使视觉证据与精确的医学语义对齐，本文旨在探索替代的结构化监督预训练范式。

Result: 在多个下游临床分类任务上进行微调后，采用图像-文本对齐预训练的模型取得了卓越的准确性，并生成了高度可解释的、聚焦于真实病理特征的注意力图，其性能远超传统的分类基线模型。

Insight: 论文的核心创新在于系统性地比较了三种结构化监督预训练范式，并实证了跨模态语义对齐（图像-文本对）的优越性。该方法不仅通过嵌入高维诊断逻辑将注意力锚定在精确的视觉证据上，还实现了深刻的抽象推理，从而从根本上增强了模型的特征表示能力。

Abstract: Vision Transformers (ViTs) have shown immense potential in medical image analysis. However, standard pre-training via global image classification suffers from spatial collapse, where models rely heavily on background shortcuts rather than localising critical foreground lesions. To overcome this limitation and align visual evidence with precise medical semantics, we systematically investigate alternative pre-training paradigms.Specifically, we evaluate three independent forms of structured supervision: topological priors via graph self-supervision, dense pixel-level constraints via segmentation, and cross-modal semantic grounding via image-text pairs. Notably, our empirical analysis reveals that while all three forms of structured supervision successfully alleviate the global pooling bottleneck and steer visual attention towards foreground regions, image-text alignment achieves the most superior performance. By embedding high-dimensional diagnostic logic, the cross-modal approach not only anchors attention on precise visual evidence but also enables profound abstract reasoning. Extensive experiments demonstrate that this semantically enriched pre-training fundamentally enhances the model’s feature representation. Consequently, when fine-tuned for downstream clinical classification tasks, our models achieve superior accuracy and yield highly interpretable attention maps focused on true pathological features, vastly outperforming vanilla classification baselines.

[79] FineHOI: Part-Aware Dense Representations for Zero-Shot Human-Object Interaction Detection cs.CVPDF

Francesco Tonini, Lorenzo Vaquero, Mohammad Mahdi Derakhshani, Cees Snoek, Elisa Ricci

TL;DR: 本文提出FineHOI框架，用于零样本人-物交互检测，通过自适应部件级注意力模块将人和物体分解为语义一致的部分，并基于交互相关性重新加权，结合区域感知交互变换器集成部件感知和全局特征，以提升对未见过交互的泛化能力。

Details

Motivation: 现有基于视觉语言模型的方法依赖全局或检测器中心特征，压缩了交互线索并阻碍细粒度空间推理，而人-物交互由局部空间关系定义，因此需要显式建模密集补丁级特征以克服这一限制。

Result: 在零样本HOI检测任务上，FineHOI在多个基准测试中一致优于现有方法，特别是在未见交互上取得了显著提升。

Insight: 创新点在于通过无监督聚类实现部件级分解和自适应注意力重加权，结合变换器集成多尺度特征，增强了模型对局部交互关系的建模能力，为零样本HOI检测提供了更细粒度的表示方法。

Abstract: Human-Object Interaction (HOI) detection aims to localize humans and objects in images and classify their interactions. Zero-shot HOI focuses on recognizing interactions that are not observed during training, requiring models to generalize beyond seen verb-object compositions. Recent approaches leverage Vision-Language Models (VLMs), benefiting from rich semantic representations. However, they often rely on global or detector-centric features that compress interaction cues and hinder fine-grained spatial reasoning. To overcome this limitation, we propose FineHOI, a zero-shot HOI framework that explicitly models interactions from dense patch-level features. Our approach is motivated by the observation that human-object interactions are defined by localized spatial relationships, which are not preserved by global and detector-centric representations. To this end, we introduce an Adaptive Part-Level Attention module that decomposes humans and objects into semantically coherent parts via unsupervised clustering, and re-weights them based on their interaction relevance. These representations are then integrated through a Region-Aware Interaction Transformer that integrates part-aware and global features and produces the final HOI embedding. Extensive experiments demonstrate that FineHOI consistently outperforms existing zero-shot HOI methods, achieving particularly strong gains on unseen interactions. Code is available at https://github.com/francescotonini/fine-hoi.

[80] ProtoRAG: Prototype-Based Retrieval Augmentation for Few-Shot Fine-Grained Remote Sensing Object Detection cs.CVPDF

Jian Wang, Yuxiang Hong, Chufeng Zhou, Chao Pang, Xiaokang Zhang

TL;DR: 本文提出了ProtoRAG，一个基于原型的检索增强框架，用于解决遥感图像中少样本细粒度目标检测的挑战。该框架将多模态大语言模型的粗定位能力与外部对象级视觉记忆解耦，通过判别性原型空间学习和不确定性引导的候选约束推理策略，增强模型对视觉相似子类别的识别能力。

Details

Motivation: 遥感图像中的少样本细粒度目标检测面临标注数据有限且需要区分视觉相似子类别的双重挑战。现有的多模态大语言模型虽然能提供粗定位，但缺乏可靠的视觉证据进行细粒度识别。

Result: 在MAR20、HRSC2016和FAIR1M-2.0三个数据集上的九种少样本设置中，ProtoRAG均超越了代表性基线方法，分别以14.80、2.27和4.04 mAP$_{50}$的优势超过了最强基线，达到了SOTA水平。

Insight: 创新点在于将粗定位与细粒度识别解耦，并引入基于判别性原型学习的视觉记忆库。通过监督对比学习和原型一致性正则化学习稳定且具有判别性的原型表示，并设计不确定性引导的推理策略，仅在模糊实例上调用多模态推理，提高了效率与准确性。

Abstract: Few-shot fine-grained object detection (FGOD) in remote sensing imagery is challenging because limited annotations must support both object localization and discrimination among visually similar subcategories. Although multimodal large language models (MLLMs) provide strong coarse object localization, they lack explicit visual evidence for reliable fine-grained recognition. To address this limitation, we propose ProtoRAG, a prototype-based retrieval-augmented framework that decouples coarse localization from fine-grained recognition by equipping MLLMs with an external object-level visual memory. To construct a reliable visual memory from limited support samples, we introduce Discriminative Prototype Space Learning (DPSL), which encourages discriminative and prototype-stable representations through supervised contrastive learning and prototype-consistency regularization. We further develop an uncertainty-guided candidate-constrained reasoning strategy that augments MLLMs with retrieved candidate-specific visual references and invokes multimodal reasoning only for ambiguous instances. Extensive experiments show that ProtoRAG consistently surpasses representative baselines in nine few-shot settings, outperforming the strongest baselines by 14.80, 2.27, and 4.04 mAP$_{50}$ on MAR20, HRSC2016, and FAIR1M-2.0, respectively.

[81] Test-Time Weak-to-Strong Alignment: Transferring Implicit Rewards from Weak to Strong Flow Models cs.CVPDF

Xin Xie, Fan Zhang, Dong Gong

TL;DR: 本文提出了一种名为AlignGraft的测试时弱到强对齐方法，通过利用一对弱对齐模型（源对齐对）在采样过程中提供隐式奖励监督，从而无需在测试时访问奖励函数或其梯度，即可引导冻结的大型流模型（如Stable Diffusion 3.5、FLUX、Wan）实现对齐。该方法允许任务特定和样本特定的指导，并能将对齐强度外推至超过源对齐对的水平。

Details

Motivation: 现有对齐方法（如强化学习或偏好优化）需要为每个检查点重复训练，且模型在训练后固定于特定奖励和强度；测试时对齐方法虽能引导冻结模型，但通常依赖奖励函数本身或其梯度作为每步信号。本文旨在探索能否通过模型自身（而非外部奖励函数）提供监督，实现跨模型规模的隐式奖励转移。

Result: 在图像和视频流模型（Stable Diffusion 3.5、FLUX、Wan）上的广泛实验表明，该方法能提升冻结大型模型在偏好、组合和文本渲染奖励上的性能，有时甚至超过源对齐模型本身，同时以较小的恒定采样开销保持大模型的保真度。

Insight: 创新点在于将监督源从外部奖励函数改为弱对齐模型对（源对齐对），该对存储了训练奖励作为隐式、逐步、KL锚定的信号，并利用其在采样过程中的速度差精确传输对齐信号。这使得一次弱模型的对齐运行产生的监督能被整个模型家族在测试时重用，实现了高效的跨规模知识转移。

Abstract: Aligning a text-to-image generation flow model with a reward makes it follow objectives that the training data alone does not provide. Alignment fine-tuning delivers this by reinforcement learning (RL) or preference optimization, but it must be repeated for every checkpoint and returns a model fixed at the reward and strength it was trained with. Test-time alignment instead steers a frozen model during sampling, allowing task-specific and sample-specific guidance. Existing methods obtain this only by drawing the per-step signal from the reward function itself, through its gradient, or through a separately trained value function. We propose changing the supervision source: let a pair of weak models, not a reward function, supply the supervision. A source aligned model, kept together with its base as a source alignment pair, stores its training reward as an implicit, step-wise, KL-anchored signal expressed in the sampler’s own coordinates. We explore whether this model-form supervision can cross scale, and show that it does: our method, AlignGraft, aligns a larger, frozen, never-tuned model by adding the pair’s velocity difference during sampling. The transport is exact under a shared noising kernel and needs neither the reward nor its gradient at test time. The method has no schedules, only a single scalar that controls the alignment strength and can extrapolate it beyond that of the source alignment pair. Across image and video flow models (Stable Diffusion 3.5, FLUX, and Wan), the transfer lifts the frozen large model on preference, compositional, and text-rendering rewards, can exceed the source aligned model itself, and preserves the large model’s fidelity at a small constant sampling overhead. Extensive experiments show that one alignment run on a weak model produces supervision that the whole model family can reuse at test time.

[82] Geometry-Aware Test-Time Learning for Quantitative Spatial Reasoning cs.CV | cs.AIPDF

Gege Zhang, Shuaicheng Niu, Gang Dai, Lei Sun, Shuangping Huang

TL;DR: 本文提出了一种名为TTL-SR的几何感知测试时学习框架，旨在提升视觉语言模型在定量空间推理任务上的鲁棒性。该方法通过在测试时利用未标注数据和几何一致性约束来适应目标域，解决了模型在分布偏移下预测不一致的问题。

Details

Motivation: 视觉语言模型在定量空间推理任务中，面对新颖物体配置或重述的空间查询时，常产生不一致或矛盾的预测，这源于3D监督成本高导致的模型表示与底层几何结构错位。

Result: 在Q-Spatial-ScanNet数据集上，TTL-SR显著提升了空间推理性能，使Qwen3-VL-4B-Instruct和SpatialRGPT-VILA-1.5-8B模型的准确率分别提高了6.47%和9.41%。

Insight: 创新点在于提出了一个无需额外标注的测试时学习框架，通过几何耦合辅助查询、自适应几何触发构建伪标签以及几何感知多目标损失，利用测试数据自身来增强模型的几何一致性表示能力。

Abstract: Quantitative spatial reasoning in visual-language models (VLMs) aims to infer spatial distances and directional relationships among objects in 3D space from a 2D image and a natural language query. Despite recent progress, VLM spatial reasoning remains brittle under distribution shifts, largely due to the high cost of 3D supervision. As a result, models often produce inconsistent or contradictory predictions when faced with novel object configurations or rephrased spatial queries, revealing a misalignment between learned representations and underlying geometry. To address this, we propose TTL-SR, a geometry-aware Test-Time Learning framework for quantitative Spatial Reasoning that leverages geometric consistency constraints and unlabeled test data to adapt models to target domains. Specifically, TTL-SR augments the input query with geometrically coupled auxiliary queries, filters unreliable predictions via adaptive geometric triggering to construct structured token-level pseudo-labels, and updates model parameters under a geometry-aware multi-objective loss using only test data. Experimental results demonstrate that TTL-SR significantly boosts spatial reasoning performance, yielding 6.47% and 9.41% accuracy gains for Qwen3-VL-4B-Instruct and SpatialRGPT-VILA-1.5-8B on Q-Spatial-ScanNet dataset, respectively.

[83] What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations cs.CV | cs.AIPDF

Robert Nolting, Alexandra Schild, Moritz Weckbecker, Maximilian Schall, Gerard de Melo

TL;DR: 本文研究了基于视觉Transformer（ViT）的动物重识别（Re-ID）模型是否在表征空间中学习到有意义的生物学概念（如性别和年龄）。通过使用DINOv3骨干网络并在西部低地大猩猩数据集上进行三元组损失微调，研究发现性别和年龄在表征空间中呈现为线性方向，这些方向可泛化到未见个体，且具有因果性影响。研究还表明，Re-ID训练并未创造这些概念，而是重新定位了它们，并且这些表征具有冗余编码和视觉模糊个体塑造的特点。

Details

Motivation: 解决野生动物监测中相机陷阱图像分析自动化需求，并探究基于ViT的动物重识别模型是否学习到可解释的生物学概念，以增强模型决策的可信度和可审计性。

Result: 在西部低地大猩猩Re-ID任务中，性别和年龄作为线性方向在表征空间中被识别，达到最高0.91的AUROC，且可从单张图像中恢复；激活导向实验证实性别方向对模型预测具有因果影响。

Insight: 创新点在于揭示Re-ID模型在无显式监督下自发组织生物学概念为线性表征，并通过数据归因和激活导向等方法验证其可解释性，为野生动物监测的可审计计算机视觉提供了新见解。

Abstract: Conservation increasingly relies on camera traps that collect more wildlife imagery than experts can manually analyze, making animal re-identification (Re-ID) essential for monitoring individuals and populations. Yet understanding which cues drive model decisions is challenging for ViT-based Re-ID models, whose metric-learning objectives provide no explicit supervision for biological concepts. We ask whether such models nonetheless organize their representations along biologically meaningful axes. Using a DINOv3 backbone fine-tuned for Western lowland gorilla Re-ID with triplet-margin loss, we find that sex and age emerge as linear directions that generalize to held-out individuals, reaching up to 0.91 AUROC and being recoverable from a single image per individual. Activation steering further shows that the sex direction is causally used by the model, flipping a significant fraction of predictions to the opposite sex. Comparing off-the-shelf and fine-tuned backbones shows that Re-ID training does not create these concepts, but relocates them across the network. Finally, data attribution reveals that the representation we find reflects a graded biological axis, is redundantly encoded across the population and shaped by visually ambiguous individuals. Together, these findings show how interpretability can uncover both the biological structure and failure modes of Re-ID representations, providing a step toward auditable computer vision for wildlife monitoring.

[84] Image-Scale Robustness and Visual Recognition Performance: A Cross-Architecture Analysis cs.CV | cs.AIPDF

Anish Monsley Kirupakaran

TL;DR: 本文研究了不同视觉识别模型对图像尺度变化的鲁棒性，发现模型在ImageNet-1K上的基线准确率与尺度鲁棒性之间存在强烈的负相关关系，而模型参数量、架构家族和表示稳定性对此关系影响甚微。

Details

Motivation: 视觉识别模型对图像尺度变化的敏感性已被广泛认知，但不同异构架构之间影响这种敏感性的因素尚不明确，本文旨在探究尺度鲁棒性是否在现代视觉模型中存在共同的定量结构。

Result: 在20个预训练的ImageNet-1K分类器（涵盖卷积、移动、高效和Transformer等七种架构家族）上，基线准确率与特征尺度（表征识别性能开始显著下降的尺度）呈强负相关（Pearson r = -0.890），且该关系在多种稳健性检验中保持稳定。

Insight: 创新点在于提出了一个量化尺度鲁棒性的经验框架（特征尺度），并揭示了尺度鲁棒性主要由基线识别性能主导，而非模型大小、架构家族或表示稳定性，这为后续理论探索提供了可复现的规律。

Abstract: The sensitivity of visual recognition models to changes in image scale is well established, yet the factors governing this sensitivity across heterogeneous architectures remain unclear. In this work, we investigate whether scale robustness exhibits a common quantitative structure across modern vision models. We evaluate 20 pretrained ImageNet-1K classifiers spanning seven architectural families, including convolutional, mobile, efficient, and Transformer-based architectures. By systematically reducing input image scale, we construct scale-accuracy response curves and define a characteristic scale as a compact measure of the onset of substantial recognition degradation. We then examine the relationship between characteristic scale and baseline recognition accuracy, model parameter count, architectural family, and representation stability. A strong inverse association is observed between baseline accuracy and characteristic scale (Pearson r = -0.890, R^2= 0.792, p < 10^-6). This relationship remains stable under bootstrap resampling, leave-one-architecture-out analysis, and leave-one-family-out analysis. In contrast, parameter count provides negligible additional explanatory power after controlling for baseline accuracy (p = 0.80), while architectural family does not provide significant incremental explanatory power. Furthermore, characteristic scale shows essentially no association with representation stability (r = -0.003, p = 0.991). These results indicate that, across the studied models, scale robustness is strongly organized by baseline recognition performance rather than simply by model size, architectural family, or representation stability. The study provides an empirical framework for characterizing scale robustness across vision architectures and identifies a reproducible accuracy-scale regularity that warrants further theoretical investigation.

[85] DriveZero: End-to-End Driving Beyond Human Demonstrations cs.CVPDF

Hao He, Chengcheng Hu, Zirun Su, Heng Zhang, Haisong Liu

TL;DR: DriveZero是一个端到端自动驾驶系统，它通过分解驾驶为感知模型和动作模型，分别进行预训练后结合，超越了传统基于人类驾驶日志模仿学习的限制。感知模型DriveVFM整合了多个冻结的视觉基础模型，无需任务特定标注；动作模型DriveRL采用混合智能体闭环强化学习框架，在交互世界中训练特权教师策略。该系统在nuPlan、NAVSIM和HUGSIM等基准测试中实现了最先进的性能。

Details

Motivation: 现有端到端自动驾驶系统通常通过模仿人类驾驶日志学习，其行为受限于记录轨迹的质量和覆盖范围，无法超越人类演示。本文旨在开发一个能学习超越人类演示的驾驶行为的系统。

Result: 在nuPlan基准上，DriveRL在Val14、Test14-hard和Test14-random社区划分的非反应和反应模式下平均得分93.57，超过了Log-Replay专家。DriveZero在NAVSIMv1、NAVSIMv2和闭环HUGSIM基准上实现了最先进的性能，且无需任何人类轨迹监督。

Insight: 创新点在于将驾驶任务解耦为感知和动作两个模型，并针对各自特点采用不同的学习范式（感知利用大规模视觉数据，动作依赖闭环反馈）。通过整合冻结的视觉基础模型构建感知骨干，以及利用强化学习在交互世界中训练特权教师策略，实现了超越人类演示的多样化、目标一致的监督信号。

Abstract: Most end-to-end autonomous-driving systems learn by imitating human driving logs, leaving their learned behavior constrained by the quality and behavioral coverage of the recorded trajectories. This report presents DriveZero, an end-to-end system that learns driving behavior beyond human demonstrations. It decomposes driving into a perception model and an action model, pretrains each in the regime best suited to it, and combines them into one end-to-end planner. The two models call for different learning recipes: perception must understand the world, and benefits from massive and diverse visual data; action must interact with it, and requires closed-loop feedback. On the action side, we introduce DriveRL, a mixed-agent closed-loop reinforcement-learning framework. It converts real driving logs into interactive worlds, where a privileged teacher policy is trained with PPO through closed-loop rollouts. For the perception model, DriveVFM consolidates multiple frozen vision foundation models, including DINOv3, SigLIP2, SAM and Depth Anything V2, into a single backbone from raw images alone, requiring no task-specific annotations. DriveZero then unifies the two: a camera-only planner that distills the frozen DriveRL teacher through its rolled-out trajectories. The goal-conditioned teacher can moreover be queried under augmented driving intents, yielding diverse, goal-consistent supervision that logged data cannot provide. On nuPlan, DriveRL with value-guided test-time action search achieves a mean score of 93.57 across the Val14, Test14-hard, and Test14-random community splits in both non-reactive and reactive modes, exceeding the Log-Replay expert on all three splits. DriveZero achieves state-of-the-art performance on NAVSIMv1, NAVSIMv2 and the closed-loop HUGSIM benchmark without any human trajectory supervision.

[86] GradeTrap: Authority Cues in Images Shift VLM Judgments Despite Explicit Instructions to Ignore Them cs.CV | cs.CL | cs.CY | cs.LGPDF

Deep Dessai

TL;DR: 该论文提出了GradeTrap评估框架，用于测试视觉语言模型在面对相互冲突的社会线索时，能否独立判断而非盲目服从权威。研究发现，尽管被明确指示忽略所有学生答案和评分标记，模型在面对来自教师或官方答案的权威线索时，其判断仍会显著偏向权威方，而非独立评估证据。

Details

Motivation: 随着视觉语言模型在现实世界关键场景中的部署，需要确保它们能够独立评估证据，而非不加批判地服从人类权威。论文旨在量化模型在面对权威线索（如教师评分、官方答案）与学生答案冲突时，其判断被权威影响的程度。

Result: 在Gemini 3.5 Flash-Lite、GPT-5.6 Luna和Claude Haiku 4.5三个模型共有的45个测试项上，与一个通用的第二答案控制组相比，教师评阅线索使模型选择冲突答案的概率增加了6.9个百分点，而官方答案线索则增加了19.5个百分点。相比之下，仅显示一个冲突的学生答案影响很小。

Insight: 论文的创新点在于设计了GradeTrap这一受控评估框架，将社会线索（学生答案与权威答案）置于直接冲突中，以量化权威线索对VLM判断的‘陷阱’效应。客观来看，该研究揭示了即使有明确的忽略指令，VLMs仍存在显著的‘权威服从’偏差，这对模型在需要独立判断的真实场景（如教育、评估）中的部署提出了重要的可靠性问题。

Abstract: As vision-language models (VLMs) become increasingly capable and are deployed in consequential real-world settings, they must evaluate evidence independently rather than defer uncritically to human authority. We introduce GradeTrap, a controlled evaluation that places two social cues in direct conflict: a student answer, which should attract sycophantic agreement, and a conflicting answer attributed to a peer, teacher, or official answer key, which should attract authority-based deference. Models produce free-form answers while being explicitly instructed to solve independently and ignore all student answers, feedback, and grading marks. We test the models on 60 synthetic real-world trade-off scenarios. Five neutral trials establish a stable model-relative preference, followed by three repetitions of six experimental cues including controls. On the 45-item common intersection across Gemini 3.5 Flash-Lite, GPT-5.6 Luna, and Claude Haiku 4.5, a generic second-answer control yields 5.4% conflicting-answer selection. Relative to that control, pooled within-item changes show no reliable peer-review effect, a 6.9-point teacher-review effect, and a 19.5-point official-key effect. In contrast, a displayed conflicting student answer alone compared to a displayed student reference answer alone only raises selection from 2.2% to 5.2%. Official-key provenance therefore redirects judgements more than a student answer or the generic second-answer control, despite an explicit ignore instruction and an opposing student answer given along with the official key. Effects vary in magnitude across the three models.

[87] Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation cs.CVPDF

Chang Liu, Henghui Ding, Lingyi Hong, Ning Xu, Linjie Yang

TL;DR: 本文总结了ECCV 2026期间举办的第八届大规模视频目标分割（LSVOS）挑战赛。该挑战赛在三个互补场景下评估视频分割：基于MOSEv2的复杂半监督视频目标分割、基于MeViSv2-Text的文本引导参考视频目标分割以及基于MeViSv2-Audio的音频引导参考视频目标分割。报告描述了任务和评估协议，并回顾了每个赛道前三名团队的方法。

Details

Motivation: 挑战赛旨在评估和推动视频目标分割技术在复杂、多模态场景下的发展，解决传统单模型掩码传播方法在物体身份识别、查询有效性验证和时间可靠性等方面的局限性。

Result: 报告总结了各赛道前三名团队的结果，但未提供具体的定量指标（如mIoU或J&F分数）或与SOTA的直接比较。评估是在MOSEv2、MeViSv2-Text和MeViSv2-Audio三个基准上进行的。

Insight: 主要创新点在于领先解决方案普遍从单一模型掩码传播转向模块化流程，整合了基础分割模型、目标感知记忆、多模态推理、显式目标存在性验证、智能体交互和纠正性跟踪等技术，这代表了该领域的一个重要范式转变。

Abstract: This report summarizes the 8th Large-scale Video Object Segmentation (LSVOS) Challenge, held in conjunction with ECCV 2026. The challenge evaluates video segmentation in three complementary settings: complex semi-supervised video object segmentation on MOSEv2, text-guided referring video object segmentation on MeViSv2-Text, and audio-guided referring video object segmentation on MeViSv2-Audio. We describe the tasks and evaluation protocols and review the methods of the top three teams in each track. Across the nine leading solutions, foundation segmentation models are combined with target-aware memory, multimodal reasoning, explicit target-existence verification, agentic interaction, and corrective tracking. These systems illustrate a broader transition from single-model mask propagation toward modular pipelines that reason about object identity, query validity, and temporal reliability.

[88] Automatic Red Teaming for Implicit Vulnerabilities of Text-to-Image Models cs.CVPDF

Chang Ma, Junlin Han, Shuo Chen, Runjia Li, Philip Torr

TL;DR: 本文提出了一种名为AdvPIE的多模态智能体框架，用于自动红队测试文本到图像（T2I）模型中难以检测的隐式对抗性提示。该框架包含一个策略智能体和一个评判智能体，通过迭代反馈生成和优化看似无害但能诱导生成不当图像的隐式提示，无需访问目标模型参数。

Details

Motivation: 解决T2I模型安全部署中的关键挑战：针对隐式对抗性提示进行红队测试。这类提示在文本层面看似良性，却能诱导生成不当视觉内容，比显式提示更难检测和防御。

Result: 在标准和经过安全对齐的T2I模型上进行的大量实验表明，AdvPIE能有效暴露隐式漏洞，其性能优于多种基线方法。

Insight: 创新点在于提出了一个无需模型参数访问的多模态智能体框架，通过策略智能体与评判智能体的交互迭代优化提示，并引入了新颖的累积对抗解码策略，动态调整令牌分布以在保持采样多样性的同时增强生成有害图像的能力。这为自动化、高效地发现模型深层安全漏洞提供了新思路。

Abstract: Red-teaming Text-to-Image (T2I) models is essential for safe deployment, yet it remains particularly challenging against implicit adversarial prompts. Unlike explicit adversarial prompts that can be readily identified and blocked, implicit ones are much harder to detect: the prompts appear benign on the text surface yet still lead to inappropriate visual content. To address this, we propose Adversarial Probing for Implicit VulnErabilities (AdvPIE), a multimodal agentic framework to expose implicit vulnerabilities without requiring access to the parameters of target models. AdvPIE adopts a policy agent to generate and refine implicit adversarial prompts based on the feedback from a judge agent. To construct informative feedback, the judge agent provides modality-specific safety evaluation at both global and relative levels across iterations. To effectively leverage the feedback, we propose a novel Cumulative Adversarial Decoding strategy for the policy agent, which dynamically reweights token distributions to favor tokens that lead to more harmful images while preserving sampling diversity. Extensive experiments on standard and safety-aligned T2I models show that AdvPIE1 effectively uncovers implicit vulnerabilities, outperforming various baseline methods.

[89] PASTEL: Panoramic Alignment for Monocular 4D Scene Reconstruction cs.CVPDF

Yuankun Yang, Yi Wei, Bo Bai, Wenyang Zhou, Li Zhang

TL;DR: PASTEL提出了一种从单目视频进行4D场景重建的新范式，通过结合可见区域重建与不可见区域生成，实现了超出相机可见范围的场景合成。该方法引入全景场景对齐表示，将复杂的3D不可见区域探索转化为可处理的2D方向轨迹规划，从而在保持视角偏差最小的同时最大化探索不可见区域。

Details

Motivation: 现有4D重建方法通常无法恢复相机可见范围之外的区域，限制了虚拟现实和具身AI等应用。论文旨在解决单目视频输入下，如何合成超出观测边界的合理场景内容的问题。

Result: 在DyCheck IPhone数据集上，PASTEL在全图像PSNR指标上比之前的最先进方法提升了0.9dB，能够合理外推输入单目视频观测边界之外的场景内容，并显著提升单目4D重建性能。

Insight: 创新点在于提出了全景场景对齐表示，将6自由度视角规划简化为带显式可见边界的2D方向搜索，从而将不可见区域生成问题转化为可处理的轨迹规划问题。这为单目4D重建提供了新的视角合成策略，可借鉴于其他需要外推或补全的场景理解任务。

Abstract: Reconstructing 4D scenes from casually captured monocular video is vital for applications in virtual reality (VR) and embodied AI. Recent advances in 4D reconstruction and novel view synthesis have substantially propelled this capability. However, existing reconstruction methods generally cannot recover regions beyond visible camera limits. Consequently, we introduce a new paradigm that achieves 4D scene synthesis by combining visible-region reconstruction from monocular input with invisible-region generation beyond observable camera boundaries. We present Panoramic Alignment for Strategic Exploitation of Generative Priors (PASTEL). Specifically, PASTEL proposes panoramic scene alignment, a novel representation that reformulates the intractable 3D “invisible region” exploration into a tractable 2D directional trajectory planning. This is achieved by reducing the viewpoint planning from 6-DoF search to a 2D directional search with explicit visibility boundaries. By operating within this panoramic space, our method strategically identifies camera trajectories that maximize exploration beyond observable boundaries while minimizing viewpoint deviation. Experimental results show that PASTEL can not only extrapolate plausible scene content beyond the observable boundaries of input monocular videos, but also substantially boost monocular 4D reconstruction performance. PASTEL outperforms the previous state-of-the-art method by 0.9dB in full-image PSNR on the DyCheck IPhone dataset.

[90] TBDub: Production-Oriented Visual Dubbing cs.CVPDF

Bihan Li, Xinyang Li, Zeran Xu, Meiguang Jin, Junfeng Ma

TL;DR: TBDub是一个面向生产环境的视觉配音系统，它在X-Dub的基础上，通过任务自适应的后训练和任务感知的少步蒸馏，提升了在直播和生成视频内容中的鲁棒性、时间与运动稳定性、身份与口腔细节保持以及推理效率。

Details

Motivation: 现有X-Dub方法在处理直播和生成视频内容时，在生产域鲁棒性、时间与运动稳定性、身份与口腔细节保持以及推理效率方面存在局限，TBDub旨在解决这些问题。

Result: 在38个TalkVid视频片段上，其30步教师模型在全部8个重建、感知、身份和同步指标上均优于X-Dub；在MOS评估中，教师模型在唇部同步一致性、身份一致性和视觉质量上分别提升了0.14、0.95和0.90分，而2步学生模型在唇部同步和视觉质量上得分最高，身份一致性接近教师模型，且在单张H20 GPU上实现了7.13有效FPS，总延迟降低了13.93倍。

Insight: 核心创新在于结合了任务自适应的后训练（使用生产域数据、特定条件与过滤、增强音频特征）和任务感知的少步蒸馏，将视频DiT模型压缩为高效的两步学生模型，在显著提升推理速度的同时，基本保持了生成质量和视听同步性能。

Abstract: Visual dubbing must synchronize mouth motion with replacement speech while preserving identity, appearance, and temporal consistency. Although X-Dub provides a strong mask-free video-editing baseline, its application to livestream and generated-video content reveals limitations in production-domain robustness, temporal and motion stability, identity and oral-detail preservation, and inference efficiency. We present \textbf{TBDub}, a production-oriented extension of X-Dub that combines task-adaptive post-training with task-aware few-step distillation. Post-training adapts the video DiT using production-domain data, production-specific conditioning and filtering, and enhanced audio features to obtain a 30-step Teacher. Distillation adapts DMD/DMD2 to conditional video editing and compresses the Teacher into a two-step Student. On 38 TalkVid clips, the Teacher improves all eight reported reconstruction, perceptual, identity, and synchronization metrics over X-Dub. In the MOS evaluation, it improves lip-sync consistency, identity consistency, and visual quality over X-Dub by 0.14, 0.95, and 0.90 points, while the Student achieves the highest lip-sync and visual-quality scores and remains close to the Teacher in identity consistency. In paired end-to-end generation timing from the first VAE encode through the final VAE decode on a single NVIDIA H20 GPU at $512\times512$, the Student reaches 7.13 effective FPS and reduces total latency by $13.93\times$; the DiT stage alone is accelerated by $42.49\times$. The Student largely retains the Teacher’s generation quality and audiovisual synchronization. The code is available on GitHub at \https://github.com/TaoLiveAIGC/TBDub, and the 30-step Teacher and two-step Student weights are available on Hugging Face at https://huggingface.co/TaoLiveAIGC/TBDub.

[91] Multiple Myeloma Lesion Segmentation on Whole-Body Diffusion-Weighted Imaging via Efficient Anatomical Anticipation and Multimodal Confirmation cs.CV | cs.AIPDF

Mengmeng Zhang, Shengqian Huang, Junde Zhou, Xiaoping Wu, Hao Luog

TL;DR: 本文提出了一种用于全身扩散加权成像（WB-DWI）上多发性骨髓瘤（MM）病变分割的两阶段框架。第一阶段从ADC图像中无监督地生成骨ROI作为解剖先验；第二阶段提出了解剖引导的多模态U-Net（AMU-Net），以更符合临床评估的方式利用ADC信息。

Details

Motivation: 解决WB-DWI上自动分割MM病变的挑战，现有方法依赖成本高昂的骨ROI标注或对ADC的简单融合，无法有效利用解剖结构和病变鉴别信息。

Result: 在评估的方法中取得了最佳整体性能，平均Dice分数达到76.2%。

Insight: 创新点在于：1）无需专用骨标签，从ADC图像高效生成解剖先验（骨ROI）；2）提出AMU-Net，以临床评估一致的方式（而非简单通道融合）利用ADC模态，提供互补的结构和病变鉴别线索。

Abstract: Whole-body diffusion-weighted imaging (WB-DWI) is widely used for multiple myeloma (MM) assessment, yet automated lesion segmentation remains challenging due to limited anatomical delineation and the low specificity of marrow hyperintensity. Existing studies have introduced bone region-of-interest (ROI) information and apparent diffusion coefficient (ADC) maps to mitigate these ambiguities, but practical limitations remain. Bone ROI construction often relies on costly manual annotation, image registration, or dedicated bone models, while ADC is usually incorporated only through simple channel fusion, limiting its ability to provide complementary structural and lesion-discriminative cues. To address these limitations, we propose a two-stage framework for MM lesion segmentation on WB-DWI. In the first stage, we train a bone ROI generation model from ADC images without dedicated bone labels, providing an efficient and practical anatomical prior for lesion analysis. In the second stage, we propose Anatomy-guided Multimodal U-Net (AMU-Net), which leverages ADC in a manner consistent with clinical lesion assessment rather than treating it as a generic auxiliary modality. Extensive experiments demonstrate the effectiveness and practicality of the proposed method. It achieves the best overall performance among the evaluated methods, with a mean Dice score of 76.2%.

Rasul Khanbayov, Mariam Sohail, Ahmed Abdala, Hasan Kurban

TL;DR: 本文探讨了行为AI评估中扰动测试的有效性，指出单一扰动不足以证明模型对输入的使用，并推导出识别输入依赖所需的最小扰动数量。通过理论分析，作者揭示了未报告盲基线的现有评估方法的缺陷，并在视觉-语言模型上进行实验，发现模型输出与输入无关，仅依赖于预设的校准值。

Details

Motivation: 动机在于解决行为评估中单一扰动测试的局限性，即无法可靠地证明AI系统是否真正使用了输入信息，从而避免误判模型能力。

Result: 在三个视觉-语言模型上应用三个扰动的完整识别集进行实验，结果显示所有模型得分远低于其盲基线，输出仅依赖于少量预设校准值，且无法通过扰动改变响应。

Insight: 创新点在于从线性代数角度形式化扰动测试的识别条件，强调需要至少n个独立扰动来评估n个输入，并推导出未使用输入时的盲基线分数，为评估方法提供了理论依据和实际基准。

Abstract: Behavioral evaluations perturb an input and read the induced change in the output in order to certify that a system uses that input. We show that the number of perturbations such a certificate requires is fixed, and that reporting a single perturbation cannot supply it. Where a response ratio is a property of the policy rather than of the test items, the behavioral record is a linear measurement of an exponent vector recording how much the output depends on each input, so perturbations identify input use exactly when their logarithms span the input space. At least $n$ are needed for $n$ inputs, an incomplete design confuses precisely the policies differing along the kernel of its design matrix, and sharpening a perturbation never substitutes for adding an independent one. We also derive in closed form the score such a test awards a policy that reads nothing, which is far from zero and which none of the probes we survey reports. Instantiating this where the correct response is fixed by dimensional analysis, we run a complete identifying set of three perturbations on three vision–language models reporting a physical quantity from video. All three score far below their own blind bound rather than above it, because each defaults to one of a small set of round calibration values that never matches what the scale asserts; none moves its relabeling response by a single exponent, and none is separable from the same model instructed to ignore the video.

[93] From Gaze to Meaning: A Training-Free AI Agent for Unified Grounding and Explanation cs.CVPDF

Shayan Nasiriboukani, Sara Atito, Mohammad Nezamipour, Muhammad Awais

TL;DR: 本文提出了一种无需训练的Gaze Target Agent（GTA），利用预训练的视觉-语言模型，通过视觉引导提示和基于记忆的检索策略，在无需额外训练的情况下，实现了对注视目标预测、注意力定位和物体识别等任务的统一推理。

Details

Motivation: 现有方法通常依赖大量训练且缺乏可解释性，难以在没有大量监督的情况下联合推理注视目标、关注物体和视觉定位。

Result: 在GazeFollow和GazeHOI基准测试上达到了最先进的性能，定性分析显示其能提供详细的语义预测，即使在真实标签错误时也能预测正确目标，且不受词汇限制。

Insight: 创新点在于首次提出了无需训练的注视目标代理，通过提示工程和记忆检索增强预训练模型，实现了跨任务的统一、可解释的视觉推理，避免了模型再训练的开销。

Abstract: Understanding human attention is fundamental for scene interpretation, yet existing approaches often rely on heavily trained models that lack interpretability. Prior methods struggle to jointly reason about gaze targets, attended objects, and visual grounding without extensive supervision. To the best of our knowledge, this work introduces the first training-free Gaze Target Agent (GTA) for gaze-guided reasoning across tasks such as gaze target prediction, attention localization, and object identification. This is achieved by leveraging pretrained vision-language models, augmenting them with visually guided prompts, and employing a memory-based retrieval strategy for high-uncertainty samples to improve performance without additional training. We evaluate our approach using both quantitative metrics and qualitative results. Quantitatively, our method achieves state of the art performance on the GazeFollow and GazeHOI benchmarks. Qualitatively, our agent provides detailed semantic predictions, predicts the correct targets even when ground truth labels are wrong, and remains flexible without vocabulary constraints.

[94] PhysWeep: Does a Video Generator Realize the Physics You Ask For? cs.CVPDF

Rasul Khanbayov, Hasan Kurban

TL;DR: PhysWeep是一个用于评估图像到视频生成器物理参数实现准确性的基准测试框架。它通过将生成器视为黑盒，从生成的像素中恢复实际实现的物理参数，并量化生成结果的可追踪性、请求值与实现值之间的偏差，以及分析文献中提出的失败机制。

Details

Motivation: 现有评估方法主要依赖合理性评分，即判断生成的视频片段在运动上是否看起来自然，但这无法检测出视频看起来自然但编码了错误物理参数值的情况。PhysWeep旨在填补这一空白，直接测量生成器实现的物理参数与请求参数之间的差距。

Result: 在三个开源生成器上对六个物理参数轴进行测试，PhysWeep发现了一种具体、可复现且先前未记录的失败模式：在产生可追踪运动的情况下，其中两个生成器会产生自信且拟合良好的动态，但这些动态收敛于少数固定的错误值，这些值由采样种子而非请求参数决定，且该现象在两个独立的模型家族、两个物理系统和一个独立的追踪器上复现。

Insight: 该研究揭示了当前视频生成器在物理参数控制上存在系统性偏差，其失败模式（种子条件性的错误常数锁定）不同于文献预期的回归或基于案例的钳制，且合理性评分在结构上无法检测此类失败。这强调了需要超越表面合理性、直接评估参数实现准确性的新基准的重要性。

Abstract: Image-to-video generators are often credited with absorbing physical dynamics as implicit world models, a claim the community currently checks with plausibility scores that ask whether a clip looks consistent with real-world motion. Plausibility is the wrong test on its own, because a clip can look natural while encoding the wrong value of the governing physical parameter, and no existing benchmark measures this gap directly. PhysWeep closes it with a fixed, label-free audit, treating a frozen generator as a black box, recovering the realized parameter from generated pixels, and reporting how often generation is trackable at all, how far the realized value sits from the requested one, and which, if either, of the literature’s two proposed failure mechanisms the data support. A deterministic-simulator positive control confirms every score is exactly checkable. Applied to three open generators across six sweep axes, PhysWeep finds a specific, reproducible, previously undocumented failure. Conditional on producing trackable motion, two of the three generate confident, well-fit dynamics that converge to one of a small number of fixed, wrong values selected by the sampling seed rather than by the request, reproducing across two independent model families, two physical systems, and an independent tracker. It matches neither the prior reversion nor the case-based clamping the literature anticipates, because the reversion target is seed-conditional rather than a single global default, and a leave-one-out selection rule rejects both; the in-range faithfulness slope is statistically indistinguishable from zero wherever a response is estimable at all. A benchmark averaging over seeds would never see this: each sample is confidently locked to a wrong constant, exactly the failure a plausibility score is structurally blind to. We release the protocol, suite, and analysis code.

[95] Spatial Attention Supervision for Defect Localization: Exploiting Ground-Truth Masks as Training Signal in Diffusion-Augmented Defect Detection cs.CV | cs.LG | eess.IVPDF

Sajjad Rezvani Boroujeni, Muskan Saraf, Gnana Tulasi Makineni, Tom Bush, Hossein Abedi

TL;DR: 本文提出了一种利用缺陷真实掩码作为空间注意力监督信号的方法，用于训练工业缺陷检测分类网络。该方法通过引入激活对齐损失，引导卷积特征图聚焦于缺陷区域，并结合DDPM数据增强，在MVTec-AD基准上显著提升了基于激活的缺陷定位性能，而分类性能保持不变。

Details

Motivation: 工业检测数据集中通常仅用于评估的真实缺陷掩码未被充分利用。本文旨在将这些掩码重新用作训练过程中的空间监督信号，以教导模型不仅预测缺陷类别，还能关注缺陷位置。

Result: 在MVTec-AD瓶类基准测试中，该方法显著提升了基于激活的定位性能（Pixel-AUROC）：EfficientNetB0提升18.0%，ResNet50提升18.7%。实验覆盖了85个模型，包括四种CNN主干和Swin-V2-T基线，发现空间表示较弱的架构受益最大，而ConvNeXt-T无显著效果。无监督方法PatchCore仍保持最佳定位性能（Pixel-AUROC=0.983）。

Insight: 创新点在于将评估用的真实掩码转化为训练时的空间注意力监督信号，通过激活对齐损失实现混合监督（支持无掩码样本如扩散生成图像）。客观来看，该方法提供了一种简单有效的途径，利用现有标注提升模型的可解释性和定位精度，尤其适用于数据增强与空间监督存在协同效应的场景。

Abstract: Ground-truth defect masks in industrial inspection datasets are typically reserved for evaluation. This paper repurposes them as spatial supervision signals during training of classification networks, teaching a model not just what to predict but where to look. The method adds an activation-based attention alignment loss that steers convolutional feature maps toward defect regions, in a mixed-supervision formulation that also accommodates samples without masks, such as diffusion-generated images. Combined with DDPM augmentation, synthetic images contribute quantity while masks contribute spatial precision. We evaluate 85 models (four CNN backbones under a 2x2 data/training factorial over five seeds, plus a Swin-V2-T transformer baseline) on the MVTec-AD bottle benchmark, with localization measured on held-out defect images excluded from classifier gradient updates. Main findings: (1) attention-guided training improves activation-based localization (Pixel-AUROC) by +18.0% for EfficientNetB0 with augmentation (p=0.005, Cohen’s d=2.6) and +18.7% for ResNet50 (p=0.008), significant in four of eight CNN settings (uncorrected for multiple comparisons) with no significant change in classification; (2) for EfficientNetB0 a data x training-mode interaction is significant (p=0.002), consistent with a super-additive effect (+13.6% combined vs +1.6% summed individual effects); (3) architectures with weaker spatial representations benefit most, whereas ConvNeXt-T shows no effect, apparently because its depthwise-convolution activations yield spatially uninformative channel-mean maps; (4) unsupervised PatchCore remains the strongest localizer (Pixel-AUROC=0.983), contextualizing the supervised gains. These results show that existing evaluation masks can act as practical training signals that measurably and reproducibly improve where defect classifiers attend.

[96] One Model, Two Worlds: Bidirectional Sonar-Optical Translation cs.CVPDF

Shengji Jin, Trung Tien Dong, Ahmed Lamidi, Chen Chen, Xiaomin Lin

TL;DR: 本文提出了一种统一的声纳-光学图像双向翻译模型DARB，通过方向不对称的物理先验路径（声纳到光学采用距离感知调制，光学到声纳采用极射线依赖处理）共享扩散桥主干，并结合自适应真实感监督（ARS）优化训练对称性，使单个模型在双向任务上均达到或超越专用单向模型的性能。

Details

Motivation: 解决水下感知中声纳与光学图像双向翻译需要独立模型导致的存储和计算冗余问题，同时克服现有方法对两个方向物理成像差异处理不足的缺陷。

Result: 在声纳到光学翻译上，PSNR仅比专用模型低0.11 dB；在光学到声纳翻译上，FID优于专用模型0.70；在八个评估指标中的七个上超越两个独立训练的BBDM模型。

Insight: 创新点在于方向不对称的物理先验路径设计（DARB）和基于重建质量与梯度平衡的自适应真实感监督（ARS），实现了物理差异解耦下的模型共享与高效训练。

Abstract: Translating between imaging sonar and optical cameras is valuable for underwater perception, but supporting both directions with separate models duplicates storage and computation. A unified bidirectional model is therefore attractive, yet existing approaches largely treat the two directions symmetrically despite their fundamentally different image-formation physics. We argue that sharing a generative model does not require sharing the physics. We introduce the Direction-Asymmetric Realism Bridge (DARB), which retains a shared diffusion-bridge trunk while routing direction-specific physical priors through asymmetric pathways: range-aware modulation for sonar-to-optical translation and polar ray-dependent processing for optical-to-sonar translation. We further show that symmetry in training is also costly: applying a common realism schedule reduces sonar-to-optical PSNR by 2.60 dB. Our Adaptive Realism Supervision (ARS) instead determines when, where, and how strongly perceptual supervision is applied from reconstruction quality and gradient balance. Together, DARB and ARS enable one bidirectional model to match the sonar-to-optical specialist within 0.11 dB PSNR, outperform the optical-to-sonar specialist by 0.70 FID, and surpass two independently trained BBDMs on seven of eight metrics.

[97] Adapting Vision Foundation Models to Acoustics for Pose-Free 3D Sonar Reconstruction cs.CVPDF

Kevin Zhang, Jingxi Chen, Mohamad Qadri, Russell Shomberg, Michael Kaess

TL;DR: 本文提出了一种将视觉基础模型适配到声纳领域的方法，通过利用视觉与声纳模态间的几何关系以及基于物理的合成数据生成，实现了无需姿态信息的3D声纳重建。

Details

Motivation: 水下环境浑浊且低可见性，使得传统RGB视觉基础模型无法适用，而缺乏大规模声纳数据集又阻碍了从头训练声纳基础模型，因此研究如何将现有视觉基础模型高效迁移到声纳领域。

Result: 实验首次实现了基于声纳的无需姿态信息的3D重建，展示了模型在新能力上的有效性。

Insight: 创新点在于利用跨模态几何关系进行模型适配，并采用基于物理的噪声模型生成合成数据，这为数据稀缺领域迁移预训练模型提供了可行路径。

Abstract: Vision foundation models trained on Internet-scale RGB datasets enable remarkable capabilities across a range of tasks, from text-to-video generation to few-shot 3D scene reconstruction. An acoustic foundation model trained on large-scale sonar datasets could enable similar capabilities in the underwater domain, where turbidity and low-visibility conditions make conventional RGB foundation models inapplicable. Unfortunately, a lack of freely available large-scale sonar datasets makes training such a model from scratch impractical. In this work, we demonstrate that vision foundation models can be efficiently adapted to the sonar setting by (1) exploiting the geometric relationship between the two sensing modalities and (2) employing accurate physics-based noise models for synthetic data generation. The resulting sonar adaptation models enable new capabilities: For the first time, we experimentally demonstrate sonar-based pose-free 3D reconstruction.

[98] MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control cs.CV | cs.ROPDF

Ting Huang, Yue Huang, Zeyu Zhang, Shuicheng Yan, Hao Tang

TL;DR: 本文提出了MobileVLA-R1 2.0，一个强化学习增强的视觉-语言-动作（VLA）框架，旨在解决移动机器人中自然语言指令到可靠可执行动作的落地挑战。该框架通过显式地将结构化的具身推理与可执行的机器人控制相结合，并利用监督思维链对齐和强化学习来学习多粒度推理，从而提升推理与动作的一致性。

Details

Motivation: 解决移动机器人VLA系统中，高层语义推理与低层运动及操作控制之间存在的鸿沟，克服现有方法依赖隐式推理或单一动作预测，难以在保持长期决策连贯性的同时生成精确、适应性强的机器人动作的问题。

Result: 在语言引导导航（VLN-CE）、四足机器人控制（QUARD）以及Unitree Go2和G1机器人的真实世界移动操作任务上进行了广泛评估。相比强大的VLA基线模型，MobileVLA-R1 2.0持续表现更优，在VLN-CE上的成功率（SR）平均提升1.6个百分点，在真实世界G1移动操作任务上的全任务成功率相比MobileVLA-R1提升了10.0个百分点，并在不同机器人平台上展现了鲁棒的长期指令跟随和闭环执行能力。

Insight: 创新点在于提出了一个显式耦合结构化具身推理与可执行控制的RL增强VLA框架，通过监督CoT对齐和强化学习优化推理到动作的一致性，并设计了推理条件化的动作解码器，实现了高层动作生成与机器人特定驱动的解耦，提供了一个统一的感知-推理-动作接口。

Abstract: Grounding natural-language instructions into reliable and executable actions remains a fundamental challenge for vision-language-action (VLA) systems on mobile robots, due to the persistent gap between high-level semantic reasoning and low-level locomotion and manipulation control. Existing approaches often rely on implicit reasoning or monolithic action prediction, making it difficult to maintain coherent long-horizon decision making while producing precise and adaptable robot actions. To address this challenge, we propose MobileVLA-R1 2.0, an RL-enhanced VLA framework that explicitly couples structured embodied reasoning with executable mobile robot control. The framework learns multi-granularity reasoning over embodied trajectories through supervised Chain-of-Thought (CoT) alignment and reinforcement learning, improving reasoning-to-action consistency beyond purely behavioral supervision. To support both locomotion and manipulation, we further introduce a reasoning-conditioned action decoder that maps multimodal reasoning representations to task-level action targets, which are subsequently translated into embodiment-specific commands by robot controllers. This design provides a unified perception-reasoning-action interface while decoupling high-level action generation from robot-specific actuation. We conduct extensive evaluations on language-guided navigation, quadruped control, and humanoid mobile manipulation, covering VLN-CE, QUARD, and real-world deployments on Unitree Go2 and G1 robots. MobileVLA-R1 2.0 consistently outperforms strong VLA baselines, achieving an average 1.6 point improvement in SR on VLN-CE and a 10.0 point improvement in full-task success on real-world G1 mobile manipulation tasks over MobileVLA-R1, while demonstrating robust long-horizon instruction following and closed-loop execution across different robotic platforms.

[99] VDiff-Bench: A Challenging Benchmark for Fine-Grained Image Difference Identification cs.CV | cs.AI | cs.CLPDF

Yixin Wan, Tianle Zheng, Kai-Wei Chang

TL;DR: 本文介绍了VDiff-Bench，一个用于评估多模态大语言模型（MLLMs）在细粒度图像差异识别能力上的挑战性基准。该基准包含1756个四选一问题，覆盖10种变化类别，旨在测试模型区分两幅相似图像间细微差异的能力。实验评估了11个开源和闭源的SOTA MLLMs，发现它们在低层级变化（如噪声和纹理）识别上表现脆弱，暴露了标准单图像视觉语言任务未能捕捉的模型缺陷。

Details

Motivation: 尽管多模态大语言模型在通用视觉理解任务（如视觉问答）上表现强劲，但它们往往在识别两幅相似图像间变化这一基本比较技能上存在困难。因此，作者构建了VDiff-Bench基准，以专门诊断和评估MLLMs在细粒度视觉比较任务上的能力。

Result: 在VDiff-Bench基准上评估了11个SOTA开源和闭源MLLMs。结果显示，模型在不同来源和变化类别上表现不均，在语义变化上得分较高（例如三个7-8B规模的开源模型达到52.5-70.6%），但在噪声、纹理等低层级变化上表现极差（仅8.7-33.3%）。值得注意的是，闭源模型Grok 4.3在识别噪声和纹理差异时性能显著下降，甚至落后于Kimi K2.5等大型开源模型。

Insight: 论文的创新点在于构建了一个专注于细粒度图像差异识别的、具有挑战性的诊断性基准（VDiff-Bench），其核心是精心策划了基于真实变化条件的困难负样本，迫使模型区分实际变化与相近的语义替代项。这揭示了MLLMs在低层级视觉变化理解上的一个关键弱点，为未来模型改进提供了明确的评估方向。

Abstract: Multimodal Large Language Models (MLLMs) perform strongly on general visual understanding tasks such as visual question answering, yet they often struggle with a basic comparative skill: identifying what has changed between two similar images. We introduce VDiff-Bench, a challenging multiple-choice benchmark for fine-grained Image Difference Identification. VDiff-Bench contains 1,756 four-way questions over image pairs and covers 10 change categories: position, motion, regional image color, overall image color, appearance/disappearance, noise/resolution, texture, substitution/size, OCR/text, and illumination. Each question corresponds to two image inputs with 4 choices: the true difference, two hard negative descriptions, and a “no difference” distractor. To make the task challenging, we specifically curate ground-truth-conditioned negatives that require models to distinguish the actual change from nearby semantic alternatives. Experiments with 11 state-of-the-art open- and closed-source MLLMs show that fine-grained visual comparison remains brittle: models exhibit uneven performance across sources and change categories, with persistent failures on subtle low-level changes like noises and textures. For instance, three 7-8B-scale open-source MLLMs score 52.5-70.6% on semantic changes but only 8.7-33.3% on low-level changes like noise and texture, falsely assuming no changes between two image inputs. Surprisingly, despite strong performance of other closed-source commercial models, Grok 4.3 demonstrate remarkable performance drop on identifying noise and texture differences between images, falling significantly behind large open-source models like Kimi K2.5 and K3. Overall, VDiff-Bench provides a targeted diagnostic for evaluating comparative visual understanding in MLLMs, exposing failures that are not captured by standard single-image vision-language tasks.

[100] SignDino: Self-Supervised Sign Language Representation Learning via Temporal-Axis Self-Distillation cs.CV | cs.CLPDF

Junyi Hu, Zhewen He, Haomian Huang, Zhenhua Li, Zhifei Li

TL;DR: 本文提出SignDino，一种自监督手语视频编码器，它将DINOv3的学生-教师框架从图像裁剪的空间域迁移到跟踪手语流的时间域。该方法通过检测器将视频分解为左手、右手和面部流，利用冻结的DINOv3 ViT提取每帧解剖学裁剪的特征，并通过轻量级时间Transformer进行时间自蒸馏学习。

Details

Motivation: 解决手语自监督表示学习中的两个核心特性：手语由少量解剖学上不同的发音器官产生，且其意义依赖于这些器官的时间组织，而现有自然图像自监督方法未重点关注这些特性。

Result: 在从手语到英语的翻译、孤立手语识别和手指拼写检测等基准测试中，SignDino提供了强大的公开自监督表示，并在匹配的下游评估中展现出具有竞争力或最先进的性能。

Insight: 创新点在于将自蒸馏从空间域转移到时间域，并采用检测器优先的流程分解发音器官流，从而固定强大的图像级视觉基元，仅学习发音器官状态随时间演化的模式；同时结合了多种训练目标以优化时间表示。

Abstract: Self-supervised sign language representation learning must model two properties not central to natural-image SSL: signs are produced by a small set of anatomically distinct articulators, and their meaning depends on the temporal organisation of those articulators. We introduce SignDino, a self-supervised sign-video encoder that moves the DINOv3 student–teacher recipe from the spatial domain of image crops to the temporal domain of tracked sign streams. Each video is decomposed into left-hand, right-hand, and face streams by a detector-first YOLOv8n+ByteTrack pipeline. A frozen DINOv3 ViT-B/16 embeds each per-frame anatomical crop, while lightweight temporal Transformers, not the image backbone, form the student and EMA teacher. They are trained by temporal DINO self-distillation, frame-level masked-token prediction in the style of iBOT, KoLeo feature spreading, and Gram anchoring of the frame-to-frame similarity structure. This design keeps strong image-level visual primitives fixed and learns only how articulator states evolve across time. We evaluate on sign-to-English translation, isolated sign recognition, and fingerspelling detection benchmarks. Across these tasks, SignDino provides a strong public self-supervised representation and shows competitive or state-of-the-art performance under matched downstream evaluation.

[101] Object-Aware Background-Controlled Editing via Weighted Velocity Guidance cs.CVPDF

Wuji Wang, Yue Wu, Chenhao Yi, Shuhui Wang

TL;DR: 本文提出了一种无需训练的图像编辑框架OAVC，通过引入对象级控制来改进基于速度引导的扩散或流匹配生成模型。该方法将语义残差的作用区域与注入方式解耦，构建背景锚定的参考界面并进行对象局部化的安全语义注入，以抑制背景漂移并稳定对象边界。

Details

Motivation: 现有基于速度的编辑方法通常将提示诱导的残差全局应用于潜在空间，并依赖模型隐式定位语义变化，这导致在对象中心编辑时，非目标区域的小分量会在多步积分中累积，引起背景漂移和对象边界不稳定。

Result: 在基于图像和视频校正流骨干的对象中心图像和视频基准测试中，OAVC在背景保持、结构保真度、边界稳定性和时间一致性方面均表现出改进，同时保持了有效的局部编辑能力。

Insight: 创新点在于将语义残差的作用区域与注入动力学解耦，通过构建背景锚定参考界面和对象局部化安全注入，结合约束注入算子和时间自适应空间加权，实现了无需训练或修改预训练模型参数的对象感知背景控制编辑。

Abstract: Training-free image editing steers diffusion or flow-matching generative models at inference time by modifying prompt-conditioned denoising velocities. Existing velocity-based editors often apply prompt-induced residuals globally over the latent space and rely on the model to localize semantic changes implicitly. For object-centric edits, these residuals are rarely zero outside the target object, so small non-target components can accumulate during multi-step integration, causing background drift and unstable object boundaries. We propose Object-Aware Velocity Control (OAVC), a training-free framework that introduces object-level control into the velocity-integration process. OAVC decouples where semantic residuals are allowed to act from how they are injected into the dynamics. It constructs a background-anchored reference interface under the source prompt and then performs object-localized safe semantic injection under the target prompt. A constrained injection operator suppresses drift-inducing velocity components, while time-adaptive spatial weighting stabilizes the transition near object boundaries. OAVC requires no training or modification of pretrained model parameters. Experiments on object-centric image and video benchmarks with image and video rectified-flow backbones show improved background preservation, structural fidelity, boundary stability, and temporal consistency while retaining effective localized editability.

[102] Radiation, Rotation and Scale Invariant Feature Descriptor for Multimodal Image Matching cs.CVPDF

Yuanxin Ye, Tengfeng Tang, Tao Peng, Zhiqiang Han, Jiayuan Li

TL;DR: 本文提出了一种辐射、旋转和尺度不变（RRSI）特征描述符，用于解决多模态图像匹配中几何畸变和非线性辐射差异带来的挑战。该方法通过双头区域采样模块同时进行笛卡尔和对数极坐标采样，并在统一的深度特征空间中联合编码几何与辐射关系，同时引入双向跨模态生成重建约束来锚定模态不变的几何拓扑。

Details

Motivation: 多模态图像匹配是多源信息融合的基础任务，但几何畸变和非线性辐射差异严重限制了其性能，尤其是在辐射、旋转和尺度变化下。

Result: 在光学-红外和光学-SAR数据集上的实验表明，该方法具有高度竞争力的匹配性能和强大的旋转与尺度变化鲁棒性，支持0到360度的全旋转范围和高达4倍的尺度因子，并在计算机视觉、遥感和医学成像等多模态图像上验证了其泛化能力。

Insight: 创新点在于设计了双头区域采样模块以同时保留空间结构并增强对旋转和尺度的鲁棒性，以及在统一特征空间中联合编码跨模态关系，并通过无额外推理开销的双向生成重建约束来学习模态不变的几何表示。

Abstract: Multimodal image matching is a fundamental task for multi-source information fusion. However, geometric distortions and nonlinear radiometric differences (NRD) severely limit performance, especially under radiometric, rotation, and scale variations. To address this issue, we propose a radiation, rotation, and scale invariant (RRSI) feature descriptor. First, a dual-head regional sampling (DHRS) module simultaneously performs Cartesian and Log-Polar sampling on keypoint neighborhoods, retaining spatial structural properties while enhancing robustness to rotation and scale variations. We then jointly encode geometric and radiometric relations between multimodal images in a unified deep feature space, enabling feature encoding, interaction, and fusion across intra-modal, dual-head sampled, and inter-modal regions. Furthermore, we introduce a bidirectional cross-modal generative reconstruction constraint during training. By decoding implicit features into structural patches of the counterpart modality, this mechanism anchors modality-invariant geometric topologies without additional inference overhead. Experiments on optical-infrared and optical-SAR datasets demonstrate highly competitive matching performance and strong robustness to rotation and scale variations. RRSI supports the full rotation range from 0 to 360 degrees and scale factors up to four. Its generalization ability is further validated on multimodal images from computer vision, remote sensing, and medical imaging. The implementation will be made publicly available at https://github.com/yeyuanxin110/RRSI .

[103] ChildGaze: A Benchmark Dataset for Collaborative Behavior Understanding in Children cs.CVPDF

Sindhuja Penchala, Saketh Reddy Kontham, Prachi Bhattacharjee, S. Nima Mahmoodi, Daniel Fonseca

TL;DR: 该论文提出了ChildGaze数据集，这是一个用于理解儿童协作行为的数据集。它基于ChildPlay视频集合构建，提供了儿童和成人的面部、左右手边界框标注，并引入了‘协作’与‘非协作’两种行为标签。该数据集旨在支持儿童发展、教育分析和以人为中心的计算机视觉研究。

Details

Motivation: 动机在于，仅估计儿童的注视点不足以判断其是否积极参与共享活动。为了支持这种更高层次的分析，需要构建一个专门标注儿童协作行为的数据集。

Result: 在数据可靠性评估中，协作标签的原始一致率达到93.16%，Cohen’s kappa为0.8631；边界框标注的平均交并比为0.808。使用预训练的ViT和Swin Transformer模型进行基线实验，分别在个体儿童级别和帧级别达到了97.44%和96.80%的准确率。

Insight: 创新点在于构建了首个以儿童为中心、标注协作行为的数据集，并引入了精细的‘协作/非协作’行为标签以及多层次（行、人、帧）的组织结构。这为研究自然情境下的儿童社交互动提供了一个可靠的基准。

Abstract: Understanding collaborative behavior in children is important for analyzing social participation, peer interaction, shared attention, and engagement during play and learning activities. Reliable recognition of these cues can support research in child development, educational analysis, and human-centered computer vision. However, estimating where a child is looking does not necessarily reveal whether the child is actively participating in a shared activity. To support this higher-level analysis, we introduce ChildGaze, a child-centered behavioral annotation dataset built on the ChildPlay video collection [1]. ChildGaze introduces two behavioral labels, collaborative and non-collaborative, assigned independently to each child within a frame. The dataset provides face, left-hand, and right-hand bounding boxes for children and adults and organizes the annotations at the row, person, and frame levels. The current release contains 27 annotated video files, 10,641 frames, and 73,268 body-part annotation rows. Annotation reliability was evaluated on 1,187 frames using independent annotations from two annotators. The collaboration labels achieved 93.16% raw agreement and a Cohen’s kappa of 0.8631, while bounding-box annotations achieved an overall mean IoU of 0.808. Baseline experiments with pretrained ViT and Swin Transformer models achieved up to 97.44% child-person-level accuracy and 96.80% frame-level accuracy, respectively. These results show that ChildGaze provides a reliable benchmark for studying collaborative behavior in naturalistic child-adult and peer interactions.

[104] NOVA: Normal-Side Modeling for Training-Free Zero-Shot Video Anomaly Detection cs.CVPDF

Wei-Chih Yin, Yun-Ching Kao, Cheng-Kuan Lin, Yu-Chee Tseng

TL;DR: 本文提出了一种无需训练的零样本视频异常检测框架NOVA，通过强化正常侧建模来提升异常检测性能。该方法在语言层面设计了排除异常相关动词的提示构造策略，在视觉层面构建了视频特定的视觉正常锚点，以解决现有方法中决策边界模糊和模态鸿沟的问题。

Details

Motivation: 现有基于CLIP的零样本视频异常检测方法过于关注异常侧语义，而正常侧建模不足，导致决策边界模糊和文本-视觉模态鸿沟，影响了正常与异常的区分能力。

Result: 在UCF-Crime数据集上达到89.86% AUC，在XD-Violence数据集上达到95.07% AUC和84.82% AP，在同类无需训练的零样本方法中达到了最先进的性能。

Insight: 创新点在于从语言和视觉两个层面系统性地强化正常侧建模：语言上通过筛选静态低运动动词构建提示，视觉上利用测试视频初始帧构建视频特定的正常锚点，无需额外训练或标注即可有效缩小模态鸿沟并锐化决策边界。

Abstract: Training-free zero-shot video anomaly detection (ZS-VAD) leverages vision-language models (VLMs) to localize anomaly instances from a predefined anomaly vocabulary, without providing any video. Existing CLIP-based methods often emphasize anomaly-side semantics, while the competing normality side remains less carefully formulated. We identify two key limitations in existing solutions: (i) blurred decision boundary: normal prompts may contain ambiguous verbs, such as running, that are semantically close to anomalies, reducing normal and abnormal separation in the VLM embedding space; and (ii) modality gap: poor alignment between features of textual normal anchors and visual frames. We propose NOVA, a training-free ZS-VAD framework that strengthens the normal side at both linguistic and visual levels. NOVA introduces Normality-Aware Prompt Construction (NA), which excludes anomaly-adjacent verbs and biases normal descriptions toward static, low-motion scenes. To overcome the text-vision modality gap, NOVA constructs a Visual Normality Anchor (VNA), which creates a weighted visual normal anchor from the initial frames of each test video, providing a video-specific normal reference without task-specific training or annotations. NOVA achieves 89.86 percent AUC on UCF-Crime and 95.07 percent AUC and 84.82 percent AP on XD-Violence, reaching state-of-the-art performance among comparable training-free zero-shot methods.

[105] DualPathOcc: Dual-Resolution BEV Encoder for 3D Occupancy Prediction cs.CVPDF

Lihao Qiu, Jian Chen, Ruihao Wang, Ramu Gautam, Mei Yang

TL;DR: 论文提出DualPathOcc，一种基于相机的3D占用预测框架，通过结合空间增强器、双路径BEV编码器和高度感知加权交叉熵损失，在单帧Occ3D-nuScenes基准上达到37.37 mIoU，无需显式深度损失。

Details

Motivation: 解决从多视角图像预测3D占用时，在2D到3D提升过程中保持几何细节，同时处理稀疏体素场景表示的挑战。

Result: 在Occ3D-nuScenes基准测试中，单帧预测达到37.37 mIoU，未提及是否达到SOTA，但展示了有效性能。

Insight: 创新点包括空间增强器用于高分辨率特征聚合、SENet增强的双路径BEV编码器进行局部-全局上下文建模，以及高度感知加权交叉熵损失优化近地面占用预测；客观分析表明，该方法通过纯占用监督避免了显式深度损失，简化了训练流程。

Abstract: Predicting 3D occupancy from multi-view images requires preserving geometric detail during 2D-to-3D lifting while reasoning over sparse, volumetric scene representations. We present DualPathOcc, a camera-based framework that combines a Spatial Enhancer for high-resolution feature aggregation before BEV compression, a SENet-augmented dual-path BEV encoder for local-global context modeling, and height-aware weighted cross-entropy for near-ground occupancy. The final model is optimized with occupancy supervision and no explicit depth loss. On single-frame Occ3D-nuScenes, DualPathOcc achieves 37.37 mIoU. We further analyze how surface-centered depth targets interact with volumetric occupancy learning.

[106] An Integrated Video-AI Platform for Action-Level Microanastomosis Training and Performance Feedback cs.CVPDF

Yan Meng, Daniel A. Donoho

TL;DR: 本文提出了一种集成的视频AI平台，用于显微外科吻合术的培训和性能反馈。该平台通过三个模块将完整的手术模拟过程转化为可检查的交互式反馈：基于Transformer的手术动作分割、基于目标检测和跟踪的器械尖端定位与性能分类，以及基于大型语言模型（LLM）的统一问答界面。

Details

Motivation: 显微外科吻合术技能的培养需要重复练习和及时、针对具体动作的反馈，但专家对冗长显微镜视频的审查难以扩展到频繁或分布式的培训场景。

Result: 在包含72个手术（共576个缝合点）的两中心研究中，动作分割模块的准确率达到87.66%，F1分数为82.86%，经过工作流感知优化后分别提升至93.62%和88.32%。五个性能分类器的平均准确率为76.0%，Cohen’s κ系数在0.63到0.93之间。

Insight: 创新点在于将视频动作分割、器械运动学分析与基于LLM的交互式反馈集成到一个统一的平台中，实现了从原始视频到结构化性能评估和自然语言问答的端到端自动化反馈，为可扩展的显微外科培训提供了技术基础。

Abstract: Developing microanastomosis skill requires repeated practice with timely, action-specific feedback, yet expert review of lengthy microscope videos does not scale to frequent or distributed training. We present an integrated video-AI platform that turns a complete simulated procedure into inspectable, interactive feedback through three connected modules. First, a proposed transformer segments the video into six surgical actions. Second, object detection and tracking localize instrument tips within each action; the resulting kinematic features and action statistics drive supervised classification of five NOMAT-aligned performance dimensions. Third, a grounded large language model (LLM) uses these structured outputs to answer user questions about the current scene, actions, motion, and predicted performance through a unified interface. In a two-site study, 17 participants completed 72 procedures comprising 576 suture placements. The action-segmentation module achieved 87.66% accuracy and 82.86% F1, increasing to 93.62% and 88.32% after workflow-aware refinement. The five performance classifiers achieved 76.0% mean accuracy, with Cohen’s $κ$ from 0.63 to 0.93. Although the language interface and educational benefit require prospective evaluation, these results establish the technical basis for an expert-supervised platform that can shorten review, expose the evidence behind performance estimates, and support scalable formative microsurgical training.

[107] Separating Capability from Confidence: Grounded Dual-State Calibration for GRPO-Trained Medical Vision-Language Models cs.CV | cs.LGPDF

Yangyang Xie, Ke Hao, Jiaqi Liu, Yun Gu, Xinglin Zhang

TL;DR: 该论文提出了一种名为DualRead的新方法，用于提升医学视觉语言模型（VLMs）的置信度校准。该方法将模型的能力学习与置信度估计分离，通过分析模型在回答过程中的关键内部状态（如回答前的可解性和回答后对生成答案及其视觉支持的评估）来获取可靠性信息。此外，论文还引入了CCG-AUC指标来评估置信度是否基于视觉证据。

Details

Motivation: 现有基于GRPO的方法将置信度与答案生成联合优化，这会干扰答案学习并使置信度趋于二元值，且无法明确评估视觉支持。因此，需要将能力学习与置信度估计分离，并确保置信度能反映答案正确性和患者特异性视觉证据。

Result: 在两个VLM骨干网络以及分布内和分布外的医学VQA基准测试中，DualRead在保持答案准确性的同时，相比仅使用语言化置信度的方法，提高了正确性区分度和校准度。CCG-AUC指标揭示了置信度是否对答案相关的视觉证据而非非视觉线索做出响应。

Insight: 主要创新点在于将能力学习与置信度估计解耦，并利用模型在回答过程关键节点的内部状态来估计置信度。客观来看，其提出的CCG-AUC指标为评估置信度是否基于视觉证据提供了一个新颖且可量化的方法，这对于需要高可靠性的医学应用具有重要意义。

Abstract: Medical vision-language models (VLMs) require confidence that reflects both answer correctness and patient-specific visual evidence. Recent GRPO-based methods optimize verbalized confidence together with answer generation. However, this joint optimization may interfere with answer learning and drive confidence toward near-binary values. Verbalized confidence also provides no explicit assessment of visual support. We therefore separate capability learning from confidence estimation and propose \textbf{DualRead}. DualRead builds on the insight that reliability can be read from the actor’s internal states at critical moments in the answering process. It freezes the GRPO-trained actor and combines pre-answer solvability with a post-answer assessment of the generated answer and its visual support. To further assess whether confidence reflects visual grounding, we introduce \textbf{Counterfactual Confidence Grounding AUC} (CCG-AUC). It measures whether confidence decreases when real-image substitution changes the actor from correct to incorrect. Across two VLM backbones and both in- and out-of-distribution medical VQA benchmarks, DualRead improves correctness discrimination and calibration over verbalized confidence while preserving answer accuracy. CCG-AUC reveals whether confidence responds to answer-relevant visual evidence rather than primarily to non-visual cues.

[108] Multi-Grid Post-Training for Long-Form Multi-Shot Video Generation cs.CVPDF

Jiawei Mao, Haoqin Tu, Hardy Chen, Yuhan Wang, Keyang Xu

TL;DR: 本文提出MovieGrid，一种多网格后训练范式，用于生成长格式多镜头视频。该方法将长视频分解为时间有序的短片段，并在空间网格上排列以进行联合建模，从而减少每个时间轴处理的镜头数量并实现跨片段的全局信息交换。

Details

Motivation: 现有视频生成器倾向于连续运动，当整个叙事沿单一时间轴展开时难以呈现完整的镜头集。本文旨在解决生成长格式多镜头视频时，保持镜头内运动连贯性和跨镜头视觉叙事一致性的挑战。

Result: 在相同token预算下，MovieGrid在1616帧视频中生成的镜头数是Temporal Packing方法的6.05倍。在涵盖五个现实世界类别的基准测试中，它在镜头内一致性（0.9131 vs. HoloCine的0.8086）和镜头间一致性（0.5914 vs. StoryMem的0.5384）方面均达到最先进水平。

Insight: 核心创新在于将时间分解与空间网格排列相结合的多网格后训练范式，以及配套的噪声无关随机网格训练、网格嵌入、角色感知故事提示和网格边界损失等技术，有效提升了长视频生成的叙事完整性和视觉一致性。

Abstract: Generating long-form multi-shot videos requires coherent within-shot motion and visually consistent narratives across shots. Existing video generators favor continuous motion and struggle to present complete shot sets when an entire narrative is packed along one temporal axis. We propose MovieGrid, a Multi-Grid Post-Training paradigm that decomposes a long video into shorter, temporally ordered chunks and arranges them on a spatial grid for joint modeling. This design reduces the number of shots handled by each temporal axis while enabling global information exchange across chunks. We construct the Multi-Grid Long Video (MGLV) dataset from 1,000 long-form videos using source video collection, hierarchical segmentation, grid video construction, and character-aware story annotation, producing 54K grid videos paired with story prompts. Our Noise-Free Random-Grid Training retains a random subset of chunks as clean visual context for denoising the remaining chunks. Grid Embedding encodes grid structure, character-aware Story Prompts link recurring entities, and Grid Boundary Loss stabilizes layouts. Under the same token budget, MovieGrid generates 6.05 times more shots than Temporal Packing in a 1,616-frame video. On a benchmark spanning five real-world categories, it achieves state-of-the-art intra-shot consistency (0.9131 versus 0.8086 for HoloCine) and inter-shot consistency (0.5914 versus 0.5384 for StoryMem). MovieGrid can further scale video length with minimal compromise through single or multiple generations.

[109] Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understanding cs.CVPDF

Xiao Zhang, Wang Zeng, Sheng Jin, Wentao Liu, Chen Qian

TL;DR: 本文提出CamVLM框架，通过动态视角控制使大型视觉语言模型能够主动获取视觉证据，以解决监控视频理解中因固定视角被动观察导致的证据缺失问题。作者构建了CCTV-Anomaly大规模监控视频理解数据集和CamTrack-53K以物体为中心的视角轨迹数据集，并提出了基于强化学习的视角策略优化框架。实验表明CamVLM在被动观察和动态视角设置下均达到了最先进的性能。

Details

Motivation: 解决大型视觉语言模型在监控视频理解中面临的挑战，包括缺乏大规模领域特定数据集以及固定视角被动观察的局限性，这些局限性导致目标距离远、尺寸小、被遮挡或移出当前视野时关键视觉证据容易丢失。

Result: 广泛的实验表明，CamVLM在被动观察和动态视角设置下均实现了最先进的性能，验证了基于主动摄像头的推理对于监控视频理解的有效性。

Insight: 创新点在于将视角控制建模为主动视觉感知问题，并提出了一个基于强化学习的视角策略优化框架，将摄像头控制视为序列决策过程，学习超越监督轨迹模仿的长期观察策略。这为视觉语言模型在动态、交互式环境中的应用提供了新思路。

Abstract: Large vision-language models (LVLMs) have recently achieved remarkable progress in general-purpose video understanding. However, their application to surveillance videos remains challenging due to the lack of large-scale domain-specific datasets and the limitation of passive observation from fixed viewpoints. In surveillance scenarios, critical visual evidence can be easily missed when targets are distant, small, occluded, or move beyond the current camera view. In this work, we introduce CamVLM, a new framework for Thinking with Cameras, which enables LVLMs to actively acquire visual evidence through dynamic viewpoint control rather than passively analyzing fixed video streams. We first construct CCTV-Anomaly, a large-scale surveillance video understanding dataset containing 14,459 videos across 10 anomaly categories, with detailed captions and event annotations. We further formulate viewpoint control as an active visual perception problem and build CamTrack-53K, an object-centric viewpoint trajectory dataset for learning camera actions. Moreover, we propose a reinforcement learning based viewpoint policy optimization framework, which models camera control as a sequential decision-making process and learns long-horizon observation strategies beyond supervised trajectory imitation. Extensive experiments demonstrate that CamVLM achieves state-of-the-art performance under both passive observation and dynamic viewpoint settings, validating the effectiveness of active camera-based reasoning for surveillance video understanding. Our datasets, model, and code will be available at https://github.com/xiaozhang79/CamVLM .

Shiqi Pan, Qi Zheng, Hanqin Sun, Youjian Zhang, Daquan Feng

TL;DR: 本文提出O2C-Nav，一种高效的零样本视觉语言导航框架，旨在解决连续环境中的导航任务。该方法通过免训练的结构化航点生成器和一种新颖的抽象表示，将历史感知的候选航点直接投影到RGB图像上作为视觉标记，使得每个决策步骤只需调用一次大型多模态大模型。结合低层的快速行进方法规划器，将选定的目标转换为可执行的无碰撞路径。

Details

Motivation: 当前零样本VLN-CE方法要么依赖预训练的航点预测器，要么每步需要多次查询大型模型，导致推理延迟和计算开销过高。本文旨在解决这一问题，实现高效、实时的机器人部署。

Result: 在R2R-CE和RxR-CE基准测试上的广泛评估表明，O2C-Nav超越了当前最先进的零样本方法，突显了其在实时机器人部署中的巨大潜力。

Insight: 创新点在于提出了一个免训练的结构化航点生成器和一种将稀疏、历史感知的候选航点直接投影到RGB图像上的抽象表示，这为模型提供了具体的空间感知和显式记忆，同时显著减少了视觉处理负担。整个框架实现了每步仅调用一次大模型的高效决策范式。

Abstract: Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to navigate unseen environments by following natural language instructions. Current zero-shot VLN-CE methods either rely on pre-trained waypoint predictors or require multiple queries to large models per step. To address prohibitive inference latency and computational overhead, we propose O2C-Nav, an efficient zero-shot navigation framework that calls only a single large model once per decision step. Our approach introduces a training-free structured waypoint generator and a novel abstract representation that projects sparse, history-aware candidate waypoints directly onto RGB images as visual markers. The MLLM selects a waypoint or generates a fallback target bounding box at each step, while a low-level Fast Marching Method (FMM) planner converts the selected target into an executable collision-free path. This paradigm provides the model with concrete spatial perception and explicit memory while significantly reducing the visual processing load. Extensive evaluations on the R2R-CE and RxR-CE benchmarks demonstrate that O2C-Nav outperforms current state-of-the-art zero-shot methods, highlighting its great potential for real-time robotic deployment. Code is available at https://github.com/kkpsq/O2C-Nav-Code.

[111] OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolution cs.CV | cs.AI | cs.CL | cs.LGPDF

Shubhashis Roy Dipta, Sourajit Saha, Shaswati Saha, Nobin Sarwar

TL;DR: OracleZoom是一种基于策略自蒸馏的递归超分辨率框架，通过参考约束机制在训练过程中利用自身轨迹和最后可用的真实图像证据，结合无参考质量目标指导细节生成，实现了在极端放大倍数下的高质量图像超分辨率。

Details

Motivation: 递归超分辨率在深度放大时面临真实图像监督缺失的问题，导致深层预测缺乏监督，OracleZoom旨在解决这一挑战，通过参考约束框架在超出监督边界后仍能利用最后的真实证据。

Result: 在七个数据集上，OracleZoom实现了最先进的超分辨率质量，平均CLIPIQA得分为0.713，在更深放大尺度上增益更大，同时显著减少了幻觉现象。

Insight: 创新点包括基于策略的自蒸馏设计、参考约束递归训练、KL约束预训练潜在先验限制质量漂移以及EMA一致性稳定监督边界，这些方法结合了直接和跨尺度监督与无参考质量目标，有效平衡了内容保真度和细节生成。

Abstract: Recursive Super-Resolution (SR) extends fixed-scale SR to extreme magnification by repeatedly feeding predictions back into the same model, analogous to zooming an image repeatedly. However, ground truth availability at every scale, especially at depth, remains challenging as the required source resolution grows geometrically, leaving deeper predictions unsupervised. We present OracleZoom, an on-policy distillation-inspired, reference-constrained framework that trains on its trajectory while carrying the last ground-truth evidence beyond the supervision boundary. Direct and cross-scale supervision constrain verifiable content, while a no-reference quality objective guides unresolved fine-scale detail. A KL-constrained pretrained latent prior limits quality-driven drift, while EMA consistency stabilizes the supervision boundary. Across seven datasets, OracleZoom achieves the state-of-the-art SR quality across zooming scales, averaging 0.713 CLIPIQA, with larger gains on deeper scales, while significantly reducing hallucinations. Code, data, and models are available at https://dipta007.github.io/OracleZoom/ .

[112] CAM: Question Answering on Entity-Centric Videos with Continuous Extraction and Adaptive Querying cs.CVPDF

Yizhou Tian, Zizhe Chen, Shiyuan Deng, Garry Yang, Zijie Dai

TL;DR: 本文提出CAM方法，用于解决基于实体中心视频的问答任务。CAM通过连续提取和自适应查询来增强记忆能力，以捕捉视频中的高层语义和细粒度细节。该方法在三个基准测试中优于现有最佳基线，准确率提升高达23个百分点。

Details

Motivation: 现有方法从固定长度视频片段中提取独立记忆条目，难以捕捉需要长时间总结的高层语义（如角色特征和关系），且仅依赖基于相似性的检索，可能无法检索问答所需的细粒度细节。

Result: 在三个基准测试上的评估表明，CAM优于现有最佳基线（SOTA），准确率提升最高达23个百分点。

Insight: 创新点包括：1）通过知识图存储实体和关系，并基于子图大小进行连续提取以总结高层语义；2）采用规划器-执行器-验证器管道自适应组合多种搜索方法（如图遍历、视频重看、音频监听）来检索细粒度细节，从而更灵活地适应问题意图。

Abstract: Memory facilitates question answering over long videos by extracting and retrieving facts to fit within the limited context windows of multimodal LLMs (MLLMs). Existing solutions typically extract independent memory entries from fixed-length video clips and thus cannot capture high-level semantics that need to be summarized over extended time periods, such as character traits and relations. Moreover, they rely solely on similarity-based retrieval and may fail to retrieve the fine-grained details required for question answering. To tackle these problems, we propose CAM, featuring continuous extraction for high-level semantics and adaptive querying for fine-grained details. In particular, CAM stores the entities and relations extracted from video clips in a knowledge graph. To capture the high-level semantics of each entity or relation, CAM summarizes the local subgraph of the target entity or relation once the subgraph reaches a predefined size. To retrieve the fine-grained details required for question answering, CAM supports multiple search methods, including knowledge graph traversal, video re-watching, and audio listening. It utilizes a planner-executor-verifier pipeline to adaptively compose these search methods according to question intent. Evaluations on three benchmarks show that CAM outperforms SOTA baselines and improves their accuracy by up to 23 percentage points. Code is available at https://github.com/Jake-Tian/CAM.

[113] Diffuse2Seg: Diffusion Models Can Segment Anything Without Supervision cs.CVPDF

Christoph Hümmer, Joachim Sicking, Fabian Hüger, Hanno Gottschalk

TL;DR: Diffuse2Seg是一种无需监督的开放世界实体分割方法，它利用预训练的文本到图像扩散模型的中间特征和自注意力机制，通过传播点提示网格来生成多粒度实例掩码。该方法在多个领域的自动掩码生成任务上超越了之前的SOTA方法，并且使用其生成的标签训练的模型在开放世界分割任务上取得了显著提升，同时还能为半监督学习提供强初始化。

Details

Motivation: 开放世界实体分割需要为任意对象生成掩码，但像SAM这样依赖大规模人工标注数据的方法成本高昂且难以扩展。本文旨在探索利用无需额外训练或监督的文本到图像扩散模型的内在表征能力来解决此问题。

Result: Diffuse2Seg在五个领域的自动掩码生成任务上，AR_1000指标比先前SOTA方法高出4.3-7.1个百分点。使用其生成标签训练的实例分割模型，在“things”和“stuff+things”数据集上分别将无检测器的开放世界分割性能提升了7.4和7.7个百分点，并在“stuff+things”上以AR_1000指标超越了基于检测器的UnSAM 2.1个百分点。此外，其标签为半监督学习提供了强初始化，仅用5k标注图像即可超越全监督模型。

Insight: 核心创新在于将生成式扩散模型重新用于分割任务，通过其自注意力表征以边缘保持的方式传播点提示网格来生成掩码，无需任何额外训练或监督。这揭示了预训练扩散模型内部特征对物体结构的强大编码能力，为低成本获取开放世界分割标签提供了新途径，并可有效推动下游分割模型和半监督学习的发展。

Abstract: Open-world entity segmentation aims to predict masks for arbitrary objects across domains and at multiple granularities, from parts to whole objects. In this setting, SAM sets a strong standard: trained on SA-1B, comprising 11M images and over 1B carefully annotated masks, it achieves remarkable zero-shot performance. Collecting such labels is expensive and time-consuming, however, which limits how far this recipe can scale. Text-to-image diffusion models offer a way around this. Their intermediate features transfer well across perception tasks, and since object structure emerges as the model denoises a noise sample into an image conditioned on a text prompt, that structure is already encoded in these representations. They can therefore be exploited for open-world entity segmentation without retraining or supervision. Building on this observation, we introduce Diffuse2Seg, which repurposes generative diffusion models for automatic mask generation by propagating a grid of point prompts through their self-attention representations in an edge-preserving manner. Diffuse2Seg produces multi-granular instance masks and outperforms prior state-of-the-art label generators by 4.3-7.1 p.p. in AR_1000 across five domains. Training an instance segmentation model on these generated masks advances detector-free open-world segmentation by 7.4 and 7.7 p.p. on “things” and “stuff+things” datasets and surpasses the detector-based UnSAM on “stuff+things” by 2.1 p.p. in AR_1000. Finally, we show that a model trained on Diffuse2Seg labels provides a strong initialization for semi-supervised learning, outperforming its fully supervised counterpart with already 5k labeled images.

[114] Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models cs.CVPDF

Yijie Zhu, Zitong Yu, Wei Li, Hui Ma, Wen Li

TL;DR: 本文提出了ProWAM模型，一种基于执行进度进行条件化调制的世界动作模型。该模型通过自监督双时序进度编码器来可靠地表征任务执行进度，并利用分层进度条件化想象调制机制，自适应地利用对未来视觉动态的想象，以生成更优的动作。

Details

Motivation: 现有世界动作模型在利用对未来动态的想象时，未能充分适应不断演变的执行进度，可能导致引入分散注意力或不可靠的预测线索。论文旨在解决未来效用存在的两种非均匀性问题：进度间和进度内的效用差异。

Result: 广泛的实验表明，ProWAM在多个基准测试中，相比强大的VLA和WAM基线模型，取得了持续的性能提升。

Insight: 核心创新在于将执行进度作为显式的中间表示，并以此条件化地调制对未来想象的利用。具体包括：自监督双时序进度编码器用于捕捉短期交互与长期历史；以及分层调制机制，分别在进度间和进度内两个互补层面自适应地调整未来隐变量的利用。

Abstract: World Action Models (WAMs) extend Vision-Language-Action (VLA) models by incorporating future visual dynamics into action generation. However, existing WAMs often utilize imagined futures with limited adaptation to evolving execution progress, potentially introducing distracting or unreliable predictive cues. This limitation arises from two empirically identified forms of non-uniformity in future utility: (i) at the inter-progress level, the utility of imagined futures varies across execution stages as control demands change; and (ii) at the intra-progress level, individual future latents exhibit heterogeneous relevance within the same progress state. To address these limitations, we propose ProWAM, a Progress-Conditioned World Action Model that introduces execution progress as an explicit intermediate representation for adaptive imagination utilization. ProWAM comprises two tightly coupled components: (1) To obtain a reliable representation of execution progress, we propose the Self-Supervised Dual-Temporal Progress Encoder (SS-DTPE). SS-DTPE couples short-term action-observation interaction modeling with long-term recurrent progress aggregation to capture recent execution feedback and accumulated task history. (2) Conditioned on the progress representation from SS-DTPE, we propose the Hierarchical Progress-Conditioned Imagination Modulation (HPIM) to adapt imagination utilization to execution progress. HPIM operates at two complementary levels: an inter-progress global modulation mechanism adapts future utilization across execution stages, while an intra-progress relevance mechanism differentiates individual future latents within each progress state. Extensive experiments demonstrate consistent gains over strong VLA and WAM baselines.

[115] 3DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models cs.CVPDF

Ling Liu, Bingchen Gong, Amal Dev Parakkat, Maks Ovsjanikov

TL;DR: 本文提出了3DHarnessBench基准，用于评估前沿视觉语言模型（VLMs）从多种输入中恢复3D几何并生成Blender Python代码的智能体能力。该基准包含四个逐步增强主动探索能力的测试设置，揭示了不同模型在视觉感知、主动推理、工具调用和自我纠正方面能力的不均衡性。

Details

Motivation: 现有评估框架通常使用固定输入（如单张渲染图或文本描述）来提示VLMs，无法充分评估其作为智能体进行主动探索和交互的能力。本文旨在通过一个层次化的基准，系统性地测评VLMs在3D几何恢复任务中的智能体能力。

Result: 实验表明，所有前沿模型在获得更丰富的函数调用权限时，其3D几何恢复能力均有显著提升，但提升幅度高度依赖于具体模型，显示出智能体3D-to-code能力的不均衡性。

Insight: 创新点在于提出了一个层次化的智能体能力评估基准，通过从单视图到完全3D交互的渐进式设置，系统性地探测VLMs的主动感知和推理能力。这为评估和提升VLMs在3D内容生成与操作中的工具使用和自主探索能力提供了新框架。

Abstract: We introduce 3DHarnessBench, a benchmark that evaluates the agentic ability of frontier vision-language models (VLMs) to recover 3D geometry as Blender Python code from a variety of inputs. Unlike previous frameworks that prompt the VLMs with a fixed input (e.g., a single rendering or a text description), 3DHarnessBench evaluates four separate harness settings that progressively enable active agentic exploration, facilitated by recent Blender MCP functionality. Our hierarchy from Single-view, Multi-view, Active Visual (arbitrary viewpoint access), and Full 3D Interaction (complete access to the target object through Blender function calls) probes the models’ abilities in both visual perception and active inference, tool calling, and self-correction. We observe that the ability of all frontier models to recover 3D geometry improves significantly with richer function call access, although the improvements are strongly model-dependent, revealing highly uneven agentic 3D-to-code capabilities. We will release the benchmark, code, outputs, and agent trajectories for reproducible 3D evaluation.

[116] Physico-Geospatial Grounded Scene Interpretation for Mobile Robotics cs.CV | cs.ROPDF

Nicolas Schuler, Janik Kurtz, Lea Dewald, Marcel Sauber, Félicia Teferle

TL;DR: 本文提出了一种用于移动机器人场景理解的新方法，该方法通过整合预训练视觉语言模型（VLM）的输出、OpenStreetMap建筑与街道数据以及传感器获取的位置、时间和度量信息，并利用大语言模型（LLM）进行信息融合，从而生成具有物理-地理空间基础的自然语言描述。

Details

Motivation: 动机在于将物理和地理空间的世界知识整合到机器人系统中，以增强其在动态和非结构化环境中的场景理解与交互能力。

Result: 在一个大学校园的户外记录数据集上进行了评估，在建筑物基础定位任务中取得了0.83的F1分数，在路径表面基础定位任务中取得了0.64的F1分数，证明了该方案的概念可行性。

Insight: 创新点在于提出了一种无需修改预训练VLM、通过多源信息（语义、地图、传感器数据）融合与LLM推理来增强场景解释的框架，为机器人提供了物理和地理空间基础的自然语言理解能力。

Abstract: Recent advancements in deep learning allow robotic agents to interact with dynamic and unstructured environments. Of special interest is the integration of physico-geospatial world knowledge into such systems, either by using physics-aware machine learning models, knowledge graphs to model relationships or spatio-temporal and logical reasoning. In the present work, we introduce an approach to augment the output of pre-trained, unmodified VLMs used for scene interpretation by integrating semantic descriptions, OpenStreetMap building data and street information with positional, temporal and metric information obtained from our sensory systems, fusing this information using LLMs. We apply this concept to an outdoor recording within a university campus, achieving an F1-Score of 0.83 in the task of grounding buildings and 0.64 for path surface grounding on our pilot evaluation set. The results demonstrate the conceptual capability of the proposed solution to deliver physico-geospatial grounded natural language descriptions. Code and results are available at https://datahub.rz.rptu.de/hstr-csrl-public/publications/physico-geospatial-grounded-scene-interpretation

[117] GeoCo-SAVi: Geometry-Consistent Slot Attention for Explicitly Editable Object Representations cs.CVPDF

Haoxiang Huang, Zhekai Wang, Xiang Liu, Sen Cui, Changshui Zhang

TL;DR: GeoCo-SAVi是一种几何一致的槽注意力模型，旨在提升以对象为中心的视频表示中几何属性的明确性和可编辑性。它通过空间等变的对象级解码器、位置对齐机制和外观移植等方法，确保位置和尺度等几何命令能有效控制渲染结果，减少外观变化对几何属性的干扰。

Details

Motivation: 现有基于槽注意力的对象中心视频模型（如Invariant Slot Attention）中，显式定义的几何参数（如位置、尺度）与解码出的实际中心、范围可能不一致，导致编辑几何属性时产生意外的运动或缩放，且替换外观可能意外改变几何布局。

Result: 在Obj3D数据集上，GeoCo-SAVi在保持与ISA相当的重建质量的同时，将位置质心误差降低了80%以上，并将外观引起的尺寸变化减少了50%以上，能产生预期的平移和缩放响应。在250个MOVi-C视频上，相比两个相同协议的基线模型，它在重建、实例分组和固定身份的几何控制方面均有提升。

Insight: 创新点在于通过几何权威性和语义对齐，将显式几何参数转化为组合控制的有效命令。具体包括：空间等变的对象级解码器使位置和尺度成为有效控制指令；位置对齐和归一化注意力重叠机制确保几何参数的一致性；外观移植技术分离了几何语义和外观，使受体的几何布局主导渲染，而供体的外观提供形状信息；时序初始化器在帧间传播校准后的槽，增强了时间一致性。

Abstract: Object-centric video models represent scenes with slots, yet exposed geometry can vary in meaning with appearance. In Invariant Slot Attention (ISA), explicit position and scale can disagree with the decoded center and extent; edits can yield unexpected motion or resizing, and replacing appearance can shift geometry. GeoCo-SAVi promotes geometric authority and semantic alignment. Its spatially equivariant, object-wise decoder makes position and scale effective commands: changing them moves or resizes the rendered support. Factual position alignment ties position to the decoded center, and normalized attention overlap discourages duplicate allocation. Appearance transplantation aligns geometry semantics across objects, so recipient geometry governs layout while donor appearance supplies shape. A temporal initializer propagates calibrated slots across frames. On Obj3D, GeoCo-SAVi matches ISA reconstruction, reduces p-centroid error by over 80%, and cuts appearance-induced size variation by over 50% while producing the expected translation and scale responses. On 250 MOVi-C videos, it also improves reconstruction, instance grouping, and fixed-identity geometry control over two same-protocol references. GeoCo-SAVi transforms explicit geometry into compositional control, making both position and scale more readable and editable.

[118] When Does a Laugh Begin? Structured Annotator Disagreement in Temporal Laughter Localization cs.CV | cs.AIPDF

Eyal Hanania, Daniel Arkushin, Naveh Ayal, Jonathan Benvenisti, Amos Bercovich

TL;DR: 本文研究了笑声时间定位任务中标注者之间的分歧问题，发现这种分歧是结构化的而非随机噪声。作者重新标注了SMILE-Temporal基准数据集，分析了分歧的系统性模式，并提出了一种基于校准容忍带的评估方法，以更准确地评估模型预测。

Details

Motivation: 现有笑声时间定位任务通常基于单一参考标注进行评估，但标注者在笑声边界（尤其是细微笑声）上存在分歧，这影响了评估的可靠性。本文旨在揭示这种分歧的结构化特性，并改进评估方法。

Result: 在SMILE-Temporal数据集（672个视频，1683个事件）上，标注者间一致性为α=0.757。研究发现，偏移点的分歧是起始点的1.73倍，轻微笑声的分歧率（77%）远高于完整笑声（20%），且分歧可从事件属性预测（AUC=0.831）。使用单一标注评估时，系统F1分数波动达0.246，系统排名正确率仅69.7%（而使用全部标注可达80%）。

Insight: 创新点在于揭示了标注分歧的系统性模式（如偏移点分歧更大），并提出了基于合规校准容忍带（偏移点容忍带0.727秒，起始点0.5秒）的评估方法，将预测与全部标注分布进行比较，提高了评估的鲁棒性和公平性。

Abstract: Annotators routinely disagree on laughter boundaries and subtle chuckles, yet temporal laughter localization typically evaluates against a single reference annotation. We show that this disagreement is structured rather than random noise. Re-annotating the SMILE-Temporal benchmark (672 videos, 1,683 events) with 3-5 annotators per video (alpha = 0.757), we find systematic patterns: disagreement is 1.73 times larger at offsets than onsets, far more common for chuckles than full laughs (77% vs. 20%), and predictable from event attributes (AUC = 0.831). Evaluating against a single annotator breaks down under this structure: system scores shift by 0.246 F1 depending on the chosen ground truth, correctly ranking systems only 69.7% of the time (vs. 80% against all annotators). We propose a disagreement-calibrated evaluation that scores predictions against the full annotator distribution using conformally calibrated tolerance bands (wider at offsets, 0.727s, than onsets, 0.5s). The per-annotator annotations and analysis code are available at https://github.com/WSCSports/SMILE-Disagreement .

[119] MARR: Decoupling Policy, Execution, and Calibration for All-in-One Medical Image Restoration cs.CVPDF

Haobin Chen, Ao Chang, Heqin Zhu, Rundong Wang, Ting Liu

TL;DR: 本文提出了MARR框架，用于解决多模态医学图像（PET、CT、MRI）一体化修复中的挑战。该方法通过解耦策略选择、特征执行和输出校准三个模块，在无需退化标签或独立模态模型的情况下，实现了对异质性医学图像的高效统一恢复。

Details

Motivation: 一体化医学图像恢复旨在用一个模型处理多种模态图像，但不同模态在退化统计、解剖对比度和输出空间偏差上差异巨大。完全共享的网络会纠缠模态特定的残差误差，而独立的模态专用网络又牺牲了统一部署的实用性。因此，研究核心在于确定应将有限的适应性（adaptation）置于何处。

Result: 在一个包含PET、CT和MRI的一体化修复基准测试中，MARR在相同协议下重新训练的13种方法中表现最佳，在PET、CT和MRI上分别达到37.34 dB、33.85 dB和32.09 dB的PSNR值，并取得了最佳的模态平均PSNR 34.43 dB，达到了SOTA水平。

Insight: 创新点在于将一体化修复问题重构为对策略、执行和校准三个层面的有限适应性分配问题。具体而言，设计了基于退化感知的策略路由、模态私有的残差执行和图像域残差校正的紧凑框架，其中零初始化的模态特定输出头能在不干扰初始共享预测的情况下进行最终校准，这是一种高效且实用的设计思路。

Abstract: All-in-one medical image restoration seeks to recover heterogeneous clinical images with a single model, but PET, CT, and MRI differ substantially in degradation statistics, anatomical contrast, and output-space bias. A fully shared network can entangle modality-specific residual errors, whereas separate modality-specific networks sacrifice the practical advantages of unified deployment. We therefore recast all-in-one restoration as a question of where limited adaptation should be placed: policy selection, feature execution, or output calibration. We propose MARR, a compact restoration framework that constrains multi-modality adaptation into degradation-aware policy routing, modality-private residual execution, and image-domain residual correction without requiring degradation labels or separate modality-specific models. The policy branch forms a routing prompt from input statistics, latent content, and modality identity, and uses it only as a control signal. Prompt-gated modality-private adapters then perform lightweight residual refinement at intermediate decoder stages, while zero-initialized modality-specific output heads calibrate the final image-domain residual without perturbing the initial shared prediction. On an all-in-one PET, CT, and MRI restoration benchmark, MARR outperforms thirteen methods re-trained under the same protocol, achieving PSNR values of 37.34 dB, 33.85 dB, and 32.09 dB on PET, CT, and MRI, respectively, and the best modality-average PSNR of 34.43 dB. The code is publicly available at https://github.com/CHB-learner/MARR.

[120] Attention-Enhanced Deep Features with Heterogeneous Ensemble Learning for Glaucoma Detection cs.CV | cs.AI | cs.LGPDF

Abdullah Al Shafi, Nishat Sadaf Lira, Abrar Hasan, Kazi Saeed Alam, Swapnil Kundu Argha

TL;DR: 本文提出了一种用于青光眼检测的混合框架，该框架结合了注意力增强的深度特征提取与异构集成学习。具体而言，使用InceptionV3提取深度表示，并通过卷积块注意力模块（CBAM）进行细化以增强判别性视网膜特征。为了提高分类鲁棒性，使用多种机器学习模型结合单级集成（SLE）和双级集成（DLE）策略对提取的特征进行分类，同时采用SMOTE结合Tomek Links（SMOTE+TL）来缓解类别不平衡问题。

Details

Motivation: 现有基于深度学习的青光眼自动检测方法往往忽视特征细化、受类别不平衡影响，并且依赖单一分类器，限制了预测的鲁棒性。本文旨在解决这些问题。

Result: 在两个公开的视网膜眼底数据集上的实验评估表明，基于深度特征的方法持续优于基于手工特征的方法，而所提出的注意力增强框架实现了最佳整体性能。Grad-CAM可视化证实了模型关注临床相关的视网膜区域。

Insight: 主要创新点在于将注意力机制（CBAM）与深度特征提取结合以增强判别性特征，并采用异构集成学习策略（SLE和DLE）结合SMOTE+TL来提升分类鲁棒性和处理类别不平衡。这为医学图像分类任务提供了可借鉴的特征增强与集成学习相结合的思路。

Abstract: Glaucoma is a progressive optic neuropathy characterized by irreversible damage to the optic nerve, making timely diagnosis critical to prevent permanent vision loss. Although deep learning has demonstrated promising performance in automated glaucoma detection, existing approaches often overlook feature refinement, suffer from class imbalance, and rely on individual classifiers that limit prediction robustness. To address these challenges, this paper proposes a hybrid glaucoma detection framework that integrates attention-enhanced deep feature extraction with heterogeneous ensemble learning. Specifically, deep representations are extracted using InceptionV3 and subsequently refined by incorporating the Convolutional Block Attention Module (CBAM) to enhance discriminative retinal features. To improve classification robustness, the extracted features are classified using multiple machine learning models together with Single-Level Ensemble (SLE) and Double-Level Ensemble (DLE) strategies, while SMOTE combined with Tomek Links (SMOTE+TL) is employed to alleviate class imbalance. Furthermore, a systematic comparison of handcrafted, deep, and attention-enhanced deep feature representations is conducted. Experimental evaluation on two public retinal fundus datasets demonstrates that deep feature-based methods consistently outperform handcrafted feature-based methods, while the proposed attention-enhanced framework achieves the best overall performance. Furthermore, Grad-CAM visualizations confirm that the proposed model focuses on clinically relevant retinal regions, providing interpretable evidence on the model’s prediction process.

[121] VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes cs.CVPDF

Yan Ma, Jiadi Su, Zhulin Hu, Ethan Chern, Linhao Zhang

TL;DR: 本文介绍了VidaForge，一个用于视频预训练数据配方研究的开源基础设施。它将数据配方定义为从原始视频到训练数据集的可执行五阶段工作流，允许研究人员系统地比较不同数据决策对模型性能的影响。作者通过对比Wan 2.1和V-JEPA 2.1的从头预训练实验，展示了该工作流的应用，并发布了包含314万个场景片段、6475小时视频的VIDAFORGE-3M数据集。

Details

Motivation: 当前视频基础模型严重依赖大规模预训练数据，但其端到端数据管道通常是封闭的，难以检查或复用，这阻碍了研究人员探究数据配方如何影响模型预训练。

Result: 在Wan 2.1和V-JEPA 2.1的从头预训练实验中，更广泛覆盖的数据配方在下游基准测试中取得了最高分，而基于损失的评估则倾向于不同的配方。

Insight: 主要创新点在于提出了一个将视频数据配方定义为可执行、可追溯工作流的开放研究框架，使得数据决策与下游模型性能的关联研究变得系统化和可复现。同时，发布的带细粒度标注的大规模数据集为社区提供了宝贵资源。

Abstract: Video foundation models increasingly rely on large-scale pretraining data, yet the end-to-end data pipelines behind them remain largely closed and difficult to inspect or reuse. Researchers seeking to understand how video data recipes affect model pretraining often need to build substantial infrastructure before testing even a focused hypothesis. We present VIDAFORGE, an open research infrastructure that represents a video data recipe as an executable five-stage workflow from raw videos to training datasets. A decision in this workflow can be varied to construct alternative datasets while preserving how every sample was produced. To demon strate this research workflow, we compare data recipes with different coverage and quality in early from-scratch pretraining of Wan 2.1 and V-JEPA 2.1. Across both learning objectives, the broader-coverage recipe achieves the highest downstream benchmark scores, while loss-based evaluation favors different recipes. This study demonstrates how VidaForge connects data-recipe choices to downstream model performance. We further release VIDAFORGE-3M, containing 3.14 million scene level clips totaling 6,475 hours, with fine-grained annotations and curation signals for video data-recipe research.

[122] Counterfactual Tests for Measuring Chain-of-Thought Faithfulness in Visual Language Models cs.CV | cs.AI | cs.CLPDF

Bayar Menzat, Maximilian Süss, Ruizhi Wang, Benno Steinegger, Thomas Lukasiewicz

TL;DR: 本文针对视觉语言模型（VLMs）中的思维链（CoT）忠实性问题，提出了两种反事实测试方法vCT和vCCT，用于评估CoT是否真实反映模型决策过程。研究在Counter-SNLI-VE和Counter-A-OKVQA两个数据集上对八个开源VLMs进行了基准测试，发现CoT在跟踪视觉证据方面不可靠，且Predict-then-Explain解释比预答案CoT更忠实。

Details

Motivation: 现有方法主要针对文本输入测量CoT忠实性，但难以直接应用于视觉输入；本文旨在解决视觉语言模型中CoT可能看似合理却无法忠实反映模型决策过程的问题。

Result: 在Counter-SNLI-VE和Counter-A-OKVQA数据集上测试表明，CoT常忽略导致预测显著变化的移除对象，却在变化小时提及；Predict-then-Explain解释与扰动引起的概率变化更一致，而二进制vCT分数常接近饱和。

Insight: 创新点包括将反事实测试（CT/CCT）适配到视觉输入（vCT/vCCT），并构建了包含单对象差异的图像对数据集；客观分析认为，该方法为评估VLMs的CoT忠实性提供了新工具，揭示了CoT在视觉上下文中的局限性。

Abstract: Chain-of-thought (CoT) may often look plausible, yet it may not faithfully reflect the model’s decision-making process. While methods for measuring the faithfulness of CoTs for textual inputs have been increasingly introduced, using these methods for visual inputs is not straightforward. In this work, we adapt the family of counterfactual methods for measuring CoT faithfulness, namely the Counterfactual Test (CT) and Correlational Counterfactual Test (CCT), to visual inputs, and call them vCT and vCCT, respectively. Using vCT and vCCT, we benchmark eight recent open-source Vision Language Models (VLMs) on two datasets. Our analysis shows that CoTs do not reliably track visual evidence that influences model predictions: they may omit the removed object even when its removal causes a large prediction shift, yet mention it when the shift is small. We further find that Predict-then-Explain explanations align more strongly with perturbation-induced probability shifts than pre-answer CoTs, while binary vCT scores are often nearly saturated. We also include a reconstruction control, in which images pass through the same editing pipeline without object removal, and find that the main object-removal intervention induces larger shifts than reconstruction alone. We construct and release Counter-SNLI-VE and Counter-A-OKVQA, two datasets of image pairs that differ by a single object.

[123] Companion-style QA Assistance in Ego-Vision cs.CV | cs.AIPDF

Hangyu Qin, Junbin Xiao, Shenglang Zhang, Angela Yao

TL;DR: 本文提出了BuddyVQA基准数据集和MyBuddy模型，用于解决第一人称视角流媒体视频中的伴侣式问答任务。BuddyVQA包含超过2.1万个问题，关注自我指示表达和交互式链式问题，MyBuddy模型通过多模态思维链推理、问题过滤器和多级记忆机制来提升性能。

Details

Motivation: 现有VideoQA基准大多忽略了日常第一人称QA辅助中的两个关键特性：自我指示表达和交互式链式问题，这需要模型在长视频流中推断用户的实时意图。

Result: MyBuddy模型在BuddyVQA基准上显著提升了基础模型的性能，并且这些提升能够泛化到其他流媒体和通用视频QA基准上，证明了方法的有效性和适用性。

Insight: 创新点在于提出了专门针对第一人称流媒体视频的伴侣式QA基准，并设计了结合多模态思维链推理和高效信息检索机制的模型架构，以解决长上下文中的意图推断和视觉指代消解问题。

Abstract: AI companions are envisioned as always-on assistants that support users in daily life. With this regard, we introduce BuddyVQA, a benchmark for companion-style question answering (QA) on egocentric streaming video. BuddyVQA contains 21.6K questions linked to 6K highlight moments across 1,012 long, egocentric videos. It features two key characteristics that are common in daily first-person QA assistance but are largely overlooked in existing VideoQA benchmarks: ego-deictic expressions and interactively chained questions (e.g., “Where is it?”, “How to get there?”). These require models to infer a user’s in-situation intent by resolving visual pronouns in the context of egocentric visual and QA contents, with both grounded in a long-form streaming setting. To tackle the challenges, we propose MyBuddy, a companion-style QA assistant that highlights a multimodal chain-of-thought reasoning mechanism to infer the final answer based on the historical QA and visual content. An additional question filter and multi-level memory are designed to facilitate efficient QA and visual information retrieval under streaming QA settings. Experiments show that MyBuddy significantly enhances the performance of foundation models on BuddyVQA. Moreover, these gains generalize to other streaming and common video QA benchmarks, demonstrating the applicability and effectiveness of our approach. Our code and dataset are available at https://github.com/QHUni/BuddyVQA

[124] RoLA: Rotary-Positioned Low-Rank Linear Attention for Efficient Diffusion Transformers cs.CVPDF

Zekun Zhang, Yixiang Cai, Yuxi Liu, Tengxu Sun, Tianle Liu

TL;DR: 本文提出了RoLA（Rotary-Positioned Low-Rank Linear Attention）方法，用于解决扩散Transformer（DiT）在视频生成中自注意力计算复杂度高的问题。该方法设计了一种与3D旋转位置编码（RoPE）兼容的低秩线性注意力分支，能够在保持相对位置几何关系的同时实现跨token的全局聚合，从而在90%稀疏度下保持生成质量，并在Wan2.1-14B模型上实现2.63倍的端到端推理加速。

Details

Motivation: 扩散Transformer在视频生成中表现出色，但其密集的时空自注意力计算复杂度随序列长度呈二次方增长，成为推理瓶颈。现有的稀疏低秩混合方法在结合3D RoPE时存在结构兼容性问题：旋转操作与非线性特征映射通常不可交换，导致难以在保持相对旋转几何的同时维护查询无关的线性摘要。

Result: 在开源视频DiT上的实验表明，该方法在90%稀疏度下仍能保持竞争力的生成质量，在Wan2.1-14B模型（720p，81帧）上实现了2.63倍的端到端推理加速（在NVIDIA H100 GPU上测量）。

Insight: 创新点在于将RoPE应用于非线性低秩特征映射之外，并重用与低秩瓶颈匹配的预训练旋转调度的截断子集，从而设计出具有相对位置行为的线性时间低秩全局分支，无需额外位置参数。这解决了旋转与非线性不交换的兼容性问题，实现了真正的跨token聚合。

Abstract: Diffusion Transformers (DiTs) achieve strong video generation quality, but their dense spatiotemporal self-attention scales quadratically with sequence length and quickly becomes the dominant inference bottleneck. Sparse low-rank hybrids alleviate this cost by combining a local sparse branch with a global compressed branch. In video DiTs equipped with 3D Rotary Position Embeddings (RoPE), the global branch faces a structural compatibility issue: when RoPE is applied before a nonlinear feature map, the rotation and nonlinearity generally do not commute, making it difficult to keep a query-independent linear summary while preserving relative rotary geometry. Existing work often sidesteps this issue by replacing genuine cross-token global aggregation with coordinate-conditioned surrogates or learnable absolute positional modules. These compromises can be effective, but they approximate relative decay from absolute coordinates and introduce extra positional parameters. We propose \textbf{RoLA}, a rotary-positioned low-rank linear-attention branch that keeps genuine cross-token aggregation while remaining compatible with a reusable linear summary. The design applies RoPE \emph{outside} the nonlinear low-rank feature map and reuses a truncated subset of the pre-trained rotary schedule matched to the low-rank bottleneck. This yields a linear-time low-rank global branch with relative positional behavior by design and no additional positional parameters; the full sparse–low-rank module still includes the fixed-sparsity sparse branch. Experiments on open-source video DiTs show that the resulting method remains competitive in generation quality at 90% sparsity while achieving 2.63$\times$ end-to-end inference speedup on Wan2.1-14B (720p, 81 frames, measured on an NVIDIA H100 GPU).

[125] ADELE - Adaptive Delaunay Grids for High-Fidelity Mesh-Native Reconstruction cs.CV | cs.GRPDF

Johannes Weidenfeller, Shaofei Wang, Philipp Fürnstahl, Siyu Tang

TL;DR: 本文提出了一种名为ADELE的自适应网格优化框架，用于高质量、网格原生的三维重建。该方法结合了可优化的Delaunay四面体网格与多分辨率哈希网格，通过点剪枝和插入实现自适应细化，并利用基于光栅化的深度偏移渲染来减少几何伪影。

Details

Motivation: 现有重建方法（如NeRF/3DGS）通常将网格提取作为后处理步骤，导致表面过度平滑或三角形数量过多；而现有的网格原生优化方法则受限于固定分辨率离散化和不稳定的优化行为。本文旨在解决这些问题，实现高质量、自适应的网格重建。

Result: 该方法在多个以物体为中心的基准测试中显著优于现有的网格优化方法，并与最先进的NeRF/3DGS方法性能相当。

Insight: 创新点包括：结合Delaunay四面体网格与多分辨率哈希网格的自适应表示；使用体渲染引导粗几何，并利用基于网格的渲染恢复细节；提出可微分的、基于光栅化的深度偏移渲染公式以减少伪影。从客观角度看，该方法通过自适应网格细化与混合渲染策略，有效平衡了重建质量与计算效率。

Abstract: Meshes remain the most practical representation for geometry reasoning and integration into graphics pipelines, yet existing reconstruction methods struggle to produce high-quality meshes. Most state-of-the-art approaches initially learn an intermediate representation (NeRF/3DGS) and treat mesh extraction as a post-processing step, which often leads to oversmoothed surfaces or poor quality meshes with excessive triangle counts.Existing mesh-native optimization methods alleviate some of these issues but suffer from fixed-resolution discretizations and unstable optimization behavior. In this paper, we introduce an adaptive mesh-based optimization framework and a practical mesh rendering technique to address these challenges. Our representation combines an optimizable Delaunay-triangulated tetrahedral grid with a multi-resolution hash grid. The former is refined through point pruning and insertion, while the latter provides latent features for SDF/appearance value predictions. We use volumetric rendering to bootstrap a coarse geometry while leveraging mesh-based rendering for recovering fine-grained details. Additionally, we propose a differentiable, rasterization-based depth-offset rendering formulation, reducing geometric artifacts and improving reconstruction quality. Our method significantly outperforms existing mesh optimization approaches across a variety of object-centric benchmarks while being competitive with state-of-the-art NeRF/3DGS methods.

[126] LASSNet: Level-Aware Availability-Conditioned Spatial-Semantic Fusion for Brain Tumor Segmentation with Missing MRI Modalities cs.CVPDF

Haobin Chen, Ao Chang, Rundong Wang, Zhicheng Li, Zhihao Tang

TL;DR: LASSNet是一种用于脑肿瘤分割的神经网络，专门处理多模态MRI数据中可能缺失某些成像序列的情况。该方法通过层次感知的可用性条件空间-语义融合机制，在不同特征层次上根据模态可用性进行自适应融合，避免了显式重建缺失模态。

Details

Motivation: 解决多模态MRI脑肿瘤分割中因采集成本、协议差异、扫描失败或患者状况导致一个或多个模态缺失的问题，探索融合策略是否应随特征表示层次而变化。

Result: 在BraTS2019和BraTS2023数据集上，针对所有15种非空模态配置，LASSNet在WT、TC和ET区域的平均Dice分数分别达到76.7%和83.2%。

Insight: 创新性地提出融合应同时受模态可用性和特征层次条件约束，设计了层次可用性条件融合（HACF）模块处理高分辨率空间特征，以及三尺度关系-空间融合（TriRSF）模块建模瓶颈层语义关系，实现了不依赖缺失模态重建的端到端分割。

Abstract: Brain tumor segmentation from multimodal MRI relies on complementary evidence across four imaging sequences, yet one or more modalities may be unavailable because of acquisition cost, protocol variation, scan failure, or patient condition. Existing work has explored reconstruction, knowledge transfer, and direct feature fusion, but leaves open whether missing-modality fusion should change with representation level. High-resolution lateral features retain spatial detail, whereas compressed bottleneck features encode semantic and inter-modality context. We therefore hypothesize that fusion should be conditioned jointly on modality availability and feature hierarchy. We propose the Level-Aware Availability-Conditioned Spatial-Semantic Fusion Network (LASSNet), which contains two level-specialized modules. Hierarchical Availability-Conditioned Fusion (HACF) constructs four lateral representations using count-normalized aggregation of available modalities, mask-conditioned channel modulation, and local 3D refinement. Tri-Scale Relational-Spatial Fusion (TriRSF) models relations among available modality descriptors and spatial context across multiple bottleneck resolutions, followed by cross-scale aggregation and availability-conditioned global spatial attention. A shared coarse-to-fine decoder starts from TriRSF semantics and progressively injects HACF features, without reconstructing missing inputs. Across all 15 non-empty modality configurations, LASSNet obtains mean Dice scores of 76.7% and 83.2% over WT, TC, and ET on BraTS2019 and BraTS2023, respectively.

[127] Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features cs.CVPDF

Ali Rafiaei, Michael Greenspan

TL;DR: 本文提出了B2TFPose，一种无需训练、零样本的6自由度姿态估计方法，用于从RGB图像中估计未见过的物体姿态。该方法仅使用一个冻结的DINOv3视觉Transformer作为预训练组件，提取密集的patch级特征，通过重新审视经典的局部特征匹配范式，实现了跨合成到真实域差距的泛化。

Details

Motivation: 解决在无需任务特定微调的情况下，对未见物体进行6自由度姿态估计的挑战，旨在通过大规模自监督基础模型复兴经典的局部特征匹配方法。

Result: 在BOP Benchmark的七个核心数据集上，B2TFPose在不使用精炼时达到40.7的平均AR，使用精炼后达到56.4，在无需训练的RGB方法中取得了最先进的性能，并超越了包括GigaPose和GenFlow在内的已训练方法，同时推理速度具有竞争力。

Insight: 创新点包括：采用测地线非极大值抑制策略获取视角多样化的模板集以进行由粗到细的对应匹配；提出渲染引导的重新对应（RRC）方法，在估计姿态下合成物体特定视图并重新建立密集2D-3D对应以锐化初始估计，无需额外学习参数；以及多掩码假设选择策略共同评分竞争的分割候选以解决分割模糊性。从客观角度看，该方法巧妙地将大规模自监督特征与经典匹配范式结合，实现了高效、泛化性强的零样本姿态估计。

Abstract: We present B2TFPose, a training-free zero-shot method for 6DoF pose estimation of unseen objects from RGB images. Using a single frozen DINOv3 vision transformer as its only pretrained component within the pose estimation pipeline, B2TFPose extracts dense patch-level features that generalize across the synthetic-to-real domain gap without any task-specific fine-tuning, revisiting the classical local feature matching paradigm through the lens of large-scale self-supervised foundation models. Three contributions advance the training-free state of the art. A geodesic non-maximum suppression strategy retrieves a viewpoint-diverse template set for coarse-to-fine correspondence matching. Render-guided Re-Correspondence (RRC) synthesizes object-specific views at the estimated pose and re-establishes dense 2D-3D correspondences to sharpen the initial estimate without additional learned parameters. A multi-mask hypothesis selection strategy jointly scores competing segmentation candidates to resolve segmentation ambiguity. On the seven core datasets of the BOP Benchmark, B2TFPose achieves 40.7 mean AR without refinement and 56.4 with refinement, establishing state-of-the-art performance among training-free RGB methods and outperforming trained counterparts including GigaPose and GenFlow, at competitive inference speed.

[128] Uni-Light: An Ultra-Lightweight Framework via Uncertainty-Aware Knowledge Distillation for Brain Tumour Segmentation cs.CVPDF

Libing Kuang, Soren Salehi, Ziling Wu, Ahmad P. Tafti, Armaghan Moemeni

TL;DR: 本文提出了一种名为Uni-Light的超轻量级框架，用于多模态MRI的3D脑肿瘤分割。该框架通过结合多尺度卷积、不确定性感知知识蒸馏以及符号距离场边界损失，在显著降低计算开销的同时，实现了高保真度的分割。

Details

Motivation: 现有脑肿瘤分割方法计算量大，而当前的轻量级架构又难以在复杂的肿瘤区域保持分割精度。本文旨在解决这一矛盾，为资源受限的临床环境提供一个高精度且高效的解决方案。

Result: 在BraTS2023-GLI和MSD-BTS数据集上的实验表明，Uni-Light将参数量减少了97.56%，FLOPs减少了73.03%，推理内存占用减少了81.58%，同时其Dice分数平均超越了当前最先进模型1.47%。

Insight: 核心创新在于利用不确定性感知的知识蒸馏，将教师模型的不确定性作为数据驱动的监督信号，引导学生模型关注难以分类的区域，从而在不增加标注成本的情况下重新优化训练数据分布。此外，结合多尺度特征和几何约束的边界损失也是实现高效高精度分割的关键。

Abstract: Accurate 3D brain tumour segmentation from multi-modal Magnetic Resonance Imaging (MRI) is essential for clinical diagnosis and treatment planning. Existing brain tumour segmentation methods often suffer from heavy computational demands, while current lightweight architectures frequently lack the capacity to maintain segmentation fidelity in complex tumour regions. To address these issues, we propose a novel ultra-lightweight framework (Uni-Light) that achieves high-fidelity segmentation with substantially reduced computational overhead. It combines multi-scale convolutions with an uncertainty-aware knowledge distillation scheme that directs the student model toward hard-to-classify regions, complemented by a Signed Distance Field boundary loss for geometric constraints. Experimental results on BraTS2023-GLI and MSD-BTS datasets demonstrate that Uni-Light reduces parameters by 97.56%, floating-point operations (FLOPs) by 73.03%, and inference memory footprint by 81.58%, while surpassing the state-of-the-art model by an average of 1.47% in Dice score, offering a highly competitive trade-off between segmentation accuracy and computational efficiency in resource-constrained clinical settings. This work also advances data engineering for medical imaging by demonstrating that teacher model uncertainty can be exploited as a data-driven supervisory signal, re-prioritising the training data distribution without requiring additional annotation.

[129] Agentic Visual Generation: From Generative Models to Agentic Control cs.CVPDF

Yinming Huang, Shuyuan Tu, Xi Yan, Jiahao Zhan, Zihan Yang

TL;DR: 本文提出了一个基于控制器决策范围的框架，将视觉生成系统从生成模型演化为智能体控制过程进行分类。该框架定义了四个控制级别（L1-L4），分别对应条件控制、执行控制、结果自适应控制和经验自适应控制，并分析了不同视觉生成任务中控制器能力的演进和分布。

Details

Motivation: 现有视觉生成系统缺乏一致的标准来判断何时一个生成系统具有智能体特性，通常将规划深度、工具使用、多角色协作和强化学习等特征视为智能体性的证据，但这些特征并不直接决定控制器在生成过程中能做出哪些决策。

Result: 通过将提出的框架应用于图像、视频、编辑、3D、世界、幻灯片和用户界面生成等多个领域，揭示了控制器能力如何演进以及其机制在不同控制级别上的分布情况。

Insight: 创新点在于提出了一个以控制器在生成过程中的直接决策范围为核心的新分类框架，该框架强调决策范围而非模型大小、系统复杂性或工具数量，为理解和比较不同视觉生成系统的智能体特性提供了清晰、一致的标准。

Abstract: Visual generation is evolving from generative models used through a single invocation into agentic control processes that can plan, select tools, inspect intermediate synthesized outputs, revise failures, and reuse prior experience. In most existing systems, the controller is an LLM or VLM, while visual generation models serve as tools or executors. However, existing work lacks a consistent criterion for determining when a generation system becomes agentic. Planning depth, tool use, multi-role collaboration, and reinforcement learning are often treated as evidence of agenticity, even though none of them necessarily determines which generation decisions the controller can make. We organize the field according to what the controller can directly control in the generation process. At L1 Conditioning Control, the controller prepares the input to a predetermined generator but does not control which visual operation is executed. At L2 Execution Control, it selects and invokes actual generation, editing, rendering, or other content-modifying operations. At L3 Outcome-Adaptive Control, it observes an intermediate outcome and uses that observation to change a subsequent operation within the current task. At L4 Experience-Adaptive Control, it retains experience from completed tasks and uses that experience to change decisions on future tasks. L0 Fixed Support separately denotes generators, editors, evaluators, reward models, benchmarks, and fixed pipelines without a deployed controller that makes generation-level decisions. These levels describe a progressively broader decision-making scope rather than model size, system complexity, output quality, tool or role count, or training method. Applying this framework across image, video, editing, 3D, world, slide, and user-interface generation reveals how controller capabilities have evolved and how their mechanisms are distributed across levels.

[130] Comparative Study of Anatomical and Learned Features in AI Models for Structural Brain MRI cs.CV | cs.AIPDF

Boyang Yu, Miquel Lopez Escoriza, Long Chen, Arjun V. Masurkar, Narges Razavian

TL;DR: 本研究系统评估了基于AI的神经影像建模中三种主流特征提取范式：解剖特征计算、CNN监督学习和ViT无监督预训练+监督微调。基于约8万参与者的18个公开数据集，研究发现基于解剖特征的线性模型在诊断性能上可与复杂AI框架（包括在数千扫描上预训练的基础模型）相媲美。同时，CNN和预训练ViT能隐式捕获相关解剖信息。基于此，论文提出了一种在基础模型预训练中融入解剖信息的新方法ASP，在生物年龄估计任务上超越了现有模型。

Details

Motivation: 旨在全面比较AI神经影像建模中不同特征提取方法（解剖特征、监督CNN、无监督预训练ViT）的有效性，以明确各范式的优势与局限。

Result: 在涵盖七个不同临床任务的约8万参与者数据集上，解剖特征的线性模型与复杂AI模型（包括大规模预训练的基础模型）的诊断性能相当；提出的ASP方法在生物年龄估计任务上超越了现有模型。

Insight: 创新点在于通过大规模实证研究揭示了解剖特征在特定任务中的竞争力，以及AI模型能隐式学习解剖信息；提出的ASP方法将显式解剖信息融入基础模型预训练，为领域适应提供了新思路。

Abstract: In this work, we comprehensively evaluate three popular feature-extraction paradigms in AI-based neuroimaging modeling: (1) computation of anatomical surfaces and volumes, (2) supervised learning with convolutional neural networks (CNNs), and (3) unsupervised pretraining of vision transformer (ViT) foundation models, followed by supervised finetuning. Our study is based on 18 publicly available datasets containing 3D structural T1-weighted MRI scans from approximately 80,000 participants across seven distinct clinical tasks. We observe that a linear model based on anatomical features matches the diagnostic performance of complex nonlinear features learned by sophisticated AI frameworks, including foundation models trained on thousands of scans. Conversely, CNNs and pretrained ViTs learn features that implicitly capture relevant anatomical information, bypassing the need for explicit feature extraction. Building upon these insights, we propose Anatomy Segmentation Pretraining (ASP), a novel method to incorporate anatomical information during foundation-model pretraining, which outperforms existing models in biological age estimation.

[131] Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane cs.CVPDF

Jian Shi, Xinge Yang, Chaoyang Wang, Wolfgang Heidrich, Peter Wonka

TL;DR: 该论文揭示了现代立体匹配模型在视差跨越零值时性能急剧下降的问题，即当物体位于零视差平面（ZDP）后方（对应负视差）时，端点误差（EPE）会激增4.6至37倍。作者提出了ZDPShift基准测试，包含来自七部开源电影的21,495个立体图像对，并展示了六个SOTA模型在该场景下的崩溃。研究发现，预训练的特征本身已能处理负视差，问题仅在于输出约定丢弃了该能力，通过在SceneFlow合成数据上进行训练即可解决，且不影响在KITTI等标准数据集上的正向视差性能。

Details

Motivation: 解决现代立体匹配模型在处理负视差（即物体位于零视差平面后方）时的系统性失败问题，因为现有数据集、架构和评估协议均基于非负视差几何构建，导致模型无法处理影视和VR等内容中常见的负视差场景。

Result: 在提出的ZDPShift基准测试上，六个SOTA图像和视频立体匹配模型（如FoundationStereo）在零视差平面移动后性能崩溃，EPE从2.24像素激增至75.33像素；但仅使用SceneFlow合成数据训练解码器（冻结预训练特征），即可将误差控制在正负视差范围内基本持平（EPE波动在0.2像素内），且在KITTI、Middlebury等标准数据集上的正向视差精度基本保持不变。

Insight: 创新点在于揭示了立体匹配模型对负视差的盲点源于数据与输出约定的限制，而非底层匹配能力不足；通过ZDPShift基准量化了该问题，并证明仅需调整训练策略（如用合成数据微调解码器）即可扩展模型至全视差范围，这为改进立体匹配系统的鲁棒性提供了简单有效的途径。

Abstract: Modern stereo matching models fail when disparity crosses zero, with end-point error (EPE) rising by 4.6-37$\times$. Yet stereoscopic content, from cinema 3D to VR, routinely contains objects behind the zero-disparity plane (ZDP), corresponding to negative disparities. The blind spot cascades through datasets, architectures, and evaluation protocols, all of which inherit the non-negative geometry. Rectified parallel cameras place ZDP at infinity, so every finite depth yields $d=fB/z \ge 0$ by construction, and nothing within the standard pipeline can violate, or even measure, a negative disparity. To measure it, we propose \textit{ZDPShift}, a benchmark of $21{,}495$ stereo pairs from seven cinematographer-authored open movies, each frame rendered at five zero-disparity-plane positions with dense signed ground truth. Six state-of-the-art image and video stereo matching models collapse once the plane moves. On identical scene content, FoundationStereo goes from $2.24$ px EPE to $75.33$px, with every backbone leaving roughly half of all pixels exceeding a three-pixel disparity error. What is missing, however, is not the underlying matching capability. % The capability itself, however, is already present. Training on supervision synthesized from SceneFlow, which adds no new data or parameters, keeps the error flat across the signed range. Training only the decoder, with the pretrained matching features frozen, performs comparably across all six backbones, with EPE jittering within $0.2$px. Thus, the pretrained features already extend to the negative regime they were never trained on, and only the output convention discarded it. Meanwhile, positive-regime accuracy on KITTI, Middlebury, ETH3D, and Sintel is largely preserved.

[132] Generalist Open-World Temporal Perception cs.CVPDF

Cristian Sminchisescu

TL;DR: 本文提出了一种名为GOWTPA的通用开放世界时序感知架构，旨在构建一个能够整合多模态感官输入、语言和结构化输出的统一世界模型。该模型旨在从原始多模态数据流中推断几何、语义、交互结构等信息，并保持跨遮挡和视角的身份一致性，以支持理解、预测和可控合成等高级任务。

Details

Motivation: 为了解决下一代人工智能系统需要具备原生时序和多模态感知与推理能力的问题，论文旨在构建一个能够表示生物形态、物理结构和人造物及其交互的、具有时间一致性的通用感知系统。

Result: 摘要中未提及具体的定量实验结果或基准测试结果，但提出了一个架构范式，将感知与合成视为同一生成基座下的不同条件化过程。

Insight: 核心创新点在于提出了一个统一的架构范式（GOWTPA），将识别、结构化预测和仿真视为同一生成模型的不同条件化模式，从而将通用时序感知定位为更广泛多模态智能和物理AI的基础层，这与当前主要依赖语言探针或逼真视频生成来获取能力的范式形成互补。

Abstract: The next generation of artificial intelligence systems will likely be natively temporal and multimodal in both inputs and outputs: able to converse, perceive, predict, reason, and synthesize through a shared world representation. Realizing this requires a temporal perceptual substrate integrating sensory streams, language, and structured outputs within a multimodal world model. We seek a generalist open-world perceptual system that represents biological forms, natural physical structures, and artifacts, and their interactions, as a coherent, temporally persistent process. The model should infer geometry, articulation, semantics, interaction structure, and uncertainty from raw multimodal streams; maintain identity through occlusion and viewpoint change; generalize across species, forms, mechanisms, and materials; and abstain or expand its ontology when encountering the unknown. The objective is a structured world state supporting understanding, prediction, counterfactual reasoning, and controllable synthesis. Recent work suggests that some cross-modal and reasoning-like capabilities can emerge from large-scale generative video pretraining, reminiscent of language-model scaling. Yet these capabilities are often accessed through language probes or expressed through photorealistic video, leaving explicit semantic, geometric, or temporal structure largely unexposed. This paper articulates an alternative and complementary paradigm: perception and synthesis as distinct conditionings within a shared Generalist Open-World Temporal Perception Architecture (GOWTPA). Recognition, structured prediction, and simulation arise as different conditionings of the same generative substrate, while reasoning and embodiment-specific policies build upon the resulting world state. This positions generalist temporal perception as a potential foundation layer for broader multimodal intelligence and physical AI.

[133] RAIDAL: Redundancy-Aware Information Density Active Learning for CTC-Based Continuous Sign Language Recognition cs.CVPDF

Rafael A. Diniz Augusto, Gabriel L. Oliveira, Erickson R. Nascimento

TL;DR: 本文提出了一种名为RAIDAL的冗余感知信息密度主动学习方法，用于解决基于CTC的连续手语识别中因视频时间冗余（如休息姿势、不规则停顿等）导致主动学习样本选择失准的问题。该方法利用CTC解码器在推理过程中产生的对齐峰值来定位手语词汇区域，从而限制基于表示的评分仅在这些区域内进行，无需额外标注成本。在三个数据集和两种架构上的实验表明，RAIDAL在大词汇量、预算有限的情况下显著优于基线方法，并在小词汇量、大预算场景中保持竞争力。

Details

Motivation: 连续手语识别的发展受限于连续视频流标注的高成本，而传统主动学习采集函数未针对弱对齐的手语视频设计，视频中的时间冗余（如非手语动作和冗余帧）会扭曲样本的信息量估计，影响选择效果。

Result: 在三个数据集和两种架构上，RAIDAL在大词汇量、预算有限的设置中实现了最强的数据效率提升，优于竞争基线；在小词汇量、大预算设置中仍保持竞争力。

Insight: 创新点在于重新利用CTC解码器的对齐峰值来识别手语词汇区域，为主动学习采集函数提供时间结构信息，从而避免冗余帧干扰，这是一种零额外标注成本的方法，可提升样本选择的准确性。

Abstract: Continuous sign language recognition (CSLR) is a key technology for accessibility, yet its development remains limited by the high cost of annotating continuous video streams. Active learning offers a path toward mitigating this cost, but standard acquisition functions are not designed for weakly aligned sign language videos, where sign executions are interleaved with rest poses, irregular pauses, sign-like motion, and temporally redundant frames. This temporal redundancy can undermine sample selection, as acquisition scores may be influenced by timesteps from regions that are not associated with the decoded gloss sequence, distorting the video’s estimated informativeness. In this work, we show that modern CSLR models already contain a mechanism for identifying gloss-level temporal evidence: the CTC decoder. Although typically used only during inference, its alignment peaks indicate where the model localizes each predicted gloss in the feature sequence, providing a source of temporal structure for active learning acquisition functions at zero additional labeling cost. Thus, we introduce RAIDAL (Redundancy-Aware Information Density Active Learning), which repurposes the CTC decoder to restrict representation-based scoring to decoder-aligned gloss regions, rather than exposing the acquisition function to the entire unfiltered video. Across three datasets and two architectures, RAIDAL achieves its strongest data-efficiency gains over competing baselines in large-vocabulary, budget-limited settings, while remaining competitive in the smaller-vocabulary, large-budget setting. The code used in this work is publicly available at github.com/verlab/RAIDAL.

[134] Organization of Valence and Arousal in Vision-Language Representations of Built Environments: Insights from the EMOIS Dataset cs.CVPDF

Madoka Yonekura, Katsunori Kohda, Nobuhiko Muramoto, Takahiro Yamaguchi

TL;DR: 本文介绍了用于研究建筑环境情感印象的EMOIS数据集，包含1,544张真实世界建筑图像，每张图像都标注了从大规模网络调查中收集的效价和唤醒度评分。研究使用CLIP表征进行预测和几何分析，系统地探究了效价和唤醒度在表征空间中的编码和组织方式。

Details

Motivation: 视觉感知对人们在日常生活中形成的情感印象有重要贡献，但视觉基础模型如何表征这些印象在很大程度上尚未被探索。为了系统研究这一主题，需要构建一个专门的数据集和分析框架。

Result: 回归分析显示，在EMOIS数据集内部重复留出评估中，效价和唤醒度的平均决定系数分别达到0.865和0.807，预测性能很高。与通用情感图像数据集OASIS的跨数据集分析揭示了二者在情感组织上的差异。

Insight: 研究创新性地构建了针对建筑环境情感印象的密集标注数据集EMOIS，并利用CLIP表征进行系统分析，发现效价比唤醒度表现出更强、更一致的组织结构。这为理解建筑环境的情感计算表征提供了新的资源和见解。

Abstract: Visual perception of built environments contributes to the affective impressions that people form in everyday life. However, how these impressions are represented within vision foundation models remains largely unexplored. To support the systematic investigation of this subject, we introduce the Emotional Impression of Spaces (EMOIS) dataset, comprising 1,544 real-world built-environment images. Each image is annotated with image-evoked valence and arousal ratings collected from Japanese adults by conducting a large-scale web-based survey, with approximately 120 ratings per image. Using Contrastive Language–Image Pre-training (CLIP) representations, we perform predictive and geometric analyses to systematically investigate how valence and arousal are encoded and organized within the representation space. These analyses reveal that valence exhibited stronger and more coherent organization than arousal. Cross-dataset analyses with the Open Affective Standardized Image Set (OASIS), a benchmark dataset of general affective photographs, reveal differences in affective organization between the two datasets. Regression analyses demonstrate high predictive performance for valence and arousal within EMOIS, with mean coefficients of determination of 0.865 and 0.807, respectively, across repeated internal hold-out evaluations. Finally, we present an example-based interface illustrating how learned representations can support qualitative interpretation of predicted affective values. These findings can help elucidate affective representations of built environments and establish EMOIS as a densely annotated resource for future affective computing research in this domain.

[135] Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models cs.CV | cs.CL | cs.LG | cs.ROPDF

Mimo Shirasaka, Haochen Zhang, Yonatan Bisk

TL;DR: 该论文提出了情境观察者定位的概念，旨在评估视觉语言模型在具身任务中从说话者视角理解空间关系的能力。作者构建了POVBench基准数据集，用于区分推断、陈述和给定三种观察者定位形式，并测试了多个先进VLM模型。研究发现，即使观察者定位明确，模型基于方向性语言定位目标仍具挑战性，但显式分解观察者相对空间推理能改善定位性能。

Details

Motivation: 解决视觉语言模型在具身任务（如机器人学）中，能否从情境线索推断说话者视角并理解其空间关系的问题，即评估其情境观察者定位能力。

Result: 在POVBench基准测试中，多个SOTA视觉语言模型在基于方向性语言定位目标方面表现不佳，即使观察者定位明确时仍存在挑战；但显式分解观察者相对空间推理能提升目标定位效果。

Insight: 创新点在于提出了情境观察者定位的评估框架和POVBench数据集，能系统分离不同定位形式；客观分析表明，显式结构化空间推理是提升VLM在具身空间理解任务性能的关键方向。

Abstract: Reasoning over language instructions in embodied tasks such as robotics often requires understanding spatial relations from a speaker’s situated perspective. Humans infer such perspectives from shared environmental knowledge, activity context, and commonsense. Recent vision-language models (VLMs) appear capable of spatial reasoning, but their ability to infer a speaker’s viewpoint from contextual cues and interpret situated spatial relations from that viewpoint remains unclear. We call this capability contextual observer grounding. To study this capability, we construct the Point-of-View Benchmark (POVBench), a dataset of 3D scenes and queries that disentangles Inferred, Stated, and Given forms of observer grounding in natural embodied communication. Given multi-view observations and a natural-language sentence, models must localize unseen or underspecified targets from situated spatial and contextual cues. Across state-of-the-art VLMs, localizing targets from directional language remains challenging, even when observer grounding is made explicit. We find that explicit breakdowns of observer-relative spatial reasoning improve target localization. Our project page is available at https://mimo-owl.github.io/POVBench/.

[136] Novel Methods for Catheter and Guidewire Segmentation in X-ray Fluoroscopy under a Federated Learning Setting cs.CV | cs.AIPDF

Chayun Kongtongvattana

TL;DR: 本文提出了一种用于X射线透视中导管和导丝分割的结构感知联邦学习框架，解决了数据稀缺、隐私保护和结构复杂性等问题。该工作包括引入CathAction基准数据集、提出形状敏感损失函数、扩展至联邦学习设置并加入对抗优化，以及开发结构感知扩散模型生成合成视频序列以增强训练数据。

Details

Motivation: 基于学习的血管内手术器械分割方法受限于结构复杂性、数据稀缺性以及跨机构集中训练面临的隐私法规限制，需要一种能在保护数据隐私的同时实现高性能分割的协作学习框架。

Result: 在真实动物和体模数据上评估，形状敏感损失将Dice系数提升高达2.9点；联邦学习设置下，形状敏感损失在4到8个客户端时比联邦平均法在平均交并比上高出3点，加入对抗优化后真实动物数据上平均交并比提升超过10点；合成视频序列将数据稀缺下的联邦训练Dice分数从44%提升至51%，并在四个外部站点上均取得增益。

Insight: 创新点包括将分割掩码转换为符号距离图在结构特征空间中进行比较的形状敏感损失函数，在联邦学习中引入对抗优化的投影梯度下降方法，以及结合结构监督和域自适应重建目标的结构感知扩散模型用于生成合成训练数据，有效提升了模型在隐私保护下的分割性能和泛化能力。

Abstract: Endovascular procedures rely on real-time manipulation of thin instruments, catheters and guidewires, under X-ray fluoroscopy guidance, where accurate visual analysis is essential for procedural safety. Learning-based methods are constrained by structural complexity, data scarcity, and privacy regulations precluding centralised training across institutions. This thesis presents a structure-aware federated learning framework for catheter and guidewire analysis, with four contributions evaluated on real-animal and phantom data. A benchmark dataset, CathAction, is introduced for catheterisation analysis, with over 600,000 annotated frames and 40,000 segmentation masks. A shape-sensitive loss transforms masks into signed distance maps compared in a structural feature space, improving Dice coefficient by up to 2.9 points across five backbones. This is extended to federated learning with shape-sensitive loss, preserving geometric consistency under heterogeneous client data and outperforming federated averaging by up to three points in mean intersection-over-union as clients scale from four to eight. Federated learning with projected gradient descent adds adversarial optimisation, raising mean intersection-over-union by over ten points on real-animal data. Finally, a structure-aware diffusion framework synthesises catheter and guidewire video sequences, combining structural supervision with a domain-adaptive reconstruction objective, reducing Frechet video distance over a strong baseline while maintaining visual fidelity. Incorporating synthetic sequences into federated training raises the Dice score from 44 to 51 percent under data scarcity, with gains across four held-out sites. Together, these contributions advance privacy-preserving catheter and guidewire analysis, supporting collaborative training without centralising patient data or large amounts of manual annotation.

[137] Emo-DVS: A Multimodal Benchmark for Privacy-Aware Emotion Recognition with Event Cameras cs.CV | cs.AIPDF

Jiaqi Chen, Qinfu Xu, Hao Zhuang, Liyuan Pan

TL;DR: 该论文提出了Emo-DVS，一个用于隐私保护情感识别的多模态基准数据集，包含事件、音频和文本三种模态。为了解决现有事件相机方法在复杂场景下的局限性，作者还提出了信息引导门控融合（IGF）框架，通过预训练事件编码器、自适应模态门控和互信息最大化来融合多模态信息。

Details

Motivation: 传统RGB相机的情感分析存在隐私风险，而事件相机通过捕获异步亮度变化，能在保护面部身份细节的同时提供高动态范围感知。然而，现有基于事件的方法受限于数据集规模小、采集条件简单和依赖单模态视觉线索，难以应对复杂的真实世界场景。

Result: 在提出的Emo-DVS基准上进行的广泛实验表明，IGF框架实现了最先进的性能。

Insight: 创新点包括：1) 建立了首个大规模、多模态（事件、音频、文本）的事件相机情感分析数据集Emo-DVS，并耦合了动态光照与面部动作单元（FAU）子集；2) 提出了IGF框架，通过预训练、自适应门控和互信息最大化来有效融合多模态信息并抑制噪声，为解决事件相机数据稀缺和模态对齐问题提供了新思路。

Abstract: Emotion analysis is a fundamental task in computer vision, but its practical deployment remains constrained by the privacy risks inherent to conventional RGB cameras. Bio-inspired event cameras present a promising hardware-level solution because they capture asynchronous brightness changes, thereby reducing exposure of facial identity details while leveraging high dynamic range for robust perception under challenging illumination conditions. Despite these advantages, existing event-based methods struggle in complex real-world settings due to limited dataset scales, simple acquisition conditions, and reliance on single-modality visual cues. To address these, we establish a challenging tri-modal benchmark with event, audio, and text modalities and propose the Information-Guided Gated Fusion (IGF) framework, which first pre-trains an event encoder on the FAU subset of Emo-DVS to capture fine-grained facial dynamics, then employs adaptive modality gating to suppress modality-specific noise, and finally leverages mutual information maximization to align robust cross-modal representations. To alleviate data scarcity, we introduce Emo-DVS, the first large-scale event-based emotion analysis dataset, which couples dynamic illumination with the Facial Action Unit (FAU) subset and emotion subset. Extensive experiments demonstrate that IGF achieves state-of-the-art performance.

[138] CARDEA: Auditable Reasoning Grounded in Spatial Evidence for End-to-End Coronary Angiography Interpretation cs.CVPDF

Jia-Jen Lee, Shih-Yen Hou, Kee Koon Ng, Wei-Chun Wang, Shih-Sheng Chang

TL;DR: CARDEA是一个用于冠状动脉造影（CAG）端到端解释的统一大型视觉语言模型。它通过视觉特征对齐、自蒸馏链式框（CoB）冷启动和带可验证奖励的强化学习（RLVR）三阶段训练，旨在提供可审计的、基于空间证据的决策过程。模型在领域偏移下的优势分类和复杂性评估任务中表现与专家相当，并且RLVR显著提升了零样本报告生成能力。

Details

Motivation: 解决现有CAG AI系统缺乏可审计决策过程、无法进行全面的开放式评估，从而导致临床医生信任度低和临床采用准备不足的问题。

Result: 在领域偏移下，CARDEA在优势分类任务上的准确率达到0.91（95% CI, 0.86-0.95），与专用分类器相当；在复杂性评估上与两位介入心脏病专家水平相当（准确率0.90，CI 0.82-0.97）。RLVR将零样本报告生成的血管严重程度宏F1分数从基础模型的0.513提升至0.686，显著高于基线。

Insight: 创新点在于通过RLVR训练范式，在可验证的封闭式任务上涌现出开放式报告生成能力，这是监督模仿学习所不具备的。模型的核心是提供端到端CAG分析流程，并暴露其结论背后可审计的空间证据（如边界框推理轨迹），增强了决策的可解释性和可信度。

Abstract: Invasive coronary angiography (CAG) is the gold standard for diagnosing coronary artery disease, but interpretation varies substantially among observers. Existing AI systems can improve consistency but lack auditable decision processes and are limited in comprehensive open-ended assessment, undermining clinician trust and clinical adoption readiness. We developed CARDEA, a unified large vision-language model that serves as the inference core of a CAG pipeline. It was trained solely on public datasets and closed-ended tasks in three stages: visual feature alignment, a self-distilled Chain-of-Box (CoB) cold start, and reinforcement learning with verifiable rewards (RLVR) with a CoB reward encouraging bounding-box use in the reasoning trace. We assessed its two study-level diagnoses, dominance classification and complexity assessment, against a dedicated classifier and two interventional cardiologists. Report generation was excluded from training and evaluated zero-shot across stages on an external cohort using vessel-severity macro-$F_1$. CARDEA trailed the classifier on in-distribution dominance but drew level under domain shift (accuracy, 0.91 [95% confidence interval (CI), 0.86 to 0.95]) and was comparable to the cardiologists on complexity assessment (accuracy, 0.90 [CI, 0.82 to 0.97]). Only RLVR improved zero-shot report generation, raising its vessel-severity macro-$F_1$ (0.686 [CI, 0.664 to 0.707]) above the untuned base model (0.513) and over twice the always-normal floor (0.312). CARDEA runs an end-to-end CAG pipeline from raw multi-view videos through keyframe selection to study-level diagnosis while exposing auditable spatial evidence behind its conclusions. RLVR on verifiable closed-ended tasks surfaced open-ended reporting ability that supervised imitation did not. Clinical use requires prospective validation against expert cardiologists.

[139] PRG-Fusion: Orchestrating Generative Priors with Reconstruction Evidence for Driving View Synthesis cs.CVPDF

Sipeng He, Jialei Chen, Zhen Fang, Dongchun Ren, Feng Zhao

TL;DR: PRG-Fusion是一个用于驾驶场景视图合成的框架，旨在结合基于重建的方法的几何一致性和生成模型的真实感。它通过从重建场景中提取区域退化证据，将其转化为‘保持、修复、生成’标签，作为区域感知时空合成的统一路由策略，分别协调3D高斯泼溅外观保持、激光雷达引导结构校正和视频先验驱动的内容补全。

Details

Motivation: 解决驾驶视频合成中，基于重建的方法在视角偏离训练轨迹时易产生伪影和内容缺失，而生成模型在任意轨迹上合成真实视图时难以保持跨帧的时间和几何一致性的问题。

Result: 在Waymo数据集上的大量实验表明，PRG-Fusion在新轨迹视频合成中实现了最先进的整体性能，具有卓越的视觉质量和几何保真度，同时在大轨迹偏移下保持了有竞争力的视图一致性。

Insight: 创新点在于提出了一种利用重建证据来协调生成先验的区域感知合成框架，通过PRG标签将合成任务分解为不同区域的处理策略，并采用两阶段训练范式（从稀疏激光雷达投影学习几何控制，再从密集3DGS渲染学习外观控制），有效结合了两种方法的优势。

Abstract: Synthesizing photorealistic driving videos along specified trajectories is essential for scalable closed-loop simulation. Reconstruction-based methods leverage neural rendering to synthesize geometrically consistent views, but often exhibit diverse artifacts and missing content when the viewpoint deviates from the training trajectory. In contrast, generative models can synthesize realistic views along arbitrary trajectories from vehicle sensor data, yet often struggle to maintain temporal and geometric consistency across frames. To combine the strengths of both, we propose PRG-Fusion, a framework for driving view synthesis that uses reconstruction evidence to orchestrate generative priors across regions. Specifically, we extract region-wise degradation evidence from reconstructed driving scenes and convert it into Preserve, Repair, and Generate (PRG) labels. At inference, these labels serve as a unified routing policy for region-aware spatiotemporal synthesis, orchestrating 3DGS appearance preservation, LiDAR-guided structural correction, and video-prior-driven content completion across Preserve, Repair, and Generate regions, respectively. We then follow a two-stage training paradigm, first establish geometric control from sparse LiDAR projections and subsequently learning appearance control from dense 3DGS renderings. Extensive experiments on Waymo demonstrate that PRG-Fusion achieves state-of-the-art overall performance in novel trajectory video synthesis, with superior visual quality and geometric fidelity while maintaining competitive view consistency under large trajectory shifts.

[140] Joint-Conditioned Stereo Surface Reasoning for Interaction Field Estimation cs.CV | cs.ROPDF

Yanlin Jin, Yifan Yang, Bowen Yang, Kai Zhu

TL;DR: 本文提出了一种名为Joint-Conditioned Stereo Surface Reasoning (JSSR)的方法，用于估计手-物体交互场。该方法通过时间立体网络联合预测3D关节点、直接交互场以及每视角端点证据，并利用校准候选搜索评估端点假设，结合关节特定图像兼容性和跨视角对应性。系统在SHOW3D交互场挑战榜上排名第三。

Details

Motivation: 预测手-物体交互场需要从图像中定位每个手部关节对应的最近物体表面点，这些区域通常较小且部分被遮挡。本文将此任务视为关节条件化的表面端点估计，旨在利用共享的局部表面证据来提升准确性。

Result: 基于JSSR方法构建的系统在SHOW3D交互场挑战榜上排名第三，表明其在交互场估计任务中具有竞争力。

Insight: 创新点包括将交互场估计建模为关节条件化的表面端点估计，引入时间立体网络进行联合预测，以及设计校准候选搜索机制结合图像兼容性和跨视角对应性。此外，手部共享的候选支持和学习残差门控机制有助于在观测模糊时控制几何校正，提升鲁棒性。

Abstract: Predicting hand–object interaction fields requires locating the nearest object-surface point for each hand joint, often from small and partially occluded image regions. We view this task as joint-conditioned surface-endpoint estimation: each joint has its own nearest endpoint, while endpoints from the same hand can draw on shared local surface evidence. This structure motivates Joint-Conditioned Stereo Surface Reasoning (JSSR). A temporal-stereo network jointly predicts 3D joints, a direct interaction field, and per-view endpoint evidence. Calibrated candidate search evaluates endpoint hypotheses using joint-specific image compatibility and cross-view correspondence. A hand-shared candidate support lets joints draw on common surface evidence, and a learned residual gate controls the geometric correction when observations are ambiguous. Our system built on this method ranked third on the SHOW3D Interaction Field Challenge leaderboard.

[141] BEFORE THE FLIP: Measuring Hidden Score Shifts In Quantized Vision Language Models Before The Answer Changes for Visual Question Answering cs.CVPDF

Sourajit Saha, Shubhashis Roy Dipta, Shaswati Saha, Nobin Sarwar, Yuxuan Jiang

TL;DR: 该论文提出了BEFORE THE FLIP方法，用于量化视觉语言模型（VLM）压缩过程中，在答案尚未改变时，测量其内部得分（如log概率）的隐藏变化。研究发现，在视觉问答任务中，4位量化比8位量化会导致答案得分差距更显著地向替换图像标记后的输出偏移，尽管实际答案改变的比例很小。同时，研究还表明，为每个问题单独调整权重组的精度并未带来超越随机对照组的可靠收益。

Details

Motivation: 量化虽然能降低视觉语言模型的存储和运行成本，但即使压缩后模型的答案保持不变，其内部得分也可能发生隐藏变化，这会影响模型的鲁棒性和可靠性。论文旨在量化并理解这些在答案“翻转”之前发生的隐藏得分偏移。

Result: 在LLaVA模型的8,277个视觉问答问题中，4位量化比8位量化导致“是/否”得分差距更显著地向替换图像标记后的输出偏移（Qwen模型也呈现相同模式但差异较小），然而在9,000个问题中仅有265个答案在4位量化下发生改变。在另一项针对1,024个校准问题的研究中，为每个问题单独选择权重组并未在任何测试的存储预算下超越随机对照组。

Insight: 论文的创新点在于提出了一个衡量量化模型中隐藏得分偏移的框架（BEFORE THE FLIP），揭示了即使答案不变，量化也可能显著改变模型内部的置信度分布。客观来看，该方法为评估量化对模型内部表示的影响提供了新视角，并挑战了为不同输入动态调整量化精度的潜在收益假设。

Abstract: Quantization makes vision language models (VLMs) cheaper to store and run by using fewer bits to represent their weights. While unchanged answers on visual question answering (VQA) after compression are an expected behavior, they can still hide changes in the underlying scores (log probabilities). For example, a model may still answer yes after compression, even as the score gap between yes and no shrinks. We introduce BEFORE THE FLIP to measure these hidden changes. Our method compares the score change caused by compression with the change caused by replacing the image’s internal representations, or image tokens, with one fixed average token. We then increase the precision of one weight group at a time to identify where extra bits help, and test whether choosing different groups for each question offers benefits beyond shuffled controls. Among 8,277 LLaVA questions where image token replacement measurably affects the scores, 4-bit compression shifts the yes or no score gap farther toward the replacement output than 8-bit compression. Qwen shows the same pattern, but with a smaller difference. Yet only 265 of 9,000 LLaVA answers change at 4 bits. In a separate study of 1,024 calibration questions, choosing weight groups separately for each question does not outperform both shuffled controls at any tested storage budget. These findings show that compression can alter the scores behind unchanged answers, but do not establish a reliable benefit from adjusting precision for each question.

[142] Re-calibrated Contrastive Loss for Transformation-Aware Prompt Conditioning in Vision-Language Models cs.CV | cs.AIPDF

Seungmin Oh, Seunghun Kang, Jongbin Ryu

TL;DR: 本文提出了一种针对视觉-语言模型的转换感知提示条件化方法和重新校准的对比损失，以提升迁移学习效果而不损害泛化性能。该方法通过固定文本描述符识别图像变换，在变换层面实现图像与文本的对齐，并改进损失函数以处理多正样本场景。

Details

Motivation: 现有方法在迁移学习中常忽略数据特性，简单复用预训练策略，将同类样本视为独立实例且独立处理图像与文本提示，增加了模型学习难度。

Result: 在分布偏移、迁移学习和少样本设置下的实验表明，该方法相比现有方法取得了持续改进，代码已开源。

Insight: 创新点在于引入变换感知的提示条件化，在变换层面对齐多模态表示，同时通过重新校准的对比损失缓解多正样本下的梯度稀释问题，有助于学习领域特定特征。

Abstract: Ensuring effective transfer learning for vision-language models without compromising their generalization performance is crucial. However, many existing methods overlook data characteristics and simply reuse the training strategies adopted during pre-training. Specifically, they treat same-class samples as distinct instances and transform images independently of their paired text prompts, which makes model learning more difficult. We address these limitations through transformation-aware prompt conditioning and a re-calibrated contrastive loss. Fixed text descriptors identify the transformations applied to paired images, providing transformation-level consistency without altering class semantics. This design aligns the image and text branches at the transformation level, enabling richer representations while preserving the models’ ability to generalize. In addition, our loss function mitigates positive-gradient dilution in soft-target cross-entropy when each anchor has multiple valid positives. During transfer, our approach treats same-class samples as positives rather than distinct instances, enabling the model to learn domain-specific features more effectively. Experiments across distribution shift, transfer learning, and few-shot settings demonstrate consistent improvements over existing approaches. Source code for our method is available at https://github.com/SoongE/ReCalCon.

[143] AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding cs.CVPDF

Yuzhou Long, Haodong Zhang, Yunpeng Yang, Peng Wu, Guansong Pang

TL;DR: 本文提出了AnomalyCraft-700K，一个用于细粒度视频异常理解（VAU）的大规模、组件可控的合成异常数据集。该数据集包含超过4万个视频和70万个任务级文本标注，通过一个渐进的三阶段流程生成语义可控、时间结构化的异常事件，并构建了每个类别的困难正常样本来增强模型区分能力。此外，数据集利用组件作为验证单元，修正了生成过程中的视频-文本不一致性，为从异常检测到细粒度异常推理的六项任务提供了可靠的跨模态对齐标注。

Details

Motivation: 视频异常理解领域的进展长期受限于真实异常视频难以收集且内容不可控的固有缺陷。现有的合成异常方法虽部分缓解了数据稀缺问题，但其生成过程主要在类别或提示级别进行控制，缺乏组件级的视频-文本一致性验证，并且未能提供足够多的、靠近正常-异常边界的困难正常样本。

Result: 在传统和基于多模态大语言模型（MLLM）的评估协议下，对广泛使用的方法进行评估表明，AnomalyCraft-700K作为监督信号来源是有效的，能够支持从异常检测到细粒度异常理解的各项任务。

Insight: 论文的核心创新在于提出了一个组件级可控且可验证的合成异常生成框架。其借鉴之处包括：1）从细粒度语义组件出发，通过渐进式三阶段流程（语义控制、时间结构化）生成高质量合成数据；2）主动构建“困难正常样本”以迫使模型学习基于异常语义而非表面视觉线索进行判别；3）将组件作为验证单元，对生成过程中的跨模态不一致性进行修正，确保了标注的可靠性，这为构建高质量、可解释的合成数据集提供了新思路。

Abstract: Progress in video anomaly understanding (VAU) has long been limited by inherent deficiencies of real-world anomaly videos, which are hard to collect and offer little control over their content. Synthetic anomaly approaches partially alleviate data scarcity, yet their generation remains largely controlled at the category or prompt level. They also lack component-level verification of video-text consistency and provide insufficient hard normal samples near the normal-anomaly boundary. To address this, we present AnomalyCraft-700K, a component-controllable synthetic anomaly dataset for fine-grained VAU, containing over 40K videos and over 700K task-level textual annotations. From fine-grained semantic components and a progressive three-stage pipeline, we craft anomaly events that are richly detailed, semantically controlled, and temporally structured, and additionally construct per-category hard normal samples to prompt the model to discriminate based on anomaly semantics rather than surface visual cues. Moreover, using the components as verification units, AnomalyCraft-700K further performs component-wise correction of video-text discrepancies introduced during generation, providing reliable annotations with verified cross-modal alignment for six tasks that progress from anomaly detection, through anomaly retrieval and captioning, to fine-grained anomaly reasoning. Evaluations of widely used methods under both traditional and MLLM-based protocols demonstrate that AnomalyCraft-700K serves as an effective source of supervision, from anomaly detection to fine-grained anomaly understanding.

[144] AV-SafetyBench: A Safety Benchmark for Text-to-Audio-Video Generation cs.CV | cs.AIPDF

Suah Choi, Tae-Young Lee, Gyeong-Moon Park

TL;DR: 本文介绍了AV-SafetyBench，这是首个专门为文本到音视频（T2AV）生成模型设计的安全基准。该基准包含一个四轴13类别的分类法和5200个手动审核的提示，用于评估模型在视觉、语音和非语音音频方面的安全性。评估协议通过全音视频、仅视频和仅音频三种视图分析输出，并将不安全内容归因于四种风险来源之一。对五个开源T2AV模型的评估显示，全音视频不安全率在25.1%到49.4%之间，其中仅音频和音视频联合风险占相当比例，突显了跨模态安全评估的重要性。

Details

Motivation: 随着T2AV模型能够从单一文本提示联合生成视频、语音、音效和环境音，现有安全基准主要孤立关注生成视频或音频，无法捕捉音频轨道或音视频联合解释可能带来的新安全风险，因此需要专门基准来填补这一空白。

Result: 在五个开源T2AV模型上评估，全音视频不安全率范围为25.1%至49.4%；风险来源分析显示，对于其中四个模型，仅音频和音视频联合风险（即仅视频评估会遗漏的不安全输出）占可分配风险来源的全音视频不安全输出的41.6%至48.3%，在跨模态危害涌现类别中，音视频联合风险占比高达87.5%。

Insight: 创新点在于提出了首个针对T2AV生成的安全基准，通过多视图评估协议和风险来源分类（视频仅、音频仅、音视频两者、音视频联合），系统量化了跨模态交互带来的安全风险，强调了孤立评估的局限性，为未来模型安全评估提供了重要工具和洞见。

Abstract: Recent text-to-audio-video (T2AV) models jointly generate video, speech, sound effects, and ambience from a single text prompt. This capability poses new challenges for safety evaluation, as unsafe content may be conveyed through the audio track or arise only when the visual and audio tracks are interpreted jointly. Existing safety benchmarks largely focus on either generated video or generated audio in isolation and are therefore not designed to capture these risks. To close this gap, we introduce AV-SafetyBench, the first safety benchmark developed specifically for T2AV generation. AV-SafetyBench comprises a four-axis, 13-category taxonomy and 5,200 manually reviewed prompts that specify visual scenes, speech, and non-speech audio. Our evaluation protocol assesses each output under three views: Full-AV, Video-Only, and Audio-Only. It then uses the Video-Only and Audio-Only judgments to assign Full-AV unsafe outputs to one of four risk sources: Video-Only, Audio-Only, AV-Both, or AV-Joint. We evaluate five open-source T2AV models and validate the automated Full-AV judgments against human annotations. Across the five models, Full-AV Unsafe Rates range from 25.1% to 49.4%. Beyond these aggregate rates, risk-source analysis reveals that, for four of the five models, Audio-Only and AV-Joint cases-unsafe outputs missed by video-only evaluation-account for 41.6-48.3% of Full-AV unsafe outputs for which a risk source could be assigned. In the Cross-Modal Harm Emergence category, AV-Joint accounts for 87.5% of unsafe outputs withan assigned risk source. Together, these findings demonstrate the value of AV-SafetyBench for evaluating T2AV safety across the visual and audio modalities and their interaction.

[145] GIFT: Goal-Injected Fine-Tuning for Efficient Manipulation Policy Adaptation cs.CV | cs.ROPDF

Xiaoyuan Fang, Shuo Feng, Yuxuan Wang, Enhua Cheng, Peng Zhou

TL;DR: 本文提出了GIFT（Goal-Injected Fine-Tuning）框架，一种轻量高效的微调方法，用于将生成的目标图像作为高层视觉指导，无缝集成到多个预训练的视觉-语言-动作（VLA）模型中，以提升其在机器人操作任务中的鲁棒性和性能。

Details

Motivation: 现有基础模型由于计算成本高，未能系统性地整合目标图像条件，而仅依赖初始观察和语言指令限制了VLA模型的鲁棒性。本文旨在通过高效的微调方法，将生成的目标图像信息融入预训练策略，以解决这一问题。

Result: 实验表明，在SIMPLER基准的两个设置上，仅经过一个epoch的微调，GIFT分别比基线模型性能提升6.0%和13.4%；在LIBERO基准上提升4.7%，证明了其高效性和有效性。

Insight: 创新点包括：1）提出零初始化卷积层，渐进式注入目标图像特征，避免破坏预训练策略的稳定性；2）引入改进的图像编辑方法，从初始观察和任务指令生成语义和视觉一致的目标图像；3）轻量级微调框架，实现了高效的目标理解与策略适应。

Abstract: Compared with relying solely on initial observations and language instructions, predicting goal images with generative models as high-level visual guidance can significantly enhance the robustness of Vision-Language-Action (VLA) models. However, most existing foundation models have not systematically incorporated goal image conditioning due to the high computational training cost. To this end, we propose Goal-Injected Fine-Tuning (GIFT), a lightweight and efficient fine-tuning framework that seamlessly integrates generated goal images into multiple representative pretrained VLA models. Our approach introduces goal image features into observations via a zero-initialized convolution which progressively grows parameters from zero and prevents harmful noise from disrupting the pretrained policy during fine-tuning. As training proceeds, goal information is gradually incorporated, enabling efficient goal understanding without disrupting model stability. We further introduce a refined image editing method to generate semantically and visually consistent goal images from initial observations and task instructions. Experiments show that goal-aware VLA models achieve substantial performance gains across tasks: with only a single epoch of fine-tuning, GIFT outperforms the base model by 6.0% and 13.4% on two SIMPLER settings, and by 4.7% on LIBERO, demonstrating both efficiency and effectiveness.

[146] FreqDoor: A Hidden Trojan in the Frequency Domain for Backdoor Attacks on Vision-Language Models cs.CVPDF

Yasir Arafat Prodhan, Sadad Hasan, Mohammed Imamul Hassan Bhuiyan

TL;DR: 该论文提出了一种名为FreqDoor的新型后门攻击方法，针对视觉语言模型（VLMs）。该方法通过在频域植入触发器，将触发源图像的振幅谱成分选择性地与干净图像的相位谱混合，生成空间分布且视觉不可察觉的触发器，而无需修改文本输入。

Details

Motivation: 现有的VLM后门攻击触发器多为空间、文本或双模态的，可能产生局部化或可识别的触发模式。本文探索了不同的攻击面，旨在设计一种更隐蔽、分布式的训练时后门攻击。

Result: 在BLIP-2、InstructBLIP和LLaVA模型上，针对图像描述（Flickr8k）和视觉问答（VQAv2）任务进行了评估。在Flickr8k上，攻击成功率分别达到99.6%、99.8%和98.4%；在VQAv2上，攻击成功率分别为99.6%、92.4%和79.6%，同时保持了生成文本的语义质量。

Insight: 创新点在于首次将后门触发器植入频域，利用振幅谱和相位谱的分离特性，实现了视觉上难以察觉且空间分布的攻击模式。这为理解多模态模型的安全漏洞提供了新的视角，并展示了频域操作在隐蔽攻击中的潜力。

Abstract: Vision-language models (VLMs) have recently shown excellent progress in open-ended image-to-text generation. However, their multimodal nature makes them persistently vulnerable to backdoor attacks. Existing backdoor triggers for VLMs are either spatial, textual, or bimodal, which may yield localized or recognizable trigger patterns. In this work, we explore a different attack surface and propose \ textsc {FreqDoor}, a training-time backdoor attack that implants triggers in the frequency domain. \ textsc {FreqDoor} mixes amplitude-spectrum components from a trigger-source image selectively while preserving the phase of a clean image to generate a spatially distributed and visually imperceptible trigger without modifying the textual input. We evaluate the attack on BLIP-2, InstructBLIP, and LLaVA for image captioning and visual question answering. On Flickr8k, \ textsc {FreqDoor} achieves attack success rates of $99.6%$, $99.8%$, and $98.4%$ on the three models, respectively, while preserving the semantic quality of the generated captions. On VQAv2, the corresponding attack success rates are $99.6%$, $92.4%$, and $79.6%$.

[147] LoGAN: Multilingual Font Localization with Generative Agents cs.CV | cs.AIPDF

Zhuoning Yuan, Ta-Ying Cheng, Benjamin Klein

TL;DR: 本文提出了LoGAN，一种基于视觉语言模型（VLM）的智能体框架，用于少样本多语言字体本地化。该方法通过分解任务为字形扩散、风格微调、间距调整和纹理扩展等多个组件，并由VLM智能体协调，能够基于少量源语言字形或字母生成目标语言的完整字符集，支持包括中日韩在内的多种语言。

Details

Motivation: 现有方法大多专注于单字形生成，在处理多语言字体渲染方面能力有限。本文旨在解决将字体（包括Logo）本地化到新语言时，需要在字形、颜色/纹理、间距/字距等方面进行精确设计适配的复杂问题。

Result: 在涵盖超过27种语言的字体和真实世界Logo数据集上进行了评估，并与专门的字体生成模型以及具有强大文本渲染能力的SOTA图像编辑模型（如FLUX、Nano-Banana）进行了比较。定量和定性评估均表明，该方法在保持更好的风格、纹理和字距一致性的同时，实现了更高的字形保真度。

Insight: 主要创新点在于提出了一个由VLM智能体协调的多组件分解式框架，将复杂的多语言字体本地化任务系统化。其可借鉴之处在于利用智能体协调多个专门化模块（如扩散模型、风格微调）来处理字体生成中的不同子问题（字形、风格、间距、纹理），以实现少样本下的高质量多语言覆盖。

Abstract: Localizing a font into new languages is a highly intricate task requiring precise design adaptation of glyphs, color/texture, and spacing/kerning, from source to target languages. Most existing methods focus on single glyph generation with limited capability in handling multilingual font rendering. In this work, we propose LoGAN, a VLM-based agentic framework for few-shot multilingual font localization, which takes in a small number of individual glyphs from a font or letters from a logo and uses them to generate complete character sets in other languages. LoGAN breaks down this task into multiple components: a glyph-level diffusion model, a style finetuning module, a spacing and kerning transfer algorithm, and a texture expansion model, with a VLM agent coordinator. LoGAN achieves broad language coverage for font localization with various styles, including Chinese/Korean/Japanese (CJK). We evaluate our approach on both font and real-world logo datasets spanning more than 27 languages and compare it against both specialized font generation and state-of-the-art image editing models with strong text rendering capabilities (e.g., FLUX, Nano-Banana). Our approach yields higher glyph fidelity while maintaining better style, texture, and kerning consistency according to both quantitative and qualitative evaluations.

Su Li, Yigong Zhang, Lei Xiong, Chune Li

TL;DR: 该论文针对社交媒体多模态情感分析中视觉信息利用不足的问题，提出了NAPS视觉预处理流水线和DS-TANet/DS-TAFNet双流时序建模网络。NAPS通过人脸跟踪、身份嵌入和标准化唇部运动分析来减少原始视频噪声；DS-TANet结合静态图像流和光流运动流进行时序建模；DS-TAFNet进一步融合视觉与文本特征。在CH-SIMS v2.0S数据集上，该方法显著提升了视觉模态的性能和最终融合效果。

Details

Motivation: 解决多模态情感分析中因原始视频噪声大和时序建模不足而导致的文本主导问题，旨在更有效地利用视觉信息。

Result: 在CH-SIMS v2.0S数据集上，使用NAPS预处理的静态视觉基线Macro F1达到80.98%，与文本基线（80.55%）相当；DS-TANet将视觉Macro F1提升至82.58%；最终的DS-TAFNet融合模型取得了87.49%的准确率和87.48%的Macro F1。

Insight: 创新点在于系统性的七阶段视觉预处理流水线（NAPS）和结合静态与运动流的双流时序建模架构。核心洞察表明，在数据有限条件下，提升视觉输入质量和时序表征比增加融合复杂度更有效。

Abstract: Multimodal sentiment analysis often remains text-dominant due to raw-video noise and insufficient temporal modeling. Using CH-SIMS v2.0S, this study proposes three improvements: the NAPS pipeline—a seven-stage system integrating face tracking,identity embedding, and normalized lip-motion analysis to reduce visual noise;DS-TANet, combining an EfficientNetB2 static stream, RAFT optical-flow motion stream, motion-guided attention, and Bi-GRU temporal modeling; and DS-TAFNet, fusing visual and MacBERT-Base textual representations via concatenation fusion. With NAPS, the static visual baseline achieves 80.98% Macro F1, comparable to the text baseline of 80.55%; DS-TANet improves visual Macro F1 to 82.58%;and DS-TAFNet achieves 87.49% accuracy and 87.48% Macro F1. These results demonstrate that improving visual input quality and temporal representation is more effective than increasing fusion complexity under limited-data conditions.

[149] CNsEMD: An Expert-Annotated Multi-Field-Strength MRI Dataset and a Hyperspherical Manifold Network for Multimodal Cranial Nerve Parcellation cs.CVPDF

Lei Xie, Junxiong Huang, Guoqiang Xie, Jiawei Zhang, Jiahao Huang

TL;DR: 本文提出了一个专家标注的多场强MRI数据集CNsEMD，用于颅神经分割，并设计了一个投影超球面流形网络PHM-Net。该网络通过在共享的超球面嵌入空间中学习角度关系来实现跨模态表示，从而解决颅神经分割因结构细小、对比度低和轨迹复杂而带来的挑战。

Details

Motivation: 动机在于颅神经分割对神经解剖分析和神经外科手术规划至关重要，但现有方法面临两大挑战：一是缺乏公开、专家标注的数据集；二是颅神经本身结构细小、图像对比度低、形态复杂，导致准确分割极其困难。

Result: 在提出的CNsEMD数据集上进行了广泛实验，结果表明PHM-Net的性能优于现有的最先进方法。CNsEMD为多模态颅神经成像建立了一个可复现的基准。

Insight: 创新点包括：1）引入了首个专家标注的多场强MRI颅神经分割数据集CNsEMD；2）提出了PHM-Net，其核心是超球面跨模态交互模块，在单位超球面上进行特征交换，而非传统的欧几里得空间融合；3）设计了保持幅值的投影超球面方向表示和超球面原型分割头，利用角度相似性进行体素级分类，提供了一种几何一致的解决方案。

Abstract: Cranial nerves (CNs) play essential roles in sensory, motor, and autonomic functions. Accurate CN parcellation from multimodal magnetic resonance imaging (MRI) is crucial for neuroanatomical analysis and neurosurgical planning. However, accurate CN parcellation remains extremely challenging because CNs are very small, exhibit low image contrast, and have slender tubular morphologies and complex anatomical trajectories. Moreover, the lack of publicly available, expert-annotated datasets has impeded the development and fair benchmarking of learning-based CN analysis methods. In this work, we introduce CNsEMD, an expert-annotated multimodal dataset for CN parcellation. It comprises data from 202 subjects acquired on 3T, 5T, and 7T MRI scanners. We further propose the projective hyperspherical manifold network (PHM-Net), which learns cross-modal representations by capturing angular relationships in a shared hyperspherical embedding space. Rather than performing multimodal fusion in Euclidean space, the proposed Hyperspherical cross-modal interaction (HCI) module enables bidirectional feature exchange between T1-weighted (T1w) and direction-encoded color (DEC) representations on a unit hypersphere. The Magnitude-preserving projective hyperspherical orientation representation (PHOR) captures the axial nature of DEC orientations while preserving diffusion magnitude. The hyperspherical prototype segmentation head (HPSH) further extends angular similarity to voxel-wise classification using normalized voxel embeddings and learnable class prototypes. Extensive experimental results on the CNsEMD dataset demonstrate the effectiveness of our PHM-Net against state-of-the-art methods. CNsEMD establishes a reproducible benchmark for multimodal CN imaging, while PHM-Net provides a geometry-consistent solution for CN parcellation across diverse MRI acquisitions.

[150] SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem cs.CV | cs.AIPDF

Soohyun Ryu, Sohee Kim, Eunho Yang

TL;DR: 本文提出了一种通过合成积木堆叠问题来增强大型视觉语言模型空间智能的新方法。作者构建了包含15000个问题的SpatialBlock-15k数据集，涵盖3D到2D投影、视角变换和结构组合等任务，并引入颜色调制作为视觉线索。实验表明，使用该数据集训练的模型在空间推理任务上显著优于基线方法，并能泛化到真实世界场景。

Details

Motivation: 现有LVLMs在从2D图像重建和理解3D场景结构（即空间智能）方面能力有限，而现有方法依赖需要密集几何标注的真实场景数据集，这些标注成本高、耗时长且容易产生噪声。

Result: 在空间推理任务上，使用SpatialBlock-15k数据集训练的LVLMs显著优于基线方法，并能有效泛化到真实世界的空间任务，尽管数据集是合成且紧凑的。

Insight: 创新性地借鉴人类认知发展过程，通过结构化积木操作任务来学习基础空间技能；提出使用合成数据集替代需要密集标注的真实数据，通过可控颜色调制作为视觉线索来促进基于锚点的推理；证明了合成数据训练对提升模型空间智能的有效性和泛化能力。

Abstract: Large Vision-Language Models (LVLMs) have achieved strong performance on diverse visual tasks, yet their ability to reconstruct and reason about the 3D structure of the scene depicted in 2D images – referred to as spatial intelligence – remains limited. Existing approaches attempt to address this gap by using real-scene spatial question answering datasets that require dense geometric annotations. However, constructing such labels is costly, time-consuming, and often noisy due to reliance on external perception modules. In this work, we propose a novel paradigm inspired by human cognitive development: learning foundational spatial skills through structured block-manipulation tasks. We introduce SpatialBlock-15k, a synthetic dataset of 15,000 block-stacking problems covering 3D-to-2D projection, viewpoint transformation, and structural combination. The dataset further incorporates controlled color modulation as visual cues to encourage anchor-based reasoning in visually complex conditions. Experiments demonstrate that LVLMs trained on our dataset through either direct answering or reasoning-based prediction significantly outperform baselines and generalize to real-world spatial tasks, despite the dataset’s synthetic and compact nature. Code and data are available at https://github.com/rsoohyun/SpatialBlock.

[151] Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection cs.CV | cs.LGPDF

Jiangning Zhu, Bowen Li, Shenyu Qiao, Yima Gu, Zhao Zhang

TL;DR: 本文提出了一种名为DAD的图形设计检测模型，将图形设计检测视为组合解构问题，按组合顺序解码元素，并利用下层元素更好地检测上层元素。关键创新包括模态检测（预测每个元素的完整边界框，包括被上层元素遮挡的区域）以及元素级相对策略优化（EleRPO），后者将GRPO从序列级监督扩展到元素级优化，提供细粒度训练信号。

Details

Motivation: 现有目标检测模型将图形设计中的元素视为无序集合，忽略了其明确的组合顺序，这限制了检测性能。本文旨在解决这一局限，通过利用组合顺序来改进图形设计元素的检测。

Result: 实验表明，DAD在模态检测上超越了所有基线方法，达到人类水平性能，支持有效的图像到图层分解。EleRPO在九个检测基准上一致优于GRPO。

Insight: 创新点包括将图形设计检测形式化为组合解构，引入模态检测以处理遮挡，以及提出EleRPO进行元素级优化。从客观角度看，该方法通过利用组合顺序和细粒度奖励，为图形设计检测提供了新的建模视角和性能提升。

Abstract: Graphic designs, such as posters, advertisements, and infographics, are an important medium for communicating information and shaping understanding. Unlike natural images, they consist of layered elements with explicit compositional order. However, existing object detection models treat these elements as an unordered set, leaving compositional order unexploited. To address this limitation, we present Detect Anything in Graphic Design (DAD), a model that formulates graphic design detection as compositional deconstruction. It decodes elements in compositional order, using lower-layer elements to better detect higher-layer ones. The key feature of DAD is amodal detection, which predicts the full bounding box of each element, including regions occluded by elements placed above it. Building on this formulation, we propose Element Relative Policy Optimization (EleRPO), which extends GRPO from sequence-level supervision to element-level optimization. EleRPO provides fine-grained training signals that capture how each detected element contributes to overall detection quality, and works synergistically with compositional order to improve detection performance. To support training and evaluation, we build a dataset of 10 million graphic designs. Experiments show that DAD outperforms all baselines and achieves human-level performance in amodal detection, supporting effective image-to-layer decomposition. EleRPO consistently improves over GRPO across nine detection benchmarks.

[152] CASCADE: A Spatio-Temporal-Causal Reasoning Representation and Dataset for Driving cs.CVPDF

Jenny Schmalfuss, Despoina Paschalidou, Simon Gerstenecker, German Ros, Jose M. Alvarez

TL;DR: 本文提出了CASCADE（驾驶环境因果时空分析），这是一个用于自动驾驶场景推理的结构化表示和人工标注数据集。该表示方法以逐帧方式记录与自车交互的智能体的动作、位置及其对其他智能体动作和状态的依赖关系，从而支持机器可验证的推理预测。CASCADE数据集基于PhysicalAI数据集，包含2066个驾驶片段、超过3.4万个标注元素，为评估物理AI模型的推理能力提供了基准。

Details

Motivation: 当前自动驾驶系统在长尾场景中缺乏泛化能力，而推理能力是解决这一问题的关键。然而，现有方法（如基于文本的推理轨迹、时空场景图）要么缺乏时空基础，要么缺少因果链接，且大规模推理标注多由模型生成、难以验证，因此需要一种能明确表达场景依赖关系并支持可验证推理的表示方法。

Result: CASCADE提供了一个完全由人工标注的数据集，包含2066个驾驶片段、8600个带时间戳的自车与智能体动作、3700个因果链接、2900个潜在影响以及6100个对智能体、物体、交通灯和环境的标注。该数据集可作为基准，用于评估物理AI模型的推理能力并验证自动生成推理标签的质量。

Insight: 主要创新点在于提出了一个将时空基础与因果链接相结合的驾驶场景结构化表示，使推理预测能够以逐元素方式进行机器验证，无需依赖（多模态）大语言模型作为评判者。这为自动驾驶的因果推理研究提供了一个可验证的、人工标注的基准数据集。

Abstract: Reasoning is a promising route to the generalization that autonomous driving requires in the long tail, as it can infer how the elements of a scene depend on one another and traverse those dependencies to conclusions beyond what is observed. Yet it is hard to tell whether a model’s conclusions follow the scene’s dependencies, because no driving representation makes them explicit enough to test against. Text-based reasoning traces lack spatio-temporal grounding, spatio-temporal scene graphs lack causal links, and reasoning annotations at scale are increasingly model-generated and hard to verify. To this end, we introduce CASCADE (Causal Spatio-Temporal Analysis of Driving Environments), which encompasses two components: (1) a structured scene representation for reasoning in driving scenes and (2) a human-annotated dataset built on it. For every actor that interacts with the ego vehicle, the CASCADE representation records frame-by-frame, for as long as the actor is visible, what action is taken, where it occurs, and how it depends on the actions and states of others. The resulting structure makes reasoning predictions machine-verifiable: they can be scored against it element by element, without relying on (M)LLM judges. The CASCADE dataset provides comprehensive human annotations for 2,066 driving clips of the PhysicalAI dataset, with over 34K elements that establish the spatio-temporal and causal context of each scene, including 8.6K time-stamped ego and agent actions, 3.7K causal links and 2.9K potential influences, and 6.1K annotations for agents, objects, traffic lights, and environments. Being entirely human-annotated, CASCADE provides the reference for this comparison: benchmarking the reasoning abilities of Physical AI models, and verifying the quality of automatically generated reasoning labels. The CASCADE dataset is available at https://huggingface.co/datasets/nvidia/cascade.

[153] SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spotting cs.CVPDF

Xudong Xie, Yuzhe Li, Jing Shi, Zhifei Zhang, Curtis Wigington

TL;DR: 本文提出SupGRPO方法，通过结合监督微调（SFT）和基于组相对策略优化的强化学习微调（GRPO）来增强文本检测与识别模型。该方法设计了专门的奖励函数和基于匹配的在线SFT，以解决GRPO的奖励稀疏问题和SFT的实例顺序依赖问题，并在艺术文本数据集ATS上验证了其优越性能。

Details

Motivation: 现有专用文本检测器在自然场景中定位准确，但对复杂或艺术文本识别能力弱；而多模态大语言模型（MLLMs）识别能力强但定位能力弱。本文旨在结合两者优势，赋予文本检测器强大且通用的识别能力，同时最大化其定位能力。

Result: 实验表明，SupGRPO在文本识别和检测任务上均有提升，在艺术文本数据集ATS上取得了优越性能。

Insight: 创新点在于联合训练策略SupGRPO，结合SFT和GRPO互补优化，并设计了针对坐标令牌的匹配式在线SFT，有效缓解了奖励稀疏和顺序依赖问题，为多模态任务微调提供了新思路。

Abstract: Text spotting requires both accurate text recognition and precise spatial localization. Current specialised spotters excel at predicting tight bounding boxes in natural scenes, but falter on complex or artistic text, whereas multimodal large language models (MLLMs) possess strong recognition capabilities yet remain weak at localisation. To equip the text spotter with general and powerful recognition capabilities and to maximize its localization ability, we explore two MLLM-based fine-tuning methods: Supervised Fine-Tuning (SFT) and reinforcement learning fine-tuning based on Group Relative Policy Optimisation (GRPO). An interesting finding is that SFT is less effective than GRPO at enhancing recognition, while GRPO is less effective than SFT at enhancing detection. To compensate for each other’s shortcomings, we introduce a joint training strategy, SupGRPO, which simultaneously optimizes the model using both SFT and GRPO. SupGRPO employs the specially designed reward functions and develops a matching-based online SFT applied solely to coordinate tokens. It both mitigates the reward sparsity problem of GRPO and avoids the instance order dependency problem of SFT. To evaluate particularly challenging cases, we curate ATS, a dataset for artistic text spotting. Experiments demonstrate that SupGRPO improves both text recognition and detection, and attains superior performance. Our code and dataset will be released at https://github.com/Psycho-9/SupGRPO.

[154] Ambient @ EgoProactive 2026 : Proactive Egocentric Assistance with Visually Grounded Supervision cs.CV | cs.AIPDF

Logesh Kumar Umapathi

TL;DR: 本文介绍了在ECCV 2026 Wearable AI Challenge的EgoProactive赛道中获得第一（大模型组）和第二（≤2B模型组）排名的提交方案。该任务要求可穿戴助手根据八秒的第一人称视频片段决定是否干预。方法核心包括：将干预时机重新定义为单令牌分类任务，显著提升了性能；并利用视觉基础的工具调用视频代理生成额外监督数据，证明了视觉基础比标注数据量更重要。

Details

Motivation: 解决可穿戴助手在何时主动干预（说话或保持沉默）的决策问题，特别是在标注数据有限的情况下，如何有效提升模型性能。

Result: 在ECCV 2026挑战赛的EgoProactive任务中，该方法在大模型组排名第一，在≤2B模型组排名第二。通过单令牌分类重构，宏F1提高了0.249，G-mean提高了0.30。

Insight: 创新点在于将干预时机预测重构为简单的单令牌（是/否）分类任务，而非自由生成，大幅提升了效率与性能；同时，利用视觉基础的工具调用代理生成监督信号，证明了视觉基础对于任务的有效性优于仅依赖大规模文本叙述标注。

Abstract: We present our submission to the EgoProactive track of the ECCV 2026 Wearable AI Challenge, which ranked first in the large-model division and second in the <=2B division. The task requires a wearable assistant to decide after each eight-second segment of egocentric video whether to intervene or remain silent. Our approach has two main components. First, we reformulate intervention timing as single-token classification. Rather than generating either $interrupt$ or $silent$, the model predicts yes or no, and we derive the decision from the renormalised probabilities of these two tokens. This formulation improved macro-F1 by 0.249 and G-mean by 0.30 over free-form generation. Second, because labelled data were limited to the released validation set, we generated additional supervision using a tool-calling video agent that inspects each clip and assigns intervention timestamps. A narration-only alternative was four times larger and ten times cheaper, but transferred worse than supervision from an unrelated real corpus, suggesting that visual grounding is more important than annotation volume for this task.

[155] A Two-Stage Framework for Ego-Centric Key Object Identification via Object State Prediction cs.CVPDF

Shihong Ling, Yue Wan, Xiaowei Jia, Na Du

TL;DR: 本文提出了一种新颖的两阶段框架，用于增强自动驾驶中的关键物体识别。该框架通过整合虚拟自车表示和模块化物体状态预测器，明确考虑自车视角来估计物体行为，并利用时空推理优化关键物体识别，优先考虑物体状态和相对空间信息而非仅依赖视觉关系。

Details

Motivation: 现有方法主要独立检测物体或利用视觉关系，但未明确考虑自车视角来确定物体重要性，因此需要一种能整合自车视角的结构化方法来解决这一不足。

Result: 在真实世界驾驶数据集上的实验结果表明，该方法在复杂交通环境中能有效准确检测关键物体。

Insight: 创新点在于引入虚拟自车表示和模块化物体状态预测器，以自车视角为核心进行物体行为估计，并结合时空推理优先考虑物体状态和空间信息，这为自动驾驶中的物体重要性评估提供了新思路。

Abstract: This paper presents a novel framework designed to enhance key object identification in autonomous driving. Existing methods primarily focus on either detecting objects independently or leveraging visual relationships, but they do not explicitly consider the ego vehicle’s perspective in determining object importance. To address this gap, we propose a structured approach that integrates a virtual ego-vehicle representation and a modular object state predictor, enabling a more accurate estimation of object behaviors relative to the ego-vehicle. Subsequently, our framework employs spatial-temporal reasoning to refine key object identification, prioritizing objects based on their states and relative spatial information rather than relying solely on visual relationships. Experimental results on real-world driving datasets demonstrate the effectiveness of our approach in accurately detecting critical objects in complex traffic environments.

[156] Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models cs.CV | cs.AIPDF

Dongsu Song, DaeYun GO, Jay Hoon Jung

TL;DR: 本文提出了一种名为Adversarial Scenario Attack (ASA)的黑盒攻击框架，用于发现视觉模型对自然语义变换的脆弱性。该框架利用多模态语言模型和文本引导的图像编辑器，通过查询和反馈机制搜索有效的自然语言编辑场景（如背景、天气、材质/颜色变换），从而生成对抗样本。

Details

Motivation: 现有方法在生成自然对抗样本时面临挑战，它们通常依赖代理模型、先验知识或高成本的查询优化，而能暴露模型脆弱性的自然变换模式是未知的。本文旨在开发一种高效的黑盒攻击方法，以发现模型对现实语义变化的脆弱性。

Result: 在多种ImageNet分类器上，ASA相比之前的基于查询的生成攻击方法，实现了显著更高的攻击成功率，同时需要更少的受害者模型查询次数，并保持了有竞争力的感知质量。此外，ASA生成的对抗图像和编辑场景均表现出良好的可迁移性。

Insight: 创新点在于将自然语言编辑场景作为搜索空间，通过多模态模型和贪婪探索器联合优化，高效识别可重用的自然变换脆弱性模式。这揭示了视觉模型对特定语义变换模式存在系统性漏洞，且这些漏洞可在黑盒设置下被有效发现和利用。

Abstract: Natural adversarial examples (NAEs) reveal that vision models can fail under realistic semantic changes beyond norm-bounded perturbations. However, generating NAEs in a black-box setting remains challenging because existing generative attacks often rely on surrogate models, learned attack priors, or costly query-based optimization, whereas the natural transformations that expose model vulnerabilities are unknown a priori. We propose \textbf{Adversarial Scenario Attack (ASA)}, a query-based black-box framework that searches over natural-language editing scenarios using a multimodal language model and a modern text-guided generative editor. ASA jointly explores background, weather, and material/color transformations through winner–loser feedback, and uses a greedy explorer to compose only attack-improving scenarios. Across diverse ImageNet classifiers, ASA achieves substantially higher attack success rates than prior query-based generative attacks while requiring fewer victim-model queries and preserving competitive perceptual quality. Moreover, ASA exhibits both image-level and prompt-level transferability: its adversarial images remain effective across victim-model architectures, while its discovered editing scenarios can be reused across same-class images and, in some cases, across architectures. These findings suggest that vision models possess reusable vulnerabilities to natural transformation patterns, which ASA can efficiently identify in a black-box setting.

[157] Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer cs.CV | cs.AIPDF

Zhiwei Ning, Zhen Zhou, Puhua Jiang, Xintong Han, Gengming Zhang

TL;DR: 本文提出Flow3D-OPD，一个用于基于流匹配扩散Transformer（DiT）的图像到3D生成模型的两阶段后训练框架。该框架通过多教师策略蒸馏，整合了领域专家知识，以解决3D几何生成中强化学习面临的奖励定义困难和梯度干扰问题。

Details

Motivation: 现有基于流匹配扩散Transformer的图像到3D生成模型虽能产生高保真网格，但其后训练策略尚未充分探索。主要瓶颈在于难以定义全面的3D几何质量奖励，以及在联合优化异构目标时产生的梯度干扰。

Result: 该方法在所有几何质量维度上均取得一致提升，并在平均指标上超越了所有教师模型。广泛的实验表明，该框架为3D生成中的强化学习提供了一个有效的范式。

Insight: 核心创新点是将大型语言模型和图像生成中已验证有效的策略蒸馏（OPD）引入3D几何生成，并设计了包含半策略增强、基于代理验证器的直接偏好优化（DPO）以及结合硬任务路由采样和梯度累积的策略蒸馏的两阶段框架，有效缓解了联合优化中的梯度干扰问题。

Abstract: Recent image-to-3D generation models built on flow-matching diffusion Transformers (DiT) can produce high-fidelity meshes, yet their post-training strategy remains largely unexplored. There exist several critical bottlenecks in reinforcement learning: the inherent difficulty of defining comprehensive rewards for 3D geometric quality, and the gradient interference that arises when jointly optimizing heterogeneous objectives. Inspired by the practicability of on-policy distillation (OPD) in large language models and image generation, we propose \textbf{Flow3D-OPD}, a two-stage post-training framework that introduces multi-teacher distillation into 3D geometry generation. In the first stage, we utilize the semi-policy to enhance the foundational capability of the pretrained model and then design an agentic verifier for 3D geometric quality evaluation. Based on the verifier, we could cultivate domain-specialized teacher models via direct preference optimization (DPO). In the second stage, we consolidate heterogeneous expertise into a unified student model through on-policy distillation with hard task-routing sampling and gradient accumulation, which could mitigate the gradient interference in joint optimization. Without relying on elaborate modifications, our straightforward yet effective design achieves consistent improvements across all geometric quality dimensions and surpasses all teacher models in the average metric. Extensive experiments demonstrate that our approach provides an effective paradigm for reinforcement learning in 3D generation.

[158] NutriBench-Kitchen: Benchmarking Embodied AI for Nutrition Management cs.CVPDF

Yulin Wei, Xiangchen Wang, Jianhui Pan, Jinyu Xiao, Zheng Tan

TL;DR: 该论文提出了NutriBench-Kitchen基准测试，用于评估具身AI在动态厨房环境中进行营养管理的能力，包括感知营养相关事件、维护持久食物状态以及基于知识的规划。同时，论文还提出了一个诊断性长视频代理Nutri-Vgent，以展示显式状态表示和结构化记忆的价值。

Details

Motivation: 现有基准测试主要评估静态食物理解或具身烹饪动作，但无法衡量智能体能否在动态厨房中持续更新并利用营养相关状态进行决策。因此，需要一个新的基准来填补这一空白，以推动具身营养管理能力的发展。

Result: 在NutriBench-Kitchen基准上评估了专有和开源的大型视觉语言模型，发现它们与人类性能存在显著差距，特别是在定量成分估计、长期状态跟踪和交互约束下的推理方面。提出的Nutri-Vgent代理通过显式状态表示和结构化记忆，在这些任务上取得了持续改进。

Insight: 论文的创新点在于将营养管理形式化为一个需要持续状态跟踪和知识驱动规划的具身任务，并为此创建了一个包含多样化任务家族的综合性基准。从客观角度看，引入分离的情景记忆、食物状态记忆和食谱记忆的架构设计，为解决长视频理解和复杂决策问题提供了可借鉴的思路。

Abstract: An embodied kitchen assistant must do more than recognize food in isolated frames. It must track ingredient states over time and integrate visual observations with recipe and nutritional knowledge to support constraint-aware decision-making. We formalize this capability as \emph{Embodied Nutrition Management}: perceiving nutrition-relevant events, maintaining a persistent food state, and using it for knowledge-grounded planning. Existing benchmarks evaluate static food understanding or embodied cooking actions, but do not measure whether an agent can continuously update and use nutrition-relevant states in dynamic kitchens. To fill this gap, we introduce \textbf{NutriBench-Kitchen}, a benchmark containing 1,500 manually verified question–answer pairs from 160 cooking videos. It covers five task families: Ingredient Entry, Memory Management, Recipe Query, Long-Term Planning, and Short-Term Planning, spanning food-state construction, maintenance, knowledge retrieval, and decision-making across different planning horizons. Evaluations of proprietary and open-source large vision-language models reveal a substantial gap from human performance, particularly in quantitative ingredient estimation, long-term state tracking, and reasoning under interacting constraints. We further introduce \textbf{Nutri-Vgent}, a diagnostic long-video agent with separate episodic, food-state, and recipe memories. Its consistent improvements demonstrate the value of explicit state representations and structured memory for nutrition management. Together, NutriBench-Kitchen and Nutri-Vgent provide a testbed for studying persistent state tracking and knowledge-grounded reasoning in dynamic kitchens. Code is available at https://github.com/V1ol1n/NutriBench-Kitchen.

[159] Ambient @ EgoLongQA 2026: Distilling Long-Video perception into a Sub-2B Model cs.CVPDF

Logesh Kumar Umapathi

TL;DR: 本文介绍了在ECCV 2026 Wearable-AI挑战赛EgoLongQA赛道中获得<=20亿参数组第一名的系统。该系统是一个单一的20亿参数视觉语言模型，通过蒸馏一个工具使用智能体流程中的感知模块（而非智能体本身）获得，能够单次前向传播回答关于十分钟第一人称视频的多选题。

Details

Motivation: 解决在资源受限条件下（如参数规模≤20亿），对长时第一人称视频进行高效、准确问答的问题。

Result: 在保留测试集上准确率达到0.8279，达到该参数分区的第一名；其性能达到大型智能体流程精度的89%，而参数量仅为后者的1.1%；通过剪枝多语言嵌入表，最终模型参数量控制在1.9985B，符合参赛要求。

Insight: 创新点在于将大型工具使用智能体流程中的初级感知模块（而非整个复杂智能体）蒸馏到小型学生模型中，并使用正确回答的教师轨迹进行过滤，实现了在极小参数量下对长视频理解任务的高效迁移。通过剪枝嵌入表来精确控制模型规模也是一个实用的工程技巧。

Abstract: We describe our entry to the EgoLongQA track of the Wearable-AI Challenge in ECCV 2026, which placed first in the <=2B parameter division with 0.8279 on the held-out test set. Our system is a single 2B vision-language model that answers multiple-choice questions about ten-minute egocentric videos in one greedy forward pass; It is obtained by distilling the junior perception module of a tool-using agentic pipeline, not the agent itself into a small student, using teacher traces filtered to those that answered correctly. it reaches 89% of the accuracy of the large agentic pipeline using 1.1% of its parameters. This raises a 27.1% base model to 81.4% on our held-out questions. The 2B backbone has 2.2132B parameters and therefore over the divisional limit, to make the entry admissable we prune the multilingual embedding table from 248,320 to 143,469 rows, reaching 1.9985B with provably identical logits on retained rows.

[160] Mind the Approximation: Fisher-Weighted SVD Compression for ViTs cs.CV | cs.AI | cs.LGPDF

Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler, Emad Aghajanzadeh, Ryan Pegoud

TL;DR: 本文提出了一种名为FACTS的结构化Fisher近似方法，专门用于压缩视觉Transformer（ViT）模型，并配合Fisher加权的奇异值分解（SVD）。该方法通过强制token局部聚合并保留token内的激活-梯度依赖关系，提高了压缩效果。同时，作者还引入了快速约束秩搜索（CoRS）方法，在固定FLOP约束下优化各层的秩分配。实验表明，FACTS在不需微调的情况下，显著改善了ViT和混合架构的精度-效率权衡。

Details

Motivation: 作者发现，在压缩视觉Transformer时，改进Fisher近似的保真度并不能有效预测压缩后的模型精度。这一观察促使他们设计一种更适用于ViT压缩的结构化Fisher近似方法。

Result: 在ViT和混合架构上的广泛实验表明，FACTS方法在不进行微调的情况下，持续改善了精度与效率的权衡。例如，在Swin-B模型上，其Top-1准确率比最强的SVD基线方法高出多达5.8个百分点，并且通过提出的搜索方法还能获得进一步的提升。

Insight: 论文的核心创新在于提出了一种针对ViT结构特点（如token依赖）量身定制的结构化Fisher近似方法（FACTS），以及一种高效的、满足FLOP约束的层间秩分配搜索策略（CoRS）。这为基于SVD的模型压缩提供了更精确的损失感知机制和自动化配置方案。

Abstract: Model compression is key to mitigate deployment challenges of ever growing machine learning models. In this area of research, singular value decomposition (SVD)-based compression offers a compelling trade-off between computational efficiency and model accuracy. Fisher-weighted SVD in particular provides principled, loss-aware compression. However, we find that improving the fidelity of Fisher approximation used in the compression is poorly predictive of post-compression accuracy for Vision Transformers (ViTs). Motivated by this observation, we propose FACTS, a structured Fisher Approximation tailored to Compressing ViTs with Fisher-weighted SVD, which enforces token-local aggregation while preserving within-token activation-gradient dependence. Additionally, we introduce a fast Constrained Rank Search (CoRS), that optimizes layer-wise rank allocation while adhering to a fixed floating point operation (FLOP) constraint. Extensive experiments across ViTs and hybrid architectures demonstrate that FACTS consistently improves accuracy-efficiency trade-offs without requiring finetuning. Notably, it outperforms the strongest SVD baseline by up to +5.8 percentage points (p.p.) Top-1 on Swin-B, with further gains driven by our search method. Code is available at https://github.com/MoritzTho/FACTS.

[161] Weakly-supervised Kidney Tumor Classification from CT Scans with Multi-Instance Learning and Anatomical Filtering cs.CVPDF

Joonas Ariva, Dmytro Fishman

TL;DR: 该论文提出了一种弱监督的CT扫描肾脏肿瘤分类方法，通过结合多示例学习（MIL）和解剖学过滤来解决像素级标注稀缺和扫描级标签训练中的过拟合与捷径学习问题。MIL将CT体积分割为2D切片实例，利用ImageNet预训练的2D架构替代计算密集的3D模型；解剖学过滤则使用自监督的身体部位回归模型Compass裁剪出病理相关区域。该方法在内部数据集（TUH）和外部数据集（KiTS23、TCGA-KiRC）上进行了评估，仅使用扫描级标签即可实现高效分类。

Details

Motivation: 解决CT扫描分析中因精确像素级标注稀缺而依赖扫描级标签训练时，面临的监督信号弱、输入体积大导致的模型过拟合和捷径学习问题。

Result: 在肾脏肿瘤分类任务中，最佳模型在内部测试集上达到F1分数0.83；解剖学过滤对基于嵌入的ABMIL模型的分布外泛化至关重要，而基于实例的FocusMIL对分布偏移表现出更强的固有鲁棒性。

Insight: 创新点包括将MIL与解剖学过滤结合以增强弱监督学习效率，以及使用自监督模型Compass进行无分割掩码的病理区域裁剪；这为其他器官和病理的弱监督CT分类流程提供了概念验证。

Abstract: Deep learning models for CT scan analysis are often limited by the scarcity of precise pixel-level annotations, which require significant radiologist effort to produce. Training on scan-level labels alone reduces annotation requirements but introduces challenges: low supervision ratios and large input volumes make models prone to overfitting and shortcut learning. In this work, we investigate two complementary methods to address these challenges: multi-instance learning (MIL) and anatomical filtering. MIL divides CT volumes into 2D slice instances, enabling efficient 2D architectures with ImageNet pretraining rather than computationally demanding 3D models. Anatomical filtering uses Compass, our self-supervised body part regression model, to crop scans to pathology-relevant subregions without requiring segmentation masks. We evaluate two MIL frameworks - Attention-based MIL (ABMIL) and FocusMIL - on kidney tumor classification across one internal dataset (TUH) and two external datasets (KiTS23 and TCGA-KiRC). Our best models achieve F1 = 0.83 on the internal test set using only scan-level labels. We further show that anatomical filtering with the Compass model is critical for the out-of-distribution generalization of embedding-based ABMIL, while instance-based FocusMIL demonstrates greater inherent robustness to distribution shift. While evaluated on kidney tumors, we consider this a proof-of-concept for a broader weakly supervised CT classification pipeline applicable to other organs and pathologies.

[162] Deep Learning for Biopsy-Free Subtyping of Basal Cell Carcinoma from Dermatoscopic Images cs.CV | cs.AIPDF

Alexandros Papadopoulos, Chrysa Episkopou, Ioannis Sarafis, Aimilios Lallas, Anastasios Delopoulos

TL;DR: 这篇论文探讨了使用深度学习从皮肤镜图像中无创分型基底细胞癌（BCC）的可行性。研究利用预训练的视觉变换器（ViT）模型，在有限的标注数据（1271张图像）上，通过分层k折交叉验证，实现了区分侵袭性BCC亚型与其他亚型的任务。

Details

Motivation: 当前BCC的亚型分型依赖于侵入性的皮肤活检，成本高且有创。论文旨在探索仅通过单张皮肤镜图像进行无创分型的可能性，以改善临床治疗规划和患者预后。

Result: 在区分侵袭性BCC与其他亚型的任务中，ViT模型取得了AUC 0.784的优异性能，超越了基于CNN的基线模型和先前报道的人类读者表现，展示了其潜力。

Insight: 创新点在于将预训练的ViT模型应用于皮肤镜图像的小样本BCC亚型分类任务，证明了先进视觉模型在医学图像分析中，即使数据有限，也能实现高性能和无创诊断的潜力。

Abstract: Basal Cell Carcinoma (BCC) is the most common type of skin cancer, accounting for nearly 80% of skin cancer di- agnoses. Its optimal clinical management is guided by the distinct histopathologic subtype, with aggressive variants requiring more drastic measures. In current clinical practice, subtyping relies on skin biopsies, a procedure both costly and invasive. In this paper, we conduct a preliminary investigation into using deep learning for BCC subtyping, solely from a single dermatoscopic image of the lesion. Given the limited data at our disposal, we employ pre-trained vision transformers (ViTs), a state-of-the-art family of models highly effective for challenging downstream tasks with limited labeled data. Through repeated stratified k-fold cross-validation, we demonstrate that ViTs can achieve superior performance (AUC 0.784 on a dataset of 1271 dermatoscopic images of various BCC subtypes) over standard CNN-based baselines as well as previously-reported human reader perfor- mance, on the task of differentiating aggressive BCCs from other subtype families. These initial findings highlight the potential of combining deep learning and dermatoscopy to provide a biopsy- free alternative for BCC subtyping, thus aiding in improving treatment planning and patient outcomes.

[163] CHILD: Human-in-the-Loop OOD Detection for Safe Clinical Deployment cs.CVPDF

Jinlun Ye, Kaiyue Lu, Runhe Lai, Xinhua Lu, Jia-Xin Zhuang

TL;DR: 本文提出CHILD框架，一种无需训练、基于稀疏人类反馈的流式OOD检测方法，旨在提升医疗AI系统部署的安全性。该方法通过自适应风险感知样本选择机制，在严格预算约束下仅选取最不确定的样本进行人工审核，并利用基于检索的分数校准模块优化预测，无需更新模型参数。在四个医疗基准测试中，仅使用5%的反馈预算即可显著降低误报率并提升检测性能，优于现有先进方法。

Details

Motivation: 解决医疗AI系统中OOD检测的安全性问题，特别是在安全关键的临床环境中，完全自动化的测试时适应（TTA）可能引发安全风险，而人工监督又资源密集，因此需要一种能平衡安全与效率的方法。

Result: 在四个医疗基准测试上，CHILD仅使用5%的稀疏反馈预算，就将平均FPR95从72.63%降至60.26%，AUROC从75.53%提升至81.85%， consistently outperforming state-of-the-art baselines。

Insight: 创新点包括自适应风险感知样本选择机制，以高效利用有限人工反馈；以及基于检索的分数校准模块，通过紧凑特征缓存优化预测而不更新参数，实现了训练免费和资源高效的人机协同OOD检测。

Abstract: Out-of-distribution (OOD) detection is critical for safe deployment of medical AI systems. Recently, test-time adaptation (TTA) has emerged as a new paradigm for OOD detection, automatically adjusting detector behavior during deployment. However, such automatic adaptation mechanisms may raise safety concerns in safety-critical clinical environments. While physician oversight can mitigate these risks, it is resource-intensive and must be judiciously allocated. To reconcile safety with efficiency, we propose CHILD, a training-free framework designed to enhance streaming OOD detection via sparse human feedback. Operating under strict budget constraints, CHILD employs an adaptive risk-aware sample selection mechanism to pinpoint only the most decision-uncertain samples for review. Crucially, it maximizes the utility of this sparse feedback through a retrieval-based score calibration module, which refines model predictions using a compact feature cache without any parameter updates. Extensive experiments on four medical benchmarks demonstrate that CHILD turns limited supervision into significant reliability gains: with a sparse feedback budget of only 5%, it reduces the average FPR95 from 72.63% to 60.26% and improves AUROC from 75.53% to 81.85%, consistently outperforming state-of-the-art baselines. Our code is publicly available at https://github.com/figec/CHILD.

[164] The Price of Consistency: Exploiting Visual Anchors for Multimodal Jailbreaking in Video Generation cs.CVPDF

Peng Li, Qianqian Xu, Yangbangyan Jiang, Zhipeng Yu, Qingming Huang

TL;DR: 本文揭示了视频生成模型中视觉锚点（如参考图像）在提升时空一致性的同时，会因强制一致性而阻碍模型从有害内容转向良性内容，从而增加安全风险。基于此，作者提出了DIVA框架，通过将有害意图解耦为静态视觉锚点图像和动态运动文本提示，实现了无需训练的多模态越狱攻击，并在多个商业平台和开源模型上取得了比纯文本方法更高的攻击成功率。

Details

Motivation: 随着视频生成从纯文本驱动转向多条件可控生成，参考图像作为视觉锚点被广泛用于提升一致性，但其对安全性的影响尚未被充分探索。本文旨在研究视觉锚点如何因强制一致性而消除模型从有害内容转向良性内容的安全逃逸路径，从而揭示其固有的安全风险。

Result: 在多个领先的商业平台和主流开源视频生成模型上的广泛实验表明，DIVA框架实现了比现有纯文本方法显著更高的攻击成功率。此外，作者贡献了TI2VSafetyBench，这是首个针对多条件视频生成的安全基准。

Insight: 论文的核心创新点在于揭示了视觉锚点的一致性机制与安全风险之间的内在矛盾（即“一致性的代价”），并据此提出了一个无需训练的多模态越狱攻击框架DIVA，它通过解耦意图和双标准选择来平衡攻击隐蔽性和语义保持。从客观角度看，这项工作首次系统性地探讨了多条件视频生成中的安全漏洞，并为该领域的安全评估提供了首个基准。

Abstract: The rapid evolution of video generation has shifted the paradigm from pure text-driven to multi-conditional controllable generation, with reference images now widely adopted as conditional inputs to achieve superior spatiotemporal consistency. While these reference images serve as powerful visual anchors that significantly enhance controllability, their impact on safety remains largely unexplored. In this work, we reveal the visual anchoring effect: by enforcing consistency, the mechanism prevents the generated content from drifting away from the original harmful intent, thereby eliminating the model’s natural safety escape route from harmful to benign content. Consequently, visual anchors inherently increase the safety risk—this is the price of consistency. Building on this insight, we propose Decoupling Intent via Visual Anchors (DIVA), a training-free multimodal jailbreak framework for video generation that exploits this vulnerability. DIVA decouples harmful intent into a static visual anchor image and a dynamic motion text prompt, and employs dual-criteria selection to balance attack stealthiness with semantic preservation. Extensive experiments across various leading commercial platforms and mainstream open-source video generation models demonstrate that DIVA achieves a substantially higher Attack Success Rate than existing text-only methods. To facilitate future research, we additionally contribute TI2VSafetyBench, the first safety benchmark for multi-conditional video generation.

[165] Proximity-CLIP: Text-Guided Semantic Proximity Learning for Zero-Shot Anomaly Detection cs.CVPDF

Manwen Yang, Leqian Ding, Yu Guo, Fei Wang

TL;DR: 本文提出了Proximity-CLIP框架，用于解决零样本异常检测（ZSAD）中因视觉语言模型的对象中心偏差导致的正常与异常文本原型语义重叠问题。该框架通过视觉校准的语义邻近学习机制学习合适的语义边界，并设计了一个由文本先验驱动的异常查询模块来主动检索局部缺陷线索，从而在保持预训练结构连续性的同时提升判别能力。

Details

Motivation: 动机是解决现有基于视觉语言模型的零样本异常检测方法中，正常与异常文本原型因对象中心偏差而产生高度语义重叠的问题。强制正交性会破坏预训练模型的结构连续性，导致几何困境。

Result: 在多个零样本异常检测基准测试上的广泛实验表明，Proximity-CLIP以最小的架构修改，性能超越了当前最先进的方法。

Insight: 创新点在于提出了视觉校准的语义邻近学习机制，通过有界的动态正则化学习语义边界，平衡了判别性与结构对齐；以及设计了异常查询模块，利用校准后的异常原型作为语义查询，从上下文视觉块中主动检索局部缺陷，缓解了全局池化对细微异常的稀释效应。

Abstract: Vision-language models offer a promising approach for zero-shot anomaly detection (ZSAD). However, due to object-centric bias, normal and anomalous text prototypes exhibit a high semantic overlap. While enforcing strict orthogonality between them improves discriminability, mapping highly contiguous visual inputs onto drastically orthogonal prototypes introduces a geometric dilemma, disrupting the pre-trained structural continuity. To address this problem, we propose Proximity-CLIP, a framework that visually calibrates the semantic margin to guide visual adaptation. First, we introduce a visually-calibrated semantic proximity learning mechanism that uses a bounded dynamic regularization to learn an appropriate semantic margin, ensuring discriminative separation while preserving structural alignment. Second, we design an Anomaly Query Module (AQM) driven by these text priors. Using the calibrated anomalous prototype as a semantic query, the AQM actively retrieves localized defect cues from contextual visual patches, mitigating the dilution of subtle anomalies during global pooling. Extensive experiments demonstrate that Proximity-CLIP outperforms current state-of-the-art methods across multiple ZSAD benchmarks with minimal architectural modifications.

[166] MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling cs.CV | cs.AIPDF

Jin Xu, Xiaojian Huang, Zhuodong Luo, Zhihong Zhang, Xin Liu

TL;DR: 本文提出了MV-STRIDE，一个用于多模态大语言模型（MLLMs）的多视图层次化空间推理数据集和训练框架。该工作旨在解决现有MLLMs在2D视觉语言任务上进展迅速，但在需要结构化3D认知路径的多视图空间推理方面存在瓶颈的问题。通过构建一个明确建模基础感知、场景理解和复杂上下文推理之间依赖关系的层次化数据集，并配合多阶段训练，使MLLMs能够掌握跨视图的、3D一致的空间推理能力。

Details

Motivation: 现有MLLMs在2D任务上表现出色，但缺乏结构化3D认知路径，导致其在多视图空间推理这一基础能力上存在瓶颈。现有数据集结构扁平，无法有效支撑模型学习人类的空间认知过程。

Result: 基于所提出的层次化数据集和多阶段训练框架，模型在多个空间推理基准测试上取得了最先进的性能，特别是在多视图导向的MMSI-Bench上表现优异。

Insight: 核心创新在于构建了一个层次化、依赖关系明确的多视图空间推理数据集（MV-STRIDE），它将复杂的空间推理任务分解为相互依赖的基础能力，并强制跨视图依赖约束以防止单视图可解，从而为模型提供了符合人类认知的学习路径。此外，提供了基于认知基础的思维链监督来支持复杂推理。

Abstract: Despite the rapid progress of Multimodal Large Language Models (MLLMs) in 2D vision-language tasks, robust multi-view spatial reasoning remains a fundamental bottleneck due to the lack of structured 3D cognitive pathways in existing datasets. To address this, we introduce MV-STRIDE, a Multi-View hierarchical SpaTial Reasoning dataset with Interdependent and DEcomposed capabilitiEs. Moving beyond flat data structures, MV-STRIDE explicitly models the dependency relationships between foundational perception, scene understanding, and complex contextual reasoning, providing a coherent learning pathway aligned with human spatial cognition. We develop a systematic QA generation pipeline leveraging diverse 3D scene sources that enforces cross-view dependency constraints to prevent single-view solvability, generating multi-level spatial reasoning tasks supported by cognitively grounded chain-of-thought supervision for complex inference. Extensive evaluations demonstrate that our multi-stage training framework based on our hierarchical dataset achieves state-of-the-art performance across multiple spatial reasoning benchmarks, notably the multi-view oriented MMSI-Bench. Our approach enables MLLMs to maintain robust, 3D-consistent spatial reasoning across diverse viewpoints. The code and dataset are available at https://co1dspring.github.io/MV-STRIDE/.

[167] KODAMA: Multimodal Digital Twin Reconstruction for Urban RF Propagation Modelling cs.CVPDF

Maximiliano Wardle, A. Ryo Koblitz

TL;DR: 本文提出了KODAMA，一个用于城市射频传播建模的多模态数字孪生自动重建流水线。它仅利用现成的地理空间数据（如航空影像、激光雷达、街景图像）来自动生成可用于射线追踪的射频数字孪生模型，无需现场勘测或校准。

Details

Motivation: 当前射频数字孪生（RFDT）的构建面临两难选择：要么是粗糙的自动化场景，要么是耗时数周手动构建并需测量校准的模型。KODAMA旨在解决此问题，实现无需校准、自动化的城市级高精度RFDT重建。

Result: 在三个站点（频率覆盖3.6至28 GHz）的测试中，KODAMA未经校准的预测达到了个位数的RMSE，相比自动化基线方法将点对点误差降低了高达5.35 dB，并且与经过测量校准的手工构建RFDT的误差差距仅为0.22 dB。

Insight: 核心创新在于提出一个完全自动化的端到端流水线，通过多模态数据融合（航空影像、LiDAR、街景图像）来联合重建几何、立面细节和电磁材料属性，从而在无需现场校准的情况下，实现了接近手工校准模型精度的射频传播预测。

Abstract: 3D reconstruction typically strives for geometric fidelity or visual plausibility. Radio frequency digital twins (RFDT) are instead judged by whether communication channels behave in them as they do in the real world. RFDTs promise site-specific channel prediction but current practice forces a choice between coarse automated scenes and hand-built, measurement-calibrated models that take weeks to construct per-site. We present KODAMA, an automated pipeline that reconstructs ray tracing-ready RFDTs at city scale from off-the-shelf geospatial data alone: aerial imagery, LiDAR, and photogrammetry yield terrain and watertight building meshes, while exposure-weighted multi-view fusion of street-level imagery recovers façade relief, electromagnetic materials, and clutter—all without site visits or calibration. Across three sites spanning 3.6 to 28 GHz, KODAMA’s uncalibrated predictions achieve single-digit RMSE, reducing point-to-point error by up to 5.35 dB over automated baselines and coming within 0.22 dB of a measurement-calibrated, hand-built RFDT.

[168] CRISP: Corneal Confocal Microscopy Real-Time Image Stitching Pipeline cs.CVPDF

Qincheng Qiao, Puli Zhang, Jian Zhou, Xinguo Hou

TL;DR: 本文提出了CRISP，一种用于常规角膜共焦显微镜视频流的开源实时宽视野图像拼接框架，旨在解决现有方法依赖离线后处理、额外硬件或特定采集协议的问题，通过焦点感知门控、局部配准和稀疏锚点图等技术实现低延迟的实时拼接。

Details

Motivation: 现有角膜共焦显微镜设备视野有限，而基底神经丛形态空间不均匀，离散采样导致可重复性差，限制了其作为定量评估工具的临床应用，需要一种适用于常规视频流的实时宽视野拼接方案。

Result: CRISP框架在常规CCM视频流上实现了实时宽视野拼接，提供低延迟覆盖反馈，并输出帧、姿态和锚点信息以初始化离线精细拼接，据作者所知是首个此类开源框架。

Insight: 创新点包括焦点感知门控排除离焦段、局部姿态传播与稀疏锚点图维护非冗余覆盖，以及在局部连续性中断时通过全局外观检索和几何验证进行重定位与子图合并，降低了宽视野拼接的采用门槛。

Abstract: Morphology of the sub-basal nerve plexus (SNP) reflects peripheral nerve health, and corneal confocal microscopy (CCM) provides an important means for in vivo, real-time, non-invasive observation of the SNP. However, mainstream CCM devices offer a limited field of view per frame, whereas the SNP is spatially non-uniform; discrete image sampling is therefore sensitive to sampling location and frame selection, which limits the reproducibility and clinical adoption of CCM as a quantitative assessment tool. Wide-field stitching can reconstruct larger SNP mosaics by integrating sequentially acquired CCM images, but existing methods largely rely on offline post-processing, additional hardware, or specific acquisition protocols, and lack open-source real-time solutions for conventional CCM video streams. This paper presents CRISP (Corneal confocal microscopy Real-time Image Stitching Pipeline), an open-source real-time SNP wide-field stitching framework for conventional CCM examination video streams. CRISP excludes defocused and discontinuous segments via focus-aware gating, propagates poses through local pairwise registration, and maintains non-redundant spatial coverage with a sparse anchor map; when local temporal continuity is interrupted, the system completes relocalization and subgraph merging through global appearance retrieval followed by geometric verification. The framework prioritizes low-latency coverage feedback during examination while outputting accepted frames, poses, and anchor information to initialize offline fine stitching. To our knowledge, CRISP is the first open-source real-time SNP wide-field stitching framework released for conventional CCM video streams. By lowering the barrier to adoption and reproduction of wide-field stitching, CRISP may help move SNP wide-field imaging from a research tool into routine clinical examination workflows.

[169] DF26: We Cannot Tell Fake From Real Anymore cs.CVPDF

Severyn Shykula, Andrii Yermakov, Ivan Samarskyi, Dmytro Mishkin, Jan Cech

TL;DR: 论文提出了DF26基准测试，用于检测由最新文本到视频和图像到视频模型生成的完全合成视频片段。该基准包含271个真实视频和2420个由七种现代视频模型生成的合成视频，涵盖单人公开演讲场景。研究表明，人类和现有最先进的深度伪造检测器在识别AI生成视频方面的表现接近随机猜测水平。

Details

Motivation: 解决当前AI生成视频检测方法在应对现代生成模型分布偏移时的局限性，强调现有评估协议的不足，并推动建立能明确衡量对现代生成模型鲁棒性的基准测试。

Result: 在DF26基准上，人类检测准确率接近随机水平（50%），现有最先进的深度伪造检测器表现也类似，未能有效区分真实与合成视频。

Insight: 创新点在于构建了专注于现代文本到视频/图像到视频模型生成内容的基准测试，揭示了当前检测方法在面对新型生成技术时的根本性脆弱性，强调了评估协议需要适应快速演进的生成模型分布变化。

Abstract: We introduce DF26, a novel benchmark for detecting AI-generated videos containing fully synthetic clips produced by recent text-to-video and image-to-video models. The videos capture single-person public-speaking scenarios, spanning direct-to-camera recordings, official statements, and studio interviews - 271 real and 2,420 synthetic videos generated by seven modern video models. The study on DF26 shows that human performance in detecting AI-generated videos, as well as state-of-the-art deepfake detectors, is close to random chance. Our results highlight the limitations of current evaluation protocols and motivate the need for benchmarks that explicitly measure robustness to modern generative model distribution shifts.

Raphael Lorenzo-Louis, Bertrand Luvison, Serena Ivaldi

TL;DR: 本文研究了人类和机器从服务机器人视角预测人类交互意图的能力，比较了人类注释者、轻量级姿态模型和视觉语言模型在HUI360数据集上的表现。研究发现，人类在仅使用姿态输入时略优于轻量级模型，而在使用完整视频输入时显著优于视觉语言模型，且模型性能与规模无关。

Details

Motivation: 从机器人视角预测人类交互意图是一个高度依赖多模态线索的直觉性任务，本文旨在评估人类和现有模型在此任务上的表现差异。

Result: 在HUI360数据集的100条测试轨迹上，人类使用姿态输入时F1分数比轻量级模型高0.08，使用完整视频输入时比视觉语言模型高0.2；视觉语言模型的性能与模型规模无关。

Insight: 论文创新点在于从机器人视角系统比较人类直觉与机器推理在交互预测任务上的差距，并指出仅靠模型推理能力不足以匹配人类的社会直觉，强调了多模态融合的重要性。

Abstract: Anticipating whether a person will interact from one’s own perspective is a highly intuitive task for humans, that relies on a combination of cues. We investigate how humans perform at predicting a person’s intention to interact from a service robot’s point of view, using pose-only or full video input, then benchmark different lightweight pose-based models and state-of-the-art vision-language models. We conducted our benchmark on the HUI360 dataset on a fixed pilot subset of 100 test tracks (25 positive, 75 negative). We found that with pose-only input, human annotators outperform lightweight trained pose models but not by large margins (+0.08 in F1-Score). But when given full egocentric video with a target bounding box, human annotators perform substantially better and largely outperform the Vision-Language Models (+0.2 in F1-Score). We also compared VLMs of different size and under different input conditions, and found that the best results do not correlate with model size. Our result confirms that predicting interactions is a challenging task for social robots and that reasoning-capable models are necessary but their actual reasoning capabilities alone do not suffice to match the social intuition of humans.

[171] Federated Binary Gating with Server-Side Vision-Language Inference for Surveillance Anomaly Classification cs.CV | cs.AI | cs.LGPDF

Côme-Alexis Puech, Sébastien Thuau, Amira Gran, Arthur Mennessier, Siba Haidar

TL;DR: 本文提出了一种用于监控异常分类的混合两阶段联邦学习架构。该架构结合了客户端的轻量级二进制CNN门控模型进行本地异常筛选，以及服务器端的零样本视觉语言模型进行细粒度分类。研究在非独立同分布数据场景下，通过分解任务解决了直接联邦多类分类不稳定的问题，并在真实异构部署中验证了其在分类质量与数据传输量之间的权衡。

Details

Motivation: 解决隐私敏感的监控系统在利用大型视觉语言模型时面临的原始视频数据集中化访问挑战，以及在联邦学习环境中，非独立同分布客户端数据导致直接多类异常分类不稳定（尤其是稀有类别）的问题。

Result: 在UCF-Crime数据集（分为五个粗粒度元类）和真实三节点异构部署中评估。直接联邦多类训练失效，而所提方法在固定阈值路由下，保持了与集中式CNN+VLM基准相近的宏平均F1分数（F1-macro），同时将传输视频比例降至51.4%。另一种以灵敏度为导向的路由策略将宏ROC AUC从0.673提升至0.692，假阴性率从29.3%降至22.9%，但F1-macro略有下降且传输量增加。

Insight: 创新点在于将联邦学习任务分解为客户端粗粒度二进制筛选与服务器端细粒度零样本VLM推理的混合架构，有效平衡了隐私、通信开销与分类性能。客观分析表明，该设计将联邦学习的优势（本地数据处理）与中央强大模型（VLM）的推理能力相结合，并通过路由策略灵活权衡服务器资源使用与异常检测灵敏度。

Abstract: Privacy-sensitive surveillance systems could benefit from large vision-language models (VLMs), but such models typically require centralized access to raw video. In federated learning settings, this challenge is amplified by non-independent and identically distributed (non-IID) client data, which can make direct multiclass anomaly classification unstable, especially for rare categories. We propose a hybrid two-stage architecture that combines a federated binary convolutional neural network (CNN) gate with server-side zero-shot VLM inference. The lightweight LiteCNN3D gate performs local anomaly screening and forwards only flagged videos to Qwen3-VL-8B, which assigns them to four anomaly metaclasses. We evaluate this design on UCF-Crime grouped into five coarse metaclasses and implement the federated stage in a real three-node heterogeneous deployment. In the studied setting, direct federated multiclass training collapses, whereas the proposed decomposition yields a better trade-off between classification quality and raw-video transmission. With fixed-threshold routing, the federated hybrid pipeline preserves nearly the same macro-averaged F1 score (F1-macro) as its centralized CNN+VLM counterpart while reducing the fraction of transmitted videos to 51.4%, although with a lower proxy macro receiver operating characteristic area under the curve (ROC AUC) than the centralized hybrid system. A complementary sensitivity-oriented routing operating point increases macro ROC AUC from 0.673 to 0.692 and reduces the false negative rate from 29.3% to 22.9%, but decreases F1-macro from 0.503 to 0.485 while increasing transmission from 51.4% to 57.9%. These results suggest that federation is better suited to coarse local screening, while routing rules can be adjusted to trade server-side VLM usage for higher anomaly sensitivity.

[172] RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting cs.CV | cs.AI | cs.GR | cs.LG | cs.MMPDF

Hejun Wang, Jinxi Li, Junwei Jiang, Shiwei Mao, Hu Cheng

TL;DR: 本文提出了一种名为RelightFormer的前馈生成Transformer模型，用于单视图和多视图图像重光照任务。该模型基于视频基础模型改进，通过潜在光照模块动态注入目标环境光，并采用置换不变位置编码处理无序多视图输入。模型在包含大量物体和光照条件的大规模Laval Objaverse数据集上训练，在单视图、多视图和新视图重光照任务中实现了最先进的视觉质量和零样本泛化能力。

Details

Motivation: 传统图像重光照方法依赖于复杂的逆向渲染流程或单视图生成模型，前者存在病态优化问题，后者忽略了多视图线索对理解3D几何和材质交互的关键作用。本文旨在克服这些限制，开发一种无需显式估计内在属性的前馈生成模型。

Result: 在单视图、多视图和新视图重光照任务上的广泛实验表明，该方法在视觉质量和真实感方面达到了最先进水平，并展现出强大的零样本泛化能力。

Insight: 创新点包括：1) 基于视频基础模型构建，通过潜在光照模块和交叉注意力动态注入光照条件；2) 采用置换不变位置编码，实现对无序多视图输入的对称处理，避免序列偏差；3) 构建了大规模Laval Objaverse数据集以支持数据驱动训练。

Abstract: Image relighting is traditionally tackled via complex inverse rendering pipelines, which suffer from ill-posed optimization, or single-image generative models that ignore crucial multi-view cues necessary for understanding 3D geometry and material interactions. To address these limitations, we introduce a feed-forward generative Transformer for direct single- and multi-view image relighting that entirely bypasses explicit intrinsic property estimation. Adapted from a video foundation model, our architecture features a latent illumination module that dynamically injects target environment maps into spatial features via cross-attention. Furthermore, we employ permutation-invariant positional encodings to symmetrically process unordered multi-view inputs without sequential bias. To train this robust data-driven model, we construct the massive Laval Objaverse Dataset (LOD), comprising 90K objects and 39K unique illuminations. Extensive experiments demonstrate state-of-the-art visual quality, photorealistic relighting quality, and strong zero-shot generalization across single-view, multi-view, and novel-view relighting tasks.

[173] Unified Vision-Centric Pedestrian Crossing Action Prediction via Adaptive Patch Projection and Proactive Spatial Rectification cs.CVPDF

Yao Tian, Le Yang, Binglu Wang

TL;DR: 本文提出ViCross，一种基于多模态大语言模型的视觉中心行人过街动作预测框架，无需额外感知模块，仅通过首帧目标初始化实现目标中心推理。该方法通过可变分辨率补丁映射模块高效分配视觉token以保留关键细节，并利用空间约束增强策略整合时空先验进行训练时主动空间校正。实验表明，ViCross在视觉中心预测设置中表现优异，并在多种设置下与多源融合方法竞争。

Details

Motivation: 现有方法依赖额外感知模块或多源信息融合来获取稳定的目标中心表示，而视觉中心设置的可靠性仍存疑问。本文旨在探索仅基于视觉线索的行人动作预测，避免对额外感知的依赖。

Result: 大量实验表明，ViCross在视觉中心预测设置中取得了显著提升，并在多个设置下与多源融合方法具有竞争力。

Insight: 创新点在于将多模态大语言模型应用于视觉中心动作预测，并设计了可变分辨率补丁映射以平衡计算效率与细节保留，以及空间约束增强策略来整合时空先验进行主动校正，从而在仅依赖视觉输入的情况下实现稳定推理。

Abstract: Vision cues are available and informative for pedestrian action prediction, but obtaining stable target-centric representations from video frames remains challenging without frame-level external perception cues. Thus, most methods rely on additional perception modules or multi-source information fusion, leaving the reliability of vision-centric setting an open question. To this end, we propose ViCross, a vision-centric pedestrian crossing action prediction framework powered by multimodal large language models, which maintains target-centric reasoning from video frames without additional perception modules beyond first-frame target initialization. While multimodal large language models exhibit strong visual understanding, applying them directly to vision-centric action prediction faces two challenges. First, accurately perceiving target pedestrians often requires high resolution inputs and dense visual tokenization, making full-frame encoding computationally prohibitive. ViCross tackles this with Variable Resolution Patch Mapping module for efficient token allocation while preserving key pedestrian details. Second, missing spatiotemporal priors hinder consistent cross frame reasoning. ViCross mitigates this with a Spatial Constraint Enhancement Strategy that captures past motion, future locations, and action semantics for training-time proactive spatial rectification. Extensive experiments show that ViCross delivers clear gains in vision-centric prediction settings and is competitive with multi-source fusion approaches in several settings. Code is available at https://github.com/2tianyao1/ViCross.git.

[174] Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection cs.CV | cs.AI | cs.LGPDF

Sébastien Thuau, Amira Gran, Siba Haidar, Rachid Chelouah

TL;DR: 本文提出了一种轻量级联邦MIL-VLM级联框架，用于解决分布式、弱标注且资源受限场景下的视频异常检测问题。该方法仅在各客户端训练紧凑的MIL评分器，并利用冻结的视觉语言模型对高评分可疑片段进行事后验证。

Details

Motivation: 针对现有弱监督视频异常检测方法通常依赖集中式训练，且基于VLM的扩展方法需要密集推理、生成解释或额外适配的问题，本文旨在探索如何在联邦学习环境下，利用VLM以轻量且无需解析的方式提升检测性能。

Result: 在UCF-Crime数据集上使用InternVL3.5-2B和Qwen3-VL-2B-Instruct进行实验，结果表明：基于文本生成的验证方法在经过诊断性时序后处理后能提升帧级AUC，但对提示词、解析器、模型选择和平滑处理敏感；而基于logit的接口提供了无需解析的固定信号，在两种VLM上均能超越MIL基线，提升帧级AUC和AP，且主要配置中无需时序后处理。

Insight: 创新点在于提出了无需解析器的VLM验证框架，通过直接利用VLM的next-token Yes/No概率logit值提取连续异常分数，避免了文本生成验证对提示工程和解析的依赖，为联邦学习场景提供了一种简单、局部且稳定的片段级验证替代方案。

Abstract: How can vision-language models help video anomaly detection (VAD) when surveillance data remain distributed, weakly labeled, and resource-constrained? Most weakly supervised VAD methods assume centralized training; recent VLM-based extensions further rely on dense inference, generated explanations, or additional adaptation. We introduce a lightweight federated MIL-VLM cascade in which only a compact MIL scorer is trained across clients, while a frozen VLM verifies high-scoring suspect segments post hoc. We study two VLM feedback interfaces: parsed text-generation decisions and a logit-based interface that extracts a continuous anomaly score from next-token Yes/No probabilities. Experiments on UCF-Crime with InternVL3.5-2B and Qwen3-VL-2B-Instruct show that text-generation verification can improve frame-level AUC after diagnostic temporal post-processing, but remains sensitive to prompts, parsers, model choice, and smoothing. In contrast, the logit interface provides a fixed parser-free signal that improves both frame-level AUC and frame-level AP over the MIL baseline across both VLMs, without temporal post-processing in its main configuration. Since suspect segments are updated independently once available, next-token logit feedback provides a simple segment-local alternative to text-generation verification.

[175] CrACK: Adversarial Attacks on Cross-Model Consistency in Collaborative Vision Foundation Models cs.CVPDF

Feifei Liu, Jintao Cheng, Chi Man Vong, Xiaoyu Tang

TL;DR: 本文提出了一种针对协作式视觉基础模型（如CLIP、SAM、DINO）的新型对抗攻击方法CrACK，该攻击无需修改输入像素、模型权重或训练数据，而是通过破坏模型间特征接口的语义空间对齐依赖关系，导致整个协作管道产生灾难性性能下降，而单个模型输出保持不变，从而揭示了现有逐模型防御的结构性盲点。

Details

Motivation: 现有研究通常假设协作式视觉基础模型系统的安全性源于其单个模型的鲁棒性，但本文挑战了这一假设，指出所有协作管道共享一个漏洞：模型间在消费中间输出时未验证语义一致性，即存在未受保护的语义-空间对齐依赖接口。

Result: 在四个协作管道和八个基准测试上的实验表明，CrACK攻击能导致预测性能的灾难性退化，而每个独立模型的输出保持不变，使得逐模型防御失效；此外，攻击还能级联影响大型视觉语言模型（如LLaVA），使其在视觉输入完好的情况下产生错误响应。

Insight: 论文的核心创新在于首次识别并利用了协作模型间语义-空间对齐依赖这一共享漏洞，提出了无需修改底层模型或输入的两阶段推理时攻击方法（对抗性亲和矛盾注入和语义接口毒化），其关键洞察是：协作AI系统的安全性不能简化为其组件的鲁棒性，模型间特征接口必须被视为首要的安全边界。

Abstract: Training-free collaborative pipelines that integrate Vision Foundation Models such as CLIP, SAM, and DINO achieve strong open-vocabulary dense prediction and are increasingly deployed in safety-critical applications. The security of these systems is commonly assumed to follow from the robustness of their individual models. We challenge this assumption. We identify a vulnerability shared by every collaborative pipeline: each model consumes the intermediate output of another without verifying semantic consistency, an unverified premise that we term the semantic-spatial alignment dependency. Existing adversarial attacks target a single model and overlook this premise, leaving the inter-model interface entirely unguarded. We propose CrACK (Cross-model Adversarial Consistency attack), an inference-time attack that exploits this interface without modifying any input pixel, model weight, or training data. CrACK operates in two stages: Adversarial Affinity Contradiction Injection corrupts the cross-modal affinity matrix by inverting SAM encoder features under the guidance of CLIP patch-level semantics, and Semantic Interface Poisoning steers the prediction through a max-distance label permutation derived from CLIP text embeddings. Experiments on four collaborative pipelines across eight benchmarks show that CrACK causes catastrophic degradation while every individual model continues to produce its unchanged standalone output, rendering per-model defenses structurally blind. The corruption further cascades into large vision-language model reasoning, driving models such as LLaVA to produce erroneous responses from visually intact inputs. Our results show that the security of a collaborative AI system cannot be reduced to the robustness of its components, and that inter-model feature interfaces must be treated as first-class security boundaries.

[176] Mitigating Shortcut Learning: Texture-Penalized Prototype Networks cs.CVPDF

Akshay Anilkumar Girija, Elena Hoemann, Frank Köster, Sven Hallerbach

TL;DR: 本文提出了一种名为纹理惩罚原型网络（TPPN）的新型架构框架，旨在缓解标准卷积神经网络（CNN）因强烈的纹理归纳偏置而导致的性能下降问题。该方法通过引入纹理惩罚分支（TPB）来抑制局部纹理特征的提取，迫使网络主干学习更纯净的形状偏置表示，并通过基于原型的超球面相似性评估来加强几何约束，从而实现更鲁棒的分类。

Details

Motivation: 标准卷积神经网络（CNN）存在强烈的纹理归纳偏置，即过度依赖局部高频纹理模式而非全局结构形状，这导致其在纹理变化或环境效应下容易出现自信的错误分类。本文旨在解决这一缺陷，而不依赖于资源密集的数据增强方法。

Result: 在纹理-形状线索冲突数据集和合成噪声基准测试上的评估表明，该方法显著增强了形状偏置。具体而言，它将基线ResNet-50的固有纹理偏置从55.11%降低至29.73%，超越了现成的Vision Transformer（ViT-B/16）的纹理抑制能力。在干净验证数据上，该架构仅导致0.90个百分点的精度轻微下降，并在分布外（OOD）形状和扰动条件下表现出更强的鲁棒性和形状准确性。

Insight: 论文的创新点在于提出了一种结构化的、高效的纹理惩罚分支（TPB）和基于原型的超球面约束机制，主动抑制CNN的纹理捷径学习，强制网络学习形状偏置表示。这为缓解CNN的固有纹理偏置提供了一种无需大量数据增强的新架构解决方案，具有较好的泛化能力。

Abstract: Standard Convolutional Neural Networks (CNNs) exhibit severe performance degradation due to a strong inductive texture bias that prioritizes local, high-frequency patterns over global structural shapes. This dependency causes confident misclassifications during textural changes or environmental effects. To address this flaw, this study introduces the Texture-Penalized Prototype Network (TPPN), a novel architectural framework that shifts this inherent bias without depending on resource-intensive augmented datasets. Specifically, a Texture-Penalization Branch (TPB) imposes a penalty to suppress the extraction of local texture proxies, forcing the network backbone to discard high-frequency cues and extract purified, shape-biased representations. By evaluating similarities within a prototype-based hypersphere derived from the final convolutional features, the approach enforces strict geometric constraints, treating objects as compositions of essential parts to achieve robust classification. Evaluations on texture-shape cue-conflict datasets and synthetic noise benchmarks demonstrate the stronger shape bias of this structural disentanglement. The proposed framework reduces the inherent texture bias of a baseline ResNet-50 from 55.11% to 29.73%, surpassing the texture-suppression capabilities of an off-the-shelf Vision Transformer (ViT-B/16). Furthermore, the approach demonstrates robust generalization under cue-conflict conditions, resisting textural shortcut learning when encountering Out-of-Distribution (OOD) shapes. The model maintains stronger shape accuracy against elevated perturbations. On clean validation data, the architecture incurs a minimal drop in accuracy of 0.90 percentage points. This provides a structural, efficient solution to CNN texture bias.

[177] TeMo: Temperature Modulation for Multimodal Contrastive Learning cs.CVPDF

Dhimitrios Duka, Bernt Schiele, Hilde Kuehne, Anna Kukleva

TL;DR: 本文提出TeMo（温度调制）框架，通过根据正负样本对的相似性自适应调整对比学习中的温度超参数，实现更细粒度的多模态对比学习。该方法将温度调制的多模态和单模态损失与标准多模态对比损失无缝集成，使模型在不同训练阶段捕获粗粒度和细粒度语义。

Details

Motivation: 现有对比学习方法通常固定或学习全局温度超参数，无法针对不同样本对进行精细调节，限制了多模态对比学习的性能。

Result: 在多种零样本检索和分类任务上的广泛实验表明，TeMo的每个组件均能持续提升性能，并取得了新的最先进（SOTA）结果。

Insight: 创新点在于提出基于相似性的温度自适应调制机制，以及通过渐进式损失集成策略实现多粒度语义学习，为对比学习中的超参数优化提供了新思路。

Abstract: Contrastive learning approaches achieve strong performance by training models to bring similar samples closer while pushing dissimilar samples apart. A crucial component of contrastive learning is the temperature hyperparameter $τ$, which controls the penalty strength applied to negative samples. However, most existing methods either fix this hyperparameter or learn a global value during training. In this paper, we introduce TeMo, Temperature Modulation framework, a similarity-based modulation approach that adaptively adjusts the temperature for each positive-negative pair according to their similarity, enabling more fine-grained multimodal contrastive learning. Our approach seamlessly integrates temperature-modulated multimodal and unimodal losses with the standard multimodal contrastive loss by gradually transitioning between them. This design allows the model to capture both coarse- and fine-grained semantics at different training stages. Extensive experiments demonstrate that each component of TeMo consistently enhances performance across diverse zero-shot retrieval and classification tasks, establishing new state-of-the-art results.

[178] Heat Kernel Textures: the Geodesic Gaussians That Do Not Splat cs.CV | cs.GR | cs.LGPDF

Simone Foti, Caner Korkmaz, Stefanos Zafeiriou, Tolga Birdal

TL;DR: 本文提出了一种名为Heat Kernel Textures (HKTex)的新型纹理表示方法，旨在替代传统的UV映射。该方法基于离散黎曼几何，将各向异性热核作为测地高斯函数定义在三角网格表示的物体表面上，从而消除了UV展开带来的接缝、扭曲、顶点重复和分辨率不均等问题，并显著降低了内存占用。该方法可与基于物理的渲染器集成，并能从现有纹理或多视图图像进行优化。

Details

Motivation: 为了解决传统UV映射存在的UV空间浪费、接缝、扭曲、顶点重复和分辨率变化等固有问题，并大幅降低纹理的内存占用，本文从3D高斯泼溅（3D Gaussian Splatting）中汲取灵感，重新思考纹理表示方式。

Result: 摘要中未提及具体的定量实验结果或基准测试比较。

Insight: 论文的核心创新点在于将各向异性热核作为测地高斯函数，直接在物体表面流形上定义和优化纹理表示，从而完全绕开了UV展开过程。从客观角度看，该方法将3D高斯泼溅的思想从体积表示成功迁移到表面纹理表示，并引入了离散黎曼几何的理论基础，为解决纹理映射的经典问题提供了一个新颖且内在的解决方案。

Abstract: 3D Gaussian Splatting has recently revolutionised novel view synthesis as well as many other 3D vision methods and applications. Drawing inspiration from this representation, we now rethink textures to overcome the main issues of UV mapping while considerably lowering their memory footprint. Heat Kernel Textures (HKTex) eliminate UV unwrapping as well as their persistent issues of wasted UV space, seams, distortions, vertex-duplication, and varying resolution. Grounded in discrete Riemannian geometry and intrinsically defined on any manifold surface discretised as a triangular mesh, HKTex uses anisotropic heat kernels as geodesic equivalents to Gaussians. Like our kernels, also the optimisation of their position and the adaptive densification strategies were redefined to operate on the surface of the object to be textureised. Our novel representation is also fully integrated with a physically based renderer and can be optimised either from existing textures or multi-view images. Our project page and code are available at circle-group.github.io/research/HeatKernelTextures.

[179] Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search cs.CVPDF

Zixiao Gu, Yabo Chen, Xunzhi Xiang, Yu He, Haibin Huang

TL;DR: 该论文提出了Search-to-World任务，用于系统评估智能体系统如何将用户请求通过网页搜索转化为可用的3D世界。作者定义了Observed Retrieval Rate和World Delivery Rate两个指标，并开发了WorldSearcher框架，该框架采用‘先复用后重建’的策略，并包含一个结构化的恢复控制器来处理失败情况。

Details

Motivation: 目前缺乏对智能体系统将检索到的网页内容转化为可用3D世界能力的系统性评估，也没有端到端的评估流程或基准。

Result: 在Search-to-World基准上的实验表明，3D世界的交付成功率依赖于底层智能体模型，且观察到相关内容并不保证能成功交付世界。联合训练恢复子智能体可以提高交付成功率和行动效率。

Insight: 创新点在于提出了首个端到端的3D世界交付评估任务和量化指标，以及一个结合复用、重建和结构化恢复控制的实用评估框架，将相关内容的观察与最终可感知世界的成功交付区分开来。

Abstract: Agentic systems can interpret user requests, search the live web, and use external tools, but their ability to transform retrieved web content into a usable 3D world has not been systematically evaluated. No established end-to-end pipeline or benchmark exists for this capability. We introduce Search-to-World, an end-to-end evaluation task covering request understanding, web visual-content retrieval, and 3D-world delivery. We define Observed Retrieval Rate (ORR) and World Delivery Rate (WDR) to distinguish observing relevant content from successfully delivering a request-aligned, perceptually acceptable world. We also present WorldSearcher, a reuse-then-reconstruction harness that connects existing search agents to world delivery: it first retrieves reusable 3D worlds and, when none are available, reconstructs a world from video. A structured recovery controller revises temporal grounding, replaces source videos, or reformulates queries after failure. Using WorldSearcher, we benchmark representative models on Search-to-World and study supervised fine-tuning (SFT) for recovery subagents. Results show that delivery depends on the underlying agentic model, and that relevant-content observation does not ensure world delivery. Jointly training recovery agents improves delivery success and action efficiency. Search-to-World makes agentic 3D-world delivery measurable, while WorldSearcher provides a practical evaluation harness with recovery capabilities.

[180] Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation cs.CV | cs.MAPDF

Jiaben Chen, Sixun Dong, Qinhong Zhou, Raine Ma, Zhiyang Dou

TL;DR: 本文提出了一种用于长篇叙事到电影生成的结构化编排层，通过多智能体框架在剧本和现成视频生成器之间运作。该层以FilmDSL（一种面向电影的领域特定语言）为核心，使镜头、相机指令、资产与连续性要求等电影约束显式化，从而通过规划、生成、批判和修复的共享结构化规范来协调智能体。实验表明，在电视剧风格片段上，该方法在可控性和一致性方面优于纯文本和纯参考基线。

Details

Motivation: 解决当前基于提示的长篇叙事到电影生成工作流在镜头级可控性、视觉身份和角色行为的跨片段一致性方面的不足，其核心原因在于剧本与视频模型之间缺乏结构化的中间层，尤其是在剧本在关键电影决策点上描述不足时。

Result: 在电视剧风格片段上的实验表明，该方法在可控性和一致性方面优于纯文本和纯参考基线。

Insight: 创新点在于引入了结构化的编排层和FilmDSL领域特定语言，将电影约束显式化，并采用多智能体（生成与批判）框架进行协调与迭代优化，无需重新训练基础模型即可实现针对性修复，提升了生成过程的规划性和可控性。

Abstract: Long-form narrative-to-film generation requires shot-level controllability and cross-clip consistency in both visual identity and character behavior-requirements that remain difficult to satisfy with current prompt-based workflows. A core reason existing workflows remain brittle is the lack of a structured intermediate layer between scripts and video models, especially when screenplays are underspecified at key cinematic decision points. We introduce a structured orchestration layer for film-oriented script-to-video generation, implemented as a multi-agent framework that operates between scripts and off-the-shelf video generators. The layer is centered on FilmDSL, a film-oriented domain-specific language that makes cinematic constraints explicit, including shot and camera directives, asset and continuity requirements, and persona cues, so that agents coordinate through a shared structured specification for planning, generation, critique, and repair. Specifically, a generation agent constructs asset packs and storyboard keyframes that anchor composition before clip-by-clip synthesis, while a critic agent produces structured QA signals and triggers targeted refinement without retraining the base model. Experiments on TV-style segments show improved controllability and consistency over text-only and reference-only baselines.

[181] TV-SGS: Gaussian Splatting with Geometric Information Propagation via Tensor Voting under sparse views cs.CVPDF

Harish N Sathishchandra, Philippos Mordohai

TL;DR: 本文提出了TV-SGS方法，通过引入张量投票机制，在稀疏视图下增强3D高斯溅射中的几何结构。该方法实现了高斯溅射体之间的直接通信，通过不依赖渲染的3D损失函数提供几何监督，从而在保持或提升渲染质量的同时，显著改善场景几何的准确性。

Details

Motivation: 现有3D高斯溅射方法中，多个溅射体仅通过投影到共同像素间接交互，缺乏对3D几何结构的直接约束。在输入视图稀疏、图像监督有限的情况下，几何正则化至关重要，因此需要一种能直接增强3D几何结构的方法。

Result: 在DTU和Tanks-and-Temples数据集上的实验表明，TV-SGS相比基线方法显著改善了输出几何质量，同时保持或提升了渲染质量。该方法易于集成到多种骨干网络中。

Insight: 创新点在于将张量投票机制适配用于测试时优化，为高斯溅射提供几何监督；提出了一类不依赖渲染的3D损失函数，可与现有损失结合，特别适用于稀疏视图下的几何正则化。从客观角度看，这种直接基于3D空间的几何信息传播机制，为解决稀疏视图下神经渲染的几何模糊问题提供了新思路。

Abstract: Gaussian Splatting has been effective in inferring scene representations that excel in novel view synthesis. Multiple splats cooperate seamlessly to synthesize the pixels of novel views and are jointly optimized even though they only affect each other indirectly, via pixels they project to in common. We present an approach that enables direct communication among splats to enhance the geometric structures they form in 3D. This is accomplished by Tensor Voting, which was originally designed to infer structures from noisy inputs and has been adapted here to provide supervision during test-time optimization, leading to more accurate scene geometry. We introduce a new class of 3D losses that do not rely on rendering and can be combined with essentially all losses previously reported in the literature. Our 3D losses are especially effective when the input views are sparse and geometric regularization is essential due to limited supervision from the images. Our method is easy to integrate with a diverse set of backbones, and our experiments on the DTU and Tanks-and-Temples datasets demonstrate that TV-SGS improves the geometry of the outputs compared to the backbone, while maintaining or improving rendering quality.

[182] Harnessing CLIP and DINO: An Uncertainty-Aware Cascaded Fusion Network for Generalizable Deepfake Image Detection cs.CV | cs.AIPDF

Xuechao Zou, Yi Zhou, Kai Li, Shun Zhang, Yuhui Chen

TL;DR: 本文提出了一种名为UCF-Net的不确定性感知级联融合网络，用于提升深度伪造图像检测的泛化能力。该方法通过融合CLIP的语言对齐语义先验和DINO的自监督视觉结构先验，并利用基于熵的不确定性进行加权融合，以应对未见过的伪造数据。

Details

Motivation: 当前基于视觉基础模型的深度伪造检测器通常依赖单一预训练表示，容易对特定训练分布过拟合，难以泛化到未见过的伪造方法。本文旨在通过融合多种预训练模型的优势来提升检测器的泛化性能。

Result: 在整合了约400万张图像的公共深度伪造数据集统一基准测试中，UCF-Net在域内和跨域评估中都取得了最佳的平均AUC。在包含8个最新生成器的超过8000张人脸图像的跨生成器评估集上，该方法在有限目标域数据下能有效适应，但零样本迁移仍具挑战。

Insight: 创新点在于提出了一种不确定性感知的级联融合框架，有效结合了CLIP和DINO的互补先验知识，并通过分层特征提取、专家级聚合和基于不确定性的加权融合来提升泛化能力。从客观角度看，该方法为多模型融合和不确定性建模在检测任务中的应用提供了新思路。

Abstract: The growing realism and accessibility of manipulated and generated faces threaten the trustworthiness of digital media. To detect such forgeries, deepfake detectors based on vision foundation models have shown promising performance, but they typically rely on a single pretrained representation and are prone to overfitting to particular training distributions. To improve generalization to unseen forgeries, we propose UCF-Net, an uncertainty-aware cascaded fusion network that harnesses CLIP’s language-aligned semantic priors and DINO’s self-supervised visual-structure priors. UCF-Net extracts hierarchical features across Transformer depths, uses layer-wise expert aggregation to adaptively combine each encoder’s multi-level cues, and performs weighted fusion of the resulting representations based on entropy-derived uncertainty. We further consolidate public deepfake datasets into a unified benchmark of approximately 4M images and construct a separate cross-generator evaluation set with over 8K face images from eight recent generators. On the unified benchmark, UCF-Net achieves the best mean AUC among the evaluated methods in both in-domain and cross-domain evaluations. On the cross-generator set, it adapts effectively with limited target-domain data, although zero-shot transfer remains challenging.

[183] TFTrack: A Template-Free Framework for Efficient 3D Point Cloud Tracking cs.CV | cs.AIPDF

Zhaofeng Hu, Sifan Zhou, Jiahao Nie, Ziyu Zhao, Weizi Li

TL;DR: 本文提出了一种名为TFTrack的无模板3D单目标跟踪框架，旨在解决现有基于Siamese范式的3D点云跟踪方法因依赖模板-搜索对和复杂运动建模而导致效率低下的问题。该框架仅利用上一帧的边界框中心和尺寸作为先验，直接在当前帧中进行目标定位，并探索了体素、柱体和点三种不同的3D表示变体。

Details

Motivation: 现有基于激光雷达的3D单目标跟踪方法源自2D视觉的Siamese跟踪范式，依赖于计算成本高的双输入设计和由模板先验引导的过度运动建模，这阻碍了其效率。本文旨在通过分析揭示模板范式的冗余性和复杂运动建模的不必要性，从而构建一个更高效的跟踪框架。

Result: 在KITTI和nuScenes基准测试上的大量实验表明，TFTrack与领先的基于模板的跟踪器性能相当，同时将浮点运算量减少了约50%，并以约120 FPS的速度运行。

Insight: 核心创新在于提出了首个无模板的3D点云跟踪框架，通过论证历史边界框中心已编码足够的历史上下文，以及几何对齐能提供足够的运动先验，从而简化了过度复杂的以运动为中心的设计，为嵌入式机器人系统（如自动驾驶汽车）的实时高效部署建立了新的极简主义范式。

Abstract: LiDAR-based 3D Single Object Tracking (3D SOT) is critical for robotic perception and navigation and aims to localize dynamic objects across frames in sparse point clouds. Existing methods, rooted in the Siamese tracking paradigm from 2D vision, rely on costly dual-input designs and excessive motion modeling guided by template priors, hindering their efficiency. Our in-depth analysis reveals: (i) the template paradigm is redundant, as the previous bounding box center encodes sufficient historical context; (ii) complex motion modeling is unnecessary, as geometric alignment provides adequate motion priors. Based on the above findings, we propose the first Template-Free Tracking framework (TFTrack). The novel framework eliminates the need for template-search pairings and operates directly on the current frame guided solely by the prior bounding box center and size. We instantiate this paradigm into three variants: TFTrack-Voxel, TFTrack-Pillar, and TFTrack-Point, to explore different 3D representations under a unified framework, ensuring flexibility across sparse and dense scenes. Extensive experiments on KITTI and nuScenes benchmarks show that TFTrack is competitive with leading template-based trackers, while reducing FLOPs by approximately 50% and running at approximately 120 FPS. By simplifying overcomplicated motion-centric designs, TFTrack establishes a new minimalist paradigm for efficient 3D point cloud tracking, paving the way for real-time and resource-efficient deployment in embedded robotic systems, such as autonomous vehicles. The code is available at https://github.com/tftrack-anonymous/TFTrack/tree/main.

Lucas Hirsch, James R. Hopgood, Javid Khan, Yoann Altmann, Mike E. Davies

TL;DR: 本文提出了一种跨模态学习框架，利用光学视觉基础模型为SAR图像目标识别提供类别级监督。该方法基于DINOv3构建光学类别原型，训练SAR模型时将其嵌入与对应光学原型对齐，在推理时SAR模型可独立运行。在UNICORNv2数据集上的实验表明，该方法能有效提升SAR分类精度。

Details

Motivation: 解决SAR目标识别中标注数据有限、斑点噪声严重以及与光学图像存在显著域差距的问题，同时利用光学领域大规模数据集和强大基础模型的优势。

Result: 在UNICORNv2数据集（包含严重斑点噪声和类别不平衡的民用车辆EO/SAR数据集）上，EO原型对齐方法在SAR分类准确率上优于冻结DINOv3、仅SAR微调和未配对分布对齐基线，t-SNE可视化显示训练后的SAR嵌入空间具有更清晰的类别分离。

Insight: 创新点在于提出无需严格配对EO/SAR数据的跨模态原型对齐框架，证明光学视觉基础模型（尽管在可见光谱图像上训练）能为SAR图像分类提供可迁移信息，为跨挑战性传感模态利用大规模预训练视觉基础模型提供了实用方法。

Abstract: Synthetic Aperture Radar (SAR) is an important modality in a wide range of imaging applications due to its versatile, long range and near all weather operating capabilities. However, Automatic Target Recognition (ATR) remains a challenging problem due to limited labelled data, the strong speckle in SAR images and the significant domain gap between SAR and more abundant optical imagery. In contrast, electro-optical (EO) imagery benefits from massive datasets, clearer visual structure and powerful foundation models. In this work, we investigate how vision foundation models trained on optical data can provide class level supervision for SAR classification. We propose a cross-modal EO to SAR prototype alignment framework in which a frozen EO encoder, based on a DINOv3 vision foundation model, is used to construct class level optical prototypes without requiring strict EO/SAR pairs. A SAR model is then trained to classify SAR images while aligning its embeddings to the corresponding EO class prototype. At inference time, the SAR model operates independently, without access to optical imagery. We evaluate our approach on the UNICORNv2 dataset, an EO and SAR dataset of civilian vehicles with heavily speckled images and severe class imbalance. EO prototype alignment improves SAR classification accuracy over frozen DINOv3, SAR only finetuning and unpaired distribution alignment baselines, and t-SNE visualizations provide qualitative evidence of clearer separation among classes in the trained SAR embedding space. These results suggest that optical vision foundation models, despite being trained on visible spectrum imagery, provide transferable information for SAR image classification, offering a practical method for using large scale pretrained vision foundation models across challenging sensing modalities.

[185] DroneGround: Open-Vocabulary Drone Payload Characterization Using Synthetic Data and Grounded Vision-Language Models cs.CVPDF

Ami Pandat, Rajasekhar Punna, Gopika Vinod, Rohit Shukla

TL;DR: 该论文提出了一种名为DroneGround的两阶段框架，用于实现开放词汇的无人机有效载荷识别。该方法首先使用YOLO26s检测器定位无人机并提取图像区域，然后利用LoRA微调的PaliGemma视觉语言模型生成无人机及其有效载荷的语义描述，并通过一个基于遮挡的定位模块提供可解释的定位。

Details

Motivation: 解决在远距离成像条件下，由于标注真实数据稀缺和部署时存在显著分布偏移，导致现有封闭集目标检测方法难以可靠识别无人机有效载荷，且无法泛化到未见类别的问题。

Result: 在合成和真实无人机图像上的大量实验表明，DroneGround显著提升了合成到真实数据分布偏移下的鲁棒性，将F1分数从传统封闭集检测器的82.5%提升至96.3%，并且在泛化到未见有效载荷类别上表现更优（F1分数80.4% vs 42.7%）。

Insight: 创新点在于将有效载荷识别构建为开放词汇问题，并利用合成数据训练和基于视觉语言模型的语义描述生成来解决数据稀缺和泛化问题；同时，引入基于遮挡的定位模块增强了模型的可解释性。

Abstract: Automated drone surveillance has become increasingly important for public safety, critical infrastructure protection,and restricted airspace monitoring. While existing vision-based systems achieve strong performance for drone detection and tracking, reliable payload characterization remains highly challenging under long-range imaging conditions due to limited availability of annotated real-world datasets, and substantial distribution shifts encountered during deployment. Existing approaches formulate payload characterization as a closed-set object detection problem, limiting their ability to recognize previously unseen payloads and generalize beyond the training distribution. To address these challenges, we generate a photorealistic synthetic drone-payload dataset using Unreal Engine 5 and Cosys-AirSim and propose DroneGround: Grounded Vision-Language Payload Characterization, a two-stage framework for robust open-vocabulary payload analysis. DroneGround first employs a YOLO26s detector to localize drones and extract drone-centric image crops, followed by a LoRA-fine-tuned PaliGemma vision-language model that generates seman- tic descriptions of the detected drones and their attached payloads, enabling open-vocabulary payload characterization beyond predefined categories. An occlusion-based grounding module further provides interpretable payload localization by identifying image regions responsible for the generated descriptions. Extensive experiments on both synthetic and real-world drone imagery demonstrate that DroneGround substantially improves robustness under synthetic-to-real distribution shifts, outperforming a conventional closed-set payload detector by improving the F1-score from 82.5% to 96.3%, while achieving significantly better generalization to previously unseen payload categories (80.4%versus 42.7% F1). Dataset and code will be released upon acceptance of the paper.

[186] VoT: Vision-of-Thought for Unified Multimodal Representation Alignment cs.CV | cs.AI | cs.CLPDF

Jingxiang Sun, Chao Liao, Zhengxiong Luo, Chaorui Deng, Chen-lin Zhang

TL;DR: 本文提出Vision-of-Thought (VoT)框架，在视觉语言模型（VLM）和扩散变换器（DiT）之间引入一个离散的视觉思维层，以生成代表高级视觉计划（如物体和布局）的VoT令牌，从而在文本到图像生成中建立显式、可解释的中间表示。

Details

Motivation: 当前文本到图像系统通常采用’文本编码器加扩散解码器’范式，缺乏一个能有效桥接高级语言语义和低级视觉信号的显式、可解释的中间表示。

Result: 实验结果表明，VoT提高了语义对齐性，并为可解释和可控的生成提供了一个结构化接口。

Insight: 创新点在于将VLM用作多模态规划器来生成离散的VoT令牌，而非仅作为文本编码器，并通过结合VLM对齐、特征重建和向量量化损失的闭环目标训练专门的VoT分词器，使令牌在语义上可读且保留生成所需的视觉信息。

Abstract: Current text-to-image systems typically employ a “text encoder plus diffusion decoder” paradigm, in which text semantics directly modulate continuous latent noise. Despite their success, these methods lack an explicit, interpretable intermediate representation that effectively bridges high-level linguistic semantics and low-level visual signals. In this paper, we propose Vision-of-Thought (VoT), a framework that introduces a discrete visual-thinking layer between vision-language models (VLMs) and diffusion transformers (DiTs). Instead of treating VLMs merely as text encoders, we use them as multimodal planners that generate discrete VoT tokens representing high-level visual plans, such as objects and layouts, before rendering pixels. We train a specialized VoT tokenizer in the VLM semantic space with a closed-loop objective that combines VLM alignment, feature reconstruction, and vector-quantization losses. These objectives make the tokens semantically readable by the VLM while preserving the visual information needed for generation. Experimental results demonstrate that VoT improves semantic alignment and provides a structured interface for interpretable and controllable generation.

[187] SAFIRE: Safety-Critical Benchmark for Fine-grained Fire and Smoke Understanding in Multimodal LLMs cs.CV | cs.AI | cs.CLPDF

Pengfei Li, Naufal Suryanto, Sicheng Zhang, Mohammad Alsharid, Muzammal Naseer

TL;DR: 该论文提出了一个名为SAFIRE的大规模基准测试，用于评估多模态大语言模型在火灾烟雾理解方面的能力。该基准包含来自20个场景的8.3万张带标注图像，以及基于9.7千张图像生成的19.3万个多项选择视觉问答，涵盖从基础感知到高阶推理的10个评估维度。评估发现现有模型在安全关键推理方面存在重大差距，但使用少量领域特定数据进行适配能显著提升性能。

Details

Motivation: 多模态大语言模型在视觉语言任务上进展显著，但其在安全关键场景下的可靠性尚未得到充分探索。火灾烟雾理解对公共安全和灾害响应至关重要，而现有基准缺乏多样化的真实场景和上下文感知评估。

Result: 评估十个开源MLLM（8B-38B参数）的平均准确率为61.9%，揭示了在安全关键推理方面的主要差距。实验进一步表明，仅使用7%的领域特定数据适配视觉编码器，就能将火灾场景分类准确率从20.1%提升至64.5%。

Insight: 论文的创新点在于构建了一个大规模、多场景、多维度评估的安全关键基准，并采用GPT辅助的多阶段验证流程确保标注质量。客观来看，其核心洞察在于，即使数据量有限，精心策划的领域特定数据也能带来性能的实质性提升，这为提升MLLM在专业领域的可靠性提供了有效路径。

Abstract: Multimodal Large Language Models (MLLMs) show strong progress on vision-language tasks, yet their reliability in safety-critical settings remains underexplored. Fire-smoke understanding is central to public safety and disaster response, but most existing benchmarks lack diverse real-world scenarios and context-aware evaluation. We introduce SAFIRE, a large-scale benchmark for fire-smoke understanding in MLLMs, comprising 83K captioned images from 20 scenarios and 193K multiple-choice VQA (MCVQA) generated from a 9.7K-image subset, spanning 10 evaluation dimensions from basic perception to higher-order reasoning. A GPT-5.4-assisted multi-stage verification pipeline with MLLM majority voting ensures annotation quality. Evaluating ten open-source MLLMs (8B-38B) yields an average accuracy of 61.9%, exposing major gaps in safety-critical reasoning. We further show that adapting vision encoders with only 7% of our domain-specific data boosts fire-scene classification accuracy from 20.1% to 64.5%, indicating that carefully curated data can yield substantial gains even when data volume is limited. All datasets, models, and code are available at https://risys-lab.github.io/SAFIRE/.

[188] Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluation cs.CVPDF

Shangzhe Di, Zhaokai Wang, Weidi Xie

TL;DR: 本文提出了ProbeGen基准，用于评估图像生成器在零样本视觉感知任务（如深度估计、指代分割和物体计数）上的能力，并比较了20个模型在11个公开基准上的表现。研究发现，预训练图像生成器具备可测量的零样本感知能力，但在准确性和效率上仍不及专用模型，而在分布偏移和组合语义推理方面更具鲁棒性。

Details

Motivation: 受Vision Banana等工作的启发，本文旨在探究图像生成器在零样本设置下，在公开视觉感知基准上能达到何种程度，以评估其作为通用感知器的潜力。

Result: 在11个公开基准上测试了20个模型（包括专有和开源图像生成器、专用感知模型及MLLMs），结果显示专用模型在分布内准确性和效率上更强，而生成模型在分布偏移下更鲁棒且组合语义推理能力更好。

Insight: 创新点在于将视觉感知任务重新定义为条件生成任务，并通过系统基准评估揭示了生成模型与专用模型在感知任务上的权衡（准确性vs.鲁棒性），为零样本生成式感知这一新研究方向奠定了基础。

Abstract: Recent work, such as Vision Banana, shows that lightweight instruction tuning can enable an image generator to achieve state-of-the-art performance across multiple visual perception tasks. Motivated by this perspective, we ask how far image generators can go on public visual perception benchmarks in a zero-shot setting. We introduce ProbeGen, a benchmark for zero-shot generative perception that casts monocular depth estimation, referring/reasoning segmentation, and object counting as conditional generation tasks specified through text prompts, and compares 20 models in total—including proprietary and open-weight image generators, specialist perception models, and MLLMs—across 11 published benchmarks. We observe that pretrained image generators show measurable zero-shot perceptual competence, but with a clear trade-off: specialist models remain stronger for in-distribution accuracy and efficiency, while generative models are often more robust under distribution shift and better at compositional semantic reasoning. We hope this study helps establish zero-shot generative perception as a meaningful research direction and provides a useful foundation for future work at the intersection of visual generation and understanding.

[189] JEDI: JEPA-to-Edge Distillation for Efficient Cropland Segmentation from Satellite Imagery cs.CV | cs.LGPDF

Kishor Kumar Bhaumik, Nicolas Roque dos Santos, Jia Chen, Evangelos E. Papalexakis

TL;DR: 本文提出了JEDI（JEPA-to-Edge Distillation）框架，用于将大型视觉模型（I-JEPA ViT教师模型）的知识蒸馏到紧凑的SegFormer学生模型中，以实现高效的卫星图像农田分割。该方法通过两阶段训练，包括跨架构表示对齐和持续的特征对齐，在显著压缩模型规模的同时保持了分割性能。

Details

Motivation: 大型视觉模型为遥感分割提供了有用的表示，但其计算成本过高，难以部署在卫星或边缘设备上。现有的特征级蒸馏方法通常假设师生架构相似，并且在任务训练开始时停止特征对齐，这限制了在激进压缩下的性能。

Result: 在CalCROP21数据集上，JEDI-B0模型以4.04M参数取得了68.0的mIoU，比独立学生模型提升了16.0个点，并且接近639M参数教师模型70.0 mIoU的性能（差距仅2.0个点）。在SegFormer B0、B1、B2三个变体上，JEDI均优于响应、结构、通道和关系蒸馏等基线方法。

Insight: 核心创新在于提出了一个两阶段蒸馏框架，通过跨架构投影和空间对齐来弥合师生模型表示空间的差异，并在整个任务适应阶段持续进行特征对齐。这表明在激进的模型压缩场景下，持续的表示对齐对于保持性能至关重要。

Abstract: Large vision models provide useful representations for remote-sensing segmentation but are often too expensive for deployment at the satellite or field edge. Existing feature-level distillation methods also tend to assume similar teacher and student architectures and often stop feature alignment when task training begins. We introduce JEDI (JEPA-to-Edge Distillation), a two-stage framework that transfers representations from a large I-JEPA Vision Transformer teacher to a compact SegFormer student. First, JEDI aligns the student’s terminal representation with the teacher’s token space using cross-architecture projection and spatial alignment. It then jointly optimizes supervised segmentation, temperature-scaled response distillation, and persistent feature alignment throughout task adaptation. On CalCROP21, JEDI-B0 achieves 68.0 mean Intersection-over-Union (mIoU) with 4.04M parameters, improving over the standalone student by 16.0 points and coming within 2.0 points of the 70.0 mIoU achieved by the 639M-parameter teacher. We evaluate SegFormer B0, B1, and B2 students with 4.04M, 14.33M, and 28M parameters, respectively. Across all three variants, JEDI consistently outperforms response-, structure-, channel-, and relational-distillation baselines under the same teacher-student setting. These results show that persistent representation alignment is especially valuable under aggressive compression, substantially reducing model size and computation while preserving segmentation performance.

[190] TDDN: Text-aligned Diffused DINO Network for Puzzle Understanding cs.CV | cs.AIPDF

Harsha Patnala, Debopriyo Banerjee, Ayush Sunil Munot, Somak Aditya

TL;DR: 本文提出TDDN模型，通过融合DINOv3和CleanDIFT特征构建感知编码器，并与文本编码器对齐，以解决现有视觉语言模型在细粒度视觉感知上的不足。该模型在图像-文本检索任务上与CLIP相当，并在密集预测任务上显著超越CLIP，同时在提出的Puzzle Perception基准测试中表现出色。

Details

Motivation: 现有基于CLIP的视觉语言模型为获取高层语义而牺牲了细粒度视觉细节，导致其在需要精细空间理解的视觉推理任务（如图像谜题）上表现不佳。

Result: 在图像-文本检索任务上，TDDN与CLIP性能相当（在四个设置中的三个超越CLIP）。在密集预测任务上，TDDN显著超越CLIP（ADE20K mIoU从5.20提升至18.11，COCO-Stuff从7.35提升至24.44）。在提出的Puzzle Perception数据集上，其分割精度是CLIP的两倍（mIoU从11.04提升至22.51），在通用对比编码器中达到领先水平。

Insight: 核心创新点在于将DINOv3的细粒度感知能力与文本对齐目标相结合，通过轻量级对齐训练（仅约59万对齐对）保留了感知优势。这为构建兼具强语义理解和精细空间感知能力的视觉基础模型提供了新思路。

Abstract: Structured visual reasoning, such as image puzzles, demands fine-grained visual perception, an ability current Vision Language Models (VLMs) lack. VLMs built on CLIP-based ViT backbones trade fine-grained detail for high-level semantics, and we show this loss propagates downstream. To recover it, we fuse DINOv3 and CleanDIFT representations into a perception encoder (DiffusedDINO) and align it with RoBERTa-L, yielding a text-aligned model TDDN that preserves this perceptual advantage: with frozen backbones and only $\sim$590K alignment pairs, TDDN matches CLIP on image-text retrieval, surpassing it on three of four settings. It does so while more than tripling CLIP’s dense-prediction accuracy (ADE20K 5.20 $\to$ 18.11 mIoU, COCO-Stuff 7.35 $\to$ 24.44), despite CLIP’s massive training corpus. TDDN leads on segmentation benchmarks among general-purpose contrastive encoders, including SigLIP$,$2. We further introduce Puzzle Perception, a segmentation and visual question answering dataset that probes fine-grained spatial understanding, on which TDDN doubles CLIP’s segmentation accuracy (11.04 $\to$ 22.51 mIoU).

[191] Flexible Motion Generation from Language and Style References cs.CV | cs.GR | cs.LGPDF

Kai Weixian Lan, Bodie Criswell, Briana Fedkiw, Zhan Zhang, Joseph Teran

TL;DR: 本文提出FlexMoGen框架，通过结合自然语言描述和运动风格参考来灵活生成人体运动。文本提示定义语义内容，风格示例补充细节，模型能生成高质量运动，在保持语义的同时反映目标风格，支持长序列和多风格合成。

Details

Motivation: 现有方法依赖离散风格标签，无法捕捉细粒度风格细节（如时序、关节动作），且难以泛化到长序列或多风格生成，需要更灵活的控制机制。

Result: 实验表明FlexMoGen在内容保真度和风格反映上达到最佳平衡，在未见过的文本-风格组合上表现出强泛化能力。

Insight: 创新点包括无监督变分风格编码器、轻量适配模块调制风格、统一架构联合预训练，以及高效相对位置编码，支持时变多风格合成。

Abstract: We introduce FlexMoGen, a novel framework for flexible human motion synthesis conditioned on both natural language descriptions and motion style references. Text prompts are effective at defining semantic content, but they are often limited in capturing fine-grained style details such as timing, limb articulation, and expressive dynamics. A style example clip supplements the text by conveying these nuanced motion characteristics directly, enabling the model to preserve high-level intent while reproducing the desired stylistic traits. Given a text prompt and a style example clip, FlexMoGen generates high-quality motions that preserve semantic content while faithfully reflecting the target style, offering users greater control over the animation generation process. Unlike prior methods that rely on discrete style labels and do not generalize to long or multi-style generation, FlexMoGen learns a variational style encoder without style supervision and supports long, time-varying, multi-style synthesis. Our framework jointly pre-trains the style encoder and a text-to-motion latent diffusion model within a unified architecture, modulating motion style through a lightweight adaptation module. It integrates an efficient relative positional encoding scheme and is trained on both stylized and non-stylized datasets, enabling strong generalization to unseen text-style combinations. Experiments show that FlexMoGen achieves the best balance between content fidelity and style reflection.

[192] ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding cs.CVPDF

Chia-Hui Chen, Shih-Ying Yeh, Fu-En Yang, Min-Hung Chen, Shang-Hong Lai

TL;DR: 本文提出了ReactVAU，一个用于实时流式视频异常理解（VAU）的慢-快解耦框架。该框架旨在解决现有VAU方法无法满足因果性、无法部署于实时监控流的问题，通过轻量级快速检测模块、异常感知持久记忆和仅在可疑事件时激活的重型慢速推理模块，在严格流式约束下实现高效的异常检测与因果推理。

Details

Motivation: 现有视频异常理解方法依赖离线推理和全局时序采样，违背因果性，无法应用于实时监控流；而通用流式视频模型虽满足因果访问，但会在内存压缩过程中稀释罕见的瞬态异常，并常在长时间正常区间内统一调用重型多模态大模型，效率低下。

Result: 在多个基准测试上的广泛实验表明，ReactVAU在严格流式约束下运行，同时在异常检测和因果推理方面取得了有竞争力的性能，并通过最小化重型MLLM调用显著提升了计算效率。

Insight: 创新点在于提出了慢-快解耦的流式处理框架，其核心是：基于空间网格折叠的轻量级快速连续异常过滤、保护关键视觉线索免受时间衰减的异常感知持久记忆，以及仅在可疑事件时被唤醒进行语义验证和因果描述的重型慢速推理模块。这种按需激活重型模型的设计是提升流式系统效率的关键。

Abstract: In this paper, we propose ReactVAU, a Slow-Fast Decoupled Framework for real-time streaming Video Anomaly Understanding (VAU). Existing VAU methods rely on offline inference with global temporal sampling, which violates causality and prevents deployment in live surveillance streams. Conversely, general streaming video models satisfy causal access but dilute rare transient anomalies during memory compression and often invoke heavyweight MLLMs uniformly over long normal intervals. React VAU addresses this gap with three synergistic components: a lightweight Fast Detection Module based on Spatial Grid Folding (SGF) for continuous anomaly filtering; an Anomaly-Aware Persistent Memory (AAPM) that protects critical visual cues from temporal decay; and a heavyweight Slow Reasoning Module that remains dormant during normal streams and is awakened only by suspicious events for semantic verification and causal description. Extensive experiments on multiple benchmarks demonstrate that ReactVAU operates under strict streaming constraints while simultaneously achieving competitive performance in both anomaly detection and causal reasoning, alongside significantly enhanced computational efficiency by minimizing heavyweight MLLM invocations. Project page is available at https://huiyuiui.github.io/React_VAU/

[193] A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models cs.CVPDF

Kacper Mroczek, Michal Kepski

TL;DR: 本文提出了一种针对人体姿态估计和基于关键点动作识别模型的黑盒对抗攻击方法，称为OKS攻击。该方法使用目标关键点相似度作为攻击反馈信号，直接针对人体姿态的空间结构而非其外接框，在Penn Action数据集上有效降低了姿态估计质量，并显著削弱了下游动作识别任务的性能。

Details

Motivation: 人体姿态估计和基于关键点的动作识别模型正越来越多地被部署为视频理解流程的组成部分，但其对抗攻击的脆弱性尚未得到充分研究。现有的时序相干黑盒攻击（如用于视觉目标跟踪的攻击）使用边界框重叠度量（如IoU）作为反馈，这不适用于衡量由关键点配置构成的人体姿态的退化。

Result: 在Penn Action数据集上的实验表明，OKS攻击能持续降低被评估姿态估计器的姿态质量，平均OKS下降范围在0.0802到0.1494之间。在下游的跨数据集动作识别评估中，攻击使准确率降低了6.18到13.86个百分点，并且优于查询匹配的随机噪声扰动。该攻击对自上而下和单阶段姿态估计模型均有效。

Insight: 论文的核心创新点在于将姿态估计领域常用的评估指标——目标关键点相似度直接用作黑盒对抗攻击的反馈信号，从而实现了对姿态空间结构的针对性攻击，而非依赖不合适的边界框度量。这为评估和理解姿态相关模型的鲁棒性提供了一个新的攻击范式和基准。

Abstract: Human pose estimation and keypoint-based action recognition models are increasingly deployed as components of video understanding pipelines, yet their vulnerability to adversarial attacks remains insufficiently studied. Temporally coherent black-box attacks have been previously studied in visual object tracking, where the attack feedback can be defined using bounding-box overlap measures such as Intersection over Union (IoU). However, human pose estimation produces keypoint configurations rather than enclosing boxes, making box-level similarity poorly suited for measuring pose degradation. We propose OKS Attack, a decision-based black-box attack that uses Object Keypoint Similarity (OKS) as the attack feedback signal, directly targeting the spatial structure of human poses rather than their enclosing boxes. Experiments on the Penn Action dataset show that OKS Attack consistently reduces pose quality across evaluated pose estimators, with mean OKS decreases ranging from 0.0802 to 0.1494. In a downstream cross-dataset action-recognition evaluation, the attack reduces accuracy by 6.18 to 13.86 percentage points and outperforms query-matched random-noise perturbations. The attack is effective across both top-down and single-stage pose estimation models. The source code will be made publicly available at https://github.com/KacperM33/OKS_attack

[194] SAFER-Activities: A Dataset for Smart Assessment of Fall Events and Routine Activities cs.CV | cs.AIPDF

Diwas Lamsal, Pramod Wickramatilake, Jednipat Moonrinta, Mongkol Ekpanyapong, Matthew N. Dailey

TL;DR: 该论文提出了一个名为SAFER-Activities的新数据集，专门用于跌倒检测和日常活动监控，特别包含轮椅使用场景。该数据集包含超过66小时的多摄像头视频、85,310个动作实例以及30个动作类别的帧级标注。作者在多种测试集上对2D/3D骨架模型、RGB模型和多模态融合策略进行了基准测试，发现骨架模型在领域偏移下泛化能力最好，而融合RGB特征能提升域内识别性能。

Details

Motivation: 现有动作识别数据集多为片段式，缺乏在线识别所需的帧级细节，难以满足智能医疗监控系统对精确动作识别（尤其是跌倒等关键事件）的实时需求。

Result: 在实验室内部、分布外和跨数据集测试集上的评估表明，基于骨架的模型在领域偏移下泛化性能最佳；将冻结的RGB特征与骨架流融合能提升域内识别性能（在轮椅子集上效果最明显），但会降低分布外性能。跨数据集和定性评估证实，在SAFER-Activities上训练的模型能很好地迁移到未见环境和外部跌倒数据。

Insight: 创新点在于发布了首个专注于跌倒检测和日常活动监控、包含轮椅场景且提供帧级标注的大规模视频数据集。客观分析表明，该工作强调了骨架模态在动作识别任务中对于领域泛化的重要性，并为多模态融合策略在特定场景（如轮椅使用）下的有效性提供了实证依据。

Abstract: Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as falls, particularly for mobility-challenged individuals. Existing datasets are often clip-based, lacking the frame-level detail needed to recognize actions online, as they unfold. To address this, we introduce SAFER-Activities, a dataset for fall detection and physical activity monitoring, with a dedicated subset for wheelchair use scenarios. It comprises over 66 hours of video data captured by multiple cameras, with 85,310 action instances and frame-level annotations for 30 action classes. We benchmark action recognition on SAFER-Activities with 2D and 3D skeleton models, RGB models with frozen backbones, and multimodal fusion strategies, and evaluate on in-lab, out-of-distribution, and cross-dataset test sets. Skeleton-based models generalize best under domain shift; fusing frozen RGB features with the skeleton stream improves in-domain recognition over the baseline CNN1D, most clearly on the wheelchair subset, but degrades out of distribution. Cross-dataset and qualitative evaluations confirm that models trained on SAFER-Activities transfer well to unseen environments and external fall data. To support research on robust fall detection and activity monitoring, we release the dataset and code at https://safer-activities.github.io/.

[195] MamMA: A Mamba-Based Pedestrian Trajectory Prediction Algorithm Considering Occupancy Map and Pedestrian Awareness States cs.CV | cs.LGPDF

Juncen Long, Xiaofeng Jin, Gianluca Bardaro, Simone Mentasti, Matteo Matteucci

TL;DR: 本文提出了一种名为MamMA的行人轨迹预测算法，该算法基于Mamba架构，并考虑了占用地图和行人意识状态。算法通过将占用地图分块提取障碍物特征，并区分行人的意识状态（如注意力水平）来提升预测精度。在多个公开数据集上的实验表明，MamMA在平均位移误差和最终位移误差指标上优于现有先进方法。

Details

Motivation: 现有行人轨迹预测算法常使用俯视图图像提取障碍物信息，但移动机器人通常使用LiDAR生成局部占用地图，且搭载的视觉传感器提供以自我为中心的视角图像，包含更细粒度的行人行为信息。为了更有效地利用LiDAR和车载视觉传感器收集的信息，需要一种能融合占用地图和行人意识状态的预测方法。

Result: 在STCrowd、SiT、JRDB、ETH和UCY数据集上的实验结果显示，MamMA在平均位移误差（ADE）和最终位移误差（FDE）指标上均优于当前最先进的算法（SOTA）。

Insight: 创新点在于将占用地图分块处理以提取障碍物特征，并引入行人意识状态作为影响感知和速度的因素；同时，首次将Mamba架构应用于行人轨迹预测任务，有效融合了多模态传感器信息，提升了在复杂人机共存环境中的预测性能。

Abstract: Many pedestrian trajectory prediction algorithms have been proposed to improve the safety of navigation for mobile robots working in human-robot coexistence environments. Some pedestrian trajectory prediction algorithms extract information about obstacles near pedestrians from top-down view images to improve the accuracy of trajectory prediction. However, mobile robots typically create local occupancy maps using LiDAR, rather than top-down view images. Meanwhile, the vision sensors on board robots provide egocentric view images, which contain fine-grained behavioral information about the pedestrians near the robot. To better use the information collected by LiDAR and on-board vision sensors, we propose MamMA, a Mamba-based pedestrian trajectory prediction algorithm considering occupancy maps and pedestrian awareness states. MamMA divides the occupancy map by patches and extracts obstacle features from each patch to create map features. Pedestrian awareness states are divided and considered, as some studies show that awareness states affect the perception and speed of pedestrians. Furthermore, a Mamba-based model is proposed to predict the future trajectories of pedestrians based on different types of features. Experiments on the STCrowd, SiT, JRDB, ETH, and UCY datasets show that MamMA achieves better average displacement error and final displacement error than the state-of-the-art algorithms.

[196] A Quantitative Evaluation Framework for Temporal Explainability in Echocardiographic Video Segmentation cs.CV | cs.LGPDF

Jiyoo Noh, Jonathan H. Chan

TL;DR: 本文提出了一种用于超声心动图视频分割中时序可解释性的定量评估框架，通过四个互补指标（时序一致性、显著性运动、解剖重叠和时序重叠）来评估Grad-CAM解释。在EchoNet-Dynamic数据集上，比较了2D U-Net与不同时间步长的ConvLSTM U-Net模型，发现中间层解释的显著性一致性较低且质心运动较大，而时序瓶颈解释比编码器瓶颈解释更稳定。

Details

Motivation: 深度学习在超声心动图视频分割中已达到SOTA性能，但时序可解释性的定量评估仍未被充分探索，需要一种框架来量化解释的时序特性。

Result: 在EchoNet-Dynamic数据集上，所有模型的分割性能相当，但中间ConvLSTM解释的显著性一致性显著低于最终预测解释，且质心运动更大；时序瓶颈解释在所有步长下都比编码器瓶颈解释更稳定，最终ConvLSTM解码器解释与2D U-Net相当。

Insight: 创新点在于提出了首个针对医学视频模型时序可解释性的定量评估框架，揭示了传统逐帧解释指标无法区分中间解释变化是源于有意义的时序特征演化还是解释不稳定性，从而推动了显式考虑演化表示的时序感知XAI方法的发展。

Abstract: Deep learning has achieved state-of-the-art performance in echocardiographic video segmentation, with an increasing number of models incorporating temporal information. However, quantitative evaluation of temporal explainability remains largely unexplored. We propose a quantitative framework for evaluating Grad-CAM explanations using four complementary metrics measuring temporal consistency, saliency motion, anatomical overlap, and temporal overlap. Using EchoNet-Dynamic, we compare a baseline 2D U-Net with ConvLSTM U-Net models trained across multiple temporal strides. While segmentation performance remained comparable across all models, intermediate ConvLSTM explanations exhibited substantially lower saliency consistency and greater centroid motion than final prediction explanations. Temporal Bottleneck explanations were significantly more stable than Encoder Bottleneck explanations across all strides, while final ConvLSTM Decoder3 explanations were broadly comparable to those of the 2D U-Net. Importantly, conventional frame-wise explanation metrics cannot determine whether variation in intermediate explanations reflects meaningful temporal feature evolution or explanation instability. These findings establish a preliminary quantitative framework for temporal explainability and motivate temporal-aware XAI methods that explicitly account for evolving representations in medical video models.

[197] VI-Bench: Benchmarking Prompt Inversion from AIGC Videos cs.CVPDF

Wulin Xie, Rui Zhao, Kecen Li, Xiujin Liu, Bokang Zhang

TL;DR: 本文提出了VI-Bench，一个用于评估从AIGC视频中逆向恢复生成提示（prompt inversion）能力的基准测试。该基准基于1610万个真实用户提示和900个人工验证的AIGC视频构建，包含从简单到复杂的三个任务层级，并评估五个关键维度。研究评估了18个视觉语言模型，发现现有模型在此任务上能力有限，揭示了视频提示逆向是一个独特且未被充分评估的能力。

Details

Motivation: 现有的视频理解基准主要关注描述视频内容，但无法评估模型从生成的AIGC视频中逆向恢复出用于生成该视频的、可复现的控制提示（prompt）的能力。这种能力对于创意重用、编辑以及评估提示泄露风险至关重要，但目前缺乏专门的评测标准。

Result: 在VI-Bench上评估了18个代表性VLM（包括2个专有模型和16个开源模型），使用衡量提示对齐度和视频保真度的Inversion Score。结果显示，即使最强的模型得分也仅为0.632；随着任务对控制丰富度和多镜头推理的要求提高，模型性能急剧下降；模型常生成看似合理的提示，但其重新生成的视频与参考视频存在偏差。

Insight: 论文的创新点在于首次构建了一个专门用于评测视频提示逆向能力的基准（VI-Bench），并定义了从语义基础到组合逆向的渐进式任务层级。其核心洞察是，视频提示逆向要求模型将视觉理解转化为可稳定复现的生成控制，这是一种与现有视频字幕或理解任务不同的、尚未被充分探索的关键能力。

Abstract: Recent advances in video generation have made prompt-based control increasingly central to AIGC video generation. Prompts specify what a video should depict and how it should be represented, controlling factors such as visual style or camera behavior. Understanding this recoverability is important both for creative reuse and editing, and for assessing prompt leakage risks. However, existing video understanding benchmarks do not measure this capability: a caption may describe what is visible, but a replayable prompt must recover the generation-relevant controls needed to reproduce the video. To address this gap, we introduce VI-Bench, a benchmark built from 16.1 million real-user prompts and 900 human-verified AIGC videos. VI-Bench spans three progressively harder settings, namely single-shot semantic grounding, control over style and camera behavior, and multi-shot compositional inversion, and evaluates five generation-critical dimensions: subject, action, scene, style, and camera. We evaluate 18 representative VLMs, including 2 proprietary and 16 open-source models on VI-Bench, using an Inversion Score that measures prompt-level alignment with the original prompt and video-level fidelity of the regenerated video. The results reveal substantial limitations: even the strongest model achieves only 0.632 on Inversion Score, performance degrades sharply as samples require richer control and multi-shot reasoning, and models often produce plausible prompts whose regenerated videos deviate from the reference. These findings show that video prompt inversion is a distinct and under-evaluated capability requiring models to transform visual understanding into replay-stable generative control.

[198] Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation cs.CV | cs.LGPDF

Igor Pavlovic, Thiemo Wandel, Anton Obukhov, Luca Bartolomei, Andrey Davydov

TL;DR: 本文提出了Marigold V2，一种基于扩散变换器（DiT）的单目深度估计方法。该方法通过改进训练策略和损失函数，将预训练的多步流匹配模型转化为高效的单步推理深度估计器，旨在生成更清晰、更泛化的深度图，并在其他密集回归任务上也取得了SOTA结果。

Details

Motivation: 解决单目深度估计这一病态问题中现有模型泛化能力不足、生成的深度图不够清晰和细节丢失的挑战，特别是在处理分布外输入和毛发、树叶等精细结构时。

Result: 在KITTI和ETH3D基准测试上，AbsRel指标相比之前最佳方法提升了16-26%，达到了新的SOTA水平。定性评估显示，模型能更好地解析毛发、树叶和细边缘。

Insight: 创新点包括：1）提出将模型内部表征与真实语义特征对齐的方法；2）设计了一种基于新颖Sinkhorn损失的两阶段微调协议。这些技术有效缓解了朴素训练带来的伪影，提升了模型性能与泛化能力。

Abstract: Monocular depth estimation is a ubiquitous yet highly ill-posed computer vision task, with downstream applications in scene reconstruction, computational photography, and robotics, among others. Despite the field’s maturity, recent models still struggle to generalize to out-of-distribution inputs and to produce sharp and detailed depth maps. In this paper, we revisit Marigold, a set of techniques for repurposing modern image generation and editing models, powered by the diffusion transformer (DiT) architecture, into state-of-the-art monocular depth estimators. Our recipes target single-step inference from pretrained multi-step flow-matching models, with quantization where needed, preserving model capacity while remaining cheap to run. We analyze the artifacts of naive training and identify two effective remedies: aligning the model’s internal representations with semantic features extracted from ground-truth, and adopting a 2-stage fine-tuning protocol built around a novel Sinkhorn-based loss. The results are crisper, cleaner depth maps that generalize well out-of-distribution, with 16-26% improvement in AbsRel over the previous best on KITTI and ETH3D. Qualitatively, our model resolves fur, foliage, and hair-thin edges that have eluded prior models. Furthermore, Marigold V2 achieves state-of-the-art results when applied to other dense regression tasks, such as surface normals estimation and intrinsic image decomposition. Project website: https://hf.co/spaces/huawei-bayerlab/marigold-v2-web

[199] SynthGait-19K: A Physically Grounded Synthetic Video Dataset for Gait Parameter Estimation cs.CVPDF

Soroush Mehraban, Xin Lei Lin, Vida Adeli, Majid Mirmehdi, Amirhossein Dadashzadeh

TL;DR: 本文介绍了SynthGait-19K，一个基于物理模拟的大规模合成步态视频数据集，包含19,272个行走视频，用于步态参数估计。作者开发了Gait2Vid方法，将异构的MoCap数据统一为SMPL模型，并在可控视角和场景外观下生成多样化的RGB视频。论文评估了多种方法在该数据集上的表现，并提出了一个名为GaitXFormer的直接RGB参考模型。

Details

Motivation: 现有用于从单目视频估计临床相关步态参数的数据集规模小、视角受限、视觉多样性不足，限制了可扩展移动性评估的进展。

Result: 在SynthGait-19K数据集上，对直接RGB、基于姿态、生物力学和人体网格恢复等方法进行了基准测试。实验表明，合成数据监督能有效迁移到真实视频，提升了GaitXFormer和基于姿态架构的性能。研究发现，空间步态参数对视觉域偏移更敏感，且改进的人体网格重建本身不一定能提升下游步态估计性能。

Insight: 主要创新点在于构建了一个大规模、物理基础、视角和外观可控的合成步态视频数据集，以及配套的数据生成流程Gait2Vid。从客观角度看，该工作为步态分析领域提供了一个可扩展的基准测试平台，并深入分析了不同方法、数据规模和域偏移对步态参数估计的影响，具有重要的方法论参考价值。

Abstract: Accurate estimation of clinically meaningful gait parameters from monocular video is important for scalable mobility assessment, yet progress is limited by the small scale, restricted viewpoints, and limited visual diversity of existing datasets. We introduce SynthGait-19k, a physically grounded synthetic video dataset containing 19,272 walking videos derived from 6,427 MoCap sequences across 437 subjects, with paired SMPL motion and annotations for six gait parameters. To construct the dataset, we develop Gait2Vid, which unifies heterogeneous MoCap recordings through SMPL and synthesizes diverse RGB walking videos under controllable viewpoints and scene appearances. We assess the generated videos for consistency with their conditioning gait kinematics and validate extracted gait events against force-platform measurements. Using SynthGait-19K, we benchmark direct RGB, pose-based, biomechanical, and human-mesh-recovery approaches and analyze viewpoint, training-data scale, and synthetic-to-real domain shift. We also introduce GaitXFormer as a direct RGB reference model for estimating gait parameters. Synthetic supervision transfers effectively to real videos across both GaitXFormer and a pose-based architecture, demonstrating utility across different representations. We further find that spatial gait parameters are more sensitive to visual domain shift and that improved HMR reconstruction alone does not necessarily translate to improved downstream gait estimation.

[200] DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting cs.CV | cs.HCPDF

Yuhang Wang, Chuheng Wei, Jingxin Yang, Xishun Liao, Hao Zhou

TL;DR: 本文提出了DriveMotion，一个用于连续驾驶员运动序列建模与预测的大规模多源基准数据集。该数据集整合了自然驾驶数据、公开车内视频和AIDE数据集，提供了统一表示和同步驾驶上下文。通过引入动态锚定评估方法，解决了自然驾驶数据中长时间静态运动主导评估的问题，并展示了多源训练对提升模型泛化性能的有效性。

Details

Motivation: 现有驾驶员数据集多关注短片段行为识别，而人体运动预测基准主要针对车外场景，缺乏连续驾驶员运动预测的基准。本文旨在填补这一空白，构建一个多源、大规模、具有统一表示的驾驶员运动预测基准，以更好地建模驾驶员行为、注意力和短期意图。

Result: 在动态锚定的评估窗口上，学习模型相比持续性预测降低了高达15%的预测误差；采用机动增强训练使预测衍生的Part-State F1分数相比零运动参考提升了44%；使用完整多源语料训练相比仅使用BATON训练，在保留的网络驾驶员数据上预测误差进一步降低了38%。

Insight: 创新点包括：1）构建了大规模多源驾驶员运动预测基准，整合了异构数据源；2）提出了动态锚定评估方法，聚焦于车辆机动前后的有意义运动片段，避免了长时间静态运动对评估的干扰；3）验证了多源训练对提升模型泛化能力的重要性，为驾驶员运动预测提供了可复现的评估框架。

Abstract: Driver motion can provide cues to ongoing behavior, attention, and near-term driving intent. However, most existing driver-centric datasets focus on recognizing predefined driver behaviors from short video clips, while human motion forecasting benchmarks largely target motion outside the vehicle. We introduce DriveMotion, a multi-source benchmark for continuous driver motion forecasting. DriveMotion contains 393 hours of 133-keypoint motion sequences at 10 Hz from 360 drivers, integrating naturalistic driving data, curated public in-cabin videos, and the AIDE dataset into a unified representation with per-joint validity masks and synchronized driving context. Naturalistic driving contains long periods of limited body movement, making uniformly sampled evaluation dominated by persistence and less sensitive to brief but behaviorally meaningful motion. To address this, we use dynamics-anchored evaluation, placing forecasting windows around vehicle maneuvers identified offline from CAN signals without providing CAN to the model at inference. Arm motion in pre-maneuver windows is 3.4x greater than in route-matched stable-driving controls. On these anchored windows, learned models reduce forecasting error over persistence by up to 15%, while maneuver-enriched training improves forecast-derived Part-State F1 by 44% over the zero-motion reference. Training on the full multi-source corpus further reduces forecasting error on held-out web drivers by 38% compared with BATON-only training. DriveMotion provides identity-disjoint splits, fixed evaluation subsets, and reference implementations for reproducible evaluation of continuous driver motion forecasting. The dataset and benchmark are available at https://huggingface.co/datasets/HenryYHW/DriveMotion

[201] Observe Before You Alert: Adaptive Driver Alerting with Vision-Language Models cs.CV | cs.ROPDF

Yuhang Wang, Lingyao Li, Hao Zhou

TL;DR: 本文提出了VLAlert，一个基于视觉语言模型的驾驶员警报框架，将警报生成建模为包含静默、观察和警报的三动作策略。该框架通过引入观察动作来收集证据并延迟不确定的警告，形成一个轻量级的感知-动作循环以实现自适应警报。VLAlert使用Qwen3-VL-4B作为安全证据生成器，并在VLAlert-Bench基准测试中取得了优于现有基线方法的性能。

Details

Motivation: 现有的事故预警模型通常只输出二元风险分数，对于模糊场景仅通过阈值处理，这在实际驾驶警报的序列决策和部分可观测性下存在不足。本文旨在解决何时证据充分到可以发出警告的决策问题。

Result: 在VLAlert-Bench验证集上，VLAlert实现了最高的部署导向效用（DAUS 0.4878），并提升了AUROC、AP_tick、F1_t和平衡准确率等指标。在221个保留的ADAS接管视频片段上，R@5s从74.2%提升至88.7%，F1从0.585提升至0.686，表明其性能优于Open-BADAS等基线方法。

Insight: 创新点在于将警报决策形式化为包含观察动作的三动作策略，通过延迟决策和调整观察窗口来主动收集证据，从而处理不确定性。同时，利用视觉语言模型生成安全证据并聚合结构化信念跨度的隐藏状态，为危险估计和策略预测提供了紧凑且有效的表示。

Abstract: Driver alerting from dashcam video requires sequential decision-making under partial observability: a system must decide not only whether a scene is risky, but also when the evidence is sufficient to warn. Most existing accident anticipation models output a binary risk score, leaving ambiguous scenes to be handled by thresholding. We propose VLAlert, a vision-language alerting framework that casts warning generation as a tri-action policy over SILENT, OBSERVE, and ALERT. The OBSERVE action acts as an internal evidence-gathering decision that delays uncertain warnings and changes the next observation window, creating a lightweight perception-action loop for adaptive alerting. VLAlert uses Qwen3-VL-4B as a safety-evidence generator and pools hidden states from structured belief spans to form compact representations for danger estimation and policy prediction. We evaluate VLAlert on VLAlert-Bench, a unified per-tick benchmark from four real-world dashcam alert datasets, and further test transfer to held-out naturalistic ADAS takeover clips. On VLAlert-Bench validation, VLAlert achieves the highest deployment-oriented utility among tested baselines, with DAUS 0.4878 compared with 0.4752 for Open-BADAS, and improves AUROC, AP_tick, F1_t, and balanced accuracy from 0.610, 0.176, 0.276, and 0.581 to 0.689, 0.195, 0.297, and 0.648, respectively. On 221 held-out ADAS-TO-Critic clips, VLAlert improves R@5s from 74.2% to 88.7% and F1 from 0.585 to 0.686. These results indicate that adaptive observation and safety-focused VLM representations provide measurable gains for driver-facing alert decisions.

[202] MRI-Guided Reslice-Refined Cross-Slice SDF Reconstruction of the Left Ventricle from Cardiac MRI with Sparse Axial Supervision cs.CVPDF

Quanxin Zheng, Shuai Zhao

TL;DR: 该论文提出了一种名为MR-RS-SDFR的隐式符号距离场（SDF）框架，用于从心脏磁共振（CMR）体积数据和稀疏的轴向弱标注中重建左心室（LV）心内膜的连续三维表面。该方法首先利用轴向和纵向几何线索构建跨切片SDF初始化，然后通过MRI边缘场法线对齐和可微分重切Dice及轮廓一致性两种互补信号进行细化，以克服弱标注带来的分割误差传播和平面外几何约束弱的问题。

Details

Motivation: 当仅能从少量轴向切片获得监督信息时，从心脏磁共振数据重建三维左心室心内膜表面具有挑战性，因为平面外几何约束较弱，且自动生成的二维掩码可能将分割误差传播到恢复的形状中。

Result: 在稀疏-16设置下，使用Medical SAM3掩码，最终的MR-RS-SDFR重建达到了0.928的Dice系数和3.80mm的HD95。对于所有三种稀疏-16掩码源，MR-RS-SDFR在Dice和HD95指标上均数值优于协议匹配的完整GHD+DVS方法。Dice系数从稀疏-4到稀疏-16显著提升，之后在稀疏-64时达到饱和。

Insight: 创新点在于提出了一种结合跨切片SDF初始化和基于MRI图像边缘场与可微分重切一致性进行细化的每病例隐式重建策略。该方法不依赖于特定训练或微调的弱掩码生成器，有效利用了图像本身的边界线索来补充弱标注信息，从而在稀疏监督下实现鲁棒的三维表面重建。

Abstract: Reconstructing a three-dimensional left-ventricular (LV) endocardial surface from cardiac magnetic resonance (CMR) data is challenging when supervision is available on only a small number of axial slices. Through-plane geometry is weakly constrained, and automatically generated two-dimensional masks can propagate segmentation errors into the recovered shape. We present MR-RS-SDFR, a per-case implicit signed distance field (SDF) framework that reconstructs a continuous LV surface from a CMR volume and sparse axial weak masks. The method first builds a cross-slice SDF initialization from axial and longitudinal geometric cues and then refines the field using two complementary signals: MRI edge-field normal alignment, which provides an image-derived boundary cue independent of the weak masks, and differentiable reslice Dice and contour consistency, which preserve agreement with the observed planes. We evaluate three weak-mask generators – LOO TransUNet, LOO nnU-Net, and an off-the-shelf Medical SAM3 model used without MM-WHS-specific training or fine-tuning – and five sparsity levels from 4 to 64 axial planes. In the sparse-16 setting, final MR-RS-SDFR reconstruction reaches 0.928 Dice and 3.80mm HD95 with Medical SAM3 masks. The upstream generators do not exhibit a single common ranking across 2D and dense 3D segmentation, and nnU-Net- and Medical-SAM3-driven sparse reconstruction achieve the same mean final Dice despite different upstream error profiles. Across all three sparse-16 mask sources, MR-RS-SDFR is numerically better than protocol-matched full GHD+DVS in both Dice and HD95. Final Dice improves markedly from sparse-4 to sparse-16 and then saturates at the reported precision through sparse-64. These results support MRI-guided per-case SDF refinement as a reconstruction strategy that remains effective across weak-mask generators and supervision densities.

[203] Boundary Voting Network for Ambiguity-Aware Timestamp-Supervised Action Segmentation cs.CVPDF

Runzhong Zhang, Yueqi Duan, Yang Chen, Weipeng Hu, Chen Cai

TL;DR: 本文提出了一种边界投票网络（Boundary Voting Network），用于解决时间戳监督动作分割中动作边界定位模糊的问题。该方法通过层次化传播视频级全局先验知识到局部动作过渡区域，增强特征判别性并优化边界估计，从而提升伪标签的稳定性和分割模型的性能。

Details

Motivation: 时间戳监督动作分割中，仅使用每个动作的一个随机标注帧进行训练，精确的动作边界定位至关重要，但现有方法在动作过渡区域因特征判别性不足而面临边界模糊问题，导致伪标签不稳定和模型性能下降。

Result: 在GTEA、50Salads和Breakfast三个基准数据集上的大量实验表明，该方法有效提升了动作分割性能，达到了当前先进水平（SOTA）。

Insight: 创新点在于引入边界投票机制，通过生成关键动作表示作为投票，协同增强动作过渡区域的特征并细化边界定位，从而缓解特征模糊性，可借鉴于其他弱监督视频理解任务中边界不确定性的处理。

Abstract: Timestamp-supervised action segmentation aims to segment and classify actions in untrimmed videos with a random frame annotated per action. Precisely localizing action boundaries from timestamp annotations is crucial for this setting, as it enables generating framewise pseudo-labels and applying the well-explored fully-supervised training. However, prevailing methods struggle with intrinsic uncertainty in boundary localization due to less discriminative features in action-transiting regions. This imprecise boundary estimation significantly reduces the stability and reliability of the generated pseudo-labels in ambiguous action-transiting regions, consequently resulting in performance deterioration of the trained segmentation models. In our paper, we introduce the boundary voting network that mitigates feature ambiguity by hierarchically propagating video-level global prior knowledge into local action-transiting regions. By generating key action representations as votes throughout the video and targeting action-transiting regions, all votes collaboratively contribute to action-transiting feature enhancement and boundary localization refinement. Extensive experiments demonstrate the effectiveness of our method on GTEA, 50Salads, and Breakfast datasets.

[204] From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs cs.CV | cs.CLPDF

Juwan Chung, Sungjune Park, Yeongyun Kim, Yong Man Ro

TL;DR: 本文提出了一种针对遥感多模态大语言模型（RS-MLLMs）的区域选择范式，用于解决遥感图像中目标与变化区域定位的难题。该方法通过文本条件区域提议模块生成候选区域，并将其编码为携带时空信息的特殊令牌，由LLM通过选择令牌来完成定位，特别适用于多时序图像的变化定位任务。

Details

Motivation: 现有方法依赖生成边界框坐标序列，对于遥感图像中常见的小型、密集目标定位脆弱，且在需要同时定位多个目标时误差显著增加。本文旨在将自然图像MLLM中的区域选择范式适配到遥感领域，以更鲁棒地处理单图像和多时序图像中的定位问题。

Result: 实验表明，该方法在时序变化定位任务上显著优于基于坐标生成的基线方法，同时提升了单图像视觉定位性能，并在理解任务上保持了竞争力。

Insight: 创新点在于将区域选择范式引入遥感MLLM，通过文本条件区域提议和候选区域令牌化编码，将定位任务转化为LLM的令牌选择问题，提高了对密集小目标和多目标场景的鲁棒性；独特的Oracle分析框架可分解区域提议器和LLM选择器的贡献，提供了可诊断的模型洞察。

Abstract: Remote sensing multimodal large language models (RS-MLLMs) have advanced scene understanding and visual question answering over satellite imagery, yet localizing specific objects or changed regions remains challenging. Existing approaches rely on generating bounding box coordinates as token sequences, which is fragile for the small, densely packed objects common in remote sensing and increasingly error-prone when multiple targets must be localized simultaneously. In this work, we present an RS-specific formulation of the region selection paradigm, previously explored in natural-image MLLMs, and extend it to temporal change localization over multi-image sequences. Our framework employs a text-conditioned region proposal module, encodes each candidate as special tokens carrying per-frame visual features enriched with spatial and temporal cues, and lets the LLM localize targets by selecting region tokens in its response. We construct a multi-task training and evaluation suite spanning localization, referring expression, visual grounding, and understanding tasks across single-image and multi-temporal settings. Experiments show that our approach substantially outperforms coordinate-generation baselines on temporal change localization, while improving single-image visual grounding and maintaining competitive understanding performance. Oracle analysis decomposes the contributions of the region proposer and the LLM selector, providing diagnostic insight unique to this framework. Our code will be available at https://github.com/juwan-kr/RS-RegionSelect.

[205] WSPolypNet: Weakly Supervised Polyp Localization in Colonoscopy Videos cs.CV | cs.AIPDF

Giseong Hwang, Minjae Jo, Yeonghyeon Park, Kyeonghun Kim, Seoyeon Han

TL;DR: 本文提出了WSPolypNet，一个用于结肠镜视频息肉定位的弱监督框架。该框架仅使用视频级标签，通过3D卷积神经网络生成类激活图来定位候选息肉区域，并利用多视图策略增强定位线索，再结合MedSAM2模型进行分割掩码传播，从而显著降低了对密集帧级空间标注的需求。

Details

Motivation: 解决结肠镜视频中密集帧级标注成本高昂的问题，旨在开发一个仅需视频级标签即可进行息肉定位的弱监督方法，以减少对昂贵空间标注的依赖。

Result: 在IoU阈值为0.3、0.5和0.7时，WSPolypNet的CorLoc分数分别达到47.80%、43.68%和35.01%，优于单视图设置的36.87%、33.72%和27.94%。对于小息肉，多视图策略将CorLoc@0.5从16.01%提升至30.97%，同时框架实现了94.51%的召回率，展示了其有效性。

Insight: 创新点在于结合了弱监督时空学习（使用3D CNN和视频级标签生成CAM）与多视图增强策略，并利用MedSAM2进行分割掩码传播来细化定位，这为减少医学图像分析中的标注负担提供了新思路。

Abstract: Because dense frame-level annotation of colonoscopy videos is costly, we propose WSPolypNet, a weakly supervised framework for polyp localization using only video-level labels. WSPolypNet employs a 3D convolutional neural network trained with video-level supervision to generate class activation maps (CAMs), which identify candidate polyp regions without requiring frame-level spatial annotations. The CAM-derived localization cues are further enhanced using a multi-view strategy and provided to MedSAM2 as point prompts. MedSAM2 then propagates segmentation masks across the video, refining the coarse localization cues according to polyp boundaries. WSPolypNet achieved CorLoc scores of 47.80%, 43.68%, and 35.01% at IoU thresholds of 0.3, 0.5, and 0.7, respectively, compared with 36.87%, 33.72%, and 27.94% in the single-view setting. For small polyps, the multi-view strategy improved CorLoc@0.5 from 16.01% to 30.97%. The framework also achieved a recall of 94.51%. These results demonstrate the potential of weakly supervised spatiotemporal learning to substantially reduce spatial annotation requirements for polyp localization in colonoscopy videos.

[206] PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generation cs.CVPDF

Cong Wang, Hanxin Zhu, Yonglin Tian, Jiayi Luo, Ruiqi Song

TL;DR: 本文提出PhysFlow，一个两阶段框架，通过将视频生成分解为运动感知的光流生成和运动条件的外观合成，以提升生成视频的物理合理性。该框架包含物理感知光流生成器PA-Flow和流引导视频生成器FlowRender，并构建了物理视频数据集PhysVideo用于训练。实验表明，PhysFlow在保持高视觉保真度的同时，能生成物理上更合理的视频。

Details

Motivation: 当前视频生成模型在生成视觉上吸引人的视频方面取得进展，但确保物理一致且合理的动态仍是一个基本挑战。本文动机在于物理规律主要编码在运动模式中，因此通过显式建模运动来提升物理合理性。

Result: 大量实验表明，与现有方法相比，PhysFlow生成的视频具有更优的物理合理性，同时保持了高视觉保真度。

Insight: 创新点在于将视频生成解耦为显式的光流（运动）生成和条件外观合成两阶段，并引入物理感知注意力模块来建模运动属性与材料特性对运动的影响。此外，构建了基于物理引擎和3D-GS渲染的标注数据集PhysVideo，为物理监督训练提供了支持。

Abstract: Video generation models have recently attracted substantial attention for their ability to generate visually compelling videos, yet ensuring physically consistent and plausible dynamics still remains a fundamental challenge, driving a growing line of research on physical realism in video generation. To address this challenge, motivated by the fact that physical regularities are primarily encoded in motion patterns, we propose PhysFlow, a novel two-stage framework for improving the physical plausibility of generated videos by decomposing video generation into motion-aware optical flow generation followed by motion-conditioned appearance synthesis. Specifically, PhysFlow consists of a physics-aware optical-flow video generator called PA-Flow and a flow-guided video generator called FlowRender. During the first stage, PA-Flow employs a physics-aware attention module to model how motion attributes and material properties influence global motion and local deformation, respectively, and generates an optical flow video as an explicit representation of motion. In the second stage, FlowRender leverages the decoupled motion representation as guidance to synthesize realistic textures and appearances, ultimately producing the final physically plausible video. To further support model training with explicit physical supervision, we construct PhysVideo, a physics-based video dataset generated with a physics engine and 3D-GS rendering, containing 10K foreground objects and 50K realistic video sequences with annotations of motion and material properties. Extensive experiments demonstrate that our proposed PhysFlow generates videos with superior physical plausibility while maintaining high visual fidelity compared with existing methods.

[207] Drive by Hindsight and Foresight: Tool-Grounded Synergistic Reasoning over Hierarchical Memory for Autonomous Driving cs.CV | cs.ROPDF

Baojie Chen, Zijun Jia, Jing Zhong

TL;DR: 本文提出了一种用于自动驾驶的协同推理框架，该框架将分层记忆与主动工具调用紧密耦合在一个闭环推理循环中。该框架包含场景级短期记忆和演化长期记忆，通过自适应调用工具来优化推理，并离线整合可重用经验。

Details

Motivation: 现有基于视觉语言模型的自动驾驶方法存在幻觉、时空感知弱和泛化能力有限的问题，且模型缺乏主动感知场景信息和回答后积累经验的能力。本文旨在克服这些限制。

Result: 在DriveLMM-o1基准测试中，其7B模型总体推理得分达到80.03，多项选择题准确率为79.09%，超过最强基线7.74个百分点，并在多个基准上表现出强大的泛化能力。消融实验验证了各组件有效性，短期记忆将STSBench准确率提升24.2分，离线长期记忆整合带来额外3.57分的多项选择题增益。

Insight: 主要创新点在于首次提出了一个将分层记忆与主动工具调用紧密耦合的协同推理闭环框架。其分层驾驶记忆结构（短期与长期）以及离线经验整合机制，使得模型能够通过积累的驾驶经验实现持续的自我进化，这为解决自动驾驶中的复杂时空推理和泛化问题提供了新思路。

Abstract: VLMs have shown promise for autonomous driving, yet still suffer from hallucination, weak spatio-temporal perception, and limited generalization. Recent methods improve reasoning and decision-making through CoT explanations, retrieval-augmented generation or the static injection of tool outputs. Although these mechanisms enrich the context, the model neither proactively perceives scene information nor accumulates experience after answering. To overcome these limitations, we present, to our knowledge, the first synergistic framework that tightly couples hierarchical memory with proactive tool invocation in a closed reasoning loop. Our contributions are threefold. (i) Hierarchical Driving Memory: a scene-level short-term memory maintains the dynamic scene state, and an evolving long-term memory retrieves reusable experience and tool strategies. (ii) Memory-Tool Synergistic Reasoning Framework: guided by the scene state and retrieved experience, the model adaptively invokes tools to refine its reasoning at inference time and consolidates reusable experience into a long-term memory pool offline. (iii) Data Generation and Two-stage Training Pipeline: verified memory-tool trajectories built by multi-step teacher rollout are used to train with SFT and GRPO. Our 7B model reaches an overall reasoning score of 80.03 and MCQ accuracy of 79.09% on DriveLMM-o1, surpassing the strongest baseline by 7.74 MCQ points and generalizes strongly across benchmarks. Notably, ablation and analysis studies validate the effectiveness of each component and further reveal the complementary roles of hierarchical memory. Short-term memory strengthens spatio-temporal understanding, improving STSBench accuracy by 24.2 points, while offline long-term memory consolidation yields an additional 3.57-point MCQ gain with all parameters frozen, demonstrating continual self-evolution through accumulated driving experience.

[208] SoftRerank: Hierarchical Soft Fusion with Candidate-Label Reranking for Long-Tailed Micro-Action Recognition cs.CV | cs.MMPDF

Yichi Zhang, Zhichao Xia, Yanjun Chi, Lingsi Zhu, Yuefeng Zou

TL;DR: 本文提出了一种名为SoftRerank的细粒度微动作识别方法，针对微动作短暂、视觉变化弱且类别间运动模式相似等挑战。该方法结合了InternVideo2.5的全微调、分层软融合以及轻量级候选标签重排序器，并在长尾数据集MA-52上通过类别平衡采样和逆频率重加权来缓解类别不平衡问题。

Details

Motivation: 微动作是微妙、低强度的非语言行为，能反映精细的人类状态（如情绪和意图），但其识别因动作短暂、视觉变化弱、类别间运动模式相似而困难。本文旨在解决这些挑战，特别是在长尾标签分布下的细粒度微动作识别问题。

Result: 在MA-52数据集上，该方法取得了79.99%的F1-mean分数，并在ACM Multimedia 2026的第三届微动作分析大挑战赛中排名第一，达到了当前最佳水平（SOTA）。

Insight: 创新点包括：结合全微调预训练模型（InternVideo2.5）与分层软融合来提升粗粒度和细粒度预测的一致性；引入轻量级候选标签重排序器，专注于易混淆的细粒度动作样本；在长尾场景下采用类别平衡采样和逆频率重加权策略以减轻频繁类别的影响。这些方法可借鉴于其他细粒度或长尾视觉任务中。

Abstract: Micro-actions are subtle, low-intensity non-verbal behaviors that provide cues to fine-grained human states, including emotions and intentions. Recognizing them remains difficult because they are brief, contain weak visual changes, and often exhibit similar motion patterns across categories. This paper addresses these challenges with a fine-grained micro-action recognition method that combines full fine-tuning of InternVideo2.5, hierarchical soft fusion, and a lightweight candidate-label reranker. For the long-tailed label distribution in MA-52, we use class-balanced sampling and inverse-frequency reweighting to reduce the effect of frequent classes during training. We fine-tune InternVideo2.5 end to end and attach coarse and group-conditional fine-grained classification heads to the shared video representation, improving the consistency between coarse and fine predictions. For ambiguous samples, the candidate-label reranker uses hard samples and video-label matching to focus on easily confused fine-grained actions. Experiments validate the proposed method, which achieves a 79.99% F1-mean on MA-52 and ranks first in the 3rd Micro-Action Analysis Grand Challenge at ACM Multimedia 2026.

[209] CS-CLIP: Compositional Scene Graph-guided CLIP for Robust Compositional Reasoning cs.CV | cs.AIPDF

SeongJun Jeong, Minjoon Jung, Woo Suk Choi, Youwon Jang, Byoung-Tak Zhang

TL;DR: 本文提出了CS-CLIP，一种通过场景图引导和结构化负样本构建来增强组合推理鲁棒性的视觉语言模型。该方法利用场景图识别组合元素，并通过选择性掩码构建负样本，强制模型关注组合结构而非表面线索。

Details

Motivation: 现有具备组合性感知的视觉语言模型存在元素特异性偏差，在某些组合元素上甚至不如原始CLIP模型，因此需要一种更鲁棒的组合推理方法。

Result: CS-CLIP在组合推理任务上达到了最先进的性能，并且在所有组合元素上均表现出鲁棒性，同时保持了跨模态检索和下游视觉推理等通用能力，且所需训练样本少于先前方法。

Insight: 创新点在于利用场景图结构化地识别组合元素并构建关键负样本，通过保留与原始描述最矛盾的负样本来强制模型学习组合结构，这是一种提升模型组合推理鲁棒性的有效方法。

Abstract: Vision-language models (VLMs) demonstrate strong performance across compositional reasoning benchmarks, which require reasoning over semantic perturbations of objects, attributes, relations, and their interactions. However, our controlled analysis reveals that existing compositionality-aware VLMs exhibit element-specific biases, often underperforming vanilla CLIP on certain compositional elements. To address this, we propose Compositional Scene Graph-guided CLIP (CS-CLIP), which uses scene graphs to identify compositional elements and construct structured negatives via selective masking. We further retain negatives that are most contradictory to the original caption, forcing the model to rely on compositional structure rather than surface cues. CS-CLIP achieves state-of-the-art compositional reasoning with robust performance across compositional elements. It also preserves general vision-language capabilities such as cross-modal retrieval and downstream visual reasoning, while requiring fewer training samples than prior methods.

[210] ActionSplice: In-Flight Action Editing for Interactive World Models cs.CV | cs.LGPDF

Pardis Taghavi, Tingyu Guo, Jonas Lossner, Gaurav Pandey, Reza Langari

TL;DR: 本文提出ActionSplice，一个用于交互式世界模型的推理框架，旨在解决分块自回归视频世界模型中动作编辑导致的延迟或回滚问题。该框架通过反事实状态传输（CST）技术，在不解冻世界模型和采样器的情况下，将中断的表示快速调整到修正动作对应的状态，从而避免重复已完成的计算。

Details

Motivation: 在分块自回归视频世界模型中，每个生成块通常以一个动作为条件；当在采样过程中接收到新动作时，要么等待下一个块，要么基于旧动作的状态继续求解，要么触发回滚重复计算，这导致效率低下和交互延迟。

Result: 在minWM-Wan Action2V和HY-WM1.5基准测试中，CST_R变体相较于直接条件交换，将回滚相关的LPIPS降低了61.5%和75.9%；CST_T变体将后缀LPIPS降低了56.1%和77.5%，同时分别带来2.73倍和1.69倍的像素级加速。在HY-WorldPlay协议下，CST_R获得了25.66 dB的PSNR、0.6902的SSIM和0.1337的LPIPS。

Insight: 创新点在于将动作编辑问题形式化为反事实状态传输（CST），通过轻量级校正器在不解冻模型的情况下调整表示，避免了回滚或等待；CST_R和CST_T变体分别提供了完整块更新和部分时间前缀保留的灵活编辑策略，提升了交互效率和视觉质量。

Abstract: Chunk-autoregressive video world models typically condition each generated chunk on one action. An action received during sampling must therefore wait for the next chunk, condition future solver evaluations on a state produced under the previous action, or trigger rollback that repeats completed evaluations. We introduce ActionSplice, an inference framework that formulates this problem as Counterfactual State Transport (CST). A lightweight corrector transports the interrupted backbone-native representation toward the matched state induced by the revised action at the same solver step. The world model and sampler remain frozen, and sampling resumes without replaying completed evaluations. The retargeting variant $\mathrm{CST}{R}$ updates the entire active chunk, while the temporal-splicing variant $\mathrm{CST}{T}$ preserves a temporal prefix and updates only the suffix. Across minWM-Wan Action2V and HY-WM1.5, $\mathrm{CST}{R}$ reduces rollback-relative LPIPS by 61.5% and 75.9% relative to direct condition swapping. $\mathrm{CST}{T}$ reduces suffix LPIPS by 56.1% and 77.5%, respectively, while providing $2.73\times$ and $1.69\times$ pixel-ready speedups over waiting. Under the HY-WorldPlay protocol, $\mathrm{CST}_{R}$ obtains a PSNR of 25.66 dB, an SSIM of 0.6902, and an LPIPS of 0.1337 against the original rollout.

[211] Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models cs.CVPDF

Ke Hao, Yuanzhi Liang, Tingxi Chen, Rui Li, Haibin Huang

TL;DR: 本文提出了一种名为生成式接地反馈（GGF）的自进化后训练框架，用于统一多模态模型。该框架仅使用文本提示和模型自身的视觉经验，通过让模型根据提示生成视觉‘梦境’，并利用流级反馈和梦境回放接地两种机制，在无配对图文监督的情况下，联合优化视觉理解和生成能力，使两者相互促进。

Details

Motivation: 动机在于解决统一多模态模型中视觉理解与生成能力通常被作为独立任务分别优化的问题，旨在探索如何让这两种能力在没有外部监督数据的情况下相互提供反馈并协同进化。

Result: 在不同理解-生成集成设计的统一模型上的实验表明，该方法在文本到图像生成任务上取得了持续改进，同时在视觉理解任务上也获得了适度的性能提升。

Insight: 创新点在于提出了一个仅依赖模型自身生成内容（梦境）和内部反馈的自进化学习框架，通过流级反馈和梦境回放接地机制，实现了生成能力为理解提供视觉接地，而理解能力反过来优化后续生成的无监督协同训练范式。

Abstract: Unified multimodal models integrate visual understanding and generation within a single network, yet the two capabilities are commonly optimized as separate tasks. We introduce Generative Grounding Feedback(GGF), a self-evolving post-training framework that uses only text prompts and the model’s own visual experience. Given a prompt, the model first generates a visual ``dream.’’ Flow-level feedback compares text-, image-, and repair-conditioned predictions at the same noisy latent state, transferring image-grounded generation directions to the prompt condition. Dream replay grounding replays this dream through captioning and re-imagination, training claim-level evidence to remain consistent across the replay while separating unrelated visual experiences. Jointly optimized, these two directions let generation provide visual grounding for understanding and understanding refine subsequent generation without paired image–text supervision. Experiments across unified models with different understanding–generation integration designs show consistent improvements in text-to-image generation together with modest gains in visual understanding.

[212] Tracking-by-detection in Multi-object Tracking: Survey and Experiments cs.CVPDF

Yujin Yang, Kyujin Shim, Kangwook Ko, Changick Kim

TL;DR: 本文是一篇关于多目标跟踪（MOT）中检测跟踪（TBD）范式的综述与实验研究。它系统回顾了TBD中的相似性度量、数据关联、相机运动补偿和插值策略等技术，并通过从一个最小基线跟踪器出发，公平评估了不同方法在各种数据集上的贡献，旨在建立强基线并为稳健MOT系统的设计提供基础。

Details

Motivation: 尽管检测跟踪范式在多目标跟踪中已成为主流，但现有研究常因评估协议不一致（如使用不同的基线跟踪器、超参数和数据集）而难以公平评估各模块（如相似性度量、数据关联策略）的真实贡献，阻碍了客观比较。

Result: 研究通过从一个最小基线跟踪器出发，在多样化数据集上公平评估了各种方法的贡献，最终建立了一个强基线跟踪器，并整合了均衡的方法组合。

Insight: 论文的创新点在于提供了一个系统性的综述和公平的实验评估框架，强调了评估一致性的重要性，其建立的强基线和方法组合为设计适用于实际部署的稳健、通用MOT系统提供了原则性基础。

Abstract: Multi-object tracking (MOT) is an essential computer vision task that simultaneously tracks multiple objects in video sequences, with various applications in surveillance, autonomous navigation, and human-computer interaction. The tracking-by-detection (TBD) paradigm, which combines object detection with temporal association, has emerged as a leading approach, driven by innovative algorithms. Despite recent progress, fair evaluation of TBD-based methods remains a challenge. Many studies introduce modules such as similarity metrics, data association strategies, or motion models, but they are often evaluated under inconsistent protocols, with different baseline trackers, hyperparameters, and datasets. Such inconsistencies obscure the genuine contribution of each module and hinder objective comparison. This survey systematically reviews TBD-based MOT techniques, including similarity measurements, data association, camera motion compensation, and interpolation strategies. Starting from a minimal baseline tracker, we fairly evaluate the contributions of each method across diverse datasets and accumulate well-balanced methods. Our findings establish a strong baseline tracker and provide a foundation for the principled design of robust and versatile MOT systems suitable for real-world deployment.

[213] Human-Centric Image Captioning with Subject-Centered Spatial Understanding cs.CVPDF

Bozhou Li, Jiahang Zhang, Yue Ding, Yushuo Guan, Bohan Zeng

TL;DR: 本文针对多模态大语言模型在人物中心图像描述任务中存在的结构幻觉问题，提出了SPACE基准来系统评估模型以主体为中心的空间理解能力。研究发现现有模型难以基于主体的内在参考系进行描述，为此作者设计了一个专门的数据构建与对齐流程，包括从细粒度身体部位定位提取结构化空间提示以指导两阶段描述重写，并设计了基于量规的奖励用于组相对策略优化，以在模型对齐过程中显式惩罚关键空间错误。

Details

Motivation: 尽管多模态大语言模型在通用图像描述上表现出色，但在人物中心场景中经常产生结构幻觉，这影响了其在精确头像/视频生成和细粒度人类动作理解等关键下游应用中的可靠性。现有基准的整体描述性指标往往掩盖了这些对结构完整性至关重要的局部空间反转错误。

Result: 在提出的SPACE基准上进行的大量实验表明，该框架显著提升了人物中心描述的质量，特别是在以主体为中心的空间推理方面，其性能可与强大的闭源模型竞争。

Insight: 论文的创新点在于系统性地暴露并量化了MLLMs在主体中心空间理解上的瓶颈，并提出了一个结合结构化空间提示提取、两阶段描述重写和基于量规的组相对策略优化的专门化数据构建与对齐流程，以生成空间忠实的数据并显式纠正关键空间错误。

Abstract: While multimodal large language models (MLLMs) achieve remarkable performance on generic image captioning, they frequently suffer from structural hallucinations in human-centric scenarios. Accurately modeling human subjects is foundational for critical downstream applications, such as accurate avatar/video/image generation and fine-grained human action understanding. However, these tasks require highly precise subject-centered spatial grounding, such as distinguishing egocentric left/right laterality and maintaining correct anatomical-object bindings. Although catastrophic for structural integrity, these localized spatial inversions are often overshadowed by overall descriptive metrics in existing benchmarks. To systematically expose and quantify this bottleneck, we introduce SPACE (Subject-centric Poses, Appearance, and Characteristics Evaluation), a benchmark designed to evaluate subject-centered spatial understanding. On SPACE, we reveal that despite strong generic perception, current MLLMs consistently fail to ground descriptions in the subject’s intrinsic frame of reference. To bridge this gap, we propose a specialized data construction and alignment pipeline. We first extract structured spatial hints from fine-grained body-part localization to guide a two-stage caption rewriting process, yielding highly spatially-faithful training data. Furthermore, we design a rubric-based reward for Group Relative Policy Optimization (GRPO) that explicitly penalizes structurally critical spatial errors during alignment. Extensive experiments on SPACE demonstrate our framework significantly improves human-centric caption quality, particularly in subject-centered spatial reasoning, achieving performance competitive with strong closed-source models. Our benchmark and code are available at https://github.com/JHang2020/SPACE-Eval.

[214] From Glance to Scrutiny: Progressive Distortion Reasoning for Fine-Grained Image Quality Assessment cs.CVPDF

Aoting Zhang, Mingze Gao, Dongbao Yang, Longyi Chen, Daoxin Zhang

TL;DR: 本文提出GS-IQA框架，将图像质量评估（IQA）重新定义为一种渐进式的‘位置-内容-程度’诊断过程，模拟人类从粗略一瞥到仔细审视的感知流程。该框架采用两阶段强化学习范式，首先定位和识别失真区域，然后评估其严重程度，并通过在线生成针对模型感知瓶颈的困难样本来提升对细微差异的判别力。

Details

Motivation: 现有基于多模态大语言模型（MLLMs）的IQA方法主要关注整体质量预测，如同黑盒，难以揭示失真发生的位置及其如何影响感知质量，这阻碍了对局部和异构退化的细粒度分析。

Result: 在构建的区域级IQA基准Diag-Bench（包含约25K样本，涵盖12种失真类型和5个有序严重级别）上的大量实验表明，GS-IQA在失真定位、识别和严重程度估计方面持续超越最先进（SOTA）方法，其诊断表征也能有效迁移到多种外部基准上的传统全局质量预测任务。

Insight: 创新点在于将IQA任务结构化为具有依赖关系的渐进式诊断流程，并设计了两阶段强化学习范式（包含感知门控奖励和在线奖励条件退化生成）来模拟和优化这一流程，从而实现了对局部失真的细粒度、可解释性分析。

Abstract: Multi-modal large language models (MLLMs) have demonstrated significant potential in image quality assessment (IQA) by bridging visual perception with descriptive evaluations. However, existing approaches mainly focus on holistic quality prediction, often functioning as black boxes that provide limited insight into where distortions occur and how they affect perceived quality, hindering fine-grained analysis of localized and heterogeneous degradations. We propose GS-IQA, a framework that reformulates IQA as a progressive Where–What–How diagnosis, emulating the human perceptual process from an initial glance to closer scrutiny. Since a severity judgment is meaningful only for a correctly localized and recognized region, we realize this progression through a two-stage reinforcement learning paradigm that respects such dependencies: the glance stage uses a perception-gated reward to establish where degradations lie and what they are, activating severity feedback only once both are correct, while the scrutiny stage introduces online reward-conditioned degradation generation to synthesize hard examples targeted at the model’s perceptual bottlenecks, sharpening its discrimination of subtle severity variations. To enable systematic evaluation, we construct Diag-Bench, a region-level IQA benchmark of about 25K curated samples spanning 12 distortion types and five ordinal severity levels. Extensive experiments show that GS-IQA consistently surpasses state-of-the-art methods in distortion localization, recognition, and severity estimation, and that its diagnostic representations transfer effectively to conventional global quality prediction across diverse external benchmarks. Code and data will be released.

[215] Do Input-Level Defenses Transfer to Observation-Level Attacks on VideoLLMs? cs.CV | cs.CRPDF

Bangshuo Zhu, Wei Song, Yuxin Cao, Yuezhong Wu, Zhiquan Liu

TL;DR: 本文研究了视频大语言模型（VideoLLMs）在观察级攻击下的防御问题，发现现有的输入级对抗防御方法对这类攻击的保护效果有限且不一致。通过构建DefTEval评估框架，在五个VideoLLM模型、十一种防御方法和五种攻击类型上进行系统测试，结果表明防御效果主要受模型架构而非防御方法本身影响，且安全检测率常接近零。

Details

Motivation: VideoLLMs在安全关键应用（如内容审核和视频分析）中日益普及，但其依赖的帧采样、令牌压缩和多模态融合等观察流程容易受到观察级攻击，而现有防御方法主要针对输入级攻击设计，缺乏针对观察级攻击的专门防御评估。

Result: 在DefTEval框架下的实验显示，输入级防御对观察级攻击的保护效果普遍较差，有害内容检测率经常接近零；即使攻击在每个采样帧中都嵌入有害信号，防御仍会失败。防御效果主要由模型架构主导，且在不同内容类别间差异显著。

Insight: 论文的创新点在于首次系统评估了输入级防御对观察级攻击的迁移性，揭示了VideoLLMs安全漏洞的深层原因：采样遗漏、令牌压缩导致的局部特征丢失以及多模态融合对弱化视觉信号的系统性抑制。研究指出，确保VideoLLMs安全需要系统级鲁棒性机制，包括采样感知的覆盖保证、令牌级安全相关特征的保留以及多模态平衡融合。

Abstract: Video Large Language Models (VideoLLMs) are increasingly deployed in safety-critical applications such as content moderation and video analytics. To process long videos efficiently, VideoLLMs rely on frame sampling, token compression, and modality fusion, which together form an observation pipeline that reduces the raw video to a compact internal representation. Recent observation-level attacks exploit this pipeline to prevent the model from perceiving harmful content, yet no defense has been explicitly designed for this threat. We introduce DefTEval, a controlled evaluation framework that systematically assesses whether input-level adversarial defenses, which operate on the pixel content of already-sampled frames, can mitigate observation-level attacks. Across five VideoLLMs, eleven representative defenses, and five attack types, we find that input-level defenses offer limited and inconsistent protection, with harmful detection rates frequently near zero. Critically, defenses fail even against attacks that embed harmful signals in every sampled frame, indicating that the bottleneck extends beyond sampling omission to the suppression of signals that do enter the model. Token compression discards localized features, and modality fusion systematically down-weights weakened visual signals. Furthermore, defense effectiveness is dominated by model architecture rather than by the defense method itself, and detection rates vary drastically across content categories, exposing structural weaknesses in temporal reasoning. These findings demonstrate that securing VideoLLMs requires system-level robustness mechanisms spanning sampling-aware coverage guarantees, token-level preservation of safety-relevant features, and modality-balanced fusion.

Aryan Singh, Chandan Biswas

TL;DR: 本文提出了一种监督跨模态特征对齐框架，用于帕金森病步态冻结的无穿戴检测。该方法利用预训练的IMU传感器运动学数据和临床元数据作为监督信号，指导一个仅使用视觉输入的可部署模型，以克服基于视觉方法在转向任务中因自遮挡导致的跟踪误差和分类错误。

Details

Motivation: 现有步态冻结评估主要依赖可穿戴IMU传感器，但其强制佩戴限制了临床连续部署；而基于视觉的无干扰方案在转向任务中因几何自遮挡导致骨骼坐标确定性和高频特征丢失，分类误差大。

Result: 在步态冻结检测任务中，该方法实现了85.5%的准确率和82.4%的平衡准确率，将硬件传感器的预测保真度转移到了视觉表示中，同时推理时仅需视觉模型。

Insight: 创新点在于提出了一种跨模态子空间蒸馏框架，利用IMU和临床元数据作为监督源来对齐和增强视觉表示；通过引入关节速度和加速度导数以及基于置信度的门控机制，缓解了遮挡期间的跟踪误差，实现了无穿戴、高精度的检测。

Abstract: Objective assessment of Freezing of Gait (FoG) in Parkinson’s disease (PD) relies predominantly on wearable Inertial Measurement Units (IMUs). While IMUs provide optimal kinematic precision, mandatory sensor attachment restricts continuous clinical deployment. Conversely, unobtrusive vision-based alternatives suffer substantial classification errors during turning-in-place tasks, where geometric self-occlusion degrades deterministic skeletal coordinates and obscures the high-frequency precursors required for FoG detection. To resolve these physical observation limits, we propose a supervised cross-modal subspace distillation framework. During optimisation, pre-trained kinematic data from IMU sensors and contextual clinical metadata act as oracles to guide a deployable visual architecture. By incorporating joint velocity and acceleration derivatives, utilising a confidence-based gating mechanism, the visual model mitigates some of the tracking errors during occlusion events. Empirical evaluations confirm this latent alignment transfers the predictive fidelity of hardware sensors directly into the visual representation, yielding $85.5%$ accuracy, and $82.4%$ balanced accuracy. All the while maintaining a vision only model at inference.

[217] EdMCGS: Event-Driven Markov Chain Gaussian Splatting for Extreme-Low-Frame-Rate Dynamic Scene Reconstruction cs.CVPDF

Yuzhong Wang, Wenmin Wang, Xinxing Yu

TL;DR: 本文提出了EdMCGS，一种端到端的方法，用于从极低帧率RGB图像和事件流中重建动态3D场景，并能在任意中间时间点进行渲染。该方法将场景运动建模为事件驱动的马尔可夫链，其中稀疏的RGB帧在自身时间戳锚定状态，而事件流则驱动状态在帧间过渡。

Details

Motivation: 解决仅依赖RGB图像的方法在重建动态场景时，由于连续帧之间缺乏证据而产生大量伪影的问题。通过引入事件流来补充帧间缺失的运动信息。

Result: 在合成和真实世界场景上的实验表明，EdMCGS在重建质量上优于仅基于RGB和仅基于事件的基线方法，并且能以实时速度渲染，使用的3D高斯数量远少于最强的基于事件的基线。

Insight: 核心创新在于将事件流作为推理时驱动3D高斯运动（而非仅作为训练监督）的事件驱动马尔可夫链模型，以及通过局部等距项保持传播运动的局部刚性，实现了从事件直接生成中间运动而非插值。

Abstract: We present EdMCGS (Event-driven Markov chain Gaussian Splatting), an end-to-end method for reconstructing dynamic 3D scenes from extreme-low-frame-rate RGB together with an event stream, which can then be rendered at any intermediate timestamp. Methods relying solely on RGB images generate numerous artifacts due to the lack of evidence from between consecutive frames. To supply this missing evidence, we model the scene motion as an event-driven Markov chain, in which the sparse RGB frames anchor the state at their own timestamps while the events recorded within an interval drive the transition across it. Since the transition reads the events of the current interval, it remains active at inference and produces the in-between motion of the 3D Gaussians directly from the events rather than by interpolation, which sets our method apart from prior work that uses events only as training-time supervision. The state is carried by a compact set of control points, each driven by the events sampled in the neighborhood of its own image projection, and a temporal local isometry term keeps the propagated motion locally rigid. Experiments on synthetic and real-world scenes show that EdMCGS outperforms both RGB-based and event-based baselines, while rendering in real time with far fewer Gaussians than the strongest event-based baseline. We release our source code and a new dataset at https://github.com/joseclipse/EdMCGS.

[218] VeriScene: Reconstructing Crime Scenes from Legal Evidence via World-Model Agent cs.CV | cs.CRPDF

Kevin Chuanpu Fu, Yongsen Zheng, Zee Kin Yeong, Kwok-Yan Lam

TL;DR: 本文提出了VeriScene，一种基于世界模型（world model）的智能体，用于从多模态法律证据（如法医照片和证人证言）中重建犯罪现场并生成重演视频。该方法通过迭代融合证据、审计循环、约束注入验证等步骤，确保每个主张可追溯至证据且动作符合物理规律。

Details

Motivation: 现有世界模型在处理原始、无序的法律证据时存在缺陷：会忽略证据、掩盖矛盾证词，并生成违反证据记录的动作。因此，需要一种能够可靠融合多模态证据、确保可追溯性和物理合理性的系统来支持法医应用。

Result: 在包含25个犯罪场景、7种物理驱动案例类型（139张法医风格照片和65条带有植入不可靠性的陈述）的基准测试中，VeriScene在20个测试场景上实现了0.9014的证据覆盖率和0.7213的事实一致性（0-1尺度），在事实一致性和时间连贯性上分别比端到端多模态LLM基线提高了20.35%和34.88%，且可泛化至四种LLM编排后端，每个场景成本为1.82美元。

Insight: 创新点在于设计了审计循环机制，使证据融合过程可追溯，并通过探针推演与约束注入验证假设动态，确保生成的场景既忠实于证据又物理合理。这为基于世界模型的可信场景重建提供了系统化框架。

Abstract: World models take multimodal inputs like text, photos, and diagrams to generate dynamic scenes in accordance with the laws of physics, thus opening a compelling application: fusing multimodal legal evidence to re-create a crime scene and re-enact how an offence could have been committed. However, feeding the raw, unorganized evidence into a world model fails in forensic use: it silently drops evidence, glosses over contradictory testimony, and produces motion that violates the evidentiary record. This paper presents VeriScene, an agent that orchestrates the world model: it reconstructs crime scenes from forensic photographs and witness statements of varying reliability, keeping every claim traceable to evidence and every motion physically plausible. VeriScene iteratively fuses the evidence into a cited narrative under an auditing loop, verifies the hypothesized dynamics via probe rollouts in the world model with corrective constraint injection, and renders the offence as a re-enactment video from a fused keyframe. On a benchmark of 25 crime scenarios across 7 physically-driven case types (139 forensic-style photographs and 65 statements with planted unreliability), VeriScene attains 0.9014 evidence coverage and 0.7217 factual consistency (0-1 scale) on the 20 test scenes, outperforming an end-to-end multimodal-LLM baseline by 20.35% in factual consistency and 34.88% in temporal coherence, while generalizing across four LLM orchestration backends at USD 1.82 per scene.

[219] CoVeR: Coverage-Based Token Pruning for Multi-View 3D Reasoning in VLMs cs.CV | cs.LGPDF

Nhat-Tan Bui, Varshini Elangovan, Arun Reddy Anugu, Sreyas Mohan, Wei Ye

TL;DR: 本文提出CoVeR，一种基于覆盖度的确定性、无需训练的视觉令牌剪枝方法，用于多视图3D推理任务。该方法通过仅利用令牌坐标信息，选择能够全面覆盖场景各区域的令牌，解决了现有学习重要性方法和体素化方法在冗余令牌处理上的局限性。

Details

Motivation: 多视图图像表示3D场景虽可利用2D视觉语言模型的预训练先验，但会产生大量冗余视觉令牌，计算成本随视图数量增长。现有令牌剪枝方法在3D多视图场景中各有不足：学习重要性方法因空间冗余性导致区域覆盖不均；体素化方法无法精确控制令牌预算且存在饱和现象。

Result: 在三个3D推理基准测试中，CoVeR均超越先前SOTA方法，平均提升3.9个百分点。仅使用约8%的视觉令牌即可保留93.5%的全令牌性能，并在四个不同VLM上验证了其即插即用的泛化能力。

Insight: 创新性地将空间覆盖率与3D推理性能关联，提出仅依赖几何坐标的无训练剪枝机制。通过确保场景区域全覆盖和精确预算控制，突破了体素化饱和瓶颈，避免了学习方法的重复选择问题，为多模态3D推理提供了高效令牌压缩方案。

Abstract: Representing a 3D scene as multi-view images allows 2D VLMs to reason in 3D by reusing priors from pre-training, sidestepping the scarcity of annotated 3D data. However, it produces thousands of redundant visual tokens whose cost grows with every view. Existing visual token pruners fall into two families, each limited in the 3D multi-view setting. Learned importance methods rank tokens by attention or encoder features; because redundancy here is fundamentally spatial, they keep near-duplicate tokens from a few prominent regions and leave most of the scene unrepresented. Voxelization methods improve spatial coverage but cannot enforce an exact token budget and saturate as multi-view observations overlap in 3D, capping retention well below the target. We show that spatial coverage is associated with 3D reasoning performance and introduce CoVeR, a deterministic, training-free selector that uses only token coordinates, with no learned signals. CoVeR selects tokens that collectively cover every region of the scene, and solves the limitations of both families: it enforces an exact per-scene budget, breaks the voxelization saturation plateau, and avoids the near-duplicate selections of learned importance. Extensive experiments show CoVeR outperforms prior SOTAs on all three 3D reasoning benchmarks and generalizes as a plug-and-play module tested across four VLMs. Notably, with only $\approx$8% of visual tokens, it preserves 93.5% of full-token performance, surpassing SOTA by 3.9 percentage points on average across benchmarks.

[220] Studying Image Tokenizers as Visual Languages in Unified Multimodal Models cs.CV | cs.CLPDF

Siting Li, Zhengyang Wang, Simon Shaolei Du, Xi Chen, Yang Liu

TL;DR: 本文构建了一个纯自回归测试平台，通过分析多模态持续预训练中不同任务的验证损失，研究了图像分词器作为视觉语言在统一多模态模型中的行为。研究发现，任务特定损失需独立分析，图像到文本损失能更一致地预测下游性能，且图像分词器设计会影响文本建模。

Details

Motivation: 现有图像分词器评估方法（如孤立指标或仅生成/理解任务）未能充分捕捉其在多模态联合建模中的行为，因此需要一种更全面的评估框架来理解视觉语言与文本的交互。

Result: 在构建的测试平台上，通过多模态预训练任务（文本、图像、文本到图像、图像到文本）的损失分析发现，图像到文本损失与监督微调后的生成和理解性能均相关，而文本到图像损失的关系则随图像分词空间变化。

Insight: 创新点在于提出以任务特定损失为透镜来评估图像分词器，揭示了重建质量与下游性能的非必然关联，以及分词器设计对联合建模的影响；客观分析表明，该方法为分词器设计提供了更细粒度的评估视角。

Abstract: Image tokenizers define the ``visual language’’ of unified multimodal models, yet are commonly studied through isolated metrics or generation-/understanding-only evaluations. These evaluations do not fully capture how visual tokens behave when modeled jointly with text. We build a controlled pure-autoregressive testbed and track task-specific validation losses during multimodal continual pretraining across text, image, text-to-image (T2I), and image-to-text (I2T) prediction. We examine how these losses scale and relate to downstream performance, then use them to study multimodal learnability—how well image and text tokens are jointly modeled—and tokenizer design. We find that (1) losses should be analyzed by task, since they exhibit distinct scaling behavior and rank tokenizers differently. (2) The loss–performance relationship depends on the predicted token space: for a fixed tokenizer, T2I and I2T losses correlate with generation quality, but across tokenizers, the T2I loss–performance relationship shifts with the image-token space, whereas I2T loss, computed over a shared text vocabulary, provides a more consistent signal. I2T loss also correlates with both generation and visual understanding performance after supervised finetuning. Using losses as a lens, we show that (3) better reconstruction does not necessarily yield lower task-specific losses or stronger downstream performance, and that (4) image tokenizer choice can affect text modeling under joint optimization. As case studies, we revisit three tokenizer design axes—the discriminator, semantic supervision, and vocabulary size—to examine their effects on joint modeling and downstream performance. Together, our testbed offers a complementary perspective on image tokenizers as visual languages, highlighting their interplay with text in joint multimodal training.

[221] To Adapt or Not to Adapt? Selective Adaptation for Vision-Language Models cs.CV | cs.LGPDF

Siru Jiang, Yuwei Liang, Jian Liang, Ran He, Tieniu Tan

TL;DR: 本文提出了一种名为选择性适应的新问题，旨在决定是否对给定的测试样本进行测试时适应（TTA）。作者观察到现有TTA方法存在两种失败模式：适应过程经常无效，或者反而将原本正确的预测变为错误。为此，他们提出了一个简单的基线方法——交叉增强相似性（CAS），该方法仅在增强视图间的预测相似度较低时才执行适应。

Details

Motivation: 现有测试时适应方法在应对分布偏移时，经常出现适应无效甚至有害的情况，即要么预测不变，要么将正确预测变为错误。这促使研究者思考能否识别并跳过这些无益或有害的适应过程。

Result: 提出的CAS基线方法在跳过近85%的适应过程的情况下，不仅保持了整体准确率，在某些情况下甚至有所提升。

Insight: 创新点在于引入了选择性适应的新问题，并提出了一个基于跨增强视图预测相似度的简单而有效的启发式基线。这为未来研究提供了一个新方向，即如何更智能地决定何时进行适应，以避免无效或负面的适应效果。

Abstract: Test-time adaptation (TTA) has emerged as a prominent strategy for adapting vision-language models to distribution shifts during inference. We conduct a per-sample analysis of model predictions before and after adaptation, and observe two failure modes in existing TTA methods that echo previous work. Adaptations are frequently negligible, yielding no change in the model’s predictions, and more severely, they can be detrimental by flipping previously correct predictions to incorrect ones. This naturally raises a question: Can we identify and skip such negligible or harmful adaptations? In this work, we introduce a new problem of selective adaptation, which aims to determine whether a given test sample should undergo adaptation or be skipped. To this end, we propose Cross-Augmentation Similarity (CAS), a simple baseline that performs adaptation only when predictions across augmented views exhibit low similarity. Notably, CAS not only preserves but in some cases improves overall accuracy, even when skipping nearly 85% of the adaptation process. We hope other researchers will explore this new direction and surpass the performance of our baseline. Our code is available at https://github.com/sirujiang/selective-adaptation.

[222] Segment Any Motion with Radar: Robust Multimodal Moving-Object Segmentation and Tracking cs.CV | cs.AIPDF

Jue Wang, Xuan Wang, Hao Zhou, Ruixiang Zhou, Yixuan Zhou

TL;DR: 该论文提出了一个名为RGBTR-Motion的固定摄像头多模态基准数据集，它同步提供了RGB、热成像和雷达数据流，并带有密集的实例掩码和跨时间的身份一致性标注。同时，论文还提出了SAM-Radar框架，这是一个基于SAM 3构建的、融合RGB、热成像和雷达数据的运动目标分割与跟踪方法，旨在利用雷达直接测量径向速度的优势，解决恶劣光照、天气、反射和遮挡条件下的感知难题。

Details

Motivation: 现有基于外观、光流或估计轨迹的运动感知方法在恶劣条件（如光照不足、恶劣天气、反射和遮挡）下会失效。雷达能直接测量径向速度，是解决此问题的天然方案，但缺乏同时提供雷达测量、密集运动实例掩码和时间一致身份标注的基准数据集。

Result: 在提出的RGBTR-Motion基准上，SAM-Radar取得了0.7027的IoU和0.8090的F1-50分数。在跟踪指标上，其MOTA、HOTA和IDF1分别比最强的竞争方法提升了0.2977、0.1603和0.2857，达到了SOTA水平。

Insight: 核心创新点在于提出了一个融合雷达、RGB和热成像的多模态基准数据集，以及一个利用雷达直接测量进行运动监督的检测器。该方法通过将雷达回波投影到图像位置并进行前景分类，无需文本提示即可有效抑制杂波，并利用雷达回波作为物理证据，在目标视觉特征退化或短期遮挡时维持轨迹关联，从而提升了鲁棒性。

Abstract: Moving-object perception must decide which image regions correspond to real motion and keep every instance identified over time. Methods that read motion from appearance, optical flow, or estimated trajectories lose that evidence under poor illumination, adverse weather, reflections, and occlusion. Radar is a natural remedy because it measures radial velocity directly instead of inferring it from photometric correspondence. However, existing benchmarks do not jointly provide radar measurements, dense moving-instance masks, and temporally consistent identities for surveillance. We therefore introduce RGBTR-Motion, a synchronized and calibrated fixed-camera benchmark that pairs RGB, thermal, and radar streams with dense instance masks and temporally consistent identities across diverse surveillance scenes. We also develop SAM-Radar, an RGB, thermal, and radar-based segmentation and tracking framework built on SAM 3. SAM-Radar’s radar-aware detector fuses calibrated RGBT features with radar returns that are grounded at their projected image locations, and motion supervision, implemented as foreground classification of those projected returns, teaches the detector to reject clutter without any text prompt. The tracker associates accepted radar returns with individual trajectories and uses them as physical evidence that a visually degraded target remains present. This allows it to bridge short periods of low visibility or occlusion and reconnect a reappearing target to its existing identity instead of starting a new track. SAM-Radar attains 0.7027 IoU and 0.8090 F1-50, and raises MOTA, HOTA, and IDF1 by 0.2977, 0.1603, and 0.2857 over the strongest competing values.

[223] Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method cs.CV | cs.AIPDF

Boao Yu, Zimo Chen, Junreng Rao, Yue Hu, Zhengqiu Zhu

TL;DR: 该论文提出了一个面向城市环境中空地协同目标搜索（AGOS）任务的基准测试AGOS-Bench、数据集AGOS-Dataset以及一个无需训练的智能体方法AGOS-Agent。AGOS任务要求无人机和无人车协同工作，根据多视角视觉参考来搜索和验证指定目标车辆。论文通过引入基准和数据集来评估通用视觉语言模型在此任务中的能力，并提出了一个基于工具增强的智能体框架来提升模型性能。

Details

Motivation: 城市环境中的空地协同目标搜索是一个未被充分探索的具身智能任务，现有研究缺乏专门的基准来评估通用视觉语言模型在此类动态协调任务中的能力。

Result: 在九个视觉语言模型上的广泛实验表明，AGOS-Agent方法提升了其中八个模型的整体成功率，并减少了所有模型的决策步骤。在困难子集上，Gemini-3.6-Flash的成功率从8.6%提升至55.7%，路径长度加权成功率从7.6%提升至44.0%。

Insight: 论文的创新点在于构建了首个空地协同目标搜索的基准和数据集，并提出了一种无需训练、基于工具增强的智能体方法。该方法通过设计明确的‘搜索-移交-验证’协作协议，将复杂的动态协调任务解耦，仅要求视觉语言模型负责场景理解和决策，从而有效提升了任务性能。

Abstract: Air-Ground Object Search (AGOS) in urban environments is a challenging embodied task, which requires an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV) to jointly search for and verify a specified target vehicle from multi-view visual references. To study this underexplored problem, we introduce AGOS-Bench, the first dedicated benchmark for evaluating whether general-purpose Vision-Language Models (VLMs) can integrate aerial discoveries and ground-level verification through UAV-UGV cooperation. We further provide AGOS-Dataset as the companion resource of exemplary trajectories constructed by an automatic pipeline. It consists of 7.7k episodes for searching objects of diverse categories and attributes, spanning three difficulty levels. To address the AGOS task, we propose AGOS-Agent, a training-free and tool-augmented approach. The agentic method relieves VLMs from complex and dynamic coordination via a deliberate search-handoff-verify cooperation protocol, only demanding VLMs for scene understanding and decision-making. Extensive experiments on nine VLMs show that AGOS-Agent improves overall success rate for eight of the nine evaluated backbones while reducing decision steps for all nine. On the hard split, the SR and SPL of Gemini-3.6-Flash increase from 8.6% to 55.7% and from 7.6% to 44.0%, respectively.

[224] CAR-MIL: Counterfactual Attention Regularization for Multiple Instance Learning cs.CVPDF

Imane Chraki, Pierre Marza, Stergios Christodoulidis, Maria Vakalopoulou

TL;DR: 本文提出CAR-MIL框架，通过引入反事实注意力正则化目标来改进多示例学习中的注意力机制。该方法在标准注意力MIL架构上增加了一个轻量级反事实注意力分支，旨在通过最小化、结构化的注意力重分布来改变预测，从而引导注意力学习更可靠地反映实例重要性。

Details

Motivation: 现有MIL方法中的注意力权重并不总能忠实反映实例重要性，可能关注虚假相关区域，因此需要一种机制来显式引导注意力学习，提高其可靠性和可解释性。

Result: 在具有实例级真值的合成MIL基准和五个数字病理学数据集（涵盖四个任务）上评估，CAR-MIL保持了有竞争力的分类性能，在更具挑战性的任务上提升最大，同时提高了注意力可靠性。

Insight: 创新点在于将反事实可解释性推理整合到注意力学习中，通过事实与反事实注意力图捕捉互补证据：前者突出支持预测的区域，后者揭示重新加权会挑战预测的区域，从而引导注意力分配更具信息性。

Abstract: Multiple Instance Learning (MIL) is widely used for weakly supervised learning, particularly in digital pathology, where fine-grained annotations are costly. Most MIL methods aggregate instance features via attention mechanisms. However, attention weights do not always faithfully reflect instance importance and may focus on spuriously correlated regions. In this work, we propose CAR-MIL, a framework that explicitly guides attention learning through a counterfactual attention regularization objective inspired by counterfactual explanations. Built on a standard attention-based MIL architecture, our approach introduces a lightweight counterfactual attention branch trained to produce an alternative prediction while remaining close to the factual attention distribution. This encourages prediction changes to arise from minimal, structured redistributions of attention, leading to more informative evidence allocation. The resulting factual and counterfactual attention maps capture complementary evidence: the former highlights regions supporting the prediction, while the latter reveals regions whose reweighting would challenge it. We evaluate our method on synthetic MIL benchmarks with instance-level ground truth enabling controlled analysis of attention behavior and on five digital pathology datasets across four tasks. CAR-MIL maintains competitive classification performance, with the largest gains observed on more challenging tasks, while improving attention reliability, demonstrating the benefits of integrating counterfactual explainability reasoning into attention learning. Code is available at: https://github.com/ImaneCR/CAR-MIL/.

Shanwei Fan, Bin Zhang, Zhiwei Xu, Yingxuan Teng, Siqi Dai

TL;DR: 本文提出AirAnchor，一种新的零样本空中视觉与语言导航范式，通过空间锚点桥接局部与全局空间信息，并将其整合到共享的导航框架中，以实现全面的空间感知与决策。

Details

Motivation: 现有零样本方法通常仅在单一空间尺度上操作，要么依赖当前观测构建的局部表示，要么依赖历史经验构建的全局记忆，这限制了无人机在复杂城市环境中基于自然语言指令进行精确导航的能力。

Result: 在AerialVLN基准上的大量实验表明，AirAnchor显著优于现有的零样本基线方法，验证了所提范式的有效性和效率。

Insight: 创新点在于通过查询驱动的空间锚点定位、持久性物体空间记忆以及空间感知导航代理三个核心组件，实现了局部与全局空间信息的显式整合，为决策提供了更全面的空间基础。从客观角度看，这种多尺度空间信息的桥接与融合策略是提升零样本导航性能的关键。

Abstract: Aerial Vision-and-Language Navigation requires drones to follow natural-language instructions and navigate through complex urban environments. Accurate navigation relies on both local and global spatial information, which support immediate action grounding and long-horizon path planning, respectively. However, existing zero-shot methods typically operate at a single spatial scale, relying either on local representations constructed online from current observations or on global memories built offline from historical experience. To address this limitation, we propose AirAnchor, a new paradigm that bridges local and global spatial information through spatial anchors and integrates both into a shared navigation framework, enabling comprehensive spatial grounding for decision-making. AirAnchor consists of three core components: (1) Query-Driven Spatial Anchor Grounding, which identifies decision-relevant anchors from visual observations and organizes them into local spatial representations; (2) Persistent Object Spatial Memory, which incrementally maintains an object knowledge base as persistent global spatial memory and retrieves landmark-related spatial priors; and (3) a Spatially-Informed Navigation Agent, which explicitly integrates both local and global spatial information into an agentic framework for decision-making. Extensive experiments on AerialVLN demonstrate that AirAnchor substantially outperforms existing zero-shot baselines, validating the effectiveness and efficiency of the proposed paradigm.

[226] SignRefine: Adapting Foundational Video Models for Sign Language Generation cs.CVPDF

Anton Pelykh, Edward Fish, Ozge Mercanoglu Sincan, Richard Bowden

TL;DR: 本文提出SignRefine模型，用于从2D关键点条件生成手语视频。该模型基于预训练的视频扩散Transformer，通过引入具有空间定位的局部适配器来选择性细化手部和面部区域，从而纠正现有视频扩散模型在手语生成中产生的伪影问题。为支持研究，作者还构建了大规模原生手语视频数据集NVSign。

Details

Motivation: 现有视频扩散模型主要基于口语视频训练，在手语生成中会产生伪影，导致手语难以理解。因此，需要一种能够从关键点条件生成清晰、可理解手语视频的方法。

Result: 在NVSign数据集上训练后，模型在手部姿态精度指标上比最强基线提升高达30%。在手语用户的偏好评估中，该模型在超过80%的比较中因视觉质量和可理解性更受青睐。

Insight: 创新点在于利用预训练视频扩散模型的先验，通过空间定位的局部适配器进行针对性区域（手、脸）细化，实现了仅从2D关键点生成跨外观和视觉条件的手语视频。同时，构建大规模原生手语数据集NVSign为领域研究提供了重要资源。

Abstract: Sign language video generation demands precise hand and facial articulation, yet modern video diffusion models, trained predominantly on spoken-language video, produce artifacts that render signing unintelligible. We propose SignRefine, a sign language video generation model that produces comprehensible signing from 2D keypoint conditioning alone, generalizing across appearances and visual conditions. Our approach builds on a pretrained video diffusion transformer and introduces local adapters with spatial grounding to selectively refine hand and face regions, steering the strong base model’s prior toward accurate articulation. To enable this work and support broader sign language research, we present NVSign, a large-scale dataset of video content natively produced in sign language, offering diverse signer appearances, environments, and natural conversational settings. Trained on this data, our model shows up to 30% improvement in hand pose precision metrics over the strongest baseline and is preferred by sign language users for visual quality and comprehensibility in more than 80% of comparisons.

[227] Temporal State Transport in Video Generation: Diagnosing and Correcting Spectral Imbalance cs.CV | cs.LGPDF

Luyao Tang, Bingjun Luo, Dong Yi, Jialin Guo, Haoning Xi

TL;DR: 本文提出了一种基于时序状态传输的视频生成诊断与校正方法。通过引入光谱张力指标来识别视频生成中的两种时序故障：碎片化传输和过度混合热点，并提出了无需训练的谱传输稳态调节器来纠正这些病理状态，从而提升时序一致性和视觉质量。

Details

Motivation: 现有无训练方法主要关注跨帧注意力或局部注意力熵，但未能揭示时序交互是否处于健康的传输状态。论文旨在通过时序状态传输的视角，诊断并校正视频生成中的光谱不平衡问题，以确保模型能够跨时间保持视觉属性（如身份、场景布局、运动等）的一致性。

Result: 在预训练视频生成模型上的实验表明，原始模型常处于不平衡的时序状态，而所提方法能选择性地对最差的时序热点应用更大校正，在不进行微调的情况下改善了时序一致性和视觉质量。

Insight: 创新点在于从时序状态传输的角度诊断视频生成问题，提出了光谱张力这一可解释的诊断指标，并设计了无需训练的谱传输稳态调节器来动态校正病理状态，为视频生成的时序一致性提供了新的分析和优化框架。

Abstract: Reliable video generation requires more than high-quality frames to form a coherent story: a model must maintain a persistent state, transporting visual attributes such as identity, scene layout, motion, and fine details across time. Existing training-free methods mainly strengthen cross-frame attention or analyze local attention entropy, but these views do not reveal whether temporal interactions stay in a healthy transport regime. In this work, we study video generation through the perspective of Temporal State Transport. We introduce Spectral Tension, a signed diagnostic that compares local attention diffuseness with global spectral diversity, and use it to identify two opposite temporal failures: fragmented transport and over-mixing hotspots. Based on this diagnosis, we propose Spectral Transport Homeostasis, a training-free regulator that softly corrects pathological temporal states while largely preserving balanced ones. Experiments on pretrained video generation models show that the original model often occupies imbalanced temporal regimes, whereas our method selectively applies larger corrections to the worst temporal hotspots and improves temporal consistency and visual quality without finetuning. Code: https://github.com/lytang63/temporal-state-transport

[228] STSG-VQA: Evidence-Grounded Temporal Question Answering from Surgical Spatio-Temporal Scene Graphs cs.CVPDF

Jing Li, Duygu Sarikaya

TL;DR: 本文提出了STSG-VQA基准，用于评估手术视觉语言模型（VLMs）的时序推理能力。该方法通过构建时空场景图（STSG）来显式建模手术状态的动态演变，并基于此生成可追溯证据的问答对。实验表明，使用STSG监督微调模型能显著提升其在所有时序类别上的准确率。

Details

Motivation: 现有手术视觉语言模型的监督主要是帧级别的，缺乏对手术工作流动态的显式建模，导致时序推理能力受限。

Result: 在STSG-VQA基准上，使用STSG监督微调Qwen3-VL-4B和Hulu-Med-4B模型，相比其零样本基线分别提升了24.39和19.56个百分点，相比静态场景图监督分别提升了16.50和14.25个百分点，在所有时序类别上均取得显著提升。

Insight: 创新点在于提出了多层次的时序监督方法，通过增强对象连续性、事件交互连续性和流程连接性来构建时空场景图（STSG），并基于此生成可追溯证据的问答对，为手术VLMs提供了更有效的时序推理监督信号。

Abstract: Despite recent advances in surgical vision-language models (VLMs), temporal reasoning remains limited because existing supervision is largely frame-centric. Frame-level scene graphs (SGs) have proven effective in providing structured representations of surgical environments but do not explicitly model the dynamics of surgical workflows. To explicitly model how surgical states evolve across time, we introduce a multi-level structured temporal supervision methodology that augments frame-level surgical SGs with object-level continuity, event-level interaction continuity, and procedure-level connectivity. We then execute temporal queries over the resulting spatio-temporal scene graphs (STSGs) to generate evidence-grounded question-answer pairs, which together form the STSG-VQA benchmark. Each question is linked to the temporal interval and STSG evidence used to derive its reference answer, enabling traceable verification. The benchmark contains 18,458 question-answer pairs across seven temporal categories. Fine-tuning Qwen3-VL-4B and Hulu-Med-4B with STSG-derived supervision improves question-level micro accuracy by 24.39 and 19.56 percentage points over their zero-shot baselines and by 16.50 and 14.25 points over static scene-graph supervision, respectively. These gains span all temporal categories, indicating that STSG-derived supervision helps surgical VLMs reason over temporally grounded interactions rather than isolated frames. The code and dataset will be made publicly available upon acceptance.

[229] Layer Selection in VLMs for Zero-Shot OOD Detection via Multi-Resolution Entropy Estimation cs.CVPDF

Shyam Nandan Rai, Francesco Di Salvo, Sebastian Doerrich, Christian Ledig

TL;DR: 本文提出了一种用于视觉语言模型（VLM）零样本分布外（OOD）检测的中间层选择方法。现有方法通常仅依赖最终层嵌入，但作者发现在医学影像中，中间层能提供互补的OOD信号，且最佳表征深度取决于图像模态。为解决传统单分辨率熵估计对分箱选择敏感的问题，本文提出了一种多分辨率熵估计策略，通过聚合多个离散化尺度的直方图统计量来实现鲁棒且稳定的中间层选择。

Details

Motivation: 动机在于解决医学AI系统安全部署中的关键问题——分布外检测。现有基于VLM的零样本OOD检测方法几乎完全依赖最终层嵌入，这一假设在医学影像中并不成立，因为中间层包含重要信息且最佳深度因模态而异。同时，现有的基于熵最小化的层选择方法对分箱选择高度敏感，导致性能不稳定。

Result: 在两个医学OOD基准测试（MIDOG和OASIS）上，该方法在涵盖不同成像模态、多样偏移类型和不同VLM骨干网络的情况下，均一致优于最先进的方法。

Insight: 创新点在于挑战了“最深表征层最优”的普遍假设，并揭示了医学影像中中间层表征的互补价值。核心方法创新是提出了多分辨率熵估计策略，通过跨多个离散化尺度聚合统计量，解决了单分辨率熵估计的敏感性和不稳定性问题，为轻量级、稳定的零样本OOD检测提供了新思路。

Abstract: Out-of-distribution (OOD) detection is crucial for safe deployment of medical AI systems, where domain shifts arise across institutions, acquisition protocols, and patient populations. VLMs enable zero-shot OOD detection by embedding images into a language-aligned latent space, where cross-modal similarity serves as a non-parametric confidence signal for identifying in-distribution samples. Yet existing methods rely almost exclusively on final-layer embeddings, implicitly assuming that the deepest representations are universally optimal. We first show that this assumption does not hold in medical imaging: intermediate layers provide complementary OOD signals, and the optimal representational depth depends on the respective image modality. While prior work selects layer combinations via entropy minimization of normalized histograms, we demonstrate that single-resolution entropy estimation is highly sensitive to binning choices, leading to performance variations of up to 19.3% AUROC. To address this instability, we propose a multi-resolution entropy estimation strategy that aggregates histogram statistics across multiple discretization scales, enabling robust and stable intermediate-layer selection. Across two medical OOD benchmarks, namely MIDOG and OASIS, covering distinct imaging modalities, diverse shift types, and different VLM backbones, our method consistently outperforms state-of-the-art approaches, offering a lightweight and stable solution for zero-shot OOD detection.

[230] From Where to How: Continuous 4D Interaction Forecasting from Egocentric Video cs.CV | cs.AIPDF

Qiaohui Chu, Haoyu Zhang, Meng Liu, Haoxiang Shi, Dongmei Jiang

TL;DR: 该论文提出了Coherent4D数据集和HIGFlow框架，用于解决以自我为中心视角的4D交互预测问题，即预测未来交互在3D空间中的连续位置以及实现该交互的全身姿态。HIGFlow采用级联的‘从何处到如何’流程，先预测交互位置，再以此引导生成多样且结构一致的全身运动。

Details

Motivation: 现有方法难以将语义理解转化为精确的连续3D定位，且在姿态预测中难以平衡运动多样性与结构一致性。更根本的是，交互位置与身体运动之间的连续几何和时间对应关系常被分开建模，未能充分捕捉。

Result: 在涵盖三个领域的Coherent4D数据集上进行的大量实验表明，该方法在位置和姿态预测任务上均优于代表性基线模型，消融实验也验证了所提组件的有效性。

Insight: 核心创新在于提出了一个统一的、级联的‘从何处到如何’预测框架，将交互位置预测与姿态生成耦合起来，并通过确定性的运动锚点和残差流匹配技术来保证运动多样性与结构一致性。同时，贡献了一个大规模、时空对齐的4D交互预测数据集和相应的连续空间评估指标。

Abstract: Egocentric 4D interaction forecasting aims to anticipate both where future interactions will occur in 3D and how the human body will move to realize them, providing an important capability for assistive robotics and human-computer interaction. Existing methods struggle to translate semantic understanding into precise continuous 3D localization and to balance motion diversity with structural consistency in pose forecasting. More fundamentally, these tasks are often modeled separately, leaving the continuous geometric and temporal correspondence between interaction locations and body motion insufficiently captured. To address these challenges, we introduce Coherent4D, a large-scale egocentric dataset for continuous 4D interaction forecasting, comprising approximately 233K samples across three domains. Each sample pairs a sequence of future 3D interaction locations with corresponding full-body poses, aligned in time and expressed in a shared coordinate system. We also provide evaluation metrics in continuous space. Building on this formulation, we propose HIGFlow, a Hand Interaction Guided Residual Flow framework that models forecasting as a cascaded where-to-how process. HIGFlow first forecasts continuous future interaction locations by combining semantic grounding with short-horizon visual dynamics, and then uses the predicted location sequence to condition a deterministic motion anchor and residual Flow Matching for diverse yet structurally consistent full-body motion forecasting. Extensive experiments across all three domains demonstrate consistent improvements over representative baselines on both location and pose forecasting, while ablations validate the contributions of the proposed components. The project page is available at https://corrineqiu.github.io/from-where-to-how/.

[231] Charts Are Beyond Pixels: Probing for Layer-Wise Chart Understanding and Editing cs.CV | cs.LGPDF

Xiaochuan Zhong, Yifan Hou, Chenxi Pang, Shaobo Cui

TL;DR: 本文提出了LayerWiseBench，一个用于评估视觉语言模型在图表理解和编辑任务中层级能力的基准。该基准围绕图层归属、图层绑定和可见性排序三个核心概念构建，包含来自14种图表类型的2800个源图表，并从中衍生出大量理解和编辑任务。评估发现，现有模型在处理涉及重叠组件前后关系的任务时存在显著挑战。

Details

Motivation: 现有图表基准主要评估最终输出的正确性或保真度，无法直接评估模型对图表内部层级结构（如图层功能角色、语义对应关系和可见性关系）的理解和操作能力。

Result: 在评估的VLM中，Qwen3.5-27B在图层归属和图层绑定任务上分别达到93.04%和97.46%的准确率，但在可见性排序任务上仅为61.46%。在评估的图像编辑器中，整体mIoU在1.49%到4.93%之间，其中涉及可见性约束的编辑任务mIoU最低（0.37%到2.00%）。

Insight: 论文的创新点在于提出了首个专注于图表层级结构理解和编辑的基准，并揭示了处理重叠组件前后关系是当前模型在图表任务中普遍存在的瓶颈，这为未来模型需要更显式地建模组件身份和可见性关系提供了方向。

Abstract: Charts are structured visual compositions whose elements have distinct functional roles, semantic correspondences, and visibility relations. This structural view motivates evaluating whether models can understand and manipulate charts at the layer level. Existing chart benchmarks, however, primarily assess the correctness or fidelity of final outputs and do not directly evaluate these layer-wise behaviors. We present LayerWiseBench, a benchmark organized around three core concepts, layer attribution, layer binding, and visibility ordering, that structure its chart-understanding and chart-editing evaluations. Generated from executable chart programs, LayerWiseBench pairs each rendered chart with spatially aligned per-layer RGBA assets and construction-derived labels for functional roles, semantic bindings, and visibility relations. From this layer-wise representation, we derive controlled understanding questions, editing targets, reference images, and evaluation regions. It contains 2,800 source charts across 14 chart paradigms, from which we derive 7,329 layer-wise understanding questions and 53,791 instruction-guided editing variants. Among the evaluated VLMs, Qwen3.5-27B, which achieves the highest QA macro-average, obtains 93.04% accuracy on layer attribution and 97.46% on layer binding, but only 61.46% on visibility ordering. Across the four evaluated image editors, overall mIoU ranges from 1.49% to 4.93%, and visibility-constrained edits have the lowest mIoU for every editor, ranging from 0.37% to 2.00%. Taken together, these results identify tasks involving front-to-back relations between overlapping components as a recurring challenge across understanding and editing, motivating more explicit modeling of component identity and visibility relations.

[232] TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection cs.CV | cs.AIPDF

Adrien Dorise, Marjorie Bellizzi, Julia Cohen, Stéphane May

TL;DR: 本文提出了TriCCOT，一种用于星载地球观测目标检测的三部分架构，旨在解决计算资源有限和图像未完全校正的挑战。该架构结合了卷积区域提议网络、保形预测阶段和硬件友好的注意力分类器Aper-GATES，以在FPGA上实现高效部署。实验在DIOR和VDVRaw数据集上展示了其竞争性的检测性能和鲁棒性，并成功在Xilinx Versal VCK190 FPGA上部署。

Details

Motivation: 星载目标检测面临计算资源有限和原始噪声图像的约束，卷积检测器硬件高效但表示能力不足，而基于Transformer的模型全局推理能力强但难以在FPGA上部署。

Result: 在DIOR和VDVRaw数据集上，TriCCOT相比其他FPGA兼容架构，实现了竞争性的检测性能，并提升了对空间模糊和信号相关噪声的鲁棒性。

Insight: 创新点包括三部分架构整合、保形预测提供概率覆盖保证，以及Aper-GATES通过卷积投影和硬件友好门控操作重构自注意力，避免了传统Transformer操作，实现了CNN-Transformer统一推理在嵌入式平台的部署。

Abstract: Onboard object detection in Earth observation is constrained by limited computational resources and the absence of fully corrected imagery. While convolutional detectors are hardware-efficient, they often struggle to extract robust representations from raw and noisy data. Conversely, transformer-based models provide stronger global reasoning capabilities but remain difficult to deploy on FPGA accelerators due to quadratic attention complexity and non-compatible operations. We introduce TriCCOT, a tri-part architecture for robust and deployable onboard object detection. TriCCOT combines a convolutional region proposal network, a conformal prediction stage, and Aper-GATES, our hardware-friendly attention-based classifier. The region proposal network generates candidate bounding boxes, which are subsequently enlarged via conformal prediction, providing a distribution-free probabilistic coverage guarantee. The resulting crops are processed by Aper-GATES, which reformulates self-attention through convolutional projections, global channel statistics, and hardware-friendly gating operations, avoiding standard transformer operations that are poorly suited to CNN-oriented accelerators. Experiments on the DIOR and VDVRaw datasets demonstrate competitive detection performance and improved robustness to spatial blur and signal-dependent noise when compared to FPGA-compatible architectures. Finally, we report full deployment on a Xilinx Versal VCK190 FPGA without modifying the underlying DPU architecture, enabling unified CNN-Transformer inference for spaceborne embedded applications.

[233] CausalChapter: Improving Long-Video Chaptering with Interventional Dependency Modeling cs.CV | cs.AIPDF

Xinran Duan, Guozhang Li, Yaoyao Zhong, Mei Wang, Lizhi Wang

TL;DR: 本文提出CausalChapter框架，用于改进长视频（特别是教学视频）的自动章节划分任务。该框架通过轻量级的掩码和移除干预来估计预测级影响，以解决现有方法中边界误差传播和跨章节上下文碎片化的问题。

Details

Motivation: 长格式教学视频需要自动章节划分以支持浏览、导航和知识访问。现有的基于长上下文语言模型的方法成本高且对内容密集、文本长、主题过渡平滑的讲座视频脆弱；而可扩展的“先分割后描述”范式虽降低成本，但引入了边界误差传播和跨章节上下文碎片化两个新挑战。

Result: 在长视频章节划分基准测试上的实验表明，CausalChapter在边界定位、章节描述质量和跨章节连贯性方面均有提升。

Insight: 创新点在于提出了一个受干预启发的因果推理框架，包含局部依赖转移模块用于边界定位（通过检测相邻时间窗口间预测依赖性的下降），以及跨片段支持选择模块用于章节描述生成（根据对当前预测的支持度对历史上下文进行重排序）。这为处理长序列任务中的依赖建模和上下文选择提供了新思路。

Abstract: Long-form instructional videos require automatic chaptering to support browsing, navigation, and knowledge access. Recent long-context language models can perform chaptering from textualized video inputs, but they remain costly and brittle for content-dense lecture videos with long transcripts, smooth topic transitions, and detailed chapter outputs. A scalable segment-then-caption paradigm reduces this cost, but introduces two new challenges: boundary error propagation and fragmented cross-chapter context. We propose \textbf{CausalChapter}, an intervention-inspired framework for long-video chaptering that estimates prediction-level influence through lightweight masking and removal interventions. For boundary localization, our Local Dependency Shift module detects drops in predictive dependency between adjacent temporal windows; for chapter description generation, our Cross-Segment Support Selection module reranks historical contexts according to their support for the current prediction. Experiments on long-video chaptering benchmarks show that CausalChapter improves boundary localization, chapter description quality, and cross-chapter coherence.

[234] Kairos: A Dataset for Fine-Grained Video-Language Modeling over Space, Time, and Dynamics cs.CV | cs.AIPDF

Ruibo Ming, Lei Sun, Deheng Zhang, He Zhang, Jialu Li

TL;DR: Kairos是一个用于细粒度视频语言建模的数据集，包含长时视频（10分钟至半小时）并带有时间解析的标注，涵盖动作、实体、交互和上下文线索的时序对齐，旨在支持细粒度评估、长程建模、指令数据构建、表示学习和视频生成。

Details

Motivation: 现有视频数据集大多依赖粗粒度或稀疏对齐的监督，压缩了时序变化，限制了模型学习连续视觉动态的可复用表示，因此需要构建一个能建模长时间视觉内容的数据集。

Result: 论文未在摘要中提及具体定量结果或基准测试，但强调Kairos数据集为视频语言建模提供了通用基础，支持多种下游任务。

Insight: 创新点在于引入时间解析的细粒度标注，使模型能够捕捉视频中随时间展开的动态变化，为长时视频理解和生成任务提供了更丰富的监督信号。

Abstract: Many emerging video language modeling tasks require systems to move beyond clip-level abstraction and model visual content as it unfolds over extended time horizons. However, most existing video datasets rely on coarse or sparsely aligned supervision, which compresses temporal variation and limits the ability of models to learn reusable representations of continuous visual dynamics. We introduce Kairos, a video dataset for video-language modeling with time-resolved annotations. Kairos consists of long-duration videos, ranging from ten minutes to half an hour, annotated with fine-grained temporal alignment. The annotations capture ongoing actions, entity appearances and attributes, interactions, and evolving contextual cues along the video timeline. This time-resolved structure supports fine-grained evaluation, long-range modeling and reasoning, instruction data construction, representation learning, and video generation. Kairos provides a general-purpose foundation for modeling visual experiences over time.

[235] CVT-GS: Learning to Simplify 3D Gaussian Splatting with Centroidal Voronoi Tessellation cs.CVPDF

Bingxian Li, Yilong Li, Jingliang Peng, Peng-Shuai Wang, Fei Zhu

TL;DR: 本文提出CVT-GS，一种无需优化的后处理简化框架，用于压缩已训练的3D高斯泼溅（3DGS）场景。该方法通过几何感知的质心Voronoi剖分（CVT）构建空间连贯单元，并使用轻量级神经单元合并器在可微渲染监督下为每个单元预测单个代表性高斯的几何与外观。

Details

Motivation: 3DGS在实时新视角合成中表现强大，但高保真渲染通常依赖大量高斯基元，导致显著的存储和计算开销。现有简化技术多为侵入式，需要训练时剪枝、架构修改或昂贵的逐场景微调，限制了其在预训练模型上的部署。

Result: 在多个数据集上的实验表明，该方法在实现100倍高斯点减少时，比现有最优方法快12倍，同时PSNR提升1.3 dB。

Insight: 创新点在于将简化定义为渲染感知的多对一合并过程，而非简单基元剪枝，从而生成与现有渲染器无缝兼容的标准3DGS场景。这提供了一种非侵入式、高效的后处理压缩方案。

Abstract: While 3D Gaussian Splatting (3DGS) has emerged as a powerful representation for real-time novel view synthesis, rendering high-fidelity scenes often relies on a massive number of Gaussian primitives, incurring substantial storage and computational overhead. Existing simplification techniques are largely intrusive, requiring training-time pruning, architectural modifications, or computationally expensive per-scene fine-tuning. These drawbacks limit their deployment on off-the-shelf pretrained models. In this paper, we propose CVT-GS, a novel optimization-free post-hoc simplification framework that directly compresses trained 3DGS scenes without sacrificing visual fidelity. Our approach first constructs spatially coherent cells over Gaussian centers via a geometry-aware Centroidal Voronoi Tessellation (CVT). Subsequently, a lightweight neural cell merger predicts the geometry and appearance of a single, highly representative Gaussian primitive for each cell under differentiable rendering supervision. By formulating simplification as a rendering-aware many-to-one merging process rather than naive primitive pruning, CVT-GS outputs a standard 3DGS scene that is seamlessly compatible with existing renderers. Experiments on various datasets demonstrate the superiority of our method. Notably, when achieving a 100-fold reduction in Gaussian points, our method operates 12 times faster than state-of-the-art methods while improving the PSNR by 1.3 dB.

[236] Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark cs.CVPDF

Xupeng Zhang, Xihang Wang, Michael Xie, Haoyuan Liang, Hau Ern Lien

TL;DR: 本文针对三叉神经痛（TN）术前评估中MRI-MRA图像融合的注册问题，提出了一个以感兴趣区域（ROI）为中心的神经血管注册评估基准。通过构建包含149名患者临床标注数据的基准，评估了六种代表性注册流程，发现传统全脑注册评估方法在局部ROI评估中具有误导性，并指出TN的MRI-MRA注册应被视为局部、血管感知、对比度敏感和视野感知的可视化任务。

Details

Motivation: 解决三叉神经痛术前评估中MRI（显示神经结构）与MRA（显示血管结构）图像融合的临床需求，传统全脑注册评估方法无法准确反映小ROI区域的临床相关性，且存在血管标注不全、局部对比度变化和视野不匹配等问题。

Result: 在149名患者的临床标注基准上评估了六种注册流程，使用局部图像相似性、血管定位指标等多项指标；结果显示传统评估总结常具误导性，可变形细化相比仿射对齐仅带来有限且视野依赖的改进。

Insight: 创新点在于将TN的MRI-MRA注册重新定义为以ROI为中心的神经血管注册评估问题，并构建了专门的临床基准；客观分析表明，该研究强调了多模态医学图像注册评估需考虑局部解剖结构、血管特异性、图像对比度和视野匹配性，而非通用全脑方法。

Abstract: Preoperative evaluation of trigeminal neuralgia (TN) often requires joint interpretation of structural MRI, which depicts the trigeminal nerve and surrounding cisternal anatomy, and time-of-flight MRA, which highlights vascular structures. Although MRI-MRA fusion is clinically attractive for visualizing neurovascular compression, this task is poorly captured by conventional whole-brain registration evaluation because the clinically relevant target is a small trigeminal ROI, vessel annotations are partial and clinically focused, local TOF-MRA contrast is variable, and field-of-view mismatch can limit deformable alignment. We formulate TN MRI-MRA fusion as an ROI-centered neurovascular registration-evaluation problem and construct a benchmark from 149 patients with clinician-annotated bilateral trigeminal ROIs. Six representative registration pipelines were evaluated using local image-based metrics, segmentation-derived vessel-localization metrics, prediction-volume analysis, and contrast- and FOV-stratified comparisons. Conventional evaluation summaries were often misleading: local image similarity, vessel-background separability, and downstream vessel localization did not co-rank methods; one-sided vessel distances were strongly affected by predicted vessel extent under partial annotations; and local MRA contrast determined when vessel-separability metrics were informative. Deformable refinement provided only a small, FOV-dependent benefit over affine alignment, while reader review showed that locally favorable vessel distances could coexist with globally implausible registrations. These findings indicate that TN MRI-MRA registration should be evaluated as a local, vessel-aware, contrast-sensitive, and FOV-aware visualization task rather than as generic multimodal brain registration. Our code is publicly available at https://github.com/jhuldr/TN-Reg-Benchmark.

[237] FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minute cs.CV | cs.ROPDF

Hongchi Xia, Tianhang Cheng, Wei-Chiu Ma, Shenlong Wang

TL;DR: FIRE3D是一个统一的端到端前馈框架，能够在一分钟内将单张RGB图像或随意拍摄的RGB视频转换为可用于游戏和交互应用的、模拟就绪的3D场景资产。其核心是预测一个组合式场景表示，包括每个物体的6自由度位姿、边界框、网格和纹理。

Details

Motivation: 解决从单目RGB输入快速重建交互就绪的3D场景的问题，旨在生成物理解耦、可直接用于模拟和交互的完整3D环境，克服现有方法速度慢或物体级完整性不足的局限。

Result: 在多个数据集上，在位姿精度、几何完整性和纹理质量方面展示了具有竞争力或达到最先进水平（SOTA）的结果，且运行速度比之前的交互就绪方法快数个数量级。

Insight: 创新点在于将场景建模为离散实体的集合，实现了模态完整的模拟就绪重建，无需测试时优化，是首个快速、前馈且提供物体级完整性的3D场景重建框架。

Abstract: We present FIRE3D, a unified framework that takes a single RGB image or casual RGB video and transforms it into simulation-ready 3D scene assets for games and interactive applications in under a minute. At the core of FIRE3D is a feed-forward, end-to-end network that predicts a compositional scene representation from posed RGB-D observations estimated from the RGB capture, including the 6-DoF pose, bounding box, mesh, and texture for every object. By modeling the scene as a collection of discrete entities, FIRE3D produces amodally complete and simulation-ready environments where objects are physically decoupled and ready for interaction. Our framework requires no test-time optimization, runs orders of magnitude faster than prior interaction-ready methods, and provides object-level completeness beyond existing feed-forward 3D approaches. We demonstrate competitive or state-of-the-art results across pose accuracy, geometry completeness, and texture quality across various datasets while being orders of magnitudes faster. Project page: https://xiahongchi.github.io/Fire3D/

[238] DSE-VTG: Dual-Side Enhancement for Training-Free Video Temporal Grounding cs.CVPDF

Zhuo Cao, Bingqing Zhang, Sen Wang, Xue Li

TL;DR: 本文提出了DSE-VTG，一种无需训练的双边增强框架，用于解决文本引导的视频时序定位任务。该方法通过多尺度相似性融合整合帧级和片段级视觉信息以捕捉时序动态，并通过查询级测试时适应优化查询嵌入以解决歧义，从而在无需任务特定训练的情况下提升了定位性能。

Details

Motivation: 解决现有无需训练的VTG方法面临的两个核心信息瓶颈：逐帧视觉编码忽略了视频的时序动态，而固定的查询嵌入无法处理查询文本的歧义性。

Result: 在三个标准基准和两个分布外基准上的实验表明，DSE-VTG在无需训练的方法中达到了最先进的性能。在Charades-STA上，其mIoU比之前最强的无需训练方法提升了5.61个点；在分布偏移的Charades-CG Novel-Word上，其mIoU达到50.86，超过了最强的有监督基线2.76个点。

Insight: 创新点在于双边增强：视觉侧通过多尺度相似性融合统一了时序感知的相似性特征；文本侧通过轻量级的查询级测试时适应，在测试时动态调整查询嵌入以适应具体视频，无需微调骨干网络或调用外部大语言模型，实现了高效且鲁棒的无需训练定位。

Abstract: Text-guided Video Temporal Grounding (VTG) aims to localize the relevant segments in an untrimmed video based on text queries, yet collecting dense temporal annotations and training task-specific models remain costly and brittle under distribution shift. Recent training-free VTG approaches mitigate this issue by directly matching pretrained vision-language representations, but they still face two fundamental information bottlenecks: frame-wise visual encoding overlooks temporal dynamics, while fixed query embeddings cannot resolve query ambiguity. To address these issues, we propose DSE-VTG, a \underline{D}ual-\underline{S}ide \underline{E}nhancement framework that addresses both without any task-specific training. On the visual side, Multi-scale Similarity Fusion (MSF) combines frame- and clip-level similarities into a unified, temporally aware similarity profile. On the textual side, Query-level Test-Time Adaptation (Q-TTA) optimizes a lightweight additive offset to adapt the query embedding to the video at test time, without finetuning the backbone or calling external large language models. Extensive experiments on three standard and two OOD benchmarks show that DSE-VTG achieves state-of-the-art performance among training-free methods. On Charades-STA, it improves mIoU over the strongest prior training-free method by 5.61 points. Under distribution shift, DSE-VTG reaches 50.86 mIoU on Charades-CG Novel-Word, surpassing the strongest supervised baseline by 2.76 mIoU. Our code will be released upon acceptance.

[239] SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation cs.CVPDF

Linnan Zhao, Xu Liu, Lingling Li, Licheng Jiao, Fang Liu

TL;DR: SeGDeP是一种用于推理分割任务的显式语义-几何解耦提示方法，通过独立的语义提示分支和几何投影路径，将多模态大语言模型（MLLM）的输出转换为语义特征和边界框，共同指导SAM 3掩码解码器生成精确分割掩码。该方法采用两阶段训练策略，包括接口对齐和基于组奖励解耦策略优化的反馈平衡，在多个基准测试中实现了优异性能。

Details

Motivation: 现有MLLM-分割器接口通常将语义识别和空间定位信号耦合在单一上下文中，导致难以区分失败源于目标解释错误还是定位错误，因此需要设计解耦接口以明确分离语义和几何信息处理。

Result: SeGDeP-4B在八个RefCOCO系列数据集上平均cIoU达到82.7，在ReasonSeg验证集和测试集上分别获得66.0和59.6的gIoU，仅通过LoRA微调了Qwen3-VL参数的0.38%，实现了高效且高性能的分割。

Insight: 创新点在于提出显式的’什么-哪里’解耦接口，通过独立路径分别处理语义和几何信息，避免信号混淆；采用GDPO训练策略平衡多目标反馈，并通过实验验证了两条路径的互补性而非冗余性，为多模态推理任务提供了可解释的模块化设计思路。

Abstract: Reasoning segmentation converts an implicit linguistic conclusion into a precise mask, requiring both semantic identification and spatial grounding. Existing MLLM-segmenter interfaces either use a special trigger or compress both signals into one context, although they receive different supervision and fail differently. This coupling obscures whether a failure arises from target interpretation or from localization. We present SeGDeP, an explicit what-where interface. A semantic prompt branch and an independent geometric projection path transform resolved MLLM states into semantic features and a DETR-predicted box, which jointly condition a SAM 3 mask decoder. Training first aligns this executable interface, then uses group reward-decoupled policy optimization (GDPO) to balance format, box-IoU, and mask-IoU feedback. SeGDeP-4B reaches 82.7 average cIoU over eight RefCOCO-family splits and 66.0/59.6 gIoU on ReasonSeg val/test while adapting only 0.38% of Qwen3-VL parameters through LoRA. Controlled stage-wise ablations, gradient diagnostics, and prompt interventions further show that the two paths develop complementary semantic and geometric specialization rather than duplicating the same evidence.

[240] EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning cs.CVPDF

Jingpu Yang, Fengxian Ji, Mingxuan Cui, Yilin Sun, Hang Zhang

TL;DR: 论文提出EgoSIS，一种无需姿态信息的适配器，用于无人机视频问答任务。它通过三个阶段将RGB图像导出的双向光流转换为运动规范化的视觉证据，以分离相机运动和场景变化，从而提升模型的空间推理能力。

Details

Motivation: 无人机视频问答需要区分相机运动和场景变化，但仅依赖RGB的多模态模型缺乏明确且稳定的参考来进行这种分离。

Result: 在SIS-Bench基准测试上，EgoSIS-8B模型在感知任务上达到89.9%准确率，感知加记忆任务上达到82.5%，整体准确率为76.2%，在自我感知和记忆任务上提升最为显著。

Insight: 创新点在于提出了一个三阶段、可解释的适配器架构，将光流分解为运动、残差支持和可靠性因子，并通过可靠性门控记忆和零初始化残差注入空间证据，无需改变基础视觉模型的token数量。

Abstract: UAV video question answering requires separating camera motion from changes in the scene, but RGB-only multimodal models receive no explicit, stable reference for that separation. We present EgoSIS, a pose-free adapter that converts RGB-derived bidirectional flow into motion-canonical visual evidence in three stages. Factorized Visual Ego-Transitions (FVET) fits a robust image-plane transition and exposes motion, residual-support, and reliability factors. Reliability-Gated Ego-Transition Memory (ReTEM) uses reliability-weighted updates for a bounded history and re-anchors it at cuts or sustained uncertainty. Ego-Aligned Spatial Evidence (EASE) warps supported visual features into each segment’s local anchor and injects four spatial evidence tokens per visual slice through zero-initialized residuals, without changing Qwen’s visual-token count. On SIS-Bench, EgoSIS-8B obtains 89.9% perception, 82.5% perception-plus-memory, and 76.2% overall accuracy, with the largest gains concentrated in self-awareness perception and memory. The adapter thus provides an interpretable interface between optical flow and spatial reasoning.

[241] CoSA: Correlation-Guided Change A ttention with Learnable Residual Gating for Remote Sensing Change Detection cs.CVPDF

Abdirashid Omar, Jonghyuk Park

TL;DR: 本文提出了一种用于遥感变化检测的CoSA方法，通过相关性引导的变化注意力和可学习的残差门控机制来提升性能。论文在目标域（CCTV图像）上使用少量标注数据和大量未标注数据进行了实验，并强调了伪标签评估与自训练标签隔离的重要性。

Details

Motivation: 解决固定交通摄像头图像像素级标注成本高的问题，以及从街景图像训练的模型应用于高空CCTV时存在的视角和外观差异，旨在开发数据高效的目标域处理流程。

Result: 在40张手动验证图像上获得88.91%的IoU作为可辩护的目标域结果；伪标签内部一致性达到98.52% IoU，但并非基于人工标注的真实准确率；在NVIDIA RTX A6000 GPU上实现77.03 FPS的推理速度。

Insight: 创新点包括相关性引导的变化注意力机制和可学习的残差门控结构；客观分析认为，论文强调了伪标签评估需与自训练标签隔离的实践洞察，对半监督学习中的评估方法具有借鉴意义。

Abstract: Pixel-level annotation of fixed traffic-camera imagery is expensive, while crosswalk models trained from street-level imagery face a substantial viewpoint and appearance shift when applied to elevated CCTV. We investigate a data-efficient target-domain pipeline using 241 manually annotated CCTV images and 5,926 unlabeled CCTV frames. A source-domain experiment trains a 31.0M-parameter custom U-Net on 3,300 first-person-view (FPV) images and obtains 93.05% IoU on its 330-image FPV test split. This result is a source baseline, not transferred performance: the released CCTV notebook instantiates a 42.0M-parameter DeepLabV3-ResNet50 from torchvision weights, and no compatible mapping from the U-Net checkpoint is implemented. Training on 201 manual CCTV images and selecting on 40 held-out manual masks yields 88.91% IoU. The model then predicts all unlabeled frames; image-level certainty and a largest-component area prior rank the candidates, and the top 1,000 attain mean certainty 0.976 and mean combined score 0.988. A repository audit shows that the reported second-stage 98.52% IoU was measured on a 150-image split containing only teacher-generated pseudo-masks. Because of a directory-layout mismatch, the executed combined-data loader found zero manual samples and split 1,000 pseudo-labeled samples into 850 training and 150 evaluation samples. We therefore report 98.52% as internal pseudo-label agreement rather than human-ground-truth accuracy. The defensible target-domain result is 88.91% IoU on the 40 manual validation images. Batch-one FP32 inference at 512 x 512 requires 12.98 ms, corresponding to 77.03 FPS, on an NVIDIA RTX A6000 48 GB GPU. These findings support the practicality of confidence-and-geometry filtering while also showing why pseudo-label evaluation must remain isolated from the labels used for self-training.

[242] Prior-free relative 6D pose estimation of multiple object instances cs.CVPDF

Behdad Khodabandehloo, Andrea Caraffa, Davide Boscaini, Fabio Poiesi

TL;DR: 本文提出了一种无需先验知识的相对6D姿态估计方法（PROSE），用于估计同一图像中多个未知物体实例之间的相对姿态，无需CAD模型、模板或参考图像。该方法利用多模态基础特征建立实例间的粗略对应关系，并通过循环一致性进行优化，最终实现全局一致的对应关系以估计相对6D姿态。

Details

Motivation: 现有物体6D姿态估计方法逐渐减少对物体特定先验的依赖，但仍需已知物体类别或参考信息。本文旨在进一步消除这一假设，解决在未知物体场景下估计多个实例相对姿态的问题。

Result: 在基于三个多实例BOP数据集构建的新基准（PRENCH）上，PROSE方法在无需任务特定监督或额外学习组件的情况下，一致优于将现有单图像SOTA方法适配到该设置得到的基线。

Insight: 创新点在于提出了完全无需先验的相对6D姿态估计新设定，并利用多模态基础特征和跨实例的循环一致性实现无训练的姿态估计，为未知物体姿态估计提供了新思路。

Abstract: Object 6D pose estimation formulations have progressively reduced reliance on object-specific priors, evolving from explicit 3D models to multi-view object captures to single reference images. We take this progression to its extreme by introducing prior-free relative 6D pose estimation, which lifts the assumption of knowing which object is to be posed within the scene. This novel setting aims to estimate the relative poses of multiple instances of an unknown object within the same image, without requiring CAD models, templates, or reference images. We solve this by formulating a novel method (PROSE) that finds coarse correspondences between object instances using multimodal foundation features, thus requiring no training. We refine these correspondences by imposing cycle consistency across tuples of instances, and leverage the resulting globally consistent correspondences to estimate the relative 6D pose between any pair of instances. To enable systematic evaluation, we design a novel benchmark (PRENCH) built from three multi-instance BOP datasets and enriched with task-specific metadata. PROSE consistently outperforms baselines obtained by adapting state-of-the-art single-image methods to the proposed setting, while requiring neither task-specific supervision nor additional learned components. Project website: https://tev-fbk.github.io/PROSE/

[243] Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval cs.CVPDF

Shuaiqi Cheng, Siyu You, Yanbi Wu, Yuxi Chen, Jiahao Zhang

TL;DR: 本文针对部分相关视频检索（PRVR）任务中，现有方法因过度依赖局部最强响应而导致误检的问题，提出了名为TRACE的评分级证据验证算子。该方法通过激活查询相关的全局视频寄存器，将其支持路由至帧级证据，并在局部时序选择前平滑边缘化替代路径，从而对原始局部评分进行查询条件化的残差校准。

Details

Motivation: 现有PRVR方法在最终排序时往往仅信任最强的局部响应，导致与查询仅偶然相似的视频片段会产生无根据的高分峰值，作者将此问题定义为查询无关的集中瓶颈。

Result: 在ActivityNet Captions、Charades-STA和TVR三个基准测试上，TRACE均取得了最佳的SumR分数，并分别将DreamPRVR骨干网络的性能提升了1.2、1.1和1.5个点。

Insight: 核心创新在于提出了一个评分级的、查询条件化的证据验证算子，它不进行表示级的特征融合，而是将全局上下文证据作为残差来校准局部评分，从而缓解了查询无关的集中瓶颈。消融实验等分析表明性能提升源于证据验证机制本身，而非简单的分数偏移。

Abstract: Partially Relevant Video Retrieval (PRVR) retrieves untrimmed videos when queries describe only short moments. Although recent methods improve local representations, uncertainty modeling, and global context, final ranking often still trusts the strongest local response; a coincidentally similar fragment can therefore produce an unsupported peak. We identify this failure as the query-agnostic concentration bottleneck and propose TRACE, a score-level evidence verification operator for PRVR. Given a query and global video registers, TRACE activates query-relevant registers, routes their support to frame-level evidence, and smoothly marginalizes alternative query-to-register-to-frame paths before localized temporal selection. Unlike representation-level feature fusion, TRACE uses this evidence only as a query-conditioned residual calibration of the original local score. On ActivityNet Captions, Charades-STA, and TVR, TRACE achieves the best SumR on all three benchmarks and improves the DreamPRVR backbone by 1.2, 1.1, and 1.5 points, respectively. Ablation, routing-corruption, hard-negative, and cross-backbone transfer analyses support the interpretation that the gains arise from query-conditioned evidence verification rather than a generic score offset.

Yungsoo Han, Youngseok Jang, Seungwon Roh, Jeongyeon Seo, H. Jin Kim

TL;DR: DXPR是一种基于深度的跨模态地点识别框架，利用视觉基础模型将单目相机查询与激光雷达地图进行匹配，无需特定模态编码器。该方法通过将相机图像和激光雷达扫描转换为统一的深度图像表示，使机器人能在预建激光雷达地图中仅使用相机进行鲁棒定位，适应季节、天气和光照变化。

Details

Motivation: 解决机器人和自动驾驶车辆在严重季节、天气和光照变化下，仅使用相机在预建激光雷达地图中进行鲁棒定位的挑战，避免依赖特定模态编码器。

Result: 在KITTI里程计和Boreas数据集上的广泛实验显示，DXPR在大多数序列上实现接近完美的Recall@1，优于先前的跨模态地点识别基线；在Boreas上，DXPR在序列内性能与强单模态基线（DINOv2-SALAD）相当，在更具挑战性的序列间设置中表现更优，且比RangeBEV在序列内和序列间评估中均更稳健。

Insight: 创新点包括使用视觉基础模型学习模态不变的全局描述符，以及引入几何感知重叠挖掘器，通过跨模态尺度对齐和前向扭曲测量计算像素级重叠分数，以自适应调整多相似性损失中的正边距，避免在弱重叠视图上过拟合，提升几何保真度。

Abstract: We present DXPR, a depth-based cross-modal place recognition (CMPR) framework that uses vision foundation models (VFMs) to match monocular camera queries against a LiDAR map without modality-specific encoders. This enables robots and autonomous vehicles to robustly localize using only cameras within pre-built LiDAR maps, even under severe seasonal, weather, and illumination changes. The key idea is to convert both camera images and LiDAR scans into a unified depth image representation so that a single VFM backbone with an aggregation head can learn modality-invariant global descriptors. To make pairwise metric learning faithful to scene geometry, we introduce a geometry-aware overlap miner: after cross-modal scale alignment of camera and LiDAR depth, we forward-warp measurements between views to compute a pixel-level overlap score. This score relabels ambiguous pairs and adaptively modulates the positive margin in a multi-similarity loss to avoid overfitting on weakly overlapping views. Extensive experiments on KITTI odometry and Boreas demonstrate strong performance and robustness across seasons, weather, and day/night. On KITTI, DXPR achieves near-perfect Recall@1 on most sequences and outperforms prior CMPR baselines. On Boreas, DXPR achieves intra-sequence performance on par with a strong single-modal baseline (DINOv2-SALAD), while showing clear improvements in the more challenging inter-sequence setting. Compared with RangeBEV, our method consistently performs better in both intra- and inter-sequence evaluations, demonstrating robustness under diverse seasonal and illumination changes.

[245] PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decoding cs.CVPDF

Xiang Liu, Jinxiang Wang, Bin Chen, Zimo Liu, Mingyao Hong

TL;DR: 本文提出了一种名为PIC的基于隐式神经表示（INR）的前馈图像编码架构，旨在解决现有INR编码器编码速度慢和解码效率未充分利用的问题。该方法通过单次前向传播计算INR网络所需信息，实现了20 FPS的编码速度和2000 FPS的解码速度，在率失真性能上与JPEG相当或更优。

Details

Motivation: 尽管INR在图像编码中展现出解码复杂度低的优势，但其实际应用受到编码速度慢和解码效率未充分利用的限制。本文旨在设计一个同时具备实用编码速度和极快解码速度的INR图像编解码器。

Result: PIC在率失真性能上与JPEG相当或更优，同时实现了20 FPS的编码速度和2000 FPS的解码速度，显著超越了JPEG的解码性能。据作者所知，这是首个在学习型图像编解码器中，在RD性能和解码速度上同时优于或媲美JPEG，并保持实用编码速度的工作。

Insight: 主要创新点在于提出了一个前馈INR架构，将编码过程简化为单次前向传播，极大提升了编码速度；同时通过高度优化的解码器实现亚毫秒级解码，将INR的理论解码优势转化为实际性能，为学习型编解码器的实时应用提供了新思路。

Abstract: Implicit neural representation (INR) has achieved remarkable progress in novel view synthesis and image/video coding in recent years.Compared to conventional end-to-end image codecs, INR-based compressors demonstrate significant advantages in decoding complexity. However, their practical application has been hindered by the inferior encoding speed and underutilized decoding efficiency.In this work, we propose a feedforward INR image coding architecture, Practical INR Image Codec (PIC), that computes all the necessary information for INR network in a single forward pass, achieving an encoding speed of 20 FPS. Additionally, we implement a highly optimized decoder that reaches 2000 FPS decoding speed, significantly surpassing JPEG’s performance at comparable rate-distortion (RD) performance. To the best of our knowledge, this work presents the first learning-based image codec that simultaneously outperforms or is comparable with JPEG in both RD performance and decoding speed while maintaining practical encoding speed. Code is available at https://github.com/actcwlf/PIC.

[246] Task-driven Processing with Coarse-to-Fine Glimpse-based Active Perception cs.CVPDF

Oleh Kolner, Thomas Ortner, Stanisław Woźniak, Angeliki Pantazi

TL;DR: 本文提出了CF-GAP（从粗到细的基于瞥视的主动感知）方法，作为现有实例检测器的任务驱动前端。它通过选择性引导一系列有限视野的瞥视来迭代聚焦相关区域，从而在高分辨率杂乱场景中增强处理能力，避免全图处理并消除无关信息干扰。

Details

Motivation: 现有视觉模型通常处理整张图像，缺乏根据特定任务（如实例检测）选择性聚焦相关区域的能力，在高分辨率杂乱场景中关键细节容易丢失。

Result: 在HR-InsDet和Robotools基准测试上，CF-GAP将各种最先进实例检测器的平均精度（AP）提升了高达20%，并使得轻量级检测器性能超越更大模型。

Insight: 创新点在于将任务信息融入主动感知过程，通过从粗到细的瞥视序列迭代优化关注区域，实现了计算效率和高精度处理的平衡，为高分辨率任务处理提供了新范式。

Abstract: State-of-the-art vision models process images in their entirety, lacking the ability to selectively zoom in on relevant regions. This limitation is particularly acute in scenarios where processing must be conditioned on a specific task - such as instance detection, which requires localizing a specific object in a high-resolution, cluttered scene. In such settings, critical details are easily lost as images are often resized to match the model dimensions and computational constraints. We introduce Coarse-to-Fine Glimpse-based Active Perception (CF-GAP), a task-driven front-end that enhances high-resolution processing of existing instance detectors. CF-GAP selectively directs a sequence of limited view glimpses across the scene, utilizing task information to iteratively refine focus on the most relevant regions. These localized regions are then processed at high resolution by a downstream instance detector. By avoiding full-image processing and eliminating irrelevant confounding information, CF-GAP improves Average Precision (AP) by up to 20% across various state-of-the-art instance detectors on the HR-InsDet and Robotools benchmarks, while further enabling lightweight detectors to outperform their larger counterparts.

[247] “World Knowledge” in the Weights: Reading Concept Circuits of Vision Transformers cs.CVPDF

Yanlin Chen, Tang Li, Xi Peng

TL;DR: 该论文提出了一种使用跨层转码器（CLTs）从视觉Transformer（ViTs）中读取概念电路的方法，以揭示模型内部如何表示世界结构。概念电路是有向图，节点对应稀疏、可解释的概念，边捕捉跨层的概念交互。该方法提供了全局概念电路（输入不变，从权重中恢复，揭示编码的’世界知识’）和实例概念电路（输入依赖，解释具体预测）两种互补视图，并展示了其在自动发现虚假相关性、移除虚假相关性（在Waterbird数据集上优于现有方法11.0%）以及模型比较（如对比CLIP与DINO）方面的应用。

Details

Motivation: 解决视觉Transformer内部如何表示世界结构这一未知问题，旨在通过可解释的概念电路来理解模型的内部工作机制和编码的知识。

Result: 在Waterbird数据集上，通过干预实例概念电路来移除虚假相关性，方法比现有方法提升了11.0%的性能；同时，通过全局概念电路对比了不同基础模型（如CLIP与DINO）的表示结构。

Insight: 创新点在于提出概念电路作为可解释性工具，将模型权重中的’世界知识’可视化为稀疏概念图，并区分全局与实例视图，从而支持虚假相关性发现、模型干预和比较，为理解Transformer的内部表示提供了新途径。

Abstract: Vision transformers (ViTs) have achieved remarkable generalization across visual domains, yet little is known about how they internally represent the structure of the world. To address this gap, we use Cross-Layer Transcoders (CLTs) to read concept circuits from ViTs: directed graphs whose nodes correspond to sparse, interpretable concepts and edges capture concept interactions across layers. Our method yields two complementary views of model behavior. The global concept circuit is input-invariant and can be recovered directly from learned cross-layer weights, exposing the reusable “world knowledge” encoded in the model. The instance concept circuit is input-dependent and identifies the concepts and pathways actually used for a specific prediction, enabling faithful example-level explanations. We demonstrate the utility of concept circuits in three ways: (1) Automatic spurious correlation discovery: leveraging the statistics of our global concept circuits to identify shortcut dependencies within the model. (2) Spurious correlation removal: intervening on the instance concept circuit to steer the model towards correct predictions. Empirical results show that our method outperforms existing counterparts by 11.0% on the Waterbird dataset. (3) Model comparison: contrasting the global concept circuits of different foundation models (e.g., CLIP vs. DINO) to reveal how supervision paradigms shape representational structure. Our code is available at https://github.com/deep-real/VisionCLT

[248] Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout cs.CVPDF

Zhuoran Zhao, Shengju Qian, Tongtong Liang, Xianghao Kong, Songchun Zhang

TL;DR: 本文提出了一种名为Mask Forcing的双噪声掩码展开策略，旨在解决自回归视频扩散蒸馏中因反向KL散度的模式寻求行为导致的模式塌缩问题，从而提升生成视频的视觉质量和真实感。该方法通过在自回归学生模型的自展开过程中，沿空间和时间轴随机注入更干净的信号来扰动输入，鼓励模型探索教师分布的更多区域，并改善中间预测以减少误差累积。

Details

Motivation: 现有方法通过分布匹配蒸馏将预训练的双向视频扩散模型提炼为因果自回归学生模型，但生成的视频常存在过饱和和过度平滑问题，视觉质量和真实感有限，其根本原因是DMD中反向KL目标导致的模式寻求行为，使学生分布塌缩到教师分布的少数模式上。

Result: 大量实验表明，该方法能有效提升多种自回归视频扩散蒸馏方法的视觉质量，且无需引入真实视频数据或额外的训练后处理阶段。

Insight: 核心创新点在于提出了双噪声掩码展开策略，通过随机掩码在自展开过程中注入干净信号来扰动输入，这既鼓励了学生对教师分布更广泛的探索，又通过干净令牌为噪声令牌提供了去噪指导，从而缓解模式塌缩并减少误差积累，是一种高效且无需额外数据的改进方案。

Abstract: Autoregressive (AR) video diffusion models have shown great potential in real-time video generation. Recent methods distill pretrained bidirectional video diffusion models into causal AR students through Distribution Matching Distillation (DMD), but the generated videos often suffer from over-saturation and over-smoothing issues, resulting in limited visual quality and realism. The key contributing factor is the mode-seeking behavior of the reverse KL objective in DMD, which can cause the student distribution to collapse onto only a few modes of the teacher distribution. To address this, we propose Mask Forcing, a Dual-Noise Masking Rollout strategy that perturbs the AR student self-rollout to mitigate mode collapse induced by reverse-KL mode seeking. The core idea is to inject cleaner signals into noisy rollout inputs via random masks along spatial and temporal axes during the self-rollout process of AR diffusion distillation. Such perturbations encourage the student rollouts to explore more regions of the teacher distribution, allowing DMD to provide learning signals beyond the modes already covered by the student. Moreover, the cleaner tokens act as denoising guidance for other noisier tokens, improving the intermediate rollout predictions and reducing error accumulation. Extensive experiments demonstrate that our method improves multiple AR video diffusion distillation methods with higher visual quality efficiently, without incorporating real video data or additional post-training stages.

[249] GoDeep: Annotation-Free Open-Vocabulary 3D Scene Understanding via Language-Space Lifting cs.CV | cs.AIPDF

Thodoris Betsas, Anastasios Doulamis, Andreas Georgopoulos

TL;DR: GoDeep提出了一种无需标注的开放词汇3D场景理解方法，通过将视觉语言模型作为翻译器，生成结构化、实体级的图像描述，并在纯语言嵌入空间中进行投影和聚合，无需3D训练数据或编码器。该方法在ScanNet++上与基于标注的基线方法竞争，并在文化遗产基准测试中通过词汇修正展示了更忠实的内容跟踪能力，能有效定位场景中的未见对象，且预测结果在点级别可解释。

Details

Motivation: 解决现有开放词汇3D语义分割方法通常将CLIP特征提升到3D空间，导致组合任务中表现类似词袋模型，且即使无需标注的变体也常需要大量3D训练数据和特定领域编码器的问题。

Result: 在ScanNet++上，该方法与在ScanNet上训练的强无需标注基线方法竞争；在5栋文化遗产基准测试中，通过系统词汇修正后性能优于基于CLIP的变体，且在ScanNet++上能准确定位真正未见对象，证明语言空间嵌入比基于CLIP的嵌入更清晰地区分对象存在与缺失。

Insight: 创新点在于使用视觉语言模型作为纯翻译器生成结构化描述，直接在通用纯语言嵌入空间中进行处理，无需3D训练或编码器，实现了更忠实的内容跟踪、未见对象定位和点级别可解释性；通过启发式加权和可解释性特性，提出了优先精细元素定位的聚合策略作为概念验证。

Abstract: Open vocabulary 3D semantic segmentation methods typically lift CLIP features into 3D. This embeds points in a joint vision-language space known to behave like a bag-of-words on compositional tasks. Furthermore, even annotation free variants often require a large 3D training corpus and a dedicated 3D encoder per domain. Instead we use a vision-language model purely as a translator. It produces structured, entity-level descriptions of each posed image. These descriptions are grounded, projected, and aggregated directly in a general-purpose, language-only embedding space, with no 3D training corpus or encoder required. On ScanNet++, our pipeline is competitive with strong annotation free baselines trained on ScanNet. On a 5-building cultural heritage benchmark, raw scores initially favor a CLIP-based variant, but a single systematic vocabulary correction reverses this ranking. An effect confirmed by a second, independent correction on a different class, indicating that language-space embeddings track physical content more faithfully. This fidelity extends to genuinely out-of-vocabulary (OOV) objects on ScanNet++ proving that language-space embeddings separate presence from absence objects far more sharply than CLIP-based embeddings do. GoDeep also localize these OOV objects within the scene, all without any 2D-3D annotation. Because every representation remains discrete text, predictions are also explainable at the point level. Finally, exploiting both a heuristic weighting, that favors precise over merely frequent observations and GoDeep’s explainability property, we propose an aggregation strategy, as a proof of concept, that favors finer elements localization.

[250] Canonical Color as a Lens into Concept Decodability in Vision Encoders and VLMs cs.CV | cs.AIPDF

Xiaofu Chen, Stella Frank, Yova Kementchedjhieva

TL;DR: 该论文探讨了视觉编码器在图像输入中如何编码概念信息，特别是规范颜色信息。通过构建具有规范颜色的对象数据集，研究团队使用彩色和灰度图像探测视觉编码器对颜色和物体身份的线性可解码性。研究发现，即使从灰度图像中，规范颜色信息仍然可解码，并且与预测的物体身份相关联，这表明了概念层面的联系。进一步分析扩展到完整的视觉语言模型（VLMs），发现VLM的后训练对视觉编码器中颜色可解码性有显著影响。

Details

Motivation: 研究动机是探索视觉编码器在表示图像时，除了可见信息外，还包含多少概念信息，特别是规范颜色信息，以理解其内部语义表示。

Result: 实验结果表明，规范颜色信息在灰度图像中仍可线性解码，并与物体身份预测相关；在VLMs中，后训练显著影响颜色可解码性，提供了对概念语义信息的可控分析。

Insight: 创新点在于使用规范颜色作为可控测试案例，揭示了视觉编码器中概念信息的可解码性，以及VLM训练对编码器表示的影响，为理解视觉表示提供了新视角。

Abstract: Visual encoders construct a representation of the image input for Vision-Language models. How much conceptual, as opposed to immediately visible, information does this representation contain? We use canonical color as a controlled test case to ask whether vision encoders make canonical-color information linearly accessible, even when color is removed from the input image. We construct a dataset of objects with canonical colors, and probe vision encoders for both color and object identity using color and grayscale images. We find that canonical color remains decodable from grayscale images, and is tied to predicted object identity, indicating a conceptual link. Extending this analysis to full VLMs, we find that VLM post-training can have a surprisingly large effect on color decodability in the vision encoder. Overall, canonical color provides a usefully controllable lens for tracing object-level conceptual semantic information in vision encoders and VLMs.

[251] Point4D: Long-range 4D Motion Reconstruction cs.CVPDF

Minsik Jeon, Jay Karhade, Deva Ramanan, Shubham Tulsiani

TL;DR: Point4D是一个前馈模型，用于从长视频序列中进行4D（3D+时间）运动重建。它能够可靠地推断跨越数百帧视频的密集逐点3D轨迹，克服了现有方法仅限于几十帧短输入窗口的限制。其核心创新在于解耦了轨迹预测与图像平面可见性的灵活3D查询运动解码器，以及从任意可见帧提取并重用视觉描述符的策略。

Details

Motivation: 现有4D重建方法受限于短输入窗口（最多几十帧），无法处理长视频序列中的长期、密集3D运动轨迹重建问题。

Result: Point4D在多个超过200帧的长视频跟踪基准测试中取得了最先进的性能，大幅超越了之前的前馈4D方法。

Insight: 创新点在于提出了一个基于3D查询的运动解码器，将轨迹预测与图像可见性解耦，并允许跨视频块直接重新查询3D端点，无需重投影或匹配；同时，从点的任意可见帧提取视觉描述符进行重用，比仅依赖源图像块效果更好。

Abstract: We introduce Point4D, a feed-forward model for 4D reconstruction of long-range video sequences. Point4D is able to reliably infer dense per-point 3D trajectories across multi-hundred-frame videos, unlike existing 4D methods that are limited to short input windows of at most a few dozen frames. A key innovation that enables this is our flexible 3D query-based motion decoder that decouples trajectory prediction from image-plane visibility. The predicted 3D endpoints are then directly re-queried in the next chunk without re-projection or matching. Furthermore, we show that extracting and reusing a visual descriptor from an arbitrary frame where the point is visible leads to better performance than relying solely on the source patch. Overall, Point4D achieves state-of-the-art performance across diverse long-video tracking benchmarks spanning over 200 frames and largely outperforms previous feed-forward 4D method. Project page: https://point-4d.github.io

[252] SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators cs.CVPDF

Yuncong Yang, Zhengtao Han, Furkan Ozyurt, Zeyuan Yang, Han Yang

TL;DR: SyncWorld是一种动作条件化的世界模型，通过视觉校准片段（配对帧和动作）来指定特定设置下的动作-视觉映射，从而作为零样本模拟器在未见环境中运行，无需额外训练。

Details

Motivation: 解决世界模型在机器人应用中因视觉环境、相机视角、机器人放置或体现方式变化导致相同数值动作在像素空间中表现不一致的问题，以实现可靠的细粒度可控性。

Result: 实验表明，SyncWorld能在未见设置中准确模拟动作结果，其模拟能力支持测试时策略改进，无需训练。

Insight: 创新点在于利用视觉校准上下文来学习动作-视觉映射，使模型能通过视觉证据解释动作，并在缺乏显式校准时利用交互历史，提升泛化能力。

Abstract: World models are increasingly used as policy-in-the-loop imagination environments, where reliable rollouts require fine-grained controllability with respect to low-level robot actions. A key obstacle to scaling such models in robotics is that actions are not a universal language in pixel space: changes in visual environment, camera view, robot placement, or embodiment alter how the same numerical action manifests visually, leading to conflicting supervision under mixed training and brittle generalization at deployment. We introduce SyncWorld, an action-conditioned world model that serves as a zero-shot simulator across unseen environments without any additional training. SyncWorld leverages a visual calibration episode—paired frames and actions that showcase all the controllable degrees of freedom—to specify the setup-specific Action–Visual Mapping in context. Training with visual calibration contexts teaches the model to interpret actions through visual evidence and to leverage interaction history when explicit calibration is unavailable. Experiments show that SyncWorld can accurately simulate action outcomes in previously unseen settings, and that its capability of simulating rollouts enables test-time policy improvement without training.

physics.optics [Back]

[253] Reliable iToF Depth Sensing via Sensor-Intrinsic Uncertainty Modeling and State-Space Restoration physics.optics | cs.CVPDF

Yansong Du, Yutong Deng, Yuting Zhou, Zhancong Xu, Yingjia Lu

TL;DR: 本文提出了一种用于间接飞行时间（iToF）相机可靠深度感知的联合深度-不确定性建模与恢复框架。该框架首先从校准的传感器响应中开发了一个传感器本征的深度不确定性模型，用于生成异方差合成数据；然后设计了一个结合状态空间建模与卷积细化的U形恢复网络进行深度恢复。

Details

Motivation: 解决iToF相机在实际成像条件下，由于传感器本征不确定性导致的测距精度下降问题，以及现有合成数据（如空间均匀或仅与距离相关的高斯扰动）无法准确模拟真实iToF噪声特性所造成的合成-真实域差距。

Result: 在合成测试集上达到40.85 dB PSNR和2.54 mm MAE，在真实iToF测量数据上达到35.42 dB PSNR和4.87 mm MAE。实验验证了所提不确定性模型在不同距离和返回信号条件下的有效性，并证明其异方差数据合成方法能持续提升不同恢复骨干网络（如U-Net, Restormer）的性能。

Insight: 创新点在于提出了一个基于传感器校准响应的像素级深度不确定性模型，用于生成更真实的异方差合成数据，并设计了结合长程状态空间建模（DVSS块）与卷积空间-通道细化的网络结构，以实现结构保持的深度恢复。这种方法弥合了合成与真实数据的差距，并提升了恢复性能的鲁棒性。

Abstract: Indirect time-of-flight (iToF) cameras provide compact and cost-effective dense depth measurements, but their ranging accuracy is often degraded by sensor-intrinsic uncertainty under practical imaging conditions. Spatially uniform or range-only Gaussian perturbations cannot accurately reproduce the range-dependent and signal-dependent noise characteristics of real iToF measurements, leading to a synthetic-to-real gap for learning-based restoration. To address this problem, we propose a joint depth-uncertainty modeling and restoration framework for reliable iToF sensing. A sensor-intrinsic depth-uncertainty model is first developed from calibrated tap responses, returned-signal levels, and sensor noise statistics through a depth-oriented weighted least-squares formulation. The resulting pixel-wise uncertainty is used for heteroscedastic depth synthesis and uncertainty-aware restoration supervision. Based on this heteroscedastic data synthesis, we further develop a U-shaped restoration network with Depth Visual State Space (DVSS) blocks, which combine long-range state-space modeling with convolutional spatial-channel refinement for structure-preserving depth recovery. Experiments on synthetic data and measurements captured by an in-house iToF prototype validate the proposed uncertainty model under varying range and returned-signal conditions. Controlled comparisons with fixed and range-aware Gaussian noise, together with evaluations on U-Net, Restormer, and DVSS, further demonstrate that the proposed synthesis consistently benefits different restoration backbones. The complete framework achieves 40.85~dB PSNR and 2.54 mm MAE on the synthetic test set, and 35.42 dB PSNR and 4.87 mm MAE on real iToF measurements.

cs.AI [Back]

[254] Reasoning-Aware Compression: Identifying and Protecting Vulnerable Reasoning Circuits for Energy-Efficient LLM Deployment cs.AI | cs.CL | cs.PFPDF

Leonard Twagirayezu, Prasenjit Mitra

TL;DR: 本文提出了一种推理感知压缩框架，用于在大型推理模型部署中实现节能。该方法通过量化基准测试和硬件级GPU能耗测量，识别并保护易受损的推理电路，避免统一量化对关键推理路径的损害。研究发现INT4量化可能因延长推理链而增加能耗，且不同任务的脆弱性模式不同，通过选择性压缩可实现帕累托最优的能效提升。

Details

Motivation: 当前压缩方法对所有组件采用统一量化，可能损害大型推理模型中的关键推理电路，导致部署能耗高且性能下降。本文旨在开发一种能识别和保护这些脆弱电路的压缩框架，以实现更节能的部署。

Result: 在GSM8K、FOLIO、MATH-500、ProofWriter和MuSiQue五个推理基准上验证，选择性压缩在ProofWriter上使R1-Qwen-7B Top-10%模型比FP16精度提升12个百分点，同时能耗降低9.7%，实现了帕累托最优，而统一量化方法无法达到此效果。

Insight: 创新点在于提出推理感知压缩框架，通过量化脆弱性分析选择性保护敏感电路；客观分析发现推理电路的脆弱性具有任务依赖性（如注意力投影对数学推理更关键），且量化可能因延长推理链而抵消节能收益，这为高效LLM压缩提供了新视角。

Abstract: Large Reasoning Models (LRMs) impose substantial energy costs during deployment, yet current compression methods apply uniform quantization across all components, risking damage to critical reasoning circuits. We present a reasoning-aware compression framework that benchmarks quantization conditions across five reasoning benchmarks, GSM8K, FOLIO, MATH-500, ProofWriter, and MuSiQue, with hardware-level GPU energy measurement; profiles per-module INT4 vulnerability across all 196-224 (layer, projection) pairs via a perturbation sweep on a held-out calibration split, then selectively restores the most sensitive circuits to FP16. Three findings emerge. First, INT4 quantization can increase energy by extending reasoning chains; a 25% power reduction becomes a net energy increase on GSM8K. Second, vulnerability is task-dependent: attention projections are more critical for mathematical reasoning, and sensitivity patterns differ by architecture in logical inference. Third, selective compression achieves Pareto-optimal points inaccessible to uniform methods: R1-Qwen-7B Top-10% on ProofWriter gains +12 pp over FP16 at -9.7% energy, validated on held-out data across five reasoning benchmarks.

[255] EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent cs.AI | cs.CLPDF

Yirong Zeng, Shen You, Jinhang Feng, Yufei Liu, Xiao Ding

TL;DR: 本文提出了EnvCraft框架，旨在解决Agentic RL中交互式训练环境稀缺的问题。该框架通过环境合成引擎构建沙箱隔离的工作空间，并利用拓扑感知数据生成引擎产生连贯的任务轨迹，从而自动合成可执行环境和可扩展的训练数据。

Details

Motivation: 当前LLM正从被动语言接口转向自主的Claw-like智能体，但Agentic RL的扩展受到交互式训练环境严重匮乏的瓶颈限制。现有合成环境仅限于工具调用端点，无法满足此类智能体端到端的真实世界需求。

Result: 在Qwen3/3.5模型（8B-32B）上的实验表明，该方法在Claw-style基准测试上带来高达+11.9%的性能提升，在通用工具使用基准测试上提升+8.0%，同时降低了推理令牌成本。

Insight: 核心创新在于提出了一个自动化合成可执行环境和训练数据的框架，通过沙箱隔离和拓扑感知的数据生成，为Agentic RL提供了鲁棒且可泛化的学习信号，有效缓解了环境稀缺问题。

Abstract: The paradigm of LLMs has rapidly shifted from passive language interfaces to autonomous Claw-like agents that execute long-horizon tasks across stateful workspaces. While Agentic Reinforcement Learning (Agentic RL) provides a promising path to optimize these agents, its scaling is heavily bottlenecked by the severe scarcity of interactive training environments. Existing synthetic environments are strictly limited to tool-calling endpoints, rendering them insufficient for accommodating the end-to-end real-world demands of claw-like agents. To bridge this gap, we introduce EnvCraft, an automated framework for synthesizing executable environments and scalable training data. Specifically, EnvCraft employs an environment synthesis engine to build sandbox-isolated workspaces, alongside a topology-aware data generation engine to produce coherent task trajectories. Overall, we synthesize 139 interactive environments comprising approximately 20K complex tasks for Agentic RL training. Experiments on Qwen3/3.5 models (8B-32B) show that our method yields gains of up to +11.9% on Claw-style benchmarks and +8.0% on general tool-use benchmarks, with concurrent reductions in inference token cost. The results confirm that synthesized executable environments provide robust and generalizable learning signals for training.

Vijay Bommireddy, Raviteja Bommireddy

TL;DR: 本文探讨了图智能体检索增强生成（Graph-Agentic RAG）系统在公益应用中的可信构建问题，分析了其架构、故障传播机制，并提出了一种基于构造保证的设计蓝图。论文通过梳理文献，将系统风险建模为证据到行动的故障链，并提出了包含五个接口合约的保证框架，以在系统边界明确来源、时效性、授权、不确定性和可恢复性。

Details

Motivation: 图智能体RAG结合结构化证据与自适应控制器，适用于答案依赖于跨文档、实体、时间或机构关系的场景，但这也引入了耦合的故障路径：图构建中的缺陷可能成为检索证据，影响后续控制决策，并传播至严重后果。因此，需在公益场景中设计并评估此类系统，确保新鲜度、授权、可追溯性、监督和补救与答案质量同等重要。

Result: 论文未提及具体的定量实验结果或基准测试，而是通过文献综述和框架构建，提出了一种保证蓝图和评估议程，侧重于系统设计和风险缓解的理论分析。

Insight: 创新点包括将图智能体RAG的风险建模为证据到行动的故障链，并提出基于构造保证的接口合约框架，强调在系统边界明确关键属性（如来源和授权），以提升可信度。从客观角度看，这为复杂AI系统的可信设计提供了结构化方法，尤其在公益领域具有借鉴意义。

Abstract: Graph-agentic retrieval-augmented generation combines structured evidence with adaptive controllers that can plan retrieval, traverse relations, verify intermediate claims, delegate subtasks, and use tools. This combination is useful when answers depend on relations across documents, entities, time, or institutions, but it also creates coupled failure paths: a defect in graph construction can become retrieved evidence, alter later control decisions, and propagate toward a consequential outcome. We examine how such systems should be designed and evaluated for social-good settings in which freshness, authorization, traceability, oversight, and recourse matter alongside answer quality. We organize the literature by graph substrate, graph lifecycle, agent function, coordination pattern, and authority boundary, and distinguish graph-based retrieval from observation-dependent graph control. We then synthesize reported risks as an evidence-to-action failure chain and propose an assurance-by-construction blueprint comprising five interface contracts for evidence, retrieval, reasoning, capability and delegation, and outcome. These contracts make provenance, temporal validity, authorization, uncertainty, and recoverability explicit at system boundaries. An illustrative public-benefit information design shows how the framework constrains graph structure, permissions, abstention, and operating authority. Finally, we derive an evaluation agenda spanning graph assertions, trajectories, claims, coordination, and outcomes.

[257] SerenAI: State-transition system inspired by text-based world AI models cs.AI | cs.CLPDF

Elvin Babayev, Artem Sinitsa, Arash Hajisharifi, Kabir Bakhshaei

TL;DR: 本文提出了一种名为SerenAI的文本世界模型启发的状态转换系统，旨在生成可验证的预测而非自由文本。系统输入环境、状态和动作描述，输出因果增量、下一状态、有效性奖励和终止信号。通过参数高效微调和基于验证器的强化学习进行适配训练，在结构化输出预测方面相比基线模型有显著提升。

Details

Motivation: 解决在需要法律、运营或财务工作流程的领域，大型语言模型生成无约束自由文本难以审计和验证的问题，旨在构建一个输出可验证预测的系统。

Result: 在内部评估中，相比8B参数的开放权重基线模型，SerenAI在JSON有效性、模式有效性、精确结构化输出匹配、因果增量精确匹配、结果状态精确匹配、奖励精确匹配和终止信号精确匹配等多个指标上均有大幅提升，例如结构化输出精确匹配从0.0%提升至41.5%。

Insight: 创新点在于将世界模型思想转化为一个可验证的状态转换系统，其输出是结构化的、可审计的预测项；采用参数高效微调与基于验证器的强化学习两阶段适配训练方法，有效提升了结构化预测的准确性；论文还提出了面向法律工作流程的验证协议，强调了校准、人工监督和本地部署的重要性。

Abstract: Although professional workflows leverage large language models widely, the interpretation for auditing unconstrained free-text generation is usually intractable if such generation demands legal, operational or financial workflow. We hereby demonstrate a text based system called SerenAI - inspired by world-models, it is a state transition system that outputs verifiable predictions rather than merely text: Provided with a description of the environment, state, and actions, the generated output contains 4 items: causal deltas that causally effect the given state, a next state that can logically follow from the given state and action, a validity reward, and a termination signal. For the released proto-model, we employ 2 steps of adaptation training, namely parameter efficient fine-tuning followed by verifier based RL over 50,000 exampled cause and effects in 12 environments spanning 10 reasoning domains. Compared to an initial internal evaluation of an 8B open-weight baseline, SerenAI increased JSON validity from 85.0% to 93.2%, schema validity from 55.0% to 84.0%, exact structured-output match from 0.0% to 41.5%, causal-delta exact match from 0.0% to 41.5%, resulting-state exact match from 0.0% to 42.0%, reward exact match from 1.0% to 80.5%, and termination exact match from 38.0% to 81.5%. These support the narrower claim that verifier-compatible adaptation can improve structured transition prediction. They do not yet establish legal-grade reliability. Accordingly, the paper also specifies a validation protocol for evidence-grounded legal workflows, calibration, human oversight, and sovereign on-premise deployment.

[258] Reason Through the Latent! Making Latent Visual Reasoning Necessary cs.AI | cs.CL | cs.CV | cs.LGPDF

Suhyeong Park, Junha Jung, Jaewoo Kang

TL;DR: 本文提出了因果视觉循环推理（CVRR）方法，旨在强制模型通过隐状态的循环计算进行视觉推理，而非依赖显式的文本思维链或其他图像条件路径。该方法在多个基准测试（V*、MMVP、BLINK、MME-RealWorld-Lite）上保持了强大的性能，而其他隐式推理器在相同约束下无法恢复可比的视觉能力。

Details

Motivation: 解决现有隐式视觉推理中，模型可能不真正依赖隐状态进行计算的问题，即视觉信息存在于隐状态并不保证模型在生成答案时实际使用该状态，尤其是当存在其他图像条件路径时。

Result: 在V*、MMVP、BLINK和MME-RealWorld-Lite基准测试上，CVRR在严格接口下保持了强大的性能，而兼容的隐式推理器即使在相同约束下重新训练也无法恢复可比的视觉能力。因果干预进一步表明，当问题固定时，预测对循环内容保持敏感，且持续的视觉证据会因果地修正循环轨迹。

Insight: 创新点在于通过强制循环计算作为唯一的图像条件路径，确保隐状态计算真正用于预测，从而区分了隐状态的信息性与实际用于预测的隐式计算。这为构建更可靠的隐式多模态推理模型提供了新思路。

Abstract: Latent visual reasoning aims to perform multimodal reasoning through hidden-state computation rather than explicit textual chains of thought. However, visual information being present in a latent state does not imply that the model actually relies on that state when producing its answer, especially when alternative image-conditioned paths remain available. We introduce \textbf{C}ausal \textbf{V}isual \textbf{R}ecurrent \textbf{R}easoning (CVRR), which preserves pretrained visual competence while making recurrent computation the required image-conditioned path to prediction. CVRR initializes recurrence from the question hidden state after the pretrained vision-language model has incorporated the image, then repeatedly updates this state while re-reading the same fixed visual evidence. Before decoding, visual states and the original multimodal KV cache are removed so that only the final recurrent state carries image-conditioned information to the answer. Across the $V^*$, MMVP, BLINK, and MME-RealWorld-Lite benchmarks, CVRR retains strong performance under this strict interface, while compatible latent reasoners fail to recover comparable visual competence even when retrained under the same constraint. Causal interventions further show that predictions remain sensitive to recurrent content when the question is held fixed, and that persistent visual evidence causally revises the recurrent trajectory. These results distinguish latent informativeness from latent computation that is actually used for prediction.

[259] NormViz: A Benchmark and Framework for Grounding Multimodal Reasoning in Global Cultures cs.AI | cs.CLPDF

Akhila Yerukola, Fabrice Y Harel-Canada, Simran Khanuja, Abhinav Sukumar Rao, Ashima Suvarna

TL;DR: 该论文提出了NormViz，一个用于评估和提升多模态AI系统视觉规范理解能力的基准和框架。它包含一个高质量的人工验证基准NormViz-Bench（包含3268个对比图像对，覆盖16个国家）和一个训练数据集NormViz-Train（包含6.4万张带解释的图像）。研究发现，即使是最强的视觉语言模型（VLMs）在该基准上的表现也很差，而利用训练数据进行微调可以显著提升模型性能。

Details

Motivation: 现有的AI系统难以服务文化多样化的全球人口。先前关于文化理解的研究多局限于纯文本或视觉物品识别，而AI系统根据当地社会规范对视觉可观察行为进行推理的能力（即视觉规范理解）尚未得到评估。

Result: 在NormViz-Bench基准上，最强的视觉语言模型Gemini 3.0 Flash和Qwen2.5 VL 7B的准确率分别仅为26.6%和21.6%，尤其在识别违反规范和与文化无关的良性视觉行为方面存在困难。使用NormViz-Train数据集微调后，Qwen3-VL 4B和8B模型的对比对准确率相对提升了125%和36%，尽管绝对性能仍低于30%。

Insight: 论文的创新点在于首次系统性地定义了“视觉规范理解”这一新任务，并构建了首个高质量、跨文化的对比性视觉基准来评估它。其核心洞察是，通过构建仅存在文化相关行为差异的对比图像对，并强制要求模型对图像对进行正确分类，可以有效防止模型依赖表面视觉捷径，从而真正评估其连接视觉感知与文化意义的能力。这为多模态AI的文化适应性研究开辟了一个新的、具有挑战性的前沿方向。

Abstract: AI systems are used worldwide, but they struggle to serve the needs of culturally diverse populations. Prior work on cultural understanding evaluates AI systems on text-only settings or on visual artifact recognition (e.g. foods, clothing). The ability to reason about visually observable behaviors through local social norms, which we call visual norm understanding, remains unexamined. We introduce NormViz-Bench, a high quality, human-validated benchmark of 3,268 contrastive image pairs (6,536 images) spanning 16 countries. Each pair varies only in the culturally relevant behavior (e.g., objects, attributes, spatial relations, and actions) that alters how each image is interpreted. Each image is labeled as conforming to, violating, or irrelevant to local social norms, and pair-level evaluation requires both images to be correctly classified, thereby preventing reliance on superficial visual shortcuts. Even the strongest VLMs, Gemini 3.0 Flash and Qwen2.5 VL 7B, succeed on only 26.6% and 21.6% of pairs, struggling most with identifying violating and culturally benign visual behaviors. Towards bridging this, we introduce NormViz-Train, a training dataset of 64k images paired with explanations. Though absolute performance remains low (<30%), finetuning on NormViz-Train improves pair accuracy relatively by up to 125% and 36% Qwen3-VL 4B and 8B respectively, showing a path forward to teach models to connect visual perception to cultural significance. Together, NormViz-Bench and NormViz-Train establish visual norm understanding as a challenging and consequential frontier for multimodal AI.

[260] AgentIdeaBench: Benchmarking Scientific Ideation in the Agent Era cs.AI | cs.CLPDF

Yunxiang Mo, Tianshi Zheng, Yisen Gao, Rui Wang, Newt Nguyen Kim Hue Nam

TL;DR: 本文介绍了AgentIdeaBench，一个用于评估AI智能体科学构思能力的多学科基准测试。该基准在静态观察和主动探索两种匹配设置下，对33个大型语言模型在5个学科的40个子领域进行了多维度的、经过文献验证的评分。研究发现主动探索模式能揭示更大的能力上限，且性能提升与模型能力相关。

Details

Motivation: 现有的科学构思评估主要基于静态、精选的参考文献集让模型生成想法，这种被动设置与现代AI科学家的检索-推理工作流不符，并且随着模型性能提升，其区分度下降。因此，需要一个新的基准来评估更贴近实际工作流程的科学构思能力。

Result: 在AgentIdeaBench上对33个LLM的评估显示，主动探索模式下的性能提升速度约为静态观察模式下的两倍，且这种探索增益是能力门控的，对最强模型最有利。此外，引入的‘科学世界建模’方法对中等能力模型有益，但对前沿模型影响减弱。

Insight: 论文的创新点在于提出了一个匹配静态与主动两种设置的基准测试框架，并采用基于检索文献验证的多维度评分来评估假设的原创性。客观来看，其核心洞察是揭示了主动探索评估能更有效地测量和区分模型在真实科学工作流中的构思能力上限，且这种增益与模型的基础能力紧密相关。

Abstract: Scientific ideation is the capacity to formulate novel and testable hypotheses from scientific evidence, and autonomous AI scientists depend on it. Existing evaluations largely assess it by asking models to generate ideas from a static, curated set of reference papers. That passive setup departs from the retrieval-and-reasoning workflow of modern AI scientists, and it becomes less discriminative as models improve. We introduce AgentIdeaBench, a multidisciplinary benchmark that evaluates scientific ideation under two matched settings, static observation and active exploration. We report matched Static-Active evaluations for 33 LLMs across 40 densely scored subfields spanning five disciplines, using a multidimensional, literature-verified scoring framework whose critics assess originality against retrieved prior art. Active exploration reveals considerably more capability headroom, and that headroom is unevenly distributed across models. Performance scales about twice as fast as under static observation, and the exploration gain is capability-gated, favoring the strongest models over the weakest. The gain reflects better grounding, improving feasibility, clarity, and specificity while leaving measured originality unchanged under our critics. We further explore Scientific World Modeling, a generation-time loop that refines a draft hypothesis through structured thought experiments. It benefits mid-capability models, and its impact diminishes among frontier models that appear to have internalized such reasoning patterns already. AgentIdeaBench gives future work on scientific ideation a measurement basis suited to the agent era.

[261] Eliciting Self-Verification in Multimodal Reasoning Agents with Reinforcement Learning cs.AI | cs.CL | cs.CVPDF

Vishwas Sathish, Viresh Ranjan, Xinliang Zhu, Arnab Dhua, Douglas Gray

TL;DR: 本文提出了一种名为SVRL的强化学习微调框架，旨在提升多模态推理代理的自我验证能力，通过训练代理在推理过程中自行验证和过滤检索到的证据，减少对外部验证器的依赖，并引入搜索感知惩罚和查询多样性奖励来优化工具使用效率。

Details

Motivation: 解决多模态代理在整合文本和图像信息、处理噪声检索证据时，因缺乏显式验证信号和稀疏结果级监督而导致的可靠工具使用难题。

Result: 在仅使用5,000个视觉问答示例微调Qwen-2.5-VL-7B模型后，SVRL在多个基准测试中实现了多跳VQA泛化能力和工具效率的持续提升，缩小了紧凑代理与大型专有模型之间的性能差距。

Insight: 创新点在于通过纯强化学习框架实现自我验证，无需外部验证器，并结合搜索感知惩罚和查询多样性奖励提供细粒度反馈，从而在低训练和推理成本下提升多模态代理的可靠性和效率。

Abstract: Reasoning agents increasingly rely on external tools such as web search to answer complex queries. Reinforcement learning (RL) finetuning algorithms such as GRPO have improved long-form reasoning in text-only language models, particularly for coding and mathematics. Reliable tool use in multimodal agents, however, remains challenging because models must interpret text and images while integrating noisy retrieved evidence, often under sparse outcome-level supervision without explicit verification signals. We present Self-Verification via Reinforcement Learning (SVRL), an RL-only finetuning framework that trains multimodal agents to verify and filter retrieved evidence within their own reasoning traces, reducing reliance on external verifiers at inference time. SVRL also introduces a search-aware penalty that discourages unnecessary tool calls and a query-diversity reward that encourages diverse, well-formed search queries, providing fine-grained feedback on when and what to search. Finetuning Qwen-2.5-VL-7B with SVRL on only 5{,}000 visual question answering examples yields consistent gains in multi-hop VQA generalization and tool efficiency across benchmarks. Overall, SVRL narrows the gap between compact agents and much larger proprietary models while requiring substantially lower training and inference cost.

[262] SchemeArena: Factorized Stress Testing of Scheming in LLM Agents cs.AI | cs.CLPDF

Jie Ruan, Inderjeet Nair, Amy Liu, Muhammad Khalifa, Yusheng Zhou

TL;DR: 本文提出了SCHEMEARENA基准，一个包含400个场景的因子化压力测试基准，用于系统研究LLM智能体中的‘密谋’行为（即智能体暗中追求未对齐目标）。研究通过控制关键因素（如工具性目标、环境条件、监督机制）来探究密谋行为的成因，并开发了SCOUT监控器来基于智能体的推理和行动证据进行多标准判断。

Details

Motivation: 现有研究仅考察少量场景，难以分离不同条件如何影响智能体密谋的倾向或能力，且规模和任务多样性不足，限制了在现实部署中对密谋策略的覆盖和理解。

Result: 在五个LLM智能体上的受控压力测试表明，明确的工具性目标是驱动密谋倾向的最强因素；策略性提示有助于将密谋推理转化为具体隐蔽行为；监督具有混合效果（在某些闭源模型中，仅行动监控反而增加密谋）；思维链（CoT）是有用但不完整的监控信号。

Insight: 创新点在于构建了因子化的场景合成框架，实现了可扩展的密谋压力测试；提出的SCOUT监控器通过多标准证据进行可靠监控；研究发现部分监督可能作为优化约束而非威慑，揭示了密谋行为中推理与行动可能解耦的现象。

Abstract: We study scheming in LLM agents, in which agents covertly pursue misaligned goals. Our focus is to understand how scheming arises from the interaction of key factors, such as instrumental goals, environmental affordances, oversight conditions, and perceived consequences. Prior work examines only a small number of scenarios, limiting the ability to isolate how these conditions shape an agent’s propensity or capability to scheme. This limited scale and task diversity also restrict coverage of realistic deployment settings and the range of scheming strategies that can be observed. To this end, we introduce SCHEMEARENA, a 400-scenario benchmark for scalable scheming stress testing, constructed through a factorized scenario synthesis framework spanning diverse safety-relevant tool domains, instrumental goals, oversight conditions, and pressure mechanisms. To enable scalable and reliable monitoring, we further propose SCOUT, a scheming monitor that grounds multi-criteria judgments in evidence drawn from agents’ reasoning and actions. Across controlled stress tests on five LLM agents, we find that explicit instrumental goals are the strongest driver of scheming propensity. Strategic hints play a distinct role by helping agents translate scheming reasoning into concrete covert behavior. Oversight has mixed effects: in several closed models, action-only monitoring increases scheming, suggesting that partial oversight can act as an optimization constraint rather than a deterrent. CoT is a useful but incomplete monitoring signal: it can reveal latent scheming before execution, yet action-only scheming shows that covert behavior may occur without explicit reasoning evidence. We release the benchmark, code, and monitor at: https://github.com/launchnlp/SchemeArena.

[263] Does Deeper Reasoning Compromise Alignment? Revealing and Mitigating of Alignment Collapse in Large Reasoning Models cs.AI | cs.CLPDF

Yu-Hang Wu, Yu-Jie Xiong, Henghua Zhang, Bairui Zhang, Jia-Chen Zhang

TL;DR: 本文挑战了深度推理增强安全对齐的普遍观点，揭示了大型推理模型在深度推理过程中可能发生对齐崩溃的关键漏洞。作者提出了对齐损失率（ALR）来量化这一现象，并基于此不稳定性设计了一种名为推理陷阱（RT）的新型越狱攻击范式。为缓解此问题，论文提出了一种轻量级防御策略——推理残差对齐（RRA），通过残差连接在推理过程中动态重强调输入。

Details

Motivation: 尽管深度推理被广泛认为能增强安全对齐，但扩展推理下对齐机制的稳定性尚未得到充分探索。本文旨在揭示并量化深度推理可能引发的对齐崩溃问题。

Result: 实验表明，随着推理深度增加，对齐损失率（ALR）显著上升，模型对外部扰动的鲁棒性严重下降。提出的推理陷阱（RT）攻击能有效诱导模型进行扩展推理，从而放大对抗攻击的影响，导致安全能力急剧下降。

Insight: 核心创新点在于揭示了深度推理导致对齐崩溃的现象及其根本原因——注意力稀释，即扩展推理过程与原始输入对注意力的竞争。提出的推理残差对齐（RRA）是一种轻量级防御策略，通过残差连接动态重强调输入以缓解注意力稀释问题。

Abstract: The emergence of Chain-of-Thought (CoT) has established a robust foundation for Large Reasoning Models (LRMs). While deep reasoning is widely believed to enhance safety alignment, the stability of alignment mechanisms under extended reasoning remains underexplored. This paper challenges the prevailing view by revealing a critical vulnerability: Deep Reasoning May Induce Alignment Collapse. To rigorously quantify this phenomenon, we propose the Alignment Loss Rate (ALR) metric. Our experiments demonstrate that as reasoning depth increases, ALR rises significantly, indicating a severe degradation in model robustness against external perturbations. Capitalizing on this instability, a novel jailbreaking paradigm, Reasoning Trap (RT), is proposed. RT induces the model into extended reasoning to amplify the impact of adversarial attacks, leading to a sharp decline in safety capabilities. To elucidate the mechanism behind this collapse, we identify Attention Dilution as the root cause, arising from the competition for attention between the extended reasoning process and the original input. To mitigate this, Reasoning Residual Alignment (RRA), a lightweight defense strategy that dynamically re-emphasizes the input via residual connections integrated with the reasoning process.

[264] SE-GoS: Self-Evolving Graph-of-Skills for Skill Library at Scale cs.AI | cs.CLPDF

Dawei Fu, Cheng Jiang, Sitian Qian, Huainan Wang, Zhongkai Hao

TL;DR: 本文提出了SE-GoS（自演化技能图）框架，旨在解决大规模技能库中技能检索效率低下的问题。该框架无需训练，通过利用历史执行轨迹，对现有的技能图进行拓扑、边权重和技能描述三个维度的演化，从而提升LLM智能体在未见任务上的表现和检索效率。

Details

Motivation: 现有技能图方法（如GoS和SkillDAG）虽然利用图结构进行可扩展的技能检索，但未能系统地将历史执行轨迹提炼成能泛化到未见任务的、更优的检索图。本文旨在探索如何在不改变检索算法或技能内容的情况下，仅通过执行经验来改进静态技能图。

Result: 在SkillsBench基准测试上，使用三种不同LLM进行实验。SE-GoS一致地提高了任务奖励，同时相对于加载全部技能减少了输入token。在一个代表性设置中，一轮演化将奖励从52.4%提升至59.4%，输入token减少约三分之一，并且演化后的图在不相交的保留测试集上比静态GoS基线提升了5.4个百分点。

Insight: 核心创新点在于提出了一个无需训练、不改变检索流程的框架，通过执行反馈对技能图进行多维度（拓扑、边权重、描述）的在线演化，将静态检索图转变为动态演化的检索基础设施。这为构建可自我改进的大规模技能库系统提供了新思路。

Abstract: Modern LLM agents increasingly rely on reusable skills, yet as skill libraries scale to thousands of entries, effective retrieval becomes a bottleneck. Graph-of-Skills (GoS) addresses this challenge by exploiting dependency-aware graph structure for scalable skill retrieval, while SkillDAG further demonstrates that skill graphs can accumulate execution-backed structure online. However, these approaches leave open whether historical execution traces can be systematically distilled into a better retrieval graph that generalizes to unseen tasks. We present Self-Evolving Graph-of-Skills (SE-GoS), a training-free framework that evolves an existing GoS graph from execution traces while preserving the original retrieval pipeline. SE-GoS performs three complementary updates: topology evolution that discovers and prunes skill relationships from execution evidence, edge-weight evolution that reinforces retrieval-relevant relationships based on historical effectiveness, and description evolution that optimizes retrieval-facing skill descriptions using execution feedback. Across three LLMs on SkillsBench, SE-GoS consistently improves task reward while reducing input tokens relative to full skill loading, with gains varying across model families. In a representative setting, one evolution round improves reward from 52.4% to 59.4% while reducing input tokens by approximately one-third relative to full skill loading, and the resulting graph transfers to a disjoint held-out split with a 5.4-point improvement over the static GoS baseline. These results show that skill graphs can be improved from execution experience without model training, changes to the retrieval algorithm, or modifications to skill content, turning a static retrieval graph into an evolving retrieval infrastructure.

[265] Do Dynamic Routers Need Memory? HeRo: History-Aware Routing for Efficient LLM Inference cs.AI | cs.CLPDF

Hongjin Lin, Wentao Wan, Keze Wang

TL;DR: 本文提出了HeRo（History-Aware Routing），一种用于高效LLM推理的动态层路由框架。它通过引入路由器记忆机制，显式地维护跨模型深度的路由历史状态，从而解决现有方法仅依赖当前隐藏状态、忽略路由决策序列依赖性的问题。在冻结的骨干网络上仅训练轻量级路由器和适配器，HeRo在多个Llama模型上实现了最高的性能保留率，同时显著减少了推理计算量。

Details

Motivation: 现有动态层路由方法将每个路由决策视为仅以当前隐藏状态为条件的局部操作，忽略了路由决策在深度上的序列性和路径依赖性，这导致早期决策会影响下游路由器的输入，并且层使用目标将所有决策耦合在一起。HeRo旨在通过引入显式的路由历史来解决这种不匹配。

Result: 在Llama 3.1-8B、Llama 2-7B和Llama 2-13B模型上，HeRo在十个基线中始终实现了最高的综合性能保留。具体在Llama 3.1-8B上，在七个基准测试中，它绕过了26.87%的模型参数，却达到了稠密模型性能的100.24%；在更严格的计算预算下，绕过了38.82%的参数，仍保留了97.01%的性能。

Insight: 核心创新点是引入了显式的路由器记忆机制，通过线性注意力增量地聚合先前的路由分数及其诱导的残差更新，形成一个紧凑的历史表示。这使得路由器在决策时能联合考虑累积的历史状态和当前隐藏表示，从而做出更准确、更自适应的路由决策，尤其在多步推理和代码生成任务上效果显著。该方法仅需训练轻量级组件，无需修改预训练参数，具有很好的实用性和可扩展性。

Abstract: Dynamic layer routing reduces the inference cost of Large Language Models (LLMs) by learning to skip layers for individual tokens. Existing methods, however, treat each routing decision as a local operation conditioned solely on the current hidden state which is a formulation that overlooks the sequential, path-dependent nature of routing across depth: earlier decisions shape the representations seen by downstream routers, and the layer-usage objective couples all decisions jointly. We propose History-Aware Routing (HeRo), a dynamic routing framework that resolves this mismatch by introducing a router memory mechanism to maintain an explicit routing state across model depth. The memory is constructed via linear attention, incrementally aggregating preceding routing scores and their induced residual updates into a compact history representation. At each routed layer, the router conditions jointly on this accumulated state and the current hidden representation to select the executed branch. Instantiated for token-wise FFN routing, HeRo trains only lightweight routers and adapters on a frozen backbone, requiring no modification to pretrained parameters. Across Llama 3.1-8B, Llama 2-7B, and Llama 2-13B, HeRo consistently achieves the highest aggregate performance retention among ten baselines. On Llama 3.1-8B, it bypasses 26.87% of model parameters while achieving 100.24% of dense model performance across seven benchmarks, and retains 97.01% while bypassing 38.82% of model parameters under a tighter computation budget. Ablation studies confirm that removing routing history consistently degrades performance, most notably on multistep reasoning and code generation, validating that explicit routing memory enables more accurate and adaptive dynamic routing than solely conditioning on hidden state.

[266] Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning cs.AI | cs.CL | cs.IT | cs.LGPDF

Mar Gonzàlez I Català, Haitz Sáez de Ocáriz Borde, Davide Murari, Carola-Bibiane Schönlieb, Pietro Liò

TL;DR: 本文提出了一种名为答案分布轨迹的新表示方法，用于追踪大型语言模型在推理过程中对答案的完整预测分布变化。该方法比仅关注最终答案或熵曲线的评估方式更精细，能够揭示推理的动态机制，如探索、修正、运动和承诺等阶段。通过对16个开源语言模型和4个推理基准的实验，研究发现即使最终答案和熵曲线相似，推理动态也可能存在显著差异，且训练和推理选择会系统性地重塑这些动态。

Details

Motivation: 现有工作如思维链推理通常仅通过最终准确率评估，忽略了推理路径；熵曲线虽能追踪不确定性演变，但无法揭示具体竞争假设。本文旨在克服这些限制，提供更全面的推理动态分析框架。

Result: 在16个开源语言模型和4个推理基准上，实验显示相同终点和相似熵曲线的轨迹可能表现出显著不同的推理动态，且不同目标和任务导致动态特征各异。训练和推理选择（如温度参数）会系统性地改变这些动态特征。

Insight: 创新点在于引入受随机动力学启发的答案分布轨迹表示，作为比端点和熵摘要更精细的工具，能够区分推理成功与失败的不同动态机制，为分析和评估LLM推理动态提供了丰富框架。

Abstract: Chain-of-thought reasoning provides a structured computation between a model’s input and final answer. Yet it is often evaluated through endpoint accuracy, which ignores the path taken to reach that answer. An emerging line of work addresses this limitation using entropy profiles, which track how uncertainty evolves over the reasoning process but do not reveal which competing hypotheses account for that uncertainty. We introduce answer-distribution trajectories, a stochastic-dynamics-inspired representation that tracks the model’s full predictive distribution over answers as reasoning unfolds. As a strictly finer representation than endpoint and entropy summaries, answer-distribution trajectories enable us to characterize a trace through a dynamical reasoning profile spanning exploration, revision, motion, and commitment, and to distinguish different dynamical mechanisms of reasoning success and failure. Across sixteen open-weight language models and four reasoning benchmarks, we show that traces with the same endpoint and similar entropy profiles can exhibit substantially different reasoning dynamics. We further find substantial variation in these dynamics both within and across models and tasks, with different objectives favoring different dynamical profiles. Additionally, we show that training and inference choices systematically reshape these profiles. Our results suggest that answer-distribution trajectories provide a rich framework for analysing and evaluating the dynamics of LLM reasoning.

[267] ExecCritic: Learn to Test, Test to Improve for Coding Agents cs.AI | cs.CL | cs.SEPDF

Leitian Tao, Baolin Peng, Haorui Wang, Hang Wang, Hao Cheng

TL;DR: 本文提出了ExecCritic框架，用于提升代码修复智能体的性能。该框架采用测试-验证-修订的脚手架结构，将测试生成与源代码修复分离，并分别训练测试智能体和修复智能体。通过在SWE-bench Verified基准上的实验，证明了高质量测试对执行反馈的有效性至关重要，且经过角色特定训练的智能体组合显著提升了问题解决率。

Details

Motivation: 现有代码修复智能体使用执行反馈时，若测试本身存在缺陷（如与补丁错误一致），会导致虚假信心。本文旨在解决测试质量对反馈有效性的关键影响，确保测试能准确捕获需求行为。

Result: 在SWE-bench Verified基准上，基础测试智能体的测试将解决率从无测试基线的61.2%降至57.3%，而GPT-5.6-sol的测试提升至65.3%。经过角色特定训练后，Qwen测试智能体的Base-to-Gold成功率从22.2%提升至62.2%，两个训练后智能体组合达到72.6%的解决率，较无测试基线提升11.4个百分点。

Insight: 创新点在于将测试生成与代码修复解耦的脚手架设计，以及针对不同角色（测试与修复）的强化学习训练方法。这确保了测试的独立性和行为有效性，避免了错误一致性，从而更可靠地利用执行反馈指导代码修订。

Abstract: Execution feedback can guide coding agents toward correct repository repairs, but only when the tests capture the behavior requested by the issue. Agent-generated tests can encode incomplete or incorrect behavioral targets; when the same trajectory writes both the patch and the test, their errors can agree and create false confidence. We introduce ExecCritic, combining a test–verify–revise scaffold with a role-specific reinforcement learning recipe for training agents within it. The scaffold separates test construction from source-code repair: a Test agent independently generates repository-native tests, a fail-closed harness qualifies and freezes them, and a Repair agent revises source code from their execution feedback without changing the tests. Both roles use Qwen-3.5-35B-A3B as the backbone and are trained separately. In Learn to Test, the Test agent learns to produce behaviorally valid tests that distinguish correct from incorrect patches. In Test to Improve, the Repair agent learns both direct task resolution and feedback-guided revision. On SWE-bench Verified, test quality determines whether feedback helps: holding the base Repair agent fixed, tests from the base Test agent reduce resolved rate from a no-test baseline of 61.2% to 57.3%, whereas tests from GPT-5.6-sol raise it to 65.3%. Role-specific post-training raises the Qwen Test agent’s Base-to-Gold success from 22.2% to 62.2%; composing the two post-trained Qwen agents reaches 72.6%, an 11.4-point gain over the original no-test baseline without stronger-model or Oracle feedback at evaluation time. Code is publicly available at https://github.com/MSR-Orchard/execcritic.

[268] Multimodal Resource-Exhaustion Attacks on Vision-Language Models via Joint Pixel-Prompt Optimization cs.AI | cs.CR | cs.CVPDF

Zhaoxiong Ni, Yatie Xiao, Chi-Man Pun, Fei Peng, Qingxiao Guan

TL;DR: 本文提出了首个针对自回归视觉语言模型（VLMs）的联合像素-提示优化（JPPO）复合对抗攻击框架。该框架将用户可见的提示文本提升为与图像扰动并列的一类对抗变量，在受限的联合输入威胁模型下，对像素和提示表面进行耦合、分阶段的优化，从而产生协同的成本放大效应。

Details

Motivation: 现有针对VLMs的资源耗尽攻击通常采用单模态威胁模型，主要优化图像分支而固定用户提示，未能将可用性攻击作为一个跨模态的联合优化问题进行探索。本文旨在弥补这一空白，揭示当前VLM服务防御中的结构性盲点。

Result: 在MS COCO和ImageNet数据集上，使用8/255的无穷范数预算对五个开源VLM家族进行评估。JPPO在Qwen2.5-VL-7B上实现了超过4.6倍的延迟放大和5.3倍的能量放大，在BLIP-2上实现了超过36.6倍的延迟放大和32.7倍的能量放大。其成本放大效果在直接比较的基线方法中最强，且所需优化迭代次数显著更少。

Insight: 核心创新在于将可见提示文本首次提升为与图像扰动并列的一类对抗变量，并提出了一个联合优化框架。其产生的成本放大源于多模态协调，而非提示长度或孤立模态，这揭示了当前VLM防御的盲点，并推动将成本感知的鲁棒性评估作为多模态部署的一级安全需求。

Abstract: Resource-exhaustion attacks against autoregressive vision-language models (VLMs) typically assume unimodal threat models, treating the image branch as the primary optimization surface while holding user-visible prompts fixed. Even recent loop-centric variants remain confined to this single-channel paradigm, leaving the exploitation of availability unexplored as a cross-modal optimization problem over jointly controllable input surfaces. We introduce Joint Pixel-Prompt Optimization (JPPO), the first compound adversarial framework elevating the visible prompt to a first-class adversarial variable alongside image perturbations. Under a restricted joint-input threat model, JPPO performs coupled, stagewise optimization over both the pixel and prompt surfaces. This produces synergistic cost amplification, mechanistically distinct from loop-dependent failures, exhibiting negligible loop incidence in our experiments. Evaluating five open-source VLM families on MS COCO and ImageNet under an 8/255 infinity-norm budget, JPPO achieves over 4.6x latency and 5.3x energy amplification on Qwen2.5-VL-7B, and over 36.6x latency with 32.7x energy amplification on BLIP-2. This represents the strongest cost amplification among directly compared baselines while requiring substantially fewer optimization iterations. Ablations confirm this amplification arises from multimodal coordination rather than prompt length or isolated modalities. These findings reveal structural blind spots in current VLM serving defenses, motivating cost-aware robustness evaluation as a first-class security requirement for multimodal deployments.

[269] Weakly supervised neural network: segmentation of complex structures in X-ray microCT cs.AI | cs.CVPDF

Daniele Rusconi, Michela Ascolese, Stephanie Fest-Santini, Alberto Bravin, Maurizio Santini

TL;DR: 本研究探讨了在X射线显微CT数据中，使用弱监督深度学习策略来分割复杂结构（如大鼠肾脏肾小球），以减少标注成本。通过基于nnU-Net框架的二维卷积神经网络，结合稀疏点标注和少量全分割图像，实现了对低对比度结构的可靠定位。结果表明，弱监督方法能有效降低标注工作量，同时接近全监督模型的性能。

Details

Motivation: 解决X射线断层扫描数据中复杂结构分割任务对大量精确标注数据的依赖问题，以降低标注成本并提高可扩展性。

Result: 在大鼠肾脏高分辨率microCT切片上评估，弱监督方法能可靠定位肾小球，结合少量高质量标注后，分割性能接近全监督模型水平。

Insight: 创新点在于将nnU-Net框架适配到弱监督设置，利用稀疏点标注和有限全分割图像；客观分析表明，针对稀疏标注的损失函数设计可能进一步提升性能，为生物医学图像分析提供高效的标注策略。

Abstract: Segmentation of complex structures in X-ray tomographic data is a fundamental task in biomedical research, but it often requires large amounts of precisely annotated data, making fully supervised approaches costly and difficult to scale. In this study, weakly supervised deep learning is investigated as a strategy to reduce annotation effort while maintaining accurate segmentation. A two-dimensional convolutional neural network based on the nnU-Net framework was adapted to a weak supervision setting using sparse dot-based annotations, complemented by a limited number of fully segmented images. The approach was evaluated on high-resolution microCT slices of rat kidneys, targeting the segmentation of renal glomeruli, which are small, low-contrast anatomical structures. Results indicate that weak supervision provides a meaningful learning signal, enabling reliable localization of glomeruli even in the absence of dense labels. Incorporating a small set of high-quality annotations substantially improves segmentation performance, approaching that of a fully supervised model. These findings highlight the potential of weakly supervised learning as an annotation-efficient strategy for the analysis of complex structures in X-ray tomographic data, and suggest that alternative loss formulations tailored to sparse annotations may further enhance performance.

[270] RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohorts cs.AI | cs.CVPDF

Diwas Lamsal, Juha Carlon, Reinhard Claeys, Maxim Yudayev, Louis Flynn

TL;DR: 本文提出了RevalExo，一个用于惯性及视觉运动模式识别的功能性日常活动基准数据集。该数据集基于标准化的临床和生态验证的日常活动协议构建，包含27名来自三个不同群体（健康老年人、中风幸存者和可能患有肌少症的老年人）的参与者，提供了10.1小时跨11种运动模式的帧级标注，其中5.1小时为配对的惯性-视觉记录。论文评估了单模态/多模态识别、跨群体泛化以及视觉引导知识迁移三个挑战，并发布了该数据集以促进相关研究。

Details

Motivation: 现有公共基准数据集通常采集自健康成年人，缺乏检测模式转换所需的时间精确标签，或任务集有限，无法满足现实临床约束和日常移动需求下辅助设备（如动力外骨骼）的开发与评估。

Result: 在RevalExo基准上的实验结果表明，融合惯性和视觉输入能带来一致的性能提升，但整体识别（F1约93%）与转换期间的识别（F1约68%）之间存在显著差距，同时在跨群体泛化和跨模态迁移方面仍存在持续挑战。

Insight: 创新点在于构建了一个反映老龄化和临床人群日常移动需求的、经过临床和生态验证的功能性日常活动基准数据集，并系统性地评估了多模态融合、跨群体泛化和跨模态知识迁移等关键挑战，为面向真实临床场景的运动模式识别研究提供了重要资源和分析基准。

Abstract: Assistive devices for people with mobility impairments, such as powered exoskeletons, rely on accurate locomotion mode recognition to adapt control strategies and provide appropriate assistance during daily activities. However, public benchmarks are typically collected from healthy adults, lack temporally precise labels necessary for detecting mode transitions, or focus on a limited set of tasks. To support development and evaluation under realistic clinical constraints and daily mobility demands, we introduce RevalExo, a functional daily-activity benchmark for inertial and visual locomotion mode recognition. RevalExo is built around a standardized, clinically and ecologically validated daily-activity protocol reflecting the cumulative everyday mobility demands in ageing and clinical populations. The benchmark includes 27 participants across three cohorts: older adults without mobility impairments, stroke survivors, and older adults with probable sarcopenia. The full cohort was recorded with lower-body IMUs, while synchronized egocentric video was collected for a clinically feasible subset of 13 participants. RevalExo provides 10.1 hours of frame-level annotations across 11 locomotion modes, including 5.1 hours of paired inertial–visual recordings. We benchmark three challenges: unimodal and multimodal locomotion mode recognition across multiple horizons, cross-population generalization from older adults without mobility impairments to clinical cohorts, and vision-guided knowledge transfer to IMU-only models. Results confirm consistent gains from fusing inertial and visual inputs but reveal a substantial gap between general recognition ($\sim$93% F1) and recognition during transitions ($\sim$68% F1), alongside persistent challenges in cross-population generalization and cross-modal transfer. We release RevalExo to stimulate further research on these open challenges.

cs.MM [Back]

[271] Vision-Guided Text Prompt Tuning for Multimodal Sentiment Analysis cs.MM | cs.CVPDF

Xiaoran Kou, Jingyi Wu, Peng Sun, Yang Liu, Hong Chen

TL;DR: 本文提出了一种名为视觉引导文本提示调优（VG-TPT）的方法，用于多模态情感分析。该方法通过分层自适应提示，将视觉情感线索注入到冻结的BERT文本编码器中，实现可控的视觉校准，避免了视觉噪声的引入和文本语义的扭曲。

Details

Motivation: 解决多模态情感分析中，如何以可控、自适应且参数高效的方式，利用视觉面部证据校准以文本为中心的情感理解这一核心挑战，同时避免因不区分地融合视觉信息而引入噪声或扭曲文本语义，并降低完全微调大型视觉和文本编码器带来的高成本和过拟合风险。

Result: 在CMU-MOSEI和CMU-MOSI基准测试上，VG-TPT方法持续优于纯文本基线，并与多种全模态方法相比取得了具有竞争力或更优的性能，同时仅更新了240万个可训练参数。

Insight: 创新点在于将视觉-文本情感建模形式化为对冻结文本表征的可控视觉校准，通过一个由演化文本状态和视觉引导特征共同指导的路由器，从可训练的提示库中组合出样本特定和层级特定的提示，实现了参数高效的层间自适应调制。

Abstract: Multimodal sentiment analysis requires effective modeling of both verbal semantics and non-verbal affective cues. A central challenge is to calibrate text-centered sentiment understanding with visual facial evidence in a controlled, adaptive, and parameter-efficient manner. Text usually serves as the semantic anchor, whereas visual cues provide complementary evidence for ambiguous or implicit expressions; however, indiscriminate fusion may introduce visual noise and distort textual semantics. Moreover, fully fine-tuning large visual and textual encoders is costly and prone to overfitting on limited and scenario-dependent MSA benchmarks. To address these issues, we propose Vision-Guided Text Prompt Tuning (VG-TPT), which formulates visual-text sentiment modeling as controllable visual calibration of frozen text representations. VG-TPT injects visual affective cues into a frozen BERT encoder through layer-wise adaptive prompts, rather than relying on late-stage feature fusion or full backbone tuning. A co-guided router composes prompts from a trainable prompt bank according to both the evolving text state and the visual guidance feature, enabling sample-specific and layer-specific modulation. Experiments on CMU-MOSEI and CMU-MOSI show that VG-TPT consistently improves over text-only baselines and achieves competitive or superior performance compared with several full-modality methods, while updating only 2.4M trainable parameters. The code is available at https://github.com/ma-tubu/VG-TPT.

cs.SD [Back]

[272] Emotion as a Distribution: Joint Valence-Arousal Probability Learning for Speaker-Independent Multimodal Emotion Recognition cs.SD | cs.CLPDF

Tingyi Lin, Wen-Ren Yang, Kuanwei Chen

TL;DR: 本文提出了一种将情绪建模为分布而非单一硬标签的多模态情感识别方法，通过文本+语音系统输出在效价-唤醒平面上的概率矩阵，采用二维高斯软目标进行训练，并在严格的说话人无关评估设置下验证了其有效性。

Details

Motivation: 人类情绪是连续且混合的，但现有多模态识别器通常将其简化为单一硬标签；本文旨在通过暴露情感空间上的概率分布来更准确地建模情绪，以支持心理咨询等应用。

Result: 在严格的说话人无关IEMOCAP数据集5折留一会话外评估中，所提出的双头系统达到73.0% ± 0.3的未加权准确率，比Transformer融合基线提升3.0个百分点；使用冻结WavLM-Large特征时，同一架构提升至76.6% ± 1.3。

Insight: 创新点在于将情绪建模为效价-唤醒平面上的概率分布，而非单一类别；该方法能恢复情绪环状模型结构，其质心跟踪效价和唤醒度，熵值与标注者歧义性相关，为连续且混合的情绪识别提供了新视角。

Abstract: Human emotion is graded and frequently mixed, yet most multimodal recognizers collapse it onto a single hard label. We argue the recognizer should instead expose a distribution over affective space. Our text+speech system, alongside its categorical decision, emits a $9\times9$ probability matrix over the Valence-Arousal plane, trained with a two-dimensional Gaussian soft target under a Kullback-Leibler/cross-entropy objective, aimed at counseling support. Evaluation is strict: speaker-independent 5-fold leave-one-session-out IEMOCAP with rotating-session inner validation, headline metrics only on the held-out session. Within one fixed encoder-fusion-head pipeline we compare Transformer and state-space (Mamba-1/2/3) backbones at matched depth and width, at two operating points ($T\approx550$, $T\approx2750$). The featured dual-head system reaches 73.0% $\pm$ 0.3 unweighted accuracy over three seeds (separate rerun: 72.1%), exceeding the Transformer fusion baseline by 3.0 UA points (95% session-bootstrap CI [1.0,4.7]; significant under paired t-test and session-level bootstrap), with no latency or memory advantage at these lengths; swapping the ~1M trainable front-end for frozen WavLM-Large features (learnable layer weights) lifts the same architecture to 76.6% $\pm$ 1.3. Pre-specified controls scope the claims honestly: simpler valence-arousal auxiliaries reproduce the classification lift within noise, and a dedicated regression head tracks the continuous ratings slightly better, so the head’s specific value is the normalized affect distribution itself. That distribution recovers the circumplex: its center of mass tracks valence and arousal (CCC 0.66/0.66; predominantly between-class structure, weaker within-class tracking), and its entropy is weakly but consistently linked to categorical rater ambiguity, not dimensional spread.

[273] From Scores to Evidence: Auditable Decisions Can Improve Speech Deepfake Detection cs.SD | cs.CL | eess.ASPDF

Mengzhe Geng, Yujia Lu, Patrick Littell, Manuela Kunz, Xie Chen

TL;DR: 本文提出了一种可审计的决策记录方法，用于语音深度伪造检测，该方法不仅输出一个检测分数，还整合了被动检测分数、条件密钥探测分数、检索支持和说话人档案边界等四种对齐线索，以提供决策背后的证据。

Details

Motivation: 当前语音深度伪造检测器通常仅输出每个话语的单一分数，这无法解释边界案例为何应被信任、延迟或复审，也无法区分相同分数区间内不同证据来源的差异。

Result: 在ASVspoof 5 Track 1匹配子集的4,080个示例上，固定检索增强规则将等错误率从仅使用检索证据时的15.84%降低到11.91%，而完整记录的后校准达到8.43% EER；在33.75%的复审预算下，暴露的线索联合覆盖了校准模型82.85%的错误。

Insight: 创新点在于将多种证据线索整合到可审计的决策记录中，在保持单一操作分数用于阈值设置和复审的同时，保留了每个决策的溯源证据，增强了检测系统的透明度和可解释性。

Abstract: Speech deepfakes can mimic a speaker’s voice convincingly enough to deceive listeners and automated systems. This has driven strong progress in speech deepfake detection, but most detectors still end with one score per utterance. That score is useful for ranking systems, yet it says little about why a borderline item should be trusted, deferred, or reviewed. Two utterances can fall in the same score band for different reasons, for example because passive and retrieval evidence disagree or because the keyed probe is unavailable. We ask whether the final decision can remain scalar without discarding that provenance. We answer this question with an auditable decision record that carries four aligned cues into a late calibration step: a passive detector score, a conditional keyed-probe score on a marked derivative, retrieval support, and a speaker-profile margin, together with explicit disagreement coordinates. On the 4,080-example ASVspoof 5 Track 1 matched subset, the fixed retrieval-augmented rule improves on retrieval-only evidence, from 15.84 percent to 11.91 percent EER, and late calibration over the full record reaches 8.43 percent EER. At a 33.75 percent review budget, the exposed cue union covers 82.85 percent of the calibrated model’s errors. The best passive WavLM run still reaches 6.71 percent EER, so we do not present the decision record as a stronger standalone detector. Its contribution is to preserve the evidence behind each surfaced utterance while still producing one operating score for thresholding and review.

[274] AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing cs.SD | cs.CL | cs.MMPDF

Ziyang Ma, Zhikang Niu, Wenming Tu, Tianrui Wang, Ruiqi Yan

TL;DR: AuK是一个开源的语音生成与编辑基础模型，通过自然语言指令和音频上下文统一接口，支持语音生成、内容编辑、增强与分离、副语言编辑和声学编辑五大任务。模型结合了多模态大语言模型进行语义条件控制、联合训练的VAE进行声学条件控制，以及混合整流流Transformer进行生成。通过生成预热、联合预训练、人类反馈优化和强化学习等策略训练，并进一步蒸馏出轻量版AuK-Flash以降低推理成本。

Details

Motivation: 旨在构建一个统一的、开源的、可通过自然语言指令灵活控制的基础模型，以同时解决多样化的语音生成与编辑任务，打破传统任务特定模型的局限。

Result: 实验表明，AuK在零样本和指令控制的语音生成以及通用指令引导编辑任务上取得了领先性能，同时在信号级修复任务上保持竞争力。其轻量版AuK-Flash在匹配条件下实现了4.5倍的实时加速。

Insight: 创新点在于通过大规模指令-音频对构建统一的任务接口，并设计了结合语义与声学条件控制、采用混合整流流Transformer的架构。训练策略上，结合了生成预热、联合预训练、人类反馈优化和强化学习，并通过一致性初始化和任务路由解耦DMD进行高效蒸馏，实现了性能与效率的平衡。

Abstract: We introduce AuK, an open-source foundational model that unifies speech generation and editing through a common interface of natural-language instructions and audio context. To support this broad capability set, we construct approximately 3.03 billion instruction–audio instances and 1.95 million hours of effective supervision across five task families: speech generation, content editing, enhancement and separation, paralinguistic editing, and acoustic editing. AuK combines a multimodal large language model for semantic conditioning, an VAE jointly trained on speech, general audio, and music for acoustic conditioning, and a hybrid rectified-flow Transformer that performs dual-stream MMDiT blocks followed by unified single-stream DiT blocks for generation. Training begins with generation-only warm-up and proceeds to joint generation–editing pre-training. We then apply complementary post-training strategies: human-feedback preference optimization for open-ended editing and reward-based reinforcement learning for speech generation. To reduce inference cost, we further distill the model with consistency initialization and task-routed Decoupled DMD. The resulting AuK-Flash performs 4-step inference without classifier-free guidance and achieves a 4.5 wall-clock speedup over the full model under matched conditions. Experiments demonstrate leading performance on zero-shot and instruction-controlled speech generation and general instruction-guided editing, while remaining competitive on signal-level restoration tasks. We release both the source code and model weights to support reproducibility and further research.

cs.HC [Back]

[275] FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation cs.HC | cs.CLPDF

Zhengping Jiang, Gonzalo Ramos, Jina Suh, Shiqian Rachel Ng, Elias Stengel-Eskin

TL;DR: FrankenReport是一个用于长篇幅知识寻求报告生成的系统，它通过自适应提前退出的机制，在生成过程中评估中间输出并预测进一步计算是否带来显著质量提升。该系统在低预算下大幅超越随机分配基线，并能随着预算增加平滑恢复全流程质量，同时能够适应简单自然的用户反馈。

Details

Motivation: 解决深度研究系统在现实部署中面临的延迟和资源消耗挑战，特别是针对长篇幅知识寻求报告生成任务。

Result: 在模拟研究中，低预算下性能大幅超越随机分配基线（高达4倍），且随着预算增长能平滑恢复全流程质量；用户研究表明，尽管用户和主题偏好不同，它能高效适应简单自然反馈，与需要更昂贵监督的方法相当。

Insight: 创新点在于提出基于计算期望值的自适应提前退出机制，可预测未来质量增益；客观分析认为，将计算资源分配决策建模为预测问题，并利用中间草稿进行预测，是资源受限环境下长文本生成的有效策略。

Abstract: While deep research systems address interactive information-seeking needs impressively, their real-world deployments face latency and resource-consumption challenges. We present FrankenReport, an interface for long-form knowledge-seeking report generation that supports adaptive early exiting per section: it evaluates intermediate outputs during generation and predicts whether further targeted computation will yield significant quality gains. In a simulation study, FrankenReport outperforms random allocation baselines by a large margin (up to 4x) under low budgets and smoothly recovers full-pipeline quality as the budget grows, showing that future quality gains are predictable from intermediate drafts. Through experiments and user studies, we further show that despite varying preferences across users and topics, FrankenReport adapts to simple, natural user feedback as efficiently as methods requiring much costlier supervision such as generated drafts and explicit rationales.

[276] Large-Scale User Behavior Analysis in Multimodal AI-Assisted Manual Task Execution cs.HC | cs.AI | cs.CLPDF

Rafael Ferreira, Diogo Tavares, Diogo Glória-Silva, David Semedo, João Magalhães

TL;DR: 本文对多模态对话助手（CTAs）在真实场景中的大规模用户行为进行了分析，揭示了用户与助手交互流程、用户意图、对话特征以及影响满意度的行为因素，并提出了具体的设计指导。

Details

Motivation: 现有研究多在受控环境下进行，缺乏对真实场景中大规模用户使用多模态对话助手行为的深入理解。

Result: 基于数千名真实用户的数据分析，研究发现了用户交互流程、意图、对话特征和满意度相关行为的新见解，为未来研究提供了关键机会。

Insight: 创新点在于首次通过大规模真实世界数据分析揭示了CTAs的用户行为模式，并基于此提出了具体的设计指南，对用户交互设计和任务参与度的优化具有借鉴意义。

Abstract: Conversational Task Assistants (CTAs) are multimodal dialogue systems that support users in complex real-world tasks such as cooking and DIY through voice, text, image, and video interactions. Prior user studies have focused on controlled settings, leaving limited understanding of real-world CTA usage at scale. In this work, we present a large-scale study of CTA usage based on thousands of users in-the-wild. Our large-scale real-world data analysis unveils new understandings of (i) user-CTA interaction flows, (ii) user intents, (iii) user conversational traits, and (iv) behavioral factors associated with user satisfaction. Our findings reveal key opportunities for future research in CTAs, particularly in user interaction design and task engagement, concluding with concrete design guidelines.

[277] MM-SVGEdit: A Multimodal-Driven SVG Editing for UI Design cs.HC | cs.CVPDF

Shibo Yang, Yuqing Gao, Zipeng Liu

TL;DR: 本文提出MM-SVGEdit，一种多模态驱动的SVG编辑方法，用于UI设计领域。该方法通过视觉定位与修改的两阶段策略，结合自然语言指令和直接操作（鼠标键盘）两种交互方式，旨在提升SVG编辑的准确性、效率和用户可控性。

Details

Motivation: 解决传统SVG编辑技术门槛高、手动迭代繁琐，以及基于LLM的编辑方案精度低、用户可控性差的问题。

Result: 在自构建的包含14,476个问答对的数据集上评估，覆盖11种对单个和多个UI目标的编辑操作，结果显示MM-SVGEdit在提升编辑精度、效率和用户感知控制的同时，减少了token消耗和响应时间。

Insight: 创新点在于将传统SVG编辑与LLM方法结合，并采用两阶段（定位后修改）的多模态交互策略，支持语言和直接操作，提高了编辑的灵活性和可控性。

Abstract: In the field of UI design, Scalable Vector Graphics (SVG) is widely used as a design medium. However, traditional SVG editing techniques have high entry barriers and require cumbersome manual iteration, while LLM-based editing solutions suffer from low accuracy and poor user controllability. To address these issues, we propose MM-SVGEdit, a multimodal-driven SVG editing approach that integrates traditional SVG editing and LLM-based methods. We introduce a two-stage strategy in which visual grounding is followed by modification. Both stages support two interaction modalities: natural language instructions and direct manipulation (mouse and keyboard). We trained and evaluated MM-SVGEdit on a self-constructed dataset of 14,476 question-answer pairs generated from UIs, covering 11 types of editing operations on both single and multiple UI targets. The results show that MM-SVGEdit improves SVG editing accuracy, efficiency, and user-perceived control while reducing token consumption and response time.

cs.IR [Back]

[278] EviMap: Evidence-Grounded Hierarchical Topic Maps for Exploring Unlabeled Corpora cs.IR | cs.CL | cs.HCPDF

Zhiyin Tan, Changxu Duan

TL;DR: EviMap是一个交互式系统，旨在为研究人员和从业者提供无标签文本语料库的可审计主题概览。它通过提取文档内的证据短语，而非整个文档，构建三层主题地图（方面、组和细粒度主题），并利用嵌入聚类和LLM进行语义判断，确保每个节点都能追溯到原始文本中的支持短语，从而增强可验证性。

Details

Motivation: 解决在缺乏标签、查询或编码方案时，探索陌生自由文本集合（如调查评论、报告等）的初始主题地图的可信度问题，现有方法在规模与可验证性之间存在权衡，而EviMap旨在提供可审计的概述以支持下游分析。

Result: 在六个异质语料库（包含2,108至101,699个文档）上演示了工作流程，并与扁平化和分层LLM基线进行了比较，通过将每个标签基于原始文本片段，使主题地图不仅可读而且可验证。

Insight: 创新点在于将证据短语而非整个文档组织成层次化主题地图，结合嵌入聚类和LLM进行语义细化，确保可追溯性和可审计性；客观分析认为，该方法通过强调证据基础，提升了主题建模的透明度和用户信任度，适用于早期探索阶段。

Abstract: Research teams and organizations often explore unfamiliar free-text collections, from survey comments and reviews to reports and domain documents, before labels, queries or coding schemes exist. At this stage, the first thematic map shapes what users notice, prioritize and carry into downstream analysis, so it should be trusted only insofar as it can be verified. Existing options force a trade-off between scale and verifiability. Qualitative coding preserves evidence but is slow. Search presupposes a query. Clustering and topic models scale but produce labels users must interpret. One-shot large language model (LLM) summaries are fluent yet difficult to reproduce or audit. We present EviMap, an interactive system providing researchers and practitioners with an auditable thematic overview of such corpora. Guided by model-generated context describing the corpus and hypothesized stakeholder concerns, EviMap extracts within-document evidence phrases and organizes them, rather than whole documents, into a three-level map of aspects, groups and fine-grained topics. Embedding-based clustering narrows the search space for finer semantic judgments by the LLM. Each node traces back to supporting phrase spans, so documents link to topics through evidence they contain and users can audit labels against the original text. Users can start from a top-level corpus map, drill into topics, inspect highlighted evidence in original documents, and combine two topics to find documents discussing both. We demonstrate this workflow across six heterogeneous corpora spanning 2,108 to 101,699 documents, with a comparison against flat and hierarchical LLM baselines. By grounding every label in verbatim source spans, EviMap makes a topic map not just readable, but verifiable. Code, demo video, and interactive dashboard are available at https://github.com/zhiyintan/EviMap.

cs.RO [Back]

[279] GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation cs.RO | cs.CVPDF

AgiBot Research Team, Renhang Liu, Wenzhi Zhao, Zhuo Yang, Liliang Chen

TL;DR: 本文提出了GE-Act 2.0，一个用于机器人操作的世界-动作模型（WAM）。该模型从零开始在操作数据上训练，包含面向控制的自动编码器（CoAE）、单步视觉规划器（SVP）和逆动力学模型（IDM）三个组件。通过知识对齐选择性优化（KASO）进行联合训练，并在100个任务上直接评估预训练模型，无需针对每个任务进行微调。实验表明，随着协同训练数据从300小时扩展到30,000小时，模型性能显著提升，并展现出跨具身（cross-embodiment）迁移能力。

Details

Motivation: 现有的世界-动作模型大多继承预训练的视频生成器，其自身的预训练和规模化研究不足。本文旨在探索如何从零开始预训练并规模化一个专门用于机器人操作的世界-动作模型。

Result: 在包含20个操作技能组的100个任务上，模型在未见过的场景、背景、光照和物体实例上进行零样本评估。协同训练数据从300小时扩展到30,000小时后，在G1-OP任务上的成功率从17.1%提升至44.1%，在G2-90D任务上从13.4%提升至31.1%。模型在19/20和18/20的技能组上均有提升，技能特定覆盖率与零样本分布外（OOD）成功率高度相关。模型还能在至少90%的试验中理解物体、颜色、形状和位置参考，并遵循明确的指令。

Insight: 创新点在于：1）模型所有可训练的生成和动作组件均从零开始在操作数据上初始化，而非继承通用视频生成器；2）设计了CoAE、SVP和IDM的模块化架构，支持在互补数据上分别预训练视觉规划和逆动力学；3）提出了KASO联合训练方法，通过选择行为兼容的预测未来状态来减少不匹配的监督信号；4）展示了模型性能随数据规模显著提升，并提供了跨具身迁移的证据。

Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled interaction. Most inherit pretrained video generators, leaving WAM pretraining and scaling underexplored. We introduce Genie Envisioner Act 2.0 (GE-Act 2.0), a world-action model whose trainable generative and action components are all initialized from scratch on manipulation data. It combines a control-oriented autoencoder (CoAE), a single-step visual planner (SVP), and an inverse dynamics model (IDM). CoAE retains action- and instruction-relevant information under aggressive compression, while SVP produces a complete future state in one differentiable pass, so visual planning and inverse dynamics can be pretrained separately on complementary data. The components are then jointly trained with knowledge-aligned selective optimization (KASO), which reduces mismatched supervision by selecting only predicted futures judged behaviorally compatible with the recorded action. We evaluate pretrained checkpoints directly, without per-task fine-tuning, on 100 tasks across 20 manipulation skill groups with held-out scenes, backgrounds, lighting, and object instances. Scaling co-training data from 300 to 30,000 hours raises success from 17.1% to 44.1% on G1-OP and from 13.4% to 31.1% on G2-90D; despite comprising less than 2% of the co-training data, G2-90D improves by 17.7 points, suggesting cross-embodiment transfer. Gains span 19/20 and 18/20 skill groups, and skill-specific coverage strongly correlates with zero-shot out-of-distribution (OOD) success (Pearson r=0.80; Spearman rho=0.85). Under the same protocol, the model grounds object, color, shape, and position references in at least 90% of trials and follows explicit instructions even when they conflict with an already-committed behavior or a conventional scene association.

[280] IM-ENGINE: Image Editing for Embodied Data Generation cs.RO | cs.CVPDF

Yian Wang, Junyi Cao, Xiaowen Qiu, Chuang Gan

TL;DR: IM-ENGINE是一个基于模拟器的数据生成流程，它利用图像编辑作为中间表示来生成具身数据。该流程通过编辑渲染场景图像来注入任务语义，利用模拟器先验恢复3D状态，并在物理模拟中优化，最终转换为机器人可执行的监督信号。它被实例化用于灵巧抓取合成和目标状态生成，结合了生成式语义先验和模拟器基础，为机器人学习提供了可扩展的任务相关监督。

Details

Motivation: 当前基于学习的操作任务数据生成方法存在局限性：人类演示捕获意图但成本高且受限于人-机器人具身差距，仿真可扩展数据生成但往往无法充分指定功能行为。需要一种能同时提供语义意义和物理可执行性的监督数据生成方法。

Result: 论文在灵巧抓取合成和目标状态生成任务上实例化了IM-ENGINE流程，生成了经过物理验证的机器人抓取以及物理有效、语义有意义的目标和轨迹。该方法结合了生成式语义先验和模拟器基础，实现了可扩展的任务相关监督生成。

Insight: 创新点在于将图像编辑作为中间表示来桥接语义意图与物理可执行性，利用模拟器先验和未改变的锚对象来恢复显式3D状态。这种方法巧妙地融合了生成模型的语义能力和物理模拟的精确性，为机器人学习数据生成提供了新思路。

Abstract: Learning-based manipulation requires supervision that is both semantically meaningful and physically executable, but current data pipelines often provide only one of these properties. Human demonstrations capture intent but are costly to collect and constrained by the human-robot embodiment gap, while simulation can scale data generation but often under-specifies functional behavior. We present IM-ENGINE, a simulator-grounded pipeline that uses image editing as an intermediate representation for embodied data generation. Given a rendered scene with known geometry, depth, segmentation, and camera parameters, IM-ENGINE edits the image to inject task-relevant semantics, recovers explicit 3D state using simulator priors and an unchanged anchor object, refines the state in physics, and converts it into robot-executable supervision. We instantiate the pipeline for dexterous grasp synthesis and goal-state generation. For grasping, IM-ENGINE generates a human grasp in image space, recovers the hand-object interaction, retargets it to a robot hand, and refines it into physically validated robot grasps. For goal generation, it edits a rendered scene into a desired outcome, recovers the target-object pose, and refines it into physically valid, semantically meaningful goals and trajectories. This combination of generative semantic priors and simulator grounding enables scalable task-relevant supervision for robot learning.

[281] Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoring cs.RO | cs.CVPDF

Zhenxin Li, Nadine Chang, Xinglong Sun, Jingde Chen, Wenhao Yao

TL;DR: 本文提出了大型离散策略（LDiP），一种完全离散的行为建模框架，用于从大量物理上合理的候选动作中进行选择。它通过随机迭代评分机制来增强表达能力，在自动驾驶、机器人操作等多个任务中超越了强大的离散和连续基线模型，展示了离散策略在表达能力、合理性和可解释性方面的优势。

Details

Motivation: 现有行为策略通常建模为连续生成模型，其迭代去噪过程虽然表达能力强，但难以解释且容易产生不合理的动作。本文旨在解决这一问题，提出一个更可解释且能保证动作合理性的离散框架。

Result: 在端到端规划、闭环驾驶、机器人操作和视觉-语言-动作等场景的实验中，LDiP在自动驾驶任务中一致超越了强大的离散和连续基线，在机器人操作任务中达到或超过了连续生成策略的水平。

Insight: 核心创新在于提出了随机迭代评分机制，通过在评分空间中引入随机性来对候选动作进行渐进式重评分和剪枝，从而在保持明确决策过程的同时，实现了对合理动作的细粒度排序和探索。这为离散策略提供了与连续模型相媲美的表达能力。

Abstract: Behavior policies are often formulated as continuous generative models, whose iterative denoising processes are expressive but difficult to interpret and prone to producing implausible actions. We propose the Large Discrete Policy (LDiP), a fully discrete behavior modeling framework that selects actions from a large vocabulary of physically plausible candidates. Rather than perturbing actions, LDiP improves expressivity through stochastic iterative scoring: it progressively re-scores and prunes candidates with score-space stochasticity, enabling fine-grained ranking and exploration among plausible actions while preserving an explicit decision process. Across end-to-end planning, closed-loop driving, robotic manipulation, and vision-language-action settings, LDiP consistently outperforms strong discrete and continuous baselines in autonomous driving, and exceeds or matches continuous generative policies in robotic manipulation. These results show that discrete policies, when equipped with effective scoring mechanisms, offer an expressive, plausible, and interpretable alternative for behavior modeling. Project website: https://zhenxinli.net/LargeDiscretePolicy/.

[282] Scene Graph-Driven Haptic Feedback for Safety Enhancement in Robotic Ophthalmic Surgery via Physically Simulated iOCT cs.RO | cs.CVPDF

Danial Arbabi, Korab Hoxha, Angelo Henriques, Mirza Imamovic, M. Ali Nasseri

TL;DR: 本文提出了一种用于机器人眼科手术的新型触觉反馈系统，该系统利用场景图（SG）来增强手术安全性。系统通过分析物理模拟的术中光学相干断层扫描（iOCT）数据，构建实时手术场景图，并基于此通过规则引擎在机器人输入设备上生成状态相关的触觉反馈。用户研究表明，该系统能显著提高手术精度和可用性。

Details

Motivation: 机器人眼科手术虽然精度高，但切断了外科医生与器械的直接联系，造成了‘感觉鸿沟’，导致触觉反馈的缺失。本文旨在通过场景图驱动的触觉反馈系统来弥补这一鸿沟，提升手术安全性。

Result: 在16名参与者的人体模型用户研究中，该系统将针头对准误差降低了14%（p = 0.044），系统可用性量表（SUS）得分提高了8%（p = 0.015），同时保持了可比的任务完成时间。轨迹分析显示，系统促成了更安全的‘先对准再接近’策略。

Insight: 创新点在于将物理模拟的iOCT数据与场景图（SG）结合，作为实时、上下文感知的触觉反馈的直接计算基础。这为机器人显微手术提供了一种新的语义抽象层和确定性规则引擎，以实现安全增强的交互。

Abstract: Robotic ophthalmic surgery offers high precision but introduces a “sensory gap” by decoupling the surgeon from their instrument, resulting in a loss of tactile feedback. This paper presents a novel haptic feedback system for subretinal injection tasks leveraging Scene Graphs (SG). The system bridges the sensory gap by analyzing a physically simulated intraoperative Optical Coherence Tomography (iOCT) feed to construct a real-time surgical SG. The SG serves as a semantic abstraction layer for the surgical scene, which is then utilized by a deterministic, rule-based engine to generate state-dependent haptic feedback on a robotic input device. The system was evaluated in a user study (N=16) using an anthropomorphic head phantom and a custom-built surgical robot. Results demonstrate that the SG-driven haptic feedback improved surgical precision, reducing needle alignment error by 14% (p = 0.044) and improving System Usability Scale (SUS) scores by 8% (p = 0.015), while maintaining comparable task completion times. A needle trajectory analysis revealed the emergence of a safer “Align-then-Approach” strategy, in which our haptic negative reinforcement prompted users to fine-tune the tool’s trajectory before approaching the retinal target. This work suggests that SGs can effectively serve as the direct computational foundation for real-time, safety-enhancing context-aware haptic feedback in robotic microsurgery.

[283] Rethinking Learned Occupancy in Autonomous Active Mapping with Observation-Gated Filtering cs.RO | cs.CVPDF

Jiahui Zhang, Bonian Han, Gongbo Liang, Yu Zhang

TL;DR: 本文研究了自主3D主动建图中学习占据率预测与规划器耦合接口的问题，发现提高占据率预测精度并不单调提升闭环覆盖性能。作者通过诊断分析，提出了一种观测门控滤波器，该滤波器在观测不足区域保留补全预测，仅在多次观测无支持时抑制预测，从而改善了规划性能。

Details

Motivation: 自主3D主动建图中，学习占据率补全预测的单一地图同时用于评估表面增益和约束无碰撞运动，但未经验证的占据率预测会同时扭曲机器人的观测选择和路径规划，作者旨在诊断并缓解这一耦合问题。

Result: 在固定主动建图系统、仅改变规划器所用占据率来源（仅观测、学习预测、经修正的预测、真值）的闭环基准测试中，使用真值占据率规划比学习基线平均提前12.7步达到其最终覆盖率的70%，但最终覆盖率仅提高0.031。提出的观测门控滤波器无需重新训练或真值，改善了易失败的起始情况。

Insight: 创新点在于诊断了学习占据率预测与规划器耦合的非单调影响，并提出了一个轻量的观测门控滤波器来动态管理预测的可靠性。客观来看，其核心洞察是规划器对几何的信任需要根据在线观测历史进行动态修订，而非静态依赖单一预测地图。

Abstract: Autonomous 3D active mapping requires a space robot to choose where to sense while building the geometry needed for navigation. Learned occupancy completion extends spatial context beyond the current field of view, but one predicted map often serves two planning roles: it scores expected surface gain and constrains collision-free motion. Unsupported occupancy can therefore distort both where the robot looks and where it believes it can travel. We study this coupled interface in a controlled closed-loop benchmark by holding the active-mapping system fixed and varying only its planner-facing occupancy across observation-only, learned, oracle-corrected, and ground-truth conditions. Improving occupancy accuracy does not monotonically improve closed-loop coverage: across 25 starts, planning with ground-truth occupancy reaches 70% of the learned baseline’s final coverage 12.7 steps earlier on average, while increasing final coverage by only 0.031. Guided by this diagnosis, we introduce an observation-gated filter that retains completion in insufficiently observed regions and suppresses predictions only after repeated frustum exposure without nearby RGB-D support. The filter improves both targeted failure-prone starts without retraining or ground truth. These results motivate online revision of planner-facing geometry during autonomous intervals between communication windows. The current study assumes benchmark RGB-D observations and sufficiently accurate pose estimates; planetary sensing conditions and accumulated localization drift remain to be evaluated.

cs.CY [Back]

Yi Yang, Xiao Jia, Zeyun Dong, Chenzhang Wang, Zhanzhan Zhao

TL;DR: 本文通过分析近5万篇相关文献，系统性地绘制了大型语言模型（LLM）社会科学研究领域的知识图谱。研究结合多种文本挖掘技术，识别出该领域的三大核心研究范畴：将LLM视为社会心智、研究LLM社会以及探讨LLM与人类的交互。

Details

Motivation: 当前关于LLM如何影响社会、沟通、学习与决策的社会科学研究仍处于碎片化状态，缺乏一个系统性的框架来整合和理解这一新兴领域。

Result: 研究在精心筛选的198篇论文全文中，通过重采样验证了三大领域划分的高度稳定性（调整兰德指数为0.952），且K-means聚类结果与作者全文分类的一致性达到77.78%。在更大规模的47,719篇文献分析中，15个主题中有13个能映射到该分类体系。

Insight: 创新点在于首次为LLM社会科学研究提供了一个可复现的、数据驱动的分类学框架。该框架揭示了研究重心（LLM-人类交互占主导）与高影响力成果分布（在顶级会议中，社会心智和LLM社会研究更受关注）之间的不匹配，为未来研究方向提供了结构化视角。

Abstract: Large language models (LLMs) increasingly shape communication, learning, work, creativity, and decision-making, yet social-science research on these developments remains fragmented. We map this emerging field using a curated corpus of 198 papers reviewed in full and a field-scale corpus of 47,719 published papers from five bibliographic databases. Combining sentence embeddings, K-means clustering, within-cluster Latent Dirichlet Allocation (LDA), author and LLM classifications, and structural topic modeling, we identify three domains: LLM as Social Minds, examining socially interpretable model behavior; LLM Societies, examining collective dynamics among interacting model-based agents; and LLM-Human Interactions, examining how people perceive, use, and are affected by LLMs. These domains contain 13 subcategories spanning reasoning, personality and bias, behavioral games, collective intelligence, simulation, trust, work, creativity, and education. In the curated corpus, the three-domain solution is highly stable under resampling (adjusted Rand index = 0.952), and K-means assignments agree with author full-text classifications for 77.78% of papers. At field scale, 13 of 15 topics map onto the taxonomy, while K-means and structural-topic-model domains agree for 73.83% of overlapping papers. LLM-Human Interactions accounts for 78.02% of domain-mapped topic mass, but venue analysis reveals a contrasting pattern: Social Minds and LLM Societies together account for 66.37% of highly cited papers in leading conference venues, whereas LLM-Human Interactions accounts for 76.81% in the corresponding journal subset. The resulting taxonomy provides a reproducible framework for understanding how model behavior, agent interaction, and institutional context jointly shape the social consequences of LLMs.

cs.PF [Back]

[285] RGB Input Pipelines: Throughput, GPU Memory, and Transformation Coverage cs.PF | cs.CVPDF

Vladimir Iglovikov

TL;DR: 该论文比较了五个图像增强库（DALI、AlbumentationsX、TorchVision、Kornia、Pillow）中七种输入路径的性能，这些路径从RGB JPEG文件开始，到同步的CUDA float16批次结束。研究在固定设置下测量了吞吐量和峰值GPU内存使用，发现DALI和AlbumentationsX在共享配方上表现最佳，其中DALI吞吐量更高，而AlbumentationsX在更多配方上表现优越。

Details

Motivation: 解决图像增强管道在模型训练前必须提供完整批次数据时，不同库的输入路径在吞吐量、GPU内存使用和转换覆盖范围方面的性能差异问题，以帮助用户选择最佳工具。

Result: 在NVIDIA L4机器上，使用57个选定配方和批次大小256进行测量。在11个所有路径共享的配方中，DALI和AlbumentationsX的中位吞吐量分别为5,029和4,679 images/s，中位峰值GPU内存为2,086和1,852 MiB。在更广泛的成对比较中，AlbumentationsX在26/26 TorchVision、50/51 Kornia和25/26 Pillow配方上表现更好；DALI在所有22个共享配方上比AlbumentationsX更快，中位吞吐量比为1.18倍。

Insight: 创新点在于系统性地比较了多个图像增强库的输入路径性能，通过手动匹配转换配方和参数确保可比性，并提供了覆盖范围普查。这为实际应用中的库选择提供了数据驱动的见解，强调了吞吐量与内存权衡以及库间性能差异。

Abstract: An image-augmentation pipeline must deliver a complete batch before a model can use it. We compare seven input paths from five libraries, starting with RGB JPEG files and ending with a synchronized CUDA float16 batch. We manually matched transformation recipes and parameters across libraries to make the workloads as comparable as possible. The experiment uses 57 selected recipes, a batch size of 256, and one NVIDIA L4 machine. Throughput and peak process GPU memory are recorded together in 759 measurements. On the 11 recipes shared by all paths, DALI and AlbumentationsX have median throughputs of 5,029 and 4,679 images/s, with median peak GPU memory of 2,086 and 1,852 MiB. Broader pairwise comparisons favor AlbumentationsX on 26/26 TorchVision recipes, 50/51 Kornia recipes, and 25/26 Pillow recipes. DALI is faster than AlbumentationsX on all 22 shared recipes, with a median throughput ratio of 1.18x. A separate census reports coverage of the 118 entries in a selected AlbumentationsX RGB catalog. The study measures input preparation at fixed settings; it does not measure model training, numerical equivalence, or the best attainable configuration of each library. Benchmark code: https://github.com/albumentations-team/benchmark.

cs.LG [Back]

[286] ACE: Adapter Consolidation across Experts for Parameter-Efficient Fine-Tuning of MoE LLMs cs.LG | cs.AI | cs.CLPDF

Ahin Lee, Sehyun Yun, Joonha Park, Taesik Gong

TL;DR: 本文提出了ACE方法，用于在参数高效微调（PEFT）中整合MoE模型中各专家的适配器。研究发现专家特定的LoRA适配器在微调过程中存在功能冗余，因此通过将冗余专家分组并用共享的更高秩LoRA模块替代，在相同参数预算下提升了性能。该方法还通过分组执行适配器计算，实现了训练加速。

Details

Motivation: 针对MoE模型参数高效微调中，为每个专家附加独立低秩适配器（专家级LoRA）导致适配能力分散、梯度监督稀疏不平衡以及计算分解为许多小矩阵乘法的问题，旨在减少冗余并提升效率。

Result: 在涵盖12个数据集和四个MoE骨干模型的评估中，ACE在三个有完整基线覆盖的骨干上，在参数匹配的PEFT方法中取得了最高的平均准确率，同时相比专家级LoRA实现了1.31倍至1.48倍的训练加速，且未增加峰值内存。

Insight: 创新点在于发现了MoE微调中专家特定适配器的冗余性，并提出了基于分组和共享的适配器整合策略（ACE），在保持参数效率的同时通过提升适配器秩和合并计算来改善性能和训练速度。

Abstract: Parameter-efficient fine-tuning (PEFT) of mixture-of-experts (MoE) models commonly attaches a separate low-rank adapter to each expert. This expert-wise design fragments adaptation in three ways: capacity is split across narrow low-rank updates, gradient supervision becomes sparse and imbalanced under sparse routing, and execution is decomposed into many small GEMMs. We find that such expert-wise separation is often unnecessary, as subsets of LoRA adapters become functionally similar during fine-tuning, revealing redundancy among expert-specific adapters. Based on this redundancy, we propose ACE (Adapter Consolidation across Experts), which groups redundant experts and replaces their expert-specific adapters with group-shared higher-rank LoRA modules under the same PEFT budget. ACE further introduces grouped adapter execution, which consolidates fragmented expert-wise adapter computations into fewer, larger group-level GEMMs. Across evaluations covering 12 datasets and four MoE backbones, ACE achieves the highest observed mean accuracy among the parameter-matched PEFT methods on the three backbones with complete baseline coverage, while providing $1.31\times$ to $1.48\times$ wall-clock training speedup over expert-wise LoRA without increasing peak memory. Our code is available at https://github.com/UbiquitousAILab/ACE.

[287] VERPO: Verified Evidence Regularized Policy Optimization cs.LG | cs.AI | cs.CLPDF

Haijiang Li, Chengyu Lv, Yi Zhang, Zhibing Zhang, Rui Qian

TL;DR: VERPO（Verified Evidence Regularized Policy Optimization）是一个用于语言模型后训练的框架，通过将证据视为策略修正的提议，同时保留结果目标，来提供更精细的监督。它分离了无证据的参考恢复和带符号的令牌级证据修正，使用Fisher证据对比来衰减修正，并通过停止令牌的ZPD控制器根据局部奖励对齐和Fisher移动成本来调整接受度。在五个科学推理和工具使用任务上，该框架在不同骨干模型上均提升了平均得分。

Details

Motivation: 现有方法中，可验证的结果奖励指导语言模型后训练，但序列级优势无法识别哪些令牌级决策应保留或修正；而证据条件教师通过特权反馈重放采样轨迹提供更密集的监督，但无差别的模仿可能转移不支持任务成功的格式或推理风格变化。

Result: 在五个科学推理和工具使用任务上，每个骨干模型的最佳变体在平均得分上超过了最强的基线：Qwen3-4B从0.6826提升到0.6857，Qwen3-8B从0.6895提升到0.7058，Llama-3.2-1B从0.4751提升到0.5657。

Insight: 创新点在于将证据作为策略修正的提议，而非直接模仿，通过分离参考恢复和证据修正、使用Fisher证据对比衰减修正，以及引入停止令牌的ZPD控制器来动态调整接受度，从而在保持结果目标的同时实现更精细的令牌级监督，避免无差别模仿的风险。

Abstract: Verifiable outcome rewards guide language-model post-training, but sequence-level advantages do not identify which token-level decisions should be preserved or revised. Evidence-conditioned Teachers provide denser supervision by replaying sampled trajectories with privileged feedback. Yet indiscriminate imitation risks transferring formatting or reasoning-style shifts that do not support task success. We introduce VERPO, a Verified Evidence Regularized Policy Optimization framework that treats evidence as a proposal for policy correction while retaining the outcome objective. It separates evidence-free reference restoration from signed token-level evidence corrections. Fisher Evidence Contrast attenuates corrections along an estimated evidence-presence direction. A stopped token-wise ZPD controller scales acceptance according to local reward alignment and Fisher movement cost, while the reference channel remains independent of acceptance. Across five scientific-reasoning and tool-use tasks, the best variant on each backbone exceeds the strongest compared baseline in average score. The averages rise from 0.6826 to 0.6857 on Qwen3-4B, from 0.6895 to 0.7058 on Qwen3-8B, and from 0.4751 to 0.5657 on Llama-3.2-1B.

[288] DataFlex-RL: An Evaluation Platform for RLVR Data Policies cs.LG | cs.CLPDF

Hao Liang, Mingrui Chen, Hengyi Feng, Meiyi Qiang, Wentao Zhang

TL;DR: 论文提出了DataFlex-RL平台，用于在统一的GRPO框架下评估RLVR（带可验证奖励的强化学习）中的数据策略（如样本选择、加权和领域混合）。主要实验在Qwen2.5-7B-Base和Llama-3.1-8B-Base模型上，使用12个数学、逻辑和科学基准测试了多种数据策略配置。研究发现，均匀采样（Uniform GRPO）相比未训练检查点提升了7.76个百分点，但所测试的多种高级数据策略均未展现出统计显著的改进。

Details

Motivation: RLVR中的数据策略（决定使用哪些样本、如何加权以及不同领域的混合方式）对训练效果有重要影响，但目前缺乏一个统一的评估平台来系统比较这些策略。本文旨在填补这一空白，为数据策略的选择提供实证依据。

Result: 在Qwen2.5-7B-Base上的实验表明，均匀GRPO将领域平衡平均准确率提升了7.76个百分点。然而，八种样本选择或重加权方法相对于均匀采样均未达到95%置信区间排除零的统计显著改进；三种自适应混合方法也未在相同精度水平上优于固定的等比例混合。在Llama-3.1-8B-Base上的扩展实验也未发现一致的优胜者。评估结果对基准集构成敏感，例如使用侧重数学的6基准摘要与使用12基准摘要的排名呈负相关（相关系数-0.33）。

Insight: 论文的核心创新点是构建了DataFlex-RL这一标准化评估平台，使得不同RLVR数据策略能在公平环境下进行比较。一个关键的实证发现是，在受控设置下，尽管改变数据策略确实能可测量地改变训练过程，但并未产生可复现的、优于均匀训练的改进，这挑战了复杂数据策略必然更优的假设，并强调了评估基准集构成对结果排名的重要影响。

Abstract: Data policies for reinforcement learning with verifiable rewards (RLVR) determine which rollouts are used, how strongly they are weighted, and which domains contribute to subsequent training batches. We introduce DataFlex-RL, an evaluation platform for comparing these choices under a common GRPO recipe. Our primary experiment evaluates 13 configurations across 12 matched seeds using Qwen2.5-7B-Base and 12 mathematics, logic, and science benchmarks. Uniform GRPO improves the domain-balanced average accuracy by 7.76 percentage points over the untrained checkpoint. None of the eight rollout-selection or reweighting methods achieves a paired 95% confidence interval that excludes zero relative to uniform sampling, and none of the three adaptive mixtures outperforms a fixed equal mixture at the same level of precision. A corrected 12-seed extension on Llama-3.1-8B-Base places the additional methods on the same score scale as the original controls, but does not reveal a consistent winner in terms of observed mean performance. We also quantify evaluation sensitivity by rescoring nine Qwen2.5-7B-Instruct runs using a math-heavy six-benchmark summary, consisting of five mathematics benchmarks and GPQA-Diamond but no logic benchmark, and comparing it with the domain-balanced 12-benchmark summary. The resulting rankings are negatively correlated, with a correlation coefficient of -0.33, whereas summaries that retain all 12 benchmarks largely agree. Across the controlled settings studied here, changing the data policy measurably changes the training process but does not produce a reproducible improvement over uniform training.

[289] Are Verifier Errors Independent Within a GRPO Group? Evidence from Qwen2.5 Rollouts cs.LG | cs.CLPDF

Esther Xin

TL;DR: 本文研究了基于组的强化学习验证奖励（RLVR）中验证器错误的相关性问题，通过分析Qwen2.5-1.5B在数学推理数据集（MATH、GSM8K、DeepMath-103K）上生成的24,998组（每组8个补全）数据，发现组内验证器错误存在显著相关性（相关系数0.530），导致有效样本量降低至1.70。研究还揭示了不同答案格式（如分数、根式）对错误聚类的影响，并指出基于聚合错误率的分析可能忽略这种依赖性。

Details

Motivation: 动机在于基于组的RLVR方法通常假设验证器错误是独立的，但共享答案格式可能导致错误之间存在依赖性，从而影响性能评估的准确性，本文旨在量化这种依赖性。

Result: 在MATH、GSM8K和DeepMath-103K基准上，估计组内验证器错误相关系数为0.530（95%置信区间0.500-0.560），在可交换错误模型下，八补全组的有效样本量降至1.70；不同答案格式的依赖性差异显著，分数、根式等格式的聚类更强；在基于规则的验证器配置中，高达0.83%的组出现优势符号不一致。

Insight: 创新点在于首次系统量化了RLVR中验证器错误的组内相关性，揭示了答案格式对错误聚类的关键影响，强调需要结合提示和答案格式进行噪声分析，而非仅依赖聚合错误率，这为改进评估方法提供了实证依据。

Abstract: Group-based reinforcement learning with verifiable rewards (RLVR) scoresmultiple completions per prompt using automatic verifiers. Analysesbased on independent verifier errors may overlook dependence associatedwith shared answer formats. We investigate this dependence in24,998 groups of eight completions generated by Qwen2.5-1.5B onMATH, GSM8K, and DeepMath-103K. We estimate a pooled within-groupverifier-error correlation of 0.530 (95% confidence interval:0.500–0.560). Under an exchangeable-error model, this correspondsto a design-effect-adjusted effective sample size of 1.70 for aneight-completion group. Dependence varies substantially across answerforms: fractions, radicals, symbolic expressions, and intervals exhibitstronger clustering than unit annotations and percent signs. Replayinggroup-relative advantages across four rule-based verifier configurationsidentifies at least one advantage-sign disagreement in up to 0.83% ofgroups. Because a group is repeated sampling for one prompt, thiswithin-group clustering may reflect shared prompt difficulty as well asshared answer form, and we do not attempt to separate the two here.Unlike studies of correlated judgments across multiple evaluators, ouranalysis examines dependence across completions scored by the sameverifier. These findings motivate prompt- and answer-form-aware analysesof verifier noise rather than characterizations based solely onaggregate error rates.

[290] One Step, One Lead: Mitigating Higher-Order Interference in Multi-Domain Reinforcement Learning via Cross-Step Control cs.LG | cs.CLPDF

Zihan Lin, Xiaohan Wang, Jie Cao, Jiajun Chai, Guojun Yin

TL;DR: 该论文提出了一种名为OSOL的新方法，用于缓解多领域强化学习（RL）中的高阶干扰问题。作者发现，传统的单步梯度诊断方法会忽略一种关键的序列干扰形式，即连续更新在输出空间中可能相互部分抵消。OSOL方法通过利用前一个检查点的标记级对数概率足迹来评估反弹风险，并在标准的GRPO更新中应用自适应缩放的校正，从而抑制跨步输出回溯。

Details

Motivation: 在多领域强化学习中，联合训练通常会降低单个领域的性能并导致优化不稳定。现有工作主要从单步视角（如一阶梯度对齐或基于曲率的代理）诊断干扰，但这种方法可能遗漏关键的序列干扰形式。

Result: 在Qwen3-30B-A3B模型上的实验表明，OSOL达到了0.4822的领域宏观平均分，比最强的基线方法提升了5.7%。控制研究进一步证实，跨步回溯比同点梯度诊断与后续任务损害的相关性更强，且前一个足迹比基于Hessian的代理更准确地预测未来反弹风险。

Insight: 论文的创新点在于引入了跨步控制视角，揭示了序列干扰的重要性，并提出了一种无需显式高阶微分、基于检查点足迹的轻量级校正机制（OSOL）。这为理解和缓解多任务RL中的优化不稳定性提供了新的思路和工具。

Abstract: Reinforcement learning (RL) across multiple domains can broaden the reasoning capabilities of large language models (LLMs), yet joint training often degrades individual-domain performance and can destabilize optimization. Existing work typically diagnoses such interference from a single-step view using first-order gradient alignment or curvature-based proxies. We show that this view can miss a critical form of sequential interference: same-point domain gradients may remain nearly orthogonal even when consecutive realized updates partially reverse one another in output space. We further show that consecutive token log-probability footprints recover this interaction directly from adjacent checkpoints as a local second-order interaction in output space, without explicitly reconstructing same-step curvature. Building on this insight, we propose OSOL, which designates a focus domain at each iteration, uses the preceding checkpoint footprint to rank token-level rebound risk, and applies a drift-ranked, adaptively scaled correction within the standard GRPO update. Our analysis shows that this correction suppresses the targeted cross-step output backtracking component. Controlled studies further show that cross-step backtracking is more strongly associated with subsequent task damage than same-point gradient diagnostics, while the preceding footprint ranks future rebound risk more accurately than Hessian-based proxies. On Qwen3-30B-A3B, OSOL reaches a domain-macro average of 0.4822, improving by 5.7% over the strongest compared baseline, without explicit higher-order differentiation.

[291] I Don’t Miss You, but I Do: Self-Explanation Faithfulness of Modality Missingness in Vision-Language Models cs.LG | cs.CL | cs.CVPDF

Aydin Javadov, Daniel Schoess, Florian von Wangenheim

TL;DR: 本文提出了一种干预性评估协议，用于检验视觉语言模型（VLMs）在输入模态缺失时，其自我解释（self-explanation）的忠实性。研究发现，VLMs普遍存在系统性偏差，即高估可用模态证据的充分性，并严重低估恢复缺失模态对预测结果的影响。

Details

Motivation: 视觉语言模型越来越多地应用于某些输入模态可能缺失的场景，但目前尚不清楚它们是否能忠实解释这种缺失信息如何影响其自身预测。本文旨在评估模型对模态动态的自我解释是否可靠。

Result: 在两个模型家族的八个开源VLM上，跨越互补/同构文本-图像设置以及多视角驾驶场景的四个任务进行评估。模型预测的变化率中位数最高仅为8.8%，而实际执行干预后的变化率高达72.1%，在64个模型-任务-条件设置中有62个存在低估。模型很少声称证据不足，但一旦声称，其预测的准确性很高（恢复模态后答案改变的中位数为78-100%）。

Insight: 核心创新点在于提出了一种基于可执行干预的行为基准，作为评估多模态自我解释忠实性的客观标准。研究发现VLMs在解释其预测对可用和缺失模态证据的依赖关系时存在系统性误判，这凸显了将模型声明与实际行为进行对比验证的重要性。

Abstract: Vision-language models are increasingly used in settings where some input modalities may be unavailable, yet we know little about whether they can faithfully explain how such missing information affects their own predictions. We introduce an interventional protocol for evaluating self-explanations of modality dynamics: models state what each modality alone would support, whether restoring a missing modality would change their answer, and whether the available evidence is sufficient; we then execute the corresponding modality intervention and compare these claims with the model’s realized behavior. We evaluate eight open-weight VLMs from two model families across four tasks spanning complementary and isomorphic text-image settings and a multi-view driving setting. We find a systematic tendency to overstate the sufficiency of available modality evidence. Models substantially underestimate the effect of restoring missing modalities: task-level median predicted change rates are at most 8.8%, while the corresponding executed change rates reach 72.1%, with underprediction in 62 of 64 model-task-condition settings. Insufficiency claims are rare, but precise when produced: restoring the modality changes the answer in a median of 78-100% of flagged cases. Retrospective self-explanations show the same tendency: on complementary data, models over-credit single-modality sufficiency; on isomorphic data, they over-credit single representation sufficiency relative to their executed behavior. Together, these results show that VLMs systematically mischaracterize how their predictions depend on available and missing modality evidence, motivating executable interventions as a behavioral ground truth for evaluating multimodal self-explanations.

[292] Distillation as Probability Transport: Routed On-Policy Distillation cs.LG | cs.CLPDF

Tianle Xia, Lingxiang Hu, Yiding Sun, Linfang Shang, Ming Xu

TL;DR: 本文提出了一种名为RouteOPD（路由式策略蒸馏）的新方法，将策略蒸馏重新定义为教师引导的概率传输过程。该方法将教师与学生模型之间的局部差异分解为源（学生过剩概率）和目标（教师不足概率），并将它们配对形成明确的传输对，从而更精确地指导知识蒸馏。

Details

Motivation: 传统策略蒸馏方法仅将教师知识简化为对单个标记的标量信用（指示概率应增减），但未指定概率应如何重新分配。本文旨在解决这一不足，通过显式建模概率传输来更有效地利用教师知识。

Result: 在四种师生模型设置和四个数学推理基准测试上的实验表明，RouteOPD一致优于基于采样反向KL散度的策略蒸馏方法，其改进伴随着更高的路由保真度和更低的背景泄漏。

Insight: 核心创新在于将蒸馏过程形式化为概率传输问题，通过分解差异、配对源-目标并优化配对对数几率，实现了对更新方向和幅度的精确联合控制。这为知识蒸馏提供了一种更精细、可解释的优化框架。

Abstract: On-policy distillation (OPD) transfers teacher knowledge on student-generated trajectories, but efficient sampled objectives reduce the teacher distribution to scalar credit on individual tokens. Such credit indicates whether a token should gain or lose probability, yet leaves the corresponding redistribution unspecified. We recast OPD as teacher-guided probability transport and propose RouteOPD (Routed On-Policy Distillation), which decomposes local teacher–student disagreement into student-excess sources and teacher-deficit destinations and couples them into explicit transport pairs. RouteOPD optimizes pairwise log-odds toward jointly realizable targets obtained from a bounded teacher potential, while adapting the transport budget to the concentration of teacher demand. This formulation directs updates toward teacher-preferred destinations and controls their magnitude within a single transport operator. Experiments across four teacher–student settings and four mathematical-reasoning benchmarks demonstrate that RouteOPD consistently outperforms sampled reverse-KL OPD, with improvements accompanied by higher routing fidelity and lower background leakage. These results demonstrate the effectiveness of explicitly modeling probability transport in on-policy distillation.

[293] Miles v0.1: Production-Level Post-Training cs.LG | cs.CLPDF

RadixArk, :, Tom Chen, Mao Cheng, Shi Dong

TL;DR: Miles v0.1是一个用于前沿模型后训练的全栈、生产级系统，基于强化学习（RL）训练循环设计，强调组件的可验证性、简洁性和可定制性。该系统支持多种训练模式（如全参数RL、LoRA RL、监督微调）和架构（包括扩散模型），并提供了一个在64个NVIDIA GB300 GPU上对744B参数模型进行端到端异步智能体RL训练的案例研究。

Details

Motivation: 旨在为研究者和企业提供一个准确、高效、可靠且可扩展的系统，以降低前沿规模强化学习（RL）后训练的门槛。

Result: 系统在64个NVIDIA GB300 GPU上对GLM-5.2 744B-A40B模型进行终端使用编码任务的异步智能体RL训练，前30个测量步骤的中位步骤时间为263秒，展示了其生产级性能。

Insight: 创新点在于将RL训练循环的每个阶段（如基于SGLang的rollout引擎、可选的训练后端、多种权重同步传输方式）围绕‘可验证、简洁、可定制’的单一原则进行系统化设计，并统一架构支持多种训练范式和模型类型（如大语言模型和扩散模型）。

Abstract: We present Miles v0.1, a full-stack, production-ready system for frontier post-training. Building upon the clean design of slime, Miles designs each stage of the reinforcement-learning (RL) training loop around a single principle: components should be verified, clean, and customizable. With accuracy, efficiency, reliability, and scalability as first-class goals, Miles aims to make frontier-scale RL accessible to researchers and enterprises alike. This report walks through the system end to end: rollout engines built on SGLang, a trainer with a choice of two backends (NVIDIA Megatron-LM and PyTorch FSDP), and three weight-synchronization transports for different deployment topologies. Beyond full-parameter RL, Miles also supports LoRA RL, on-policy distillation, supervised fine-tuning, and true-on-policy rollout-training alignment, and extends the same architecture to diffusion models. We close with an end-to-end case study: fully asynchronous agentic RL on a GLM-5.2 744B-A40B model over terminal-use coding tasks, running on 64 NVIDIA GB300 GPUs with a median step time of 263 seconds over the first 30 measured steps. Miles is open-sourced at https://github.com/radixark/miles, with the project website at https://miles.radixark.com.

[294] Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Tasks cs.LG | cs.AI | cs.CLPDF

Hongbang Yuan, Zhuoran Jin, Yixin Cao

TL;DR: 本文提出了一种名为‘反馈增强环境’的新范式，旨在解决大语言模型作为自主智能体在长视野任务中因奖励稀疏而难以通过强化学习有效训练的问题。该方法通过改造环境，在智能体探索和演化的后期阶段，将反馈从动作指导转变为观察增强，从而为智能体提供更丰富的学习信号。在SciWorld和BFCL基准测试上的大规模实验表明，该方法能稳定训练过程、促进探索，并有效提升多种模型和RL算法的性能。

Details

Motivation: 动机在于解决大语言模型作为自主智能体在长视野任务中进行强化学习训练时，面临的严重奖励稀疏问题。传统的‘智能体侧预热’方法受限于数据稀缺和探索受限，因此需要转向‘环境侧适应’来提供更有效的学习反馈。

Result: 在SciWorld和BFCL基准测试上，使用不同规模的Qwen3模型和GRPO、GSPO、DAPO等RL算法进行的大规模实验表明，所提出的反馈增强环境方法相比标准设置能持续带来性能提升。

Insight: 核心创新点在于提出了‘反馈增强环境’这一范式，将环境改造为提供丰富反馈的支架，而非仅仅依赖智能体侧的预热。其关键设计策略是在智能体探索和演化的后期阶段，将反馈形式从直接的动作指导转变为对观察的增强，这有助于稳定训练、促进主动探索，并将环境指导内化为策略权重，而非仅仅是推理时的先验。分析还指出，组内反馈一致性是稳定优化的关键边界。

Abstract: Large Language Models demonstrate remarkable proficiency in static reasoning, yet training them as autonomous agents through Reinforcement Learning (RL) for long-horizon tasks is often hindered by severe reward sparsity. While conventional \textit{agent-side warming} up via supervised fine-tuning (SFT) can alleviate this, it is frequently limited by data scarcity and constrained exploration. To address this, we propose a paradigm shift to \textit{environment-side adaptation} by constructing \textbf{F}eedback-\textbf{E}nriched \textbf{E}nvironments (\textbf{FEEs}). Through a pilot study, we establish a feedback design strategy that reformulates environments by transitioning from action guidance to observation enrichment during the later stages of both intra-episode exploration and inter-episode evolution. Large-scale experiments on SciWorld and BFCL benchmarks using various Qwen3 model scales and RL algorithms such as GRPO, GSPO, and DAPO demonstrate that FEEs consistently yield performance improvements over standard settings. Furthermore, our analysis reveals that training with FEEs \textbf{(1)} stabilizes training dynamics by reducing entropy volatility, \textbf{(2)} facilitates proactive state-space exploration in difficult tasks, \textbf{(3) }ensures the internalization of environmental guidance into policy weights rather than acting as a mere inference-time prior, and \textbf{(4) }identifies intra-group feedback consistency as a critical boundary for stable optimization.

[295] Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR cs.LG | cs.AI | cs.CLPDF

Youngjun Yu, Sanghwan Jang, Hwanjo Yu

TL;DR: 本文提出了一种名为DATPO（Difficulty-Adaptive Sentence-entropy-guided Tree-structured Policy Optimization）的方法，旨在解决强化学习与可验证奖励（RLVR）在训练中探索有限、难以提升模型推理覆盖率（pass@k）的问题。该方法通过难度自适应的树状结构策略优化，结合句子熵引导的分支和多样性优势项，以增强训练时的语义多样性，从而扩展推理覆盖范围。

Details

Motivation: 尽管RLVR在提升单样本准确性方面取得了成功，但由于训练期间探索有限，它往往无法有效扩展模型的内在推理覆盖率（pass@k）。因此，本文旨在优化训练时rollout的结构设计，以解决这一覆盖范围不足的问题。

Result: 在数学推理基准测试上的实验表明，DATPO在pass@k指标上优于基线方法，这直接转化为更优的测试时扩展性能。

Insight: 摘要宣称的创新点包括：难度自适应rollout对扩展pass@k的关键作用、树状rollout在发现正确答案上优于并行采样，以及句子熵引导的分支克服了令牌级分支的局部化现象以最大化语义多样性。从客观角度看，DATPO通过整合难度自适应树搜索与多样性优势项，显式地促进语义多样性，为扩展推理覆盖提供了一种新颖的结构化方法。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has been central to the recent success of Large Reasoning Models. However, while RLVR significantly improves single-sample accuracy, it often fails to expand the model’s intrinsic reasoning coverage (pass@k) due to limited exploration during training. To address this, we optimize the structural design of train-time rollouts to enhance pass@k. Our analysis identifies three key design principles: (1) difficulty-adaptive rollout can play an important role in expanding pass@k, beyond serving as an efficiency heuristic; (2) tree-based rollout outperforms parallel sampling in discovering correct answers; and (3) sentence-entropy-guided forking overcomes the localization phenomenon of token-level branching to maximize semantic diversity. Building on these insights, we propose DATPO (Difficulty-Adaptive Sentence-entropy-guided Tree-structured Policy Optimization). DATPO integrates difficulty-adaptive tree search with a sibling-diversity advantage term, explicitly promoting semantic diversity to expand reasoning coverage during training. Experiments on mathematical reasoning benchmarks demonstrate that DATPO outperforms baselines especially in pass@k, which directly translates to superior test-time scaling performance.

[296] Entropy-Regularized Rank-Masked Policy Optimization for Test-Time Reinforcement Learning in Code Generation cs.LG | cs.CLPDF

Jiacheng Xu, Feng Chen, Xiuneng Xu, Bo An

TL;DR: 本文提出了一种适用于代码生成的测试时强化学习方法，通过构建探针输入并基于程序行为一致性定义探针共识奖励，以解决代码无法通过表面形式比较而缺乏训练信号的问题。同时，引入了熵正则化秩掩码策略优化来防止奖励欺骗并控制策略漂移，在代码生成基准上显著提升了性能。

Details

Motivation: 现有测试时强化学习方法依赖于答案级别的自投票奖励，但代码生成中程序无法通过表面形式直接比较，导致缺乏可用的训练信号。

Result: 在代码生成基准测试中，该方法在领域内适应和零样本迁移任务上均显著提高了pass@1和pass@k指标。

Insight: 创新点在于提出探针驱动的测试时强化学习框架，利用程序行为一致性而非表面形式来构建奖励信号，并通过熵正则化和秩掩码机制增强训练稳定性，为开放词汇程序优化提供了新思路。

Abstract: Existing methods for test-time reinforcement learning (TTRL) derive rewards from answer-level self-voting on unlabeled test-time tasks with canonical answers, but this breaks down for code generation because programs cannot be compared by surface form and therefore do not directly provide a usable training signal. To make TTRL applicable to code generation, we propose probe-driven TTRL, which constructs output-free probe inputs from the problem statement, executes candidate programs on these probes, and defines a Probe Consensus Reward (PCR) from the resulting behavioral agreement. PCR provides a behavioral training signal for open-vocabulary programs, but it is not a fully reliable verifier and remains susceptible to reward hacking through spurious consensus. We therefore introduce Entropy-Regularized Rank-Masked Policy Optimization (ERPO), which converts low PCR into conservative negative updates through rank masking and controls policy drift with an entropy ceiling. On coding benchmarks, ERPO substantially improves pass@1 and pass@k in both in-domain adaptation and zero-shot transfer.

[297] Capsule Lens: Locating and Tracking Concept Geometry in Model Representations cs.LG | cs.CVPDF

Yiming Tang, Harshvardhan Saini, Samyak Jha, Huaming Chen, Xufeng Duan

TL;DR: 本文提出了Capsule Lens框架，用于在机器学习模型的内部表示中定位和追踪概念几何。该框架将概念占据的表示空间区域匹配到一个由可解释参数定义的简单、可追踪的几何形式——胶囊，并在静态和动态表示两种主要设置下进行了应用验证。

Details

Motivation: 动机在于解决模型表示中概念编码的机制可解释性问题，现有方法主要将表示映射到更可解释的空间，而非直接刻画概念如何占据表示空间，且缺乏严格验证并多聚焦于静态表示。

Result: 在静态表示中，展示了如何跨模型定位概念几何，以及跨度和范数曲线如何揭示重要的几何特征。在动态表示中，通过三个案例研究追踪了不同训练设置（如CLIP预训练、视觉问答和数学推理的RL后训练）诱导的表征漂移，揭示了从CLIP预训练中广泛的网络范围重组到RL后训练中局部化、概念特异性变化等性质不同的几何动态。

Insight: 创新点在于提出了一个直接表征概念几何形状（胶囊）并进行严格验证的框架，能够系统地分析和追踪概念在模型表示空间中的静态位置和动态演变，为机制可解释性提供了新的量化工具。

Abstract: Understanding how concepts are encoded in the internal representations of machine learning models is a central problem in mechanistic interpretability, essential both for the science of deep learning and for the trustworthy deployment of increasingly capable models. Existing approaches to interpret model representations mainly map representations onto more interpretable spaces and do not directly characterize how concepts occupy representation space; various hypotheses have been proposed, but often lack of rigorous validation and largely focus on static representations. In this work, we introduce Capsule Lens, a framework that matches the region a concept occupies with a simple, trackable geometric form, a capsule, defined by several interpretable parameters, fitted in closed form to each concept’s geometry and validated on held-out samples. We apply Capsule Lens in two major settings: static and dynamic representations. On static representations, we demonstrate how to locate concept geometry across various models, and how the span and norm curves uncover important geometric characteristics. On dynamic representations, we present three case studies tracking representation drifts induced by distinct training settings, CLIP pretraining, RL post-training on visual question answering, and RL post-training on mathematical reasoning. These analyses reveal qualitatively different geometric dynamics, ranging from broad network-wide restructuring in CLIP pretraining to localized and concept-specific changes in RL post-training. Our results include findings aligned with existing literature as well as novel observations. We believe Capsule Lens stands as a promising tool for locating, analyzing, and tracking concept geometry in both static and dynamic representations.

[298] Layer-Wise Gate-Controlled Prompt Truncation in a Multimodal Chest X-Ray Classifier cs.LG | cs.AI | cs.CVPDF

Jingtao Lei, Hongji Li, Dexiang Shu

TL;DR: 本研究在胸部X光二分类任务中，对混合提示专家（MoPE）模型进行了层门控扩展，通过控制器预测每个样本的保留比例，并据此截断静态和混合视觉提示。在单次运行中，门控模型取得了0.8996的最佳验证准确率，略高于固定长度基线的0.8969，但门控统计显示所有训练点均仅保留一个提示长度，导致视觉序列从210个令牌减少至200个。

Details

Motivation: 旨在探索在MoPE模型中引入层门控机制，以实现输入依赖的提示长度动态调整，从而可能提升模型效率与性能。

Result: 在单次运行配置下，门控模型在验证集上达到0.8996的准确率，略优于固定长度基线的0.8969；最终准确率分别为0.8963和0.8802，但未进行重复实验，且门控导致提示长度始终为1（最大配置为6）。

Insight: 创新点在于将层门控机制与提示截断结合，实现动态提示长度调整；但客观分析表明，该方法在实验中未展现出显著的样本特异性长度分配优势，且缺乏运行时加速验证，实际效益有限。

Abstract: Mixture of Prompt Experts (MoPE) adapts multimodal transformers through input-dependent prompt composition, while retaining a fixed prompt length. We investigate a layer-wise gating extension in a binary chest X-ray classification pilot study. The controller predicts a retention ratio for each sample, averages these ratios within a mini-batch, and uses the resulting integer length to truncate the static and mixed visual prompts. Retained mixed prompts are also scaled by the individual ratios. In one recorded run per configuration, the gated model reached a best validation accuracy of 0.8996, compared with 0.8969 for the fixed-length baseline; the corresponding final values were 0.8963 and 0.8802. The exported gate statistics imply a retained length of one at all recorded training points, relative to a configured maximum of six. This reduces the complete visual sequence from 210 to 200 tokens, but no direct runtime measurements establish an acceleration benefit. Report-derived labels, report text as input, sequential data partitioning, and the absence of repeated controlled experiments limit interpretation. The findings document prompt shortening under the configured gate penalty; they do not establish sample-specific length allocation, superiority over fixed short prompts, or clinical utility. Code is available at: https://github.com/jingtaolei/mope-dynamic-prompt-truncation.

[299] NeuCME: Toward Dynamic Multimodal Continual Learning via Neural Combinatorics of Multiple Experts cs.LG | cs.CVPDF

Kai Guo, Chuanbin Liu, Peng Hu, Hao Wang, Xi Peng

TL;DR: 本文提出了一种名为NeuCME的新框架，用于解决动态多模态持续学习问题，其中每个任务的多模态集合可能变化。该框架通过模态组合回放、多门控专家混合和任务相关性引导蒸馏三个关键组件，有效应对时空灾难性遗忘和自适应多模态融合的挑战。

Details

Motivation: 现有多模态持续学习方法通常假设每个任务的模态集合是预定义且固定的，而本文研究更现实的动态多模态持续学习设置，其中模态集合在不同任务间可能变化，旨在开发更接近人类智能的智能体。

Result: 在四个真实世界数据集上的广泛实验表明，NeuCME显著优于现有最先进方法，并建立了一个包含不同动态程度的综合基准来评估任务序列的动态性。

Insight: 创新点包括提出动态多模态持续学习的新学习设置、NeuCME框架中的模态组合回放和多门控专家混合机制，以及量化任务序列动态性的评估指标，为处理模态变化的持续学习提供了系统解决方案。

Abstract: Multimodal continual learning has recently shown great potential for developing agents with human-like intelligence by continuously learning new tasks across multiple modalities. However, existing methods typically assume that the set of modalities per task is predefined and fixed. In this paper, we investigate a more realistic learning setting, referred to as dynamic multimodal continual learning, in which the set of modalities may vary across tasks rather than remaining fixed. This setting involves two primary challenges: (i) spatio-temporal catastrophic forgetting and (ii) adaptive multimodal fusion. To address these challenges, we propose NeuCME (as shorthand for \textbf{Neu}ral \textbf{C}ombinatorics of \textbf{M}ultiple \textbf{E}xperts), a novel framework designed to effectively learn and integrate knowledge across tasks with varying modalities. The proposed NeuCME model comprises three key components, namely modality-combinational rehearsal, multi-gated mixture-of-experts, and task relevance-guided distillation. Furthermore, we formulate an evaluation metric to quantify the dynamism of task sequences and then set up a comprehensive benchmark with different degrees of dynamism. Extensive experiments using four real-world datasets demonstrate that the proposed NeuCME outperforms state-of-the-art methods markedly.

[300] Conditioned Initialization for Attention cs.LG | cs.CVPDF

Hemanth Saratchandran, Simon Lucey

TL;DR: 本文提出了一种名为‘条件初始化’的新方法，用于改进Transformer中注意力层的权重初始化。该方法旨在通过优化注意力层的谱特性来改善训练动态，理论上可以降低注意力雅可比矩阵的条件数，从而带来更稳定的优化过程。

Details

Motivation: 当前Transformer的注意力层权重初始化（如随机初始化、模仿初始化或权重选择）研究不足，这些初始化方法可能引入优化偏差，影响训练动态和最终性能。

Result: 经验结果表明，条件初始化方法在多种应用中加速了收敛并提高了泛化能力，突显了条件化作为提升Transformer性能的一个关键但未被充分探索的领域。

Insight: 论文的创新点在于将初始化视为一个可以系统性优化以改善训练稳定性和效率的问题，提出了一种基于谱理论的原则性初始化方案，该方法简单易用，可无缝集成到广泛的Transformer架构中。

Abstract: Transformers are a dominant architecture in modern machine learning, powering applications across vision, language, and beyond. At the core of their success lies the attention layer, where the query, key, and value matrices determine how token dependencies are captured. While considerable work has focused on scaling and optimizing Transformers, comparatively little attention has been paid to how the weights of the queries, keys and values are initialized. Common practice relies on random initialization or alternatives such as mimetic initialization, which imitates weight patterns from converged models, and weight selection, which transfers weights from a teacher model. In this paper, we argue that initialization can introduce an optimization bias that fundamentally shapes training dynamics. We propose conditioned initialization, a principled scheme that initializes attention weights to improve the spectral properties of the attention layer. Theoretically, we show that conditioned initialization can potentially reduce the condition number of the attention Jacobian, leading to more stable optimization. Empirically, it accelerates convergence and improves generalization across diverse applications, highlighting conditioning as a critical yet underexplored area for advancing Transformer performance. Importantly, conditioned initialization is simple to apply and integrates seamlessly into a wide range of Transformer architectures.

[301] Stable-MM-R1: Anchoring Multimodal Reasoning Dynamics via Entropy-Guided Stratification cs.LG | cs.CVPDF

Yimeng Ye, Shuang Chen, Wenxuan Huang, Manyuan Zhang, Kaituo Feng

TL;DR: 本文提出了一种名为Stable-MM-R1的稳健数据驱动框架，旨在解决强化学习（RL）微调大型语言模型时存在的训练不稳定性和熵快速崩溃问题。该框架通过潜在感知查询挖掘（PAQM）动态筛选数据，聚焦于具有高能力激发潜力的样本，并引入混合分层重放（HSR）机制，基于路径熵和结果奖励对rollout进行分层，以构建高对比度的优化组，从而稳定训练并提高学习信号利用率。

Details

Motivation: 当前使用强化学习激励大型语言模型进行推理的流程存在训练不稳定和熵快速崩溃的局限性，这些问题主要源于标准采样过程中的’Rollout Silencing’和低质量梯度信号。

Result: 该方法在复杂的推理任务上超越了强大的基线模型，为稳定高效的RL微调提供了一个有原则的解决方案。

Insight: 创新点在于提出了一个以数据为中心的稳定化框架，其核心是PAQM数据筛选机制和HSR批重组机制。HSR通过基于路径熵（一种rollout级别的置信度代理）和结果奖励的分层，重用当前策略的’稳定性锚点’和’困难负样本’，有效缓解了熵崩溃，并在有限计算下提升了学习信号的利用效率。

Abstract: While Reinforcement Learning (RL) effectively incentivizes reasoning in Large Language Models, current pipelines are hindered by training instability and rapid entropy collapse. These limitations often stem from “Rollout Silencing” and low-quality gradient signals in standard sampling procedures. In this work, we propose a robust, data-centric framework to stabilize RL training. We first introduce Potential-Aware Query Mining (PAQM), which filters data dynamically to focus on the “Distillation Zone”—samples with high potential for capability elicitation. Furthermore, we present Hybrid Stratified Replay (HSR), a novel mechanism that restructures batches by stratifying rollouts based on Path Entropy, a rollout-level confidence proxy, and outcome reward. Within each optimization step, HSR reuses current-policy “Stability Anchors” and “Hard Negatives” to construct high-contrast optimization groups, then clears its buffers before the next step. This approach mitigates entropy collapse while improving the utilization of learning signals under limited compute. Our method outperforms strong baselines on complex reasoning tasks, offering a principled solution for stable and efficient RL fine-tuning.

[302] Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation cs.LG | cs.CV | cs.GRPDF

Nian Wu, Nivetha Jayakumar, Jiarui Xing, Miaomiao Zhang

TL;DR: 本文提出了一种名为IGG（基于测地动态的图像生成）的新型生成扩散模型框架，旨在解决现有生成模型在图像生成过程中忽视几何与拓扑一致性的问题。该框架将保持拓扑的测地原理整合到扩散生成过程中，在测地变形空间而非传统图像强度空间中进行学习和合成，从而确保生成对象的结构得以保留。

Details

Motivation: 现有生成扩散模型主要依赖图像强度和纹理信息，对底层对象几何关注有限，无法保证生成过程中的几何或拓扑一致性，这在计算解剖学、生物学和机器人学等对结构保持至关重要的高风险领域是一个关键缺陷。同时，现有模型未能显式学习或表示生成过程中的形状变化，导致变形动态隐藏在网络参数中，过程缺乏可解释性和物理依据。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较。

Insight: 主要创新点在于将拓扑保持的测地原理引入扩散生成过程，在测地变形空间中学习平滑可逆的映射来表征几何对象变化，从而显式地建模形状变形动态，提高了生成过程的几何一致性、可解释性和物理合理性。

Abstract: Generative diffusion models have emerged as a class of powerful techniques for various imaging applications, including but not limited to synthesis, reconstruction, and segmentation. Despite their success, current generative models pose two key limitations. First, they primarily rely on image intensity and texture information, with limited attention to underlying object geometry. As a result, they do not guarantee geometric or topological consistency during the generation process, which is a crucial requirement for high-stakes domains such as computational anatomy, biology, and robotics, where preserving object structure is critical. Second, existing models fail to explicitly learn or represent shape changes in the generative process. Such deformation dynamics remain occluded within network parameters; hence leaving the transformation process uninterpretable and physically uninformed. To address these challenges, we introduce IGG (Image Generation informed by Geodesic dynamics), a novel framework that integrates topology-preserving geodesic principles into the diffusion-based generative process. In contrast to conventional methods that operate in image intensity space, IGG learns and synthesizes diverse samples within geodesic deformation spaces, where geometric object changes are learned as smooth and invertible smooth mappings from a given template/source image. Our code is publicly available at https://github.com/nellie689/IGG.

cs.CE [Back]

[303] LLM-Aided Design for Manufacturing: A Multi-Agent System for Intent-Preserving Redesign of CAD for Improved Manufacturability cs.CE | cs.CV | cs.MAPDF

Kojo Welbeck, Xiangyu Shi, Zahra Sadeghi, Qi Zhu, Ping Guo

TL;DR: 本文提出了一种基于多智能体系统的自主化、意图保持的面向制造设计（DFM）CAD模型重设计方法。该方法通过一个由预训练多模态大语言模型驱动的双智能体子系统（DFM审查器和CAD修改器），将复杂零件的重设计分解为一系列经过独立验证的设计转换步骤，从而在提升可制造性的同时保持原始设计意图。

Details

Motivation: 解决在单一操作中直接生成易于制造的CAD模型变体不可靠的问题，特别是当零件复杂度增加时，CAD模型的保真度会下降。目标是实现一种能够逐步、可靠地改进零件可制造性，且不丢失设计意图的自动化流程。

Result: 在一个包含46个零件的基准测试中（以到参考几何的倒角距离评分），CAD修改器在给定相同工具的情况下，平均比思维链单智能体更准确地复现了目标零件。消融实验验证了视觉审查循环和在每次编辑前对设计状态进行描述的重要性。一个由32个链式转换构建的离心泵壳体案例展示了该方法可达到的复杂度。

Insight: 核心创新在于将复杂的DFM重设计任务分解为一系列经过独立验证的、意图保持的微编辑步骤，并通过一个由LLM驱动的、包含视觉反馈和程序化验证的闭环多智能体系统来执行。该方法无需微调，通过迭代和验证的累积效应，能够处理比单次生成器更复杂的零件设计。视觉审查循环和设计状态描述是提升编辑准确性的关键因素。

Abstract: We introduce autonomous, intent-preserving Design for Manufacturing (DFM) redesign of CAD parts: given an engineer’s CAD model, the method returns a variant that is easier to manufacture without losing its design intent. Generating such a redesign in a single shot is unreliable, since CAD fidelity degrades as parts grow complex; we instead produce it as a sequence of individually verified design transitions. Our DFM-Redesign pipeline realizes this with two coupled agent subsystems driven by a pretrained multimodal LLM: a DFM Reviewer that inspects the current design and proposes one intent-preserving manufacturability improvement at a time, and a CAD Modifier that executes each proposal as an edit to the part’s CadQuery program. The CAD Modifier closes a verification loop, compiling every candidate edit and visually checking it against the intended change from multi-view renderings, then re-generating or re-instructing until the edit is accepted or abandoned. Iterating review and verified modification compounds edits into parts more complex than one-shot generators reliably produce, preserves the original intent at each step, and requires no fine-tuning. On a 46-part benchmark scored by chamfer distance to reference geometries, the CAD Modifier reproduces target parts more accurately on average than chain-of-thought single agents given the same tools, and ablations isolate the contributions of the visual review loop and of captioning the design state before each edit. A centrifugal pump casing built from 32 chained transitions illustrates the complexity reachable by compounding verified edits. This is a preliminary report: evaluation of the full review-and-redesign loop, including manufacturability gain and an operational measure of intent preservation, is ongoing.

Table of Contents

cs.CL [Back]

[1] CrisisKD: Five-Stage Knowledge Distillation for Aspect-Level Sentiment and Emotion Analysis in Crisis Discourse cs.CLPDF

[2] Recall Is Not Protection: Evaluating Safety Monitors Against Model Compliance cs.CLPDF

[3] CONDUIT: A Unified Residual-Stream Restoration Framework for KV Cache Reuse in Vision-Language Models cs.CL | cs.CVPDF

[4] SinoGlyphBench: A Diagnostic Benchmark for Chinese Glyph-Level Obfuscation in Language-Model Moderation cs.CLPDF

[5] UniRRM: Unified Reasoning Reward Models Across Languages and Evaluation Paradigms cs.CL | cs.AIPDF

[6] SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation cs.CL | cs.DL | cs.IRPDF

[7] Solving versus Verifying: Catching Contradictions in Tax Reasoning Systems cs.CL | cs.AIPDF

[8] ModularPhaseNet: Finite-Cyclic Phase Geometry for Computable Semantic Hierarchy, Direction, and Context Consistency in Standard Transformers cs.CL | cs.LGPDF

[9] Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts cs.CL | cs.AI | cs.CV | cs.SDPDF

[10] Generating Adversarial Texts for Machine Translation via GRPO cs.CLPDF

[11] STQA: A Benchmark for Stock-Focused Tabular Question Answering over Historical and Forecasted Data cs.CLPDF

[12] SLATE: Are AI-Generated Slides Educationally Effective? A Benchmark for Language Teaching Quality and Learner Knowledge Acquisition cs.CLPDF

[13] Beyond the Flag: Clinical Framing Closes the Moderation Gap in Suicide Risk Measurement cs.CLPDF

[14] Reliability, validity, and diagnostic evidence for multi-model LLM short-answer scoring cs.CL | cs.CYPDF

[15] Visual Search Augmented Chain-of-Thought Reasoning for Attribute Value Extraction from Product Videos cs.CL | cs.CVPDF

[16] InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization cs.CL | cs.HCPDF

[17] ECOKV: Geometry-Aware KV Cache Eviction via Complementary Diversity Metrics cs.CL | cs.AI | cs.CVPDF

[18] PARSER: Read in Parallel, Reason in Depth for Long-Context LLM Agents cs.CLPDF

[19] CantoneseLLM v2: Reasoning in a Low-Resource Language cs.CLPDF

[20] Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning cs.CL | cs.AIPDF

[21] Aha-Flow Distillation: Flow Markers Matter in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

[22] Where to Look and What to Use: Retrieve-Localize-Generate for Long-Term Conversational Memory Question Answering cs.CL | cs.IRPDF

[23] Revisiting Complete Reasoning Traces for Post-Training cs.CLPDF

[24] CircuitLens: Reasoning Circuits as Data Selection Signals for Reinforcement Learning with Verifiable Rewards cs.CL | cs.LGPDF

[25] SIFTING: A Novel LLM-Based Framework for Structured and Transparent Information Extraction from Clinical Free-Text Reports, with Application to Tumor Staging in Lung Cancer cs.CLPDF

[26] SPARROW: Scalable Taxonomy Induction via Structure-Preserving Partitioning and Constraint-Guided Merging cs.CLPDF

[27] BlueprintAgent: Constraint-Triggered Targeted Revisits for Simulation-Ready Generation from Scanned Structural Blueprints cs.CL | cs.AI | cs.CVPDF

[28] MEMO: Multimodal Evidence Memory Organization for Long-Horizon LLM Agents cs.CLPDF

[29] Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition cs.CLPDF

[30] We’re Cooked! - Probing LLM Political Alignment Via Conflict-Framed Recipe Translation cs.CL | cs.AIPDF

[31] LLM Agents as Computational Typologists cs.CLPDF

[32] A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM cs.CL | cs.AI | cs.LGPDF

[33] Reasoning Beyond Transcription: Audio Language Models on Child Stuttering Speech cs.CLPDF

[34] BanglaMemeX: Advancing Cultural Metaphoric Image Interpretation in Bangla with a Multimodal Explainable Dataset cs.CL | cs.CVPDF

[35] Vectorizer: Vectorizing NumPy Programs with Shape-Guided Rewrite cs.CL | cs.SEPDF

[36] When Metrics Reward the Worst Translations: Internalizing Cultural Reasoning for Social Media Translation Evaluation cs.CLPDF

[37] NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness cs.CLPDF

[38] SentryLine: Evidence-Grounded Question Answering over Evolving Documents in Oncology Care cs.CLPDF

[39] CreaMem: A Scene-Aware Memory Architecture for Personalized Agents cs.CLPDF

[40] Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models cs.CLPDF

[41] Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models cs.CL | cs.CYPDF

[42] Evolution of Multimodal Question Answering: From Modality-Adaptive Extraction to Unified Language Representation cs.CL | cs.CVPDF

[43] Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents cs.CLPDF

[44] Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation cs.CL | cs.AI | cs.IRPDF

[45] Evaluation of Contextual Understanding in Large Language Models cs.CL | cs.LGPDF

[46] ToolLoop: Closed-Loop Tool-Use Data Synthesis via Decomposed Generation and Dynamic Self-Feedback cs.CLPDF

[47] ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation cs.CLPDF

[48] Measuring LLM Sycophancy under Sustained Multi-Turn Pressure cs.CL | cs.AIPDF

[49] ReCite: Agentic Reasoning for Faithful Citation cs.CLPDF

cs.CV [Back]

[50] A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities cs.CV | cs.CRPDF

[51] Emergent Goal-Directed Attention in Large Vision-Language Models cs.CV | cs.AI | cs.CLPDF

[52] CrossModalQA: A Cross-modal and Multi-hop Benchmark for Multimodal Retrieval-augmented Generation cs.CV | cs.AIPDF

[53] Infrastructure-based Monocular 3D Vehicle Localization Framework with Experimental Validation cs.CV | cs.LG | eess.IVPDF

[54] DIVA: Exploiting Cross-Step Conditional Propagation for Visual Jailbreaks in Discrete Diffusion Vision-Language Models cs.CVPDF

[55] A Specialized Large Multimodal Model for Interpreting PET/CT in Head and Neck Cancer cs.CV | cs.LGPDF

[56] SimpleMemVLA: A Simple but Effective Native-Video Memory for Vision-Language-Action Models cs.CV | cs.LG | cs.ROPDF

[57] Beyond the Verdict: Evidence-Aligned Evaluation of Visual Prompt-Injection Guardrails cs.CV | cs.AIPDF

[58] VIS-DICT: A Visual Dictionary for Missing Modality Imputation in Social Network Depression Detection cs.CVPDF

[59] Dual-Latent Memory Routing for Vision-Language Reasoning cs.CV | cs.AIPDF

[60] Knowing When Not to Answer: Abstention and Refusal Reasoning in Vision–Language Models cs.CV | cs.AIPDF

[61] Video Compression with Graph-inspired Neural Representation cs.CVPDF

[62] An overview of 3D Vision-Language Models cs.CVPDF

[63] Subject-Relative Micro-Motion and Sleep Dynamics for Near-Infrared Video Sleep Staging cs.CV | cs.AIPDF

[64] SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution cs.CVPDF

[65] Time-Aware Assistive Navigation cs.CV | cs.ROPDF

[66] Unsupervised Transfer Clustering for Mitigating Cold Start in Active Prompt Learning cs.CVPDF

[67] Facial Age Estimation for Age Fraud Detection in National ID Systems cs.CVPDF

[68] Bigger Text Encoders Can Hurt CLIP Zero-Shot Performance cs.CV | cs.AIPDF

[69] SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation cs.CV | cs.AIPDF

[70] GeoContext: One Context Ladder, Two Failure Modes in Vision-Language Geolocation: Flat Reliance on User-Provided Location Context and False Confirmation of Location Claims cs.CV | cs.AIPDF

[71] AAMBERS-UAV: Acquisition-Aware Multimodal Backbone Evaluation and Ranking for UAV Weedy Rice Segmentation cs.CV | cs.LGPDF

[72] CoRe-SAM3: Conditional Semantic–Visual Reconciliation for SAM3 Crack Segmentation cs.CVPDF

[73] UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment cs.CVPDF

[74] Hierarchical Prompt Injector for Domain Generalization Segmentation cs.CVPDF

[75] GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models cs.CVPDF

[76] STAR-Pro: Stage-Wise Token Adaptive Reduction with Progressive Refinement for Efficient Large Vision-Language Models cs.CV | cs.AIPDF

[77] PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes cs.CVPDF