cs.CL [Total: 14]
cs.CV [Total: 45]
cs.RO [Total: 4]
cs.LG [Total: 1]
cs.MA [Total: 2]
cs.HC [Total: 1]
eess.IV [Total: 1]
cs.AI [Total: 8]
cs.MM [Total: 1]

cs.CL [Back]

[1] When Irrelevant Text Matters: Affine Margin Shifts in Multimodal Large Language Models cs.CL | cs.CVPDF

Yinfeng Wang, Zhiyuan Yao, Zheren Fu, Lei Zhang, Zhendong Mao

TL;DR: 本文研究了多模态大语言模型（MLLMs）在处理视觉任务时，无关文本上下文对模型预测的影响。通过构建二元视觉判断框架，发现无关文本会系统性地偏置模型决策，且这种偏置表现为决策边界的仿射变换，而非随机噪声。研究进一步将仿射参数解释为视觉承诺保持和答案方向偏置的度量。

Details

Motivation: 多模态大语言模型常暴露于辅助文本上下文中，但这些无关文本对视觉接地任务的影响尚未被充分探索。本文旨在通过受控干预，量化分析无关文本如何影响模型的视觉判断能力。

Result: 在多个基准测试中，无关文本均导致模型预测产生一致偏置。通过定义基于对数概率差的决策边界，研究发现上下文条件下的边界是上下文无关边界的仿射变换，揭示了可估计的模型偏好扭曲。

Insight: 创新点在于将无关文本影响形式化为决策边界的仿射变换，提供了边际层面的诊断视角；客观来看，该方法为理解MLLMs在噪声上下文下的鲁棒性提供了可量化的几何规律，有助于未来针对上下文干扰的模型改进研究。

Abstract: Multimodal large language models (MLLMs) are frequently exposed to auxiliary textual context, the impact of which on visually grounded tasks remains underexplored. In this paper, we investigate the influence of task-irrelevant context by formulating it as a controlled intervention within a binary visual judgment framework. By maintaining an invariant prompt structure while varying auxiliary inputs, we observe that irrelevant text consistently biases model predictions across diverse benchmarks. To move beyond performance metrics, we characterize this sensitivity through a decision margin defined by the log-probability difference between binary candidates. Our analysis reveals a robust geometric regularity: contextconditioned margins follow a consistent affine transformation of their context-free counterparts. This finding demonstrates that irrelevant context does not manifest as unstructured stochastic noise but as a estimable distortion of model preference. We further interpret the fitted affine parameters as metrics for visual commitment preservation and directional answer bias. These findings provide a margin-level diagnostic view of irrelevant-context effects in MLLMs and offer a basis for future studies on noisy-context robustness

[2] Compliance, Capability, and Conflict: Benchmarking Multimodal LLMs under System Messages cs.CLPDF

Juan Yeo, Geewook Kim

TL;DR: 本文介绍了VSysBench，一个用于评估多模态大语言模型在系统消息约束下行为遵从性的新基准。该基准基于MMVet-v2构建，将约束分为5个主要类别和22个子类别，涵盖从文本指令到完全视觉基础的约束，并引入错位对应项以测试指令层次结构。研究发现，施加系统消息会显著降低模型的基础任务准确性，开源模型在用户冲突下遵从性崩溃，而顶级专有模型保持稳定，且视觉基础约束对所有模型都是最难的类别。

Details

Motivation: 当前多模态大语言模型在生产部署中日益依赖系统消息来管理模型行为，但现有基准要么仅评估文本约束，要么将约束嵌入用户轮次，导致多模态上下文中的系统消息遵从性未被充分衡量，且未探究遵从性是否以牺牲基础视觉语言能力为代价。

Result: 在16个多模态大语言模型上的评估显示，施加系统消息会显著侵蚀基础任务准确性；在用户冲突下，开源模型的遵从性崩溃，而顶级专有模型保持稳定；视觉基础约束是所有模型中最难的类别。评估通过联合满意度率和跨约束敏感性两个指标进行。

Insight: 论文的创新点在于构建了首个专门评估多模态上下文中系统消息遵从性的基准VSysBench，并系统性地将约束分类，同时引入错位对应项进行压力测试。客观来看，该研究揭示了系统消息遵从性与模型基础能力之间的权衡关系，以及不同模型架构在冲突处理上的差异，为实际部署提供了重要参考。

Abstract: Production deployments of Multimodal Large Language Models (MLLMs) increasingly rely on system messages to govern model behavior. Yet existing benchmarks either evaluate constraints in text only or embed them into the user turn, leaving system-message adherence in multimodal contexts largely unmeasured; they also leave open whether compliance comes at the cost of foundational vision-language capabilities. We introduce VSysBench, a benchmark built on MMVet-v2 that organizes constraints into 5 main categories and 22 sub-categories, ranging from textual directives in visual contexts to fully vision-grounded ones, each paired with a misaligned counterpart that stress-tests the instructional hierarchy. VSysBench scores each response jointly along two axes, constraint compliance and answer correctness, via the Joint Satisfaction Rate (JSR) and Cross-Constraint Sensitivity (CCS). Across 16 MLLMs, we find that imposing system messages substantially erodes base task accuracy, that compliance collapses under user conflict for open-weight models while remaining stable for top proprietary ones, and that vision-grounded constraints are the hardest category for every model.

[3] NepOOC-M: Bilingual Nepali-English Benchmark and Comparative Analysis of Multimodal Architectures for OOC Detection cs.CL | cs.CVPDF

Sanjeev Khatiwada

TL;DR: 该论文提出了首个尼泊尔语主导的多语言OOC检测基准数据集NepOOC，包含1090个图像-标题对，并系统评估了五种多模态架构。研究发现，在当前数据集规模下，仅文本模型（mBERT）的表现与最佳多模态系统相当，而纯图像模型性能接近随机水平。

Details

Motivation: 针对尼泊尔语中缺乏公开的上下文外（OOC）虚假信息检测基准的问题，旨在通过构建双语数据集和比较分析多模态架构，推动该领域的进展。

Result: 在NepOOC基准上，仅文本的mBERT模型取得了94.65%的宏F1分数，与最佳多模态系统（ResNet-50+mBERT）统计上无显著差异；纯图像模型性能仅为33-50%。

Insight: 创新点在于构建了首个公开的尼泊尔语OOC检测基准，并揭示了在当前数据规模下，文本语义信息对检测任务已足够有效，数据集扩展比架构优化或区域专业化更能直接推动性能提升。

Abstract: Out-of-context (OOC) misinformation pairs authentic images with misleading captions to construct false narratives without image manipulation, making detection a problem of multimodal alignment rather than image forensics. Despite the prevalence and consequences of OOC misinformation in Nepal, no public benchmark exists for Nepali. We introduce NepOOC, the first publicly available Nepali-dominant multilingual OOC benchmark, comprising 1,090 image-caption pairs (545 pristine, 545 OOC) annotated across five typologies (fabricated, miscaptioned, temporal mismatch, geographic mismatch, identity mismatch) with inter-annotator agreement kappa = 0.84. Systematic evaluation of five multimodal architectures alongside text-only and image-only baselines reveals that caption semantics appear sufficient for strong performance at the current dataset scale. A text-only mBERT model achieves 94.65+/-0.20% Macro-F1, statistically equivalent to the best multimodal system (ResNet-50+mBERT, 94.65+/-0.20%; McNemar median p = 1.000, 0/5 seeds significant at alpha = 0.05). Image-only models perform near chance (33-50%), while training-size scaling suggests that dataset expansion is a more direct path to progress than architectural sophistication or regional specialisation.

[4] Time-Series Retrieval for Grounding Multimodal Language Models in Remaining Useful Life cs.CL | cs.AI | cs.LGPDF

Valeriu Dimidov, Raphaël Frank

TL;DR: 本文研究了基于时间序列检索的多模态大语言模型在剩余使用寿命估计中的应用，提出了一种通过检索历史相似退化片段并转化为视觉比较图，结合结构化多模态提示来提升预测性能的框架。

Details

Motivation: 探索大语言模型和智能体AI系统在特定领域维护和预测任务中的有效性，特别是针对预测与健康管理中的剩余使用寿命估计问题。

Result: 在C-MAPSS基准的FD001分区上，基于检索的推理相比随机参考选择的基线方法，显著降低了误差并提高了性能稳定性，表明时间序列检索能持续改进MLLM的RUL预测。

Insight: 创新点在于将时间序列检索增强生成技术应用于多模态预测推理，通过视觉化历史相似片段来提供上下文证据；客观分析认为，该方法有效结合了检索机制与MLLM的推理能力，但效果受模型容量限制，强调了在实际PHM设置中MLLM的当前局限性。

Abstract: Large language models (LLMs) and agentic AI systems are increasingly being explored for domain-specific maintenance and prognostics tasks, raising the question of whether they can effectively support prognostics and health management (PHM). In this paper, we investigate remaining useful life (RUL) estimation with multimodal large language models (MLLMs) grounded through time-series retrieval. We propose a framework in which historically similar degradation segments are retrieved from the training set and, together with the test trajectory, transformed into a visual comparison artifact that is processed by the MLLM through a structured multimodal prompt. The approach is evaluated on the FD001 partition of the C-MAPSS benchmark under repeated experiments comparing retrieval-based inference against a non-retrieval baseline based on random reference selection. The results show that time-series retrieval consistently improves MLLM-based RUL prediction across the evaluated models, yielding lower error and more stable performance. At the same time, the magnitude of the benefit depends on model capacity, indicating that retrieval is most effective when the underlying MLLM is able to exploit the retrieved evidence. Overall, the study shows that time-series RAG is a promising mechanism for improving multimodal prognostic reasoning, while also highlighting the current limitations of MLLM-based RUL estimation in practical PHM settings.

[5] Forking Fast: Efficiently Estimating Uncertainty Dynamics in Text Generation cs.CL | cs.AI | cs.LGPDF

Eric Bigelow, Amir Zur, Satchel Grant, Tal Haklay, Can Rager

TL;DR: 该论文提出了一种高效估计文本生成中不确定性动态的方法，通过统计模型平滑低样本推理链的噪声数据，以近似高样本数据，从而显著降低采样成本。研究表明，不确定性动态在多次重采样后会收敛到稳定模式，噪声主要源于采样而非LLM对单个token或推理步骤的敏感性。

Details

Motivation: 解决基于重采样的不确定性分析中因在每个token或句子处重采样文本序列而导致的高计算成本问题，并探索解释文本生成中不确定性动态的合适统计模型。

Result: 通过开发的统计模型平滑噪声数据，能够显著减少采样开销，同时揭示不确定性动态在多次采样后趋于稳定，噪声主要来自采样过程。

Insight: 创新点在于提出了一种高效的统计模型来近似高样本不确定性数据，降低了计算成本，并提供了对LLM推理中噪声来源的新见解，即噪声更多是采样产物而非模型内在敏感性。

Abstract: LLM reasoning is stochastic, and so understanding a model requires grappling with the distribution of reasoning chains that it might produce for a given question, i.e., its uncertainty. Resampling-based analyses characterize this distribution, revealing which steps of a rollout determine how the model arrives at its answer. However, a major limitation of these approaches is that resampling text sequences at every token or sentence in a reasoning chain is very costly. Our work strives to make resampling analysis more computationally efficient, while also shedding light on an important scientific question: what is the right statistical model for explaining uncertainty dynamics in text generation? We show that when resampling many reasoning chains, uncertainty dynamics converge to stable patterns, and noise is largely an artifact of sampling rather than an LLM’s sensitivity to each individual token or reasoning step. We develop a statistical model for smoothing noisy low-sample rollout data to better approximate high-sample data, allowing us to significantly cut sampling costs.

[6] Projector Is All You Train cs.CL | cs.CV | cs.LGPDF

Nyx Iskandar, Saathvik Selvan, Slater Victoroff

TL;DR: 本文探讨了在多模态大语言模型（MLLM）训练中，是否必须微调语言模型主干来适应新模态。通过在3D MLLMs上的实验，研究发现仅训练连接主干和模态特定编码器的投影器（projector）就足以达到与联合训练基线相当的强大性能，同时避免了主干能力漂移并提升了训练吞吐量。

Details

Motivation: 动机是质疑MLLM适应新模态时微调语言模型主干的必要性，旨在探索更高效、能保持主干原有能力的训练范式。

Result: 在3D分类、描述任务以及语言、视觉和空间推理的标准基准测试中，仅训练投影器的方法在多个语言模型主干上均实现了与联合训练基线相当的性能，同时训练样本吞吐量约为后者的两倍。

Insight: 创新点在于提出了’仅训练投影器’的轻量化MLLM适配方法，其核心洞察是投影器足以桥接模态差异，而无需微调主干，这能有效防止主干能力退化并显著提升训练效率。

Abstract: The typical training process of a multimodal large language model (MLLM) involves adapting both the language model backbone and the projector between the backbone and a modality-specific encoder. We ask whether fine-tuning the backbone of an MLLM is necessary to adapt it to a new modality. Through experiments on 3D MLLMs, we find that training only the projector is sufficient to achieve strong multimodal performance relative to existing baseline models and our jointly trained MLLMs with the same encoder and backbone. We also show that joint training leads to undesirable drift in existing capabilities of the language model, which projector-only training avoids by definition. Furthermore, projector-only training has approximately twice the training sample throughput of joint training. We validate our findings across different language model backbones via 3D classification and captioning benchmarks as well as standard benchmarks evaluating language, vision, and spatial reasoning capabilities.

[7] Stopping and Routing LLM Judge Panels cs.CLPDF

Bin Zhu, Yi Xie, Yanghui Rao

TL;DR: 本文提出了一种用于优化LLM评估流程中评委面板设计的方法，将评委选择、调用和停止决策形式化为一个角色条件分配问题。该方法通过分析评委在目标数据集上的相对角色（如冗余副本、全局补充者和特定领域专家），制定策略：丢弃冗余评委、全局添加补充者、条件路由专家，并在验证增益低于阈值时停止。

Details

Motivation: LLM评估流程通常包含多种候选评委（如通用LLM评委提示、奖励模型、安全分类器、置信度变体和任务特定验证器），但如何高效部署这些评委（包括选择哪些评委、在哪些样本上调用、何时停止构建面板）是一个关键且未充分解决的问题。

Result: 在推理、代码、安全、偏好、奖励模型、摘要和数学等多个领域的审计任务上，该方法与单一评委、扁平面板、匹配多样性启发式方法、全调用堆叠、可靠性陪审团和节俭级联等方法进行了比较。结果表明，该方法能生成一个可重用的、可审计的调用计划，并绘制出评委调用的机制图：在可部署的切片上路由专家，在饱和的验证器机制中停止，当广泛集成的风险收益值得成本时保留它们，并忽略条件副本。

Insight: 核心创新点在于将评委面板设计形式化为角色条件分配问题，并基于评委在目标数据集上的信息贡献角色（副本、补充者、专家）来制定数据驱动的调用策略。这为构建高效、可解释且成本可控的LLM评估流程提供了系统化的方法论，超越了简单的集成或级联方法。

Abstract: LLM evaluation pipelines often have many candidate judges: general LLM-as-a-judge prompts, reward models, safety classifiers, confidence variants, and task-specific verifiers. The deployment question is not only which judge is best, but which judges should be called, on which examples, and when panel construction should stop. We formulate judge-panel design as a role-conditioned allocation problem. From a small labeled audit set, declared slices, and judge costs, the method estimates target-relative roles: copies add no conditional information, complements improve the global panel, and specialists help only on slices. These roles induce a policy: drop copies, add complements globally, route specialists conditionally, and stop when validation gain falls below a threshold. Across reasoning, code, safety, preference, reward-model, summarization, and math audits, the method is compared with single judges, flat panels, matched diversity heuristics, full-call stacking, reliability juries, and frugal cascades. The result is a regime map for judge calls: route specialists on deployable slices, stop in saturated verifier regimes, keep broad ensembles when their risk benefit is worth the cost, and ignore conditional copies. The output is a reusable, auditable call plan for the next evaluation batch.

Hao Guo, Subin Huang, Junjie Chen, Zhifa Geng, Sanmin Liu

TL;DR: 本文提出了一种用于多模态讽刺检测的新框架，该框架集成了动态门控跨模态融合和讽刺感知对比正则化。该方法通过双向门控交互模块自适应地校准实例级别的文本和视觉贡献，并利用动态融合门平衡模态重要性以生成更鲁棒的多模态表示。此外，引入的讽刺感知对比正则化目标鼓励非讽刺样本的语义一致性，同时抑制讽刺情况下的误导性一致性。

Details

Motivation: 解决多模态讽刺检测中由于实例依赖的模态贡献和误导性语义一致性带来的挑战，现有方法通常依赖固定融合策略并将讽刺视为通用的跨模态不匹配，限制了其捕捉微妙讽刺线索和实例特定模态交互的能力。

Result: 在MMSD和MMSD2.0基准上的大量实验表明，所提方法始终优于强基线模型，实现了SOTA性能。

Insight: 创新点包括动态门控跨模态融合机制，能自适应地过滤特征和平衡模态重要性，以及讽刺感知对比正则化，通过标签感知的对比学习区分讽刺与非讽刺样本的语义一致性模式。从客观角度看，该方法将实例级自适应融合与针对性正则化相结合，有效提升了模型对复杂讽刺线索的捕捉能力。

Abstract: Multimodal sarcasm detection aims to identify sarcastic intent from multimodal content, where inconsistencies between literal meaning and contextual cues often signal irony. This task has attracted increasing research attention. However, accurate detection remains challenging due to instance-dependent modality contributions and misleading semantic consistency, where surface-level alignment masks underlying contradictory intent. Existing methods often rely on fixed fusion strategies and treat sarcasm as generic cross-modal mismatch, limiting their ability to capture subtle sarcasm cues and instance-specific modality interactions. To address these challenges, we propose a novel MSD framework that integrates Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization (SaCR). Specifically, a bidirectional gated interaction module performs cross-modal feature filtering and adaptively calibrates textual and visual contributions at the instance level. A dynamic fusion gate further balances modality importance to generate more robust multimodal representations. Furthermore, SaCR is introduced as a label-aware contrastive regularization objective that encourages semantic consistency for non-sarcastic samples while suppressing misleading consistency in sarcastic cases. The proposed framework is trained end-to-end with a multi-objective learning strategy that jointly optimizes multimodal classification and auxiliary unimodal supervision. Extensive experiments on MMSD and MMSD2.0 demonstrate that the proposed method consistently outperforms strong baselines.

[9] Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction cs.CLPDF

Zhifa Geng, Subin Huang, Hao Guo, Junjie Chen, Sanmin Liu

TL;DR: 本文提出了一种用于鲁棒不完整多模态情感分析的迭代代理校正框架，旨在解决现实世界中多模态输入不完整或损坏的问题。该方法通过门控残差校正逐步优化面向语言的代理，并根据估计的语言可靠性分数自适应融合校正后的代理与观测到的语言表示，从而平衡代理补偿与可信语言证据。

Details

Motivation: 现有基于代理的不完整多模态情感分析方法通常依赖一次性代理构建来补偿退化的语言信息，但初始生成的代理可能粗糙或不可靠，过早将其注入多模态推理会传播初始错误并损害情感预测。

Result: 在MOSI、MOSEI和SIMS数据集上的多种缺失模态设置下进行的大量实验表明，所提出的框架始终优于竞争基线，并在不完整输入下实现了鲁棒的情感预测。

Insight: 创新点包括通过迭代门控残差校正逐步细化语言代理，引入基于估计语言可靠性的自适应融合机制，以及使用完整语言表示作为训练时语义锚点的阶段式潜在校正目标，以稳定代理优化轨迹。

Abstract: Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs are often incomplete or corrupted, which can weaken cross-modal complementarity and introduce misleading information into downstream fusion. Existing proxy-based methods for incomplete MSA commonly rely on one-shot proxy construction to compensate for degraded language information, but the generated proxy may be coarse or unreliable at initialization. Prematurely injecting such a proxy into multimodal reasoning can propagate initial errors and compromise sentiment prediction. To address this limitation, we propose an iterative proxy correction framework for robust incomplete MSA. Our method constructs a language-oriented proxy from non-language modalities and progressively refines it under multimodal context through gated residual correction. The corrected proxy is then adaptively fused with the observed language representation according to an estimated language reliability score, allowing the model to balance proxy-based compensation and trustworthy linguistic evidence. In addition, we introduce a stage-wise latent correction objective that uses the complete language representation as a training-time semantic anchor to stabilize the proxy refinement trajectory. Extensive experiments on MOSI, MOSEI, and SIMS under diverse missing-modality settings demonstrate that the proposed framework consistently outperforms competitive baselines and achieves robust sentiment prediction under incomplete inputs.

[10] HealMed: Multilingual Evaluation of Large Language Models in Medicine cs.CLPDF

Yingjian Chen, Fan Gao, Sherry T. Tong, Haoyu Zhang, Aosong Feng

TL;DR: HealMed是一个由医学专家评审的多语言医学大语言模型评估基准，包含9种语言各1000个示例，涵盖多项选择问答、自然语言推理和开放式问答三种任务格式。研究发现，模型在低资源语言上性能下降最明显，专有模型跨语言表现最稳定，而开源和医学专用模型存在较大且不一致的差距，且翻译质量显著影响跨语言评估结果。

Details

Motivation: 解决当前缺乏专家评审的多语言医学大语言模型评估基准的问题，以系统评估模型在不同语言，特别是低资源语言上的医学能力。

Result: 在HealMed基准上，专有模型（如GPT-4）跨语言表现最稳定；许多开源和医学专用模型在低资源语言上表现出较大且不一致的性能差距；专家修订翻译会改变测量性能，表明翻译质量对评估结果有实质性影响。

Insight: 创新点在于构建了一个由多国医学专家深度参与开发与翻译评审的高质量多语言医学评估基准；关键发现是医学专业化本身并不能保证多语言鲁棒性，且翻译质量是跨语言评估的关键变量，这为未来构建更公平的评估体系提供了重要洞见。

Abstract: We present HealMed, an expert-reviewed benchmark for multilingual evaluation of large language models in medicine. HealMed contains 1,000 examples in each of nine languages, drawn from nine datasets and covering three task formats: MCQA, NLI and open-ended QA. The benchmark was developed over two years by 23 physicians and medical experts based across nine countries and regions. Each translation was evaluated and revised by two experts fluent in English and the corresponding target language. On HealMed, performance declined most in low-resource languages, although the size of the gap varied markedly across languages and models. The strongest proprietary models were the most stable across languages, whereas many open-source and medically specialized models showed larger and less consistent gaps. Medical specialization alone did not ensure multilingual robustness. Furthermore, expert revision could either raise or lower measured performance, indicating that translation quality materially affects cross-language evaluation results.

[11] SABET-QA: Temporal Knowledge Graph Question Answering cs.CL | cs.AIPDF

Brahim Touayouch, Mirette Moawad, Dmitry Akulov

TL;DR: 本文提出SABET-QA框架，用于时序知识图谱问答（TKGQA），通过双向实体-时序评分机制和槽感知上下文模块，在多跳推理中迭代优化推理状态，并利用可微分工作记忆进行渐进式假设精炼，在多个基准数据集上实现了性能提升。

Details

Motivation: 现有基于嵌入的时序知识图谱问答方法在处理多步查询时，由于采用单次推理流程而存在困难，因此需要设计一种能够迭代推理的框架来更好地处理时间敏感事实。

Result: 在CronQuestions、Complex-CronQuestions、MultiTQ和TimeQuestions等基准数据集上的实验表明，SABET-QA相比强基线模型取得了持续改进，尤其在复杂多步时序查询上表现突出。

Insight: 创新点包括双向实体-时序评分机制和槽感知上下文模块，这些设计能够对齐问题语义与时序知识图谱嵌入，并通过可微分工作记忆实现渐进式推理；客观来看，该方法通过迭代精炼机制有效提升了多步时序推理的准确性。

Abstract: Question Answering over Temporal Knowledge Graphs (TKGQA) requires reasoning over time-sensitive facts, yet existing embedding-based methods struggle with multi-step queries due to single-pass reasoning pipelines. We propose SABET-QA, a framework that iteratively refines reasoning states across multiple hops via a bidirectional entity-temporal scoring mechanism and a slot-aware contextualization module that aligns question semantics with temporal KG embeddings. A differentiable working memory enables progressive hypothesis refinement, while auxiliary temporal boundaries serve as coarse supervision when available. Experiments on CronQuestions, Complex-CronQuestions, MultiTQ, and TimeQuestions demonstrate consistent improvements over strong baselines, particularly on complex multi-step temporal queries.

[12] Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization cs.CL | cs.AIPDF

Qian Kou, Xiaofeng Shi, Xiaosong Qiu, Hua Zhou

TL;DR: 本文提出了IAR（注入、对齐、恢复）三阶段后训练框架，旨在将固定文档集合的知识内化到大型语言模型的参数中，以实现无需检索的问答。该方法通过结构化知识注入、问答行为对齐和通用能力恢复三个阶段，提升了模型在特定领域问答上的准确性，同时保持了其通用能力。

Details

Motivation: 解决大型语言模型在推理时无法检索源文档的情况下，难以回答基于特定文档集合的问题，即文档知识内化问题。

Result: 在Common Corpus和CCI数据集上，以及Llama、Phi、Qwen和SmolLM等多个模型系列上，IAR在领域问答准确率上平均提升3.6个百分点，在IFEval、MMLU和MSBench等通用基准上的平均性能提升12.1个百分点，在8个数据集-模型设置中的7个上全面优于Vanilla SFT。

Insight: 创新性地将后训练过程分解为三个独立且目标明确的阶段，将知识注入与能力对齐/恢复解耦；通过合并领域适应模型与基础指令模型来恢复通用能力，在实现领先领域内化的同时保持了强大的通用性能轮廓。

Abstract: Large language models often fail to answer questions about a bounded document collection when the source documents are not retrieved at inference time. We study this setting as document knowledge internalization: converting a fixed corpus into usable parametric knowledge for retrieval-free question answering. We propose IAR (Inject, Align, and Recover), a three-stage post-training framework that separates structured document knowledge injection, QA behavior alignment, and general ability recovery. Unlike conventional continued pretraining, Inject converts source documents into continuation, rewrite, and instruction-conditioned reconstruction objectives. Align then adapts the injected model with answer-only QA supervision, while Recover merges the domain-adapted model with the base instruction model to recover general capabilities. Across Common Corpus (CC) and CCI, and across Llama, Phi, Qwen, and SmolLM model families, IAR improves the domain-primary domain-general frontier for retrieval-free document internalization. In the main comparison, IAR improves over Vanilla SFT on all four reported metrics in 7 of 8 dataset-model settings, with average gains of 3.6 percentage points in domain QA accuracy and 12.1 percentage points in mean general performance across IFEval, MMLU, and MSBench. Extended CC baselines show that LoRA and FAPM can win individual general metrics, but among methods that also reach leading or near-leading domain internalization, IAR retains one of the strongest general profiles.

[13] OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models cs.CLPDF

Nikita Khudov

TL;DR: 本文介绍了OenoBench，一个包含3,266个多项选择题的葡萄酒领域知识基准，涵盖六个支柱（产区、葡萄品种、葡萄栽培、酿酒、生产商、商业）和四个难度等级。该语料库基于38,104个原子化、来源可追溯的事实构建，这些事实由35个经过验证的爬虫从政府注册机构、同行评审期刊和维基百科/Wikidata中提取。方法论贡献是一个LLM驱动的流程，其中语言模型重新格式化已验证的事实并审核结果，但从不作为真相来源。评估了16种前沿配置，发现总体准确率在53%-84%之间，其中o3模型以83.6%领先；推理模式提升主要集中在DeepSeek R1（+6.8个百分点），而Claude Opus和Gemini Pro则没有；Anthropic在其自身问题上表现出+9个百分点的自我偏好，而Google则表现出-8个百分点的反向偏好；前沿开源模型与专有推理模型共享成本与准确率的帕累托前沿；所有配置在闭卷可解项目上均获得约33个百分点的提升，揭示了仅上下文切片可避免的参数化召回上限。

Details

Motivation: 为了解决在特定领域（葡萄酒）中评估大型语言模型知识基础能力的缺乏，作者构建了一个高质量、来源可追溯的基准，以系统评估模型在复杂、结构化知识上的表现。

Result: 在OenoBench基准上评估了16种前沿模型配置，总体准确率范围为53%-84%，其中o3模型达到83.6%的最高准确率；DeepSeek R1在推理模式下提升6.8个百分点，而Claude Opus和Gemini Pro无提升；Anthropic模型在其自身问题上表现出+9个百分点的自我偏好，Google模型则表现出-8个百分点的反向偏好；开源模型与专有推理模型在成本-准确率帕累托前沿上表现相当；所有模型在闭卷可解项目上均获得约33个百分点的提升。

Insight: 创新点在于构建了一个完全基于可追溯来源、LLM辅助但非真相来源的基准构建流程，确保了数据的可靠性和可审计性；同时，通过多策略问题生成和九智能体审核机制，提高了基准的多样性和质量；研究揭示了模型在特定领域的知识表现、自我偏好现象以及参数化召回上限，为领域知识评估提供了新视角。

Abstract: We introduce OenoBench, a wine-domain knowledge benchmark of 3,266 multiple-choice questions across six pillars (regions, grape varieties, viticulture, winemaking, producers, business) and four difficulty tiers. The corpus is built from 38,104 atomic, source-anchored facts extracted by 35 provenance-verified scrapers from government registries (INAO, TTB, OIV), peer-reviewed journals, and Wikipedia/Wikidata. Our methodological contribution is an LLM-driven pipeline in which language models reformat verified facts and audit the result, but never serve as the source of truth: every claim traces to a URL, every question is generated by one of five strategies across five generator families, and every question is scored by a nine-agent audit calibrated against a human gold sheet via Cohen’s $κ$. Evaluating sixteen frontier configurations, we find: (i) overall accuracy spans 53%-84%, led by o3 at 83.6%; (ii) reasoning-mode lift concentrates in DeepSeek R1 (+6.8pp) and is absent in Claude Opus and Gemini Pro; (iii) Anthropic shows +9pp self preference on its own questions while Google shows -8pp inverse preference; (iv) frontier open-weight models share the cost-vs-accuracy Pareto frontier with proprietary reasoning models; and (v) every config gains around 33pp on closed-book solvable items, revealing a parametric-recall ceiling that only the contextual slice avoids. We release corpus, audit findings, human-review app, and construction code under CC-BY-SA-4.0.

[14] G-CARL: Grounded Checklist-Aligned Reward Learning for Patient-Oriented Medical Report Interpretation cs.CL | cs.AI | cs.CVPDF

Shiao Xie, Siyu Chen, Jianwei Lv, Bo Yuan, Yujin Wang

TL;DR: 论文提出了面向患者的医疗报告解读（PMRI）任务，旨在根据患者查询和对话历史，以准确且易于理解的语言解释医疗报告。为应对该任务中事实准确性与患者沟通需求的双重挑战，作者提出了G-CARL框架，该框架结合了基于检索的原子声明验证和上下文感知的加权检查表，以结构化方式监督生成质量。

Details

Motivation: 现有医疗视觉-语言任务未能充分兼顾证据驱动的医学事实准确性和依赖上下文的患者沟通需求，因此需要设计新任务和方法来满足患者对个性化医疗报告解读的需求。

Result: 在构建的真实世界基准MMedReport上，G-CARL在整体质量、声明级精确度和检查表召回率上均优于现有后训练基线；临床医生的成对偏好评估进一步证实其生成结果更准确且更符合患者需求。

Insight: 创新点在于将多源检索用于原子声明验证，并结合实例特定的加权检查表来提供结构化监督，从而在保持响应多样性的同时，联合优化事实性、用户需求满足度和表达质量。

Abstract: Personalized interpretation of medical reports has emerged as an increasingly important need among patients. Addressing this need requires both evidence-grounded medical factuality and context-dependent patient communication, yet existing medical vision-language tasks do not adequately capture these dual requirements. To bridge this gap, we introduce Patient-oriented Medical Report Interpretation (PMRI), a novel open-ended multimodal generation task that requires models to explain medical reports in accurate and accessible language based on a user’s query and dialogue history. These two objectives differ fundamentally in their verifiability, yet remain tightly coupled, making them difficult to optimize jointly under conventional supervised fine-tuning and holistic reinforcement learning paradigms. To address this challenge, we propose G-CARL, a grounded, checklist-aligned reinforcement learning framework that combines multi-source retrieval for atomic claim verification with context-aware, instance-specific weighted checklists for response coverage, providing structured supervision for factuality, user-demand satisfaction, and expression quality without constraining response diversity. We further construct MMedReport, a real-world PMRI benchmark, along with a clinician-designed three-dimensional evaluation protocol. Extensive experiments demonstrate that G-CARL consistently outperforms existing post-training baselines in overall quality, claim-level precision, and checklist recall. Pairwise preference evaluation by clinicians further confirms that G-CARL produces interpretations that are more accurate and better aligned with patient needs.

cs.CV [Back]

[15] Does Marginal Coverage Guarantee Class-Conditional Safety for Zero-Shot VLMs Under Shift? cs.CV | cs.AIPDF

Jai Kumar Sharma, Amartya Dutta

TL;DR: 本文研究了在分布偏移下，分割保形预测为零样本视觉语言模型提供的边际覆盖率是否能保证类别条件安全性。通过对CLIP、OpenCLIP和SigLIP在ImageNet及非ImageNet设置下的审计发现，边际覆盖率可能保持较高，但最差类别覆盖率会崩溃至接近零，表明边际覆盖率不能作为类别尾部安全性的保证。

Details

Motivation: 解决零样本视觉语言模型在部署分布偏移下，使用分割保形预测作为弃权层时，其边际覆盖率是否能有效保证每个类别的预测安全性的问题。

Result: 在ImageNet-Sketch上，最差类别覆盖率降至约0，10-12%的类别低于有限样本零基准，而边际覆盖率约为0.86。目标域类别校准显著提升了尾部覆盖率，但需要每个类别的标签且计算密集。结果在不同模型规模、预训练语料库、提示和误覆盖率水平α下均一致。

Insight: 核心创新在于揭示了边际覆盖率作为平均可靠性统计量，不能保证类别尾部安全性的重要局限。研究提供了对保形预测在分布偏移下实际安全性的系统审计，并评估了多种校准方法（如Mondrian校准、聚类保形、Conf-OT）的转移效果，指出目标域类别校准的有效性但伴随高成本。

Abstract: Split-conformal prediction provides marginal coverage under exchangeability and is increasingly used as an abstention layer for zero-shot vision-language models (VLMs). We audit this practice under deployment shift for CLIP, OpenCLIP, and SigLIP across ImageNet and non-ImageNet settings. Marginal coverage can remain relatively high while class-conditional tail coverage collapses: on ImageNet-Sketch, worst-class coverage falls to $\approx 0$ and 10-12% of classes lie below a finite-sample null floor, despite marginal coverage of about 0.86. The failure is aligned with target-domain class accuracy but is not predicted by the source-domain diagnostics we test. Source-side Mondrian calibration improves the in-distribution tail but does not transfer, while clustered conformal and Conf-OT improve marginal or average metrics without recovering the worst-class tail. Target-side class calibration substantially lifts the tail, but requires labels for every class and remains set-size-intensive. We further identify a 2-3$\times$ cross-family efficiency gap and show that native SigLIP sigmoid scores remove APS’s probability-mass interpretation. The findings persist across the tested model scale, pretraining corpus, prompt, miscoverage level $α$, and shifted non-ImageNet settings. Marginal conformal coverage should therefore be treated as an average reliability statistic, not as a safety guarantee for the class tail.

[16] Clustering and Token Denoising for Faster and More Robust VLMs cs.CV | cs.LGPDF

Baptiste Rossigneux, Inna Kucher, Vincent Lorrain, Emmanuel Casseau

TL;DR: 本文提出了一种名为ClustRS的无训练视觉令牌剪枝算法，旨在加速视觉语言模型（VLM）并提升其鲁棒性。该方法通过注意力加权聚类选取代表性视觉令牌，并结合残差收缩进行去噪，显著减少了计算负担。实验表明，该方法在极端噪声和令牌削减条件下，在ScienceQA-IMG和MM-VET基准上优于现有方法，并在LLaVA-OneVision上以更少令牌匹配基线性能。

Details

Motivation: 现有视觉语言模型（如LLaVA）处理大量视觉令牌（如576或729个）导致计算负担沉重，难以在边缘设备部署。虽然存在无需重训练的令牌剪枝技术，但需要更鲁棒和高效的方法来应对真实世界中的图像噪声和架构变化。

Result: 在ScienceQA-IMG和MM-VET基准测试中，该方法在极端噪声和令牌削减（减少97%至16个令牌）条件下，比基于注意力和多样性的方法性能提升高达20%。在LLaVA-OneVision上，在轻度噪声条件下，使用少于基线三分之一的令牌即可匹配其性能。

Insight: 创新点在于结合了注意力加权聚类和残差收缩去噪的无训练两阶段算法，提供了一种简单而强大的替代方案，超越了仅依赖分数或多样性的剪枝规则。从客观角度看，该方法通过语义聚类和去噪步骤，有效提升了模型对多种噪声类型的鲁棒性，为计算高效和噪声弹性的VLM部署铺平了道路。

Abstract: Recent Visual-Language Models (VLMs) have enhanced the capabilities of pre-trained LLMs by adding vision tokens alongside text, with approaches like LLaVA showing impressive results. However, the computational burden of processing up to 576 or 729 visual tokens makes edge deployment challenging. While various token pruning techniques require retraining, some are training-free and thus can easily adapt to architecture changes. We introduce ClustRS, a two-part, training-free algorithm for robust token pruning. Its first component is an attention-weighted, clustering algorithm that selects representative tokens from each semantic cluster. The second component, Residual Shrinkage, is a one-pass denoising step on the selected tokens. These training-free lightweight steps make LLaVA ready for real-world data, improving robustness to a wide range of image-noise types and intensities. Experimental results on the ScienceQA-IMG and MM-VET benchmarks show our method outperforms attention- and diversity-based methods by up to 20% under extreme noise and token conditions (reducing tokens by 97%, down to 16 tokens) on LLaVA 1.5 7b and achieves exceptional results on LLaVA-OneVision, where we match baseline performance with fewer than one-third of their tokens under mild noise conditions. Our study demonstrates a simple yet powerful alternative to both score-only and diversity-only pruning rules, paving the way for compute-efficient and noise-resilient VLM deployment.

[17] VideoRun2D Demo: Markerless Body Tracking for Biomechanical Analysis of Running cs.CVPDF

Luis F. Gomez, Julian Fierrez, Roberto Daza, Ruben Tolosana, Aythami Morales

TL;DR: VideoRun2D Demo是一个用于跑步生物力学分析的无标记人体姿态追踪框架。该框架利用不同的人体姿态估计器对短跑视频进行分析，重点关注髋关节和膝关节的屈伸角度，并通过后处理模块进行异常值检测以提升精度。

Details

Motivation: 旨在利用先进的人体姿态估计技术，为跑步运动分析提供一个无需标记点、自动化且准确的生物力学分析工具，以替代或辅助传统依赖专家手动标注的方法。

Result: 在包含44名专业运动员的314次短跑数据上评估，最佳姿态追踪器的平均均方根误差在11.46°到5.83°之间；结合后处理模块后，误差可分别降低至9.87°和5.30°。

Insight: 创新点在于将通用的人体姿态估计模型（Pose Trackers）专门化应用于跑步生物力学的特定角度分析，并设计后处理模块来提升实际应用中的鲁棒性和准确性，证明了基于视觉的自动化方法在该领域的实用价值。

Abstract: Human pose estimation has advanced significantly due to the development of deep learning models, increased data availability, and improved computing resources. These developments have led to highly accurate body tracking systems with direct applications in sports analysis and performance evaluation. The VideoRun2D Demo performs a biomechanical analysis during sprints using different human pose estimators. The proposed framework was evaluated using human pose trackers and expert manual annotations. The tested framework uses 314 sprints from 44 professional runners, focusing on two key joint angles in sprint biomechanics: 1) hip flexion/extension and 2) knee flexion/extension. The framework also includes a post-processing module for outlier detection. The tested results demonstrate that the average root-mean-square errors range from 11.46° to 5.83° for the best trackers. When integrated with the post-processing modules, these errors can be reduced to 9.87° and 5.30°, respectively. The VideoRun2D Demo findings suggest that human pose-tracking approaches can be valuable resources for the biomechanical analysis of running.

[18] CAViAR: A Causal Video Dataset for Fine-Grained Accident Reasoning in Real-World Scenarios cs.CVPDF

Sparsh Garg, Yi-Wen Chen, Vijay Kumar B G, Abhishek Aich

TL;DR: 论文提出了一个名为CAViAR的因果视频数据集，用于在真实世界场景中进行细粒度的事故推理。该数据集包含2249个真实事故视频，并提供了环境条件、事故类型、因果解释、责任方等多维度标注。研究通过评估当前先进的视觉语言模型（如Cosmos-Reason2、Qwen3-VL等），揭示了这些模型在感知与推理之间存在显著差距，尤其是在事故类型和责任判定方面表现不佳。

Details

Motivation: 当前自动驾驶系统在感知任务（如目标检测）上表现优异，但缺乏解释交通事故所需的高级因果推理能力，特别是在确定责任方和违反交通规则方面，现有基准测试尚未充分探索。

Result: 在CAViAR数据集上评估了多个先进视觉语言模型，结果显示：在考虑类别不平衡后，模型在光照条件上表现良好，但在天气和道路条件上的准确率接近或低于多数类基线；所有模型在事故类型和责任推理任务上性能急剧下降，暴露了感知与推理之间的差距。

Insight: 创新点在于构建了一个专注于因果推理的真实事故视频数据集，并系统评估了视觉语言模型在安全关键驾驶场景中的责任推理能力；客观分析认为，该研究强调了当前模型在从可见行为映射到规则相关责任类别方面的局限性，为未来提升自动驾驶系统的因果推理能力提供了基准。

Abstract: While modern autonomous driving systems excel at perception tasks such as object detection and trajectory prediction, they lack the high-level causal reasoning required to interpret traffic accidents. In particular, determining responsibility, such as identifying who is at fault and which traffic rule was violated, remains largely unexplored in current benchmarks. To this end, we introduce CAViAR (Causal Accident Video and Incident Analysis Repository), a human-annotated dashcam benchmark comprising 2,249 real-world accident videos collected from CarCrashDataset (CCD) and Nexar. Each video is annotated with structured labels spanning environmental conditions, accident type, causal explanation, apparent At-Fault Agent, affected agent, and apparent rule-violation category. We benchmark state-of-the-art vision-language models (VLMs), including Cosmos-Reason2, Qwen3-VL, and InternVL3. Once class imbalance is accounted for with majority/random baselines and balanced metrics, perceptual competence is uneven–lighting is nearly solved, whereas weather and road-condition accuracy fall at or below the majority-class baseline—and all models degrade sharply on accident type and responsibility reasoning. Overall, CAViAR exposes a practical Perception–Reasoning Gap: current VLMs may recognize salient context, but do not reliably map visible agent actions to annotated rule-relevant responsibility categories in safety-critical driving scenarios. Code, annotation schema, prompts, and evaluation scripts are available at: https://github.com/nec-labs-ma/CAViAR

[19] Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models cs.CV | cs.AIPDF

Yuanhao Ban, Jiaqi Feng, Hengguang Zhou, Xiaohuan Pei, Justin Cui

TL;DR: Stream4D提出了一种用于流式自回归扩散视频模型的4D一致性训练方法，通过引入前馈4D重建奖励和运动先验，解决了现有方法因几何漂移导致视频退化为静态或不自然运动的问题，从而生成了更具动态一致性和人类偏好的长序列视频。

Details

Motivation: 现有流式自回归扩散模型在长序列视频生成中，由于训练目标仅优化局部帧预测，会导致几何漂移累积，使视频退化为静态或不自然的运动。基于静态3D高斯泼溅重建的奖励方法会错误地惩罚真实的物体运动。

Result: 在多种自回归视频主干网络和不同生成长度上，Stream4D均提升了4D重建质量，更有效地保持了运动，并获得了更高的人类对齐偏好评分。

Insight: 核心创新在于用动态的4D重建奖励替代了静态的3D重建批评器，并结合了奖励自然场景流大小、惩罚抖动和非刚性伪影的运动先验，从而引导模型生成几何和动态一致的视频序列。

Abstract: Streaming autoregressive diffusion models enable real-time, long-horizon video generation, but their training objectives optimize local frame prediction rather than the geometry and dynamics of a coherent world: long rollouts accumulate geometric drift and degrade into static or unnatural motion. Recent bidirectional approaches address this problem using rewards signals built upon 3D Gaussian-Splatting reconstruction. However, a single rigid 3d reconstruction cannot model a dynamic scene, so this critic penalizes genuine object motion as reconstruction error and is maximized by freezing the video. This shortcut is especially detrimental in the AR setting, where each chunk can propagate an already-static configuration. In this work, we propose Stream4D, which replaces the static critic with a feed-forward 4D reconstruction reward that explicitly models scene dynamics, allowing coherent motion to receive high consistency rewards. To further guide motion magnitude and quality, we add a motion prior that rewards natural scene-flow magnitude while penalizing jitter and non-rigid artifacts. Our final recipe combines these two terms with a lightweight perceptual anchor. Across various autoregressive video backbones and various generation horizons, Stream4D improves 4D reconstruction quality, preserves motion more effectively, and achieves higher human-aligned preference. Project page: https://banyuanhao.github.io/Stream4D/

[20] Mix&Fix-Net: A Dual-Stage Trajectory Prediction Model for AIS and Vision-Derived Vessel Data cs.CVPDF

Md Mahmuddun Nabi Murad, Bora San Turgut, Yasin Yilmaz

TL;DR: 本文提出Mix&Fix-Net，一种用于船舶轨迹预测的双阶段模型，旨在同时处理来自AIS（自动识别系统）和视觉（非AIS）数据的轨迹时间序列。该模型通过一个主轨迹预测器和一个残差轨迹调整器来提升预测精度，并引入了一个新的基于网络摄像头的视频数据集来代表非AIS数据。

Details

Motivation: 现有轨迹预测模型主要依赖AIS数据，但大量小型船舶未配备AIS，导致监控空白；因此需要一种能同时利用AIS和视觉数据的预测方法。

Result: 在AIS和非AIS数据集上的广泛评估显示，Mix&Fix-Net在六个指标（均方误差、平均绝对误差、对称平均绝对百分比误差、最终位移误差、弗雷歇距离和平均欧氏距离）上，在大多数指标和数据集上持续优于现有基线方法。

Insight: 创新点在于提出双阶段混合架构（主预测器+残差调整器）以整合异构数据源（AIS与视觉），并构建了新的视频数据集来填补非AIS数据空白，提升了轨迹预测的泛化能力。

Abstract: Vessel trajectory prediction is critical for maritime safety and accident prevention. While most existing trajectory prediction models rely on Automatic Identification System (AIS) data due to its precision and availability, small vessels mostly operate without AIS, resulting in a significant monitoring gap. To address this, we propose Mix&Fix-Net, a dual-stage mixer-based trajectory prediction model designed to handle vessel trajectory time-series data derived from both AIS and (non-AIS) vision data. Our architecture integrates a Primary Trajectory Predictor with a Residual Trajectory Adjuster, enabling more refined trajectory prediction. Additionally, we introduce a new video-based dataset derived from webcam streams, from which vessel trajectories are extracted to represent non-AIS data. Extensive evaluations on both AIS and non-AIS datasets across six metrics (mean squared error, mean absolute error, symmetric mean absolute percentage error, final displacement error, Frechet distance, and average Euclidean distance) demonstrate that Mix&Fix-Net consistently outperforms existing baselines across most metrics and datasets.

Eunsoo Im, Junghun Suh, Gyeonggwan Lee, Seunghwan Hong

TL;DR: CVSD-Reg是一种鲁棒的全局LiDAR点云配准框架，通过从视觉基础模型中提取视觉语义先验知识到LiDAR表示中，解决了传统基于几何表示的方法对点云密度、扫描模式、视角和传感器特性变化敏感的问题。该方法采用两阶段训练：第一阶段通过对比蒸馏和球面流形对齐，让Point Transformer V3学生模型从冻结的DINOv2教师模型中学习；第二阶段通过对应关系学习、密度感知点丢弃增强和端到端姿态优化，将蒸馏后的表示适配到配准任务中。

Details

Motivation: 现有基于学习的全局点云配准方法主要依赖几何表示，对点云密度、扫描模式、视角和传感器特性的变化非常敏感，限制了其在实际场景中的鲁棒性和泛化能力。

Result: 在KITTI、nuScenes和HeLiPR数据集上，CVSD-Reg分别达到了97.7%、99.0%和99.3%的严格成功率（SR@0.5m/1°），包括在稀疏的16线Velodyne扫描上达到97.3%。该方法在不需相机输入或后处理ICP精配的情况下，比现有最先进的几何配准方法性能提升高达44.0个百分点。

Insight: 创新点在于跨模态视觉语义先验蒸馏，通过对比蒸馏和球面流形对齐保持教师嵌入空间的超球面几何特性；引入自监督InfoNCE一致性和软SE(3)不变性增强视角鲁棒性；采用密度感知点丢弃增强和端到端姿态优化适配配准任务；单个模型即可泛化到单传感器和零样本跨传感器场景，且推理时完全不需要相机。

Abstract: Learning-based global point cloud registration has achieved remarkable progress, yet its reliance on geometric representations makes existing methods sensitive to variations in point density, scan pattern, viewpoint, and sensor characteristics. We propose CVSD-Reg, a robust global LiDAR registration framework that distills visual semantic priors from a vision foundation model into LiDAR representations. In Stage 1, a Point Transformer V3 student learns from a frozen DINOv2 teacher through contrastive distillation and spherical-manifold alignment, which preserves the hyperspherical geometry of the teacher embedding space. Self-supervised InfoNCE consistency and soft $\mathrm{SE}(3)$ invariance further encourage viewpoint-robust descriptors. In Stage 2, the distilled representation is adapted to registration through correspondence learning, density-aware point-dropout augmentation, and end-to-end pose optimization. With a single checkpoint, CVSD-Reg generalizes to both single-sensor and zero-shot cross-sensor scenarios without sensor-specific adaptation and remains entirely camera-free at inference. On KITTI, nuScenes, and HeLiPR, CVSD-Reg achieves strict success rate (SR@0.5,m/$1^\circ$) of 97.7$%$, 99.0$%$, and 99.3$%$, respectively, including 97.3$%$ on sparse 16-beam Velodyne scans. It outperforms state-of-the-art geometric registration methods by up to 44.0 percentage points without requiring camera inputs or post-hoc ICP refinement.

Bo Ma

TL;DR: 本文提出了一种无需标注的推理时边界细化方法（LFPR），用于提升视觉-语言模型在指称定位任务中的边界框精度。该方法利用模型自身的预测，通过路由小区域至高分辨率、在上下文裁剪中重新定位、应用几何约束以及坐标融合等步骤，在不依赖目标标注的情况下优化边界框。

Details

Motivation: 现有视觉-语言模型在指称定位中能识别正确目标，但返回的边界框往往不精确。本文旨在探索如何在不使用目标标注的情况下，仅通过冻结的直接回答模型自身的预测，在推理时进行局部观察以提升边界精度。

Result: 在Ref-L4数据集上，LFPR将mAcc_{0.5:0.95}从72.947%提升至76.013%，Acc@0.5从88.531%提升至89.725%，Acc@0.9从55.788%提升至61.142%。在RefCOCO系列数据集上的迁移实验显示，所有数据集的Acc@0.5、mAcc和平均IoU均有提升（合并mAcc +0.645，Acc@0.5 +0.817）。在Flickr30K Entities上的前瞻性评估中，所有指标均得到改善（mAcc +0.973，Acc@0.9 +1.022）。应用于已发布的专家模型（如EGM-4B/8B）时，所有端点指标均提升（Acc@0.9分别+1.569/+6.716），延迟约增加一倍。

Insight: 创新点在于将指称选择与边界精度部分解耦，通过无标注的推理时细化流程（包括路由、裁剪、守卫和融合）动态优化不同IoU区间的性能。研究表明，单一IoU阈值无法全面反映模型行为，而LFPR通过组件组合有效提升了高精度边界（如Acc@0.9）的检测能力，且可与专家模型训练结合使用。

Abstract: Vision–language models can identify the correct referent while returning an imprecise bounding box. We study whether a frozen direct-answer model can use its own prediction to allocate one additional localized observation without accessing target annotations at inference. Label-free precision refinement (LFPR) routes predicted-small regions to a higher-resolution pass, re-grounds the expression inside a context crop, admits a candidate only under fixed geometric guards, and returns a fixed coordinate-wise midpoint. We report results across three evidence tiers. On 31,921 retrospective Ref-L4 expressions, LFPR raises mAcc$_{0.5:0.95}$ from 72.947% to 76.013% (Acc@0.5 88.531%$\to$89.725%, Acc@0.9 55.788%$\to$61.142%). A frozen transfer to 30,969 RefCOCO/RefCOCO+/RefCOCOg expressions improves every dataset at Acc@0.5, mAcc, and mean IoU (pooled mAcc $+0.645$, Acc@0.5 $+0.817$), while Acc@0.9 is unchanged overall: routing alone gains $+1.162$ points there, but crop, guards, and fusion give back $-1.192$, offsetting rather than showing no strict-IoU effect. A prospective, image-disjoint Flickr30K Entities evaluation improves every endpoint (mAcc $+0.973$, Acc@0.9 $+1.022$), more strongly under a single-box variant (mAcc $+2.575$, Acc@0.9 $+3.689$). The same operator applied to two released grounding specialists improves every endpoint (Acc@0.9 $+1.569$/$+6.716$ for EGM-4B/8B) at roughly twice the latency, composing with specialist training rather than replacing it. A genuine unguarded control (guard removed from the same candidates) underperforms the incumbent on every metric, showing the guard is load-bearing. Together, these results show that referent selection and boundary precision are partially separable, with different components moving opposing regions of the IoU curve – behavior a single threshold cannot reveal.

[23] VGI-BENCH: Probing Visual Intelligence in Video Generation Models cs.CV | cs.AIPDF

Xuan He, Cong Wei, Yuhao Cheng, Linrui Ma, Yuxuan Zhang

TL;DR: 本文介绍了VGI-bench，一个用于评估视频生成模型视觉推理能力的基准测试集。该基准包含27个任务和810个实例，通过任务领域和技能标签的两级分类法进行组织，旨在对模型进行细粒度评估。评估发现，当前最先进的模型（如Seedance 2.0）仅能达到51.0%的准确率，表明现有系统在视觉推理方面仍不可靠。

Details

Motivation: 当前视频生成模型在零样本视觉推理方面展现出潜力，但缺乏可靠的评估基准。现有基准需要与模型视觉先验对齐、要求有效的动态演化过程而非仅最终状态合理，并需校准任务难度以保持挑战性但部分可行。

Result: 在VGI-bench上评估显示，当前生成系统仅能解决部分视觉推理任务，最先进模型Seedance 2.0的准确率为51.0%。分析进一步揭示了输出失败模式、输入条件敏感性、从合成微调的性能迁移边界，以及去噪过程中有限的自我纠正能力。

Insight: 创新点在于提出了一个专门针对视频生成模型视觉推理能力的结构化评估基准（VGI-bench），其任务设计强调动态过程和难度校准。客观来看，该工作系统性地揭示了当前模型在复杂视觉推理上的局限性，并为未来模型开发提供了明确的评估框架和诊断工具。

Abstract: Recent studies suggest that video generation models can exhibit certain forms of zero-shot visual reasoning through generated frames. Yet reliable evaluation remains challenging: benchmarks should adopt inputs aligned with the visual priors of current video models, require valid evolving processes rather than only plausible final states, and calibrate task difficulty to remain challenging yet partly feasible. To this end, we introduce VGI-bench, containing 27 tasks and 810 instances, organized by a two-level taxonomy of task domains and skill tags for fine-grained evaluation of visual reasoning capabilities of video generation models. Our evaluations show that current generative systems can solve a subset of visually grounded reasoning tasks, but remain far from reliable, with even the strongest model, Seedance~2.0, achieving only 51.0% under our evaluation criteria. Our analysis further explore the output failure modes, input condition sensitivity, performance transfer boundary from synthetic fine-tuning, and internal denoising perspective revealing limited self-correction, where later steps mainly refine early hypotheses rather than correct reasoning errors. We hope VGI-bench will help stimulate the development of next-generation video generation models. We will release our code and data.

[24] PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment cs.CV | cs.AI | cs.CL | cs.MMPDF

Jiawei Feng, Jiancan Wu, Xingyu Zhu, Junkang Wu, Xiang Wang

TL;DR: 本文提出了感知增强对齐直接偏好优化（PEA-DPO），一种用于多模态大语言模型（MLLMs）对齐的新框架。该框架旨在解决现有DPO方法在多模态场景下的视觉不敏感问题，即模型难以区分原始图像与移除了关键视觉上下文的图像。通过理论分析和实验验证，PEA-DPO被证明能有效缓解此问题，提升模型对视觉内容的敏感性，并减少幻觉。

Details

Motivation: 直接偏好优化（DPO）在单模态语言模型对齐中有效，但其在多模态环境下的应用未被探索。研究发现多模态偏好优化存在一个关键限制——视觉不敏感性，即模型经常无法区分原始图像与缺失关键视觉信息的图像，这阻碍了有效的多模态对齐。

Result: 在三个幻觉基准测试上对不同规模的MLLMs进行评估，结果表明PEA-DPO有效缓解了视觉不敏感性，实现了更强的多模态对齐，并显著减少了幻觉。

Insight: 论文的核心创新点是识别并形式化了多模态偏好优化中的“视觉不敏感性”问题（包括跨图像不敏感性和图像内不敏感性），并提出了PEA-DPO框架，通过显式利用视觉偏好信号来克服这一挑战。从客观角度看，将感知能力（对视觉内容的敏感性）明确纳入对齐优化过程，是多模态模型对齐领域一个有价值的思路拓展。

Abstract: Direct Preference Optimization (DPO) has emerged as an effective approach for aligning large language models (LLMs) with human preferences. However, its adaptation to multimodal settings remains unexplored. Through representational analysis, we identify a key limitation in multimodal preference optimization, which we term visual insensitivity: models often fail to distinguish between images and those with critical visual context removed. Our theoretical analysis further uncovers two manifestations of this problem, namely Across-Image Insensitivity and Within-Image Insensitivity. To address these challenges, we propose Perception-Enhanced Alignment DPO (PEA-DPO), a framework for multimodal LLMs alignment, which explicitly leverages visual preference signals to overcome visual insensitivity. We further provide a theoretical analysis demonstrating that PEA-DPO provably mitigates both failure modes. Empirical results demonstrate that PEA-DPO enhances sensitivity to visual context while preserving the language modeling capacity of the base model. Evaluations across three hallucination benchmarks using MLLMs of varying scales show that PEA-DPO effectively mitigates visual insensitivity, achieves stronger multimodal alignment, and substantially reduces hallucinations.

[25] S$^2$GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices cs.CVPDF

Yiwei Li, Jiannong Cao, Weixun Gao, Rui Cao, Songye Zhu

TL;DR: 本文提出了一种名为S^2GS（结构化稀疏高斯流式处理）的高效自由视点视频重建框架，旨在解决现有方法在边缘物联网设备上部署时面临的高每帧优化时间和大存储占用问题。该框架通过利用结构感知的时间稀疏性，选择性地更新高斯残差，在不牺牲视觉保真度的前提下实现高效流式处理。

Details

Motivation: 自由视点视频的流式重建支持沉浸式物联网服务，但现有方法存在每帧优化时间长和存储占用大的问题，限制了其在资源受限的边缘物联网设备上的部署。

Result: 在消费级GPU、工业边缘物联网设备和物理远程呈现测试平台上进行的广泛实验表明，S^2GS在保持有竞争力的视觉质量的同时，持续减少了每帧优化时间和存储占用。与QUEEN相比，在RTX 4090 GPU上，S^2GS将每帧优化时间减少了59%，存储成本降低了85%。在Jetson AGX Orin上，S^2GS实现了最高的渲染吞吐量（60+ FPS）和最低的能耗。

Insight: 创新点在于利用结构感知的时间稀疏性进行选择性高斯残差更新，结合空间域的流式八叉树组织和时间域的结构化门控机制（包括分层特征传播和Gumbel-Sigmoid采样），以及多级离散方案，实现了对残差更新的细粒度控制，从而在资源受限系统上实现高效部署。

Abstract: Streaming reconstruction of Free-Viewpoint Videos (FVVs) supports immersive Internet of Things (IoT) services, such as telepresence and digital twin visualization. Existing methods suffer from high per-frame optimization time and large storage footprints, limiting deployment on resource-constrained Edge-IoT devices. To address these challenges, we propose Structured Sparse Gaussian Streaming (S$^2$GS), an FVV reconstruction framework that exploits structure-aware temporal sparsity to selectively update Gaussian residuals, enabling efficient streaming without compromising visual fidelity. In the spatial domain, a streaming octree hierarchically organizes Gaussian residuals, capturing spatial correlations that guide residual updates. In the temporal domain, a structured gating mechanism, comprising hierarchical feature propagation (HFP) and Gumbel-Sigmoid sampling, converts hierarchical dynamic cues into sparse residual update decisions under differentiable optimization. A multi-level discrete scheme is further adopted to provide fine-grained control over residual updates while preserving intricate dynamic details. Extensive experiments across consumer GPUs, industrial edge IoT devices, and a physical telepresence testbed demonstrate that S$^2$GS consistently reduces per-frame optimization time and storage footprint while maintaining competitive visual quality. Compared with QUEEN, S$^2$GS reduces per-frame optimization time by 59% and storage costs by 85% on an RTX 4090 GPU. On the Jetson AGX Orin, S$^2$GS delivers the highest rendering throughput (60+ FPS) and the lowest energy consumption among the evaluated methods, demonstrating its potential for deployment in resource-constrained systems.

[26] TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters cs.CVPDF

Honglie Wang, Jia Sun, Zijun Li, Junlong Wu, Pengcheng Wei

TL;DR: 本文提出了TextRefine，一个用于产品海报文本编辑的微调后训练框架，旨在解决现有通用模型在文本插入和替换时出现的文本保真度低、空间布局冲突和字形渲染失真等问题。该框架结合了监督微调和特定操作奖励优化，并引入了包含10万张图像和丰富标注的OpenTextEdit数据集。实验表明，TextRefine在文本保真度、放置可靠性和字形质量上均优于基线模型。

Details

Motivation: 现有基于指令的图像编辑模型在产品海报文本编辑任务中不可靠，常出现文本遗漏、渲染错误、空间布局冲突（如遮挡重要内容）以及字形结构扭曲或不一致等问题。

Result: 在文本插入和替换任务上的大量实验表明，TextRefine在文本保真度、放置可靠性和字形质量方面一致优于所评估的图像编辑基线模型，同时能更好地保留源图像内容。

Insight: 创新点包括：1) 针对文本插入任务，设计了联合评估语义保真度和目标文本覆盖度的文本跨度级奖励，并引入门控结构约束以保护非文本区域；2) 针对文本替换任务，利用连接时序分类（CTC）后验概率为目标字符提供细粒度缺陷（如笔画缺失、结构变形）的梯度监督；3) 构建了大规模、多布局、包含产品掩码和低频字符的专用数据集OpenTextEdit。

Abstract: Text editing in product posters entails inserting new text or replacing existing text while preserving product appearance, background content, and global composition. Despite recent progress in instruction-based image editing, general-purpose models remain unreliable in this setting: they often omit or incorrectly render the target text, place it over salient products or pre-existing content, and produce structurally distorted or visually inconsistent glyphs. We introduce \textbf{TextRefine}, a task-aligned post-training framework that combines supervised fine-tuning with operation-specific reward optimization to address these complementary failure modes. For text insertion, our text-span-level reward jointly assesses semantic fidelity and target-span coverage, penalizes spatial conflicts with products and existing text, and employs a gated structural constraint to preserve non-text regions. For text replacement, our glyph-level reward leverages the connectionist temporal classification (CTC) posterior of the target character to provide graded supervision for fine-grained defects, including missing strokes, structural deformations, and confusion among visually similar characters. We further introduce \textbf{OpenTextEdit}, a dataset comprising 100K images for text editing in product posters, with multi-text layouts, detailed text attributes, product masks, and challenging low-frequency characters. Extensive experiments on both insertion and replacement demonstrate that TextRefine consistently outperforms the evaluated image editing baselines in textual fidelity, placement reliability, and glyph quality while better preserving source-image content.

[27] PL-NBA: A Possession-level Universal Basketball Video Dataset Supporting Multiple Visual Understanding Tasks cs.CVPDF

Yunhao Zhao, Haoying Sun, Jiarui Li, Zhuming Wang, Ya Jing

TL;DR: 本文构建了首个基于进攻回合的篮球视频数据集PL-NBA，每个样本包含完整的NBA进攻回合，包含11,000个有效进攻回合片段和31,567个标注事件，支持事件识别、视频描述、时序动作定位和动作预测等多个视觉理解任务。

Details

Motivation: 现有篮球视频数据集通常以单一动作或活动为样本，无法保持比赛事件的时序连续性，也不支持动作预测等复杂任务，因此需要构建一个能保留事件连续性并支持多任务分析的篮球视频数据集。

Result: 在事件识别、视频描述、时序动作定位和动作预测四个任务上的实验表明，现有方法在PL-NBA上性能有限，证明该数据集是体育视频理解的一个具有挑战性的基准。

Insight: 创新点在于首次构建了以完整进攻回合为单位的篮球视频数据集，保留了事件的时序连续性和战术分析所需的上下文信息，为多任务视觉理解提供了新的基准平台。

Abstract: Visual understanding in sports has emerged as a hot topic in computer vision in recent years. Most existing basketball video datasets adopt single action or activity as sample, which can neither preserve the temporal continuity of game events nor support complex tasks such as action anticipation. To address this issue, this paper constructs the first possession-level basketball video dataset (PL-NBA), in which each sample is composed of a complete NBA offensive possession. Collected from 60 NBA games, PL-NBA contains 11,000 valid offensive possession clips and 31,567 annotated events with player names, captions, event types and timestamps. Each video clip includes multiple events and preserves the continuity of events, which is helpful for analysis of tactic. Experiment is conducted on multiple visual understanding tasks, including event recognition, video captioning, temporal action localization and action anticipation. Experimental results show that existing methods achieve limited performance on above four tasks, demonstrating that PL-NBA is a challenging benchmark for sports video understanding.

[28] MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation cs.CVPDF

Bashirul Azam Biswas, Amartya Bhattacharya, Biratal Raj Wagle, Matthew E. Maeder, James B. Yu

TL;DR: 本文提出了MUST-PET，一个用于全身PET-CT病灶分割的多模态、多示踪剂自监督学习框架。该框架通过上下文感知的掩码重建进行预训练，利用PET和CT的互补信息。实验表明，该方法能减少重建误差，提升病灶分割性能，并在有限标注数据和未见外部数据集上表现出良好的泛化能力。

Details

Motivation: 基于深度学习的全身PET-CT病灶分割在癌症诊疗中具有重要价值，但其泛化能力受限于标注稀缺和领域偏移问题。自监督学习能应对这些挑战，但在泛癌、多示踪剂的PET-CT领域尚未得到充分探索。

Result: 在包含FDG和PSMA示踪剂的多样化、多机构泛癌PET-CT扫描数据集上进行训练和验证。与从头训练相比，MUST-PET降低了重建误差，改善了病灶分割性能，在有限标注数据和独立外部测试集上表现良好。

Insight: 创新点在于提出了一个跨示踪剂的多模态自监督学习框架，通过上下文感知的掩码重建策略，利用多模态互补信息进行预训练。这为标注高效、泛化性强的医学图像分析提供了一种有潜力的解决方案。

Abstract: Deep learning-based whole-body PET-CT lesion segmentation can support cancer staging, treatment planning, and response assessment, but generalization is limited by scarce annotations and domain shifts. Self-supervised learning (SSL) can address these challenges but remains underexplored in pan-cancer, multi-tracer PET-CT. In this work, we propose MUST-PET (MUltimodal Self-Supervised learning across Tracers), a multimodal, multi-tracer SSL framework for generalizable whole-body PET-CT lesion segmentation. MUST-PET is trained and validated on a diverse, multi-institutional collection of pan-cancer PET-CT scans acquired with FDG and prostate-specific membrane antigen (PSMA)-targeted radiotracers. MUST-PET uses context-aware masked reconstruction, where one modality is partially masked and reconstructed using complementary information from both PET and CT. The pretrained model is subsequently fine-tuned with labeled samples and evaluated for reconstruction quality, lesion segmentation, label efficiency, and generalizability across independent held-out datasets. MUST-PET reduces reconstruction error, improves lesion segmentation over training from scratch, and performs well with limited labeled data and on unseen external datasets, demonstrating the potential of multi-tracer SSL for label-efficient, generalizable whole-body PET-CT. segmentation.

[29] Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning cs.CV | cs.LGPDF

Haoqiang Kang, Yinpeng Chen, Luyang Liu, Jesper Sparre Andersen, Abhijit Ogale

TL;DR: 本文提出Scaffolding Minds方法，针对多模态推理中潜在推理框架的两阶段训练范式进行优化。该方法通过引入专用的脚手架编码器来优化潜在空间中的目标表示，并改进强化学习采样器以学习均值和方差，从而解决现有方法中潜在表示与下游任务对齐不佳以及探索受限的问题。

Details

Motivation: 现有潜在推理框架存在两个关键局限：一是监督微调阶段依赖现成的视觉编码器，导致潜在表示与下游推理任务对齐不佳；二是强化学习阶段仅通过确定性正则化处理潜在组件，限制了策略探索。

Result: 在FrozenLake空间规划任务上，该方法比最强的潜在推理基线提升了9.5%，在32x32网格地图上增益扩大至19%；在九个以视觉为中心的推理基准测试中平均提升5.2%。

Insight: 创新点在于学习专用的脚手架编码器来优化潜在目标表示，并改进强化学习采样器以同时学习均值和方差，从而增强表示对齐和探索能力，这两项改进具有互补性。

Abstract: Latent reasoning has advanced multimodal reasoning through a two-stage training paradigm: (1) a helper image is encoded into latent tokens to teach visual chain-of-thought during a supervised fine-tuning (SFT) stage, and (2) these latent tokens are further refined with reward feedback during a reinforcement learning (RL) stage. In this paper, we identify two key limitations of this framework, one in each stage. First, the SFT stage typically relies on an off-the-shelf vision encoder to encode the helper image, yielding suboptimal latent representations that may not be well aligned with the downstream reasoning task. Second, existing RL methods treat the latent component only through deterministic regularization, which constrains policy drift but does not create alternative latent trajectories for exploration. To address these limitations, we propose Scaffolding Minds. Our approach learns a dedicated scaffolding encoder that provides an optimized target in latent space, and learns both the mean and variance of the RL sampler. We further show that these two improvements are complementary, together yielding substantial gains over strong baselines. Empirically, our method improves over the strongest latent-reasoning baseline by +9.5% on FrozenLake spatial planning, with the gain widening to +19% at 32x32 grid map, and by +5.2% on average across nine visual-centric reasoning benchmarks.

[30] RIPE++: Reinforced Keypoint Learning from Positive Pairs Only cs.CV | cs.LGPDF

Johannes Künzel, Peter Eisert, Anna Hilsmann

TL;DR: 本文提出RIPE++，一种仅利用正图像对进行强化学习的关键点检测与描述子学习方法。该方法通过充分利用几何一致性信号，从单个正对中同时推导奖励与惩罚，无需构建负样本对，实现了在极有限监督下的表示学习。此外，该方法还可扩展至匹配阶段，在MegaDepth1500基准上将AUC@5从56.58提升至59.65，并能在仅有部分视觉重叠的图像对上训练完整的稀疏匹配流程。

Details

Motivation: 现有基于强化学习的关键点学习方法（如RIPE）依赖粗糙的二元奖励和精心构建的负训练对，这限制了训练稳定性和描述子判别力。本文旨在仅利用正图像对，通过更丰富的几何一致性信号来学习判别性强的检测器和描述子，以应对真实场景中相机位姿或深度监督通常缺失的挑战。

Result: 在MegaDepth1500基准上，将AUC@5从56.58提升至59.65。在多个标准基准测试中，该方法取得了与全监督方法相当的结果。此外，该方法还能在低纹理医学视频序列（通常缺乏相机位姿且标准SfM流程常失败）上进行训练。

Insight: 创新点在于提出了一种仅从正图像对中同时推导奖励与惩罚的强化学习奖励机制，无需对比负样本，从而提供了更丰富的监督信号。该方法将强化学习目标扩展至匹配阶段（适配LightGlue），实现了从仅有部分重叠的图像对进行弱监督训练完整稀疏匹配流程的能力，拓宽了在监督信息极度有限场景（如医学图像）下的应用可能性。

Abstract: Sparse keypoint extraction and matching underpin core tasks in geometric computer vision, including structure-from-motion, visual SLAM, augmented reality, and medical image registration. Learning robust local feature representations, however, typically requires accurate camera poses or depth supervision, which are often unavailable in real-world settings. Reinforcement learning (RL) has recently emerged as a promising alternative, requiring only the information if two images show the same scene or not. However, existing RL formulations such as RIPE rely on coarse binary rewards and carefully constructed negative training pairs, limiting training stability and descriptor discriminability. In this paper, we revisit RL-based keypoint learning and propose a reward that fully exploits the geometric consistency signal, deriving both reward and penalty from a single positive pair without contrasting against negatives. This richer signal provides sufficient supervisory contrast to learn discriminative detectors and descriptors from positive image pairs alone, enabling representation learning under extremely limited supervision. Furthermore, we show that the same RL objective can be extended to the matching stage by adapting LightGlue, raising AUC@5 on MegaDepth1500 from 56.58 to 59.65 and enabling weakly-supervised training of the full sparse matching pipeline from image pairs with partial visual overlap. We validate our approach on established benchmarks, demonstrating competitive results compared to fully-supervised methods. We further show that the method can be even trained on low texture medical video sequences, where camera poses are usually unavailable and standard SfM pipelines often fail. Code and data are available at https://github.com/fraunhoferhhi/RIPEpp .

Mohammad Arif Ul Alam

TL;DR: 本文研究水下机器人视觉退化条件下的鲁棒跨模态感知问题，提出了一种基于预训练视觉基础模型（DINOv2）和声纳的退化感知门控融合方法，该方法在视觉严重退化时能自适应调整模态贡献，显著提升感知性能。

Details

Motivation: 水下光学图像因浑浊度、衰减、低光照等因素严重退化，而声纳提供互补信息；现有研究多关注特征对齐和正常检测性能，缺乏对视觉可靠性恶化时跨模态鲁棒性的系统研究。

Result: 在从干净到极端视觉条件的五级基准测试中，DINOv2基线平衡准确率为0.4610，而退化感知视觉-声纳融合方法达到0.6152，相对提升33.5%；在极端退化下，声纳贡献从干净条件下的14.2%自适应增加到41.3%。

Insight: 创新点在于提出了一种保持视觉和声纳编码器冻结的退化感知门控融合机制，该机制在训练中学习跨全部退化级别的融合策略，实现了无需微调预训练骨干网络的自适应跨模态依赖重新分配；研究表明基础模型表征在严重信息损失下仍有价值但不足，而显式根据模态可靠性调整融合能提升鲁棒性。

Abstract: Reliable underwater robotic perception remains difficult because optical imagery degrades under turbidity, wavelength-dependent attenuation, low illumination, scattering, and blur. Although sonar provides complementary information that is less affected by optical visibility, prior visual-sonar research has largely focused on feature alignment and nominal detection performance. We investigate cross-modal robustness as visual reliability deteriorates and assess whether pretrained visual foundation-model representations can be complemented by sonar under severe degradation. We use frozen DINOv2 as the visual encoder and construct a controlled five-level benchmark ranging from clean to extreme visual conditions. We compare conventional visual detection, frozen foundation-model representations, sonar context, fixed multimodal fusion, clean-trained adaptive gating, and degradation-aware gated fusion. Our method trains the fusion mechanism across the full range of degradation while keeping the visual and sonar encoders frozen, allowing modality contributions to adapt without fine-tuning the pretrained backbone. Under extreme combined degradation, the DINOv2 baseline achieves 0.4610 balanced accuracy, while degradation-aware visual-sonar fusion reaches 0.6152, a 33.5% relative improvement. The learned sonar contribution increases from 14.2% under clean conditions to 41.3% under extreme degradation, demonstrating adaptive redistribution of cross-modal reliance. Fusion provides the largest gains under severe turbidity and blur, whereas color attenuation alone yields little additional benefit. These results show that foundation-model representations remain valuable but insufficient under severe information loss, and that explicitly adapting fusion to modality reliability can improve robust underwater multimodal perception.

[32] StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary cs.CV | cs.CLPDF

Chenxi Shao, Bozhong Wang, Jiaxin Huang, Zhao Liu, Sunwei Zhu

TL;DR: 本文提出了StreamSoccer系统，一种用于实时足球解说的事件驱动模型。该系统通过事件记忆作为中间表示，在有限的计算和内存预算下，整合视频流并组织历史信息，以生成针对当前事件、近期窗口和历史记忆的三种解说模式。

Details

Motivation: 解决流式视频理解中，模型需要因果地更新状态、将增长的历史组织成语义单元，并在有限计算和内存下进行回忆的挑战，特别是在实时足球解说场景下，系统必须仅基于当前可用信息来描述事件、总结近期比赛、回忆早期事件或保持沉默。

Result: 在构建的三轨道流式足球解说数据集上，StreamSoccer在当前事件、近期窗口和历史记忆解说轨道上的CIDEr得分分别为38.62、23.96和17.39，在当前事件和历史记忆轨道上排名第一，在近期窗口轨道上排名第二。消融实验表明完整系统性能最佳，且在58场比赛的174次原始视频运行中，每分钟RTF p95在0.10到0.22之间，未随比赛历史持续增长。

Insight: 创新点在于显式建模事件生命周期，使用固定预算的主动记忆作为中间表示来整合流式输入，而非围绕帧、视觉令牌或缓存进行组织；同时，统一的生成器结合规则辅助调度器，支持多时间范围的解说生成，实现了对长历史计算的控制。

Abstract: Streaming video understanding requires models to causally update state as video arrives and organize growing history into semantic units that can evolve, persist, and be recalled under bounded computation and memory. This challenge is pronounced in live soccer commentary, where a system must describe completed events, summarize recent play, recall earlier events, or remain silent using only information available before each utterance. We present StreamSoccer, an event-driven system that uses event memory as its intermediate representation. A fixed-budget active memory integrates the stream; completed event states are retained locally and consolidated into retrievable historical records. A unified generator uses current, recent, and historical context to produce three commentary modes, while a rule-assisted scheduler selects a mode or silence. Unlike streaming video-language models organized around frames, visual tokens, or caches, and soccer-commentary methods based on predefined clips or output timestamps, StreamSoccer explicitly models event lifecycles. We construct a three-track streaming soccer commentary dataset and a layered evaluation protocol. At common reference anchors, StreamSoccer obtains CIDEr scores of 38.62, 23.96, and 17.39 for current-event, recent-window, and historical-memory commentary, ranking first on the current-event and historical-memory tracks and second on recent-window. Controlled ablations show that local completed events improve all tracks and that the full system performs best on all three. Across 174 raw-video runs on 58 matches, per-minute RTF p95 ranges from 0.10 to 0.22 without sustained growth with match history. These results indicate that event memory supports streaming soccer commentary across temporal scopes while controlling long-history computation.

[33] TempJail: Temporal Jailbreak Attack against Large Vision-Language Models via Subtitle Scheduling cs.CV | cs.AI | cs.CLPDF

Ling Zhou, Yihao Huang, Jingling Sun, Zhiwen Tian, Yi Zeng

TL;DR: 本文提出了一种针对大型视觉语言模型（LVLMs）的新型时序越狱攻击方法TempJail。该方法利用视频字幕作为攻击媒介，通过精心编排字幕的语义内容和时序调度（如持续时间和时间槽分配），来利用LVLMs在时序理解上的漏洞，从而诱导模型对有害查询作出违规响应。

Details

Motivation: 现有针对LVLMs的视频越狱攻击主要操纵视频中嵌入的文本内容，而忽略了信息在时间维度上的组织方式。本文发现越狱的有效性不仅取决于文本信息的语义，还与其在时间上的呈现方式（如时长和时序分配）密切相关，因此探索了利用字幕进行时序攻击的可能性。

Result: 在四个代表性LVLM和两个数据集上的大量实验表明，TempJail在所有评估的模型-数据集设置上都取得了最高的攻击成功率。具体而言，在GPT-5和Gemini 3.5-Flash上，其数据集平均攻击成功率（ASR）分别比最强基线高出53和18个百分点，达到了SOTA水平。

Insight: 论文的核心创新点在于首次系统地揭示了LVLMs在视频理解中对时序信息呈现方式的脆弱性，并提出了一个黑盒的、基于字幕时序调度的攻击框架。从客观角度看，其将攻击媒介从静态的文本/图像内容扩展到动态的时序编排，为理解和防御LVLMs的安全漏洞提供了新的视角和基准。

Abstract: Large vision-language models (LVLMs) have achieved remarkable progress in video understanding and reasoning. Despite extensive studies on text- and image-based jailbreaks, video jailbreaks against LVLMs remain largely unexplored. Existing video jailbreak methods mainly manipulate textual content embedded in videos, while overlooking how such information is organized over time. Our analysis reveals that jailbreak effectiveness depends not only on the semantics of textual information but also on its temporal presentation, including duration and timing-slot allocation. Motivated by this finding, we use subtitles, which are common in real-world videos and allow semantic content to be presented under precise temporal control without appearing visually intrusive, as a natural attack medium. Based on this insight, we propose TempJail, a black-box video-based jailbreak framework that constructs query-aligned dialogue-style subtitle sequences and optimizes their temporal scheduling to exploit temporal vulnerabilities in LVLMs and elicit responses that satisfy the harmful intent of the source query. Extensive experiments on four representative LVLMs and two datasets demonstrate that TempJail achieves the highest attack success rate across all evaluated model–dataset settings, outperforming the strongest baseline by 53 and 18 percentage points in dataset-averaged ASR on GPT-5 and Gemini 3.5-Flash, respectively.

[34] Coupled Optimal Transport with Landmark Constraints cs.CVPDF

Xiang Gu, Jian Sun, Zongben Xu

TL;DR: 本文提出了一种新颖的耦合最优传输框架，通过整合少量标注地标点来引导恢复控制分布变换的底层变形场。该框架将传输方案和变形场的优化统一到一个模型中，通过相互一致性约束将地标引导的变形场与成本驱动的传输方案耦合起来。

Details

Motivation: 现有最优传输模型主要通过最小化预设的传输成本或失真来寻找分布之间的传输映射或方案，但仅最小化传输成本可能无法识别两个分布之间几何上有意义的变换。本文旨在解决这一局限性。

Result: 论文在形状匹配任务中验证了所提方法的实际有效性，但摘要中未提及具体的定量结果或基准测试对比。

Insight: 核心创新点在于提出了一个将基于地标的配准与基于传输的分布匹配进行原则性连接的统一框架，允许从稀疏的几何监督中恢复传输映射。从客观角度看，其耦合优化和相互一致性约束的设计是新颖的。

Abstract: Existing optimal transport (OT) models primarily seek an OT map or plan between distributions by minimizing a prescribed transport cost or distortion. However, minimizing transport cost or distortion alone may fail to identify a geometrically meaningful transformation between the two distributions. To address this limitation, this paper proposes a novel coupled OT framework that leverages a small number of annotated landmarks to guide the recovery of an underlying deformation governing the distribution transformation. The coupled OT framework integrates the optimization of the transport plan and the deformation field into a unified model, where the landmark-guided deformation field and the cost-driven transport plan are coupled through a mutual-consistency constraint. As a result, the deformation is jointly determined by the annotated landmarks and cost-driven distribution matching. The proposed framework provides a principled connection between landmark-based registration and transport-based distribution matching, enabling the recovery of transport maps from sparse geometric supervision. We establish the well-definedness of the proposed model in a general variational setting and develop a finite-element-based numerical algorithm for computation whose convergence properties are systematically analyzed. The practical effectiveness of the proposed approach is verified in shape matching.

[35] Question-Guided Evidence Acquisition for Multimodal Visual Question Answering cs.CV | cs.AI | cs.LGPDF

Alin-Ionut Popa

TL;DR: 该论文提出了一种名为Q-Guide的智能体，用于解决多模态文档视觉问答（Document-VQA）中感知不可靠的问题。Q-Guide通过问题引导，在推理时进行多轮、有目的的感知，动态调用工具（如文本读取、区域放大）来获取缺失的证据，而不是依赖单次固定的页面编码。

Details

Motivation: 现有文档VQA系统通常将感知视为固定过程，对页面进行一次编码后直接回答问题，这导致模型在处理小文本、表格、视觉线索和拓扑元素时容易出错。论文认为需要更慢、更审慎的感知过程，在推理时动态决定下一步需要查看什么。

Result: 在DocVQA2026和Manga109基准测试上，Q-Guide显著优于直接提示和最近的多智能体文档系统（DocVQA2026上65.0% vs. 40.0%，Manga109上32.4% vs. 24.4%），并且在三个Claude骨干模型（Opus 4.6, Sonnet 4.6, Opus 4.5）上都保持了性能提升，达到了新的SOTA水平。

Insight: 论文的核心创新在于将感知过程从静态、一次性编码转变为动态、问题引导的多轮证据获取。一个关键的客观洞见是，性能提升主要源于将感知引导到正确位置，而非复杂的控制逻辑（如添加规划器、路由器或多智能体协作），且大部分增益在两到三轮审慎感知后即可获得，这为高效、可解释的文档理解系统设计提供了新思路。

Abstract: Multimodal LLMs can see a document, but they often can’t read it reliably. Small text, tables, visual cues, and topological elements still trip them up under direct visual inference, even when the page is already sitting in the model’s context. Most document-VQA systems treat perception as fixed: they encode the page once, ask the question, and answer from whatever the model happened to extract in that single fast pass. We think document VQA needs slower, more deliberate perception: rather than answering from one fixed encoding, the model should spend a bit of extra compute at inference time working out what to look at next, and only then answer. We build this into \textbf{Q-Guide}, a small agent that reads a question, works out what evidence it is still missing, and calls targeted tool(s) to recover it—reading text where text is needed, zooming in where detail is needed, or grounding a region where position matters. On DocVQA2026 and Manga109, Q-Guide outperforms both direct prompting and recent multi-agent document systems ($65.0%$ vs.\ $40.0%$ on DocVQA2026, $32.4%$ vs.\ $24.4%$ on Manga109), and the improvement holds across three Claude backbones (Opus 4.6, Sonnet 4.6, and Opus 4.5). We find that accuracy scales with the perception budget—most of the gain appears within two to three deliberate rounds—and that the gain comes from directing perception to the right place, not from complex control logic: adding planners, routers, or multiple collaborating agents does not help.

[36] Core-KAN: Continuous Vision Kernels with Kolmogorov-Arnold Networks cs.CV | cs.AIPDF

Lan Guo, Mengling Li, Haoran Li, Jun Shen, Yuanbo Jiang

TL;DR: 本文提出了一种名为Core-KAN的连续相对尺度卷积算子，旨在解决传统卷积核在固定离散网格上定义、难以适应异构局部结构的问题。该方法通过将输入特征映射到紧凑的潜在基空间，并使用轻量级尺度控制器预测局部相对尺度，结合基于Kolmogorov-Arnold网络（KAN）的生成器来表示深度方向的核基函数，从而能够合成任意分辨率的空间滤波器。

Details

Motivation: 传统卷积核局限于固定离散网格，无法灵活适应图像中异质的局部结构；现有自适应算子虽提高了灵活性，但往往将几何尺度变化与内容依赖的滤波耦合在一起，且逐位置生成核的计算成本高昂。

Result: 在三个具有代表性的视觉任务上的实验表明，Core-KAN在仅增加少量参数和计算开销的情况下，持续优于强大的卷积和动态核基线方法。

Insight: 核心创新在于明确解耦了几何尺度适应与内容依赖的滤波：通过一个紧凑的、尺度条件化的核响应库进行插值来处理尺度变化，而一个独立的混合控制器则基于局部内容组合这些响应。这形成了一个低秩动态卷积设计，能高效地随核大小扩展，并易于集成到分层视觉骨干网络中。

Abstract: Conventional convolutional kernels are typically defined on fixed discrete grids, limiting their ability to accommodate heterogeneous local structures. Existing adaptive operators improve flexibility but often couple geometric scale variation with content-dependent filtering, while incurring high computational cost from per-location kernel generation. To decouple geometric scale adaptation from content-dependent filtering while avoiding expensive per-location kernel generation, we propose Continuous Relative-scale KAN (Core-KAN), a relative-scale-conditioned continuous convolution operator. Core-KAN maps input features into a compact latent basis space and uses a lightweight scale controller to predict local scales relative to an exponential moving average reference. A KAN-based generator represents depth-wise kernel bases as continuous coordinate functions, allowing the operator to synthesize spatial filters at arbitrary resolutions rather than being confined to a fixed lattice. Instead of synthesizing independent kernels at every location, it constructs a compact bank of scale-conditioned kernel responses and interpolates them according to the predicted local scale map. An independent mixing controller further combines the interpolated basis responses based on local content, explicitly decoupling geometric scale adaptation from content-dependent filtering. Together with lightweight pointwise projections, this design forms a low-rank dynamic convolution that scales efficiently with kernel size and integrates readily into hierarchical vision backbones. Experiments across three representative vision tasks show Core-KAN consistently outperforms strong convolutional and dynamic-kernel baselines with only marginal parameter and computational overhead, offering an efficient, general framework for continuous, scale-adaptive convolution.

[37] Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment cs.CV | cs.CLPDF

Yunseo Lee, Hyun Jun Kim, Heeseung Shin, Changwon Lim

TL;DR: 本文提出了一种增强临床对齐的医学图像描述生成框架，通过分离并强化训练时对齐和推理时对齐来解决现有模型输出流畅但临床可靠性不足的问题。该框架整合了基于BioMedCLIP和SigLIP2的单/双视觉编码器、Q-Former和LLaMA解码器，并引入了包含临床相关奖励的MedPAIR-SCST训练方法以及推理时基于嵌入的重排序策略。

Details

Motivation: 医学图像描述在加速诊断流程和提升AI系统可解释性方面具有重要价值，但由于灰度模态、细微解剖特征、专业医学术语和数据质量差异等因素，生成临床可靠的描述仍面临挑战。现有大视觉语言模型虽然能生成流畅文本，但其输出与临床概念空间及评估标准之间的对齐程度不足。

Result: 实验表明，多编码器设计的互补视觉表征与概念级辅助学习有助于保留临床有意义的信息；推理时重排序可在无需额外训练的情况下提升语义和临床对齐；而MedPAIR-SCST能直接改进模型生成分布，产生更一致且基于临床的描述。这些方法在数据受限环境下共同促进了更可信的医学图像描述生成。

Insight: 创新点在于将临床对齐分解为训练时和推理时两个可独立优化的阶段，并提出了MedPAIR-SCST（结合临床奖励的强化学习）与嵌入重排序的协同框架。客观来看，该研究通过多编码器融合、医学概念预测辅助任务以及基于奖励的分布优化，系统性地增强了模型对专业医学知识的对齐能力，为数据稀缺领域的专业文本生成提供了可借鉴的范式。

Abstract: Medical image captioning is a technique that accelerates early-stage diagnostic workflows and enhances the interpretability of medical diagnostic AI systems. However, unlike general image captioning, clinically reliable captioning remains challenging due to grayscale-based modalities, subtle anatomical cues, specialized medical phrasing, and variations in data quality. Despite recent advances in large vision-language models, fluent outputs do not necessarily guarantee sufficient alignment with clinical concept spaces or evaluation criteria. To address this issue, we propose a framework that strengthens clinical alignment by separating and enhancing training-time alignment and inference-time alignment. We build a medical image captioning pipeline that integrates single/dual vision encoders based on BioMedCLIP and SigLIP2, a Q-Former, and a LLaMA-based decoder, and examine the contribution of auxiliary learning for UMLS concept/type prediction. At inference, we apply single-embedding-based reranking to select the best caption among candidates, while at training we introduce MedPAIR-SCST, which combines clinically relevant rewards to shift the generative distribution toward improved clinical alignment. Our experiments show that complementary visual representations with a multi-encoder design and concept-level auxiliary learning help preserve clinically meaningful information. Furthermore, inference-time reranking provides a practical way to improve semantic and clinical alignment without additional training, whereas MedPAIR-SCST goes beyond selection by directly improving the model’s distribution to generate more consistent and clinically grounded captions. These findings suggest that jointly leveraging selection-based alignment and reinforcement-learning-based alignment can promote more trustworthy medical image captioning even in data-constrained settings.

[38] A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments cs.CVPDF

Niklas Voigt, Hartmut Surmann

TL;DR: 本文提出了一种新颖的数据驱动方法，用于在GPS和无线电信号受限的室内环境中实现基于摄像头的微型无人机自主控制。该方法针对灾难应急响应场景，通过训练卷积神经网络从单目360度图像中预测连续偏航指令，使无人机在通信中断时能自主导航至开阔空间，从而保全机载传感器数据。

Details

Motivation: 解决在灾难应急响应（如消防、CBRN事件）中，微型无人机在GPS和通信信号受限的室内或地下环境中失去通信链接后，无法自主导航导致数据丢失的问题，旨在降低人类救援人员的风险并提升态势感知能力。

Result: 在预留测试集上的评估证实了学习型偏航预测方法的可行性；半自主真实世界测试进一步展示了该方法的实用性，但也揭示了关键失效模式（如反射和眩光）。

Insight: 创新点包括：1) 构建了一个面向通信中断场景的360度视觉数据集，涵盖工业、地下和训练环境；2) 提出了将等距柱状360度视频转换为平面前视图并动态生成AI训练图像-标签对的预处理流程；3) 通过比较多种CNN变体，验证了从单目视图预测连续偏航指令的端到端学习框架。

Abstract: This paper presents a novel data-driven approach to camera-based autonomy for micro-drones in GPS-denied, radio-challenging indoor environments. The target application is disaster and emergency response, where micro-UAVs can provide rapid situational awareness in hazardous settings such as firefighting and chemical, biological, radiological, and nuclear (CBRN) incidents while reducing risk for human responders. When the communication link is lost, the micro-drone uses a learned yaw controller to autonomously navigate toward open space, preserving onboard sensor data that would otherwise be lost with the vehicle. A custom micro-drone equipped with a 360-degree camera was used to record diverse industrial, underground, and training scenarios representative of communication-denied field operations. We introduce a preprocessing pipeline that converts equirectangular 360-degree footage into planar front views and dynamically generates image-label pairs for AI training. We then train and compare multiple convolutional neural network variants that predict a continuous yaw command from a single monocular view. Evaluation on a held-out test set confirms the feasibility of the learned yaw-prediction approach. A semi-autonomous real-world test further demonstrates the practicality of the method while revealing key failure modes, particularly reflections and glare.

[39] DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representations cs.CVPDF

Hangyu Tian, Zhenqi He, Yanghao Wang, Long Chen

TL;DR: 本文提出了DIFFCZSL框架，通过将预训练扩散模型的中间表示注入到基于CLIP的组合零样本学习（CZSL）流程中，利用扩散特征的生成先验来增强CLIP嵌入的语义表示，从而提升对未见属性-对象组合的识别能力。

Details

Motivation: 现有基于大规模视觉语言模型（如CLIP）的CZSL方法主要依赖判别式表示，未能显式保持原始概念与其组合之间的结构化关系；作者受扩散模型分类器成功的启发，探索扩散中间表示能否为CZSL提供互补线索。

Result: 在三个公开CZSL基准（如MIT-States、UT-Zappos、C-GQA）上的实验表明，该方法在封闭世界和开放世界设置下均显著优于基于CLIP的强基线，实现了性能的持续提升。

Insight: 创新点在于利用扩散模型的中间表示作为辅助监督，通过对比对齐将生成式先验融入判别式视觉语言模型，从而丰富嵌入空间的组合感知语义，且推理时无需额外成本；这揭示了生成式与判别式表示在组合泛化中的互补优势。

Abstract: Compositional Zero-Shot Learning (CZSL) aims to recognize unseen attribute-object compositions by leveraging knowledge of primitive concepts learned from seen compositions. Although recent works achieve impressive performance in CZSL by leveraging large vision-language models, they primarily rely on discriminative representations that may not explicitly preserve the structured relationships between primitive concepts and their compositions. Motivated by the recent success of diffusion-based classifiers and their competitive performance relative to discriminative models, we investigate whether intermediate diffusion representations can provide complementary cues for CZSL. To this end, we propose DIFFCZSL, a diffusion-augmented framework that injects generative priors from pre-trained diffusion models into CLIP-based CZSL pipelines. We extract intermediate diffusion representations and project them into the CLIP embedding space to provide auxiliary supervision on both image and text modalities. Through contrastive alignment between CLIP embeddings and diffusion features during training, our method encourages the embedding geometry toward richer composition-aware semantics, while introducing no additional cost at inference time. Extensive experiments on three public CZSL benchmarks demonstrate consistent improvements over strong CLIP-based baselines under both closed-world and open-world settings. Our results highlight the complementary strengths of generative diffusion representations and discriminative vision-language models for compositional generalization.

[40] Unified and Efficient Point-Line Local Features cs.CVPDF

François Costa, Raphael Kreft, Eckhard Goedeke, Felix Möller, Hardik Shah

TL;DR: 本文提出了一种统一高效的点线特征提取器（UPAL），能够在一个轻量级架构中联合提取关键点、线段和特征描述符。该方法通过共享主干网络提供共同表示，并采用加速后处理阶段恢复线段，显著提升了计算效率。

Details

Motivation: 现有点线特征方法效率低下，需要分别检测点和线，使用复杂网络并依赖CPU限制的启发式方法，阻碍了实时性能。本文旨在解决多视图视觉流程中点线特征提取的低效问题。

Result: UPAL在点线应用中匹配或超越了最先进方法的性能，同时显著降低了计算成本，例如相比ALIKED + DeepLSD流程实现了4倍加速和10倍内存占用减少。

Insight: 创新点在于统一架构联合提取点线特征，以及高效的线段后处理变体；可借鉴之处包括共享表示设计和轻量化加速策略。

Abstract: Multi-view computer vision pipelines typically rely on accurate sparse keypoints and robust descriptors. While incorporating line features has shown clear benefits for matching and pose estimation, existing point-line approaches remain inefficient: they detect points and lines separately, use increasingly heavy networks, and depend on CPU-bound heuristics that hinder real-time performance. We introduce a Unified Efficient Points and Lines (UPAL) feature extractor that jointly extracts keypoints, line segments, and feature descriptors within a single lightweight architecture. A shared backbone provides common representations that feed different branches for point and line features. Line segments are recovered through an accelerated post-processing stage, an enhanced and highly efficient variant of the LSD algorithm. UPAL matches or exceeds state-ofthe-art performance in both point and line applications while significantly reducing computational cost, achieving, for instance, a 4x speedup and 10x smaller memory footprint over the ALIKED + DeepLSD pipeline. Code is publicly available at https://github.com/francois141/upal.

[41] AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures cs.CVPDF

Guoxing Sun, Heming Zhu, Linjie Lyu, Pascal Fua, Christian Theobalt

TL;DR: 本文提出AvatarDynamizer，一种生成式方法，可将现成的静态3D人体化身转化为可控、真实且多视角一致的4D动态化身。该方法通过新颖的纹理空间表面动态嵌入，将化身动态建模表述为条件纹理生成，并利用编码器-解码器表示将姿态相关动态嵌入动态纹理图，从而与预训练视频扩散模型兼容，同时解码为3D高斯以进行多视角一致渲染。

Details

Motivation: 现有的人体化身建模方法存在局限：与人物无关的方法（从单目图像、视频或文本提示恢复静态3D化身）的骨架驱动动画缺乏真实的表面动态（如衣物褶皱）；而人物特定方法虽能实现高质量渲染和真实动态，但需要对每个个体进行昂贵的多视角采集。近期可泛化的动态化身方法难以嵌入表面动态，导致多视角一致性或动态表现力受限。

Result: 实验表明，该方法能有效为静态化身添加逼真的表面动态动画，在视觉保真度上优于其他可泛化方法，尤其是在动态训练数据有限的情况下。

Insight: 主要创新点在于提出纹理空间表面动态嵌入，将动态建模转化为条件纹理生成问题，实现了与预训练视频扩散模型的兼容性和多视角一致渲染。此外，为弥补现有数据集在规模、序列长度和运动多样性上的不足，作者收集了一个大规模、长序列、覆盖多样骨骼运动和表面动态的多视角数据集。

Abstract: For full-body avatars, modeling surface dynamics is crucial for overcoming the uncanny valley and achieving perceptual realism. Person-agnostic methods recover static 3D avatars from monocular images, videos, or text prompts, but their skeleton-driven animations lack realistic surface dynamics such as clothing wrinkles. In contrast, person-specific methods achieve high-quality rendering and realistic dynamics, but require expensive multi-view captures for each individual. Recent generalizable dynamic avatar methods struggle to embed surface dynamics, leading to either limited multi-view consistency or dynamic expressiveness. To this end, we propose AvatarDynamizer, a generative method that transforms an off-the-shelf static 3D avatar into a controllable, realistic, and multi-view-consistent 4D avatar. We introduce a novel texture-space surface-dynamics embedding and formulate avatar dynamics modeling as conditional texture generation. Our encoder–decoder representation embeds pose-dependent dynamics into dynamic texture maps, enabling compatibility with pre-trained video diffusion models while decoding them into 3D Gaussians for multi-view consistent rendering. Since existing datasets are limited in scale, sequence length, or motion diversity, we collect a large-scale multi-view dataset with long sequences covering diverse skeletal motions and surface dynamics. Experiments show that our method effectively animates static avatars with faithful surface dynamics and outperforms competing generalizable methods in visual fidelity, especially under limited dynamic training data.

[42] From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City cs.CV | cs.LGPDF

Joan Perez, Giovanni Fusco

TL;DR: 本文提出并应用了增强版SAGAI工作流，这是一个利用视觉语言模型从谷歌街景图像中大规模评估街道景观质量的开源工具。该研究以法国尼斯东北郊区为案例，评估了与步行友好城市环境相关的关键指标，如人行道存在性、行人入口密度和植被覆盖。

Details

Motivation: 解决在大规模郊区及城郊区域评估街道景观质量的传统实地调查方法耗时耗力的问题，以支持步行友好的15分钟城市规划。

Result: 对数千个街道观测点进行分析，生成的地图显示，理想的街道景观质量仅存在于当前郊区街道的一小部分（主要在紧凑型开发区和传统郊区），而在住宅山区尤其缺乏。

Insight: 通过改进图像采集、地理一致的视图生成、支持多种VLM架构、基于共识的推理和集成分析环境，增强了原始框架，展示了当代视觉语言模型在支持大规模、可扩展、灵活且可解释的城市公共空间质量评估方面的潜力。

Abstract: Streetscape quality has become a central concern in contemporary urban planning, particularly within the framework of the pedestrian-friendly 15-minute city, where walkability and public-space quality are increasingly recognized as key determinants of urban performance. However, assessing streetscape qualities across large suburban and peri-urban territories remains challenging due to the time and resource demands of conventional field surveys. This paper presents a planning-oriented assessment of streetscape qualities in the north-eastern periphery of Nice (France) using the latest release of SAGAI (Streetscape Analysis with Generative AI), an open-source workflow that leverages vision-language models (VLMs) for large-scale streetscape analysis from Google Street View imagery. The new release addresses limitations of the original framework through improved image acquisition, geographically consistent view generation, support for multiple VLM architectures, consensus-based inference, and an integrated analytical environment. The workflow is applied to several thousand street-level observations to evaluate qualities relevant to pedestrian-friendly urban environments: sidewalk presence, pedestrian entrance density, and vegetation. The resulting maps reveal that the desired streetscape qualities characterize only a fraction of today’s suburban streetscapes, mainly in compact developments and traditional suburban faubourgs, while they are particularly lacking on residential hills. The analysis demonstrates the potential of contemporary VLMs to support urban diagnostics in extensive suburban territories where fieldwork would be prohibitively time-consuming. Beyond the case study, the paper illustrates how recent advances in vision-language models can contribute to evidence-based planning by enabling scalable, flexible, and interpretable assessments of urban public-space quality.

[43] Gravity-aware partially calibrated absolute pose estimation from affine- or rotation-covariant features cs.CVPDF

Marcus Valtonen Örnhag, Alberto Jaenal, Stefan Adalbjörnsson

TL;DR: 本文提出了一种利用IMU重力向量和特征局部几何信息进行部分标定绝对位姿估计的新方法，通过推导新的约束条件构建了两个高效求解器：基于单个仿射对应的UP1PfAC和基于两个旋转协变特征的UP2PfORI。与传统需要四个点对应的方法相比，这些求解器减少了样本需求和计算成本，并在大规模公共数据集上实现了快速准确的定位和焦距估计。

Details

Motivation: 传统位姿估计方法未能充分利用SIFT等特征描述符中嵌入的局部几何信息，且现有方法尚未将这种信息应用于部分标定（如焦距未知）的绝对位姿估计问题中。

Result: 在大型公共数据集上的评估表明，所提方法在定位和焦距估计方面实现了快速且准确的结果，达到了当前最优水平（SOTA）。

Insight: 创新点在于结合IMU提供的重力向量与特征诱导的局部几何（仿射对应或旋转协变特征），推导出新的约束以联合估计绝对位姿和焦距，从而减少了样本需求和计算复杂度，适用于现代RANSAC类框架。

Abstract: Inertial measurement units (IMUs) are now standard in most consumer devices, such as smartphones, drones, and extended reality (XR) headsets. By fusing visual and inertial data, localization systems gain significantly in speed and robustness compared to vision-only or IMU-only approaches. However, traditional pose estimation methods fail to utilize the local geometric information embedded in feature descriptors like SIFT. Recent work has proved the advantages of leveraging this information for relative and absolute pose estimation, but its application to partially calibrated absolute pose estimation remains unexplored. In this paper, we derive novel constraints for joint estimation of absolute pose and focal length, making use of a gravity vector obtained from IMU data and the feature-induced local geometry, which we use to construct two efficient solvers: UP1PfAC, that operates given a single affine correspondence and UP2PfORI, which requires two orientation-covariant features. Unlike traditional, semi-calibrated absolute pose methods requiring four point correspondences, our solvers benefit from fewer samples and lower computational cost, simplifying robust estimation in modern RANSAC-like frameworks. We evaluate the proposed solvers against the state-of-the-art on large-scale public datasets and demonstrate that our method achieves fast and accurate localization and focal length estimation.

[44] STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection cs.CVPDF

Jakub Micorek, Mateusz Koziński, Horst Possegger

TL;DR: STEP是一种基于骨架的视频异常检测框架，通过主成分分析将姿态序列投影到紧凑的PC空间，在该空间训练基于能量的模型以学习正常姿态分布，并引入基于置信度的序列级加权机制来缓解姿态估计误差。该方法在UBnormal数据集上达到90.1%的AUROC，超越先前SOTA 12.2%，并在ShanghaiTech基准上取得有竞争力的实时性能。

Details

Motivation: 解决现有基于能量的骨架异常检测方法中，直接对原始关节坐标加噪会导致物理上不可能的姿态结构崩溃问题，尤其是在处理长时序窗口时性能严重下降。

Result: 在UBnormal数据集上达到90.1%的AUROC，比先前骨架方法提升12.2%达到SOTA；在ShanghaiTech基准上也有显著提升，且保持实时计算效率。

Insight: 创新点包括：1) 通过PCA投影到物理合理的PC空间进行加噪训练，避免结构崩溃；2) 利用姿态估计器的置信度分数进行序列级加权，增强对遮挡/运动模糊的鲁棒性；3) 轻量框架实现长序列处理与实时性能的平衡。

Abstract: Skeleton-based Video Anomaly Detection (VAD) offers a robust, privacy-preserving solution for identifying abnormal behaviors. To model the distribution of normal static and moving poses, recent methods train Energy-Based Models (EBMs) via Denoising Score Matching (DSM). However, directly injecting noise, required for training, into raw joint coordinates creates physically impossible poses, and this structural collapse severely worsens as the temporal window expands. To address this, we introduce STEP, a simple framework that utilizes Principal Component Analysis (PCA) to project pose sequences into a compact, whitened PC-space. Learning the data density within this well-behaved PC-space ensures that the injected noise translates into physically plausible variations, which allows the model to process longer video sequences without the performance collapse of raw coordinate baselines. Additionally, to mitigate inherent pose estimation inaccuracies arising from occlusions or motion blur, we integrate a sequence-level weighting mechanism based on the estimator’s confidence scores. Operating at real-time computational efficiency, our simple and lightweight framework outperforms the previous skeleton-based state-of-the-art by 12.2% (90.1% AUROC) on the challenging UBnormal dataset and achieves highly competitive results by improving on the ShanghaiTech benchmark.

[45] V-REX: Efficient Specialist VLM Training for Veterinary X-Rays cs.CVPDF

Tim Elsner, Nicole McNally, Andre Dourson, Michael Fitzke

TL;DR: 本文提出V-REX，一种专为兽医X光片设计的视觉语言模型。通过重新设计整个VLM流程，包括文本分词、预训练、对齐和推理，该方法仅用少量参数、数据和计算资源，就能从头训练出超越大型基础模型的专家模型，并首次实现为兽医X光片生成诊断报告。

Details

Motivation: 针对通用视觉语言模型训练成本高昂的问题，本文挑战了领域专家模型必须微调大型基础模型的普遍假设，旨在为兽医放射学这一特定领域高效构建高性能的视觉语言模型。

Result: 在兽医X光片诊断报告生成任务上，V-REX显著超越了现有的开源基础模型，实现了优越的下游性能。

Insight: 创新点在于对整个VLM流程（文本分词、预训练、对齐）的重新思考和工程优化，提出了新的生成式预训练和对齐策略，从而在资源有限的情况下大幅提升了训练效率和数据利用率，证明了领域专家模型可以不依赖大型基础模型从头高效训练。

Abstract: While generalist VLMs are expensive to train, creating domain experts is widely assumed to require fine-tuning increasingly large foundation models. We show that, in veterinary radiology, this assumption is misguided. By rethinking the entire VLM pipeline - from text tokenisation and pre-training to grounding and inference - we demonstrate that careful engineering can yield models that outperform much larger foundation models from scratch, without relying on any other data. Our approach introduces new strategies for generative pre-training and grounding that improve training efficiency, increasing data utilisation and downstream performance. Using only a fraction of the parameters, data, and compute of contemporary generalist models, we develop the first VLM capable of generating diagnostic reports for veterinary radiographs, surpassing open foundation models on this task by significant margin.

[46] BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal cs.CVPDF

Yigit Ekin, Enes Sanli, Aykut Erdem, Erkut Erdem, Aysegul Dundar

TL;DR: 本文提出了BeyondMasks基准数据集和CORE评估协议，旨在系统性地评估视频物体移除任务中的因果与物理一致性，而不仅仅是掩码区域的保真度。该基准包含成对的合成与真实世界视频，覆盖多种物理交互，并揭示当前先进方法在移除物体引发的次级物理效应（如阴影、反射）方面存在系统性缺陷。

Details

Motivation: 现有视频物体移除的评估主要关注掩码区域的修复质量，将其视为局部修复任务，忽略了移除物体作为一个因果干预行为，也需要消除其引发的物理效应（如阴影、反射、动态痕迹等）。现有基准缺乏对齐的干净参考视频或局限于简化合成场景，无法系统评估因果一致性。

Result: 在提出的BeyondMasks基准上对现有先进方法进行评测，结果显示尽管它们在掩码区域保真度上得分很高，但在移除次级物理效应方面存在系统性失败，暴露了视觉合理性与因果正确性之间的差距。

Insight: 创新点在于将视频物体移除重新定义为因果场景一致性任务而非局部重建，并为此提供了一个包含多样化物理交互的配对基准数据集和一个基于结构化视觉语言模型（CORE）的联合评估协议，该协议能同时衡量物体消失和后续效应一致性，比现有指标更贴近人类判断。

Abstract: Recent advances in generative video models have significantly improved visual realism in video object removal, yet evaluation protocols still focus on masked region fidelity, treating removal as local inpainting. In real scenes, object removal is a causal intervention: eliminating an object also requires removing its induced physical effects, such as shadows, reflections, illumination changes, translucency, and dynamic traces. Existing benchmarks lack aligned clean references or remain limited to simplified synthetic settings, preventing systematic evaluation of causal consistency. We introduce BeyondMasks, a paired benchmark for causally consistent video object removal, consisting of temporally aligned synthetic and real world video pairs with clean background references. The dataset spans diverse photometric, geometric, volumetric, and dynamic interactions, and supports both mask based and instruction driven editing. We further propose CORE, a structured vision language model based evaluation protocol that jointly measures object disappearance and after effect consistency, aligning more closely with human judgments than existing metrics. Benchmarking state of the art methods reveals systematic failures in removing secondary physical effects despite high masked region fidelity, exposing a gap between visual plausibility and causal correctness. BeyondMasks reframes video object removal as causal scene consistency rather than local reconstruction and provides a unified framework for its evaluation.

[47] ID-VTG: Image-Disambiguated Video Temporal Grounding cs.CVPDF

Minghang Zheng, Jingli Wei, Hongyi Yang, Yang Liu

TL;DR: 本文提出了图像消歧视频时序定位（ID-VTG）任务，旨在利用包含参考图像和文本描述的多模态查询，在视频中精确定位特定实例执行描述动作的片段。为解决该任务，作者构建了IDVTG-Gym和IDVTG-InternVid两个基准数据集，并提出了基于双分支快慢架构的视觉引导消歧聚合（VGD-Agg）框架，通过引入可学习的比较令牌和抑制值来增强模型对相似实体的区分能力。

Details

Motivation: 解决传统视频时序定位（VTG）在查询需要区分涉及视觉相似实体的多个事件时面临的挑战，特别是当依赖难以仅用文字准确描述的细粒度视觉属性时。

Result: 在提出的IDVTG-Gym和IDVTG-InternVid基准上进行了广泛实验，所提方法取得了最先进的（SOTA）结果。

Insight: 创新性地引入了图像作为消歧信息源，构建了多模态查询任务；提出了VGD-Agg框架，其双分支（快/慢）设计兼顾效率与精度，并利用可学习的比较令牌和抑制值来显式建模负样本和无关事件，从而增强模型在复杂场景下的判别能力。

Abstract: Video Temporal Grounding (VTG) faces significant challenges when natural language queries must distinguish between multiple events involving visually similar entities, particularly when relying on fine-grained visual attributes that are difficult to describe accurately in words alone. To address this, we introduce Image-Disambiguated Video Temporal Grounding (ID-VTG), a task that leverages multimodal queries combining a reference image and a text description to precisely localize segments where a specific instance performs a described action. To facilitate research, we construct two benchmarks: IDVTG-Gym, focusing on fine-grained, compositionally ordered gymnastics actions with athletes in similar uniforms; and IDVTG-InternVid, an open-world dataset featuring diverse entities (e.g., humans, animals, fictional characters) and significant temporal distractors. Methodologically, we propose the Visually-Guided Disambiguation Aggregation (VGD-Agg) framework based on a dual-branch fast-slow architecture. The fast branch efficiently generates preliminary event proposals, while the slow branch performs fine-grained frame-level matching between video frames and the reference image. We enhance discriminability via two learnable tokens: a Compare Token, which represents hard negatives to probe for the presence of the target instance (as referred to by the query image), and a Depress Value, which represents text-irrelevant events. Proposals that the Compare Token identifies as lacking the target instance are pushed toward the Depress Value, thus easing disambiguation via the text query. Extensive experiments validate our approach, which achieves state-of-the-art results on the proposed benchmarks. Code is available at https://github.com/oceanflowlab/ID-VTG.

[48] ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation cs.CVPDF

Linhan Cao, Siyuan Li, Jun Lan, Liangbo He, Guannan Li

TL;DR: 本文提出了一种名为ArmorOCR的两阶段训练框架，旨在提升大型多模态模型（LMMs）对对抗性视觉文本（人类可读但模型难以定位和识别）的鲁棒感知能力。为此，作者首先构建了首个用于评估对抗性OCR的基准数据集AdvSpot，包含390张图像及区域级标注。ArmorOCR通过策略内自蒸馏（OPSD）从特权变换观测中学习缺失的对抗性OCR感知，并利用任务条件奖励的组相对策略优化（GRPO）来精确定位、识别和视觉问答（VQA）能力。

Details

Motivation: 现有大型多模态模型在OCR识别方面表现出色，但容易受到对抗性视觉文本的攻击，而现有的OCR基准主要关注自然或文档风格文本，缺乏针对对抗性OCR的大规模、任务覆盖全面且具有区域感知的评估基准。

Result: 在作者构建的AdvSpot基准、其他对抗性OCR基准以及通用OCR基准上的实验表明，ArmorOCR能够持续提升对抗性OCR的感知能力，同时保持有竞争力的通用OCR性能。

Insight: 论文的创新点在于将对抗性OCR形式化为一个“基于定位的OCR感知”任务，并构建了首个综合性评估基准AdvSpot。提出的ArmorOCR框架通过结合策略内自蒸馏（OPSD）和组相对策略优化（GRPO），利用任务条件奖励进行多目标优化，有效提升了模型对复杂对抗性文本的鲁棒性，这一两阶段自蒸馏与强化学习结合的思路具有借鉴意义。

Abstract: Large multimodal models (LMMs) have demonstrated strong OCR recognition capabilities, yet remain vulnerable to adversarial visual text that is readable to humans but challenging for models to localize and recognize. Existing OCR benchmarks mainly focus on natural or document-style text, while adversarial OCR evaluations remain limited in scale, task coverage, or region-aware evaluation. In this paper, we formulate adversarial OCR as a \textbf{grounded OCR perception} task and introduce \textbf{AdvSpot}, the first benchmark for grounded adversarial OCR evaluation. AdvSpot comprises 390 images with region-level annotations, spanning 5 primary categories and 13 fine-grained adversarial OCR types. To address this challenge, we propose \textbf{ArmorOCR}, a two-stage training framework for robust adversarial OCR perception. ArmorOCR first acquires missing adversarial OCR perception from privileged transformed observations through On-Policy Self-Distillation (OPSD), and then refines grounded OCR perception through Group Relative Policy Optimization (GRPO) with task-conditioned rewards for localization, recognition, full spotting, and visual question answering (VQA). Experiments on our AdvSpot, other adversarial OCR benchmarks, and general OCR benchmarks demonstrate that ArmorOCR consistently improves adversarial OCR perception while preserving competitive general OCR capability.

[49] Feature Evolution and Migration during Vision Transformer Training cs.CV | cs.LGPDF

Joonas Järve, Halil Ibrahim Aysel, Tarun Khajuria, Meelis Kull

TL;DR: 本文提出了一种可视化视觉Transformer（ViT）训练过程中特征演化的新视角，通过稀疏自编码器（SAE）从CLS令牌表示中提取稀疏特征，并比较它们在网络深度（层）和训练时间（轮次）两个维度上的激活模式，从而研究特征层面的动态变化。

Details

Motivation: 动机在于揭示ViT训练过程中特征层面的动态演化，这些变化无法直接从表示层面的相似性度量中观察到，旨在理解ViT如何学习和演化。

Result: 实验表明，特征迁移主要集中在训练早期，更常向浅层迁移而非深层，且随着特征组织稳定而减少；深层比浅层更早、更稳定地稳定下来。

Insight: 创新点在于提出了一个结合深度和训练时间的二维可视化框架来研究特征演化和迁移，这为理解ViT的学习机制提供了新工具，并揭示了特征稳定性的层间差异。

Abstract: We present a novel view on feature evolution in Vision Transformers (ViTs) by visualizing the training process over two dimensions – network depth (layer) and training time (epochs). We employ Sparse Autoencoders (SAEs) to extract candidate sparse features from CLS-token representations and compare their activation profiles across epoch–layer pairs. This allows us to study feature-level dynamics that are not directly visible from representation-level similarity measures. Furthermore, we demonstrate how this framework of feature evolution allows us to describe feature migration, the change in the layer where a feature is most detectable during training. Our experiments show that migration is concentrated early in training, occurs more often toward earlier layers than toward deeper layers, and declines as feature organization stabilizes. We further find that deeper layers stabilize earlier and more strongly than shallow layers. The results show that our approach can be employed as a tool for understanding how ViTs learn and evolve.

[50] DPC-Net: Dual-Prior Collaborative Network for All-in-One Image Restoration cs.CVPDF

Zhaokun He, Kangbiao Shi, Axi Niu, Jian Jin, Peng Wu

TL;DR: 本文提出了一种名为DPC-Net的双先验协同网络，用于解决一体化图像恢复（AiOIR）任务。该网络通过联合利用退化-语义耦合先验和低层次视觉先验，旨在克服现有方法在退化建模中忽视图像语义、在重建中缺乏低层次先验所导致的结构扭曲和语义不一致问题。

Details

Motivation: 现有的一体化图像恢复方法在退化建模时往往忽略图像语义信息，并且在重建阶段缺乏低层次视觉先验的引导，这导致了恢复结果出现结构失真和语义不一致。

Result: 在多个图像恢复基准测试上的广泛实验表明，DPC-Net的性能优于当前最先进的一体化图像恢复方法。

Insight: 核心创新点在于提出了一个双先验协同框架：1）通过视觉语言模型监督退化感知网络，将图像语义信息引入退化模式的编码，形成退化-语义耦合先验；2）在解码阶段，通过知识库提供低层次视觉先验，并由双先验协同重建模块整合两种先验信息，从而在去除退化的同时更好地保持图像结构和语义保真度。

Abstract: All-in-One Image Restoration (AiOIR) aims to handle diverse degradations within a unified model. However, existing methods often overlook image semantics in degradation modeling and lack low-level visual priors during reconstruction, leading to structural distortions and semantic inconsistencies. To address these issues, we propose a novel Dual-Prior Collaborative Network (DPC-Net), which achieves high-quality restoration by jointly exploiting degradation-semantic coupled priors and low-level visual priors. Specifically, degraded images are fed into a Degradation-Aware Network (DAN) to extract degradation-semantic coupled features. To this end, a Vision-Language Model (VLM) supervises DAN by constraining its features distribution, introducing image semantics into the encoding of degradation patterns. A Degradation-Semantic Modulation Module (DSMM) further translates this guidance into degradation-semantic coupling and propagates coupled representations to the decoder. During decoding, knowledge bases provide low-level visual priors, and the Dual-Prior Collaborative Reconstruction Module (DPCR) integrates dual-prior information to guide degradation removal while preserving structure and semantics, producing high-fidelity restored images. Extensive experiments on multiple restoration benchmarks demonstrate that DPC-Net achieves superior performance against state-of-the-art AiOIR methods.

[51] G3Ego: Gaze-Guided Graphs for Egocentric Action Understanding cs.CVPDF

Marko Haralović, Akash Ramakrishnan, Estefania Talavera Martinez

TL;DR: 论文提出了G3Ego，一个基于图的自中心动作理解框架。它利用穿戴者的注视作为结构线索，从稀疏采样的视频帧中构建动作场景图，并通过注视信息剪枝无关实体，生成专注于手-物交互的高效、可解释的图表示，用于动作识别与预测。

Details

Motivation: 解决自中心动作理解中，许多第一人称动作仅依赖于少数手-物交互和少量相关实体，而现有大型视频模型依赖计算昂贵的视频预训练且可能包含无关信息的问题。

Result: 在EGTEA Gaze+和MECCANO数据集上的实验表明，G3Ego取得了与基于视频的方法相当的性能，并在类别不平衡评估下持续提升了Macro-F1分数，同时避免了依赖计算昂贵的视频预训练。

Insight: 核心创新在于将注视直接整合到图构建过程中，作为识别和剪枝动作相关实体的结构线索，而非仅作为辅助模态或注意力信号，从而生成更高效、可解释的表示。该方法避免了繁重的视频预训练，专注于关键交互。

Abstract: Egocentric action understanding is often addressed using large video models pretrained on extensive exocentric datasets. However, many first-person actions depend on a small number of hand-object interactions involving only a few relevant entities. We propose G3Ego, a graph-based framework for egocentric action understanding that uses gaze as a structural cue to identify action-relevant entities in the scene. From sparsely sampled frames, G3Ego constructs action scene graphs from vision-language descriptions, grounded objects, and hand cues, and then prunes irrelevant entities using the camera wearer’s gaze. The resulting graph embeddings are temporally aggregated for action recognition and anticipation. Unlike prior work that uses gaze primarily as an auxiliary modality or attention signal, G3Ego incorporates gaze directly into graph construction, producing efficient and interpretable representations focused on action-relevant interactions. Experiments on EGTEA Gaze+ and MECCANO show that G3Ego achieves competitive performance compared with video-based approaches and consistently improves Macro-F1 under class-imbalanced evaluation, while avoiding reliance on computationally expensive video pretraining. These results demonstrate the effectiveness of gaze-guided graph representations for egocentric action understanding.

[52] RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation cs.CVPDF

Shaoxuan Wang, Guangting Zheng, Rui Huang, Zhipeng Tang, Sha Zhang

TL;DR: RoMAN-Flow是一个用于机器人操作的离线强化学习框架，旨在解决自回归归一化流（AR-NF）策略在采样效率上的瓶颈。它通过一个免采样的优势加权似然目标进行策略优化，并将优化后的自回归策略蒸馏为一步动作生成器，从而在保持竞争力的同时大幅降低推理延迟。

Details

Motivation: 现有的扩散和流匹配机器人策略缺乏易处理的似然，限制了它们在基于似然的离线RL训练后处理中的应用；而AR-NF虽能提供精确似然评估，但其顺序采样在策略优化和部署阶段带来了显著的采样开销。

Result: 在多个模拟操作基准测试和真实世界机器人平台上的实验表明，RoMAN-Flow实现了具有竞争力的策略性能，同时显著降低了推理延迟。

Insight: 创新点在于提出了一个免采样的优势加权似然目标来优化策略，避免了自回归策略的采样开销，并通过蒸馏将自回归策略转化为一步生成器以实现高效部署，这为将精确似然模型应用于实时机器人控制提供了实用方案。

Abstract: Offline reinforcement learning improves robotic policies using previously collected data without further environment interaction. Yet prevalent diffusion- and flow-matching robot policies lack tractable likelihoods, limiting their use in likelihood-based offline RL post-training. AR-NFs offer both expressive action modeling and exact likelihood evaluation, but their sequential sampling incurs substantial sampling overhead during policy optimization and deployment. We present RoMAN-Flow (Robotic Manipulation with Autoregressive Normalizing Flows), an offline reinforcement learning framework that makes AR-NF policies practical for robotic manipulation by addressing this sampling bottleneck in both stages. During policy optimization, RoMAN-Flow employs a sampling-free, advantage-weighted likelihood objective that assigns higher likelihood to high-advantage actions from the offline dataset without sampling from the autoregressive policy. For efficient deployment, it distills the optimized autoregressive policy into a one-step action generator, enabling low-latency action prediction. Experiments across multiple simulated manipulation benchmarks and real-world robotic platforms demonstrate that RoMAN-Flow achieves competitive policy performance while substantially reducing inference latency. Code is available at https://github.com/konnyaku28/RoMAN-Flow.

[53] Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal cs.CVPDF

Radim Spetlik, David Futschik, Radek Danecek, Feitong Tan, Ziqian Bai

TL;DR: 本文提出了一种基于物理模拟的视频眼镜移除新方法，通过结合生成先验与物理光学模拟来生成高质量配对数据，并设计JFSnet网络进行修复，在保持身份、表情和姿态的同时提升时间一致性与高频细节。

Details

Motivation: 视频眼镜移除面临复杂折射畸变和镜面反射的挑战，现有生成先验方法缺乏结构约束，导致身份漂移和时序不一致问题。

Result: 在FFHQ子集（12,163张图像）上实现了高保真度和结构准确性，推理速度达27.68 FPS；在CelebV-Text视频序列的感知研究中，在眼部一致性、时间稳定性和整体修复质量上均优于扩散模型和GAN基线。

Insight: 创新点包括：通过三阶段结构过滤正则化生成先验以保持身份属性，结合物理光学模拟生成多样化配对数据，以及设计联合特征-空间网络（JFSnet）利用平移等变性约束提升时序一致性。

Abstract: High-fidelity removal of eyeglasses from video is a major challenge in facial attribute editing, as the underlying facial geometry is often obscured by complex refractive distortions and view-dependent specular reflections. While large-scale generative priors have shown promise in eye-glasses removal via static image inpainting, they often lack the structural constraints necessary to maintain identity, expression, and pose, leading to visible “identity drift” in both static images and dynamic sequences. In this paper, we propose a novel transfer framework that addresses the stochastic nature of generative priors. Our pipeline first extracts high-fidelity synthetic face images from a commercial-grade generative model (Nano Banana, Gemini 3 Pro Image), regularizes them via a three-stage structural filtering process to preserve identity, expression, and pose, and finally applies physically-based simulation of lens optics during training to provide diverse, paired data. This process transfers Nano Banana’s photo-realistic, multi-view knowledge into a specialized restoration architecture, JFSnet (Joint Feature-Spatial network). JFSnet integrates DINOv2-based semantic features with a convolutional decoder for spatial reconstruction, leveraging translation equivariance constraints to improve temporal consistency and high-frequency detail preservation. Evaluations on the curated Flickr-Faces-HQ (FFHQ) subset (12,163 images) show that our approach achieves high fidelity and structural accuracy, while maintaining inference speed of 27.68 FPS. In perceptual studies on CelebV-Text video sequences, our results are consistently preferred over diffusion and GAN-based baselines for ocular consistency, temporal stability, and overall restoration quality.

[54] Artificial Intelligence for Workflow Analysis in Colorectal Surgery: A Multicentric, Cross-Procedural Development and Generalization Study cs.CVPDF

Pietro Mascagni, Julia Alekseenko, Pooja P Jain, Marta Goglia, Andrea Balla

TL;DR: 本研究提出了AI-ColoWorkflow，一个用于结直肠微创手术（MIS-CRS）自动工作流分析的深度学习模型。该模型结合了微调的DINOv3视觉Transformer进行逐帧视觉特征提取，以及一个分层的多阶段时间卷积网络，联合优化用于手术阶段和步骤识别。研究使用来自多个中心和公开数据集的视频进行训练和评估，发现基于多中心、多手术类型数据训练的单一全局模型在阶段识别上通常优于特定中心或特定手术类型的模型。

Details

Motivation: 结直肠微创手术存在显著的变异性和结果不一致性，现有的基于视频的评估工具（ColoWorkflow）虽然有效，但手动分析耗时费力，限制了其广泛应用。因此，本研究旨在开发一个自动化的AI模型来高效分析手术工作流。

Result: 在保留测试集上，AI-ColoWorkflow模型在手术阶段识别上取得了73.01% ± 10.27的宏F1分数（平衡准确率73.43%），在步骤识别上取得了39.82% ± 7.06的宏F1分数（平衡准确率38.65%）。在泛化分析中，阶段识别的平均F1分数为48.42%。该全局模型在大多数实验中优于特定中心或特定手术类型的模型，但在步骤识别上，特定手术类型的模型对某些手术类型仍有优势。

Insight: 论文的创新点在于提出了一个结合了先进视觉Transformer（DINOv3）和分层时间建模网络的架构，用于联合识别手术的阶段和步骤。一个关键的客观发现是，使用多中心、多手术类型混合数据训练的单一模型在阶段识别任务上具有良好的泛化能力，这挑战了为每个中心或手术类型单独训练模型的传统思路，并提示未来可以探索混合训练策略以平衡通用性与特异性。

Abstract: Minimally invasive colorectal surgeries (MIS-CRS) are characterised by significant variability and inconsistent outcomes. ColoWorkflow, a tool for the video-based assessment (VBA) of MIS-CRS workflow, was recently validated. However, manual VBA is time-consuming, limiting implementation. This study presents AI-ColoWorkflow, a deep learning model for automated surgical workflow analysis across MIS-CRS. Operative videos of MIS-CRS were collected from 4 centres and a publicly available dataset. Phases and steps were manually annotated according to ColoWorkflow. A deep learning model combining a fine-tuned DINOv3 vision transformer for per-frame visual feature extraction with a hierarchical multi-stage temporal convolutional network was jointly optimized for phase and step recognition. The model trained on pooled multicentric data, namely AI-ColoWorkflow was compared against centre-specific and procedure-specific models on a held-out test set. The following metrics were used for evaluation: macro F1 score, balanced accuracy, precision, and recall. AI-ColoWorkflow achieved a macro F1 of 73.01% $\pm$ 10.27 (balanced accuracy 73.43%) for phase recognition and 39.82% $\pm$ 7.06 (balanced accuracy 38.65%) for step recognition. The global model outperformed centre- and procedure-specific models in most experiments except procedure-specific step recognition. In the generalization analysis, mean F1 was 48.42% for phase recognition. AI-ColoWorkflow can reliably recognize MIS-CRS phases. A single model trained on pooled, multicentric, multi-procedural data generalises at least as well as and often better than centre- or procedure-specific models for phase recognition in MIS-CRS, while procedure-specific step models retain advantages for certain procedure types, motivating hybrid training strategies for future surgical AI development.

[55] Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning cs.CV | cs.ROPDF

Weiliang Huang, Huanrong Liu, Bob Zhang, Qi Dou, Zhen Chen

TL;DR: 本文提出了一种用于手术运动规划的联合视觉-轨迹预测模型，旨在同时预测未来手术场景的视觉状态和手术器械的运动轨迹。该模型通过编码历史视频帧和工具轨迹，利用时空编码器和分离的解码头进行联合预测，并采用分块自回归展开策略来生成多步预测。

Details

Motivation: 现有方法通常将未来场景生成和器械轨迹预测视为两个独立任务，导致无法在轨迹层面评估运动准确性，也无法捕捉器械运动带来的视觉变化，从而忽视了预测轨迹与未来场景演变之间的一致性。

Result: 在评估的所有时间范围内，分块策略均优于直接一步预测，将第一段的PSNR从18.86提升至23.11 dB，并将ADE从45.77降低至22.22像素，证明了联合视觉-运动预测的初步可行性。

Insight: 创新点在于首次提出联合预测手术视觉状态和器械轨迹的模型，通过分块自回归展开策略改善了多步预测性能，但长时预测中的视觉质量退化和轨迹误差累积仍是未来手术世界-动作建模的重要挑战。

Abstract: Reliable surgical planning requires models to anticipate not only how instruments will move, but also how the operative visual state will evolve together with such motion. Existing approaches typically treat future scene generation and instrument trajectory prediction as two separate tasks. Scene-only models cannot directly evaluate the accuracy of future instrument motion at the trajectory level, while trajectory-only models fail to capture the visual consequences of instrument movement, leaving the consistency between predicted trajectories and future scene evolution unaddressed. Jointly forecasting both provides a more complete account of surgical action-scene dynamics by enabling explicit trajectory-level evaluation while simultaneously modeling the corresponding visual evolution. To bridge this gap, we present a preliminary joint visual-trajectory world-action model that simultaneously forecasts future visual states and instrument trajectories from historical surgical observations. Specifically, we encode historical video frames and tool trajectories into latent representations, which are processed by a temporal-spatial encoder and subsequently decoded through separate visual-state and trajectory prediction heads. Based on this preliminary architecture, a chunked autoregressive rollout is repeatedly applied to predict fifteen future steps. The chunked strategy consistently outperforms direct one-shot prediction across all evaluated horizons, improving first-segment PSNR from 18.86 to 23.11 dB and reducing ADE from 45.77 to 22.22 pixels. These results demonstrate the initial feasibility of joint visual-motion forecasting. However, we observe progressive visual degradation and accumulated trajectory errors over longer prediction horizons, which remain important challenges for future surgical world-action modeling.

[56] DreamHand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery cs.CVPDF

Yufei Liu, Xixi Wang, Hao Li, Ganlong Zhao, Kaitong Cai

TL;DR: DreamHand提出了一种离线视频级框架，通过将视频扩散模型（VDM）重新用作确定性几何编码器，从以自我为中心的视频中恢复连续的双手机器人三维运动轨迹。该方法利用确定性干净潜在编码器提取特征，并通过双向时空解码器解码，能够处理严重遮挡和手部离开视野的情况，无需外部检测器即可恢复度量放置的轨迹。

Details

Motivation: 现有单帧和窗口时序回归方法在自我中心视频中手部短暂离开画面时失效，而视频扩散模型作为像素空间渲染器依赖繁重的随机多步采样。论文旨在解决严重物体遮挡和频繁视野外间隙导致的度量三维手部轨迹恢复挑战。

Result: 在五个自我中心基准测试中，DreamHand达到了新的最先进水平：在遮挡严重的ARCTIC上将MPJPE-p降低了30%，在HOT3D上降低了40%；当评估包括视野外手部时，这些增益达到46%-61%。

Insight: 创新点在于将视频扩散模型重新用作确定性几何编码器，通过单次前向传播在干净潜在空间中暴露超出当前观察的场景内容（包括遮挡和视野外的手部），并提出了无需测试时相机内参的基于光线的相机求解器配置，为从日常人类视频到机器人操作数据的可扩展路径提供了新方法。

Abstract: Egocentric video offers scalable manipulation data for embodied AI, yet recovering metric 3D hand trajectories remains challenging due to severe object occlusion and frequent out-of-sight gaps. Existing single-frame and windowed temporal regressors fail when hand shortly leaves the frame, while recent video diffusion models (VDMs) rely on heavy, stochastic multi-step sampling as pixel-space renderers. We instead repurpose VDM into a deterministic geometry encoder. A single forward pass over the clean latent exposes scene content beyond current observations, including occluded and out-of-sight hands. We introduce DreamHand, an offline clip-level framework that extracts features via a Deterministic Clean-Latent Encoder and decodes them with a Bidirectional Spatiotemporal Decoder. DreamHand recovers continuous bimanual trajectories with metric placement and no external detector, while a Ray-Based Camera Solver supports a second configuration that needs no test-time camera intrinsics. Across five egocentric benchmarks, DreamHand sets a new state of the art, cutting MPJPE-p by 30% on occlusion-heavy ARCTIC and 40% on HOT3D. These gains reach 46%-61% once out-of-sight hands are included in the evaluation, offering a scalable path from everyday human video to robot manipulation data.

[57] Swift-Image: Exploring the Performance Frontier of Compact Unified Image Generation Models cs.CVPDF

Taihang Hu, Zhao Wang, Zuan Gao, Tao Liu, Hao Yan

TL;DR: Swift-Image是一个紧凑的统一图像生成模型，支持文生图、单图编辑和多图编辑。它采用高效的6B单流DiT架构和渐进式训练流程，并通过专家强化学习、多教师策略蒸馏和提示增强器来提升性能。研究还探索了模型压缩，生成了3B和加速变体，在有限计算预算下达到了开源模型的领先性能。

Details

Motivation: 探索在有限的计算预算下，通过系统的训练工程，一个相对较小的视觉生成器（6B参数）的性能极限，以实现文本到图像生成和图像编辑的统一。

Result: 在评估的开源模型中，6B参数的Swift-Image取得了领先的综合性能（训练耗时243K GPU小时）；压缩后的3B模型性能几乎没有损失，而少步蒸馏变体在显著减少采样步数的同时进一步提升了综合编辑性能。

Insight: 创新点包括：采用渐进式训练流程（从广泛语义覆盖到高分辨率/高质量/统一监督）、并行专家强化学习与多教师策略蒸馏的后训练方法以缓解多目标干扰、以及通过提示增强器将用户请求解耦为生成器对齐的视觉规范。研究还总结了架构、数据课程、后训练、提示增强和模型压缩的实用经验。

Abstract: We present Swift-Image, a compact unified model for text-to-image generation, single-image editing, and multi-image editing. Our goal is to explore how far a relatively small visual generator can be pushed through systematic training engineering under a constrained computational budget. Swift-Image adopts an efficient 6B single-stream DiT and a progressive training pipeline that evolves from broad semantic coverage to higher resolution, stronger visual quality, and unified generation-editing supervision. For post-training, we employ parallel expert reinforcement learning followed by multi-teacher on-policy distillation to alleviate interference among heterogeneous objectives. We further decouple high-level reasoning from pixel-level rendering with a Prompt Enhancer that translates user requests into generator-aligned visual specifications. For efficient deployment, structural pruning and few-step distillation produce 3B and accelerated variants. Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps. Our study also summarizes practical lessons for architecture, data curriculum, post-training, prompt enhancement, and model compression.

[58] Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis cs.CVPDF

Liang Xu, Chengqun Yang, Zili Lin, Xintao Lv, Yichao Yan

TL;DR: 本文提出了Inter-X++，一个用于多模态人-人交互分析的大规模综合基准数据集，以及一个统一的表示与建模框架OpenHHI。该数据集通过新型混合动作捕捉系统采集，包含超过1.1万个高保真交互序列和810万帧数据，提供了全身运动、手部细节及丰富的多模态标注。基于此，研究构建了涵盖生成与感知范式的四类下游任务统一测试平台，并提出了OpenHHI框架，实验证明其在各项任务上均达到最先进性能。

Details

Motivation: 现有的人-人交互数据集和建模方法存在保真度低、忽略灵巧手部动作、缺乏多模态标注以及评估协议不一致等问题，阻碍了智能数字人系统的公平严谨评估与发展。

Result: 在Inter-X++基准上进行的广泛实验表明，所提出的OpenHHI框架在生成和感知任务上均取得了最先进的性能。

Insight: 创新点在于构建了一个包含高保真全身与手部运动、多层次语义标注（如文本描述、交互类别、因果顺序、关系、个性及接触图）的大规模多模态交互数据集，并提出了一个统一的表示与建模框架，成功桥接了交互的理解与生成任务，同时标准化了交互表示和评估协议以消除基准测试的模糊性。

Abstract: The capability to perceive and synthesize human-human interactions is fundamental to developing intelligent digital human systems. However, existing datasets and modeling approaches are fundamentally constrained by low-fidelity kinematics, the omission of dexterous hand gestures and a severe lack of rich multimodal annotations. Furthermore, fragmented interaction representations and inconsistent evaluation protocols also impede fair and rigorous benchmarking. To systematically address these bottlenecks, we present Inter-X++, a comprehensive and large-scale benchmark designed to empower versatile HHI analysis. Captured via a novel hybrid motion capture system, Inter-X++ provides 11,388 high-fidelity interaction sequences and over 8.1M frames, featuring precise whole-body movements and detailed finger articulations. Meanwhile, we enrich the data foundation with multifaceted annotations, including hierarchical fine-grained textual descriptions, interaction categories, causal interaction orders, the relationship and personality of the subjects, as well as vertex-level contact maps and physically regularized constraints. Leveraging these elaborate annotations, we formulate a unified testing ground comprising four categories of downstream tasks that symmetrically span both generative and perceptive paradigms. To eliminate benchmarking ambiguities, we systematically standardize the interaction representations and evaluation protocols. Finally, we go beyond dataset construction to propose OpenHHI, a single and unified HHI representation and modeling framework that jointly optimizes interaction reconstruction and semantic understanding. Extensive experiments reveal that OpenHHI achieves state-of-the-art performance on both generation and perception tasks. This definitively proves that our unified representation successfully bridges interaction understanding and generation simultaneously.

[59] 4DAnyone: Create Anyone in 4D from a Casual Monocular Video cs.CVPDF

Yudong Jin, Tao Xie, Qihang Zhang, Zehong Shen, Zhen Xu

TL;DR: 4DAnyone是一个从单目视频重建4D人体的框架，通过生成重建质量的多视角一致视频，并将其提升为4D高斯溅射（4DGS）表示。该方法解决了现有相机控制视频扩散模型在生成大量目标视角时的一致性问题，并引入了参考上下文打包和目标上下文路由两项关键技术。

Details

Motivation: 现有方法在生成重建4DGS所需的大量目标视角时，由于注意力上下文有限，导致跨视角一致性差和全局结构漂移，无法满足高质量4D重建的需求。

Result: 在DNA-Rendering和DyMVHumans基准测试中，4DAnyone在新视角视频质量和下游4DGS重建方面均优于现有方法，并展现出鲁棒的野外泛化能力。

Insight: 创新点在于将多视角视频生成的一致性问题归结为有界注意力上下文问题，并提出RCP和TCR分别解决参考上下文增长和目标上下文分组隔离的瓶颈，实现了从单目视频到高质量4D人体重建的端到端流程。

Abstract: We present 4DAnyone, a framework for reconstructing 4D humans from an uncalibrated monocular video by generating reconstruction-grade multiview-consistent videos and lifting them into 4D Gaussian Splatting (4DGS). Existing camera-controlled video diffusion models synthesize plausible novel-view videos but fail to maintain consistency when scaled to the tens of target views required for 4DGS reconstruction. We identify this failure as a bounded-attention-context problem: when target views exceed the capacity of a single DiT forward pass, they must be split into groups, exposing two coupled bottlenecks. On the reference-context side, conditioning on all previously generated views grows as $O(N)$, weakening cross-view appearance guidance. On the target-context side, disjoint groups cannot directly exchange information, causing global structural drift. 4DAnyone addresses both bottlenecks with two complementary designs: Reference Context Packing (RCP) compresses growing reference views into a fixed-length mixed-resolution context with $O(1)$ reference-context complexity, while Target Context Routing (TCR) rotates target-view groupings during denoising to share context across groups at high-noise steps and stabilize details at low-noise steps. We further build the MVGameHuman dataset using our in-house game engine and combine it with light-stage and in-the-wild video datasets for training. Experiments on DNA-Rendering and DyMVHumans show that 4DAnyone outperforms prior methods in both novel-view video quality and downstream 4DGS reconstruction, with robust in-the-wild generalization. See our project page for video results and source code: https://4danyone.github.io.

cs.RO [Back]

[60] Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation cs.RO | cs.CV | cs.LGPDF

Prachi Garg, Steve Xing, Prahit Yaugand, Saurabh Gupta, Derek Hoiem

TL;DR: 本文提出了一种自监督微调方法，通过利用零样本VLA模型生成在线交互数据作为额外训练数据，以解决VLA模型在新机器人硬件上部署时因配置不匹配导致的性能下降问题。该方法旨在保持模型原有指令遵循和行为先验的同时，高效学习新技能，实现多任务操作策略。

Details

Motivation: 当前先进的视觉-语言-动作（VLA）模型（如π_{0.5}）在语义理解、指令遵循和任务行为方面表现优异，但部署到新机器人时，即使硬件配置与预训练存在微小不匹配，也会导致性能严重下降。直接使用领域专家数据微调会损害模型原有的通用能力，因此需要一种方法在适应新硬件的同时保留先验知识。

Result: 实验表明，该方法在真实ALOHA机器人和RoboTwin仿真基准测试中均取得成功，生成的策略能够继承零样本模型的先验任务、保持通用指令遵循能力，并以更高的样本效率从专家数据中学习新技能。

Insight: 创新点在于提出自监督生成在线交互数据作为微调辅助，这避免了依赖大量人工标注数据，实现了模型在新硬件上的高效适应而不丢失原有能力。从客观角度看，该方法为VLA模型的跨平台部署提供了一种数据高效的迁移学习思路，可推广到其他机器人学习场景。

Abstract: State-of-the-art vision-language-action (VLA) models such as $π_{0.5}$ exhibit strong semantic understanding, instruction following and task behavior. However, when deployed on new robots, even minor mismatches in hardware configuration relative to pretraining can cause severe performance drops. Finetuning the VLA on in-domain expert data from the new embodiment improves performance on the expert task but leads to a loss in its original instruction following and behavioral priors. In this paper, we propose a self-supervised method that generates online interaction rollouts from the zero-shot VLA as additional training data for finetuning. Our experiments show this finetuning scheme yields strong multi-task policies that, on the target robot, (1) inherit prior tasks distilled from the zero-shot model, (2) enable generalist instruction following, while (3) learning new skills from expert data with improved sample efficiency. We demonstrate the success of our approach across test sets probing generalization on a real ALOHA robot and a new simulation benchmark in RoboTwin. Video results are available at https://self-supervised-control.pages.dev/

[61] What Matters for Latent Actions in Robot Learning cs.RO | cs.CVPDF

Xizhou Bu, Qingda Hu, Lei Zhou, Lingfeng Zhang, Yingbo Tang

TL;DR: 本文首次对机器人操作中的潜在动作学习进行了全面的实证研究，通过统一的自动编码框架系统评估了41种潜在动作模型设计选择，并验证了使用潜在动作微调视觉语言模型主干能为下游策略学习提供更强初始化。

Details

Motivation: 现有潜在动作模型研究高度碎片化，在不同实验设置下孤立评估设计选择，难以确定真正影响下游机器人操作性能的关键因素。

Result: 在三个广泛使用的基准测试上进行大量实验，证明潜在动作微调视觉语言模型主干能显著提升下游策略学习性能，并在真实世界机器人操作任务中得到验证。

Insight: 提出了统一的潜在动作学习评估框架，系统分析了建模范式、学习目标、正则化方法和集成策略等维度，并检验了四种潜在动作质量代理指标与下游性能的关联性。

Abstract: Latent Action Models (LAMs) have emerged as a promising paradigm for enabling robot learning to leverage large-scale unlabeled videos through latent actions that serve as compact surrogates for physical actions. Despite rapid progress, research on LAM remains highly fragmented, with existing methods evaluating different design choices in isolation under inconsistent experimental settings, making it difficult to identify the factors that truly determine downstream robotic manipulation performance. In this work, we present the first comprehensive empirical study of latent action learning for robotic manipulation. We unify representative LAM methods within a common autoencoding framework and systematically investigate 41 LAM design choices across three dimensions, including latent action modeling paradigms, learning objectives and regularization methods, and latent action integration strategies. We further examine four proxy metrics for evaluating latent action quality and assess their ability to reliably predict downstream robotic manipulation performance. Extensive experiments on three widely used benchmarks provide strong empirical evidence that fine-tuning vision-language model (VLM) backbones with latent actions provides a stronger initialization for downstream policy learning, with further validation on real-world robot manipulation tasks.

[62] OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation cs.RO | cs.CVPDF

Jiaqi Wang, Zhou Fang, Qiongfeng Shi, Yi Zhou

TL;DR: 论文提出了一种名为OrthoSkillVLA的参数高效框架，用于解决预训练视觉-语言-动作模型在持续学习新技能时面临的灾难性遗忘问题。该方法通过分析VLA模型内部组件的不同作用，对视觉语言模型和动作头施加独立的子空间约束，并引入一个轻量级的特征感知混合专家解码器来保护先前学习的技能。

Details

Motivation: 预训练的视觉-语言-动作模型是机器人学习的强大基础，但顺序适应不同技能会干扰先前技能的表征和速度映射，导致灾难性遗忘。现有基于架构或统一子空间约束的方法要么会增加推理开销，要么无法应对VLA模型内部组件的异质性挑战。

Result: 在模拟和真实世界的广泛评估及消融实验中，OrthoSkillVLA在无需演示重放的情况下，能更好地保留先前技能并学习新技能，展示了其在持续技能学习任务上的有效性。

Insight: 创新点在于识别了VLA模型中视觉语言模型（易受容量耗尽影响）和动作头（对扰动高度敏感）的不同角色，并据此施加分离的子空间约束；同时，为输出层设计了基于特征空间亲和力的无训练路由器的轻量级混合专家解码器，以缓解输出层表达能力瓶颈和覆盖风险。

Abstract: Pretrained Vision-Language-Action models provide a strong foundation for robot learning, but sequentially adapting them to diverse skills can perturb the representations and velocity mappings used by previous skills, leading to catastrophic forgetting. Architecture-based approaches improve retention by isolating skills but lead to increased inference footprint. Recent subspace-constrained methods restrict parameter updates in an orthogonal subspace to minimize interference but impose a unified constraint on the entire model. We analyze the distinct roles of internal VLA components and identify two VLA-specific challenges. First, the VLM maintains broad semantic representations, making it vulnerable to capacity exhaustion, whereas the ActionHead refines semantics into localized velocity patterns that are highly sensitive to perturbations. Second, the final velocity decoder serves as a readout layer. Freezing it forms an output-stage expressivity bottleneck, while updating it risks overwriting previous velocity mappings. To this end, we propose OrthoSkillVLA, a parameter-efficient framework for continual skill learning in pretrained VLA models without demonstration replay. Given the representation heterogeneity, we impose separate subspace constraints on the VLM and ActionHead, preserving reusable semantic capacity while protecting localized velocity patterns. For the output layer, we introduce a lightweight feature-aware MoE decoder, where each skill is allocated a compact expert and a training-free router selects the expert according to feature-space affinity. Extensive simulated and real-world evaluations, together with ablations, demonstrate that OrthoSkillVLA better preserves prior skills while acquiring new ones.

[63] PVRA: A Pointwise Key-point Voting Framework for Robotic Assembly cs.RO | cs.CVPDF

Kulunu Samarawickrama, Roel Pieters

TL;DR: 本文提出了一种名为PVRA的基于点级关键点投票的机器人装配框架，旨在通过3D关键点学习装配依赖关系，以从RGB-D输入中推断出可执行的动作输出。该框架在装配姿态估计数据集上进行了训练和评估，并与以物体为中心的基线方法进行了比较。

Details

Motivation: 现代计算机视觉已实现机器人装配的部分自主性，但进行渐进式装配的自主操作需要超越物体感知的特定技能。通过相关领域研究的比较分析，作者认为以物体为中心的感知必须向学习装配依赖关系发展，以预测有意义的可执行输出。

Result: 在装配姿态估计数据集上训练和评估了所提出的网络，并使用增强的度量标准与以物体为中心的基线方法进行了比较，以评估渐进式装配的性能。

Insight: 创新点在于将对象感知扩展到学习装配依赖关系，通过3D关键点模块化学习框架来推断可执行输出，这为机器人自主装配提供了更具体的技能支持。

Abstract: Modern computer vision has enabled partial autonomy in robotic assembly manipulation. However, performing autonomous manipulation of a progressive assembly demands a more specific set of skills, in addition to perceiving the objects. Through a comparative analysis of research in the associated domains, we deduce that object-centric perception must advance towards learning assembly dependencies to predict meaningful actionable outputs for autonomous assembly manipulation. Subsequently, we present a 3D keypoint-based modular learning framework to learn assembly dependencies to infer actionable outputs given a RGB-D input of an assembly scene. We train and evaluate our trained network on an assembly pose estimation dataset and compare it against object-centric baselines with an augmented set of metrics for progressive assemblies.

cs.LG [Back]

[64] MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents cs.LG | cs.AI | cs.CLPDF

Bo Qian, Yuting Wu, Shuang Zeng, Huaiyu Wan, Dalin Zhang

TL;DR: 论文提出MileGPO方法，用于解决长视野LLM智能体强化学习中的信用分配问题。该方法通过里程碑发现、可靠性校准塑形和进展对比校准三个设计，从分组策略轨迹中推导过程级信用，无需辅助模型或额外环境交互。在ALFWorld和WebShop基准测试中取得了SOTA性能，并表现出较小的分布内外差距。

Details

Motivation: 解决长视野智能体强化学习中信用分配的挑战，现有方法通过步骤分组或基于图的优势估计将轨迹级信号细化为步骤级信用，但可能忽略有意义的中间里程碑。

Result: 在ALFWorld和WebShop基准测试中实现了最先进的性能，在ALFWorld上表现出较小的分布内外差距。消融实验和信用诊断表明，可靠性加权、局部进展和同状态分支证据补充了里程碑发现，并解决了模糊的中间信用分配问题。

Insight: 创新点包括通过里程碑发现识别成功轨迹中的候选里程碑和失败轨迹中的重复陷阱，使用基于结果的置信度进行可靠性校准塑形，以及通过进展对比校准测试候选里程碑是否反映局部进展和其转移是否优于同状态下的其他替代方案。这些设计共同解决了中间信用分配的模糊性，提高了信用分配的准确性。

Abstract: Credit assignment is challenging in long-horizon agentic reinforcement learning, where supervision often comes only from final rewards. Existing methods refine trajectory-level signals into step-level credits through step grouping or graph-based advantage estimation, but can overlook meaningful intermediate milestones. We propose MileGPO (Milestone Inference with Local Evidence for Graph-Based Policy Optimization), which derives process-level credit from grouped on-policy rollouts through three designs. Milestone Discovery identifies candidate milestones on successful rollouts and recurring traps on failed ones. Reliability-Calibrated Shaping (RCS) weights these candidates by outcome-based confidence, strengthening reliable milestones and traps while down-weighting uncertain ones. Progress-Contrastive Calibration (PCC) further tests whether a candidate reflects local progress and whether its incoming ansition outperforms observed alternatives from the same state.MileGPO requires neither auxiliary models nor additional environment interaction. Experiments on ALFWorld and WebShop show state-of-the-art performance and a small in-distribution to out-of-distribution gap on ALFWorld. Ablations and credit diagnostics indicate that reliability weighting, local progress, and same-state branch evidence complement milestone discovery and resolve ambiguous intermediate credit.

cs.MA [Back]

[65] Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design cs.MA | cs.CL | cs.LGPDF

Poomphob Suwannapichat, Boonyarit Changaival, Caesar Wu, Pascal Bouvry

TL;DR: 本文提出了一种基于奖励引导的自回归图生成方法（RGA-Designer），用于优化基于LLM的多智能体系统（MAS）的通信拓扑设计。该方法通过训练一个联合评估任务正确性和结构紧凑性的奖励模型，并以此反馈微调预训练的图生成器，在保持任务准确性的同时，平均减少了20.5%的令牌消耗。

Details

Motivation: 现有自动拓扑设计方法ARG-Designer虽将多智能体通信问题重构为自回归图生成，但其训练目标缺乏对生成稀疏高效拓扑的明确激励，导致令牌消耗较高。

Result: 在保持与ARG-Designer相当的任务准确性的前提下，RGA-Designer在相关基准测试中平均降低了20.5%的令牌消耗，实现了更高效的通信拓扑。

Insight: 创新点在于将人类反馈强化学习（RLHF）思想引入图生成过程，通过联合奖励模型显式优化拓扑的紧凑性和任务性能，为多智能体系统的高效设计提供了可借鉴的优化框架。

Abstract: LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption. Recent work on automatic topology design, ARG-Designer, has reframed this problem as autoregressive graph generation. However, its training objective provides no explicit incentive for the model to generate sparse and efficient topologies. We address this limitation by introducing a Reward-Guided Autoregressive Graph Generation (RGA-Designer) inspired by Reinforcement Learning from Human Feedback (RLHF). We train a reward model that jointly captures task correctness and structural compactness, and then fine-tune the pretrained graph generator using the reward model as feedback. Our method preserves task accuracy at the level of ARG-Designer while reducing token consumption by an average of 20.5%.

[66] Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving cs.MA | cs.CL | cs.CVPDF

Mehdi Azarafza, Faezeh Pasandideh, Ali Ehteshami Bejnordi, Stefan Henkler, Achim Rettberg

TL;DR: 本文提出了一种用于自动驾驶的混合框架，该框架结合了强化学习、PID控制和大语言模型的常识推理能力。系统通过一个编排器协调PPO训练的强化学习和PID控制器，并利用LLM的迭代推理来动态优化强化学习的奖励函数。该框架在随机化的CARLA仿真场景中进行了评估，展示了在保持结构化控制和安全机制的同时，整合LLM推理与传统方法的潜力。

Details

Motivation: 自动驾驶系统在需要上下文推理的复杂未知场景中，传统强化学习和基于规则的方法性能可能下降，而直接使用LLM进行车辆控制又会带来延迟和幻觉风险。

Result: 在高度随机化的CARLA仿真场景中，该混合框架在多样化的环境和交通条件下进行了评估，结果表明其能够有效整合LLM推理与传统自动驾驶方法。

Insight: 核心创新在于提出了一个由编排器协调的混合架构，将LLM的常识推理能力作为高层决策和奖励函数优化的工具，而非直接用于底层控制，从而在引入高级推理的同时规避了直接控制的延迟与风险。

Abstract: Autonomous vehicles require robust perception and decision-making capabilities to operate in diverse and unseen scenarios. While reinforcement learning and rule-based methods can provide effective control and safety mechanisms, their performance may degrade in situations requiring contextual reasoning. Large Language Models (LLMs) have demonstrated strong capabilities in understanding multimodal information and generating contextual reasoning, however, their use for direct vehicle control can introduce latency and hallucination risks. To address these limitations, a hybrid framework is proposed. This system uses an orchestrator to coordinate PPO-trained reinforcement learning and PID control, with LLM common-sense reasoning applied throughout the framework. LLM reasoning is further employed iteratively to refine the RL reward function for dynamic driving environments. The proposed framework is evaluated in highly randomized CARLA scenarios under diverse environmental and traffic conditions. The results demonstrate the potential of integrating LLM-based reasoning with conventional autonomous driving methods while retaining structured control and safety mechanism.

cs.HC [Back]

[67] Does Listening Matter? Backchanneling and Nodding in AI Clone cs.HC | cs.CL | cs.SDPDF

Koji Inoue, Kazushi Kato, Tatsuya Kawahara, Shunichi Kasahara

TL;DR: 该论文研究了在模仿特定人物的AI克隆中增加多模态倾听行为（如言语反馈和点头）的效果。通过集成实时预测模型驱动的倾听行为，研究评估了这些行为对克隆体感知注意力、真实感和共在感的影响。结果表明，增加倾听行为显著提升了AI克隆的交互真实性和临场感。

Details

Motivation: 当前AI克隆主要模仿人物的言语和声音，但缺乏倾听行为，这可能导致交互缺乏真实感。论文旨在探索增加多模态倾听行为是否能提升AI克隆的存在感和真实性。

Result: 在35名参与者的受试者内研究中，增加倾听行为显著提高了克隆体的感知注意力、与真人交谈的感觉以及共在感。这些结果基于实时预测模型驱动的行为集成，表明倾听行为对交互质量有积极影响。

Insight: 论文的创新点在于将倾听行为作为AI克隆真实性的关键维度，超越了传统的语音和内容模仿。从客观角度看，这强调了交互行为在AI克隆设计中的重要性，为提升人机交互的自然性提供了新思路。

Abstract: AI clones that imitate a specific person typically reproduce what the person says and how they sound, but not how they listen. We investigate whether adding multimodal listening behaviors gives such a clone more presence and authenticity. We integrated verbal backchannels and head nodding, driven by real-time prediction models, into an AI clone equipped with voice cloning and LLM-based responses. In a within-subjects study (N=35), adding these behaviors significantly improved the perceived attentiveness of the avatar, the sense of talking with the real person, and the feeling of co-presence. These results indicate that AI clone fidelity should extend beyond voice and response content to include interactive listening behavior.

eess.IV [Back]

[68] MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities eess.IV | cs.CVPDF

Tarun Kumar Garg, Vaanathi Sundaresan

TL;DR: MOSAIC是首个针对客户端特定缺失模态的、模态无关的联邦学习框架，用于图像级弱监督的二元肿瘤分割。它通过客户端特定的模态对齐模块、谱原型对齐损失和专用的联邦细化网络，解决了多机构临床数据中模态异构和缺失的问题，仅使用图像级标签即可实现接近全监督的分割精度。

Details

Motivation: 临床多模态融合面临机构间模态子集不完整且异构的挑战，而隐私限制又禁止集中式数据共享。联邦学习虽能缓解数据共享限制，但会因客户端特定的模态缺失而导致融合质量和分割性能下降。目前，在异构缺失模态下，联合使用联邦学习和图像级弱监督进行分割的问题尚未得到解决。

Result: 在三个多机构脑肿瘤基准数据集（FeTS2022, BraTS-MEN, BraTS-SSA）上的实验表明，该方法显著优于所有图像级、框级和点级监督的基线方法，仅使用图像级标签即可接近全监督的准确率，在FeTS2022上达到0.84 Dice分数。动态新客户端加入时，无需重新训练即可在0.01-0.04 Dice分数内快速集成。

Insight: 创新点在于提出了模态无关的客户端特定对齐模块，无需先验模态知识；利用紧凑且不可逆的频域统计量进行谱原型对齐以调和跨客户端分布偏移；以及设计专用的联邦细化网络来去噪CAM伪标签，突破了弱监督的精度上限。该方法为处理联邦环境中异构、不完整的多模态数据提供了新思路。

Abstract: Trustworthy multimodal fusion in clinical settings requires handling incomplete and heterogeneous modality subsets across institutions, where privacy constraints prohibit centralized data sharing. Federated learning (FL) mitigates data-sharing constraints but suffers from client-specific missing modalities, where institutions possess incomplete multimodal subsets, degrading fusion quality and segmentation performance. While FL and weak supervision have been studied separately, their joint use with image-level labels under heterogeneous missing modalities remains unaddressed. We propose \textbf{MOSAIC}, the first modality-agnostic federated framework for weakly supervised binary tumor segmentation under client-specific missing modalities. We introduce a client-specific modality-alignment module that fuses available channels into a shared latent space without prior knowledge of modality identity, a spectral prototype alignment loss that reconciles cross-client distribution shift using compact non-invertible frequency-domain statistics, and a dedicated federated refinement network that denoises the resulting CAM pseudo-labels into accurate masks, breaking the accuracy ceiling of weak supervision. Experiments on three multi-institutional brain tumor benchmarks (FeTS2022, BraTS-MEN, and BraTS-SSA) demonstrate significant improvements over all image, box, and point-supervised baselines, approaching fully supervised accuracy using only image-level labels and reaching 0.84 Dice on FeTS2022. Dynamic new client addition enables previously unseen institutions to join an already-trained federation within 0.01-0.04 Dice without retraining. Code is available at https://github.com/Tarun2201/MOSAIC.

cs.AI [Back]

[69] From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG cs.AI | cs.CL | cs.DC | cs.IR | cs.PFPDF

Zlatan Feric, Amir Taherin, Yanzhi Wang, David Kaeli

TL;DR: 本文提出了一种基于遥测的自适应压缩方法，用于优化边缘设备上的检索增强生成（RAG）系统。通过实验分析，论文揭示了压缩率对延迟、能耗和推理质量的影响，并发现适度的压缩可以显著降低GPU和SoC能耗，同时保持推理质量。

Details

Motivation: 解决边缘设备上RAG系统因检索上下文过长导致的延迟、能耗和内存开销问题，现有静态压缩方法无法适应工作负载变化和设备实时状态。

Result: 在NVIDIA Jetson AGX Thor平台上，使用Llama和Qwen模型（7B-8B参数）及Natural Questions、HotpotQA数据集进行实验，发现中间压缩率可降低GPU能耗达53.2%，SoC能耗达48.2%，且质量损失可忽略。

Insight: 创新点在于提出动态自适应压缩策略，利用工作负载特征和边缘遥测数据实时调整压缩率；客观分析表明，该方法在能耗与质量间找到了有效平衡点，为边缘RAG系统优化提供了新思路。

Abstract: Retrieval-augmented generation (RAG) improves language-model responses by grounding generation in external passages, which comes with overhead: retrieved context lengthens the prompt, increasing prefill work, KV-cache footprint, memory traffic, latency, and energy. Context compression offers a natural remedy by pruning retrieved text before generation. However, state-of-the-art context-compression methods are typically used with a fixed compression budget, or with the rate selected offline and then applied at inference time. This static view ignores both workload variation and the live state of the edge device. On an edge SoC, compression is not free: the compressor itself runs on the same SoC and consumes latency and energy that can offset any generation savings. This paper proposes a vision for telemetry-informed adaptive compression in edge RAG, grounded in experimental evidence. We characterize the compression tradeoff on the NVIDIA Jetson AGX Thor using Llama and Qwen generators, Natural Questions and HotpotQA datasets, and LLMLingua-2 compression. Our measurements show that generation dominates the RAG budget for larger models, reaching roughly 90% of per-query latency and 91% of GPU energy for 7B-8B generators. Exploring the impact of the compression rate reveals an adaptive operating region: mild compression can miss energy opportunities, and overly aggressive compression can hurt inference quality. Intermediate compression can reduce GPU energy by up to 53.2%, and SoC energy by up to 48.2%, with negligible quality loss. We argue for runtime policies that dynamically manage compression, guided by workload features and edge telemetry.

[70] EnvHarness: Awakening Static Worlds for Agent Learning cs.AI | cs.CL | cs.LGPDF

Chengsong Huang, Zifeng Wang, Rujun Han, Jun Yan, Yanfei Chen

TL;DR: EnvHarness是一个可编程的插件层，用于包装静态环境以动态调整其行为，无需修改底层逻辑。EnvRigger通过观察智能体执行轨迹自动合成EnvHarness组件，针对诊断出的缺陷进行环境重塑。在四个领域的五个基准测试中，该方法在保持原始验证器的同时，显著提升了智能体性能并减少了执行步骤。

Details

Motivation: 解决现有LLM智能体学习环境为手工构建、静态且无法适应智能体能力变化的问题，旨在减轻从头重建环境的工程负担。

Result: 在四个领域的五个基准测试中，EnvHarness优于原始环境和特定领域的环境生成方法，在保留实例上实现了高达9.0分的改进，并减少了9.8%的执行步骤。

Insight: 创新点在于通过可编程插件层动态重塑静态环境行为，并利用黑盒策略观察自动合成针对性组件，实现了策略与环境的持续、针对性协同进化，提供了更优的强化学习优化信号。

Abstract: LLM agents learn by interacting with environments, yet these environments are hand-built and static: blind to an agent’s weaknesses, and quickly left behind as it improves. While recent environment generation methods attempt to address this, they require domain-specific pipelines, rely on expensive or unreliable verifiers, and still produce static environments. To alleviate the engineering burden of rebuilding environments from scratch, we propose Environment Harness (EnvHarness), a programmable layer of plug-in components that wraps a static environment to reshape its behavior without modifying the underlying logic. Operating through standard interfaces, EnvHarness applies across diverse domains while ensuring every reshaped environment retains its original verifier. To automate this process, we introduce EnvRigger, which treats the target policy as a black box, observing its execution trajectories to synthesize EnvHarness components targeting diagnosed flaws, and validating them via fresh rollouts. Across five benchmarks in four domains, EnvHarness outperforms both original environments and domain-specific environment generation pipelines, achieving up to a 9.0-point improvement on held-out instances with 9.8% fewer execution steps. Furthermore, EnvHarness provides a superior optimization signal for reinforcement learning, enabling continuous, targeted co-evolution of the policy and its environment.

[71] MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use cs.AI | cs.CL | cs.CY | cs.DB | cs.LGPDF

Mengru Wang, Haozhe Luo, Zhenqian Xu, Zhixiang Cui, Haoming Xu

TL;DR: 该论文提出了MemTrapBench基准测试，用于系统评估LLM使用记忆时引发的认知陷阱，即记忆如何扭曲模型推理或信念并降低当前任务性能。论文还提出了AdaptiveMem方法，以在推理时缓解这些陷阱。

Details

Motivation: 现有记忆基准主要评估信息的提取、存储和检索是否正确，但忽略了检索到的记忆如何重塑模型推理并影响当前任务性能。论文旨在识别和评估这种记忆引发的认知陷阱。

Result: 在两个模型系列和五个代表性记忆框架上的实验表明，MemTrapBench具有挑战性：所有评估的记忆策略表现均不及无记忆设置，即使最强的方法性能也下降超过10%。提出的AdaptiveMem方法在MemTrapBench上缓解了认知陷阱，同时在标准记忆基准上保持或提升了性能。

Insight: 创新点在于首次系统性地定义了LLM记忆使用中的认知陷阱（推理固化和信念扭曲），并为此创建了专门的基准测试。从客观角度看，AdaptiveMem作为一种简单的推理时指令方法，展示了缓解此类陷阱的有效性，为改进LLM记忆机制提供了新思路。

Abstract: Memory has become a key component of large language models, enabling them to retain information and learn from long-term interactions. However, existing memory benchmarks mainly evaluate whether information is correctly extracted, stored, and retrieved, while largely overlooking how retrieved memories reshape model reasoning and affect performance on the current task. We identify memory-induced cognitive traps: even faithfully recorded and semantically relevant memories can distort model reasoning or beliefs and degrade current task performance. To systematically evaluate these failure modes, we introduce MemTrapBench, which covers two forms of cognitive traps: Reasoning Fixation and Belief Distortion. Experiments across two model families and five representative memory frameworks show that MemTrapBench is challenging: all evaluated memory strategies underperform the no-memory setting, with even the strongest methods suffering drops of more than 10%. To mitigate these cognitive traps, we propose AdaptiveMem, a simple yet effective inference-time method that instructs LLMs to avoid memory traps. AdaptiveMem mitigates cognitive traps on MemTrapBench while preserving or improving performance on standard memory benchmarks across diverse memory frameworks.

[72] ContractScrub: A benchmark for final review of legal contracts cs.AI | cs.CLPDF

Yejin Bang, Kirsty Fielding, Brandan Oliver, Brian Birke, Nabeel Seedat

TL;DR: 本文介绍了ContractScrub，这是首个用于评估法律合同最终审查（即“scrubbing”）能力的基准测试，该基准包含由经验丰富的律师手工制作的合同，涵盖多种错误类别。研究发现，前沿大语言模型（LLM）在此任务上表现不佳，突显了当前模型的实践局限性和领域特定基准测试的重要性。

Details

Motivation: 法律合同审查是一项常规但繁琐的工作，需要处理长文档并关注细节，这使其成为自动化LLM应用的理想领域。然而，尽管具有经济价值和自动化潜力，此前尚无对LLM执行合同审查能力的正式评估。

Result: 在ContractScrub基准上，前沿模型表现令人意外地差，仅有一个模型的宏平均召回率达到0.75，尽管它们在看似相关的通用基准上表现强劲。这揭示了当前模型的实际限制。

Insight: 论文的创新点在于创建了首个针对法律合同审查的领域特定基准（ContractScrub），填补了评估空白。从客观角度看，其核心洞察是：通用LLM在长上下文推理、一致性检查和命名实体识别（NER）方面的能力，并不能直接转化为特定、细致的现实世界任务（如合同审查）的高性能，强调了开发窄领域、针对性基准的必要性。

Abstract: Legal work, with its heavy reliance on processing large amounts of text, is often considered one of the domains most exposed to the use of LLMs. Contract ``scrubbing,’’ the final review of transactional agreements for errors and inconsistencies, is a particularly suitable task for automation, because it is routine, painstaking work requiring detailed attention to long documents. Scrubbing also seems to align naturally with the general capabilities expected of frontier LLMs around long-context reasoning, consistency checking, and named entity recognition (NER). Despite the economic value and potential for automation, no formal evaluations of LLMs performing contract scrubbing have been conducted. We introduce ContractScrub, the first benchmark designed to evaluate contract scrubbing capabilities, comprising contracts hand-crafted by experienced lawyers over diverse error categories such as misuse of defined terms, incorrect references, and inconsistent language. Frontier models perform surprisingly poorly with only one model reaching 0.75 macro average recall despite strong performance on seemingly related general benchmarks, demonstrating the practical limits of current models and the importance of narrowly targeted, domain-specific benchmarks for measuring real-world impact.

[73] AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement cs.AI | cs.CL | cs.LGPDF

Yizhe Chi, Wenyi Li, Deyao Hong, Xiaoqiu Wang, Mingju Gao

TL;DR: 该论文提出了AI4AI-Bench基准测试，用于评估LLM智能体在算法设计（特别是训练算法设计）方面的能力，以探究递归自我改进（RSI）的可行性。该基准包含10个冻结的研究代码库，要求智能体在有限时间内改写训练算法，然后通过隐藏的评估器对新算法进行从头运行和评分。实验结果表明，现有系统仅能弥合基线算法与最优性能之间不到五分之一的差距，且大多数提交并未真正改变模型的学习方式。

Details

Motivation: 现有基准测试无法孤立地评估智能体设计训练算法的能力（这是实现递归自我改进RSI的关键），因为它们通常通过收集数据或调整超参数来获胜，而非改变模型的学习过程本身。

Result: 在10个任务上对6个系统的29种配置进行评估，平均得分为0.166（其中0.1为基线算法，1.0为任务最优），最佳系统得分为0.250，仅弥合了基线到最优之间不到五分之一的差距。真正改变了学习方式的少数提交平均得分为0.226，远高于其他提交的0.126。

Insight: 论文的创新点在于创建了一个专门用于评估LLM智能体在训练算法设计（即RSI核心能力）上的基准测试套件，并通过实验揭示了当前系统在此任务上的局限性：大多数智能体未能实质性地修改学习算法，而增加推理努力主要提高了其尝试修改的意愿，从而提升了性能。

Abstract: Recursive self-improvement (RSI) asks whether an AI system can improve the process that produces AI systems, so that the next system inherits the improvement. That process is the training algorithm: a better objective or update rule improves the compute\mbox{-}capability exchange rate for every subsequent run, including the one that produces the next agent. Whether RSI is feasible therefore turns on whether an agent can design training algorithms. No benchmark isolates that ability: existing suites are won by collecting data or by tuning hyperparameters, and none tells a change to how a run is executed apart from a change to how the model learns. We present AI4AI\mbox{-}Bench, 10 frozen research repositories spanning 10 training algorithm families. In each task, an agent has 4 hours on one B300 to rewrite the training algorithm; its code is then rerun from scratch for up to 12 hours and scored by a fixed evaluator hidden from the agent, against the repository’s original algorithm under the same procedure. Because the 10 metrics are incommensurable, every task is mapped onto one scale on which $0$ is an uninformative model, $0.1$ is the algorithm the repository ships, and $1.0$ is the task optimum. Across 29 configurations of 6 systems on all 10 tasks the mean score is $0.166$, and the best system reaches $0.250$: even the strongest closes under a fifth of the distance between the algorithm that was already there and the optimum. The submissions show where that distance went: most never change how the model learns at all, and the minority that do average $0.226$ against $0.126$ for the rest. More reasoning effort mostly buys the willingness to go there, taking that minority from $8%$ of submissions to $64%$ and the mean score from $0.094$ to $0.196$. We release the task suite, the evaluators and every scored submission, so that the measurement can be repeated as these systems change.

[74] An Agentic Approach for Active Data Collection, Travel Behavior Modeling, and Weather-Sensitive Demand Prediction cs.AI | cs.CLPDF

Narges Ahmadi, Yubo Jiao, Jônatas Augusto Manzolli, Jiangbo Yu, Luis Miranda-Moreno

TL;DR: 本研究提出了一种三智能体工作流，将对话式数据收集、结构化数据处理和行为预测整合在一起，用于主动收集通勤者的出行选择数据、建模出行行为，并进行天气敏感的需求预测。

Details

Motivation: 解决旅行行为研究中数据收集与预测建模通常分离开发与评估的问题，旨在通过一个可审计的多智能体工作流来协调这些阶段。

Result: 在五类出行方式预测任务中，随机森林模型达到69.6%的准确率，最佳纯文本零样本大语言模型达到69.9%，而结合天气图像的最佳视觉配置模型达到71.5%的准确率。

Insight: 创新点在于提出了一个集成对话式调查、传统建模与多模态LLM预测的可审计多智能体工作流；研究发现习惯性出行信息、专家框架提示以及少量示例提示能有效提升LLM的预测性能，且视觉上下文能为特定模型提供额外的预测信息。

Abstract: Travel behavior research increasingly combines digital data collection with predictive modeling, yet these stages are often developed and evaluated separately. This study proposes a three-agent workflow integrating conversational data collection, structured data processing, and behavioral prediction. A chatbot-administered, image-augmented stated-preference survey collected mode choices from student commuters across five predefined weather scenarios, yielding 454 respondent-scenario observations. Weather-related associations were analyzed using a multinomial logit model, while logistic regression and random forest provided machine-learning benchmarks. Nine locally deployed large language models (LLMs), ranging from 2 to 35 billion parameters, were evaluated across four zero-shot prompt-and-context conditions and extended through persona, few-shot, and vision-based configurations. Random forest achieved 69.6% five-class accuracy, while the best text-only zero-shot LLM reached 69.9% without task-specific fitting. Habitual travel information produced the most consistent gains, Expert framing generally outperformed Role-Play, and persona information was most useful when habitual travel information was unavailable. Few-shot prompting improved prediction for several models, with gains stabilizing after a small number of examples. Using the same weather images shown to respondents, the best vision-based configuration reached 71.5% five-class accuracy, indicating that visual context may provide additional predictive information for selected models. Overall, the study shows how conversational surveys, structured data processing, conventional behavioral modeling, machine learning, and multimodal LLM prediction can be coordinated within an auditable multi-agent workflow.

[75] SafeBranch: Branch-Pair Safety Alignment for Embodied Agents cs.AI | cs.CV | cs.ROPDF

Hyunse Lee, Jiwoo Jeong, Haneul Lee, Kyochul Jang, Youngjae Yu

TL;DR: SafeBranch是一个用于具身智能体安全对齐的框架，它通过环境回滚从智能体自身的不安全轨迹中构建分支对，在安全关键步骤处生成安全替代动作进行对比学习，从而在不牺牲任务成功率的前提下，显著提升智能体在交互环境中的安全性。

Details

Motivation: 当前基于视觉语言模型的具身智能体在执行指令任务时经常违反安全约束，而标准监督方法（如模仿安全轨迹或对比任意安全/不安全轨迹）难以有效分离安全信号与无关差异，导致安全训练困难。

Result: 在IS-Bench、SafetyALFRED以及任务和物体分布外变体上，SafeBranch可靠地处理安全问题，且在未见物体变体上实现了比未经训练的基线大约多十倍的‘安全成功’次数，即同时满足任务成功与安全约束。

Insight: 核心创新在于利用环境回滚机制构建‘分支对’，使对比学习仅聚焦于导致安全违规的关键步骤差异，从而纯净地学习安全约束；该方法无需部署时的额外安全评判模块，实现了端到端的安全策略对齐。

Abstract: Vision-language-model-based embodied agents can complete instructed tasks but often violate safety constraints in the process, a problem recently framed as interactive safety. Training such agents to act safely is difficult, since safety and task success are distinct objectives, and safety arises only at a small number of safety-critical steps within a trajectory. Standard supervision is insufficient: imitating safe trajectories teaches behavior without explaining why it is safe, and contrasting arbitrary safe and unsafe trajectories mixes the safety signal with unrelated differences. We propose SafeBranch, a framework that aligns an embodied actor on safety through branch pairs constructed from the actor’s own unsafe rollouts via environment rollback. SafeBranch rolls each unsafe rollout back to the safety-critical step that caused the violation, queries the actor for a safe alternative, and pairs the original action with the alternative so that the two branches differ only at that step. The trained actor acts safely at deployment with no critic in the loop. On IS-Bench, SafetyALFRED, and out-of-distribution variants with unseen tasks and objects, it handles safety reliably without sacrificing task success, achieving roughly ten times more safe successes than the untrained baseline on the unseen-object variant.

[76] When Saying No Makes Better Videos: Designing Dual Gatekeeping for Pedagogically Grounded AI Content Creation cs.AI | cs.CVPDF

Yearim Kim, Njun Baek, Nojun Kwak

TL;DR: 该论文提出了一种用于AI生成教学视频的双层拒绝机制，旨在提升内容的教学质量。第一层允许教育工作者基于多媒体学习理论迭代修改AI脚本，第二层采用自动化指标检测教学连贯性和叙事-视觉同步性违规。研究表明，这种结构化拒绝机制能有效提升AI生成内容的教学价值。

Details

Motivation: 为了解决AI生成内容可能外观精美但教学逻辑有缺陷的问题，论文旨在设计一个能确保教学质量的视频创作流程。

Result: 在涉及23名教育工作者（覆盖3个主题）的用户研究和基于7个科学及哲学课程主题的自动化评估中，两个拒绝层均独立改善了相同的教学维度，表明该方法能有效提升内容质量。

Insight: 创新点在于将‘原则性拒绝’（即拒绝不达标的AI输出）系统化地整合到创作流程中，使其成为提升质量的催化剂，而非简单地接受或拒绝AI生成内容。这揭示了深思熟虑的‘抵抗’与生成式AI可以成为合作伙伴，而非对立面。

Abstract: To prevent the adoption of aesthetically polished but pedagogically flawed AI content, we study a video authoring pipeline featuring two layers of structured refusal. The first layer empowers educators to iteratively reshape AI scripts based on multimedia learning theory, while the second employs automated metrics to flag violations in instructional coherence and narrative-visual synchronization. While neither layer is exhaustive, their synergy ensures that principled resistance–the act of deferring AI output until it meets rigorous standards–becomes a catalyst for higher quality. Evaluation combining a study with 23 educators across 3 topics and automated metrics across 7 topics drawn from established science and philosophy curricula shows that both layers independently improve the same instructional dimensions, suggesting that thoughtful resistance and generative AI are not opposites but partners.

cs.MM [Back]

[77] GRACE: Grounded Reasoning via Adapter Composition and Evidence-Aware Calibration for Educational Visual Question Answering cs.MM | cs.CVPDF

Xinjin Li, Yudi Xia, Xi Zhao, Yiliu Xu, Yining Liu

TL;DR: 本文提出了GRACE框架，用于解决教育视觉问答任务。该框架通过组合轻量级适配器和证据感知校准，对冻结的多模态大语言模型进行参数高效适配，以处理包含结构化元数据、图表和语义相近选项的教育VQA问题。

Details

Motivation: 教育VQA任务需要模型结合语言和视觉证据解答课程导向的多选题，但现有方法容易受到问题-选项捷径的影响，因此需要一种能有效利用结构化教育状态（如学科、技能、年级等）的适应框架。

Result: 在ScienceQA基准上，GRACE将整体准确率从90.5%提升至93.1%，在图像上下文问题上从88.7%提升至91.2%。消融实验表明，移除教育状态组合、选项校准或视觉适配器分别导致准确率下降1.4、1.0和1.5个百分点。

Insight: 创新点在于利用结构化教育状态作为路由信号，指导轻量级语言和视觉适配器的组合，并结合证据感知的选项校准机制，这为参数高效的多模态适应提供了新思路。

Abstract: Educational visual question answering, or VQA, requires models to solve curriculum-oriented multiple-choice questions using both language and visual evidence. Compared with conventional open-ended VQA, educational examples often include structured assessment metadata, diagrams or image contexts, and semantically close answer options, creating strong opportunities for question-option shortcuts. We develop and evaluate a parameter-efficient adaptation framework for a frozen multimodal large language model in this setting. We introduce GRACE, Grounded Reasoning via Adapter Composition and Evidence-Aware Calibration, a framework that uses the pedagogical state of each question to specialize lightweight language and vision adaptation. The state combines inference-visible subject, grouped skill, grade, visual-context, question-intent, and option-structure cues. GRACE uses factor-specific prompts and lightweight visual adapters, then applies evidence-aware option calibration to score all candidates under a shared multimodal context. On ScienceQA, GRACE improves a shared-adapter baseline from 90.5 percent to 93.1 percent overall accuracy and from 88.7 percent to 91.2 percent on image-context questions. Removing pedagogical composition, option calibration, or the visual adapter reduces overall accuracy by 1.4, 1.0, and 1.5 points, respectively. These controlled results show that structured educational state is an effective routing signal for parameter-efficient multimodal adaptation.

Table of Contents

cs.CL [Back]

[1] When Irrelevant Text Matters: Affine Margin Shifts in Multimodal Large Language Models cs.CL | cs.CVPDF

[2] Compliance, Capability, and Conflict: Benchmarking Multimodal LLMs under System Messages cs.CLPDF

[3] NepOOC-M: Bilingual Nepali-English Benchmark and Comparative Analysis of Multimodal Architectures for OOC Detection cs.CL | cs.CVPDF

[4] Time-Series Retrieval for Grounding Multimodal Language Models in Remaining Useful Life cs.CL | cs.AI | cs.LGPDF

[5] Forking Fast: Efficiently Estimating Uncertainty Dynamics in Text Generation cs.CL | cs.AI | cs.LGPDF

[6] Projector Is All You Train cs.CL | cs.CV | cs.LGPDF

[7] Stopping and Routing LLM Judge Panels cs.CLPDF

[8] Dynamic Gated Cross-Modal Fusion with Sarcastic-aware Contrastive Regularization for Multimodal Sarcasm Detection cs.CLPDF

[9] Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction cs.CLPDF

[10] HealMed: Multilingual Evaluation of Large Language Models in Medicine cs.CLPDF

[11] SABET-QA: Temporal Knowledge Graph Question Answering cs.CL | cs.AIPDF

[12] Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization cs.CL | cs.AIPDF

[13] OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models cs.CLPDF

[14] G-CARL: Grounded Checklist-Aligned Reward Learning for Patient-Oriented Medical Report Interpretation cs.CL | cs.AI | cs.CVPDF

cs.CV [Back]

[15] Does Marginal Coverage Guarantee Class-Conditional Safety for Zero-Shot VLMs Under Shift? cs.CV | cs.AIPDF

[16] Clustering and Token Denoising for Faster and More Robust VLMs cs.CV | cs.LGPDF

[17] VideoRun2D Demo: Markerless Body Tracking for Biomechanical Analysis of Running cs.CVPDF

[18] CAViAR: A Causal Video Dataset for Fine-Grained Accident Reasoning in Real-World Scenarios cs.CVPDF

[19] Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models cs.CV | cs.AIPDF

[20] Mix&Fix-Net: A Dual-Stage Trajectory Prediction Model for AIS and Vision-Derived Vessel Data cs.CVPDF

[21] CVSD-Reg: Cross-Modal Visual Semantic Prior Distillation for Robust LiDAR Registration cs.CV | cs.AI | cs.ROPDF

[22] Where Grounding Accuracy Lives on the IoU Curve: Label-Free Inference-Time Boundary Refinement cs.CVPDF

[23] VGI-BENCH: Probing Visual Intelligence in Video Generation Models cs.CV | cs.AIPDF

[24] PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment cs.CV | cs.AI | cs.CL | cs.MMPDF

[25] S$^2$GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices cs.CVPDF

[26] TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters cs.CVPDF

[27] PL-NBA: A Possession-level Universal Basketball Video Dataset Supporting Multiple Visual Understanding Tasks cs.CVPDF

[28] MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation cs.CVPDF

[29] Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning cs.CV | cs.LGPDF

[30] RIPE++: Reinforced Keypoint Learning from Positive Pairs Only cs.CV | cs.LGPDF

[31] Robust Cross-Modal Foundation Model Perception for Underwater Robots under Degraded Visual Conditions cs.CV | cs.AIPDF

[32] StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary cs.CV | cs.CLPDF

[33] TempJail: Temporal Jailbreak Attack against Large Vision-Language Models via Subtitle Scheduling cs.CV | cs.AI | cs.CLPDF

[34] Coupled Optimal Transport with Landmark Constraints cs.CVPDF

[35] Question-Guided Evidence Acquisition for Multimodal Visual Question Answering cs.CV | cs.AI | cs.LGPDF

[36] Core-KAN: Continuous Vision Kernels with Kolmogorov-Arnold Networks cs.CV | cs.AIPDF

[37] Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment cs.CV | cs.CLPDF

[38] A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments cs.CVPDF

[39] DIFFCZSL: Compositional Zero-Shot Learning Regularized by Diffusion Representations cs.CVPDF

[40] Unified and Efficient Point-Line Local Features cs.CVPDF

[41] AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures cs.CVPDF

[42] From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City cs.CV | cs.LGPDF

[43] Gravity-aware partially calibrated absolute pose estimation from affine- or rotation-covariant features cs.CVPDF

[44] STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection cs.CVPDF

[45] V-REX: Efficient Specialist VLM Training for Veterinary X-Rays cs.CVPDF

[46] BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal cs.CVPDF

[47] ID-VTG: Image-Disambiguated Video Temporal Grounding cs.CVPDF

[48] ArmorOCR: Grounded Adversarial Visual Perception via Observation-Transferred Self-Distillation cs.CVPDF

[49] Feature Evolution and Migration during Vision Transformer Training cs.CV | cs.LGPDF

[50] DPC-Net: Dual-Prior Collaborative Network for All-in-One Image Restoration cs.CVPDF

[51] G3Ego: Gaze-Guided Graphs for Egocentric Action Understanding cs.CVPDF

[52] RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation cs.CVPDF

[53] Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal cs.CVPDF

[54] Artificial Intelligence for Workflow Analysis in Colorectal Surgery: A Multicentric, Cross-Procedural Development and Generalization Study cs.CVPDF

[55] Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning cs.CV | cs.ROPDF

[56] DreamHand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery cs.CVPDF

[57] Swift-Image: Exploring the Performance Frontier of Compact Unified Image Generation Models cs.CVPDF

[58] Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis cs.CVPDF

[59] 4DAnyone: Create Anyone in 4D from a Casual Monocular Video cs.CVPDF

cs.RO [Back]

[60] Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation cs.RO | cs.CV | cs.LGPDF

[61] What Matters for Latent Actions in Robot Learning cs.RO | cs.CVPDF

[62] OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation cs.RO | cs.CVPDF

[63] PVRA: A Pointwise Key-point Voting Framework for Robotic Assembly cs.RO | cs.CVPDF

cs.LG [Back]

[64] MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents cs.LG | cs.AI | cs.CLPDF

cs.MA [Back]

[65] Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design cs.MA | cs.CL | cs.LGPDF

[66] Multi-Agent Orchestration with the Common-Sense Reasoning Capabilities of LLMs for Autonomous Driving cs.MA | cs.CL | cs.CVPDF

cs.HC [Back]

[67] Does Listening Matter? Backchanneling and Nodding in AI Clone cs.HC | cs.CL | cs.SDPDF

eess.IV [Back]

[68] MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities eess.IV | cs.CVPDF

cs.AI [Back]

[69] From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG cs.AI | cs.CL | cs.DC | cs.IR | cs.PFPDF

[70] EnvHarness: Awakening Static Worlds for Agent Learning cs.AI | cs.CL | cs.LGPDF

[71] MemTrapBench: Benchmarking Cognitive Traps in LLM Memory Use cs.AI | cs.CL | cs.CY | cs.DB | cs.LGPDF