cs.CL [Total: 12]
cs.CV [Total: 57]
cs.MM [Total: 1]
cs.RO [Total: 2]
cs.IR [Total: 4]
cs.SE [Total: 1]
cs.LG [Total: 1]
cs.AI [Total: 7]

cs.CL [Back]

[1] Measuring and Improving Behavioral Consistency in Large Language Models through Fact-Heuristic-Emotion State Enforcement cs.CL | cs.AI | cs.HCPDF

Gi-Hun Lee, Joong Yull Park

TL;DR: 本文提出了一种名为认知内核模型（CKM）的提示层状态强制方法，旨在测量和改善大型语言模型（LLMs）在决策问题中的行为不一致性。该方法要求模型在决策前将输入信息分类为事实、启发式和情感三种认知角色，并通过结构化状态跟踪来增强决策稳定性。研究在韩语决策场景下对26个LLMs进行了大规模实验，结果表明CKM能显著降低输出变异性和决策翻转率，但并未提升推理正确性。

Details

Motivation: 大型语言模型在多次运行中对同一决策问题可能给出不同答案，甚至会在自身先前答案作为上下文时反转决策，这种不稳定性影响了模型的可靠部署。本文旨在探索如何在不改变模型权重的情况下，测量并部分减少这种不稳定性。

Result: 在韩语决策场景（涉及模糊性、伦理冲突、资源分配和错误处理）的37,403次观察中，CKM将重复输出变异性降低了Hedges’ g=1.09，在新模型中决策翻转率降低了82%（g=1.52）。效果并非仅来自JSON格式，且在温度0.7的采样随机性下优势更明显（g=2.87）。消融实验表明约45%的增益来自结构支架，55%来自事实/启发式/情感内容。

Insight: 创新点在于通过强制模型在决策前分离事实、启发式和情感信息（即结构化状态跟踪），作为一种轻量级的提示工程方法，可显著提升行为一致性。这揭示了模型内部信息处理的可干预性，为改善LLMs的稳定性提供了无需微调的新思路。

Abstract: Large language models (LLMs) can give different answers to the same decision problem across runs, and reverse a decision when their own prior answer returns as context. We ask whether this instability can be measured and partially reduced without changing model weights. We test the Cognitive Kernel Model (CKM), a prompt-level state-enforcement layer. Before deciding, the model must separate its input into three epistemic roles: Fact (given or verifiable), Heuristic (inferred or assumed), and Emotion (evaluative or priority signal). CKM adds no capability; it forces the model to track what kind of information it uses before acting. Formally it maintains a structured state S_t = {F_t, H_t, E_t} updated by a transition function. We evaluate CKM on Korean-language decision scenarios (ambiguity, ethical conflict, resource allocation, error handling) across 26 LLMs from four vendors and 37,403 observations, via four core experiments, a 4-arm ablation, a 5-arm sham-restriction ablation, and a temperature probe. Findings: (1) CKM reduces repeated-output variability (random-effects Hedges’ g=1.09, 95% CI [0.83, 1.35], 31 model pairs); (2) state persistence cuts the decision-flip rate by 82% in newer models (g=1.52); (3) the effect is not JSON formatting alone (value-only recomputation, g=2.24); (4) intrinsic randomness under fixed anchor states is negligible; (5) the advantage grows under sampling stochasticity (g=2.87 at temperature 0.7); (6) a sham ablation attributes about 45% of the gain to structural scaffolding and 55% to Fact/Heuristic/Emotion content, and CKM is the only arm that both raises consistency and reduces flipping. CKM does not improve reasoning correctness. The narrower result: behavioral consistency is measurable, varies across models, and is partially improvable by forcing models to separate facts, assumptions, and evaluative signals before deciding.

[2] DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification cs.CL | cs.AIPDF

Sagnik Sinha, Shreyas Shrestha

TL;DR: 本文介绍了针对CLEF 2026 CheckThat! Task 2任务开发的系统，该任务旨在对多语言（英语和阿拉伯语）数值主张进行验证。系统探索了两种方法：一是基于LLM的微调验证器，通过LoRA对推理轨迹进行独立评分并采用Best-of-N选择最终结论，同时尝试了自适应子主张分解；二是基于轻量级TF-IDF奖励模型，结合手工设计的数值和时间重叠特征对轨迹评分，并按结论组聚合分数。实验表明，LLM方法在多数指标（尤其是Recall@5）上优于奖励模型，而奖励模型在Conflicting类上表现更强；子主张分解并未提升性能；对于阿拉伯语，AraBERT优于多语言基线模型。

Details

Motivation: 解决多语言数值主张自动验证的挑战，该任务需要结合语言理解和定量推理能力，并针对CLEF 2026 CheckThat!竞赛任务设计高效系统。

Result: 在CLEF 2026 CheckThat! Task 2基准上，基于LLM的方法在大多数指标（特别是Recall@5）上优于轻量级奖励模型，而奖励模型在Conflicting类别上表现更强；子主张分解未带来性能提升；对于阿拉伯语，专用模型AraBERT在多数指标上超越了多语言基线。

Insight: 创新点包括将LLM微调与轻量级奖励模型结合进行多语言数值验证，并探索了自适应子主张分解（尽管效果不佳）；客观分析表明，针对特定语言（如阿拉伯语）的预训练模型（AraBERT）相比通用多语言模型具有优势，且复杂主张的分解可能引入噪声而非辅助推理。

Abstract: Automated verification of numerical claims is a challenging problem, as it requires both language understanding and quantitative reasoning. This paper describes our system for CLEF 2026 CheckThat! Task 2, which focuses on ranking reasoning traces generated by large language models (LLMs) and predicting a final verdict for numerical claims in English and Arabic. We explore two approaches. The first approach fine-tunes an LLM-based verifier using LoRA to score each reasoning trace independently as a binary classification problem, and selects the final verdict using Best-of-N selection. We further experiment with adaptive sub-claim decomposition to break complex claims into simpler parts before verification. The second approach uses a lightweight TF-IDF reward model with handcrafted numeric and temporal overlap features to score traces, and aggregates scores by verdict group to determine the final prediction. For Arabic, we compare a general multilingual model against AraBERT, a language-specific model pretrained on Arabic text. Our results show that the LLM-based approach outperforms the lightweight reward model on most metrics, particularly Recall@5, while the reward-based approach shows stronger performance on the Conflicting class. Sub-claim decomposition did not improve performance, suggesting that claim splitting introduces noise rather than aiding reasoning. For Arabic, AraBERT outperforms the multilingual baseline across most metrics.

[3] TabRank: Chain-of-Thought Distillation for Table Re-Rankers cs.CL | cs.AI | cs.IRPDF

Adarsh Singh, Kushal Raj Bhandari, Jianxi Gao, Soham Dan, Vivek Gupta

TL;DR: 本文提出了TabRank，一个用于表格检索的推理重排序器训练框架。该框架通过构建包含6728条推理轨迹的数据集，并探索了两种在推理轨迹上训练紧凑推理模型的方法：显式思维链蒸馏和在提示中基于教师模型推理轨迹对学生重排序器进行条件化训练。TabRank在多个领域和多表场景的分布外泛化设置中表现出色，显著提升了多种表格检索数据集的性能。

Details

Motivation: 解决结构化信息检索中为回答问题检索相关表格的关键任务。多阶段检索系统严重依赖重排序器来优化由高效第一阶段检索器产生的候选列表，而神经重排序器和基于LLM的重排序方法因其比传统稀疏或密集检索模型更强的语义理解和推理能力而变得日益重要。

Result: 在多个表格检索数据集上性能显著提升：在HybridQA上Acc@10提升30.5%，在SQA上提升15.2%，在TabFact上提升52.9%，在Multi-Table QA Benchmark的TATQA子集上提升13.1%。TabRank在多表推理上也能有效泛化。

Insight: 创新点在于将显式思维链推理应用于表格检索重排序任务，并提出了两种具体的蒸馏训练方法。从客观角度看，其构建的推理轨迹数据集和将教师模型复杂推理能力蒸馏到紧凑学生模型的框架，为提升表格检索的语义理解和推理能力提供了有效途径，特别是在多表场景和分布外泛化方面。

Abstract: The ability to retrieve relevant tables for answering questions is a key task for structured information retrieval. Multi-stage retrieval systems rely heavily on rerankers to refine candidate lists produced by efficient first-stage retrievers. As a result, neural rerankers and LLM-based reranking methods have become increasingly important due to their superior capacity for semantic understanding and reasoning compared to conventional sparse or dense retrieval models. Recently, Large Reasoning Models (LRMs) equipped with explicit chain-of-thought (CoT) reasoning have shown strong improvements in ranking quality in unstructured passage retrieval. In this work, we present TabRank, a framework for training reasoning rerankers for Tabular Retrieval. We first present a comprehensive dataset of 6728 reasoning traces for tabular reranking on the Natural Questions Tables dataset. We then explore two variants of training a compact reasoning model on these reasoning traces: explicit CoT distillation and conditioning the student reranker on the teacher’s reasoning trace within the prompt. We stress-test TabRank on several out-of-distribution generalization settings on diverse domains and multi-table scenarios. Our approach significantly improves performance across a variety of table retrieval datasets, increasing Acc@10 by 30.5% on HybridQA, 15.2% on SQA, 52.9% on TabFact, and 13.1% on TATQA subsets of the Multi-Table QA Benchmark compared to the base model. Notably, TabRank generalizes effectively to multi-table reasoning. Our code, data and models are available at https://github.com/AdarshSingh7647/TabRanker

[4] MyoCardBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios cs.CLPDF

Xiao Li, Mouxiao Bian, Zhaodi Wu, Sijie Ren, Juechen Chen

TL;DR: 该论文提出了MyoCardBench，一个用于评估大语言模型在真实心血管护理场景中表现的多任务基准。该基准包含来自13个任务特定数据集的2,263个项目，覆盖了心血管护理的连续过程。研究在零样本设置下评估了7个LLM，发现GPT-5.4表现最佳，但在心电图解读和伦理决策等任务上模型表现仍有较大差距。

Details

Motivation: 现有的医学LLM基准大多关注考试知识或孤立任务，未能反映心血管护理的纵向、多模态和安全关键的工作流程。因此，需要开发一个更贴近真实临床场景的基准来全面评估LLM。

Result: 在MyoCardBench上，GPT-5.4取得了最高的宏观平均分（62.55）和项目加权平均分（62.19），在所有三个维度（临床维度、专科任务）均排名第一。具体任务中，CardioAuxReport表现最好（86.38），而CardioECGRead（17.25）和CardioEthics（17.34）得分最低。

Insight: 论文的主要创新点是构建了一个目前最大的、基于真实世界数据的、覆盖心血管护理全流程的多任务评估基准。从客观角度看，该基准强调了临床真实性和工作流程的完整性，其评估方法（如关键点覆盖率和整体临床质量）能更有效地识别模型在临床推理中的优势和关键遗漏，为未来模型开发指明了优先级。

Abstract: Background: Most medical large language model (LLM) benchmarks focus on examination knowledge or isolated tasks and may not reflect the longitudinal, multimodal, and safety-critical workflow of cardiovascular care. Objective: To develop MyoCardBench, a real-world benchmark spanning the cardiovascular care continuum, and assess LLM performance across clinical dimensions and specialist tasks. Methods: MyoCardBench includes 2,263 items from 13 task-specific datasets derived from de-identified cardiovascular records and examination data. Sixteen cardiology physicians conducted annotation and reference construction, followed by cross-review from two senior cardiologists. Seven LLMs generated 15,841 outputs under standardized zero-shot settings. Open-ended tasks were evaluated using key-point coverage and holistic clinical quality, while CardioEthics was scored by accuracy. Results: GPT-5.4 achieved the highest macro-average (62.55) and item-weighted mean (62.19), followed by Gemini 3.1 Pro (59.95) and Qwen 3.6 27B (59.72). GPT-5.4 ranked first in all three dimensions. CardioAuxReport performed best (86.38), whereas CardioECGRead (17.25) and CardioEthics (17.34) were lowest. The largest gaps between holistic clinical quality and key-point coverage occurred in CardioComm (52.71), CardioEmergRescue (52.05), and CardioTreatPlan (48.80). Conclusions: To our knowledge, MyoCardBench is the largest real-world, multi-task benchmark for LLM evaluation across the cardiovascular care continuum and offers the broadest coverage of clinically authentic cardiology scenarios reported to date. It provides a rigorous framework for identifying model strengths, clinically important omissions, and priorities for future development.

[5] CAST: Game Solvers as Turn-Level Teachers for LLM Agents cs.CL | cs.AIPDF

Yu Wang, Yi-Kai Zhang, Wentao Shi, Ziang Ye, Yuchun Miao

TL;DR: 本文提出了一种名为CAST（Credit Assignment from Solver Teachers）的新方法，用于训练大型语言模型（LLM）在长视野游戏中做出决策。该方法利用游戏求解器状态值的变化来生成密集的回合级奖励信号，以解决传统强化学习验证奖励（RLVR）中稀疏最终奖励导致的信用分配问题。

Details

Motivation: 动机在于，训练LLM进行长期游戏决策是迈向通用决策的关键一步，但现有的RLVR方法依赖稀疏的最终奖励，难以揭示哪些具体决策决定了成功。需要一种既廉价又准确的密集过程信号来提供缺失的回合级信用。

Result: 在Sokoban、扫雷和Rush Hour游戏中，CAST在所有训练基线中表现最佳，无论是在域内评估还是未见难度评估下。此外，它在ALFWorld和WebShop基准测试中实现了最高的平均零样本性能。

Insight: 创新点在于利用游戏求解器的状态值变化来推导“求解器优势”，并将其作为密集的回合级信号注入RLVR训练中。在软最优求解器假设下，最大化该优势等价于从求解器进行策略蒸馏，且仅需标量值而非教师模型的完整输出，这降低了计算成本并提升了训练效率。

Abstract: Training large language models (LLMs) to act in long-horizon games is a promising step toward generalist decision-making, yet reinforcement learning with verifiable rewards (RLVR) relies on sparse final rewards that reveal little about which decisions determine success. Denser process signals could supply this missing turn-level credit, but existing sources are hard to keep both cheap and accurate. We observe that changes in a game solver’s state value reveal whether an action advances the state toward success. Building on this insight, we propose CAST (Credit Assignment from Solver Teachers), which converts these value changes into solver advantages and injects them into RLVR as turn-level signals. We further show that, under a soft-optimal solver assumption, maximizing the solver advantage is equivalent to on-policy distillation from the solver, requiring only scalar values rather than teacher logits. Across Sokoban, Minesweeper, and Rush Hour, CAST outperforms all trained baselines on every game under both in-domain and unseen-difficulty evaluation and achieves the highest average zero-shot performance on ALFWorld and WebShop. Our code is available at https://github.com/Wloner0809/CAST.

[6] Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors cs.CL | cs.AIPDF

Jianfei Ma, Zhaoxin Feng, Emmanuele Chersoni, Si Chen

TL;DR: 本文探讨了仅使用语言学规则作为提示压缩器的可行性，以降低大语言模型推理成本。通过离线进化搜索从词汇、句法、语义和语篇层面寻找有效规则组合，构建无需模型前向传播的压缩器。在多个数据集上评估表明，该方法在轻到中度压缩下性能与现有先进方法相当。

Details

Motivation: 现有提示压缩方法依赖语言模型前向传播进行词元重要性评分，计算成本高且必要性存疑。语言学长期研究信息内容识别，其规则可转化为确定性操作，因此探索能否仅用语言学规则实现有效压缩，避免压缩时的模型计算开销。

Result: 在短文本、多文档推理和对话记忆QA数据集上，进化出的语言学压缩器性能与近期先进提示压缩策略相似，尤其在轻到中度压缩比下表现最强。随着压缩比增加，性能逐渐下降，且直接压缩与重建路径呈现不同模式。

Insight: 创新点在于首次系统探索纯语言学规则作为无模型提示压缩器的可行性，并通过进化搜索实现多层级规则融合。研究发现有效压缩需融合不同语言学层级信号，且高压缩比下规则从词元剪枝转向句子提取，为低开销压缩提供了新思路。

Abstract: Prompt compression shortens LLM input to reduce inference cost, yet existing methods score token importance through LM forward passes. It remains questionable whether such nuanced, costly token selection is necessary. Compression requires identifying informative content, a problem that linguistic research has long addressed through cues that can be operationalized as deterministic rules. We therefore ask: can \textbf{linguistic rules alone} serve as effective prompt compressors, without LM-based scoring at compression time? To address this, we conduct offline evolutionary search over lexical, syntactic, semantic, and discourse seeds to find competitive rule combinations. The resulting linguistic compressor requires no LM forward pass at deployment and uses only CPU-side processing for compression. We evaluate it with a dual-path protocol to balance compression quality and reconstruction fidelity. Across short passages, multi-document reasoning, and dialogue-memory QA datasets, evolved compressors achieve performance similar to that of recent advanced prompt-compression strategies. Performance is strongest under light-to-moderate compression and degrades as compression becomes more aggressive, while the Direct and Reconstruction paths exhibit distinct patterns. Evolutionary analysis reveals that effective compression fuses signals across linguistic levels and, as the compression ratio increases, rules shift from token pruning to sentence extraction.

[7] Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control cs.CL | cs.ROPDF

Jiaxin Bai, Jiaxuan Xiong

TL;DR: 本文提出了时序距离联合嵌入预测架构（TD-JEPA），旨在缩小JEPA世界模型规划器中训练与规划之间的差距。该方法通过从无奖励轨迹中挖掘有向时序成本，并利用该成本作为规划时的进度成本，同时作为表示学习的监督信号，从而提升潜在世界模型预测控制的性能。

Details

Motivation: 现有JEPA规划器通常依赖嵌入几何（如潜在欧氏距离）来对想象的未来进行多步排序，但这种距离是表示学习的副产品，而非从日志中挖掘出的进度成本。本文旨在通过挖掘离线日志中的时序进度结构，并协同设计成本形式与规划时部署，以解决训练（优化短期潜在预测）与规划（需要多步未来排序）之间的不匹配问题。

Result: 在锁定的评估设置下，部署挖掘出的成本将Two-Room环境的成功率提升至100.0%（LeWM为97.4%），而在相同时序训练检查点上使用共享欧氏规划，将OGB-Cube提升了14.2分，并改善了Push-T性能。与LeWM及并发的RC-aux基线相比，TD-JEPA在每个环境中均匹配或超越了这两种方法。消融实验表明，有向头、跨轨迹负样本和展开一致性均对性能有贡献。

Insight: 核心创新在于从无奖励轨迹中挖掘有向时序成本，并将其双重用途：既作为拓扑进度主导时的规划成本，又作为表示学习信号以改善接触几何主导时的欧氏规划。这通过协同设计成本形式与规划时部署，有效缩小了JEPA世界模型规划器中训练与规划的差距。

Abstract: Joint-Embedding Predictive Architectures (JEPAs) learn world models by predicting in representation space rather than reconstructing pixels, making them a natural backbone for latent model predictive control from offline demonstration logs. JEPA-style training optimizes short-horizon latent prediction, whereas planning requires a multi-step ranking of imagined futures by goal progress. Prior JEPA planners often inherit that ranking from embedding geometry, typically latent Euclidean distance, which arises as a byproduct of representation learning rather than as a progress cost mined from the logs. We propose temporal-distance JEPA (TD-JEPA), which retains the LeWM encoder–predictor backbone and mines a directed temporal cost from reward-free trajectories: same-trajectory step order supplies positive targets, cross-trajectory pairs act as heuristic negatives, and a rollout-consistency term matches the planner horizon. The mined supervision serves two roles: as the deployed planning cost when progress is topological, and as a representation signal that improves Euclidean planning when contact geometry dominates. Under locked evaluation, deploying the mined cost raises Two-Room success to 100.0% versus LeWM’s 97.4%, while shared Euclidean planning on the same temporally trained checkpoint raises OGB-Cube by 14.2 points over LeWM and improves Push-T. Against LeWM and the concurrent RC-aux baseline under locked evaluation, TD-JEPA matches or exceeds both methods on every environment. Ablations show that the directed head, cross-trajectory negatives, and rollout consistency each contribute. TD-JEPA narrows the train–plan gap for JEPA world-model planners by discovering temporal progress structure in offline logs and co-designing cost form with plan-time deployment. Code is available at https://github.com/HKBU-KnowComp/TD-JEPA.

[8] MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice cs.CL | cs.AIPDF

Rodolfo Rizzi, Alessandro Grecucci, Massimo Stella

TL;DR: 该论文提出了MyMentorLLM，一个用于刻意练习的多模态（语音/文本）心理治疗模拟环境，生成了2100个完整的认知行为疗法（CBT）训练会话。研究分析了会话中的情感动态、治疗能力和诊断准确性，发现模拟患者表现出与障碍一致的情感特征，且不同LLM的监督质量存在差异，其中原生语音到语音模型最接近人类评分。

Details

Motivation: 解决心理治疗师需要专家反复培训和监督但可扩展性不足的问题，旨在通过AI模拟环境提供可扩展的刻意练习训练。

Result: 在模拟的CBT会话中，患者情感特征与障碍一致，受训治疗师能像真实咨询一样反映这些特征。监督质量因LLM而异，原生语音到语音模型监督评分最接近人类；在7个LLM中的5个里，监督反馈改善了模拟治疗师的诊断准确性，且症状识别准确率随模型规模增加而提高。

Insight: 创新点在于构建了一个整合患者、受训治疗师和专家监督的多模态模拟环境用于CBT刻意练习，并系统评估了情感动态、治疗能力和诊断准确性；客观分析认为，其通过结构化模拟和基于能力的监督，为心理治疗培训的可扩展AI应用提供了新范式，并揭示了LLM在监督校准和反馈有效性方面的差异。

Abstract: Psychotherapists need repeated training and supervision by experts; however, scalability is problematic. Here we present MyMentorLLM, a multimodal voice- and text-based simulation environment for deliberate practice, used to generate 2,100 complete Cognitive Behavioural Therapy (CBT) training sessions. Each session links a DSM-5-TR-grounded patient (with major depressive, generalised anxiety or borderline personality disorder), a therapist-in-training and an expert supervisor. As an initial implementation, we adopted CBT because its structured procedures and competency-based supervision facilitate standardised simulation and evaluation. Sessions were analysed for emotional dynamics, therapeutic competence and diagnostic accuracy. Simulated patients expressed disorder-congruent emotional profiles, which trainee therapists mirrored as in real human counselling. The quality of supervision differed across LLMs: while most models overestimated trainees’ competences, native speech-to-speech was closest to human scores. Supervisors’ feedback led to better diagnoses in simulated psychotherapists in 5 out of 7 LLMs, and symptom identification accuracy increased with model size. This work shows that simulation of deliberate practice is possible for CBT training, although patient fidelity, calibration of supervisors, and harmful feedback should be evaluated together.

[9] Shieldstral cs.CL | cs.CVPDF

Antonia Calvi, Avinash Sooriyarachchi, Giada Pistilli, Guillaume Lample, Maarten Buyl

TL;DR: Shieldstral是一个3B参数的多模态安全分类器，通过将内容审核统一为二元问答任务，在文本安全基准测试中匹配或超越规模近7倍于它的模型，并在多模态安全分类上达到新的SOTA水平。

Details

Motivation: 解决多模态内容审核中任务多样、分类标准不统一的问题，通过统一框架整合异构安全数据集。

Result: 在文本安全基准测试中匹配或超越规模近7倍的模型，在多模态安全分类上达到SOTA；使用约5410万样本进行训练和评估。

Insight: 将内容审核统一为二元问答任务的简单框架，实现了异构数据集的整合和小模型的高效性能；提供了大规模数据构建和细粒度评估方法。

Abstract: We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7$\times$ its size on text safety benchmarks and sets a new state of the art on multimodal safety classification. Shieldstral formulates content moderation as a binary question-answering task. This simple formulation unifies diverse moderation tasks into a single yes/no problem, enabling heterogeneous safety datasets with divergent taxonomies to be consolidated under one training framework. We present the data construction recipe, covering curation and generation of approximately 54.1M samples and a fine-grained evaluation set to evaluate policy adaptability. Together, these enable a small adaptive model to match or outperform much larger models.

[10] Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases cs.CL | cs.AIPDF

Rui Yang, Weihao Xuan, Yi Lin, Zhuhan Bao, Jonathan Chong Kai Liew

TL;DR: 本文提出了ClinMM-Bench，一个迄今为止最大的多轮多模态临床诊断评估基准，包含1089个真实世界挑战性临床案例和3760张医学图像。作者使用一个两级评估框架（诊断准确性和诊断推理质量）系统评估了15个代表性的多模态大语言模型，发现专有模型诊断准确性最高，但所有模型在生成可靠诊断推理方面仍有显著局限，并识别出五种代表性失败模式。

Details

Motivation: 现有对多模态大语言模型的评估通常依赖单轮或孤立任务，难以充分捕捉真实世界临床诊断的复杂性，包括多模态信息的渐进披露、诊断假设的动态更新和临床推理的持续细化。

Result: 在ClinMM-Bench基准上评估显示，专有模型取得了最高的整体诊断准确性，但所有模型完全正确诊断的比例仍然有限；在诊断推理质量方面，当前模型能识别合理的诊断方向，但在生成可靠诊断推理方面仍有相当大的局限性。

Insight: 创新点在于构建了首个大规模、多轮、多模态的临床诊断评估基准，并提出了一个同时评估诊断准确性和诊断推理质量的两级框架，这为更真实地评估模型在临床环境中的能力提供了新标准。从客观角度看，对五种失败模式（信息合成失败、知识映射错误、感知错误、过早终止、幻觉）的系统分析，为未来模型改进提供了明确方向。

Abstract: Clinical diagnostic evaluation should not only assess whether models can provide correct diagnoses, but also reflect the realities of clinical practice, including progressive disclosure of multimodal information, dynamic updating of diagnostic hypotheses, and continuous refinement of clinical reasoning. However, existing evaluations of multimodal large language models (MLLMs) typically rely on single-turn or isolated tasks, making it difficult to fully capture the complexity of real-world clinical diagnosis. To bridge this gap, we developed ClinMM-Bench, the largest multi-turn multimodal clinical diagnostic evaluation benchmark to date. ClinMM-Bench contains 1,089 challenging real-world clinical cases and 3,760 medical images across eight specialties. We systematically evaluated 15 representative MLLMs using a two-level evaluation framework that assessed both diagnostic accuracy and diagnostic reasoning quality. Results showed that proprietary models achieved the highest overall diagnostic accuracy, but the proportion of completely correct diagnoses remained limited across all models. In terms of diagnostic reasoning quality, current models can identify plausible diagnostic directions but still have considerable limitations in generating reliable diagnostic reasoning. Error analysis further identified five representative failure modes: information synthesis failure, knowledge mapping error, perception error, premature closure, and visual hallucination.

[11] Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs cs.CL | cs.AIPDF

Fanfu Wei, Thibault Ehrhart, Raphaël Troncy

TL;DR: 该论文研究了维基百科和维基数据中跨文本、表格和知识图谱的知识不一致性问题，提出了一个名为Kontrast的自动检测框架。该框架通过Text-to-SPARQL和LLM推理来比较表格答案与知识图谱证据，并对不一致性进行分类。研究发现跨模态不一致性普遍存在且信息丰富，揭示了真实的知识冲突、缺失的KG结构以及时间不匹配等问题，同时表明系统比较有助于不同模态知识相互补充和修正。

Details

Motivation: 维基百科和维基数据的知识分散在文本、表格和知识图谱中，当这些模态的信息不一致时，如何检测和解释冲突是一个实际问题。论文旨在研究这种跨模态知识不一致性检测问题。

Result: 在多个Table-QA数据集上的实验表明，跨模态不一致性很常见且具有信息量。Kontrast框架能够有效检测这些不一致性，并揭示了真实冲突、KG结构缺失和时间错配，同时其检测也受到Text-to-SPARQL错误和噪声的限制。该工作为大规模知识审计提供了实用工具，并为未来跨模态知识一致性研究建立了基准。

Insight: 论文的创新点在于提出了一个跨模态知识不一致性的分类法，并构建了结合Text-to-SPARQL和LLM推理的自动检测框架Kontrast。从客观角度看，其将不一致性检测系统化，并强调了不同知识模态通过比较可以相互补充和修正，这对于知识库的质量评估和增强具有借鉴意义。

Abstract: Wikipedia and Wikidata are widely used for information access, LLM pre-training, and retrieval-augmented generation. Their knowledge is deeply connected but scattered across text, tables, and knowledge graphs. This raises a practical question: when these modalities disagree, how can we detect and explain the conflict? We study this problem as \emph{modality-level inconsistency detection}. We first introduce a taxonomy of cross-modal knowledge inconsistencies, covering information granularity differences, direct conflicts, temporal changes, and KG incompleteness. We then present \textsc{Kontrast}, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies. Experiments on various Table-QA datasets show that cross-modal inconsistencies are common and informative. They reveal not only true knowledge conflicts, but also missing KG structure and temporal mismatches while being limited by Text-to-SPARQL errors and noise. Our analysis shows that text, tables, and KGs can complement and correct one another through systematic comparison. \textsc{Kontrast} provides a practical tool for large-scale knowledge auditing and establishes a benchmark for future work on cross-modal knowledge consistency. Code and data are available at https://github.com/ECLADATTA/KONTRAST.

[12] Pass the Baton: Trajectory-Relayed On-Policy Distillation cs.CL | cs.AIPDF

Haolei Xu, Xiaowen Xu, Haiwen Hong, Zixuan Ni, Hongxing Li

TL;DR: 这篇论文提出了接力式在线策略蒸馏（Relay-OPD）方法，以解决在线策略蒸馏中存在的‘前缀失败’问题。该方法在检测到学生模型推理方向错误时，让教师模型短暂‘接管’生成过程以纠正轨迹，然后学生模型再继续学习，从而提高了训练效率和模型性能。

Details

Motivation: 在线策略蒸馏（OPD）方法存在‘前缀失败’问题，即学生模型一旦在推理早期出现方向性错误，后续所有生成都会基于此偏差，导致监督信号不可靠并浪费计算资源。

Result: 在八个数学推理基准测试上，使用Qwen3-4B-Instruct-2507作为教师模型，对Qwen3-0.6B/1.7B-Non-Thinking学生模型进行训练，Relay-OPD在所有基准上都取得了最佳或次佳结果。对于1.7B模型，平均性能分别超过标准OPD 5.73%和最先进的基线FastOPD 1.49%，同时在0.6B模型上也有一致的提升，并且训练轨迹长度减少了超过50%。

Insight: 核心创新点在于利用教师-学生在失败前缀上的‘延续不对称性’作为无标签的交接触发信号，并引入有限的‘接力预算’机制。这使得干预能集中在关键早期位置，在纠正错误方向的同时，限制了与原始学生策略的偏离，实现了高效且有效的知识蒸馏。

Abstract: On-policy distillation (OPD) grounds token-level supervision in the student’s own trajectory, yet suffers from prefix failure: once the student commits to a wrong reasoning direction, all subsequent generation builds on this deviation, producing misdirected continuations that elicit unreliable supervision and waste compute. We identify a teacher-student continuation asymmetry on failed prefixes, where the teacher tends to redirect while the student continues along the original direction, and convert it into a label-free handoff trigger in Relay On-Policy Distillation (Relay-OPD). During training, Relay-OPD constructs relay trajectories by letting the teacher briefly take over at detected trigger points to produce a teacher leg, after which the student resumes and is optimized on the resulting trajectory. A limited relay budget concentrates intervention on critical early positions while limiting departure from the student policy. With a Qwen3-4B-Instruct-2507 teacher and Qwen3-0.6B/1.7B-Non-Thinking students on eight mathematical reasoning benchmarks, Relay-OPD achieves the best or second-best results on every benchmark, outperforming standard OPD by +5.73% and the strongest baseline FastOPD by +1.49% on average for 1.7B, with consistent gains at 0.6B. Training trajectory length is reduced by over 50%.

cs.CV [Back]

[13] DisasterTD: Disaster Toponym Disambiguation Using Multimodal LLMs and Cross-View Geolocalization cs.CV | cs.AIPDF

Wenping Yin, Ziqi Liu, Naixia Mou, Weijia Li, Danfeng Hong

TL;DR: 本文提出了DisasterTD框架，用于解决社交媒体图像中地名歧义导致的精准地理定位难题。该框架结合了多模态大语言模型的语义推理与跨视角地理定位技术，通过从文本中提取地名并生成候选位置，再利用跨视角图像匹配进行验证和精化。

Details

Motivation: 社交媒体图像能及时提供灾害地面视角，但其中的地理参考信息往往模糊或存在歧义，导致准确的地理定位极具挑战。

Result: 在飓风哈维数据集上的评估表明，DisasterTD在多个距离阈值下的定位精度均优于仅使用MLLM或仅使用跨视角定位的基线方法，显著降低了平均误差和中位误差，尤其在处理歧义地名时改进最大。

Insight: 创新点在于将MLLM的语义推理能力与跨视角图像匹配的验证能力相结合，构建了一个用于灾害地理定位的细粒度跨视角基准数据集，并证明了该混合方法在解决地名歧义问题上的有效性。

Abstract: Social media imagery (SMI) provides timely and fine-grained ground perspectives that are valuable for situational awareness and emergency response. Unlike satellite or aerial imagery, SMI can capture disaster impacts and ground-level conditions in a timely manner. However, geographic references in SMI are often vague or ambiguous, making accurate geolocalization challenging. To address this issue, we propose DisasterTD, a disaster toponym disambiguation framework that integrates multimodal large language model (MLLMs)-based semantic reasoning with cross-view geolocalization. First, MLLMs extract toponyms and generate candidate geolocations from noisy textual inputs. Then, cross-view matching between SMI, remote sensing imagery (RSI), and optionally street-view imagery (SVI) is used to verify and refine these candidate results. We evaluate DisasterTD on the Hurricane Harvey dataset, where SMI is augmented with collected RSI and SVI to construct a cross-view benchmark for disaster geolocalization. The dataset is divided into four categories based on toponym clarity and ambiguity, allowing a fine-grained performance analysis across scenarios. Results show that DisasterTD consistently outperforms MLLM-only and cross-view-only baselines without disambiguation, achieving geolocalization accuracies of 71.62% within 1000 m, 62.36% within 500 m, 57.99% within 250 m, 52.09% within 100 m, and 47.01% within 50 m, while reducing the mean and median errors to 11.33 km and 0.68 km, respectively. The largest improvements appear in ambiguous toponyms, where semantic reasoning with cross-view evidence reduces candidate dispersion and errors. These findings demonstrate the effectiveness of integrating MLLM-based candidate generation with cross-view verification for fine-grained disaster geolocalization.

[14] Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed cs.CV | cs.AIPDF

Xinnuo Xu, Anja Thieme, Daniela Massiceti, Ioana Tanase, Rita Marques

TL;DR: 本文指出当前文本到图像生成的通用毒性检测器存在严重缺陷，无法有效保护边缘化社区，并提出了社区特异性毒性检测（CTD）的解决方案。通过与残疾专家合作，为侏儒症和盲/低视力社区制定安全指南，并利用2400张标注图像数据集验证了现有通用检测器和大型视觉语言模型在零样本设置下性能极差（F1低于随机猜测）。研究展示了基于提示的适应方法和参数高效微调能显著提升检测性能，但CTD的整体效果仍远低于通用毒性检测水平，凸显了持续研究的必要性。

Details

Motivation: 解决现有通用毒性检测器采用“一刀切”方法，无法识别对特定边缘化社区（如残疾群体）有害内容的问题，导致约35%被标记为安全的生成图像实际上对该社区有害。

Result: 在零样本设置下，大型视觉语言模型和现有通用毒性检测器在遵循社区特定指南的毒性检测上表现灾难性失败（F1分别为0.32和0.37，低于随机猜测）；通过提示适应方法（如ICL、VQA）可显著提升性能（GPT-4o的F1达到0.50和0.78），参数高效微调也能改善较小模型性能（最佳F1为0.48和0.59），但整体CTD性能仍远低于通用毒性检测的F1≈0.9水平。

Insight: 创新点在于首次系统论证了社区特异性毒性检测的紧迫性和可行性，通过专家协作制定社区特定安全指南，并实证揭示了通用模型在边缘化社区保护上的严重不足；客观来看，该研究为AI安全领域提供了重要的范式转变思路，即从“通用”转向“情境化”检测，并展示了基于少量演示的适应方法在提升模型对特定社区危害识别能力上的潜力。

Abstract: State-of-the-art toxicity detectors for text-to-image generation adopt a one-size-fits-all approach: a single universal model applying fixed safety guidelines to all users. Our empirical evidence shows that these detectors fail to shield marginalized communities: approximately 35% of generated images labeled safe are considered harmful by disability communities. In this position paper, we argue for community-specific toxicity detection (CTD). To demonstrate its feasibility, we collaborate with disability experts to develop safety guidelines for two communities: dwarfism and blind/low vision. Using a dataset of 2,400 annotated T2I-generated images we demonstrate that both large vision-language models and existing general-purpose toxicity detectors catastrophically fail to recognize harmful content under these guidelines in zero-shot settings with F1 score lower than random guessing (F1 0.32 and 0.37). Promisingly, prompt-based adaptation methods (ICL, VQA) substantially improve harm detection performance (GPT-4o: F1 0.50 and 0.78), while parameter-efficient fine-tuning improves smaller models (0.5b-7b with best F1 0.48 and 0.59) with less than 100 demonstrations, but remains sensitive to evolving guidelines. Despite these gains, CTD performance remains far below F1 $\approx 0.9$ achieved for general-purpose toxicity detection, highlighting the challenge and the need for sustained research effort.

[15] PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models cs.CVPDF

Zichao Lin, Yifeng Xie, Bowen Qu, Haiming Wang, Jia Li

TL;DR: 本文提出了PerceptionBench，一个专门用于评估多模态大语言模型原子视觉感知能力的基准测试。该基准通过分析前沿MLLMs在42个现有基准上的早期失败点，构建了一个包含十种原子感知能力的分类法，并据此创建了3000个隔离单一能力、答案简短明确的验证问题。在16个前沿MLLMs上的测试结果表明，原子感知问题远未解决，没有模型准确率超过60%，且感知相关的幻觉是最弱的能力。

Details

Motivation: 现有基准测试无法有效隔离感知能力进行评估：整体性评估将感知错误与推理或领域知识失败混为一谈，而应用驱动型基准仅覆盖由启发式设计形成的狭窄、碎片化领域。

Result: 在16个前沿MLLMs上的基准测试结果显示，原子感知能力基本未解决，没有模型准确率达到60%，感知相关的幻觉是平均最弱的能力，并且相似的总分掩盖了显著不同的能力分布。

Insight: 创新点在于采用自底向上的方法，通过诊断模型响应中的最早失败点来构建原子感知能力分类法，从而创建了一个隔离感知、难度源于感知本身而非推理或知识的基准。这为测量和诊断MLLMs的视觉感知边界提供了一个能力层面的标准。

Abstract: We introduce PerceptionBench, a benchmark specifically designed to evaluate the atomic visual perception capabilities of Multimodal Large Language Models (MLLMs). Existing benchmarks often fail to isolate perception: holistic evaluations conflate perceptual errors with failures in reasoning or domain knowledge, while application-driven benchmarks only cover narrow, fragmented domains shaped by heuristic designs. To address these limitations, PerceptionBench adopts a bottom-up approach: by diagnosing the earliest failure points in the responses of frontier MLLMs across 42 existing benchmarks, we construct an error taxonomy whose perception branch defines ten atomic perceptual capabilities. Guided by this taxonomy, we construct 3,000 verified questions with short, unambiguous answers, each isolating a single capability, with difficulty stemming from perception rather than reasoning or knowledge. Benchmark results across sixteen frontier MLLMs reveal that atomic perception remains largely unsolved—no model reaches 60% accuracy, perception-related hallucination is the weakest capability on average, and similar overall scores conceal sharply divergent capability profiles. PerceptionBench thus provides a capability-level standard for measuring and diagnosing the visual perception boundaries of MLLMs.

[16] Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model cs.CV | cs.CLPDF

Senqiao Yang, Kaichen Zhang, Zhaoyang Jia, Jinghao Guo, Yifei Shen

TL;DR: Mage-VL是一种高效的编解码器原生流式多模态基础模型，旨在解决传统视觉语言模型在流式感知任务中的低效问题。它通过自定义的Mage-ViT分词器选择性编码高动态区域，大幅减少视觉令牌消耗，并采用仿生双系统架构实现主动流式感知。模型在静态任务上匹配先进模型，在视频理解和空间推理任务中表现优异，推理速度提升显著。

Details

Motivation: 传统视觉语言模型存在Moravec悖论：擅长复杂离线视觉推理，但在简单流式感知任务上效率低下。论文旨在开发一个高效的流式多模态基础模型，以支持实时多模态理解和交互。

Result: Mage-VL-4B在静态任务上匹配Qwen3-VL-4B，在视频理解和2D/3D空间推理任务中取得显著提升，推理速度最高提升3.5倍，并全面超越15B Phi-4-reasoning-vision基线。

Insight: 创新点包括：Mage-ViT分词器通过运动向量和残差能量选择性编码动态区域，减少75%视觉令牌；仿生双系统架构（轻量级System 1事件门和因果System 2解码器）实现主动流式感知；AI4AI数据管道优化多模态标注和训练；提供了七项关键实证发现，涵盖预训练数据效率、可变分辨率缩放等。

Abstract: Standard vision-language models (VLMs) suffer from Moravec’s paradox: they excel at complex offline visual reasoning but struggle with simple streaming perception tasks and process them inefficiently. We present Mage-VL, an efficient codec-native streaming foundation model for real-time multimodal understanding and interaction. At its core, our custom tokenizer, Mage-ViT, replaces uniform frame sampling by selectively encoding dynamic, entropy-rich regions using motion vectors and residual energy across sparse anchor (I) and predicted (P) frames. Operating at a 16 x 16 patch level, this reduces visual token consumption by over 75% while preserving spatiotemporal context. Trained from scratch on approximately 560M unlabeled images and 100M unlabeled video frames, Mage-ViT matches or outperforms flagship encoders trained on billions of image-text pairs. We establish AI4AI data pipelines encompassing prompt-code joint optimization for multimodal captioning and AI-driven performance diagnosis to guide training recipes. Furthermore, through a bio-inspired dual-system architecture - a lightweight System 1 event gate and a causal System 2 decoder - Mage-VL enables proactive streaming perception. Extensive evaluations show that Mage-VL-4B matches Qwen3-VL-4B on static tasks while achieving strong gains in video understanding and 2D/3D spatial reasoning, with up to a 3.5x wall-clock inference speedup, and comprehensively surpasses the 15B Phi-4-reasoning-vision baseline. Beyond model artifacts, we deliver seven key empirical findings covering pre-training data efficiency, variable-resolution scaling, codec system acceleration, VideoQA SFT redundancy, motion-spatial synergy, AI4AI data pipelines, and Zero-Vision SFT for multimodal RL.

[17] Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models cs.CVPDF

Taimoor Rizwan, Sara Atito, Muhammad Awais, Zhenhua Feng, Josef Kittler

TL;DR: 本文提出了Diff-ID，一种基于扩散模型的框架，用于生成身份一致且逼真的人脸图像。该方法通过整合ArcFace和CLIP嵌入、使用双交叉注意力适配器以及提出基于ArcFace余弦相似度的伪判别器损失来增强身份保真度。此外，论文还引入了基于DDIM的统一变形管道，并主张使用结合身份相似度和感知真实性的Face Image Quality (FIQ)分数来联合评估身份保持和图像真实感。

Details

Motivation: 生成扩散模型在人脸图像合成方面取得了革命性进展，但在高分辨率输出中实现鲁棒的身份保持仍是一个关键挑战。这一问题对于安全系统、生物识别认证和隐私敏感应用至关重要，因为身份完整性的任何偏差都可能破坏信任和功能。

Result: 在未见过的面孔上进行的实验表明，Diff-ID在原始ArcFace人脸相似度上未超过InstantID，但在评估方法中实现了显著更低的FID和最强的基于FIQ的身份-真实感权衡。

Insight: 主要创新点包括：使用定制合成的210K图像数据集和微调BLIP模型增强训练中的身份感知；在微调的Stable Diffusion UNet中通过双交叉注意力适配器整合ArcFace和CLIP嵌入；提出基于ArcFace余弦相似度并带有指数时间步加权的伪判别器损失；以及引入统一的DDIM变形管道和FIQ作为联合评估指标，强调身份保持和真实感应共同评估而非孤立看待。

Abstract: Generative diffusion models have revolutionized facial image synthesis, yet robust identity preservation in high resolution outputs remains a critical challenge. This issue is especially vital for security systems, biometric authentication, and privacy sensitive applications, where any drift in identity integrity can undermine trust and functionality. We introduce Diff-ID, a diffusion based framework that enforces identity consistency while delivering photorealistic quality. Central to our approach is a custom 210K image dataset synthesized from CelebA-HQ, FFHQ, and LAION-Face and captioned via a fine tuned BLIP model to bolster identity awareness during training. Diff-ID integrates ArcFace and CLIP embeddings through a dual cross attention adapter within a fine tuned Stable Diffusion UNet. To further reinforce identity fidelity, we propose a pseudo discriminator loss based on ArcFace cosine similarity with exponential timestep weighting. Experiments on held out and unseen faces show that Diff-ID does not exceed InstantID in raw ArcFace Face Similarity, but achieves substantially lower FID and the strongest FIQ based identity–realism trade off among the evaluated methods. We also present a unified DDIM based morphing pipeline that enables qualitative facial interpolation without per identity fine tuning. We further argue that identity preservation and photorealism should be evaluated jointly rather than in isolation, as high identity similarity alone does not guarantee realistic outputs. To make this trade off explicit, we report Face Image Quality (FIQ) as a complementary ratio based score that combines identity similarity and perceptual realism while keeping FS and FID as the primary metrics.

[18] Enabling Fully Integer-Only Inference for Lightweight Detection Transformers cs.CVPDF

Thanh Cong Le, Michal Szczepanski, Martyna Poreba

TL;DR: 本文提出了I-LW-DETR，这是第一个完全整数运算的轻量级DETR检测器。通过引入尺度保持分割卷积、SD-ShiftGELU近似和约束Shiftmax三个关键组件，解决了变形注意力、特征融合和非线性激活函数等Transformer组件与整数算术不兼容的问题，实现了端到端的整数推理。

Details

Motivation: 当前视觉Transformer检测器在精度上接近CNN，但由于变形注意力、特征融合和非线性激活函数等关键组件不原生支持整数运算，难以部署在NPU和微控制器上。现有量化方法要么保留Softmax等浮点算子，要么只关注重型骨干网络，缺乏针对轻量级检测Transformer的端到端整数实现方案。

Result: 实验表明，所提出的量化流水线在不同模型规模下都能生成高效的完全整数模型。在所有模型规模上，该方法仅带来适度的精度下降，同时将模型大小减少了约3.6倍，计算成本降低了一个数量级以上。

Insight: 创新点包括：1）尺度保持分割卷积为多尺度投影器的每个分支分配独立的激活尺度；2）SD-ShiftGELU通过符号相关的GELU近似保持逐元素行为；3）约束Shiftmax维持稳定的Softmax归一化。这些组件共同实现了Transformer非线性操作的整数化近似，为轻量级检测器的边缘部署提供了新思路。

Abstract: Vision Transformer detectors now approach the accuracy of CNNs but remain difficult to deploy on NPUs and microcontrollers because key components, including deformable attention, feature fusion, and nonlinear activation functions, are not natively compatible with integer arithmetic. Existing quantized detectors either retain operators such as Softmax, GELU, and LayerNorm or focus on heavyweight backbones, leaving lightweight detection transformers without an end-to-end integer implementation. We address this gap with I-LW-DETR, the first fully integer-only lightweight DETR, in which every operation in the forward pass, including transformer nonlinearities, is executed in integer arithmetic. I-LW-DETR is built upon three key components: a scale-preserving split convolution that assigns independent activation scale to each branch of the multi-scale projector; SD-ShiftGELU, a sign-dependent GELU approximation that preserves element-wise behavior while avoiding the accuracy degradation; and a constrained Shiftmax that maintains stable Softmax normalization. Experimental results demonstrate that the proposed quantization pipeline consistently produces efficient fully integer-only models across different model scales. Across all model scales, the proposed pipeline incurs only a moderate accuracy degradation while reducing the model size by approximately $3.6\times$ and the computational cost by more than one order of magnitude.

[19] LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos cs.CVPDF

Ce Zhang, Jinxi He, Katia Sycara, Yaqi Xie

TL;DR: 本文提出了LENS，一种无需训练的关键帧采样框架，用于解决长视频理解中因上下文窗口有限而导致的瓶颈问题。LENS通过动态决策何时进行空间放大以获取细粒度细节，以及何时进行时间缩小以获取更广泛的上下文，自适应地在空间放大和时间缩小之间分配有限的帧预算。

Details

Motivation: 尽管多模态大语言模型（MLLMs）发展迅速，但长视频理解仍受限于有限的上下文窗口。现有的关键帧采样方法试图通过将视频输入压缩为一组与查询相关的紧凑帧来缓解此问题，但在广阔的时空搜索空间中导航仍然具有挑战性，因为空间细节和时间覆盖常常相互冲突。

Result: 在多个长视频基准测试中，LENS持续优于先前最先进的关键帧采样方法，并相比均匀采样带来了显著提升。例如，在使用Qwen2.5-VL模型时，将Video-MME的准确率从53.3%提高到了60.7%。

Insight: 论文的创新点在于提出了一个训练自适应的、基于文本查询动态调整时空缩放策略的关键帧采样框架。其核心洞察是自适应地在空间细节（放大）和时间上下文（缩小）之间分配有限的帧预算，从而在捕获高保真细节和长距离上下文的同时实现跨多粒度的推理。

Abstract: Despite rapid progress in Multi-modal Large Language Models (MLLMs), understanding long-form videos is still bottlenecked by limited context windows. While recent keyframe sampling methods attempt to mitigate this by distilling video inputs into a compact set of query-relevant frames, navigating the vast spatio-temporal search space remains challenging, as spatial detail and temporal coverage often conflict. To address this, we introduce LENS, a training-free keyframe sampling framework that dynamically decides when to zoom in for fine-grained details and when to zoom out for broader context based on the text query. Concretely, LENS adaptively allocates a limited frame budget between spatial zoom-ins, which highlight query-relevant regions within individual frames, and temporal zoom-outs, which expand the temporal scope through multi-frame aggregation, enabling the model to reason across multiple granularities while capturing both high-fidelity details and long-range context. Across diverse long-form video benchmarks, LENS consistently outperforms prior state-of-the-art keyframe sampling methods and delivers substantial gains over uniform sampling, improving Video-MME accuracy from 53.3% to 60.7% with Qwen2.5-VL.Code is available at https://github.com/zhangce01/LENS.

[20] OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis cs.CV | cs.AI | cs.LG | eess.IVPDF

Zihan Li, Feiyang Liu, Dandan Shan, Ruibo Wang, Qingqi Hong

TL;DR: 本文提出了OPERA框架，一种用于通用生物医学图像分析的多智能体集成方法，通过离线策略学习专家路由和测试时自适应，以应对不同扫描仪、协议和患者群体间的分布偏移，无需重新训练专家模型。

Details

Motivation: 生物医学图像分析面临跨域分布偏移的挑战，导致模型需重复进行领域特定微调，成本高昂且受限于数据稀缺和隐私约束，因此需要一种无需重新训练即可适应新部署环境的解决方案。

Result: 在涵盖眼底摄影、胸部X光、CT、MRI和多模态诊断基准的9个数据集上，与30多个基线方法相比，OPERA在分类、分割和多模态任务中均一致提升了性能和校准质量。

Insight: 创新点包括将专家权重分配视为离线策略学习问题，通过专家分析模块、置信度校准、分布感知自适应和实例级路由机制，实现异构专家智能体的协调，为可部署生物医学AI提供实用路径。

Abstract: Biomedical image analysis spans diverse modalities and tasks, yet real-world deployment is hindered by severe distribution shifts across scanners, protocols, and patient populations. High-performing models consequently require repeated domain-specific fine-tuning, which is a costly cycle that becomes impractical when labels are scarce or privacy constraints limit data sharing. We propose OPERA (Offline Policy-guided Expert Routing and Adaptation), a multi-agent ensemble framework that addresses this deployment bottleneck by treating expert weight assignment as an offline policy learning problem: a routing policy is learned from a small validation set without gradient updates to any expert agent, then deployed with test-time adaptation to handle distribution shift. OPERA coordinates heterogeneous specialist agents through complementary mechanisms. The expert profiling module learns selection policies offline, enabling informed allocation of expertise. Each agent undergoes confidence calibration through temperature adjustment, ensuring more reliable probabilistic outputs. OPERA also incorporates distribution aware adaptation, where class weights are dynamically adjusted at the batch level using statistics derived from unlabeled test data. Instance level routing assigns each sample to the most suitable expert by leveraging inter model agreement and predictive entropy. We evaluate OPERA on 9 datasets covering fundus photography, chest X-ray, CT, MRI, and multimodal diagnostic benchmarks, comparing against 30+ baselines across classification, segmentation, and multimodal settings. OPERA consistently improves performance and calibration quality, demonstrating that offline policy-guided expert agents coordination is a practical path to deployable biomedical AI without retraining. Code is on \href{https://github.com/HUANGLIZI/OPERA}{GitHub}.

[21] FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video cs.CV | cs.HCPDF

Keshav Rastogi, Eugy Han, Jeremy N. Bailenson

TL;DR: FIDAC是一个开源库，用于从视频中提取和解释人际距离。它整合了多个开源人脸检测模型的结果，以生成关于人物位置和人际距离的可操作数据，并包含了提高跟踪准确性的方法，如人工编码管道和减少深度失真的基准测试工具。

Details

Motivation: 人际距离能揭示人际感知的重要信息，但难以从视频输入中直接提取和解释。

Result: 论文提出了FIDAC工具，但摘要中未提及具体的定量实验结果或基准测试性能。

Insight: 主要创新点在于整合多个模型以补偿单个模型的不足，并引入人工编码和深度失真校正方法来提高跟踪准确性。这是一个面向实际应用、易于使用的数据处理管道。

Abstract: The distance between persons reveals significant information about their perception of each other. However, such information is not easily extractable and interpretable from video input. We developed an open-sourced library, Facial Interpersonal Distance Analysis and Coding (FIDAC) that transforms facial detection results into actionable data about location and interpersonal distance. This tool merges data from multiple open-source facial detection models, strategically compensating for gaps in any individual model. In addition, we include methods for more accurate tracking, such as a pipeline for human coding of the selection of faces and a benchmarking tool to reduce depth distortion. For next steps, we plan on building upon FIDAC by evaluating its effectiveness at measuring interpersonal distance at various depths and orientations while further integrating features of proxemic analysis such as synchrony into its software.

Jelin Raphael Akkara, Filippo Ziliotto, Luciano Serafini, Lamberto Ballan, Tommaso Campari

TL;DR: 本文提出IMPRINT框架，通过结合网络检索的图像来增强文本查询，以改进零样本物体目标导航中的语义地图查询能力，特别是在长尾细粒度物体类别上。该方法无需训练或修改底层导航策略，并在OVON和HSSD-rare基准测试中验证了其有效性。

Details

Motivation: 现有基于预训练视觉语言模型的零样本物体目标导航方法通常依赖纯文本查询，但在细粒度物体类别上可靠性下降，因此需要增强查询的语义特异性以改善长尾场景下的导航性能。

Result: 在OVON和HSSD-rare基准测试中，图像增强的查询一致提高了物体定位精度，并带来了端到端导航性能的提升，但分析表明定位增益转化为导航性能高度依赖于下游检测质量。

Insight: 创新点在于利用网络图像作为条件查询来丰富文本语义，实现零样本即插即用的地图查询增强；客观分析认为该方法揭示了长尾具身导航中下游检测质量是关键系统瓶颈，为后续研究提供了方向。

Abstract: Embodied AI increasingly relies on queryable semantic maps built from pre-trained vision-language models to enable zero-shot Object Goal Navigation (ObjectNav). However, existing approaches typically depend on text-only queries, which become less reliable as semantic specificity increases toward fine-grained object categories. We introduce IMPRINT, a zero-shot plug-and-play framework that enriches textual object queries with web-sourced images to improve grounding in queryable maps. Retrieved images are encoded using a vision-language model, matched against the semantic map to produce similarity maps, and aggregated to yield context-aware localization. Notably, this requires no training or modification of the underlying navigation policy. To explicitly evaluate long-tail behavior, we present HSSD-rare, a new ObjectNav benchmark built on Habitat Synthetic Scenes and featuring semantically specific subcategories. Across both OVON and HSSD-rare, image-conditioned queries consistently improve object grounding and yield end-to-end navigation gains. Further analysis reveals that translating localization gains to navigation performance depends critically on downstream detection quality, highlighting a key systems bottleneck in long-tail embodied navigation.

[23] CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking cs.CVPDF

Xiangqun Zhang, Likai Wang, Zekun Qian, Ruize Han, Wei Feng

TL;DR: 本文提出了跨域指代多目标跟踪（CD-RMOT）这一新问题，并构建了CD-RMOT-Bench基准测试集，用于评估RMOT模型在不同视觉域间的鲁棒性。同时，作者设计了一个查询中心适应（QCA）框架来稳定连接视觉轨迹和语言指代的查询空间，作为强基线方法。

Details

Motivation: 现有指代多目标跟踪（RMOT）研究主要在域内设置下进行，忽略了视觉域偏移（如天气、视角变化）对语言条件跟踪鲁棒性的影响，因此需要系统研究跨域场景下的RMOT性能。

Result: 实验表明，域偏移会严重降低RMOT性能，且失败主要源于不稳定的表达式条件时序关联和目标选择，而非仅物体检测错误。QCA框架在CD-RMOT-Bench上建立了强基线。

Insight: 创新点在于首次系统定义了CD-RMOT问题并构建了包含真实清晰域、数字孪生变体和真实恶劣域视频的统一基准；提出的QCA框架通过稳定查询空间来缓解域偏移，为跨域语言引导跟踪提供了新方向。

Abstract: Referring multi-object tracking (RMOT) extends tracking from category-driven perception to language-guided understanding by grounding object trajectories in natural-language expressions. Despite recent progress, existing RMOT studies are largely conducted under in-domain settings, leaving the robustness of language-conditioned tracking under inevitable visual domain shifts unexplored. In this paper, we study Cross-Domain Referring Multi-Object Tracking (CD-RMOT), a new and challenging problem that evaluates whether an RMOT model trained on a labeled source domain can reliably follow natural-language expressions in an unlabeled target domain with different visual conditions. To support systematic study, we construct CD-RMOT-Bench, a unified benchmark that combines real clear-domain referring tracking data, aligned digital-twin variants, and real adverse-domain videos. CD-RMOT-Bench enables both controlled weather/viewpoint shift analysis and realistic synthetic-real transfer evaluation under a shared RMOT protocol. Further, we provide a Query-Centric Adaptation (QCA) framework, designed to stabilize the query space that bridges visual trajectories and referring expressions. Extensive experiments reveal that domain shifts severely degrade RMOT performance, where the failure is not merely caused by object detection errors but more critically by unstable expression-conditioned temporal association and target selection. QCA establishes a strong baseline, while CD-RMOT-Bench opens a new direction for robust language-guided tracking across visual domains.

[24] Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation cs.CVPDF

Zhaoyan Chen, Zhongxiu Cong, Zhuanfeng Jin, Wanshu Fan, Dongsheng Zhou

TL;DR: 本文综述了医疗世界模型在医疗保健领域的应用，将其定义为一种能够表示患者动态状态并模拟临床干预效果的AI框架。通过系统回顾98篇文献，文章总结了该领域的四大核心能力：患者状态表示、时序动态建模、干预条件模拟和临床监督规划，并指出当前研究多为回顾性、任务特定或临床前阶段，面临数据不完整、因果识别有限等挑战。

Details

Motivation: 动机在于扩展医疗人工智能超越静态预测，通过建模患者状态的动态演变和临床干预的影响，以支持更精准的临床决策和规划。

Result: 研究筛选了1,455条记录，最终纳入98篇文献，其中14篇符合严格的医疗世界模型实证定义；证据表明该技术在轨迹预测和候选干预比较方面具有技术可行性，但大多数研究缺乏前瞻性验证和临床终点评估。

Insight: 创新点在于系统定义了医疗世界模型的概念边界和技术基础，并提出了临床翻译的关键要求，如精确干预表示、稳健因果机制和不确定性校准；从客观角度看，该综述为整合临床数字孪生提供了跨领域框架，强调了从回顾性研究向临床验证转变的必要性。

Abstract: Medical world models offer a framework for extending medical artificial intelligence beyond static prediction by representing evolving patient states and modelling how they change over time and in response to clinical interventions. This Review defines the conceptual boundaries, technical foundations, application domains, and evidence requirements of the field through a structured narrative synthesis with reproducible evidence mapping.We screened 1,455 unique records and assembled a corpus of 98 sources, including 14 studies that met a strict empirical definition of a medical world model. The field is organised around four capabilities: patient state representation, temporal dynamics modelling, intervention-conditioned simulation, and clinician-supervised planning. Evidence spans medical imaging, longitudinal electronic health records, treatment response modelling, physiological and multimodal state modelling, ultrasound and surgical interaction, and population and health-system simulation; clinical digital twins are treated as a cross-cutting integration framework.Current studies provide early evidence of technical feasibility for trajectory forecasting and comparison of candidate interventions, but most remain retrospective, task-specific, or preclinical. The evidence base is further limited by incomplete longitudinal intervention data, inconsistent action semantics, limited causal identifiability, long-horizon error accumulation, inadequate uncertainty estimation, and limited external validation. Clinical translation will therefore depend on precise intervention representations, robust causal and mechanistic grounding, calibrated trajectory-level uncertainty, safety-constrained planning, and prospective multicentre validation against clinically meaningful endpoints.

[25] OrganLens: Organ-Specific Representation Learning for CT Foundation Models cs.CV | cs.AIPDF

Zhixuan Ge, Anqi Li, Sadeer Al-Kindi, Hanwen Xu, Wei Qiu

TL;DR: 本文提出OrganLens方法，用于从CT扫描中学习器官特异性表示。该方法通过自监督学习，使一个共享的CT编码器能够根据器官身份生成11个器官特异性表示，无需外部分割掩码。在多个CT数据集和下游任务评估中，器官特异性表示在相关任务上显著优于全局表示。

Details

Motivation: 现有CT基础模型通常只生成单一的全局表示，而解剖感知方法要么编码预分割的器官体积（可能丢失周围临床上下文），要么在特征形成后才将图像解耦为器官标记组（未在特征形成前根据选定器官条件化共享编码器）。因此，需要一种能学习器官特异性表示且保留上下文的方法。

Result: 在CT-RATE、RAD-ChestCT、INSPECT和NLST等多个数据集上评估。相比CT预训练的DINOv2，心脏表示将CT-RATE心脏肥大AUROC从0.910提升至0.953，肺表示将NLST肺癌死亡率的Harrell C指数提高了14.2%。全局表示在INSPECT的文本-图像和图像-文本检索中Recall@10分别达到33.09%和32.04%。

Insight: 创新点在于通过器官身份条件化共享编码器，结合器官特异性蒸馏和解剖掩码监督，实现解剖加权池化以生成器官特异性表示。这提供了一种可扩展的器官特异性CT表示学习方法，为医学研究提供了可重用框架，用于跨队列和临床终点研究器官特异性疾病。

Abstract: A CT examination captures multiple organs, but many biomedical questions concern abnormalities, prognosis, or longitudinal change in a specific organ. These questions require a separate representation for each organ within the same CT volume. Existing CT foundation models commonly produce a single volume-level representation, while recent anatomy-aware methods either encode pre-separated organ volumes or explicitly disentangle images into organ token groups. The former may remove clinically relevant surrounding context, while the latter does not condition a shared encoder on a selected organ before its features are formed. We introduce OrganLens for organ-specific representation learning through self-supervision. An organ identity conditions a shared CT encoder, while organ-specific distillation and anatomy-mask supervision shape features for anatomy-weighted pooling into organ-specific representations. At inference, the shared model produces 11 organ-specific representations without external segmentation masks. We evaluate OrganLens on CT-RATE, RAD-ChestCT, INSPECT, and NLST across diverse acquisitions and downstream evaluations. Relative to CT-pretrained DINOv2, heart representations raise CT-RATE cardiomegaly AUROC from 0.910 to 0.953, while lung representations improve the Harrell C-index for NLST lung-cancer mortality by 14.2%. The global representation reaches INSPECT Recall@10 of 33.09% and 32.04% for text-to-image and image-to-text retrieval, respectively. Across organ-related tasks, anatomically matched representations provide stronger task-relevant signal, while the global representation retains broad utility. OrganLens offers a scalable approach to organ-specific CT representation learning with a shared encoder. More broadly, it provides the medical research community with a reusable framework for studying organ-specific disease across cohorts and clinical endpoints.

[26] CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition cs.CV | cs.AI | cs.CL | cs.LGPDF

Lai Wei, Chengqi Li, Jiapeng Li, Ruina Hu, Yue Wang

TL;DR: 本文提出了CLBench-V，一个用于评估多模态上下文学习能力的基准测试，涵盖从上下文定位到知识获取的多个维度。该基准整合了公开数据集和新构建的数据集，覆盖科学、金融、空间推理等多个领域，并通过自动化构建方法降低任务创建成本。实验表明，当前多模态模型在3,443个实例上的最佳总体得分仅为0.2847，说明该任务远未饱和，且不同模型在不同维度上表现各异。

Details

Motivation: 现实世界任务常需模型从任务特定上下文中学习，而非仅依赖预训练知识；现有评估主要关注文本上下文，但实际场景中上下文常为多模态（如图表、地图、网页），因此需要专门基准来评估多模态上下文学习能力。

Result: 在CLBench-V基准的3,443个实例上测试六个近期多模态模型，最佳总体得分仅0.2847，表明任务远未饱和；InternVL3.5-30B-A3B在上下文定位和新知识学习维度表现最佳，Qwen3.5-Plus在新信息应用维度表现最佳。

Insight: 创新点在于提出首个系统评估多模态上下文学习的基准，通过三维度（上下文定位、新信息应用、新知识学习）分解任务难度，并采用自动化构建方法降低领域特定任务创建成本；客观来看，该基准为多模态模型上下文学习能力提供了细粒度评估框架，有助于定位模型弱点。

Abstract: Real-world tasks often require models to learn from task-specific context rather than relying only on pre-trained knowledge. While recent work has highlighted this capability as context learning, existing evaluations mainly focus on textual contexts. In many practical settings, however, the context to be learned from is multimodal: scientific findings are conveyed through figures and tables, financial indicators are scattered across converted reports, and spatial decisions depend on maps, scenes, or web pages. We introduce CLBench-V, a benchmark for multimodal context learning that addresses the difficulty of localizing where context use breaks down by organizing tasks around three dimensions: context grounding, new information application, and new knowledge learning. CLBench-V combines converted public benchmarks with newly constructed datasets spanning domains such as science, finance, long-document understanding, spatial reasoning, and web-based visual question answering. To reduce the cost of constructing domain-specific context-learning tasks, we further use automated construction and filtering procedures for our newly built datasets. Across 3,443 instances and six recent multimodal models, the best overall score is only 0.2847, indicating that multimodal context learning remains far from saturated. Moreover, InternVL3.5-30B-A3B performs best on context grounding and new knowledge learning, while Qwen3.5-Plus performs best on new information application. We further analyze judge reliability, context length, image count, and representative failure cases. Code is available at https://github.com/IamLihua/CLBench-V.

[27] FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding cs.CV | cs.LGPDF

Ghazal Kaviani, Ghassan AlRegib

TL;DR: 本文提出了FORGE方法，一种无需训练的、模型无关的帧选择技术，用于提升长视频理解任务中多模态大语言模型的性能。该方法通过在预训练的多模态嵌入空间中构建查询条件化的几何结构，将相关性和多样性统一为单一目标，从而在推理时从长视频中选取信息量最大化的关键帧子集。

Details

Motivation: 随着视频序列长度的增加，相关内容的密度急剧下降，而向模型暴露更多无关内容会显著降低其准确性。因此，需要一种在推理时最大化查询相关信息的方法，而无需额外训练。

Result: 在Video-MME和LongVideoBench基准测试上，使用16、32和64帧的预算，FORGE将统一关键帧选择分数提升了11.0-15.3分，优于最强的无需训练基线方法，并在Video-MME上（K=64时）将关键帧召回率提升了一倍（0.415 vs. 0.204）。在问答任务中，该方法在八个参数量从4B到32B的开源MLLM上均提升了准确性，最高比均匀采样提升8.7分，比最强基线提升5.2分。

Insight: 论文的创新点在于将嵌入空间与查询的高维结构对齐，通过构建查询条件化的几何空间来统一衡量帧的相关性和多样性，从而实现推理时的高效信息选择。从客观角度看，这是一种新颖的、无需训练的、模型无关的帧选择策略，为长视频理解提供了新的优化方向。

Abstract: Multimodal large language models (MLLMs) have enabled long-form video understanding at a scale that was not previously possible. However, the density of relevant content decreases sharply as video sequence length increases, and exposing the model to more irrelevant content measurably reduces its accuracy. In this paper, we address the problem of maximizing query-relevant information in a frame subset selected at inference time, without training. FORGE (Frame Orthogonality in Relevance Geometry) is a model-agnostic method that induces a query-conditioned geometry on a pretrained multimodal embedding space, unifying relevance and diversity into a single objective. In this space, frames that cover independent query-relevant directions are far apart, and selecting the subset of maximum information captures diverse query-relevant content within the budget. Experiments on Video-MME and LongVideoBench at budgets of 16, 32, and 64 frames show that FORGE improves the unified keyframe selection score by 11.0-15.3 points over the strongest training-free baseline and up to doubles keyframe recall (0.415 vs. 0.204 at K=64 on Video-MME). The gains extend to question answering, where accuracy improves in every evaluated setting across eight open-source MLLMs spanning 4B to 32B parameters, by up to 8.7 points over uniform sampling and 5.2 points over the strongest baseline. Our findings suggest that aligning the embedding space with the query’s high-dimensional structure is a promising direction for inference-time video understanding.

[28] MEDit-Bench: A Dataset for Evaluating Message-Driven Narrative Video Editing cs.CVPDF

Katsuya Ogata, Zongshang Pang, Mayu Otani, Yuta Nakashima

TL;DR: 本文提出了MEDit-Bench数据集与基准，用于评估消息驱动的叙事视频编辑任务。该数据集包含长视频、多种编辑消息以及每种消息对应的多个专业编辑版本，揭示了同一源素材因叙事意图不同而产生的编辑多样性。研究定义了基于时序对齐指标的自动评估协议，发现LLM作为评判者存在严重的位置偏差，并引入了消息模糊性和上下文丰富度作为难度分层因素。实验表明，尽管先进模型在宽松阈值下接近人类时序对齐水平，但在严格标准下仍落后于人类，且人类感知研究证实了模型输出与专业编辑之间存在显著质量差距。

Details

Motivation: 现有的视频摘要基准将编辑意图简化为单一的、与消息无关的显著性概念，无法捕捉叙事意图多样性带来的编辑差异。因此，需要一个新的基准来评估消息驱动的视频编辑，其中编辑选择取决于希望传达的叙事信息。

Result: 在MEDit-Bench上测试了最先进的多模态大模型（MLLMs）和强化学习微调基线。结果表明，强模型在宽松阈值下接近人类时序对齐水平，但在严格标准下所有模型都落后于人类。人类感知研究进一步证实，专业人类编辑始终比模型输出更受偏好。

Insight: 创新点在于构建了首个专注于消息驱动视频编辑的基准，通过配对多种叙事消息和对应专业编辑来量化编辑多样性。客观分析认为，其引入的消息模糊性和上下文丰富度作为难度分层指标，以及揭示LLM-as-a-judge在该任务中的位置偏差问题，为未来模型评估提供了重要洞见。

Abstract: Video editing is fundamentally message-driven: even from the same source footage, the selected shots change depending on the narrative the editor wishes to convey. Benchmarks for a closely related task, video summarization, reduce editorial intent to a single, message-agnostic notion of saliency and thus do not account for this diversity. For evaluating message-driven video editing, we present \textbf{MEDit-Bench}, a dataset and benchmark, which pairs long-form videos with multiple editing messages and multiple professionally produced edits per message, demonstrating that different messages yield substantially different edits from the same source. We define an automatic evaluation protocol based on temporal alignment metrics, and find that an LLM-as-a-judge preference, a natural proxy for narrative quality, is unreliable for this task due to severe position bias. We additionally annotate each message with ambiguity and contextfulness scores, and show that both dimensions negatively correlate with model performance, establishing message difficulty as a meaningful stratification factor. Experiments with state-of-the-art MLLMs and reinforcement fine-tuned baselines show that while strong models approach human temporal alignment at lenient thresholds, all models fall behind humans at stricter criteria. A human perceptual study further confirms a large quality gap, with professional human edits remaining consistently preferred over model outputs.

[29] Sense it with your eyes: Sensation Generation and Understanding for Advertisements cs.CVPDF

Aysan Aghazadeh, Sina Malakouti, Adriana Kovashka

TL;DR: 本文首次系统研究了广告中感官刺激的生成与理解，提出了Sensory Ad数据集、感官分类任务（SenseClass）以评估LLMs和MLLMs，开发了自动评估指标SenseScore，并设计了多智能体框架SAGA来提升广告生成中的信息对齐、感官唤起和说服力。

Details

Motivation: 感官广告通过视觉线索唤起人类感官，增强说服力，但AI在生成和理解这类内容方面尚未深入探索，因此本文旨在填补这一空白。

Result: 在Sensory Ad数据集上，SenseScore指标与人类判断高度一致；SAGA框架在信息图像对齐、感官唤起和说服力方面表现优异，为感官感知的视觉说服奠定了基础。

Insight: 创新点包括首个感官广告数据集与任务定义、自动化评估指标SenseScore，以及多智能体生成框架SAGA，这些共同推动了AI在创意广告中感官唤起能力的研究。

Abstract: Sensory advertising evokes human senses through visual cues, enabling audiences to mentally simulate experiences and increasing persuasive impact. Despite the recent increase in using AI in generating and understanding creative and persuasive content, how advertisements visually evoke sensations remains largely unexplored. In this work, we introduce the first study of understanding, evaluating, and generating sensory ads. We introduce the Sensory Ad dataset, and define sensation classification tasks (SenseClass) to benchmark LLMs and MLLMs. We further propose SenseScore, an automated evaluation metric for sensation evocation achieving strong agreement with human judgments. Finally, we introduce the Sensory Ad Generation (SenseGen) task and propose SAGA, a multi-agent framework that improves message image alignment, sensory evocation, and persuasion. Our work establishes a foundation for sensory-aware visual persuasion.

[30] Gaussian Volumetric Representation for Efficient Shear-Warp Visualization cs.CV | cs.GRPDF

Mayuri Mathur, Ojaswa Sharma

TL;DR: 本文提出了一种基于高斯分布的体素表示方法，用于高效的可视化密集医学体数据，通过蒙特卡洛体素估计和课程学习策略，在稀疏监督下学习解剖细节，支持剪切-扭曲体绘制等切片渲染方法，实现了高帧率和压缩比。

Details

Motivation: 解决大规模体数据可视化中计算成本高的问题，旨在保持解剖保真度和渲染速度的同时，减少密集体素处理的计算开销。

Result: 在稀疏监督下，该方法达到最高43.86 FPS的渲染速度，压缩比为11.31:1，适用于MRI和冷冻切片等多模态医学数据集。

Insight: 创新点包括高斯体素表示、蒙特卡洛优化和课程学习策略，结合稀疏体素和切片采样，在降低计算成本的同时保持结构和纹理连续性，为医学图像高效可视化提供了新思路。

Abstract: Medical image visualization requires volumetric rendering algorithms that preserve anatomical fidelity while maintaining high rendering speeds. To address the high computational cost of large volumetric datasets, we propose a Gaussian-based volumetric representation for efficient visualization of dense medical volumes without compromising structural and radiometric details. We optimize the proposed representation using Monte Carlo volumetric estimation, which enables training on a highly sparse subset of voxels while maintaining consistency with the dense volumetric objective. In addition, we introduce a curriculum learning strategy that progressively incorporates structured slice-based sampling during training. Sparse voxel samples provide an early global coverage of the volume, while slice samples capture spatially correlated regions that aid geometric structure and texture continuity. This combination enables the Gaussian representation to learn anatomical details of various structures and corresponding textures from sparse supervision while significantly reducing the computational cost associated with dense voxel processing. The learned representation supports slice-based rendering methods such as shear-warp volume rendering, enabling efficient visualization of multimodal medical datasets including MRI and Cryosection volumes while preserving anatomical structures. Using sparse supervision, our method achieves up to 43.86 FPS rendering with a compression ratio of 11.31:1.

[31] Balanced Soft mixture-of-expert model for Glaucoma Detection cs.CV | cs.AIPDF

Sai Venkatesh Chilukoti, Krishna Rauniyar, Min Shi, Xiali Hei

TL;DR: 本文提出了一种用于青光眼检测的平衡软混合专家模型，该模型包含三个专家和负载均衡损失函数，旨在解决多模态学习中由于联合学习目标导致的模态表示不平衡和欠优化问题。

Details

Motivation: 青光眼是一种导致不可逆视力丧失的疾病，早期检测至关重要。尽管多模态模型通过结合不同成像模态提升了检测准确性，但面临模态表示不平衡和欠优化的挑战。

Result: 在AUC指标上，所提方法超越了所有单模态基线、传统多模态模型以及当前最先进的平衡多模态模型，达到了SOTA水平。

Insight: 创新点在于引入负载均衡损失来平衡多模态表示，该方法可泛化至其他疾病检测（如糖尿病视网膜病变），为多模态学习中的表示优化提供了新思路。

Abstract: Glaucoma is a group of eye diseases that damage the optic nerve, often caused by elevated intraocular pressure. It is a leading cause of irreversible vision loss and is typically developed slowly and painlessly, making it difficult to notice until significant damage has occurred. Therefore, early detection is crucial to prevent or slow the progression of vision loss. In recent years, deep learning based uni-modal models have improved the accuracy and efficiency of glaucoma detection, empowering doctors with tools for earlier diagnosis, better monitoring, and timely treatment. Building on this, multi-modal models have emerged, leveraging the strengths of different imaging modalities to learn richer and more robust representations, further enhancing glaucoma detection accuracy. However, multi-modal learning faces challenges such as imbalanced and under-optimized uni-modal representations due to joint learning objectives. To address this, we propose a balanced soft mixture-experts model with three experts and load balancing loss. The performance is measured by AUC, our proposed method surpasses the performance of all uni-modal baselines, conventional multi-modal models, and current stateof- the-art balanced multi-modal models. The proposed model can be generalized to other disease detections such as diabetic retinopathy.

[32] HOME: Robust Hough-space Matching Method for Structured and Textureless Videos cs.CV | cs.ROPDF

Masaki Satoh

TL;DR: 本文提出了一种名为HOME的轻量级无训练特征匹配框架，用于解决在结构化或纹理缺失环境中基于点的特征匹配方法（如ORB）失效的问题。该方法通过将图像转换到霍夫空间，将全局线性结构映射为稳定的局部极值点作为关键点，从而将复杂的线匹配问题转化为高效的一维点匹配问题。

Details

Motivation: 动机在于传统基于点的视觉前端（如ORB）在强线性结构主导或纹理缺失的结构化环境中经常失效，而现有的基于线段的SLAM系统又因线段提取和描述算法计算量大，难以满足实时边缘机器人应用的需求。

Result: 在单应性估计任务上的大量评估表明，HOME在基于点的方法失效的挑战性场景中实现了鲁棒的配准，并且其运行速度远快于现有的基于线的方法。

Insight: 创新点在于提出了一种将图像映射到霍夫空间以提取稳定一维极值点作为关键点的新范式，其设计的一维径向描述子在数学上保证了旋转和平移不变性，无需显式的方向估计开销，实现了高效鲁棒的匹配。

Abstract: Visual front-ends for robotic localization typically rely on point-based features such as Oriented FAST and Rotated BRIEF (ORB), which frequently fail in structured environments dominated by strong linear structures or textureless surfaces. While line-based Simultaneous Localization and Mapping (SLAM) systems mitigate this by utilizing line segments, conventional line extraction and description algorithms are computationally prohibitive for real-time edge robotics. To address this fundamental bottleneck, we propose HOME (Hough-space One-dimensional Matching of Extrema), an ultra-lightweight, training-free feature matching framework. HOME transforms images into Hough space, mapping global linear structures to stable local extrema, which serve as keypoints, thereby reformulating complex line matching into highly efficient one-dimensional point matching. The proposed 1D radial descriptor mathematically guarantees rotational and translational invariance without the overhead of explicit orientation estimation. As a proof of concept to validate the matching accuracy and efficiency of HOME, this paper focuses on homography estimation. Extensive evaluations demonstrate that HOME achieves robust registration in challenging scenarios where point-based methods fail, operating at a much faster speed than existing line-based methods. Extending this robust matching engine to full 3D pose estimation remains a highly promising future direction.

[33] Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors cs.CVPDF

Jaeha Kim, Kyoung Mu Lee

TL;DR: 本文提出了一种名为Noise-Free One-Step LoRA的方法，用于任务驱动的图像恢复（TDIR）。该方法利用预训练扩散先验进行确定性的单步前向传播，避免了传统扩散模型因随机噪声引入的任务不一致性问题，并通过LoRA适配模块和任务保持的GAN训练策略，在提升图像感知质量的同时保持下游任务性能。

Details

Motivation: 解决退化图像不仅影响视觉质量，还会损害下游高级视觉任务的问题。现有基于扩散先验的TDIR方法存在随机性，因为采样过程依赖随机噪声，可能破坏任务一致性。

Result: 在分类、分割和检测任务上的大量实验表明，该方法在多个基准上超越了先前的TDIR方法，并在真实世界退化图像和OCR任务上验证了其泛化能力，实现了SOTA性能。

Insight: 创新点在于揭示了确定性的单步扩散前向传播能有效提升TDIR，且LoRA适配模块比ControlNet式条件化更有效；同时提出的任务保持GAN训练策略在不牺牲任务性能的前提下改善了感知质量。

Abstract: Degraded images not only reduce visual quality but also impair downstream high-level vision tasks. Task-driven image restoration (TDIR) addresses this issue by jointly optimizing restoration quality and task performance. Recent works show that pretrained diffusion priors benefit TDIR, yet diffusion-based restoration is inherently stochastic, as the sampling process depends on a random noise term, which can undermine task consistency. In this paper, we show that a deterministic, noise-free one-step forward pass with pretrained diffusion priors can substantially improve TDIR, but the benefit critically depends on the adaptation module: LoRA yields consistent gains, whereas ControlNet-style conditioning does not. This enables one-step forwarding that surpasses conventional multi-step diffusion TDIR baselines. Furthermore, we introduce a task-preserving GAN training strategy that improves perceptual quality without sacrificing task performance. Extensive experiments on classification, segmentation, and detection demonstrate consistent gains over prior TDIR methods, and we further validate generalization on real-world degraded images and OCR.

[34] RDVSv2: A Large-scale Benchmark for RGB-D Video Salient Object Detection cs.CVPDF

Tianyu Li, Jiahao He, Keren Fu, Qijun Zhao

TL;DR: 本文提出了RDVSv2，一个用于RGB-D视频显著目标检测的大规模基准数据集，包含249个视频序列和29,077个带注视点引导标注的帧级显著对象掩码。同时，基于Segment Anything Model 2 (SAM2) 构建了一个强基线模型，通过参数高效微调策略融合RGB、深度和光流信息。

Details

Motivation: 现有RGB-D视频显著目标检测数据集规模小、标注质量有限，且深度线索几何一致性不足，阻碍了该领域的发展。

Result: 实验表明，RDVSv2对现有方法更具挑战性；所提出的基线模型在RDVSv2及现有RGB-D VSOD基准上均达到了最先进的性能水平。

Insight: 主要创新点在于构建了大规模、高质量、几何一致的RGB-D视频显著目标检测基准，并提出了一个基于SAM2的、通过参数高效微调融合多模态信息的强基线模型，为相关多模态视频理解任务提供了有价值的资源。

Abstract: We introduce RDVSv2, a large-scale benchmark for RGB-D video salient object detection (RGB-D VSOD) with dense frame-level annotations. Existing datasets in this emerging field are often limited in scale and annotation quality, while also relying on less geometry-consistent depth cues. To address these limitations, RDVSv2 is built from publicly accessible stereoscopic online videos and contains 249 video sequences with 29,077 annotated frames. It includes depth maps derived from stereoscopic videos, together with frame-wise salient object masks annotated with eye-tracking guidance. Compared with existing datasets, RDVSv2 is much larger in scale and covers more diverse and challenging scenarios. In addition, we establish a strong baseline for RGB-D VSOD based on Segment Anything Model 2 (SAM2). Specifically, we employ a parameter-efficient fine-tuning (PEFT) strategy to adapt the SAM2 encoder to jointly encode RGB, depth, and optical flow cues. Extensive experiments show that RDVSv2 is substantially more challenging for existing RGB-D VSOD methods. Meanwhile, the proposed baseline achieves state-of-the-art results on RDVSv2 and existing RGB-D VSOD benchmarks. We hope that RDVSv2 and the provided baseline will serve as useful resources for future research on RGB-D VSOD and related multi-modal video understanding tasks. Our dataset and code will be available at https://github.com/ltynick/RDVSv2.

[35] Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment cs.CVPDF

Siyuan Xu, Yan Wang, Haofei Song, Lili Gao, Jiansheng Wang

TL;DR: 本文提出DMCoStain，一种用于染色转移的数据-模型协同优化框架，旨在从H&E染色图像计算生成IHC染色图像。该框架通过迭代优化训练数据和模型能力，并结合基于视觉语言模型的多模态专家引导精细选择策略，以提升染色准确性和可解释性。

Details

Motivation: IHC染色能提供关键分子信息但成本高且需专业知识，而现有染色转移方法在像素未对齐监督下对异质性生物标志物缺乏统一且可解释的建模。

Result: 在多种组织和生物标志物上的大量实验表明，DMCoStain实现了最先进的准确率。

Insight: 创新点包括数据与模型迭代协同优化的范式，以及基于模拟病理学家推理的IHC阳性表达视觉语言模型构建的多模态专家引导精细选择策略；所构建的大规模指令跟随数据集ImmunoInstruction也为领域提供了新资源。

Abstract: Histopathological examination primarily relies on hematoxylin and eosin (H&E) and immunohistochemistry (IHC) staining. Although IHC provides critical molecular information, it is costly and requires specialized expertise. Stain transfer provides an efficient alternative by computationally generating IHC from H&E images, but remains challenged by unified and interpretable modeling for heterogeneous biomarkers under pixel-unaligned supervision. We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer. It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency. To refine training data in a clinically meaningful manner, it incorporates the Multimodal Expert-Guided Finer Selection (MEGFS) strategy, built upon a pioneering IHC-positive-expression (IPE) vision-language model (VLM) that emulates pathologist reasoning. To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples. Extensive experiments on multiple tissues and biomarkers demonstrate that DMCoStain achieves state-of-the-art (SOTA) accuracy. This paradigm offers strong practical value, and MEGFS also functions as a specialized evaluation tool for future model development. Dataset, code, and more details are in https://github.com/SikangSHU/DMCoStain.

[36] ANFI: Rethinking Neighbor Feature Interaction in Person Re-ID cs.CVPDF

Xulin Li, Yan Lu, Bin Liu, Jiaze Li, Qinhong Yang

TL;DR: 本文提出了一种名为自适应邻居特征交互（ANFI）的新方法，用于行人重识别任务。该方法通过同时建模亲和关系和差异关系，并采用样本自适应的权重分配，来应对噪声邻居带来的负面影响，从而在标准、跨模态和跨域设置下均表现出优越性能。

Details

Motivation: 现有基于邻居的行人重识别方法仅依赖亲和关系，其性能严重依赖于所选邻居的可靠性，在噪声邻居存在时容易失效。本文旨在解决噪声邻居场景下的有效特征交互问题。

Result: 在标准、跨模态和跨域设置下进行的广泛实验表明，该方法优于现有的基于邻居的方法和重排序方法，在各种邻居分布下均表现出优越性。

Insight: 创新点在于同时建模亲和与差异关系，并引入样本自适应权重；从新的邻域相似性中推导差异关系，比成对相似性提供更多信息；提出噪声关系监督（NRS）训练策略，逐步增强模型对噪声关系的鲁棒性。

Abstract: In person re-identification, neighbor-based methods have achieved significant success by interacting with neighbor samples to obtain more robust representations. However, existing methods rely only on affinity relations, causing their success to depend heavily on the reliability of selected neighbors. We find that affinity-only interaction often fails in challenging scenarios due to the inevitable presence of noisy neighbors. To enable effective interactions under noisy neighborhoods, we revisit neighbor-based methods under distinct reliability conditions and propose a novel Adaptive Neighbor Feature Interaction (ANFI) method. The core idea of ANFI is to account for negative effects from noisy neighbors, allowing samples to remain distinguishable from false positive neighbors. Unlike existing methods, ANFI models not only affinity relations but also discrepancy relations, and employs sample-wise adaptive weighting for these two types of relations. Given that capturing negative effects from noisy neighbors differs significantly from traditional relation learning, we derive discrepancy relations from a new neighborhood similarity, which provides more information than pairwise similarity. In addition, we propose Noisy Relation Supervision (NRS) to train ANFI, gradually injecting robustness to noisy relations into the model. Extensive experiments conducted under standard, cross-modal, and cross-domain settings, including comparisons with neighbor-based methods and re-ranking methods, demonstrate the superiority of our method across various neighbor distributions.

[37] Bi-Level Collaborative Learning for Few-Shot Scribble-Supervised Medical Image Segmentation cs.CVPDF

Xiang-Xiang Su, Yufan Ye, Yihang Zheng, Min Gan, Guang-Yong Chen

TL;DR: 本文提出了一种双层协作学习框架，用于解决医学图像分割中标注样本稀缺和稀疏监督的双重挑战。该框架通过上层可学习超像素模型提供区域结构先验，下层分割模型学习解剖语义并反馈给上层，实现双向交互与协作学习，从而在少样本涂鸦监督下生成可靠的密集伪标签进行分割学习。

Details

Motivation: 涂鸦标注虽能降低医学图像分割的标注成本，但在实际临床中标注样本仍有限，导致模型缺乏恢复完整区域和精确边界所需的结构证据，因此需要解决稀疏监督和样本稀缺的复合约束问题。

Result: 在ACDC和前列腺数据集上的少样本涂鸦监督设置下，所提框架显著优于现有的最先进涂鸦监督方法，达到了SOTA水平。

Insight: 创新点在于引入双层协作学习机制，上层超像素模型提供区域结构先验，下层分割模型反馈解剖语义，通过双向交互提升分割性能；客观分析认为，这种层次化协作策略能有效整合结构先验与语义学习，增强模型在有限监督下的泛化能力。

Abstract: Scribble annotations offer an efficient alternative to costly pixel-wise labeling for medical image segmentation, yet in real clinical scenarios, scribble-annotated samples are often still limited, imposing the dual challenges of sparse supervision and annotated sample scarcity. These compounded constraints severely deprive models of the structural evidence needed for complete region recovery and precise boundary delineation. To break this bottleneck, we propose a bi-level collaborative learning framework for few-shot scribble-supervised medical image segmentation. Specifically, an upper-level learnable superpixel model is introduced to provide region-structural priors for lower-level segmentation, while superpixel-based region-wise pseudo-label propagation and a spatial-prior-guided filtering strategy are performed to generate reliable dense pseudo-labels for segmentation learning. Meanwhile, the anatomical semantics learned by the lower-level segmentation model under the guidance of the current superpixels are fed back to the upper level, further driving it to learn region-structural representations better aligned with the segmentation task. Through bidirectional interaction and collaborative learning between the upper and lower levels, the proposed framework significantly outperforms existing state-of-the-art scribble-supervised methods on the ACDC and Prostate datasets under the few-shot scribble-supervised setting.

[38] Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation cs.CVPDF

Zheng Tong, Yang Liu, Wanshu Fan, Jing Qin, Zhongbin Han

TL;DR: 本文通过系统性范围综述，探讨了医疗领域中基于大语言模型和多模态基础模型的智能体AI系统的架构、应用、评估及临床转化挑战。研究发现，当前研究主要集中在使用外部工具的单智能体、基于检索的工作流、多模态智能体以及多智能体系统，应用于医学问答、影像解读、电子健康记录分析等领域，但证据基础仍以公共基准、模拟环境和回顾性数据为主。

Details

Motivation: 动机在于明确医疗领域智能体AI的范围，并指出当前评估实践与临床使用要求之间的差距，旨在为临床转化提供清晰的路径。

Result: 研究筛选了1649条记录，最终纳入557项符合预定义标准（如目标导向任务执行、工具使用、反馈优化等）的独特研究，揭示了当前证据基础在过程可靠性、不确定性、安全性等方面评估不一致的现状。

Insight: 创新点在于系统性梳理了医疗智能体AI的研究现状，并强调了临床转化需要更清晰的定义、可重复的评估、可审计的监督、互操作的系统设计以及在真实临床工作流中的前瞻性验证。

Abstract: Large language models and multimodal foundation models are enabling medical artificial intelligence (AI) systems to move beyond isolated prediction and undertake multistep clinical tasks that require planning, tool use, memory, iterative correction, and coordination among specialized agents. However, the scope of agentic AI in medicine remains unsettled, and current evaluation practices are not yet aligned with the requirements of clinical use. We conducted a scoping review with systematic evidence mapping across five electronic sources, screened 1,649 exportable records, and provisionally included 557 unique studies that met predefined criteria for goal-directed task execution, tool use, interaction with external resources, feedback-based refinement, or multi-agent collaboration. The included studies describe single agents that use external tools, workflows supported by retrieval and external knowledge, multimodal agents, and multi-agent systems applied to medical question answering, image interpretation, electronic health record analysis, drug safety, and clinical trial prediction. The evidence base remains dominated by public benchmarks, simulated settings, retrospective datasets, and small-scale expert evaluation. Process reliability, evidence traceability, uncertainty, safety, workflow impact, and external validity are evaluated less consistently. Clinical translation will depend on clearer definitions, reproducible evaluation, auditable oversight, interoperable system design, and prospective validation in real-world clinical workflows.

[39] Seen, Said, or Forgotten? A Causal Audit of Visual KV Memory Across Dialog Turns cs.CV | cs.AIPDF

Hong Chen, Kang Chen, Yuxuan Fan, Bo Wang, Yubo Gao

TL;DR: 本文提出了因果视觉记忆审计（CVMA）框架，用于评估多模态对话系统中视觉键值（KV）记忆的遗忘安全性。研究发现，当前基于注意力的视觉区域选择机制在预测未来有用性方面表现不佳，甚至可能随机更差，而安全遗忘主要依赖于未来对视觉的低依赖或事实已被语言化，而非当前的低注意力。

Details

Motivation: 解决多模态助手在单次编码图像后，于多轮对话中回答问题时，如何判断哪些视觉信息可以安全遗忘，因为未来的问题是未知的，当前认为无关的证据可能在未来至关重要。

Result: 在VisDial和ConvBench基准测试上，当前注意力机制对预测未来有用视觉区域的排名表现差于随机选择；通过控制实验发现，当后续轮次不需要视觉信息或事实已通过助手文本陈述时，聚合分数会掩盖这种失败。

Insight: 创新点在于引入CVMA框架，通过因果审计揭示视觉KV记忆的遗忘风险；客观分析表明，安全遗忘的关键是未来视觉依赖度低或事实已语言化，而非当前注意力分数，这挑战了现有注意力引导的视觉-KV淘汰假设。

Abstract: Stateful multimodal assistants encode an image once but may answer questions about it many turns later. Attention-guided visual-KV eviction assumes that evidence irrelevant now will remain dispensable, although future questions are unknown. We ask when a visual fact is actually safe to forget and introduce the Causal Visual Memory Audit (CVMA), a paired single-prefill framework that tests what later answers lose when a visual region, the whole image, or prior assistant text becomes unavailable. On VisDial and ConvBench, current attention can rank future-useful regions worse than random even though a diagnostic marginal-utility control shows substantial selection headroom. Aggregate scores hide this failure when later turns do not need vision; controlled and stock-generated histories reveal a second escape route, in which assistant-text KV replaces image KV for facts already stated but not reliably for unstated facts. In the tested stacks, safe forgetting is supported by low future visual dependence or fact-specific verbalization—not by low current attention.

[40] I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models cs.CV | cs.AIPDF

Yimao Guo, Zuomin Qu, Wei Lu

TL;DR: 本文提出了一种名为I2VShield的高效主动防御框架，旨在保护图像免受基于扩散变换器（DiT）的图像到视频（I2V）模型的滥用。该方法通过集成对抗学习的文本自适应扰动生成框架和一种无目标的多模态注意力破坏攻击，在显著降低计算成本的同时，有效破坏生成视频的时空连贯性，实现隐私保护。

Details

Motivation: 针对基于DiT的I2V模型被滥用的风险，现有主动防御方法主要依赖基于梯度的对抗攻击，需要大量GPU显存资源，计算成本高昂。本文旨在解决这一效率问题，提出一种更高效的主动防御方案。

Result: 大量实验表明，该方法在多个数据集和主流基于DiT的I2V模型上取得了极具竞争力的保护性能，特别是在破坏时空连贯性方面效果显著，同时大幅降低了计算成本。

Insight: 创新点在于提出了一个集成了对抗学习的文本自适应扰动生成框架以降低计算开销，并设计了一种针对DiT模型内部注意力机制固有脆弱性的无目标多模态注意力破坏攻击，从模型内部特征层面最大化干扰，这是一种高效且针对性强的防御思路。

Abstract: The rapid advancement of video generation models has led to the increasing misuse of image-to-video (I2V) models. Although substantial progress has been made in detecting AI-generated videos, proactive defenses against I2V models remain underexplored. In particular, current proactive defenses against I2V models predominantly rely on gradient-based adversarial attacks, which require defenders to possess GPUs with substantial memory resources (VRAM) to generate adversarial examples. To address this issue, we propose I2VShield, a privacy protection method based on generative adversarial attacks tailored to Diffusion Transformer (DiT)-based I2V models. The proposed method primarily consists of two components: (1) a text-adaptive perturbation generation framework integrating adversarial learning to mitigate computational overhead while maintaining visual imperceptibility; and (2) an untargeted Multimodal Attention Disruption (MAD) attack that exploits the inherent vulnerabilities of DiT-based I2V models, maximizing the deviation of the internal attention features from their clean states. Extensive experiments demonstrate that our approach achieves highly competitive protection performance across various datasets and mainstream DiT-based I2V models, particularly in disrupting spatiotemporal coherence, while substantially reducing computational costs.

[41] DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes cs.CVPDF

Anis Ur Rahman

TL;DR: 本文提出了DensFiLM，一种密度条件化的视频显著性模型，用于处理人群场景。该模型通过在Video Swin Transformer的瓶颈处插入一个轻量级的特征级线性调制层，利用学习到的密度嵌入生成通道级的缩放和移位参数，使解码器能够根据不同密度区域选择特征来重建显著性。

Details

Motivation: 现有视频显著性模型通常在人群场景中采用单一的注视策略，而忽略了注意力会随人群密度发生系统性变化的问题。稀疏场景鼓励跟踪个体，而密集场景则将注意力转向集体运动和场景级地标。

Result: 在CrowdFix数据集上，DensFiLM在四个随机种子上的平均NSS达到1.434，CC达到0.517，分别比ACLNet提升了14.7%和14.9%。使用预测密度进行条件化的性能与使用真实密度标签的性能相当。

Insight: 核心创新点是提出了一个轻量级的密度条件化模块，通过特征级线性调制将密度信息注入模型。研究表明，在瓶颈处进行这种条件化，比单纯增加模型容量或引入显式光流、更大时空范围和社会力扩展等复杂方法，为人群视频显著性任务提供了更有效的归纳偏置。

Abstract: Video saliency models typically apply a single fixation strategy across crowd scenes, despite systematic changes in attention with crowd density. Sparse scenes encourage tracking individuals, whereas dense scenes shift attention toward collective motion and scene-level landmarks. We introduce DensFiLM, a density-conditioned video saliency model that inserts a lightweight Feature-wise Linear Modulation layer at the bottleneck of a Video Swin Transformer. A learned density embedding produces channel-wise scale and shift parameters, allowing the decoder to reconstruct saliency from features selected for each density regime. The module adds only ~100K parameters and can use either CrowdFix density labels or the model’s own density prediction. On CrowdFix, DensFiLM achieves mean NSS 1.434 and CC 0.517 over four seeds, improving over ACLNet by 14.7% and 14.9%, respectively, while predicted-density conditioning matches oracle-label performance. Ablations show that explicit RAFT optical flow and larger temporal and social-force extensions provide no further improvement in this setting. In a centre-prior-subtraction diagnostic, density conditioning yields an NSS gain of 0.462 over the unconditioned backbone, compared with 0.124 under standard evaluation. These results show that lightweight bottleneck conditioning provides a more effective inductive bias than increasing model capacity for crowd-video saliency. Our code is available at https://github.com/aniskhan25/crowdfix-saliency.

[42] Visual prompt engineering for video models cs.CV | cs.AIPDF

Robert Geirhos, Yuxuan Li, Thaddäus Wiedemer, Neha Kalibhat, Zi Wang

TL;DR: 本文提出视觉提示工程（VIPE）方法，通过自动修改任务图像来提升视频模型在视觉推理任务中的性能。研究表明，VIPE比传统的基于文本的提示工程或测试时缩放更有效，是一种计算高效的视觉推理性能提升手段。

Details

Motivation: 随着视频模型成为视觉任务的基础模型，研究者探索是否可以通过类似语言模型的提示工程方法，即自动修改输入图像来提升视频模型的性能。

Result: 在视觉物理推理等任务中，VIPE显著提升了视频模型的推理性能，效果优于基于文本的提示工程和测试时缩放方法。

Insight: 将语言模型的提示工程思想迁移到视觉领域，通过图像编辑模型生成更逼真的场景来优化视频模型输入，为视觉基础模型提供了一种简单且计算高效的性能提升途径。

Abstract: In the age of foundation models, a model is only as good as its prompt. For this reason, prompt engineering has become an essential technique for improving language model performance. Since video models are currently becoming foundation models for visual tasks (e.g., visual reasoning), we here ask whether they similarly benefit from visual prompt engineering: automatically modifying the task image to improve model performance. For example, for a visual physics reasoning task (“Where does the ball land, after passing a set of obstacles?”), an abstract sketch-like scene can be turned into a photorealistic version with a simple call to an image editing model. We find that visual prompt engineering, or VIPE for short, improves video reasoning performance across tasks. In fact, for video models, visual prompt engineering can be even more effective than classic text-based prompt engineering or test-time scaling. Ultimately, just as text-based prompt engineering systematically improves language model performance, visual prompt engineering can serve as a simple, compute-efficient approach to elicit better visual reasoning performance from video models. Example videos on our project page at https://visual-prompt-engineering.github.io/.

[43] Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation cs.CV | cs.AIPDF

Weiming Zhuang, Jiabo Huang, Jingtao Li, Zhizhong Li, Chen Chen

TL;DR: 本文提出了Argus-Unified，一个紧凑且经济的统一多模态模型，旨在同时处理图像理解和生成任务。该模型通过利用预训练的视觉语言模型作为先验，并引入混合视觉令牌（连续令牌用于理解，离散令牌用于生成）来降低计算和数据需求。仅使用1560万数据和约2000美元成本，该模型在多个理解基准上达到SOTA，并在生成质量上与专用编码器模型相当。

Details

Motivation: 将视觉理解和生成统一在一个模型中具有巨大潜力，但由于计算和数据需求巨大，以及两种能力所需视觉特征存在冲突，这仍然具有挑战性且成本高昂。本文旨在解决这些挑战，开发一个对计算和数据需求较低的紧凑、有效的统一多模态模型。

Result: 在GQA、POPE和VQAv2基准测试中，模型在多模态理解方面达到了最先进的水平；在图像生成质量方面，与Janus、Janus-Pro等使用专用视觉编码器的模型相比具有竞争力。这些成果是在成本降低约10倍、数据使用减少约5倍的情况下实现的。

Insight: 核心创新点在于有效利用预训练视觉语言模型作为强大多模态先验，并设计了混合视觉令牌策略来协调理解与生成任务。从客观角度看，其两阶段训练流程（先学习量化器和图像解码器，再训练统一多模态建模的LLM）以及极低资源消耗的实现路径，为统一模型的开发提供了一个实用且可复现的基线，显著降低了开发门槛。

Abstract: Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data demands and conflicts between the visual features needed for these two capabilities. To address these challenges, we present Argus-Unified, a compact, effective and unified multimodal model built with low demand on computation and data. Instead of aligning modalities from scratch, Argus-Unified effectively leverages pretrained vision-language models (VLMs) that provide strong multimodal priors. Specifically, we introduce hybrid visual tokens that preserve continuous tokens for understanding while learning discrete tokens for generation from a frozen unified vision encoder. Our training pipeline includes two stages: the first stage learns a quantizer and image decoder on top of the frozen vision encoder, the second stage trains the LLM initialized from a pretrained VLM for the unified multimodal modeling. Using by far the least amount of data (15.6M) and the lowest cost (~$2,000), we demonstrate that unified multimodal models can be trained economically while achieving strong performance in both understanding and generation. Notably, our model attains state-of-the-art multimodal understanding on GQA, POPE, and VQAv2, and competitive generation quality compared to models with dedicated vision encoders (e.g., Janus, Janus-Pro), all at ~10x lower cost and with ~5x less data. We envision Argus-Unified as a useful baseline that lowers the development barrier for unified models.

[44] Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion cs.CVPDF

Junhyuk Heo, Junghwan Park

TL;DR: 该论文提出了一种基于文本反转的少样本开放词汇遥感图像分割方法，通过优化文本查询来提升模型在遥感图像上的分割性能。

Details

Motivation: 开放词汇分割模型在遥感图像上表现不佳，主要原因是文本查询（如类别名称）在视觉-语言嵌入空间中缺乏针对性，无法有效匹配遥感图像特征。

Result: 在代表性基准测试中，受影响类别的平均交并比从3.9提升至39.4；在八个遥感数据集上，该方法优于在推理时注入视觉提示的少样本方法。

Insight: 创新点在于通过文本反转技术，利用少量示例优化文本查询嵌入，无需修改冻结模型，实现了仅文本推理下的性能大幅提升，为跨领域开放词汇任务提供了新思路。

Abstract: Open-vocabulary segmentation labels arbitrary categories from a text query without per-class training, yet on remote sensing imagery it underperforms on categories it handles reliably elsewhere. We find that much of this gap traces to the text query rather than to the segmentation model. Because these models are not specialized for overhead imagery, the class name that serves as the query is often a weak address into the vision-language embedding space. We show that a better name repairs part of the gap, while the remaining failures call for an address that the tested natural-language rephrasings do not provide. We recover that address from a few examples through textual inversion on a frozen model, keeping inference text only. On a representative benchmark this raises the mean intersection over union on the affected categories from 3.9 to 39.4, and across eight remote sensing datasets it improves over few-shot methods that instead inject visual prompts at inference.

[45] Less is More: Modality-Decoupling for General AIGC Audio-Video Detection cs.CV | cs.AIPDF

Jielun Peng, Yabin Wang, Yaqi Li, Jincheng Liu, Xiaopeng Hong

TL;DR: 本文提出了一种解耦的音频-视觉AIGC检测系统DAV-Det，用于检测通用场景下的AI生成音频-视频内容。该方法挑战了现有方法依赖音视频内容对应的假设，转而采用决策级融合策略，通过独立的视觉和音频检测器分别建模取证证据，并在IJCAI-ECAI 2026 DDL 2.0 Workshop的挑战赛中取得了第一名。

Details

Motivation: 现有AIGC检测方法假设音视频内容对应，通过发现跨模态不一致性来识别伪造，但作者实证发现这一假设在通用场景中并不总是成立，因此需要更鲁棒的检测方法。

Result: 该方法在IJCAI-ECAI 2026 DDL 2.0 Workshop的通用AIGC音频-视频检测挑战赛中排名第一，最终得分为0.8460。

Insight: 创新点在于提出决策级融合优于特征级融合的论点，并设计了模态解耦的检测框架：视觉检测器利用全局、块和片段级的多粒度表示捕获空间伪造线索，音频检测器通过门控时频双分支架构建模时域和频域异常以捕捉声学伪影。

Abstract: Generative AI has rapidly expanded audio-visual forgery beyond human-centric deepfakes into general scenes. Existing AIGC detection methods assume audio-visual content correspondence, identifying forgeries by spotting cross-modal inconsistencies. However, we empirically find that this assumption does not consistently hold in general scenarios. We argue that, for general audio-visual AIGC detection, decision-level fusion is a more robust alternative to feature-level fusion. Therefore, we propose DAV-Det, a decoupled audio-visual AIGC detection system that independently models forensic evidence from each modality. The visual detector leverages multi-granularity representations at global, patch, and segment levels to capture spatial forgery cues, while the audio detector exploits both temporal and spectral irregularities via a gated temporal-spectral dual-branch architecture to model acoustic artifacts. Our method ranks 1st in the General AIGC Audio-Video Detection Challenge of the IJCAI-ECAI 2026 DDL 2.0 Workshop, with a final score of 0.8460. Code is available at https://github.com/tuffy-studio/DAV-Det.

[46] ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition cs.CVPDF

Jooyeol Yun, Jintae Park, Hyesu Lim, Junha Hyung, Hyungjin Chung

TL;DR: ReDesign是一个基于智能体分解的框架，旨在从栅格图像中恢复可编辑的设计文件。它通过选择和组合跨模态的专用工具来构建可编辑的图层层次结构，并引入优雅验证机制来确保决策过程的可靠性。论文还提出了Figma Edit Replay Benchmark来大规模评估可编辑性，实验表明ReDesign在视觉保真度和可编辑性方面优于现有基线方法。

Details

Motivation: 解决从栅格图像恢复可编辑设计文件这一常见且成本高昂的瓶颈问题，关键在于恢复多模态属性（如排版、矢量几何、颜色、分组和图层顺序）以实现编辑性。

Result: 在Figma Edit Replay Benchmark（包含909个原始Figma文件和14,796个受控编辑指令）和标准重建指标上，ReDesign实现了强视觉保真度，并在布局、颜色和文本编辑方面提供了最高的可编辑性，优于分层分解基线和串行工具使用流程。

Insight: 创新点包括：采用智能体框架跨模态组合工具以恢复可编辑结构；引入优雅验证机制进行局部反馈，防止错误累积；提出基于真实设计文件的大规模可编辑性评估基准。从客观角度看，该方法将复杂任务分解为可管理的工具交互，并通过验证提升鲁棒性，为设计自动化提供了新思路。

Abstract: Recovering an editable design file from a raster image is a common and costly bottleneck in modern design workflows, yet remains challenging since editability depends on recovering multi-modal attributes, such as typography, vector geometry, colors, grouping, and layer ordering. We present ReDesign, an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities. To keep this long decision process reliable despite imperfect tool outputs, we introduce graceful verification at each expansion, which provides local accept, prune, or retry feedback that prevents error accumulation and avoids large scale reruns. To evaluate editability at scale, we introduce the Figma Edit Replay Benchmark, consisting of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructed outputs. Across this benchmark and standard reconstruction metrics, ReDesign achieves strong visual fidelity while delivering the highest editability across layout, color, and text edits, outperforming layered decomposition baselines and serial tool use pipelines.

[47] Beyond Facial Consistency: Personalized Person Image Generation with Holistic Identity Preservation cs.CVPDF

Yuxuan Xiao, Shanshan Zhang, Jian Yang, Shengcai Liao

TL;DR: 本文提出了一种用于个性化人物图像生成的新方法，旨在同时保持局部面部细节和整体外观的身份一致性。作者首先构建了一个结合全局外观控制和局部面部控制的双分支基线框架，并针对其分支贡献不协调的问题，提出了动态平衡缩放（DBS）微调策略，包括自适应时间门控和区域感知优化，以改善协调性。此外，还引入了Pexels-100基准来评估整体身份一致性。

Details

Motivation: 现有方法通常在面部保真度和整体外观一致性之间存在权衡，往往只侧重单一层次的身份信息。本文旨在解决这一局限性，实现更全面的身份保持。

Result: 实验表明，在提出的Pexels-100基准上，DBS方法在面部保真度和外观一致性之间取得了比现有开源基线更好的权衡效果。

Insight: 核心创新点在于通过动态平衡缩放（DBS）策略协调不同身份信息分支的贡献，特别是自适应时间门控和区域感知优化，以缓解面部分支过度主导的问题，为整体身份建模提供了一个可控的基础框架。

Abstract: Personalized person image generation requires preserving subject identity across both local facial details and broader appearance cues. Existing methods typically emphasize only one level of identity information, leading to an inherent trade-off between facial fidelity and overall appearance consistency. To address this, we first propose a simple dual-branch baseline that unifies global appearance control and local facial control within a shared generation framework. This simple combination of different branches yields promising results, but suffers from instability in practice due to uncoordinated branch contributions. To this end, we propose Dynamic Balancing Scaling (DBS), a fine-tuning strategy for improving face and appearance identity coordination. DBS consists of two components: adaptive temporal gating, which dynamically modulates branch contributions along the denoising trajectory, and region-aware optimization, which improves the coordination of facial, appearance, and global supervision. Together, these designs alleviate persistent face-branch over-dominance and encourage more effective appearance-aware guidance. We also introduce Pexels-100, a benchmark for evaluating holistic identity consistency in personalized person generation. Experiments show that DBS achieves a better trade-off between facial fidelity and appearance consistency than existing open-source baselines, while providing a controllable basic framework for holistic identity modeling.

[48] Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications cs.CV | cs.CLPDF

Xianghao Zang, Zijian Jiang, Jiarong Cheng, Qianrui Teng, Ying He

TL;DR: 本文是一篇关于基于指令的图像编辑（IIE）的综述性论文，系统性地梳理了该领域的研究现状。论文围绕任务定义、数据构建、模型架构、评估标准和商业应用五个核心维度进行了全面回顾，并提出了一个用于严格评估模型性能的综合诊断性基准（CDD-IIE Bench）。

Details

Motivation: 随着大语言模型（LLMs）和视觉语言模型（VLMs）的发展，基于一句文本指令就能编辑图像的实用系统成为可能。本文旨在对该快速发展的IIE领域进行系统性的梳理和总结，以明确其技术脉络、现状与挑战。

Result: 论文通过实证比较开源解决方案，揭示了它们各自的能力与局限。此外，论文提出了一个名为CDD-IIE Bench的综合诊断性基准，旨在对模型性能的多个方面进行严格评估。

Insight: 论文的主要创新点在于提出了一个系统性的五维分析框架来组织整个IIE领域，并创造性地提出了一个综合诊断性基准（CDD-IIE Bench），这为未来模型的标准化评估提供了重要工具。从客观角度看，这篇综述的价值在于其清晰的分类学和对技术演进里程碑的提炼，有助于研究者把握全局。

Abstract: Instruction-based Image Editing (IIE) aims to transform a given image into a new one based on textual instructions. Advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have accelerated progress toward practical ``one-sentence image editing” systems. This survey presents a systematic taxonomy and comprehensive review of IIE research, structured around five core dimensions: (1) task definition and hierarchical categorization of editing operations, (2) methodologies for training data construction, (3) architectural evolution from GAN-based to diffusion and autoregressive paradigms, (4) standardized evaluation metrics and benchmark development, and (5) introduction of commercial solutions. Our analysis shows critical technological milestones across model generations. We further propose a Comprehensive, in-Depth, and Diagnostic benchmark for IIE task (CDD-IIE Bench), which can rigorously assess the multiple aspects of model performance. Through empirical comparisons of open-source solutions, we highlight their respective capabilities and limitations. Finally, we discuss future research directions to advance the field.

[49] Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact cs.CV | cs.CLPDF

Mateusz Kozłowski

TL;DR: 本文对一项胸部X光视觉语言模型基准测试进行了法证可重复性审计，发现从原始协议到发布成果之间存在多处不一致，包括图像渲染错误、数据集分割丢失、报告截断等问题，导致统计结果发生显著变化，因此撤回了原论文的性能排名和临床声明。

Details

Motivation: 医学影像AI基准测试通常假设各环节（数据集、DICOM渲染、提示词、API调用、自动标注等）的一致性，但缺乏实际验证；本文旨在通过追溯性审计，检验一个已存档的VLM试点项目从设计协议到最终发布成果的可重复性。

Result: 审计发现：300次计划模型调用中297次返回非空报告；部分图像渲染未进行必要的极性反转；数据集分割信息丢失；未经验证的提取器将5份报告截断至4000字符；重建369个完整病例块后，Cochran’s Q从154.73变为182.29；45项McNemar比较中，27项未校正p值<0.05，20项经Holm校正后仍<0.05。

Insight: 研究揭示了医学AI基准测试中从协议到实践的多环节脱节风险，强调了机器可验证控制（如队列定义、DICOM渲染、提示词与模型标识、标注来源等）的重要性，为未来基准测试的透明性和可重复性提供了具体改进方向。

Abstract: Medical-imaging AI benchmarks combine datasets, DICOM rendering, prompts, provider APIs, automated labels, statistical code, manuscripts, and repository releases. Agreement across these artifacts is usually assumed rather than tested. We performed a retrospective forensic reproducibility audit of a preserved chest-radiograph vision-language model (VLM) pilot; no model was called again and no image or report was newly annotated. We traced prompt bindings, DICOM metadata, output completeness, label extraction, matched analyses, and release propagation. Of 300 planned model-prompt calls, 297 yielded nonempty reports. Sixty Claude calls labeled A/B were executed with the same C prompt. The 30 studies represented 28 patients. Four MONOCHROME1 images were rendered without required polarity inversion, dataset split membership was not retained, and the unvalidated extractor truncated five reports to 4000 characters. Reconstructing one common cohort of 369 complete case-finding blocks changed Cochran’s Q from 154.73 to 182.29. Of 45 McNemar comparisons, 27 had unadjusted p < 0.05 and 20 remained below 0.05 after Holm adjustment. These values describe only the archived automated-label matrix; they do not recover the intended prompt comparison or establish clinical performance. We withdraw the original performance, ranking, prompt-effect, and clinical claims and specify machine-verifiable controls for cohort, DICOM rendering, prompt and model identity, call status, annotation provenance, keyed analysis, and derived artifacts.

[50] A systematic evaluation of machine learning classifiers for event-by-event background rejection in LAFOV PET scanners cs.CV | physics.med-phPDF

Konrad Klimaszewski, Michał Obara, Mateusz Bala, Beatrix C. Hiesmayr, Lech Raczyński

TL;DR: 本文系统评估了XGBoost、AdaBoost和神经网络分类器在LAFOV PET扫描仪中用于逐事件背景抑制的性能。研究将符合事件分类构建为监督多类问题，使用蒙特卡洛模拟数据，比较了基于衰减因子、光子时间差、能量和与能量差的4特征集和包含拓扑变量的6特征集。结果表明，4特征模型在不同体模几何结构间泛化能力显著更好，最佳模型在NEMA IEC和XCAT体模上分别达到0.74和0.69的准确率，优于传统基于几何的截断方法。

Details

Motivation: LAFOV PET扫描仪带来灵敏度提升的同时，也显著增加了来自偶然符合、体模散射和探测器散射光子的背景率。现有机器学习方法多针对特定背景成分进行后处理，而非在原始数据上进行逐事件分类。

Result: 在西门子Biograph Vision Quadra扫描仪的蒙特卡洛模拟中，使用NEMA IEC和人体XCAT体模进行评估。4特征XGBoost模型在不同体模间泛化能力最佳，准确率损失仅0.04（6特征模型损失0.13）。最佳模型在NEMA IEC和XCAT体模上分别达到0.74和0.69的准确率，优于传统几何截断方法。

Insight: 创新点在于将符合事件分类构建为监督多类问题，并系统评估不同机器学习分类器作为重建前滤波器的性能。研究发现紧凑的4特征集具有更好的跨体模泛化能力，可作为传统截断选择的有效且几何无关的替代方案，但受限于对体模散射符合的抑制能力，进一步提升图像质量需要更大输入表征或专门处理散射成分。

Abstract: The introduction of LAFOV PET scanners brings significant sensitivity gains but also a substantial increase in the background rate from accidental coincidences, phantom-scattered and detector-scattered photons. While machine learning methods have been applied to background reduction in PET imaging, they target specific background components in post-processing rather than event-by-event classification on the raw data. In this work, we formulate coincidence classification as a supervised multi-class problem and evaluate XGBoost, AdaBoost and Neural Network classifiers as pre-reconstruction filters, using Monte Carlo simulations of the Siemens Biograph Vision Quadra scanner with NEMA IEC and anthropomorphic XCAT phantoms. We investigate two feature sets: a 4-feature representation based on the Attenuation Factor, photon time difference, energy sum, and energy difference, and an extended 6-feature set that incorporates topology-based variables. A systematic robustness study via cross-phantom inference reveals that the 4-feature models generalise significantly better across different phantom geometries, with XGBoost suffering an accuracy loss of only 0.04 compared to 0.13 for the 6-feature variant. Our best models achieve accuracies of up to 0.74 and 0.69 for the NEMA IEC and XCAT phantoms, respectively, outperforming traditional geometry-based cuts. However, we show that this compact feature set not only provides limited suppression of in-phantom scattered coincidences, but it also can lead to non-trivial spatial patterns. With scattered coincidences being the dominant background component in clinical conditions, this suggests that while the method serves as an effective and geometry-agnostic replacement for traditional cut-based selection, meaningful further gains in image quality will require either larger input representations or dedicated treatment of the phantom-scattered component.

[51] Image Quality Dependent Degradation for AI Systems cs.CV | cs.AIPDF

Yannick Kees, Elena Hoemann, Frank Köster, Sven Hallerbach

TL;DR: 本文提出了一种针对自动驾驶AI系统的设计策略，旨在处理低质量输入图像。通过基于归一化流估计图像质量，并据此动态降低网络置信度阈值，系统能够在图像质量较差时更谨慎地检测物体，从而避免最关键的误检错误。

Details

Motivation: 自动驾驶等AI系统严重依赖输入图像质量，低质量图像（如噪声、黑暗）会导致预测不准，且不同类型的错误对系统可信度影响不同（例如漏检行人比误检更关键）。因此，需要一种方法在图像质量下降时仍能避免关键错误。

Result: 论文将所提方法应用于最先进的目标检测模型进行实验，但摘要未提及具体定量结果或基准测试表现。

Insight: 创新点在于提出了一种“故障降级”系统设计，通过图像质量估计动态调整置信度阈值，而非依赖备用方案；同时，利用归一化流将输入图像与训练数据比较来估计质量，这是一种新颖的质量评估方法。

Abstract: Perception is one of the primary applications where neural networks outperform conventional algorithms. One example is AI systems for automated driving, which can detect pedestrians based on image data and avoid them accordingly. A substantial challenge with these AI systems is that their output depends heavily on the quality of the input images. For example, if an image is of inferior quality due to heavy contamination, such as noise or darkness, accurate predictions are hardly feasible. Additionally, various types of errors can occur, each with varying relevance to the trustworthiness of the underlying AI system. In particular, it may be more critical not to detect an existing person than to detect a person where there is none. Therefore, we want to show that we can still avoid the most critical errors in situations of inferior image quality. To achieve this, we aim to establish a fail-degraded system by lowering the network’s confidence threshold based on the estimated image quality, enabling it to detect objects more cautiously in uncertain situations. Additionally, we present a novel method for estimating the quality of incoming images by comparing them to the training data using normalizing flows. We will also conduct experiments applying our method to state-of-the-art object detection. In summary, we will present a design strategy for AI-based systems in automated driving that can deal with poor-quality input data without resorting to fallback solutions. Such measures enhance trust in AI-based systems and lead to an increased provision of the AI component.

[52] Towards Faithful Sentimental Image Captioning via Evidence-Aware Multi-Agent Reasoning cs.CVPDF

Tiecheng Cai, Zexian Yang, Chao Chen, Shanshan Lin, Xiangwen Liao

TL;DR: 本文提出了SEA-Cap，一个基于证据感知的多智能体系统，用于实现忠实且基于证据的情感图像描述。该方法通过情感证据挖掘器提取局部情感线索，并利用生成器、幻觉检查器和仲裁器通过共享黑板进行协作迭代，以在表达情感的同时确保视觉保真度。

Details

Motivation: 现有情感图像描述方法在情感表达与视觉保真度之间难以平衡，常因局部基础不足和缺乏情感验证机制而产生幻觉。本文旨在解决这一局限性。

Result: 在两个基准数据集上的大量实验表明，SEA-Cap有效缓解了幻觉问题，并取得了最先进的性能。

Insight: 创新点在于将情感控制从全局属性转移到可验证的对象级证据，并设计了一个多智能体协作框架，通过显式地根据挖掘的视觉证据审计生成内容，确保情感准确性和事实一致性。

Abstract: Sentimental Image Captioning (SIC) requires balancing emotional expression with visual fidelity. Existing methods often struggle with this trade-off, leading to hallucinations due to insufficient local grounding and the lack of sentimental verification mechanisms. To address these limitations, we propose SEA-Cap, a Sentiment-Evidence-Aware Multi-Agent System for faithful and evidence-grounded sentimental image captioning. SEA-Cap incorporates a Sentiment Evidence Miner that extracts structured, local affective cues to shift sentiment control from global attributes to verifiable object-level evidence. Leveraging this evidence, our framework orchestrates a collaborative workflow where a Generator, Hallucination Checker, and Arbitrator iteratively refine captions via a shared blackboard. By explicitly auditing generated content against mined visual evidence, SEA-Cap ensures both sentiment accuracy and factual consistency. Extensive experiments on two benchmark datasets demonstrate that SEA-Cap effectively mitigates hallucinations and achieves state-of-the-art performance.

[53] Fine-Grained Food Image Understanding via Target-Aware Data Alignment cs.CVPDF

Jui-Feng Chi, Wei-Lun Chu, Bruce Coburn, Jinge Ma, Fengqing Zhu

TL;DR: 本文提出了一种面向细粒度食品图像理解的数据中心化多模态对齐方法，通过目标感知数据选择和基于VLM的标题精炼来构建高质量图像-文本对，并训练互补的CLIP风格检索专家，结合分层VLM辅助的多专家决策融合策略，显著提升了细粒度食品描述与识别的性能。

Details

Motivation: 解决细粒度食品视觉语义理解任务中，基于异构网络收集的图像-文本对训练CLIP风格模型时存在的目标域差距和跨模态错位问题，例如图像分布不匹配、标题噪声多、多语言或视觉基础弱。

Result: 在细粒度食品检索任务上，数据精炼策略显著优于原始网络监督，仅基于VLM的标题精炼就带来约19%的平均性能提升；完整方法在检索分数上达到纯VLM检索的两倍以上，同时保持更高的效率。

Insight: 创新点在于从数据角度出发，通过目标感知筛选和VLM驱动的标题重写来对齐数据分布与模态，并设计了一种高效的层级多专家融合机制，仅在专家分歧时调用计算密集的VLM，兼顾了性能与效率。

Abstract: Fine-grained food visual–semantic understanding requires models to capture subtle distinctions across ingredients, cooking methods, doneness, color, texture, and plate composition. Although CLIP-style vision-language models provide a natural framework for this task, their effectiveness is limited when training relies on heterogeneous web-collected image–text pairs. Such data often exhibit a web-to-target domain gap and cross-modal misalignment, where images differ from the target distribution and captions are noisy, multilingual, or weakly grounded in visual content. We propose a data-centric multimodal alignment method for fine-grained food description and recognition. Our method first performs target-aware data selection to identify visually relevant training subsets, then applies VLM-based caption refinement to generate visually grounded, target-style descriptions. Using these curated image–caption pairs, we train complementary CLIP-style retrieval experts and further combine their decisions through a hierarchical VLM-assisted multi-expert decision-level fusion strategy that invokes the VLM only when experts disagree. Experiments show that our data refinement strategy significantly improves retrieval performance over naive web supervision, with VLM-based caption refinement alone yielding an average performance gain of approximately 19%. Our full method also achieves more than twice the retrieval score of pure VLM-based retrieval while remaining substantially more efficient.

[54] Explicit Layer Modeling for Video Object Insertion and Layer Decomposition cs.CVPDF

Kyujin Han, Seungjoo Shin, Sunghyun Cho

TL;DR: 本文提出了TriLayer数据集和DBL-Diffusion框架，旨在解决视频编辑中缺乏显式分层表示的问题。TriLayer是一个包含合成视频、背景视频和前景视频（含视觉特效）的大规模三元组数据集，为模型提供显式监督。基于此，DBL-Diffusion是一个双分支扩散框架，通过共享去噪和跨分支交互，联合建模RGB合成视频和RGBA前景层，并应用于分层对象插入（DBL-Insert）和视频层分解（DBL-Decompose）两个任务。

Details

Motivation: 当前大多数视频编辑系统缺乏显式的分层视频表示，这限制了其进行真实合成、对象重用和一致性操作的能力，尤其是在视频对象插入和视频层分解任务中，现有方法因缺乏显式的前景层监督而依赖于隐式推理或逐场景优化。

Result: 实验表明，显式的分层建模显著提高了插入的保真度和分解的质量，在相关基准测试中取得了改进。

Insight: 论文的核心创新点在于构建了首个大规模、对齐的显式分层视频数据集（TriLayer），并提出了一个能够联合学习合成视频与前景透明层的双分支扩散模型框架。这为视频编辑任务提供了可解释、可编辑的显式表示，避免了传统隐式方法的局限性。

Abstract: Most video editing systems still lack explicit layered video representations, limiting their ability to perform realistic compositing, object reuse, and consistent manipulation. This limitation is especially pronounced in video object insertion and video layer decomposition, where existing methods rely on implicit inference or per-scene optimization due to the absence of explicit foreground-layer supervision. We introduce TriLayer, a large-scale triplet video dataset containing aligned composite, background, and foreground videos, where the foreground layers include both object appearance and associated visual effects. This explicit supervision enables models to learn layered video representations directly rather than inferring them implicitly. Building on this dataset, we propose DBL-Diffusion, a dual-branch diffusion framework that jointly models RGB composites and RGBA foreground layers through shared denoising and cross-branch interaction. We instantiate the framework in two tasks: DBL-Insert for layered object insertion, which generates explicit RGBA layers for realistic compositing and flexible post-editing, and DBL-Decompose for video layer decomposition, which recovers foreground and background layers using triplet supervision. Experiments demonstrate that explicit layer modeling substantially improves both insertion fidelity and decomposition quality.

[55] Freq-RemoteVAR: Next-Frequency Autoregressive Modeling for Remote Sensing Change Detection cs.CVPDF

Luqi Gong, Rui Xu, Yue Chen, Chao Li, Jingqi Hong

TL;DR: 本文提出Freq-RemoteVAR，一种用于遥感变化检测的频率自回归框架。该方法将变化检测重新定义为频域中的结构化生成问题，通过从粗到细的逐频率预测范式，逐步生成变化信息，而非传统的一次性密集预测。

Details

Motivation: 现有遥感变化检测方法多采用一次性密集预测范式，直接从融合特征回归变化掩码，忽视了变化模式固有的频率特性。本文旨在通过频域建模来更好地捕捉变化模式的多尺度频率特征。

Result: 在CDD、GZ-CD和LEVIR-CD等多个基准数据集上的大量实验表明，Freq-RemoteVAR持续优于现有方法，特别是在具有复杂外观变化和噪声干扰的挑战性场景中。

Insight: 创新点包括：将变化检测重构为频域自回归生成任务；设计了频率感知的掩码标记化策略和频率VAR Transformer；提出了尺度对齐的RoPE交叉注意力模块以增强空间-频率一致性；引入了变化质量控制模块以自适应调制生成过程，抑制伪变化响应。

Abstract: Remote sensing change detection aims to identify land-cover changes from bi-temporal images. Most existing methods follow a one-shot dense prediction paradigm, directly regressing a change mask from fused features. However, such approaches overlook the intrinsic frequency characteristics of change patterns. We propose Freq-RemoteVAR, a frequency autoregressive framework that reformulates change detection as a structured generation problem in the frequency domain. Instead of predicting the change mask in a single step, we introduce a next-frequency prediction paradigm, where change information is progressively generated from coarse to fine. We design a frequency-aware mask tokenization strategy that decomposes change supervision into multi-frequency token targets via Fourier transformation and quantization. We develop a Frequency VAR Transformer, which performs causal autoregressive modeling over frequency tokens. The model starts from learned mask queries and progressively predicts frequency-level tokens conditioned on previously generated tokens and bi-temporal image features, effectively capturing long-range dependencies across frequency scales. We introduce Scale-Aligned RoPE Cross Attention (SRCA) module, which aligns frequency-domain mask queries with spatial-domain bi-temporal features under a unified coordinate system, enhancing spatial-frequency consistency during generation. We propose a Change-quality Control module that adaptively modulates the generation process through dynamic normalization, attention biasing, and spatial offset adjustment, thereby suppressing pseudo-change responses and improving robustness. Extensive experiments on CDD, GZ-CD, and LEVIR-CD demonstrate that Freq-RemoteVAR consistently outperforms existing methods, particularly in challenging scenarios with complex appearance variations and noisy disturbances.

[56] SepPrune:A Separator-based Pruning Framework for Efficient Multimodal Large Language Models cs.CVPDF

Yuchen Wang, Qihui Zhu, Yang Liu, Xiaoyan Sun, Siying Wu

TL;DR: 本文提出了一种名为SepPrune的高效、无需训练、即插即用的视觉令牌剪枝框架，用于多模态大语言模型。该方法利用模态分隔符令牌作为统一查询来对视觉令牌进行排序和选择，以减少高分辨率输入产生的大量视觉令牌所带来的巨大计算成本。

Details

Motivation: 现有视觉令牌剪枝方法要么依赖跨模态注意力而无法在预填充阶段前剪枝，要么依赖计算开销高的多样性估计。本文观察到视觉和文本令牌的注意力分数在模态分隔符令牌处达到峰值，表明这些分隔符连接了两个模态，从而提出利用这一特性进行高效剪枝。

Result: 在Qwen2.5-VL-7B模型上的实验表明，SepPrune达到了最先进的性能，在移除80.2%的视觉令牌的同时，保留了原始模型96.3%的准确率。

Insight: 创新点在于首次利用模态分隔符令牌作为统一查询进行令牌重要性排序和选择，这是一种无需训练、无需修改模型架构的轻量级剪枝方法。其核心洞察是模态分隔符在注意力机制中扮演了关键的桥梁角色，这为理解多模态交互和设计高效模型提供了新视角。

Abstract: Recent multimodal large language models (MLLMs), such as Qwen2.5-VL and InternVL3, generate large numbers of vision tokens for high-resolution inputs, leading to substantial computational cost. Existing vision token pruning methods either depend on cross-modal attention and cannot prune before the prefill stage, or rely on diversity estimation with high computational overhead. We observe that attention scores from both vision and text tokens peak at modality separator tokens, suggesting that these separators bridge the two modalities. Based on this observation, we propose SepPrune, an efficient, training-free, plug-and-play pruning method that uses the separator token as a unified query to rank and select informative vision tokens. SepPrune reuses the LLM’s built-in projection parameters and requires no architectural changes. Experiments on Qwen2.5-VL-7B show that SepPrune achieves state-of-the-art performance, retaining 96.3% of the original accuracy while removing 80.2% of vision tokens.

[57] Food Image Segmentation with LLM-Derived Ingredient Labels and Multimodal Fusion cs.CVPDF

Jui-Feng Chi, Wei-Ta Chu, Sheng-Long Lin

TL;DR: 本文提出了一种利用大语言模型（LLM）推断食材标签来增强食品图像分割性能的方法。该方法包含两个即插即用的多模态模块（LIM-F和LIM-Q），它们能将语义食材信息直接注入视觉分析流程，无需图像与文本的预对齐。在FoodSeg103基准测试中，该方法取得了最先进的性能，并且仅适度增加了训练时的GPU内存消耗。

Details

Motivation: 现有食品图像分割模型在视觉相似的食材和稀有食品类别上表现不佳，这限制了其在营养追踪和个性化健康监测等健康相关应用中的有效性。

Result: 在FoodSeg103基准上，该方法达到了最先进的性能。具体而言，将LIM-Q与Swin-L图像编码器和Mask2Former解码器结合，获得了55.0的mIoU；LIM-F在同一模型下达到54.4的mIoU。当集成到基于CNN的架构中时，mIoU也从47.7提升至49.8。

Insight: 核心创新点在于利用LLM从图像中推断食材标签作为额外的语义监督，并设计了两种即插即用的模块（LIM-F和LIM-Q）来灵活地将这些标签信息注入到不同架构（基于Transformer或CNN）的编码器或解码器中，从而无需图像-文本配对数据即可提升分割精度，提供了一种实用且可扩展的细粒度食品理解方案。

Abstract: Food image segmentation plays a vital role in health-related applications such as nutrition tracking and personalized health monitoring. However, existing models often underperform on visually similar ingredients and rare food categories. To address this issue, we propose two plug-and-play multimodal modules that enhance the segmentation performance by leveraging ingredient labels inferred from food images using large language models (LLMs). The first module, called LIM-F (Language Injection Module for Features), is designed to pair with any image encoder that produces multi-layer outputs (e.g., Swin Transformer), while the second module, LIM-Q (Language Injection Module for Queries), targets Mask2Former-style Transformer-based decoders. Both modules enable training without the need for pre-aligning images with text by directly injecting semantic ingredient information into the visual analysis pipeline. On the FoodSeg103 benchmark, the proposed method achieves state-of-the-art performance. Specifically, integrating LIM-Q into the Mask2Former decoder with a Swin-L image encoder yields a mean Intersection over Union (mIoU) of 55.0. LIM-F also demonstrates strong generalization and competitive performance, reaching an mIoU of 54.4 under the same model (Swin-L+Mask2Former). Furthermore, its applicability extends beyond Transformer-based decoders, as evidenced by an improvement from 47.7 to 49.8 mIoU when integrated into a CNN-based architecture. Notably, the improved segmentation accuracy is achieved with only a moderate (at most 3.8 GB) increase in the GPU memory consumption during training. Thus, the proposed approach offers a practical and scalable solution for fine-grained food understanding.

[58] Beyond Static Costs: Learning-Dynamics Aware Loss Functions for Long-Tailed Classification cs.CVPDF

Varad Shinde, Nikhil Kumar Shrey, Magesh Rajasekaran, Md Saiful Islam Sajol, Harshil Bhargava

TL;DR: 本文提出了一种名为学习动态感知损失（LDAL）的新型损失函数，用于解决长尾数据集分类问题。该方法通过动态调整类别权重，关注网络学习过程中的特征表示强度、类别固有学习难度以及跨周期预测稳定性，而非依赖静态类别频率。实验表明，LDAL在多个基准数据集上显著超越了现有的重加权损失函数，实现了准确性与泛化性的最佳平衡。

Details

Motivation: 解决长尾数据集中多数类主导、少数类严重不足导致的模型偏差问题，现有重加权方法通常依赖静态类别频率，忽略了网络学习每个类别的动态有效性。

Result: 在多个基准数据集上的实验结果表明，LDAL显著超越了最先进的重加权损失函数，实现了准确性与泛化性的最佳平衡。

Insight: 创新点在于将损失函数设计从静态样本计数转向动态学习进度，通过结合学习到的特征表示强度、基于预测香农熵的类别固有难度以及跨周期正则化项来连续调整权重，这是一种计算开销可忽略的纯目标函数方法。

Abstract: Deep learning models in computer vision face significant challenges when trained on long-tailed datasets, where a few majority classes dominate while many minority classes are severely underrepresented. Such imbalances frequently arise in real-world scenarios such as rare species recognition, manufacturing fault detection, and medical image understanding, leading to biased models that underperform on tail classes. Existing reweighting methods typically rely on static class frequencies to penalize the model, ignoring the dynamic nature of how effectively a network actually learns a class over time. We address this by introducing a novel Learning-Dynamics Aware Loss (LDAL) function that shifts the focus from static sample counts to dynamic learning progress. LDAL framework adjusts class weights continuously by leveraging: (i) the strength of learned feature representations (semantic scale), (ii) the intrinsic learning difficulty of each class, measured via the Shannon entropy of its predictions, and (iii) an inter-epoch regularizer term that tracks prediction shifts between consecutive epochs to stabilize training and avoid local minima. LDAL is purely a objective function which incurs negligible computational overhead while adapting to the feature learning of the model. Experimental results on multiple benchmark datasets demonstrate that our approach significantly surpasses state-of-the-art reweighting loss functions, providing an optimal trade-off between accuracy and generalizability. The source code is available at https://github.com/sdm2026/ldal

[59] Open-Ended CT Volume Segmentation with Weak Supervision from Language cs.CVPDF

Sanjay Subramanian, Junwei Yu, Zirui Wang, Rohil Malpani, Maggie Chung

TL;DR: 本文提出了一种结合体素级强监督与切片级弱监督的文本条件分割方法，用于训练CT扫描的分割模型。该方法从大量扫描-报告对中提取病灶描述及对应切片索引，通过微调通用2D图像分割模型SAM3，在ReXGroundingCT数据集上显著提升了分割性能。

Details

Motivation: 解决CT体积分割中标注数据稀缺的问题，通过利用报告中粗粒度的切片级描述作为弱监督信号，以降低对精细体素标注的依赖。

Result: 在ReXGroundingCT数据集上，该方法将分割Dice分数相对提升了8%（当有1000个全标注体积时）至22%（当仅有250个全标注体积时），证明了弱监督的有效性。

Insight: 创新点在于将报告中的自然语言描述与切片索引结合为弱监督信号，扩展了SAM3模型在医学图像分割中的应用；客观来看，这种混合监督策略为数据稀缺领域提供了可扩展的解决方案。

Abstract: We introduce a method for training a text-conditioned segmentation model for CT scans, which combines voxel-level supervision with coarse but scalable slice-level supervision from reports. We extract, from a large database of scan-report pairs, descriptions of findings with indices of slices where those findings occur. We then finetune a general-purpose 2D image segmentation model, SAM3, with standard segmentation losses from strongly labeled data and with a slice-level classification loss from the extracted weak supervision. Our results on the ReXGroundingCT dataset illustrate that this strategy improves the segmentation dice score: from an 8% relative gain when there are 1000 fully labeled volumes to 22% when there are 250 fully labeled volumes.

[60] Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QA cs.CV | cs.AIPDF

Carlos Celemin, Benedict Wilkins, Adrián Barahona-Ríos, Saman Zadtootaghaj, Nabajeet Barman

TL;DR: 本研究评估了六种视觉语言模型（VLMs）在游戏质量保证流程中，针对几何穿模异常检测任务的零样本性能。通过一个自定义探索代理在游戏关卡中收集视觉观察，并结合自动标注管道提供帧级标签，从而在无需人工标注的情况下进行受控评估。

Details

Motivation: 研究动机是探索VLMs在自动化游戏QA流程中的应用潜力，特别是针对几何穿模这一常见且视觉上具有挑战性的异常检测问题，旨在评估其作为自动化bug检测工具的可行性。

Result: 在零样本提示设置下，Gemini-3.1-Flash模型取得了最佳整体准确率，并对提示变化最为鲁棒；而开源模型（如Qwen、Gemma、Llama、Ministral）的性能则对提示设计高度敏感，表现出较大的精确率-召回率波动。所有模型在视觉模糊帧（如近接触几何、部分遮挡）上均产生大量误报。

Insight: 论文的核心发现是，当前VLMs更适合作为多阶段QA流程中的高召回率候选过滤器，而非独立的bug检测器。其创新之处在于构建了一个无需人工标注的、代理驱动的评估框架，用于系统性地测试VLMs在特定视觉异常检测任务上的敏感性和局限性，为实际工业应用提供了重要参考。

Abstract: In this work, we study the use of Vision-Language Models (VLMs) for anomaly detection in an agent-driven game Quality Assurance (QA) pipeline focusing on geometry clipping. In this evaluation, a custom exploration agent navigates a game level to collect visual observations, while the automatic annotation pipeline provides frame-level clipping labels. This setup allows us to evaluate recent VLMs on a controlled anomaly detection task without manual annotation. We benchmark six recent VLMs (Gemini, GPT, Qwen, Gemma, Llama, and Ministral) under a zero-shot prompting setting and analyse their sensitivity to four prompt variants. Our results show that while the VLMs can capture visual cues associated with geometry clipping, they all produce substantial false positives on visually ambiguous frames such as near-contact geometry and partial occlusions. Gemini-3.1-Flash achieves the best overall accuracy and is the most robust to prompt variation, while open-source models exhibit large precision–recall swings depending on the prompt design. These findings suggest that current VLMs are best suited as high-recall candidate filters within multi-stage QA pipelines rather than as standalone bug detectors.

[61] Face De-Identification: A Domain-Centric Survey from Capture to Processing cs.CV | cs.AIPDF

Hui Wei, Hao Yu, Guoying Zhao

TL;DR: 这篇论文是关于人脸去识别（Face De-Identification）领域的综述，首次从数据采集的全流程视角，统一概述了物理域、传感器域和数字域的方法。文章系统分析了各阶段的技术进展、挑战，回顾了现有评估协议，并指出了标准化基准的迫切需求以及未来的研究方向。

Details

Motivation: 随着对数据隐私和负责任AI的日益重视，人脸去识别技术旨在移除或隐藏图像/视频中的个人身份特征，以防止身份识别，同时保持对下游任务的实用性。本文旨在提供一个跨领域的统一概述，以应对该领域分散的研究现状。

Result: 作为一篇综述性论文，本文未提出具体的新方法或报告定量结果，而是对现有方法、评估协议和技术进展进行了系统性的梳理和分析。

Insight: 本文的主要创新点在于首次采用以数据采集流程为中心的视角，将人脸去识别技术划分为物理域（如可穿戴配件）、传感器域（在采集时集成隐私机制）和数字域（后处理）进行统一分析，并强调了建立标准化、综合性评估基准的重要性。

Abstract: Face de-identification (De-ID) aims to remove or conceal personally identifiable facial features in images or videos to prevent identity recognition while preserving utility for downstream tasks. With the rising emphasis on data privacy and responsible AI, face De-ID has emerged as an active research area spanning computer vision and privacy-preserving communities. Early approaches, and many contemporary ones, operate in the digital domain by modifying pixel-level or appearance-level features through post-capture processing. Recent advances extend face De-ID beyond post-processing by integrating privacy mechanisms directly into sensors during image acquisition, bridging sensing systems and downstream vision algorithms. In parallel, physical-domain methods explore wearable accessories and materials that conceal identity information in real-world environments prior to capture. In this survey, we present the first unified overview that spans the full data acquisition pipeline, encompassing the physical, sensor, and digital domains. Through this domain-centric lens, we systematically analyze current methodologies, technical progress, and the distinct challenges inherent to each stage. We then review and organize existing evaluation protocols, examining current practices and highlighting the critical need for standardized, comprehensive benchmarks. Finally, we identify key open problems and outline emerging research directions to guide future work in this rapidly evolving field. To support ongoing research, we maintain a project page that organizes relevant literature with collected datasets and open source code: https://github.com/CV-AC/Awesome-FaceDe-ID.

[62] MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities cs.CV | cs.AI | cs.LGPDF

Mingqiao Ye, Zhaochong An, Zhitong Gao, Xian Liu, François Fleuret

TL;DR: 本文提出了一种名为Modus的仅解码器架构的任意到任意多模态建模方法，该方法将所有模态对称处理，支持任意模态作为输入和输出，无需特定模态头、损失函数或任务流水线。Modus能够实现链式生成和跨模态自验证等应用，并在多个基准测试中展现出强大的开箱即用性能，与专用或多任务基线模型竞争。

Details

Motivation: 现有任意到任意模型通常从头开始训练，使用编码器-解码器或扩散架构，这影响了其性能，并阻碍了利用强大的预训练仅解码器模型作为先验知识。

Result: Modus在各种基准测试中表现出强大的开箱即用性能，使用单一模型即可与专用和多任务基线模型竞争。

Insight: 创新点在于采用仅解码器架构实现对称的任意到任意多模态建模，支持灵活的应用如链式生成和跨模态自验证，同时避免了特定模态组件，简化了模型设计。

Abstract: Any-to-any models predict any modality from any combination of others within a single network, a formulation used in multimodal vision and vision-language models, and increasingly in scientific domains such as ecology and astronomy. Existing any-to-any models are typically trained from scratch using encoder-decoder or diffusion architectures, impacting their performance and preventing them from using strong pre-trained decoder-only models as a prior. In this work, we investigate decoder-only any-to-any multimodal modeling, which treats all modalities symmetrically and supports arbitrary modalities as inputs and outputs without modality-specific heads, losses, or task pipelines. Because every modality is both an input and an output of the same model, the resulting model, named Modus, can support a range of applications, such as chained generation through intermediate modalities or cross-modal self-verification by scoring the model’s own outputs with another generated modality. Modus demonstrates strong out-of-the-box performance and is competitive with specialist and multitask baselines using a single model across various benchmarks. All materials are open-sourced at https://modus-multimodal.epfl.ch/.

[63] Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition cs.CV | cs.AIPDF

Podakanti Satyajith Chary, Barath Parthiban, Pranesh Velmurugan, Adeeba Khan, Nagarajan Ganapathy

TL;DR: 本文提出了PRISM-AH框架，用于视频级别的矛盾与犹豫（A/H）情感状态识别。该框架通过冻结的视觉、音频和文本编码器提取多模态特征，利用轻量级流式模型计算跨模态不和谐度、预测下一时间窗口以揭示犹豫信号，并结合参与者元数据。最后，通过知识引导的大型语言模型对结构化证据进行推理，并与模型预测结果进行后期融合，以提升识别性能。

Details

Motivation: 解决视频级别矛盾与犹豫（A/H）情感状态识别困难的问题，因为A/H信号源于面部、声音、语言和身体模态之间及内部的不一致，且在不同个体间表现各异。

Result: 在包含525个视频的公开测试集上，PRISM-AH取得了0.6133的宏F1分数，显著优于零样本基线的0.2827，验证了其有效性。

Insight: 创新点包括将A/H建模为随时间展开的多模态冲突，引入轻量级流式模型进行跨模态不和谐度评分和犹豫信号预测，以及结合知识引导的LLM进行结构化推理与后期决策融合，提升了模型的可解释性和性能。

Abstract: Ambivalence and hesitancy (A/H) are conflicting affective states that precede the delay or abandonment of health behaviour change. Recognition of A/H at the video level is difficult, since the signal arises from disagreement across and within facial, vocal, linguistic, and bodily modalities, and manifests differently across individuals. The proposed PRISM-AH (Predictive Reasoning over Interacting Streams for Multimodal Ambivalence/Hesitancy Recognition), is a framework that treats A/H as a multimodal conflict that unfolds over time. Frozen vision, audio, and text encoders are aligned into short time windows and passed to a lightweight streaming model that scores cross-modal dissonance, predicts each next window to expose a hesitation surprise signal, discovers behaviour prototypes, and is conditioned on participant metadata. Dense window-level annotations supervise the model as an auxiliary objective, and the decision threshold is calibrated for macro F1. A knowledge-guided large language model then reasons over structured evidence using the expert cue taxonomy of the dataset, and its verdict is fused late only when validation performance improves. On the labelled public test partition of 525 videos, PRISM-AH attains a macro F1 of 0.6133, compared to the reported zero-shot baseline of 0.2827. The reasoning gain is validated to transfer from validation to the larger test partition.

[64] LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection cs.CVPDF

Can Wang, Yuhao Wang, Yushe Cao, Canran Xiao, Fei Shen

TL;DR: LaP-Forensics是一个用于深度伪造检测的多模态推理框架，它通过结合RGB图像语义和基于重建的取证证据来增强检测能力。该方法利用冻结的Stable Diffusion DDIM反演-重建模型提供固定的重建参考，并通过残差图衡量局部一致性，再结合结构化Where-What-Why模型进行文本分析和伪影掩码预测。

Details

Motivation: 当前生成模型产生的图像视觉伪影较少，削弱了仅依赖表面外观的检测器和解释方法的有效性，因此需要引入更鲁棒的取证证据。

Result: 在UniversalFakeDetect数据集上实现了跨生成器的检测，并在官方SynthScars基准测试中取得了有竞争力的伪影定位结果。

Insight: 创新点在于提出了一种基于潜在-像素一致性的多模态取证框架，通过DDIM反演残差流提供稳定的重建参考，并采用GRPO强化学习优化文本输出与证据的一致性，增强了模型对生成伪影的鲁棒性解释能力。

Abstract: Recent generative models can produce images with few obvious visual artifacts, weakening detectors and explanations that rely only on surface appearance. We present LaP-Forensics, a multimodal framework that augments RGB semantics with reconstruction-based forensic evidence. A frozen Stable Diffusion DDIM inversion-reconstruction model provides a fixed reconstruction reference, and its residual map measures local compatibility with that reference. Independent projectors encode the RGB image and residual map before a structured Where-What-Why model predicts a textual analysis and an artifact mask.Supervised fine-tuning is followed by Group Relative Policy Optimization (GRPO), whose reward combines mask overlap with output-structure and evidence-reference terms. These text-side terms encourage the model to refer to the consistency map but do not constitute a verifier of free-form textual truth. A separate image-level head fuses RGB and DDIM-residual class features. Experiments show cross-generator detection on UniversalFakeDetect and competitive artifact localization on the official SynthScars benchmark. Controlled cue-construction, inversion-horizon, component, reward-term, and counterfactual analyses support the utility of the residual stream under the evaluated settings, while free-form textual faithfulness and reliability under post-processing remain open limitations.

[65] Schrödinger’s Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics cs.CV | cs.LGPDF

Timy Phan, Jannik Wiese, Björn Ommer

TL;DR: 本文提出了一种名为GARFIELD的概率模型，用于预测场景中物体可能的运动轨迹分布。该方法通过学习一个结构化的时空潜在表示，能够从单张图像和可选的稀疏约束中生成多种未来运动轨迹，并直接估计潜在的运动分布密度。相比于现有方法，GARFIELD在保持竞争力的运动规划性能的同时，实现了更快的轨迹采样和密度估计速度。

Details

Motivation: 现有方法在预测场景演化时，要么生成以外观为主的视频预测，要么仅采样少量轨迹而未显式建模可能的运动分布。本文旨在解决从部分观测中推理多种可能未来轨迹的问题，并显式地对场景运动学（kinematics）的概率分布进行建模。

Result: 实验表明，该方法在运动规划任务上表现出色，与大型视频生成模型性能相当，同时轨迹采样速度快97倍。其运动密度估计速度比从运动生成模型进行蒙特卡洛采样快两个数量级，支持交互式探索和不确定性感知规划。

Insight: 核心创新在于提出了一个统一的概率模型，其学习的潜在表示既能联合采样所有轨迹，又能通过一个高效的确定性密度解码器直接访问底层的运动分布。这使得未来运动的不确定性可以定位到特定的场景元素和时间步，并能通过额外约束进行渐进式细化，实现了对运动分布的高效建模与推理。

Abstract: Predicting how a scene may evolve from partial observations requires reasoning about multiple possible futures rather than committing to a single trajectory. Existing approaches either generate appearance-dominated video predictions or sample a small number of trajectories without explicitly modeling the distribution of possible motion. We introduce Goal-Aware Representations of Future kInEmatic Latent Distributions (GARFIELD), a probabilistic model of scene kinematics that learns a structured spatio-temporal latent representation of the distribution over possible futures given an image and optional spatio-temporally sparse constraints. The same latent representation enables both joint sampling of all trajectories and direct access to the underlying motion distribution through an efficient deterministic density decoder. As a result, uncertainty about future motion can be localized to specific scene elements and timesteps and progressively refined through additional constraints. Experiments demonstrate strong motion planning performance competitive with large video generation models while sampling trajectories $97\times$ faster. Our method further estimates motion densities two orders of magnitude faster than Monte-Carlo sampling from motion generation models, enabling interactive exploration and uncertainty-aware planning.

[66] Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing cs.CVPDF

Fengxiang Wang, Jiangnan Huang, Mingshuo Chen, Yueying Li, Yang Shi

TL;DR: 本文针对超高分辨率遥感图像中任务相关证据稀疏、局部且空间分散的问题，提出超越单一缩放工具的方法，构建了GeoMTVR数据集并开发了GeoLens模型，通过多工具视觉推理提升性能。

Details

Motivation: 解决MLLMs在处理超高分辨率遥感图像时，因证据分散而难以有效进行全局搜索、多区域比较等复杂推理任务的问题，发现单一缩放工具在困难任务上存在局限。

Result: 在XLRS-Bench上的实验表明，GeoLens通过结合监督微调和强化学习，在准确性、证据定位和工具使用效率上均优于直接推理和单一缩放基线，实现了更强的性能。

Insight: 创新点包括构建大规模多工具视觉推理数据集GeoMTVR，以及提出专注于工具注意力的强化学习算法，以优化工具调用、选择、应用和输出解释等关键决策，促进跨工具证据整合。

Abstract: Ultra-high-resolution (UHR) remote-sensing (RS) imagery provides fine-grained Earth-observation evidence over city-scale scenes, but poses a fundamental challenge for multimodal large language models (MLLMs): task-relevant evidence is often sparse, local, and spatially dispersed across extremely large visual contexts. A natural solution is to equip MLLMs with zoom-in tools for active local inspection. However, through a pilot study on XLRS-Bench, we find that zoom-in is only partially effective: it resolves easy and medium-level tasks with locally recoverable evidence, but saturates on hard cases requiring global search, multi-region comparison, path planning, or dispersed-evidence reasoning. Motivated by this finding, we move beyond single-tool zoom-in and introduce GeoMTVR, a large-scale Geospatial Multi-Tool Visual Reasoning dataset built from wide-area satellite imagery. GeoMTVR contains 13K UHR VQA samples with interleaved reasoning trajectories, diverse visual tool calls, and returned visual observations, enabling models to learn question decomposition, tool selection, regional inspection, object-level grounding, auxiliary visual reasoning, and cross-tool evidence integration. Beyond supervised fine-tuning, we propose a tool-attention-focused reinforcement learning algorithm that concentrates optimization on critical tool-use decisions, including when to invoke tools, which tool to select, where to apply it, and how to interpret tool outputs. By combining SFT on GeoMTVR with our RL algorithm, we develop GeoLens, a multi-tool visual reasoning MLLM for UHR RS. Experiments show that GeoLens consistently outperforms direct reasoning and single-tool zoom-in baselines, achieving stronger accuracy, better evidence grounding, and more efficient tool-use trajectories.

[67] Parallel Decoding Distillation for Fast Image and Video Generation cs.CV | cs.LGPDF

Neta Shaul, Chao Liu, Arash Vahdat, Julius Berner

TL;DR: 本文提出了一种名为并行解码蒸馏（PDD）的方法，用于加速图像和视频扩散或流模型的生成过程。该方法通过每次网络评估预测多个去噪步骤，简化了基于轨迹的蒸馏，并支持可变函数评估次数（NFE）的采样。

Details

Motivation: 当前基于变分分数蒸馏（VSD）和对抗损失的SOTA加速方法优化困难且易遭遇模式崩溃，导致视频多样性丧失和运动缺失，因此需要一种更简化、可扩展的蒸馏方法以实现快速推理。

Result: 在LTX-2.3文本到视频/音频、Wan 14B文本到视频和Qwen-Image文本到图像基准上，PDD在4-8次NFE下实现了SOTA性能，并显著提升了生成视频的多样性。

Insight: 创新点在于提出了一种无需使用雅可比向量积（JVPs）或有限差分近似来回归导数，而是学习平均速度表示的蒸馏架构和训练流程，这简化了优化并避免了模式崩溃问题。

Abstract: Generation in video diffusion or flow models is computationally expensive due to the slow and iterative sampling process. Current state-of-the-art (SOTA) acceleration methods heavily rely on variational score distillation (VSD) and adversarial losses to distill diffusion models into few-step generators. Albeit achieving high-quality video generation, these training losses are notoriously hard to optimize and suffer from mode collapse, leading to loss of video diversity and lack of motion. In this paper, we introduce Parallel Decoding Distillation (PDD), a simplified and scalable trajectory-based distillation method for fast inference of diffusion and flow matching models. Our architecture and training procedure are compatible with any pre-trained model and support sampling with a varying number of function evaluations (NFE). PDD accelerates generation by predicting multiple denoising steps per network evaluation. Conceptually, it learns a representation of the mean velocity without regressing its derivative using JVPs or finite-difference approximations. Our method achieves SOTA performance with 4-8 NFE on LTX-2.3 Text-to-Video/Audio, Wan 14B Text-to-Video, and Qwen-Image Text-to-Image. Moreover, PDD presents a significant improvement in generated video diversity.

[68] VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening cs.CV | cs.LGPDF

Syed Mhamudul Hasan, Anas AlSobeh, Hussein Zangoti, Abdur R. Shahid

TL;DR: VetClaw是一个用于早期兽医疾病筛查的边缘-云多模态智能体系统。它通过摄像头采集图像，结合可选症状描述，利用服务器端视觉语言模型进行零样本疾病分类。系统采用OpenClaw进行边缘设备调度和交互，LangGraph管理状态化筛查工作流，实现了从静态图像分类到动态、安全感知的协调系统的转变。

Details

Motivation: 解决传统静态图像分类在兽医疾病筛查中的局限性，通过构建一个能够整合视觉证据、调用外部模型、应用安全规则并处理不确定性的动态智能系统，以提高早期疾病检测的准确性和实用性。

Result: 实验表明，仅使用图像的VLM预测性能有限，而结合症状描述的多模态输入能提升零样本分类性能，系统通过工作流协调和安全检查增强了整体筛查能力。

Insight: 创新点在于将智能体交互与工作流编排分离的边缘-云架构设计，以及利用LangGraph实现状态化、可容错的工作流管理，使系统能够灵活集成工具、执行安全规则并处理复杂病例，为医疗AI系统提供了可扩展的工程范式。

Abstract: We present VetClaw, an edge-cloud multimodal agentic system for early veterinary disease screening. VetClaw uses a camera module as an edge sensing device and sends captured images, together with optional symptom descriptions, to a server-hosted vision-language model for zero-shot disease classification. The system separates agent interaction from workflow orchestration: OpenClaw provides scheduling, tool access, user interaction, and notification services on the edge device, while LangGraph manages the stateful screening workflow, including input validation, image transmission, model invocation, safety checks, conditional routing, failure handling, and structured logging. This design moves beyond static image classification by enabling the system to collect visual evidence, invoke external models, apply deterministic safety rules, and generate diagnostic-support alerts. Results show that image-only VLM prediction remains limited, whereas symptom-guided and multimodal inputs improve zero-shot classification performance. Thus, VetClaw transforms a static prediction model into a coordinated, safety-aware system that can use tools, manage workflows, handle failures, and escalate uncertain cases.

[69] Wonder: Video World Model Done Better cs.CV | cs.GRPDF

Jiacong Xu, Hanwen Jiang, Zhixin Shu, Kalyan Sunkavalli, Vishal M. Patel

TL;DR: Wonder是一个通用的视频世界模型，能够实现实时、相机可控的世界探索。给定图像或条件视频，Wonder构建一个可交互的虚拟世界，用户可以通过移动相机实时导航、发现未观测区域并重新访问已观察区域。该模型通过系统级协同设计，包括相机条件化、稀疏注意力记忆机制和训练策略优化，实现了16 FPS下多样化、分钟级视频的生成，并保持长期一致性。

Details

Motivation: 解决现有视频生成模型在实时交互、长期一致性和相机可控性方面的不足，旨在构建一个能够支持用户自由探索的动态虚拟世界。

Result: 模型能够以16 FPS的速度生成多样化、分钟级的视频，在几何、外观和动态方面保持长期一致性，支持图像到视频和视频条件生成，实现了实时重新拍摄动态场景的能力。

Insight: 创新点包括：引入密集坐标场的相机条件化方法，将相机运动直接转化为视觉证据；提出高效的基于稀疏注意力的记忆机制，实现快速精准的上下文检索；改进自强制蒸馏流程，增强模型对控制信号的响应能力和长期记忆保持。这些系统级设计为实时可控视频生成提供了新思路。

Abstract: We present Wonder, a general-purpose video world model for real-time, camera-controllable world exploration. Given an image or a conditional video, Wonder constructs a playable world where users can navigate interactively by moving the camera, discovering unseen regions, and revisiting previously observed areas in real time and over a long-term horizon. Achieving this capability requires a system-level co-design of control method, memory mechanism, and training strategy. We introduce a novel camera conditioning with a dense coordinate field whose renderings provide spatially aligned motion and orientation cues, allowing the model to interpret camera motion directly as visual evidence. To support fast and precise memory retrieval over a growing generation context, we propose an efficient sparse attention-based memory mechanism, enabling the model to selectively attend to a small set of relevant context tokens at inference time, regardless of actual context length. We further develop several techniques to rectify the self-forcing-style distillation pipeline, improving the student model’s ability to respect control signals, as well as maintaining diverse generation modes and long-term memory from the teacher. Together, these components enable Wonder to synthesize diverse, minute-scale videos at 16 FPS while preserving coherent geometry, appearance, and dynamics across long rollouts. Beyond image-to-video generation, Wonder naturally supports video-conditioned generation, allowing existing dynamic scenes to be re-shot in real time.

cs.MM [Back]

[70] AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities cs.MM | cs.CV | cs.SDPDF

Yuqing Wen, Yukai Huang, Qianqian Xie, Jiangtao Wu, Yibin Lin

TL;DR: 本文提出了AVE-Compass，一个用于全面评估音视频编辑能力的基准测试，包含精心策划的视频、编辑指令和细粒度检查项。研究发现现有SOTA模型在处理跨模态指令和保持非目标内容方面仍有困难，并进一步提出了AVE-Agent，一个模块化智能体框架，通过任务分解和迭代反馈来提升编辑效果。

Details

Motivation: 现有基准主要评估无声视频剪辑或孤立音频编辑，忽略了真实世界中音视频信号紧密耦合的特性以及复杂的跨模态编辑和一致性需求。

Result: 在AVE-Compass基准上的广泛评估表明，最先进的模型在执行跨模态指令和保持非目标内容方面仍存在困难。提出的AVE-Agent框架在指令执行、保真度和音视频对齐方面有所提升，同时保持了有竞争力的感知质量。

Insight: 创新点在于构建了一个全面的音视频编辑评估基准（AVE-Compass），并提出了一个模块化智能体框架（AVE-Agent），通过任务分解和基于评估反馈的迭代优化来处理复杂的跨模态编辑指令。

Abstract: While instruction-based video editing has advanced rapidly, real-world videos contain tightly coupled audio and visual signals, and editing one modality often requires coordinated changes in the other. Existing benchmarks primarily evaluate visual transformations on silent clips or isolated audio editing, leaving complex audio-visual editing and cross-modal consistency underexplored. We introduce AVE-Compass, a comprehensive benchmark with 145 curated source videos, 196 audio-visually coupled editing instructions, and 2,688 fine-grained checklist items. It evaluates Instruction Following, Fidelity Preserving, Realism, and Editing Intent through checklist-based MLLM judging and a dedicated realism rubric, complemented by automated cross-modal, video, and audio metrics. Extensive evaluation shows that state-of-the-art models still struggle to execute cross-modal instructions while preserving non-target content. We further propose AVE-Agent, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback. AVE-Agent improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining competitive perceptual quality.

cs.RO [Back]

[71] Leveraging Semantic Maps for City-Scale Cross-View Localization cs.RO | cs.CVPDF

Ethan Fahnestock, Erick Fuentes, Philip R Osteen, Nicholas Roy

TL;DR: 本文提出了一种利用语义地图进行城市规模跨视角定位的方法，通过视觉语言模型从全景图像中提取地标并与OpenStreetMap等先验语义地图进行关联，结合轻量级匹配器和贝叶斯滤波实现鲁棒的姿态估计。

Details

Motivation: 解决机器人在未遍历环境中利用常见先验数据（如OpenStreetMap）进行定位时，现有方法忽略或过度压缩语义信息的问题，旨在充分利用丰富的语义数据。

Result: 方法在包含11个环境的评估轨迹上验证，仅使用单个城市晴天数据训练，即可泛化到不同地点、光照、天气（如暴风雪和夜间）等挑战性场景。

Insight: 创新点在于利用视觉语言模型提取和关联语义地标，并蒸馏出轻量级匹配器以高效处理大规模地图，同时发布了包含多环境挑战的数据集以促进泛化跨视角方法的研究。

Abstract: We want robots to localize in previously untraversed environments against commonly available prior data. Rich semantic data available from OpenStreetMap can be useful in this task. However, existing methods either ignore this semantic information, directly matching panoramas and overhead imagery, or dramatically compress the semantic information, working with a small set of fixed classes. To leverage this rich semantic information, two challenges need to be overcome. First, useful semantic information needs to be extracted from the robot’s egocentric observations. Second, the observed information must be quickly associated with the large prior semantic map (e.g., up to 628 km^2). We show that VLMs are effective at both extracting relevant landmarks from panoramas, and identifying feasible correspondences between these landmarks and prior overhead landmarks. However, using VLMs to propose all correspondences scales poorly as the number of mapped landmarks increases. Instead, we propose distilling a lightweight matcher from a VLM which computes correspondences for all entities in a map. We use this output to form an observation likelihood which is fused over time with a Bayes filter to create a time series of pose estimates. To support further investigation into generalizable cross-view methods that leverage semantic information, we release a dataset of extracted semantics and evaluation trajectories spanning eleven environments, including panoramas we collected in a snowstorm and at night in Boston. We demonstrate our method, trained on a single city’s fair-weather data, generalizes across location, lighting, weather, and other challenges. Code and datasets are available at https://efahnestock.github.io/loci/.

[72] HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone cs.RO | cs.CV | cs.LGPDF

Simple AI, :, Yuteng Wei, Jinming Ma, Jiawei Wang

TL;DR: 本文提出了HiFi-UMI系统，一个用于生成高保真、可扩展的机器人操作演示数据的便携式采集系统。该系统通过头戴式离线立体惯性SLAM、原生相对位姿、微秒级同步触发和超广角相机等技术，实现了无需外部跟踪基础设施的毫米级末端执行器精度。实验表明，仅使用该系统生成的数据进行后训练的策略，无需任何真实机器人数据，即可直接在真实机器人上部署，并在多个骨干模型上达到与领域内遥操作基线相当甚至更好的性能。

Details

Motivation: 当前可部署操作策略的学习受限于高保真且可扩展数据的稀缺性。真实机器人遥操作成本高难以扩展，而现有的无机器人UMI（Universal Manipulation Interface）数据保真度不足，通常仅用于预训练，仍需少量真实机器人数据进行后训练。本文旨在探索通过提升无机器人UMI数据的保真度，而非减少真实机器人数据比例，来消除对真实机器人数据的依赖。

Result: 在三个不同的骨干模型（StarVLA-QwenPI, OpenPI-pi_0.5, LingBot-VA）上，仅使用HiFi-UMI数据进行后训练的策略，其成功率与在评估场景中收集的遥操作基线相比，差异分别为-2.5、+3.1和-0.6个百分点，表现相当。最强策略在精密插入任务上达到85%成功率。此外，使用同一数据集的4000小时数据进行预训练，可将十个未见任务的动作误差降低41%，并将StarVLA-QwenPI模型在真实机器人上的成功率进一步提升18.1个百分点。

Insight: 核心创新在于设计了一个软硬件协同优化的高保真UMI数据采集系统，通过提升数据本身的质量（轨迹精度、相对位姿、同步性、视野）来替代对真实机器人数据的需求，实现了“零机器人后训练”。这为机器人学习社区提供了一个大规模、高保真的开源数据集（HiFi-UMI-2K），并验证了高质量仿真数据对于策略学习和迁移的有效性。

Abstract: Learning deployable manipulation policies is bottlenecked by the scarcity of data that is both high-fidelity and scalable. Real-robot teleoperation is accurate but costly to scale; robot-free UMI capture scales readily, and current practice uses the resulting data mainly for pre-training, adding a small real-robot “anchor” at post-training. We ask whether raising the fidelity of robot-free UMI data, rather than shrinking the real-robot fraction, can remove that anchor. We present HiFi-UMI, a portable UMI data-production system co-designed for trajectory accuracy, inter-gripper relative pose, synchronization, and field of view: head-mounted offline stereo-inertial SLAM, native rather than reconstructed relative pose, a shared microsecond GPIO trigger, and two wide-angle cameras per hand covering ~200 degrees. It reaches 3 mm workspace-local end-effector accuracy without external tracking infrastructure. Using this corpus, we demonstrate zero-robot post-training: a policy post-trained solely on HiFi-UMI demonstrations deploys directly on a real robot and matches in-domain teleoperation across three backbones spanning the vision-language-action and world-action-model families, with success-rate differences of -2.5, +3.1, and -0.6 percentage points on StarVLA-QwenPI, OpenPI-pi_0.5, and LingBot-VA; the strongest policy reaches 85% on a precision insertion task, even though the teleoperation baseline is collected in the evaluation scene and no HiFi-UMI trajectory is. Pre-training on 4,000 hours from the same corpus lowers action error on ten unseen tasks by 41% and, on StarVLA-QwenPI, raises real-robot success by a further 18.1 percentage points. We open-source HiFi-UMI-2K, 2,000 hours of microsecond-synchronized, ultra-wide-FoV demonstrations, each automatically reconstructed and validated through simulation replay, as a large-scale, high-fidelity resource for the robot-learning community.

cs.IR [Back]

[73] VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents cs.IR | cs.AI | cs.CLPDF

Seonok Kim

TL;DR: 本文提出了VLD-RAG，一种面向长篇幅、视觉丰富多页文档（如报告、幻灯片和手册）的智能体化多模态检索增强生成框架。该框架通过构建保留页面信息的索引，结合稀疏和稠密检索策略，并利用由检索、回答和验证智能体组成的协调工作流，来提升跨页面证据检索和问答的准确性。

Details

Motivation: 解决在视觉丰富的长文档中进行问答时，所需证据（包含文本和视觉信号）分散在多个页面所带来的挑战，旨在提升多模态检索和跨页面推理的可靠性。

Result: 在LongDocURL和MMLongBench-Doc等视觉丰富长文档基准测试中，VLD-RAG在Top-1/Top-5证据页检索准确率和广义问答准确率上均优于之前的基于视觉的检索基线方法。

Insight: 创新点在于提出了一个协调的智能体验证工作流（检索、回答、验证智能体）与多模态混合检索策略（结合关键词稀疏搜索和稠密语义查询）的组合框架，强调验证和混合检索对于证据分散场景下的可靠信息溯源至关重要。

Abstract: Visually-rich documents such as reports, slides, and manuals often distribute the evidence needed to answer a question across multiple pages, mixing text with layout cues, tables, charts, and figures. This work studies multimodal retrieval-augmented generation for question answering over such visually-rich long documents, where retrieval must select evidence pages that include both textual and visual signals. We present VLD-RAG, an agentic multimodal RAG framework for multi-page evidence retrieval and cross-page reasoning over long documents. VLD-RAG builds a page-preserving multimodal index that stores parsed text, page-level metadata, and dense visual representations, and uses a hybrid retrieval strategy that combines keyword-based sparse search with dense semantic queries to identify candidate sources and evidence pages. A verifier-guided agent workflow coordinates a Retrieval Agent, Answer Agent, and Validation Agent to broaden evidence coverage, detect missing citations, and refine retrieval requests when needed. We evaluate retrieval with Top-1 and Top-5 evidence-page accuracy and generation with generalized accuracy, and show that VLD-RAG improves both evidence-page retrieval and end-task question answering on visually-rich long-document benchmarks, including LongDocURL and MMLongBench-Doc, outperforming previous vision-based retrieval baselines. These findings highlight that coordinated agent verification and multimodal hybrid retrieval are crucial for reliable grounding when correct answers depend on evidence scattered across pages.

[74] DocAnnot – Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation cs.IR | cs.AI | cs.CL | cs.CVPDF

Siddartha Reddy, Harikrishnan P M, Goutham Vignesh, Varun V, Vishal Vaddina

TL;DR: 本文提出了DocAnnot框架，旨在利用生成式AI（特别是大型视觉语言模型LVLM）加速关键信息提取（KIE）数据集的创建。该框架结合了LVLM进行标签值提取、OCR进行文本和边界框检测，以及一种新颖的SICM算法来关联标签和值。

Details

Motivation: 关键信息提取（KIE）的训练数据集创建传统上是一个耗时的手动过程，DocAnnot旨在显著加速这一过程，减少对人工标注的依赖。

Result: 在CORD和SROIE基准测试上，DocAnnot自动生成标注的F1分数分别达到0.679和0.846。使用其自动标注数据微调的下游KIE模型（如LayoutLMv3）在CORD上取得了0.6765的F1分数，显示出可接受的性能，但尚不及人工标注数据。

Insight: 主要创新点在于提出了一个结合LVLM、OCR和新型SICM算法的端到端自动标注框架。SICM算法通过结合空间关系、邻近度分析和文本匹配，改进了标签与值的关联，这是一个关键的算法贡献。该框架为资源受限的环境和快速模型原型设计提供了高效的半自动化解决方案。

Abstract: Key Information Extraction (KIE) is vital for many document applications, but creating training datasets is traditionally a time-consuming manual process. We introduce DocAnnot, a framework that significantly accelerates KIE dataset generation. DocAnnot leverages a Large Vision Language Model (LVLM) for label value extraction, OCR for text/bounding box detection, and a novel Spatially Informed Contextual Matching (SICM) algorithm. SICM improves label-value association by combining spatial relationships and proximity analysis with textual matching. We evaluate our framework on the CORD and SROIE benchmarks, demonstrating its ability to auto-generate annotations with F1-scores of 0.679 and 0.846, respectively. Furthermore, we investigate the effectiveness of using auto-annotated data for fine-tuning downstream KIE models. While human-annotated data remains superior, models trained exclusively on DocAnnot’s outputs attain respectable performance (e.g., LayoutLMv3 achieving an F1-score of 0.6765 on CORD). These results show that while our framework significantly reduces reliance on manual effort, it does not yet fully eliminate the need for human intervention. However, by automating the process to a point where reviewers can efficiently refine outputs, our system enables near-perfect annotations with much greater efficiency than manual annotation from scratch. This approach offers substantial time and cost savings, making it valuable for resource-constrained settings and rapid model prototyping.

[75] Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs cs.IR | cs.AI | cs.CLPDF

Chandan Kumar Sah, Xiaoli Lian, Li Zhang

TL;DR: 本文提出了一种名为BeyondUncertainty的方法，利用黑盒语言模型输出的置信度作为信号，来决定是否进行检索以增强问答系统。该方法首先获取一个结构化的临时答案和置信度估计，然后根据验证集选择的阈值，对低置信度问题进行检索，高置信度问题则直接返回答案。

Details

Motivation: 检索增强生成虽然能提升知识密集型问答性能，但盲目检索会引入无关证据和不必要的计算开销。本文旨在探索语言模型自身表达的置信度是否可作为控制检索路由的有效信号。

Result: 在六个QA基准、三个模型族和三种检索策略上评估了27,000个策略实例。BeyondUncertainty取得了平均0.483的token级F1分数，优于始终检索（0.467）和无检索（0.401），同时将检索段落数量减少了20.4%。在18个设置中的17个里，它都优于事后随机分配检索的策略，平均F1增益为0.024。

Insight: 创新点在于将语言模型内部的不确定性估计（尽管校准不佳）作为控制外部检索动作的决策信号，实现了检索选择性（减少无关检索）与答案准确性之间的权衡。然而，引入置信度探针会增加总体token使用量（28.2%），揭示了选择性证据获取与端到端计算效率之间的折衷关系。

Abstract: Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unnecessary computation. We investigate whether verbalized confidence from black-box language models can serve as an actionable signal for retrieval routing. Our method, BeyondUncertainty, first elicits a structured provisional answer and confidence estimate, then applies a model-specific threshold selected on held-out validation data and frozen before test evaluation. Low-confidence questions receive top-$5$ TF–IDF retrieval followed by a second answer call, whereas high-confidence questions return the provisional answer directly. We evaluate 27,000 policy instances across six QA benchmarks, three model families, and three retrieval policies. BeyondUncertainty achieves $0.483$ mean token-level F1, compared with $0.467$ for always retrieval and $0.401$ for no retrieval, while reducing retrieved passages by $20.4%$ relative to always retrieval. When matched on the number of questions routed to retrieval within each dataset–model cell, it outperforms a post-hoc random allocation in 17 of 18 settings, with an average gain of 0.024 F1. Although poorly calibrated as an absolute probability, probe uncertainty modestly predicts question-level retrieval benefit (AUROC $=0.628$). However, the additional probe increases total token usage by $28.2%$, revealing a trade-off between more selective evidence acquisition and end-to-end token efficiency.

[76] NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model cs.IR | cs.CV | cs.LG | cs.MMPDF

Yuming Liu, Hongye Yang, Harrison Zhao, Ellie Zhu, Bokai Cao

TL;DR: 论文提出了NEXT（Next-interest EXploration Transformer）框架，这是一个基于推理的视频推荐系统。它通过分析用户刚观看的视频来推断其下一个意图，并检索相关的后续视频，处理了显式（如剧集）和隐式（通过生成意图查询）的连续观看场景。该框架采用Item-to-Intent-to-Item的范式，超越了传统的协同参与或语义相似性推荐。

Details

Motivation: 解决视频推荐中如何基于用户当前观看内容，主动推理其下一个兴趣意图，从而提供更精准、有逻辑连贯性的推荐问题，而不仅仅是依赖协同过滤或语义相似性。

Result: 训练了NEXT-8B视觉语言模型，在DocVQA任务上取得了最佳单模型性能，总体排名第二（仅次于多智能体系统），并超越了规模大得多的200B+模型；在特定任务LLM-as-a-judge评估中，将下一个意图的逻辑质量提升了3.3%。在生产部署中，作为大型社交媒体推荐系统的附加检索路径，带来了显著的收益，包括观看时间增加0.53%和不同视频曝光增加0.51%。

Insight: 创新点在于提出了Item-to-Intent-to-Item的推理驱动推荐范式，将视频推荐转化为意图推理问题；同时，通过专门设计的三阶段训练方法（感知增强强化学习、分布对齐监督微调、组相对策略优化），成功训练了一个紧凑但高效的8B视觉语言模型作为推理引擎，证明了小规模模型在生产规模下实现高质量推理的可行性。

Abstract: We present NEXT (Next-interest EXploration Transformer), a reasoning-driven video recommendation framework that reasons over the video a user has just watched, infers the viewer’s next intent, and retrieves concrete follow-up videos. Explicit continuations such as episodes are linked directly; implicit cases are handled by generating intent queries and searching for matching candidates. This Item-to-Intent-to-Item formulation produces directed recommendations beyond co-engagement correlation or semantic similarity. To make this framework reliable at scale, we train NEXT-8B, a purpose-trained 8B vision-language model with a three-stage recipe: Perception-Enhanced Reinforcement Learning for query-agnostic evidence extraction, Distribution-Aligned Supervised Fine-Tuning over real and synthetic visual QA mixtures, and Group Relative Policy Optimization for last-mile alignment. NEXT-8B achieves the best single-model DocVQA performance, ranking second overall only behind a multi-agent system while surpassing a substantially larger 200B+ scale model, and improves next-intent logic-wise quality by 3.3% over the base model in a task-specific LLM-as-a-judge evaluation. We deploy NEXT as an additional retrieval path in a large-scale social media recommendation system and observe statistically significant production gains, including +0.53% watch time and +0.51% distinct video exposure. Overall, NEXT shows that a carefully trained compact vision-language model can serve as a practical reasoning engine for next-interest exploration at production scale.

cs.SE [Back]

[77] RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement cs.SE | cs.CLPDF

Fanqing Meng, Lingxiao Du, Qiguang Chen, Ziqi Zhao, Haocheng Lu

TL;DR: 本文介绍了RSIBench-Data，一个用于评估LLM代理作为数据为中心的研究者在递归自我改进中能力的基准测试平台。该平台通过固定后训练堆栈，让代理迭代地修订训练数据策略，并在软件工程、终端使用、科学问答和数学等六个基准上进行评估。研究发现，代理在58.33%的情况下能通过反馈改进策略，但改进不一致，且后期尝试常导致分数下降，表明当前代理能进行有用的数据为中心发现，但无法将反馈转化为持续改进。

Details

Motivation: 现有基准测试将研究决策与优化、服务、评估和系统实现混为一谈，掩盖了代理的研究能力。本文旨在通过RSIBench-Data提供一个受控基准，专注于评估LLM代理在数据为中心的后训练研究中的能力，以支持递归自我改进的研究。

Result: 在六个基准测试中，四个前沿代理在58.33%的设置下改进了首次有效尝试，但改进不一致；在观察到最佳分数后继续搜索的尝试中，78.26%以更低分数结束，其余仅恢复相同峰值。代理展示了核心数据为中心研究能力，但无法实现一致改进。

Insight: 创新点包括设计了一个固定后训练堆栈的基准测试平台，以隔离和评估代理的研究能力；通过轨迹分析识别了强运行中的四个模式：准确假设、基于验证的监督、行为对齐数据和强检查点保留。这为递归自我改进提供了可测量、可审计的测试平台，并开源了代码。

Abstract: Recursive self-improvement requires turning evidence of model failures into better models. Data-centric post-training research entails diagnosing capability gaps, designing and validating training-data strategies, and learning from checkpoint feedback. Can LLM agents automate this loop? Existing benchmarks entangle research decisions with optimization, serving, evaluation, and systems implementation, obscuring agents’ research capability. We introduce RSIBench-Data, a controlled benchmark of LLM agents as data-centric researchers with a fixed post-training stack. Agents iteratively revise training-data strategies for a fixed target model; training and serving use Tinker-backed services, official evaluation runs through Harbor and E2B sandboxes, and budgets are fixed across agents. We evaluate four frontier agents on six benchmarks across software engineering, terminal use, scientific question answering, and mathematics. Agents demonstrate core data-centric research capabilities: in 58.33% of settings, they improve upon the first valid attempt by refining strategies from feedback. However, improvement is inconsistent. Among searches continuing after the best observed score, 78.26% end with a lower-scoring final attempt, while the rest only recover the same peak. A strong candidate may therefore appear early or midway through a run even as later revisions fail. Trajectory analysis identifies four patterns in stronger runs: accurate hypotheses, validation-grounded supervision, behavior-aligned data, and preservation of strong checkpoints. These findings suggest that current agents can make useful data-centric discoveries but cannot yet translate feedback into consistent improvements. RSIBench-Data provides a measurable, auditable testbed for the research capabilities required for recursive self-improvement. We open-source our code at https://github.com/evolvent-ai/RSIBench-Data.

cs.LG [Back]

[78] OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment cs.LG | cs.CVPDF

Yi Xu, Cheng Chen, Mufan Cao

TL;DR: 本文提出了一种名为OrthKD的选择性信任知识蒸馏框架，用于在糖尿病视网膜病变筛查任务中，从异构的CNN和Transformer教师模型中提取互补的临床知识，以部署轻量级、鲁棒的学生模型。该方法通过选择性监督和正交化投影，整合了CNN的局部病灶精度和Transformer的全局结构上下文，从而提升了模型在域偏移下的性能。

Details

Motivation: 在基层医疗中部署糖尿病视网膜病变筛查模型需要边缘高效且能在域偏移下保持准确、安全、可靠的系统。现有的多教师知识蒸馏方法通常假设所有教师提供同等可信的监督，但在异构教师（如CNN和Transformer）场景下，较弱的教师模型可能产生误导性输出，因此需要一种选择性信任的蒸馏策略。

Result: 在包含132,049张视网膜图像的EyePACS数据集上，一个仅5.4M参数的MobileNetV3学生模型达到了0.885的QWK分数，并在零样本的Messidor-2数据集上将性能从0.507提升至0.728 QWK，同时获得了较强的转诊AUC和校准性能，实现了SOTA水平的轻量级部署效果。

Insight: 创新点在于提出了选择性信任蒸馏框架，通过从强CNN教师获取完整监督、从弱ViT教师仅进行特征蒸馏，并强制学生投影的正交性，以鼓励互补而非冗余的证据提取。这为异构教师的知识融合和轻量级模型的鲁棒部署提供了新思路。

Abstract: Deploying diabetic retinopathy (DR) screening models in primary care requires edge-efficient systems that remain accurate, safe, and reliable under domain shift. Multi-teacher knowledge distillation (KD) is a natural compression strategy, but existing approaches largely assume that all teachers provide equally trustworthy supervision. In our setting, this assumption fails: a strong CNN teacher (EfficientNet-B3, 0.876 QWK) and a weaker Transformer teacher (Swin-Base, 0.830 QWK) are complementary, yet the Transformer’s logits can still mislead the student. We therefore propose OrthKD, a selective-trust distillation framework that transfers full supervision from the strong CNN, uses feature-only distillation from the weak ViT, and enforces orthogonality between teacher-specific student projections to encourage complementary rather than redundant evidence. This design preserves local lesion precision, injects global structural context, and improves robustness to distribution shift. On 132,049 retinal images, a 5.4M-parameter MobileNetV3 student reaches 0.885 QWK on EyePACS and improves zero-shot Messidor-2 performance from 0.507 to 0.728 QWK, while also achieving strong referral AUC and calibration. These results show that selectively distilling heterogeneous teachers can enable practical DR screening on resource-constrained devices.

cs.AI [Back]

[79] Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization cs.AI | cs.CLPDF

Muhammad Junaid Ali, Smail Niar, El-Ghazali Talbi

TL;DR: 本文提出了一种硬件感知的多目标结构化剪枝框架，旨在优化大型语言模型（LLMs）的延迟和模型大小，以促进其在嵌入式及边缘计算环境中的高效部署。该方法采用两阶段策略：粗粒度阶段通过多目标深度剪枝移除整个注意力与MLP块以降低计算负载和内存使用；细粒度阶段则利用并行贝叶斯优化（PBO）在延迟约束下搜索最优的逐层剪枝比例，并结合基于重要性的策略对层内具体组件进行排序剪枝。实验表明，该方法在常识推理和零样本任务上性能损失最小，并在多个LLM上以37.5%和50%的剪枝比例实现了比现有方法更好的性能与推理成本降低。

Details

Motivation: LLMs在嵌入式及边缘计算环境中部署面临严格的延迟、内存和能耗限制，其庞大的参数量和计算需求阻碍了在资源受限平台上的高效执行。现有模型剪枝方法在联合优化层、注意力头和MLP维度时复杂度高，且穷举搜索设计空间计算成本大、易陷入局部最优或不稳定配置。

Result: 在多个LLM上以37.5%和50%的剪枝比例进行实验，该方法在常识推理任务上取得了优于现有方法的性能，同时显著降低了推理成本，实现了准确性、延迟和模型大小之间的有利权衡。

Insight: 创新点在于提出了一个两阶段、硬件感知的多目标结构化剪枝框架，将粗粒度的深度剪枝与细粒度的并行贝叶斯优化搜索相结合，并引入基于重要性的组件排序策略，从而在复杂设计空间中高效地联合优化延迟和模型大小，为边缘部署提供了有效的剪枝解决方案。

Abstract: Large Language Models (LLMs) have achieved widespread adoption because of their strong reasoning and query-response capabilities. However, deploying them in embedded and edge computing environments remains challenging because of strict latency, memory, and energy constraints. Their large parameter counts and computational demands hinder efficient execution on resource-constrained platforms. Although model pruning has emerged as a viable solution for reducing scale while preserving performance, jointly optimizing layers, attention heads, and Multi-Layer Perceptron (MLP) dimensions remains highly complex. Exhaustively exploring this combined design space is computationally expensive and often leads to local optima or unstable configurations. To address these limitations, we propose a hardware-aware, multi-objective structured pruning framework. The proposed two-stage method explicitly targets latency and model size for efficient deployment on edge devices. In the coarse-grained stage, multi-objective depth pruning removes entire attention and MLP blocks to reduce computational load and memory usage. In the subsequent fine-grained stage, Parallel Bayesian Optimization (PBO) searches for the optimal layer-wise pruning ratios for pruning under latency constraints, while importance-based strategies rank the specific components to be pruned within each layer’s allocated budget. Experimental results show that our approach reduces model complexity with minimal impact on commonsense reasoning tasks and zero-shot performance. Our method achieves a favorable trade-off among accuracy, latency, and model size, making it suitable for edge deployment. Across multiple LLMs at 37.5% and 50% pruning ratios, the proposed approach achieves better performance on commonsense reasoning tasks than existing methods while significantly reducing inference cost.

[80] Addressable Recall Compaction for Long Context-Window Control in AI Agents cs.AI | cs.CLPDF

Thang Dang, Yuma Ichikawa, Sakina Fatima, Koichi Shirahata

TL;DR: 本文提出了ARC（可寻址召回压缩）框架，用于管理长上下文窗口AI代理中的信息。该框架将归档存储与活跃上下文呈现分离，通过将旧工具观察结果替换为紧凑的引用标识符来压缩上下文，并允许代理按需通过标识符精确召回存储的原始内容。

Details

Motivation: 解决长序列LLM代理中，推理轨迹、动作和工具观察结果可能超出模型固定上下文窗口的问题。现有压缩方法（如丢弃、总结或检索）可能丢失关键任务细节或无法可靠恢复它们。

Result: 在Needle-in-a-Haystack评估中，使用Qwen3-8B（16k窗口）和Qwen3-32B（32k窗口）的ARC实现了99.40%的平均精确答案准确率，优于基线（88.12%）。在LongBench-v2 Hard子集上，ARC平均准确率为29.97%，优于基线（28.25%）。同时，ARC降低了预估服务时间和HBM流量。

Insight: 核心创新在于将存储与呈现解耦，并引入基于标识符的精确、按需召回机制，避免了工具重新执行或仅依赖相似性检索的局限性。这为长上下文管理提供了一种显式、可寻址的解决方案，提升了信息保留和服务效率。

Abstract: Long-horizon LLM agents accumulate reasoning traces, actions, and tool observations that can eventually exceed a model’s fixed context window. Existing compaction methods address this limitation by discarding, summarizing, or retrieving earlier information, but they may remove task-critical details or fail to recover them reliably. We propose ARC (Addressable Recall Compaction), a context-management framework that separates archival storage from active-context presentation. ARC stores tool observations in an append-only, ID-addressable log and replaces older observations with compact citations when compaction is required. The agent can subsequently use these identifiers to request stored content without re-executing the corresponding tools or depending solely on similarity-based retrieval. We evaluate ARC using Qwen3-8B with a 16k context window and Qwen3-32B with a 32k context window. On the Needle-in-a-Haystack evaluation, ARC achieves an average exact-answer accuracy of 99.40%, compared with 88.12% for the best-performing baseline in our evaluation. ARC also reduces estimated serving time and HBM traffic under our hardware-cost model. On the LongBench-v2 Hard subset, ARC obtains an average accuracy of 29.97%, compared with 28.25% for the best-performing baseline. These results indicate that explicit, address-based recall can improve information retention and serving efficiency relative to the evaluated context-management baselines under the tested settings.

[81] Towards Robust Reinforcement Learning for Small-Scale Language Model Agents cs.AI | cs.CL | cs.LG | math.OC | stat.COPDF

Md Rezwanul Haque, Md. Milon Islam, Fakhri Karray

TL;DR: 本文系统研究了70-500M参数范围内小语言模型（SLM）使用强化学习（PPO）进行对齐时的不稳定性问题，识别了三种可复现的失败模式，并提出了一套包含适配器技术、精度控制和三层安全机制的解决方案。论文提出了‘容量余量假说’，强调PPO在SLM规模下的性能取决于流畅的监督模型和有区分度的奖励信号，而非参数量。所提系统在所有实验中稳定收敛，在具备流畅先验和信息丰富奖励信号的配置中，相比SFT基线提高了偏好胜率，且所需训练数据显著少于指令微调基线。

Details

Motivation: 解决小语言模型（70-500M参数）使用强化学习（如PPO）进行对齐时普遍存在的不稳定问题，并系统性地探究其背后的失败机制。

Result: 在TinyStories、CNN/DailyMail和Wikitext-103语料库上，对Pythia和SmolLM2系列模型进行了实验。提出的方法在所有配置中稳定收敛，在具备流畅先验（困惑度<20）和有效奖励信号的配置下，其偏好胜率超过了监督微调（SFT）基线，并且性能优于指令微调基线。

Insight: 创新点在于系统识别了三种具体的失败模式（LoRA参数静默冻结、bfloat16下的数值溢出、奖励模型错误导致的策略崩溃），并提出了针对性的技术组合（合并与重初始化适配器、PPO更新时使用float32精度、包含奖励白化、重要性比率防护和权重回滚的三层安全机制）。此外，提出的‘容量余量假说’为小模型RL对齐的性能关键因素提供了新的理论视角，强调模型流畅性和奖励信号质量比单纯参数量更重要。

Abstract: The alignment of Small Language Models (SLMs) in the 70–500M parameter range using reinforcement learning is often considered unstable, though the underlying failure mechanisms have not been systematically investigated. In the State-of-the-Art (SOTA) research, fifteen (model, corpus) configurations were trained using Proximal Policy Optimization (PPO). The experiments included Pythia-70M, 160M, 410M and SmolLM2-135M, 360M on the TinyStories, CNN/DailyMail, and Wikitext-103 corpora. Three reproducible failure modes were identified in small-scale language models: silent LoRA parameter freezing in standard PEFT/TRL pipelines, numerical overflow in importance ratios when using bfloat16, and catastrophic policy collapse due to reward-model error. These issues were addressed using a merge-and-reinitialize adapter technique, float32 precision during PPO updates, and a three-layer safety mechanism comprising reward whitening, importance-ratio guarding, and weight rollback. In this paper, a capacity-headroom hypothesis is proposed, which states that PPO performance at the SLM scale depends on both a fluent supervised model ($\text{PPL}<20$) and a discriminative reward signal, rather than on the number of model parameters. The proposed system converged stably in all experiments and improved preference win rate over the SFT baseline in configurations with a fluent prior and an informative reward signal. Furthermore, it outperformed instruction-tuned baselines while requiring significantly less training data. All checkpoints, preference datasets, and training scripts are publicly released$^§$.

[82] Localized Adaptation Reveals Distinct Learning Signatures in Transformers cs.AI | cs.CLPDF

Rebecca Ramnauth, Brian Scassellati

TL;DR: 本文研究了Transformer模型中不同层（早期、中期、晚期或全栈）的局部适应（通过LoRA实现）如何影响模型在五个不同学习目标（词汇绑定、事实关联、行为策略学习、因果映射和程序推理）上的学习特征。研究发现，不同学习目标具有独特的‘适应几何’模式，即它们在特定层适应下的获取、迁移和边界性表现不同。

Details

Motivation: 动机在于探究模型适应（adaptation）发生的位置（adaptation site）如何具体塑造模型的学习内容、泛化能力以及应用的选择性，以超越通常认为的适应是跨深度分布的这一观点。

Result: 在五个模型家族上进行的参数匹配控制实验表明，不同学习目标展现出稳定且可复现的独特适应几何模式。例如，词汇绑定在早期层适应下获取和边界性最好，但需要更广泛的更新以实现迁移；事实关联则在局部适配器中偏好后期层。

Insight: 核心创新点在于提出了‘适应几何’这一概念来量化不同学习目标对适应位置的敏感性，并系统性地证明了适应位置是控制模型学习什么、如何泛化以及保留什么不变的关键设计变量。

Abstract: Transformer adaptation is typically distributed across model depth, even when the intended change is narrow. We investigate how adaptation site shapes what a model learns, how well that learning generalizes, and how selectively it is applied. We introduce a controlled benchmark spanning five objectives (lexical binding, factual association, behavioral policy learning, causal mapping, and procedural reasoning) and define each objective’s “adaptation geometry” as its profile of acquisition, transfer, and boundedness under full-stack and early-, middle-, or late-layer LoRA. The objectives exhibit distinct geometries. Lexical binding favors early-layer adaptation for acquisition and boundedness but requires broader updates for transfer; factual association favors later layers among localized adapters; behavioral learning separates late-layer action acquisition from middle-layer policy gating; and causal and procedural transfer benefit most from middle- or full-stack adaptation. These patterns largely persist under parameter-matched controls, and most corresponding directional contrasts replicate across five model families. These findings establish adaptation site as a key design variable for controlling what models learn, generalize, and leave unchanged.

[83] A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series cs.AI | cs.CLPDF

Frank Nie, Ethan B Liu, Yuan Zhu, Wei Fan, Jindong Han

TL;DR: 本文提出ClinPRISM，一种用于不规则临床时间序列问答的成本效益高的多模态大语言模型推理框架。该框架通过不规则感知多尺度编码器捕捉不同时间尺度的稀疏临床证据，利用时间证据蒸馏器整合多尺度表示并压缩为少量LLM兼容的token，并采用渐进对齐策略将不规则轨迹与LLM的文本嵌入空间对齐。

Details

Motivation: 解决现有多模态时间序列LLM在建模临床观测数据的稀疏性、异步性和不规则采样模式方面的不足，以提升不规则临床时间序列问答的准确性和效率。

Result: 在保留评估基准上达到最先进性能，仅使用16个时间序列token，平均每个问题的推理延迟为0.15秒，基于一个40亿参数的LLM骨干。

Insight: 创新点包括不规则感知多尺度编码器、时间证据蒸馏器和渐进对齐策略，这些设计有效处理了临床时间序列的不规则性，同时通过token压缩和策略优化实现了高效率和低成本。

Abstract: Question answering (QA) over irregular clinical time series (ICTS) plays a pivotal role in a wide range of healthcare applications. Although recent multimodal time-series large language models (LLMs) have shown considerable promise in general-purpose time-series QA, they remain poorly equipped to model the sparsity, asynchrony, and irregular sampling patterns of clinical observations. To fill this gap, we propose ClinPRISM, a cost-effective multimodal LLM reasoning framework for question answering over ICTS data. First, we devise an irregularity-aware multi-scale encoder to capture sparse clinical evidence at diverse temporal scales. Then, we propose a temporal evidence distiller to integrate representations across these scales and compress them into a small number of LLM-compatible tokens. Moreover, we introduce a progressive alignment strategy that sequentially aligns the irregular trajectories with the LLM’s textual embedding space. To facilitate training, we construct 30,000 clinical time series paired with multi-scale descriptions, together with 41,000 instruction-tuning instances spanning 11 tasks. Using a 4-billion-parameter LLM backbone, ClinPRISM achieves state-of-the-art performance on the held-out evaluation benchmark while using only 16 time-series tokens and achieving an average inference latency of 0.15 seconds per question.

[84] Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding cs.AI | cs.CVPDF

Linghao Meng, Qiankun Li, Junyuan Mao, Pujin Liao, Zhicheng He

TL;DR: 本文提出ReMem框架，通过双级记忆增强机制自适应地选择关键帧，以解决多模态大语言模型在长视频理解中因上下文窗口限制而忽略关键时序信息的问题。该方法在无需训练的情况下，利用记忆驱动的问题解析和协同双语义帧对齐，优化采样预算分配，提升多粒度视频推理能力。

Details

Motivation: 多模态大语言模型在长视频理解中受限于上下文窗口，现有关键帧选择方法（如均匀采样或静态查询引导）无法适应查询的多样化时间粒度，导致关键时序上下文丢失。

Result: 在四个流行的LongVideoQA基准测试中使用三种MLLMs进行评估，ReMem实现了高效且零样本的SOTA性能，例如LLaVA-Video结合ReMem在LVBench上达到54.5%（提升12.3%），在LongVideoBench上达到67.1%（提升8.2%）。

Insight: 创新点在于引入双级记忆增强机制，通过解码查询时间粒度和利用视频结构记忆来动态路由帧采样，显式保留时序信息以减少冗余；客观分析表明，该方法通过内存机制自适应处理多粒度查询，可推广至其他视频理解任务。

Abstract: While Multimodal Large Language Models (MLLMs) demonstrate superior generalization in fundamental video tasks, restricted context windows limit their long video understanding. To accommodate this constraint, models typically resort to keyframe selection. However, uniform sampling or static query-guided selection often overlooks critical temporal context, failing to adapt to the varying query temporal granularities. In this paper, we propose ReMem, a temporal granularity-adaptive keyframe selection framework for training-free LongVideoQA. ReMem introduces a dual-level memory-augmented adaptation. At the query level, Memory-Driven Question Parsing leverages LLM long-term memory to decode question temporal granularity and extract semantic entities. At the video level, Synergistic Dual-Semantic Frame Alignment exploits intrinsic structural memory to align frames with query semantics, guiding Structure-Aware Dynamic Frame Routing to cluster events and optimally distribute sampling budgets. By explicitly preserving temporal information with memory mechanisms, ReMem suppresses redundancy and empowers MLLMs to perform robust multi-granular video reasoning. Evaluations across four popular LongVideoQA benchmarks using three MLLMs demonstrate highly efficient, state-of-the-art zero-shot performance; notably, LLaVA-Video with ReMem reaches 54.5% (+12.3%) on LVBench and 67.1% (+8.2%) on LongVideoBench.

[85] CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model cs.AI | cs.CVPDF

Minhyeok Lee, Chiyoung Kim, Chanhoe Gu, Seongrok Kim, Sanghyuk Roy Choi

TL;DR: 本文提出了CoTinyVLA，一个仅0.9B参数的视觉-语言-动作模型，旨在解决大型VLA模型在嵌入式机器人平台上部署时内存需求过高的问题。该方法通过结构化监督而非扩大模型规模，在LIBERO-Plus鲁棒性基准测试中超越了多个更大的基线模型。

Details

Motivation: 现有领先的VLA模型通常具有数十亿参数，其内存需求超出了嵌入式机器人的预算。本文旨在开发一个参数少于十亿的紧凑型VLA模型，使其在保持高性能的同时满足资源受限的部署需求。

Result: 在LIBERO-Plus基准测试（包含10,030个跨七个扰动维度的任务）上，CoTinyVLA在Spatial、Object、Goal和Long四个测试套件上分别达到90.8%、87.3%、86.6%和80.7%的成功率，全面超越了最强的7B参数基线模型，提升幅度最高达15.9个百分点。特别是在最难的Robot Initial States扰动维度上，取得了73.6%的成功率，显著优于基线。

Insight: 创新点在于通过结构化监督策略实现小模型的高性能：1）采用带文本标记的双视角时序输入；2）从大教师模型中蒸馏出分层的思维链（包含任务级计划和块级思考）；3）使用释义增强扩展指令集。这些组件是可分离的，且实验表明任务级计划模块对性能至关重要。

Abstract: Vision-Language-Action (VLA) models translate natural-language commands into robot action sequences, but leading systems on the LIBERO-Plus robustness benchmark use three- to seven-billion-parameter backbones whose memory demands can exceed embedded robotic budgets. We present CoTinyVLA, a 0.9B-parameter action model on a Qwen3.5-0.8B backbone that obtains that robustness by structuring supervision instead of enlarging the model. Three components target different axes of the problem: dual-view temporal input of 16 history frames per step with textual camera and time markers; hierarchical chain-of-thought (CoT) distillation from a 35B teacher into an episode-level Plan and a chunk-level Think span over task phase, gripper state and next subaction; and paraphrase augmentation expanding 40 base commands into 800 variants. On LIBERO-Plus, spanning 10,030 perturbed tasks across seven perturbation dimensions, CoTinyVLA reaches 90.8% on Spatial, 87.3% on Object, 86.6% on Goal and 80.7% on Long, leading the strongest 7B baseline on all four suites by 4.7, 2.8, 15.9 and 3.0 points, with every margin interval excluding zero. The gains concentrate on the hardest axes of the benchmark: across the eleven published baselines none exceeds 53.2% on Robot Initial States in any suite, whereas CoTinyVLA reaches 73.6% on Goal against 39.9% for the strongest baseline. Ablations show the three components to be separable by perturbation axis, and at a matched image budget how frames are divided between the two cameras and across time accounts for 8.6 points on its own. Closed-loop inference peaks at 2.25 GiB of allocated GPU memory, and paired interventions show the episode Plan to be load-bearing: replacing it with an empty or contradictory span costs 40 to 45 points of success. Structured supervision thus lets a 0.9B backbone exceed all of them. Code: https://github.com/BrainJellyPie/CoTinyVLA

Table of Contents

cs.CL [Back]

[1] Measuring and Improving Behavioral Consistency in Large Language Models through Fact-Heuristic-Emotion State Enforcement cs.CL | cs.AI | cs.HCPDF

[2] DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification cs.CL | cs.AIPDF

[3] TabRank: Chain-of-Thought Distillation for Table Re-Rankers cs.CL | cs.AI | cs.IRPDF

[4] MyoCardBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios cs.CLPDF

[5] CAST: Game Solvers as Turn-Level Teachers for LLM Agents cs.CL | cs.AIPDF

[6] Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors cs.CL | cs.AIPDF

[7] Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control cs.CL | cs.ROPDF

[8] MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice cs.CL | cs.AIPDF

[9] Shieldstral cs.CL | cs.CVPDF

[10] Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases cs.CL | cs.AIPDF

[11] Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs cs.CL | cs.AIPDF

[12] Pass the Baton: Trajectory-Relayed On-Policy Distillation cs.CL | cs.AIPDF

cs.CV [Back]

[13] DisasterTD: Disaster Toponym Disambiguation Using Multimodal LLMs and Cross-View Geolocalization cs.CV | cs.AIPDF

[14] Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed cs.CV | cs.AIPDF

[15] PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models cs.CVPDF

[16] Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model cs.CV | cs.CLPDF

[17] Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models cs.CVPDF

[18] Enabling Fully Integer-Only Inference for Lightweight Detection Transformers cs.CVPDF

[19] LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos cs.CVPDF

[20] OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis cs.CV | cs.AI | cs.LG | eess.IVPDF

[21] FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video cs.CV | cs.HCPDF

[22] IMPRINT: Image-Conditioned Query Enrichment for Long-Tail Object Goal Navigation cs.CVPDF

[23] CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking cs.CVPDF

[24] Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation cs.CVPDF

[25] OrganLens: Organ-Specific Representation Learning for CT Foundation Models cs.CV | cs.AIPDF

[26] CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition cs.CV | cs.AI | cs.CL | cs.LGPDF

[27] FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding cs.CV | cs.LGPDF

[28] MEDit-Bench: A Dataset for Evaluating Message-Driven Narrative Video Editing cs.CVPDF

[29] Sense it with your eyes: Sensation Generation and Understanding for Advertisements cs.CVPDF

[30] Gaussian Volumetric Representation for Efficient Shear-Warp Visualization cs.CV | cs.GRPDF

[31] Balanced Soft mixture-of-expert model for Glaucoma Detection cs.CV | cs.AIPDF

[32] HOME: Robust Hough-space Matching Method for Structured and Textureless Videos cs.CV | cs.ROPDF

[33] Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors cs.CVPDF

[34] RDVSv2: A Large-scale Benchmark for RGB-D Video Salient Object Detection cs.CVPDF

[35] Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment cs.CVPDF

[36] ANFI: Rethinking Neighbor Feature Interaction in Person Re-ID cs.CVPDF

[37] Bi-Level Collaborative Learning for Few-Shot Scribble-Supervised Medical Image Segmentation cs.CVPDF

[38] Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation cs.CVPDF

[39] Seen, Said, or Forgotten? A Causal Audit of Visual KV Memory Across Dialog Turns cs.CV | cs.AIPDF

[40] I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models cs.CV | cs.AIPDF

[41] DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes cs.CVPDF

[42] Visual prompt engineering for video models cs.CV | cs.AIPDF

[43] Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation cs.CV | cs.AIPDF

[44] Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion cs.CVPDF

[45] Less is More: Modality-Decoupling for General AIGC Audio-Video Detection cs.CV | cs.AIPDF

[46] ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition cs.CVPDF

[47] Beyond Facial Consistency: Personalized Person Image Generation with Holistic Identity Preservation cs.CVPDF

[48] Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications cs.CV | cs.CLPDF

[49] Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact cs.CV | cs.CLPDF

[50] A systematic evaluation of machine learning classifiers for event-by-event background rejection in LAFOV PET scanners cs.CV | physics.med-phPDF

[51] Image Quality Dependent Degradation for AI Systems cs.CV | cs.AIPDF

[52] Towards Faithful Sentimental Image Captioning via Evidence-Aware Multi-Agent Reasoning cs.CVPDF

[53] Fine-Grained Food Image Understanding via Target-Aware Data Alignment cs.CVPDF

[54] Explicit Layer Modeling for Video Object Insertion and Layer Decomposition cs.CVPDF

[55] Freq-RemoteVAR: Next-Frequency Autoregressive Modeling for Remote Sensing Change Detection cs.CVPDF

[56] SepPrune:A Separator-based Pruning Framework for Efficient Multimodal Large Language Models cs.CVPDF

[57] Food Image Segmentation with LLM-Derived Ingredient Labels and Multimodal Fusion cs.CVPDF

[58] Beyond Static Costs: Learning-Dynamics Aware Loss Functions for Long-Tailed Classification cs.CVPDF

[59] Open-Ended CT Volume Segmentation with Weak Supervision from Language cs.CVPDF

[60] Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QA cs.CV | cs.AIPDF

[61] Face De-Identification: A Domain-Centric Survey from Capture to Processing cs.CV | cs.AIPDF

[62] MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities cs.CV | cs.AI | cs.LGPDF

[63] Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition cs.CV | cs.AIPDF

[64] LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection cs.CVPDF

[65] Schrödinger’s Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics cs.CV | cs.LGPDF

[66] Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing cs.CVPDF

[67] Parallel Decoding Distillation for Fast Image and Video Generation cs.CV | cs.LGPDF

[68] VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening cs.CV | cs.LGPDF

[69] Wonder: Video World Model Done Better cs.CV | cs.GRPDF

cs.MM [Back]

[70] AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities cs.MM | cs.CV | cs.SDPDF

cs.RO [Back]

[71] Leveraging Semantic Maps for City-Scale Cross-View Localization cs.RO | cs.CVPDF

[72] HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone cs.RO | cs.CV | cs.LGPDF

cs.IR [Back]

[73] VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents cs.IR | cs.AI | cs.CLPDF

[74] DocAnnot – Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation cs.IR | cs.AI | cs.CL | cs.CVPDF