cs.CL [Total: 17]
cs.CV [Total: 47]
cs.AR [Total: 1]
cs.AI [Total: 3]
cs.SD [Total: 2]
cs.RO [Total: 2]
cs.LG [Total: 1]

cs.CL [Back]

Rafael Macalaba, Aivin V. Solatorio, Patrick Michael Brock, Olivier Dupriez

TL;DR: 本文提出了一种弱监督框架，用于从强制流离失所和脆弱、冲突与暴力（FCV）领域的文档中提取数据集提及。该方法无需构建大规模人工标注训练集，而是先利用在通用研究文献上训练的轻量级模型生成候选提及，再由前沿大语言模型（LLM）在上下文中进行审查、验证、拒绝或修正边界。生成的标注与定向合成的对比示例结合，用于微调轻量级模型，最终实现大规模提取。

Details

Motivation: 发展和人道主义组织产生了大量调查、行政登记等数据资源，但这些数据集在研究报告、项目文档等非结构化文本中的引用分散且难以系统识别，这限制了追踪数据使用和识别数据可用性或传播差距的能力。

Result: 在包含1,706个文本段落的独立黄金标准基准测试（涵盖研究、人道主义和操作文档）上，模型在提及级别实现了74.1%的精确率和70.5%的召回率；在包含数据集引用的段落中，精确率达到89.5%。在段落级别，模型在区分包含与不包含数据集引用的段落时，达到了88.2%的准确率和88.6%的特异性。

Insight: 创新点在于结合了弱监督、轻量级模型生成候选与大语言模型（LLM）上下文审查的标签精炼流程，有效解决了领域特定标注数据有限的问题。该方法为在标注数据稀缺的领域构建特定领域监督提供了一种实用方案，并为大规模分析数据使用和差距奠定了技术基础。

Abstract: Development and humanitarian organizations produce and support surveys, administrative registries, and other data resources to inform research, policy, and operations, yet systematically identifying where these datasets are referenced remains difficult. Such references are dispersed across research papers, project documents, humanitarian reports, and other unstructured text, limiting both the ability to trace data use and to identify potential gaps in data availability or dissemination. We present a weakly supervised framework for adapting dataset extraction to forced displacement and Fragile, Conflict, and Violence (FCV) documents without first constructing a large manually labeled training corpus. A lightweight model trained on general research literature generates candidate dataset mentions from unlabeled domain documents, which a frontier large language model (LLM) reviews in context, validating or rejecting candidates and correcting their extraction boundaries. The resulting annotations are supplemented with targeted synthetic and contrastive examples and used to fine-tune the lightweight model for large-scale extraction. We evaluate the resulting model on an independent gold-standard benchmark of 1,706 text passages spanning research, humanitarian, and operational documents. Across the full benchmark, the model achieves 74.1% precision and 70.5% recall at the mention level; among passages containing dataset references, precision reaches 89.5%. At the passage level, the model achieves 88.2% accuracy and 88.6% specificity in distinguishing passages with dataset references from those without them. These results demonstrate a practical approach for constructing domain-specific supervision when labeled data are limited, and provide a technical foundation for larger-scale analysis of data use and potential gaps in the displacement data landscape.

[2] R2VC: Modular Fact-Checking with Retrieval, Verification, and Confidence Calibration cs.CL | cs.LGPDF

Dhruv Dixit, Paritosh Pandey

TL;DR: 本文提出了R2VC，一种用于自动化事实核查的模块化架构，包含检索、推理、验证和置信度校准四个步骤。该架构通过结合混合检索、生成结构化候选、外部NLI验证器以及序列级校准器，旨在提高事实核查的准确性和置信度可靠性。

Details

Motivation: 现有基于大语言模型的端到端事实核查方法通常将证据检索、推理和不确定性估计耦合在一起，导致失败难以诊断且置信度不可信。R2VC旨在通过模块化设计解决这些问题，实现可诊断、可信任的带引证和弃权的证据驱动事实核查。

Result: 在FEVER基准测试中，采用8B参数骨干模型的R2VC比基线准确率高出13.74%。消融实验表明，基于验证器的候选选择和置信度校准对性能提升贡献最大；移除候选选择会使FEVER准确率降至76.24%，移除校准则使Brier分数几乎翻倍至0.161。

Insight: 主要创新点在于将事实核查解耦为可独立优化的模块化流程，特别是引入外部NLI验证器进行基于证据的候选选择，以及轻量级序列级校准器进行置信度估计和选择性弃权。客观分析认为，这种模块化设计不仅提升了性能，还增强了系统的可解释性和可靠性，同时揭示了检索错误（尤其是错误实体证据）仍是当前的主要瓶颈。

Abstract: Large language models are increasingly used for automated fact checking, but end-to-end prompting often entangles evidence retrieval, reasoning, and uncertainty estimation, making failures difficult to diagnose and confidence difficult to trust. We present R2VC, a modular retrieve, reason, verify, calibrate architecture for evidence-grounded fact checking with citations and abstention. R2VC combines hybrid sparse+dense retrieval over Wikipedia, a supervised fine-tuned and DPO-aligned generator that produces diverse structured verdict candidates, an external NLI cross-encoder for evidence-based candidate selection, and a lightweight sequence-level calibrator for confidence estimation and selective abstention. On FEVER, an 8B backbone with R2VC achieves 13.74% higher accuracy than baseline. Ablation studies show that verifier-based candidate selection and confidence calibration are the largest contributors to performance. Removing candidate selection drops FEVER accuracy to 76.24%, while removing calibration nearly doubles the Brier score to 0.161. A manual analysis of 250 errors further shows that retrieval failures, especially wrong-entity evidence, remain the dominant bottleneck. Together, these results show that modular fact-checking pipelines can substantially improve both predictive accuracy and confidence reliability in open-domain verification.

[3] Chopthin-Consensus Power Sampling: A Diversity-Preserving Approach to LLM Decoding cs.CL | cs.AI | stat.MLPDF

Minoo Ahmadi, Seyedarmin Azizi, Erfan Baghaei Potraghloo, Mehdi Kamal, Massoud Pedram

TL;DR: 本文提出Chopthin-Consensus Power Sampling (CCPS)方法，一种用于大语言模型解码的多样性保持采样策略。该方法通过Chopthin重采样器限制权重极值比，保留更多不同的推理路径，并结合语义多数选择机制合并语义等价的答案，从而在不进行训练的情况下提升LLM的推理性能。

Details

Motivation: 现有基于顺序蒙特卡洛的推理时采样方法常采用等权重重采样，这会激进地修剪低权重轨迹，丢弃潜在正确的推理路径并降低搜索空间的谱系多样性。本文旨在解决此问题，通过保留多样性来提升推理的鲁棒性和准确性。

Result: 在三个开源模型和五个推理基准测试上的评估表明，Chopthin在15个设置中的13个提高了Oracle覆盖率。结合语义多数选择后，CCPS在15个设置中的14个匹配或超越了Power-SMC基线的最终答案准确率，绝对增益最高达10.6个百分点。

Insight: 核心创新点在于将Chopthin重采样器引入LLM解码，通过限制权重比而非强制等权重化来保持推理路径的多样性，并辅以语义聚类和多数投票的答案选择机制。这揭示了多样性保持的重采样与多样性感知的选择是提升免训练LLM推理的两个互补机制。

Abstract: Inference-time power sampling via Sequential Monte Carlo (SMC) can substantially improve large language model (LLM) reasoning without requiring post-training. However, many existing SMC approaches rely on equal-weight resampling, which can aggressively prune low-weight trajectories, discarding potentially correct reasoning paths and degrading the genealogical diversity of the search space. To address this, we introduce Chopthin-Consensus Power Sampling (CCPS). Our method applies the Chopthin resampler to LLM decoding: rather than equalizing weights and forcing unnecessary particle duplication, it enforces an upper bound on the ratio between the largest and smallest weights and carries the unequal weights forward. This targeted intervention preserves a richer set of distinct reasoning paths, keeps the weighted SMC approximation unchanged in conditional expectation, and guarantees a lower bound on the post-resampling effective sample size (ESS). To fully exploit this enriched population, we employ a semantic-majority selection mechanism that merges token-identical final trajectories, clusters semantically equivalent answers, and returns the answer supported by the largest number of distinct trajectories. Evaluating across three open-weight models and five reasoning benchmarks, we show that Chopthin increases oracle coverage in 13 of 15 settings. Combined with semantic-majority selection, CCPS matches or exceeds the final-answer accuracy of the Power-SMC baseline in 14 of 15 settings, delivering absolute gains of up to 10.6 percentage points. These findings demonstrate that diversity-preserving resampling and diversity-aware selection are complementary mechanisms for training-free LLM reasoning. Code is available at github.com/MinooAhmadii/chopthin-consensus-power-sampling.

[4] Repair Before Reinforce: Context-Augmented Knowledge Graph Reasoning for Multi-Hop Question Answering cs.CL | cs.AIPDF

Tharaka D. Fonseka, Niraj K. Jha

TL;DR: 本文提出了一种用于多跳问答的上下文增强训练框架。该框架首先通过LLM判断、历史感知的自适应修复管道来强化模型的一跳事实基础，确保其在清理后的验证集上达到100%准确率，然后利用强化学习进一步提升模型在更复杂多跳任务上的性能。在针对胃轻瘫和糖尿病构建的疾病知识图谱上验证，结果表明上下文增强监督比仅使用知识图谱监督能持续提升多跳推理性能，且从修复后的检查点初始化的强化学习能带来更大、更稳定的增益。

Details

Motivation: 解决大语言模型在仅使用孤立的知识图谱三元组进行训练时，难以学习多跳推理所需周围上下文信息的问题，以提升其在多跳问答任务上的表现。

Result: 在胃轻瘫和糖尿病疾病知识图谱上，上下文增强监督（CGModel）比仅使用知识图谱监督（KGModel）在多跳推理性能上持续提升。经过修复管道处理后，模型在清理后的一跳验证集上达到100%准确率。从修复后的SFT检查点初始化的强化学习，在3跳、4跳和5跳任务上带来了更大且更稳定的性能增益。

Insight: 创新点在于提出了“先修复，后增强”的两阶段训练范式：1）通过自适应修复管道（识别并修复一跳失败、持续微调、隔离噪声三元组）来夯实模型的事实基础；2）在修复后的坚实基础上，再应用上下文增强监督和强化学习来提升复杂多跳推理能力。这强调了在追求复杂能力前确保基础事实准确性的重要性，并展示了上下文图（由主三元组及其同源文本块中的支持三元组构成）作为监督信号的有效性。

Abstract: Question-answering often requires reasoning across multiple connected facts rather than retrieving a single isolated relation. Knowledge graphs (KGs) provide a structured way to represent such facts, but training large language models (LLMs) only on isolated KG head-relation-tail triples may limit their ability to learn the surrounding context needed for multi-hop reasoning. In this work, we propose a context-augmented training framework for multi-hop question-answering. Although generally applicable, we validate the framework in the context of disease-specific KGs, extracted using a reliable KG extraction framework called GraphMERT, for Gastroparesis and Diabetes. For each primary KG triple, we attach supporting triples extracted from the same source text chunk to form a context graph (CG). This creates two supervision settings: KG-grounded supervision, which uses only the target KG triple or path, and CG-grounded supervision, which uses the target KG triple or path together with supporting context triples. We train the Qwen3-14B model using supervised fine-tuning (SFT) under both settings, producing KGModel and CGModel variants. To strengthen the lower-hop factual foundation of the models, we introduce an LLM-judged, history-aware adaptive repair pipeline that identifies unresolved one-hop failures, continually fine-tunes on targeted repair examples, and removes or quarantines problematic noisy triples. This repair stage enables the models to reach 100% accuracy on the cleaned retained one-hop validation sets. Finally, we employ reinforcement learning (RL) using lower-hop question-answer items and evaluate generalization on harder 3-hop, 4-hop, and 5-hop tasks. Across both diseases, context-augmented supervision consistently improves multi-hop performance over KG-only supervision. RL initialized from repaired SFT checkpoints yields larger and more stable gains.

[5] HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge cs.CL | cs.AI | q-bio.QMPDF

Dominic Okonkwo, Adetayo Okunoye, Ismailcem Budak Arpinar

TL;DR: 该论文研究了大型语言模型（LLM）在生物医学假设生成中的推理能力，通过整合KEGG、Rhea和UniProt数据库构建了一个统一的生化知识图谱（HypoKG），并创建了一个包含550条从酶源到罕见疾病终点的路径基准。研究发现，当LLM仅获得源酶和疾病终点信息时，能生成评分最高的假设，但这些假设的证据基础较弱；而提供完整生物路径时，生成的假设与已知机制关系更一致，体现了证据约束推理。

Details

Motivation: 研究动机是探究LLM在生成生物医学假设时，究竟是基于科学证据进行推理，还是仅仅产生听起来有说服力的想法，以评估其真实推理能力。

Result: 在构建的包含13,200个假设的基准上，使用专家制定的五标准评分规则（每项1-5分）进行评估。结果显示，提供完整路径时假设的证据基础显著更强（证据基础评分下降delta = -0.793，p < 0.001），证实了模型在推理中真正使用了路径结构。

Insight: 论文的创新点在于提出了“证据约束推理”的概念，并证明知识图谱在假设生成中的双重作用：识别文献中未出现的生物终点对，以及通过其机制路径指导LLM在它们之间进行推理。这为利用结构化知识提升LLM的科学推理可解释性和可靠性提供了新思路。

Abstract: Large language models (LLMs) can generate biomedical hypotheses, but it remains unclear whether they truly reason from scientific evidence or simply produce convincing-sounding ideas. To study this, we combine three major biological databases: the Kyoto Encyclopedia of Genes and Genomes (KEGG), Rhea, and UniProt, into a unified biochemical knowledge graph and construct a benchmark of 550 paths connecting enzyme sources to rare disease endpoints, yielding 13,200 hypotheses from six LLMs under four conditions varying the biological information each model receives: source enzyme only, full biological path, or source and disease endpoint only. Hypotheses are scored using an expert-derived five-criterion rubric on a 1-5 scale per criterion. We find that models given both the source and disease endpoint often produce the highest-scoring hypotheses, showing that LLMs can generate compelling ideas from minimal information. However, these hypotheses are less grounded in the evidence. In contrast, models given the full biological path generate hypotheses more consistent with known mechanistic relationships. We call this evidence-disciplined reasoning. To confirm this effect, we shuffled intermediate path steps while keeping endpoints fixed. Evidence grounding dropped significantly (delta = -0.793, p < 0.001), confirming models genuinely used path structure during reasoning. Our findings show that knowledge graphs support hypothesis generation in two ways: they identify biological endpoint pairs absent from the literature, and their mechanistic paths guide how LLMs reason between them.

[6] AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization cs.CLPDF

Ji Liu, Saptarshi Majumder, Yiqing Huang, Wenwen Ouyang, Umang Pandey

TL;DR: 本文介绍了AMDKernelVault，这是一个针对AMD CDNA GPU的开源HIP和Triton内核语料库及训练框架。该工作开发了HIPKernelGen和TritonKernelGen两个智能体驱动的流水线，用于将PyTorch参考代码转换为HIP或Triton内核，并在ROCm环境下编译验证、在AMD硬件上进行延迟分析。语料库包含大量经过执行验证的内核样本。作为应用演示，作者基于该语料库对Qwen3-8B模型进行了监督微调和执行感知的强化学习训练。

Details

Motivation: 当前基于LLM的内核优化智能体主要围绕CUDA/NVIDIA生态构建，且通常依赖反复调用前沿大模型进行生成、反思和优化。本研究旨在填补这一空白，为AMD GPU提供专门的、大规模的开源内核语料库和训练框架，以促进AMD硬件上的高性能计算内核开发与优化。

Result: 在固定评估预算下，经过训练的Qwen3-8B模型在多个基准测试中取得了最高的正确率：在PyTorch-to-HIP上达到34.0% Pass@1，在TritonBench-G上达到33.2% Corr@3，在ROCmBench上达到41.94% Corr@3。然而，该模型在编译或速度指标上并未取得全面领先。

Insight: 论文的主要创新点在于构建了首个面向AMD GPU的大规模、开源、执行验证的HIP/Triton内核语料库（AMDKernelVault），并设计了配套的智能体驱动内核生成流水线（HIPKernelGen/TritonKernelGen）。从客观角度看，其贡献在于为AMD生态提供了关键的、稀缺的数据基础设施，并通过结合监督微调和执行感知的强化学习来训练专用模型，展示了语料库的实用价值，有助于降低AMD GPU高性能编程的门槛。

Abstract: We introduce AMDKernelVault, an open HIP and Triton kernel corpus and training framework for recent AMD CDNA GPUs. Existing LLM-based kernel agents are largely CUDA/NVIDIA-centric and often depend on repeated frontier-LLM calls for generation, reflection, and optimization. To address this gap, we develop HIPKernelGen and TritonKernelGen, agent-driven pipelines that transform PyTorch references into HIP or Triton kernels, compile and validate candidates under ROCm, and latency-profile them on AMD hardware. The corpus contains 62,153 execution-verified HIP kernel samples, 2,377 production-grounded ROCm Libraries QA entries, and 39,893 Triton kernels. We further train Qwen3-8B with supervised fine-tuning and execution-aware reinforcement learning as a demonstration of the corpus’s utility. Under fixed evaluation budgets, it achieves the highest correctness among the compared models on PyTorch-to-HIP (34.0% Pass@1), TritonBench-G (33.2% Corr@3), and ROCmBench (41.94% Corr@3), but does not uniformly lead compilation or speed metrics. The corpus and documentation are available at https://huggingface.co/datasets/amd/AIG-Datasets, and the associated training and kernel-generation code is available at https://github.com/AMD-AGI/hip_kernel_llm_lab.

[7] Zipbench: Low-Cost Framework for Compressing Comprehensive Benchmarks of Large Language Models cs.CLPDF

Zhongzhan Huang, Junxin Li, Guoming Ling, Yupei Lin, Shanshan Zhong

TL;DR: 本文提出了ZipBench，一种低成本的大语言模型（LLM）基准测试压缩框架，旨在解决现有基准测试冗余且评估成本高昂的问题。该方法仅需评估少量锚定LLM，通过合成伪评估结果、学习紧凑样本表示并选取代表性子集，构建了覆盖文本、多模态和智能体任务的ZipBench Zoo压缩基准库。

Details

Motivation: 动机在于广泛使用的LLM基准测试存在冗余，导致评估成本过高，而现有基准压缩方法（BCMs）通常依赖大量LLM的逐样本评估结果，难以扩展到新发布的基准测试上。

Result: 在100多个基准测试代理上，ZipBench构建的压缩版本与完整基准相比，平均绝对误差为0.002-0.02，平均斯皮尔曼相关系数约为0.98，有效降低了评估成本。

Insight: 创新点在于提出了一种理论上有误差和排序一致性保证的低成本基准压缩框架，通过合成伪结果扩展覆盖范围，无需依赖大量现有评估数据，便于新基准的快速压缩和应用。

Abstract: Comprehensive benchmark suites are essential for improving large language models (LLMs), but many widely used benchmarks are redundant, making evaluation unnecessarily expensive. Although recent benchmark compression methods (BCMs) can mitigate this cost, many strong BCMs rely on large collections of per-sample evaluation results from numerous LLMs to identify representative samples. Building such collections is also expensive unless they are already public, making these methods difficult to extend to newly released benchmarks. To address this challenge, we present ZipBench, a simple and low-cost BCM with theoretical error and rank-consistency guarantees. ZipBench evaluates only a small set of anchor LLMs, synthesizes pseudo evaluation results to broaden coverage, learns compact sample representations, and selects a small yet representative subset. Building on it, we create ZipBench Zoo, a collection of compact versions of 100+ benchmark proxies spanning text, multimodal, and agent tasks. These benchmark achieve mean absolute errors of 0.002–0.02 and average Spearman correlations of ~0.98 with the full benchmarks. Overall, ZipBench reduces the cost of both LLM evaluation and compact benchmark construction, lowering the barrier to broad LLM research for compute-constrained researchers. The code has been released in https://github.com/MilkThink-Lab/ZipBench.

[8] Agent as Policy for Robotic Manipulation cs.CLPDF

Mengzhao Jia, Yang Lin, Xixin Zhang, Zhihan Zhang, Xiaobai Liu

TL;DR: 本文提出了Agent as Policy (AGP)框架，使通用智能体能够直接驱动物理机器人执行任务，而无需针对特定任务或环境进行训练。该智能体通过解释视觉证据、编写可执行程序、发出运动命令并根据物理结果调整行动，将任务规划与执行置于其控制之下。研究在多种真实世界操作任务上进行了验证，包括精密操作、动态运动和可变形物体处理。

Details

Motivation: 旨在解决通用智能体如何直接、零样本地控制物理机器人执行多样化操作任务的问题，无需针对每个具体任务或环境进行专门训练，从而扩展智能体在物理世界中的自主性。

Result: 在多个真实世界操作任务上进行了评估，包括从人类视频进行组装、根据目标图像进行积木搭建、骰子重定向、目标投掷和双手毛巾折叠。在三种积木搭建配置上，AGP分别取得了100%、100%和80%的成功率。

Insight: 核心创新在于将智能体本身直接作为机器人的策略，通过运行时推理、编程和与物理世界的持续交互来完成任务，这为通用智能体作为机器人策略开辟了新路径，实现了从纯认知到物理操作的延伸。

Abstract: We demonstrate that a general-purpose agent can directly drive a physical robot throughout task execution without any task-specific or environment-specific training. We introduce Agent as Policy (AGP), which places task planning and execution under the agent’s control. Given a task and a robot interface, the agent interprets visual evidence, writes executable programs, issues motion commands, and revises its actions in response to physical outcomes. This brings the agent’s reasoning and programming capabilities into continuous interaction with the physical world. We study AGP across multiple real-world manipulation tasks spanning precision manipulation, dynamic motions, and deformable objects. These include assembly from human videos, block construction from goal images, die reorientation, targeted throwing, and bimanual towel folding. AGP achieves success rates of 100%, 100%, and 80% on three block construction configurations. These findings establish a path for general-purpose agents to act as robotic policies, extending their autonomy to physical manipulation through runtime reasoning, programming, and interaction.

[9] Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picture cs.CL | cs.AI | cs.HCPDF

Cody Kommers, Mingrui Ye, Evelyn Gius, Daniela Mihai, Hoyt Long

TL;DR: 本文研究了多模态语言模型在生成线索时与人类在模糊性处理上的差异，通过Dixit游戏任务发现模型倾向于产生过度明确、缺乏文化参考的线索，而人类则能利用文化知识和模糊性进行创造性表达。

Details

Motivation: 探讨AI系统如何处理模糊性，以及人类如何将模糊性作为生成性资源用于沟通和文化表达，特别是在多模态语境下。

Result: 在基于Dixit游戏的任务中，模型表现出模糊性崩溃（输出过度明确）和文化扁平化（缺乏文化知识引用），与人类线索形成鲜明对比。

Insight: 论文创新地提出了校准模糊性的概念，并揭示了多模态模型在文化理解和模糊性生成方面的局限性，强调了将文化知识融入AI系统的重要性。

Abstract: Ambiguity is often treated as a bug for AI systems to resolve—but in human communication and culture, ambiguity can also be a generative resource. From humour to politics to art, people express themselves in words and images that are open enough to invite different interpretations, yet constrained enough to be interpretable. We operationalise this notion of calibrated ambiguity with a task drawn from the parlour game Dixit. We compare differences in clues generated by human vs multimodal language models, based on a novel coding rubric for calibrated ambiguity, and find that models consistently exhibit ambiguity collapse (i.e., their outputs are over-specified, leaving no room for multiple legitimate interpretations). Unlike human clues, AI-generated clues also exhibit cultural flattening; they almost never make reference to culturally-situated knowledge, even when prompted to use allusion and figurative language.

[10] Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy cs.CL | cs.AI | cs.IRPDF

Gengxian Zhou, Jian Xu, Zichen Tang, Shiming Xiang, Haihong E

TL;DR: 本文提出了一种名为CoG（Cognition on Graph）的训练无关框架，用于增强大型语言模型在复杂知识推理任务中的能力。该框架受人类认知启发，通过计划-探索-反思的循环，在大型异构知识库（如图谱和文本）中进行自适应探索，并实现图谱与文本之间的深度双向协同。

Details

Motivation: 现有检索增强生成方法在处理大规模、异构知识库（如知识图谱和文本语料）进行复杂推理时存在局限，其图谱探索策略通常是反应式、盲目遵循图谱拓扑，缺乏对问题上下文和探索进程的自适应，且图谱与文本之间缺乏深度双向协同。

Result: 在七个多跳问答基准测试上的广泛实验表明，CoG显著优于最先进的方法，同时实现了更高的探索效率。

Insight: 核心创新在于受人类问题解决启发的、持续的计划-探索-反思认知循环，以及结构化图谱与非结构化文本之间的深度双向协同机制，其中从文本中动态提取的实体能指导图谱探索以弥合知识鸿沟，这是一种无需训练的自适应策略。

Abstract: Retrieval-Augmented Generation (RAG) has empowered Large Language Models (LLMs) to tackle knowledge-intensive tasks. However, navigating global, heterogeneous knowledge bases (large-scale knowledge graphs and text corpora) for complex reasoning remains a challenge. Existing methods typically employ reactive, graph-driven exploration strategies, which blindly follow graph topology without adapting to the question context or evolving exploration progress, and lack deep bidirectional synergy between graph and text. To address these limitations, we propose CoG (Cognition on Graph), a cognitive-inspired, training-free framework for adaptive knowledge exploration. Drawing inspiration from human problem-solving, CoG performs a continuous plan-explore-reflect cycle, where it proactively formulates investigation plans, performs dual-source retrieval, and dynamically reflects on progress to adjust strategies. Crucially, it establishes deep bidirectional synergy between structured graph and unstructured text, where entities extracted from text dynamically guide graph exploration to bridge knowledge gaps. Extensive experiments on seven multi-hop QA benchmarks demonstrate that CoG significantly outperforms state-of-the-art methods while achieving superior exploration efficiency. Our code and datasets are available at https://github.com/zhougengxian/CoG.

[11] LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification cs.CL | cs.AIPDF

Hui Ye, Jing Zhang, Xiulong Yang, Rajshekhar Sunderraman

TL;DR: 本文提出DualMLC，一种双分支学习框架，用于大规模多标签文本分类。该框架通过自回归解码器模型和双向编码器分别处理文档，各自独立计算标签相关性得分，并通过后期对数融合结合两个分支的结果，以利用异构语言模型的互补性。

Details

Motivation: 现有基于预训练语言模型的方法主要依赖单一编码器或单一排序器结合辅助特征，未能充分探索异构语言模型之间的互补性，因此本文旨在通过双分支框架整合不同语言模型的优势。

Result: DualMLC在三个广泛使用的大规模多标签文本分类基准测试上取得了最先进（SOTA）的结果，消融实验进一步证实融合异构预测器能产生比任一单独分支更强的排序性能。

Insight: 创新点在于提出双分支框架，通过异构语言模型（自回归解码器与双向编码器）的独立表示路径和后期对数融合，利用共享证据增强相关标签，并通过分支特定证据弥补另一分支表示的局限性，从而提升分类性能。

Abstract: Large-scale multi-label text classification assigns a small subset of relevant labels to each document from a vocabulary containing thousands or tens of thousands of candidate labels. Although pretrained language models have improved semantic text representations, most representation-based approaches center their prediction pipelines on a primary encoder or combine auxiliary features within a single ranker. The complementarity between heterogeneous language models therefore remains insufficiently explored. We propose DualMLC, a dual-branch framework that processes the same document through an autoregressive decoder-only language model and a bidirectional encoder. Each branch maintains its own representation pathway and independently estimates relevance scores over the shared label space. DualMLC combines the two score vectors through late logit fusion, allowing shared evidence to reinforce relevant labels and branch-specific evidence to compensate for limitations in the other branch’s representation. DualMLC achieves state-of-the-art results on three widely used large-scale multi-label text classification benchmarks. Ablation results further confirm that integrating the heterogeneous predictors produces stronger rankings than either branch alone. The source code is publicly available at https://github.com/huiyegit/DualMLC.

[12] Parameter-Efficient Retrievers for Polish and European Languages cs.CLPDF

Sławomir Dadas, Rafał Poświata, Małgorzata Grębowiec, Michał Perełkiewicz

TL;DR: 本文提出了一种三阶段训练流程，用于开发紧凑高效的稠密检索模型，该流程结合了跨语言对齐、关系知识蒸馏和对比微调技术，无需原始真实相关性标签，仅利用强嵌入模型和重排序器生成的监督信号。基于此流程，作者开发了支持8192令牌上下文的PolDense（波兰语系列模型，参数规模从1700万到10亿）和EuroDense（支持九种欧洲语言的4.35亿参数模型）。

Details

Motivation: 针对当前稠密检索系统依赖数十亿参数语言模型导致内存和计算成本高昂，难以支持大规模索引、频繁语料更新和低延迟服务的问题，旨在开发参数高效且性能仍具竞争力的检索模型。

Result: 在覆盖41个波兰语和150个多语言检索任务的广泛评估中，PolDense-10亿参数模型在性能上优于评估中参数高达90亿的检索模型，且PolDense系列在不同模型规模上形成了帕累托前沿；在10亿参数以下的评估模型中，EuroDense在任务平均和语言平均性能上均排名第一，并在九种语言中的七种领先。

Insight: 创新点在于提出了一种无需人工标注、完全利用教师模型生成监督信号的三阶段训练流程，有效实现了跨语言知识迁移和模型压缩，在保持高性能的同时显著提升了参数效率，为多语言稠密检索模型的轻量化部署提供了可行方案。

Abstract: Dense retrieval systems increasingly rely on multi-billion-parameter language models, whose memory and computational requirements make large-scale indexing, frequent corpus updates, and low-latency serving costly. We present a three-stage training pipeline for developing compact and efficient retrievers that remain competitive with substantially larger models. The pipeline combines cross-lingual alignment, relational knowledge distillation, and contrastive fine-tuning. It requires no original ground-truth relevance labels, relying exclusively on supervision generated by strong embedding models and rerankers utilised as teachers. Using this pipeline, we develop PolDense and EuroDense, both supporting contexts of up to 8,192 tokens. PolDense is a family of six Polish retrievers ranging from 17M to 1B parameters. EuroDense is a 435M-parameter retriever supporting nine European languages. We conduct an extensive evaluation covering 41 Polish and 150 multilingual retrieval tasks. The results demonstrate strong quality-efficiency trade-offs. PolDense-1B outperforms the evaluated retrievers with up to 9B parameters, while the PolDense family forms the Pareto frontier across model sizes. Among the evaluated models below 1B parameters, EuroDense ranks first in both task-averaged and language-averaged performance and leads in seven of nine languages. We release all models publicly.

[13] Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage cs.CL | cs.LGPDF

Foad Namjoo, Remy Ogasawara, Amirali Abdullah, Cullen Anderson, Narmeen Fatimah Oozeer

TL;DR: 该论文指出，二元选择真实性基准测试中，正确答案和错误答案可能在表面特征上存在系统性差异，导致模型无需进行预期推理即可超越随机猜测。作者通过构建简单分类器检测并利用这种特征泄漏，提出了一种名为Audit-Prune的通用机制来清理基准数据集，以减少表面特征泄漏，并发布了清理后的TruthfulQA版本。

Details

Motivation: 解决二元选择真实性基准测试中因表面特征泄漏导致模型可能通过捷径而非真实推理获得高准确率的问题，确保基准测试的有效性。

Result: 在TruthfulQA基准上，仅使用六个表面特征的逻辑回归分类器就能显著区分正确答案和错误答案，表明存在严重的特征泄漏；通过Audit-Prune机制清理后，泄漏被降低至接近随机水平。

Insight: 创新点在于提出了一种可检测和减少基准测试中表面特征泄漏的通用方法（Audit-Prune），强调在发布基准前进行数据清理的重要性，以避免模型学习无关的捷径特征。

Abstract: Binary-choice truth benchmarks ask models to choose between a correct and an incorrect answer, but if the two answers differ systematically in surface-level features, models can exceed chance without performing the intended reasoning. We show that this failure mode is detectable and can be exploited by downstream classifiers. In TruthfulQA, a simple six-feature logistic classifier achieves substantial accuracy in separating correct from incorrect answers. We further show that similar surface-level artifacts are present in additional benchmarks. To counteract this, we developed a general mechanism to clean them by removing the most leakage-reinforcing pairs. We release a version of TruthfulQA with surface-feature leakage reduced close to chance and provide a mechanism, Audit-Prune, so that the datasets can be cleaned before release.

[14] Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models cs.CL | cs.AIPDF

Utkarsh Soni, Syed Shariyar Murtaza, Yifan Nie, Sachin Chandrasekhar, Eugene Wen

TL;DR: 本文介绍了TAM基准测试，用于评估大语言模型在长流程程序性推理任务上的表现。该基准基于真实世界的ICD-10-CM临床编码和美国联邦量刑指南任务构建，要求模型遵循长达数百页的规则手册执行多步推理。实验表明，现有LLM在TAM上的精确匹配性能极低，揭示了当前基准可能高估了模型的真实推理能力。

Details

Motivation: 现有基准测试多为短流程推理任务，无法评估LLM在真实世界长流程、多步骤程序性任务（如遵循复杂手册）中的可靠性，因此需要构建更贴近实际应用的评估基准。

Result: 在TAM基准上，最佳模型（GPT-5结合检索增强生成等方法）的精确匹配准确率极低：ICD-10-CM编码任务仅为1%，量刑任务为15.5%，表明现有方法在长流程规则推理上存在严重不足。

Insight: 创新点在于构建了首个面向长流程程序性推理的真实世界基准TAM，揭示了LLM在复杂规则手册遵循任务上的关键短板；客观来看，该研究强调了评估LLM实际应用能力时需超越传统短流程任务的重要性。

Abstract: Large language models (LLMs) have achieved strong performance on a wide range of natural language tasks, and recent benchmarks suggest that they are increasingly adept at multi-hop reasoning. However, these benchmarks are typically short-horizon, requiring only a small number of retrieval or inference steps, and provide limited evidence of reliability on real-world tasks that involve following manuals spanning hundreds of pages with complex, interdependent guidelines. In this paper, we introduce Tasks over Application Manuals (TAM), a benchmark for evaluating long-horizon procedural reasoning. We construct TAM by curating real-world tasks from two domains: ICD-10-CM clinical coding (mapping medical conditions to diagnostic codes) and U.S. federal sentencing (computing crime sentencing guideline outcomes, specifically offense levels), with human-validated labels. Each task requires following an authoritative manual with tens of thousands of rules and executing a sequence of interdependent steps across different sections to produce an exact answer. We evaluate general-purpose prompting approaches, including retrieval-augmented generation, ReAct-style prompting, and an agent-harness baseline on GPT-5, and find that the best exact-match performance remains extremely low: 1% on ICD-10-CM coding and 15.5% on sentencing tasks. These results show that current benchmarks may overestimate LLM reasoning ability and miss a key challenge: reliably following long, rule-based procedures. The complete TAM data and code are publicly available.

[15] Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents cs.CL | cs.SDPDF

Yunqi Lu, Tyler Baumgartner, Nikhil Johri, Brandon Tai, Candice Fan

TL;DR: 本文提出了一种名为Duplex Cue的新评估方法，用于衡量全双工语音代理在对话中面对重叠语音时的‘轮内适应’能力，即说话者如何整合听者的即时贡献。通过一项案例研究，比较了人类与PersonaPlex模型在真实对话中的适应行为表现。

Details

Motivation: 现有全双工评估通常只关注代理是继续说话还是停止，这种二元划分无法涵盖人类常用的第三种反应：在继续说话的同时整合听者刚刚贡献的内容（如补充、纠正或澄清）。

Result: 在基于300个人类确认线索的案例研究中，针对66个协作性对话对，人类说话者在68.2%的情况下会进行适应，而PersonaPlex模型仅达到34.8%。模型在其他情况下表现为继续不变（42.4%）或让步（22.7%）。

Insight: 创新点在于提出了一个将听者意图（如反馈、协作、打断）与说话者行为（继续不变、轮内适应、让步）分离的评估框架，强调了评估自然语音交互不仅需要关注代理是否继续说话，更需要衡量其对听者贡献的响应方式。

Abstract: Full-duplex evaluation often emphasizes whether an agent keeps speaking or stops. That binary cannot express a third response humans use routinely: continuing to speak while incorporating what the listener just contributed. The contribution may be a missing word, a correction or a clarification. We introduce Duplex Cue, an evaluation of this \emph{in-turn adaptation} in full-duplex voice agents. Duplex Cue separates listener intent (backchannel, collaboration, or interruption) from speaker behavior: continuing unchanged, adapting within the turn, or yielding. Adaptation includes acknowledgment as well as content revision. In a single-model case study using 300 human-confirmed cues from unscripted English conversations, we compare recorded human responses with PersonaPlex continuations generated while replaying the listener’s audio. We retain 208 pairs with the ongoing speaker active at cue onset and a scorable response in each condition. On the 66 collaborative pairs, recorded speakers adapt in 68.2% of cases, compared with 34.8% for PersonaPlex. The model otherwise continues unchanged (42.4%) or yields (22.7%). These findings show why evaluating natural voice interaction requires measuring how an agent responds to a listener’s contribution as well as whether it keeps speaking.

[16] Expert-Space Exploration in MoE Reinforcement Learning cs.CLPDF

Hongyi He, Zhenghao Lin, Xiao Liu, Peng Cheng, Yan Lu

TL;DR: 本文提出了一种名为专家空间探索强化学习（ESRL）的架构感知框架，专门用于提升混合专家（MoE）模型在强化学习中的性能。该方法通过有策略地扰动专家路由来增加探索多样性，同时通过保留高置信度专家作为锚点、限制随机路由到合理候选池以及根据路由器熵自适应调整扰动强度来维持生成质量。实验表明，ESRL在多种MoE骨干网络和任务上均取得了最佳性能，且无需额外采样或计算成本。

Details

Motivation: 现有MoE模型的强化学习研究主要关注优化稳定性和训练效率，而将专家选择视为固定组件。然而，路由决定了诱导输出分布的稀疏计算路径，因此专家选择是增加策略探索多样性的一个潜在来源。作者通过实证分析发现，扰动专家路由能有效改变模型输出并增加探索多样性，但直接扰动可能激活不合适的专家，严重降低生成质量。

Result: 实验在采用top-K、top-1和共享专家路由的多种MoE骨干网络，以及数学、科学和代码任务上进行。ESRL在所有对比方法中取得了最佳性能。具体而言，在Qwen3-30B-A3B模型上，ESRL在平均Pass@1和Pass@8指标上分别比GRPO方法提升了3.2和4.5个百分点。

Insight: 论文的核心创新在于将MoE模型的路由结构明确作为强化学习的探索空间，并设计了一个架构感知的框架来安全、有效地利用这一空间。具体创新点包括：1）将高置信度专家作为锚点保留，以维持可靠的计算路径；2）将随机路由限制在合理的候选专家池内；3）根据路由器熵自适应调整扰动强度，避免过度扰动；4）记录并回放rollout阶段使用的专家路径，以缓解扰动引入的路由不匹配问题。这为利用MoE特定结构来增强RL训练提供了新思路。

Abstract: Reinforcement learning (RL) has become central to post-training of large language models. Recent advances in RL for Mixture-of-Experts (MoE) models have primarily focused on improving optimization stability and training efficiency, while treating the expert selection as a fixed component. Since routing determines the sparse computation paths that induce output distributions, expert selection offers an additional source of rollout diversity. Through empirical analysis, we find that perturbing expert routing effectively alters model output and increases rollout diversity, which is similar to increasing the decoding temperature. However, direct perturbation can activate unsuitable experts and substantially degrade rollout quality. Motivated by these observations, we introduce Expert-Space Exploration Reinforcement Learning (ESRL), an architecture-aware framework that explicitly explores the expert-routing space of MoE models. ESRL preserves high-confidence experts as anchors, and restricts stochastic routing to a plausible candidate pool, thereby retaining reliable computation paths. The perturbation strength is further adapted according to router entropy to avoid over-perturbation. To mitigate the routing mismatch introduced by perturbation, ESRL records the expert paths used during rollout and replays them during policy optimization. Experiments demonstrate that ESRL achieves the best performance across MoE backbones with top-K, top-1, and shared-expert routing, as well as across mathematics, science, and code tasks without additional sampling or computational cost. Specifically, ESRL on Qwen3-30B-A3B achieves the best among all compared methods, improving average Pass@1 and Pass@8 over GRPO by 3.2 and 4.5 percentage points, respectively. Further analyses of expert utilization and training dynamics provide insights into how exploiting MoE-specific routing structure benefits RL training.

[17] SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking cs.CLPDF

Zhiwei Li, Lei Zhu, Hao Gu, Xiang Hu, Yan Wang

TL;DR: 本文提出了SAS（Simple Attention Sparsification），一种通过端到端优化上下文排序来实现注意力稀疏化的方法。该方法在训练时将选择器的连续分数注入注意力logits，使语言建模损失能够直接更新选择器，从而在固定注意力预算下更有效地对上下文单元进行排序。

Details

Motivation: 现有可训练的注意力稀疏化方法通常使用轻量级选择器对上下文单元评分，然后进行硬Top-K选择，这会阻断语言建模损失的梯度。这导致选择器的排序与固定注意力预算下对预测的实际影响不一致，可能浪费有限的预算在不太有用的单元上。

Result: 在推理、长上下文理解和智能体任务上，SAS在各种注意力预算下均优于可训练的稀疏注意力基线，尤其是在严格预算下取得了显著提升，表明其在下游任务中实现了更有效的上下文排序。

Insight: 核心创新在于将选择器的连续分数以对数形式注入注意力softmax内部进行端到端优化，使模型学习相对优先级而非仅硬选择。同时，采用归一化softmax门来校准历史上下文与始终保留的当前块，并实现了内存高效的Triton内核以支持长序列训练。

Abstract: Post-training attention sparsification reduces the quadratic cumulative attention cost of pretrained Transformers by selecting a small set of context units (tokens or blocks) for each query. Existing trainable methods usually use a lightweight selector to score context units, followed by hard Top-K selection that blocks gradients from the language modeling loss. Consequently, these methods commonly distill layer-wise dense attention distributions. Although this encourages the selector to rank context units by dense attention weights in the original model, the ranking is not directly aligned with their impact on predictions under a fixed attention budget (i.e., the number of attended context units per query), potentially wasting the limited budget on less useful units. To address this misalignment, we propose Simple Attention Sparsification (SAS), a gated sparse attention mechanism that optimizes context ranking end-to-end with the language modeling loss. The key idea is to inject the selector’s continuous scores into attention logits during training, allowing the loss to update the selector through standard backpropagation. We identify several choices crucial for this simple design to work well in practice: placing the gate inside the attention softmax in log form, using normalized softmax gates to calibrate historical context against the always-retained current block, and preserving continuous selector scores so the model learns relative priorities rather than only hard selections. To support long-sequence training, we implement a memory-efficient Triton kernel that integrates SAS into FlashAttention-style computation. Across reasoning, long-context understanding, and agentic tasks, SAS consistently outperforms trainable sparse attention baselines across attention budgets, with especially large gains under tight budgets, demonstrating more effective context ranking for downstream tasks.

cs.CV [Back]

[18] Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity cs.CVPDF

Aditi Tiwari, Akshit Bhalla, Darshan Prasad, Heng Ji

TL;DR: 该论文提出了一种名为‘读取时记忆替换’的方法，用于直接测试视频模型中记忆机制的有效性。通过替换模型检索到的记忆内容，同时保持计算不变，该方法分离了记忆带来的整体收益与记忆特异性（即收益对检索到的具体内容的依赖程度）。实验在多个视频世界模型和数据集上进行，揭示了记忆收益可能源于通用表示支持、更广泛的上下文或精确的情景内容。

Details

Motivation: 当前视频模型广泛使用记忆机制来保存长序列信息，并假设性能提升源于检索和使用正确的过去内容。然而，标准的内存消融实验只能测试记忆是否有帮助，而无法验证检索到的内容是否真正负责这些收益。本文旨在直接测试记忆特异性，即模型增益在多大程度上依赖于检索到的具体内容。

Result: 在多个数据集和模型上的实验表明，记忆收益对检索内容的依赖程度差异很大。在Ego-Exo4D和7-Scenes数据集上，使用不含评估特定内容的身份无关控制记忆几乎能恢复全部收益；在TUM数据集上恢复约70%。在Ego-Exo4D的剂量响应实验中，当替换值偏离训练记忆表示时，恢复率从102%降至1%。WorldMem模型显示出分级依赖，而SAM 2模型则表现出强烈的记忆内容依赖性，在DAVIS数据集上，用错误但有效的记忆替换正确空间记忆导致平均区域和边界得分从0.926大幅降至0.182。

Insight: 论文的核心创新点是提出了‘读取时记忆替换’这一因果审计方法，它能够直接量化记忆特异性，从而区分记忆收益的来源是通用表示修复、上下文信息还是精确的情景内容。这为理解和诊断基于记忆的模型（尤其是视频模型）的内部机制提供了一个新的、更精细的分析工具。

Abstract: Video models increasingly use memory to preserve information over long sequences, with the assumption that gains come from retrieving and using the correct past content. Standard memory ablations test whether memory helps, but not whether the retrieved content is responsible. We test this directly with read-time memory substitution, which replaces the consumed memory value while leaving the rest of the computation unchanged. This separates memory benefit from memory specificity, the extent to which the gain depends on retrieved content. Across frozen video world models, identity-free controls containing no evaluation-specific content recover essentially the full benefit on Ego-Exo4D and 7-Scenes and about 70% on TUM. In the Ego-Exo4D dose response, recovery falls from 102% to 1% as these values move away from observed training-memory representations, supporting representation repair as the best-supported explanation in this setting. WorldMem shows graded dependence. A wrong memory from the same trajectory recovers 94.1% of the PSNR benefit relative to zero content, while a donor from a disjoint trajectory and biome recovers 43.7%. SAM 2 shows strong content dependence. On DAVIS, replacing the correct spatial memory with a valid wrong memory reduces mean region and boundary score from 0.926 to 0.182. At MOSEv2 reappearance, it falls from 0.459 to 0.000. These results show that memory gains can depend on generic representation support, broader context, or exact episodic content. Read-time substitution provides a direct way to distinguish them.

[19] Feature Recovery for Object Understanding After Irreversible Fire Damage cs.CVPDF

Aditi Tiwari, Sofia Stoica, Savya Khosla, David Forsyth, Heng Ji

TL;DR: 本文针对火灾后物体因物理变形导致的识别困难问题，提出了TRACE基准数据集和特征恢复模块（FRM）。TRACE包含21.4K真实图像合成的场景，涵盖499个物体在189个类别中的完整到损坏状态变化，定义了五个定位与理解任务。FRM作为一种即插即用模块，能将损坏特征映射到原始对齐表示，显著提升现有模型在严重退化场景下的性能。

Details

Motivation: 火灾后物体发生不可逆的物理变形（几何、材质、外观改变），导致现有视觉模型性能急剧下降，而标准图像损坏处理方法无法应对这种结构性退化，因此需要专门研究火灾后物体理解问题。

Result: 在TRACE基准上，现有模型（如RF-DETR、InternVL3.5）性能随损坏程度加剧而大幅下降（例如检测mAP下降71%，检索R@1从93.85降至28.11）。FRM模块在多种任务上带来显著提升：检索平均相对增益12.5%，材质恢复20.1%，描述生成13.2%，功能推理12.4%，且损坏越严重增益越大。

Insight: 创新点包括：1）构建了首个专注于火灾后物体物理退化的多任务基准TRACE；2）提出了轻量级即插即用特征恢复模块FRM，仅通过特征级监督实现损坏特征到原始特征的对齐，无需微调主干网络，提升了模型对结构性退化的鲁棒性。

Abstract: Objects in post-fire environments often undergo irreversible physical transformations that change their geometry, material state, and visual appearance. Detecting and identifying these remnants is critical for locating hazards, reconstructing pre-incident contents, and inventorying losses. Unlike standard image corruptions, these degradations affect the physical structure of the object itself. To study this setting, we introduce TRACE, a transformation-aware benchmark for post-fire object understanding. TRACE contains 21.4K real-image-grounded synthetic scenes and paired object-level pristine-to-degraded progressions spanning 499 object identities across 189 categories. We define five tasks targeting localization and pre-degradation understanding: degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning. Existing models degrade sharply with severity. From the least to the most severe level, RF-DETR mAP decreases by 71% relative, while InternVL3.5 retrieval R@1 falls from 93.85 to 28.11. To address this, we propose the Feature Recovery Module (FRM), a plug-and-play module that maps degraded encoder features to pristine-aligned representations while keeping the host frozen. Trained only with paired feature supervision, FRM improves scene-level detection, CLIP/SigLIP2 feature recovery, and all four object-level VLM tasks, with larger gains under more severe degradation. Across VLM hosts and severity levels, relative gains average 12.5% for retrieval, 20.1% for material recovery, 13.2% for description generation, and 12.4% for functional reasoning.

[20] Single-Query Person-Centric Bimanual Hand-Object Interaction Detection cs.CVPDF

Jonghyun Kim, Junho Roh, Yubin Yoon, Hyotae Lee, Jongkuk Park

TL;DR: 本文提出了一种以人为中心的双手-物体交互检测方法，通过单个查询预测一个人的结构化输出，包括人体框、姿态、手部框和状态以及交互目标。该方法引入了部分感知可变形注意力机制，并统一了检测与交互推理，在基于COCO构建的数据集上验证了其有效性。

Details

Motivation: 现有双手-物体交互检测方法多为手部中心化，将每只手视为独立实例，在多人物场景中易导致归属模糊。本文旨在解决如何从人物层面理解双手交互，明确双手归属并识别各自交互目标的问题。

Result: 在基于COCO构建的以人为中心的双手交互标注数据集上，实验表明，该基于Transformer的检测器框架提升了人物层面双手交互解析的性能，并为联合检测、姿态估计和手部推理提供了有效的统一框架。

Insight: 创新点在于提出了以人为中心的查询预测结构化输出，并设计了部分感知可变形注意力机制和手部到查询的关系矩阵，从而统一了检测与交互推理，避免了单独的对象回归，直接恢复目标框和类别。

Abstract: Understanding person-level bi-manual interactions requires not only detecting hands, but also identifying which two hands belong to the same person and what each hand interacts with. Existing hand–object interaction methods are mostly hand-centric: they treat each hand as an independent instance, which can lead to ambiguous ownership in multi-person scenes. We propose a person-centric formulation in which a single query predicts a structured output for one person, including the human box, body pose, hand boxes and states, and interaction targets. We introduce part-aware deformable attention to allocate attention across human, hand, and pose-specific reference regions, enabling one query to capture the full person structure. We further unify detection and interaction reasoning with a hand-to-query relationship matrix, where each hand selects its interaction target from the detected query set plus a learnable off token, directly recovering the target’s box and class without separate object regression. We build a COCO-based dataset with person-centric bi-manual interaction annotations and define structured metrics for evaluating hand states and complete hand–object tuples. Experiments with a transformer-based detector show that our formulation improves person-level bi-manual interaction parsing and provides an effective unified framework for joint detection, pose estimation, and hand reasoning.

[21] When Ground-Truth Fidelity Matters: An Orchestrated UAS Framework for Wheat Streak Mosaic Virus Detection Using Vision Transformers and Machine Learning cs.CVPDF

Dewi Endah Kharismawati, Sandeep Dhakal, Courtney E. McCusker, Jennifer R. Wilson, Erik W. Ohlson

TL;DR: 本文提出了一种基于无人机系统（UAS）多光谱影像和Vision Transformer的自动化管道，用于小麦条纹花叶病毒（WSMV）的植株级检测。研究发现，基于处理（接种与否）的标签存在严重噪声，导致模型高准确率主要由标签偏差驱动，而非真实的病害检测能力。当使用更可靠的ELISA验证标签时，模型性能显著下降，揭示了基于UAS的病害检测受限于标签保真度和数据可用性。

Details

Motivation: 解决小麦条纹花叶病毒（WSMV）早期检测困难的问题，因为其症状在空间上多变且细微，而传统目视检查不可靠，酶联免疫吸附测定（ELISA）虽准确但昂贵、劳动密集且难以规模化。

Result: 在使用基于处理的标签时，模型在超过6500个测试图像块上达到了89%的准确率。然而，当使用基于ELISA验证的更高保真度标签（行级症状严重度和植株级ELISA标签）进行评估时，深度学习和经典机器学习模型均表现出有限的泛化能力和较弱的可分离性。

Insight: 论文的核心创新点在于系统性地揭示了在农业病害检测中，标签保真度（即地面真实数据的可靠性）对模型性能评估的关键影响，挑战了仅依赖处理标签的常见做法。这强调了需要与真实生物条件对齐的标签和模型，对于推动基于遥感的植物表型分析走向实际应用具有重要借鉴意义。

Abstract: Wheat streak mosaic virus (WSMV) is a destructive pathogen of sweet corn and other cereal crops, causing yield losses and complicating early detection because symptoms are spatially variable and subtle. In sweet corn seed production, WSMV also has regulatory importance, as phytosanitary regulations from countries such as New Zealand and Chile require seed lots to be certified virus-free. Visual scouting is unreliable because symptoms can resemble abiotic stress, while enzyme-linked immunosorbent assay (ELISA) is accurate but expensive, labor-intensive, and difficult to scale. We present an automated pipeline for plant-level WSMV detection using unmanned aircraft systems (UAS) multispectral imagery. The framework integrates orthomosaic reconstruction, geospatial alignment, plant extraction, and classification using a Vision Transformer with seven-channel inputs (five spectral bands, NDVI, and NDRE). Using treatment-based labels, the model achieved 89% accuracy on over 6,500 test patches across multiple growth stages. However, ELISA-based ground truth revealed substantial label noise: only a small fraction of sampled plants in inoculated plots were infected. Treatment labels therefore did not reliably represent infection status, and the high accuracy was largely driven by label bias rather than disease detection. Performance decreased markedly against row-level symptom severity and plant-level ELISA labels. Under these higher-fidelity but smaller-sample conditions, both deep learning and classical machine learning showed limited generalization and weak separability between ELISA-confirmed mock-inoculated and infected plants. These results show that UAS-based disease detection is constrained by label fidelity and data availability, emphasizing biologically grounded labels and models aligned with real-world conditions.

[22] Physics as the label for measuring and correcting materials reasoning in multimodal models cs.CV | cond-mat.mtrl-sciPDF

Hasan Kurban, Rasul Khanbayov, Mustafa Kurban

TL;DR: 本文提出了MatPCR，一种无需人工标注的基准测试，用于评估多模态模型在材料科学推理中的物理一致性。通过程序化检查（如布拉格定律、能带隙分类等）验证模型推理链的物理合理性，并引入了约束基础自验证（CGSV）方法，以提升模型在材料数据上的物理一致性推理能力。

Details

Motivation: 当前视觉语言和语言模型在处理材料数据时存在幻觉无效属性和违反物理定律的问题，而现有评估方法仅关注最终答案匹配或依赖计算验证，缺乏对模型推理链物理一致性的系统测量。

Result: 在MatPCR基准测试中，模型在图像和结构输入上的物理一致性率得到量化评估；提出的CGSV方法在自优化后仍保持性能增益，且开源验证器在分布内有效，但在六种保留约束类型上接近随机水平。

Insight: 创新点在于利用材料数据自身的物理规律构建无标注基准，通过程序化检查实现自动化验证；客观分析认为，该方法将物理定律作为标签，为多模态模型的材料推理提供了可扩展的评估框架，并推动了自验证机制在科学领域的应用。

Abstract: Vision-language and language models increasingly interpret materials data, yet benchmarks report that they hallucinate invalid properties and violate physical law. Evaluation matches final answers to scarce human labels, while discovery agents verify final proposals or density functional theory (DFT) execution. Neither measures the physical consistency of a model’s reasoning chain. Materials data carries its own physics, making a large class of materials reasoning verifiable without annotation. We introduce MatPCR, a label-free benchmark whose programmatic oracles check diffraction geometry through Bragg’s law, scale bars, spectral peaks, and Materials Project-grounded checks of near-hull stability, computed band-gap class, and net magnetization. We define the Physical-Consistency Rate over image and structure inputs; introduce Constraint-Grounded Self-Verification, an agentic loop whose gain survives self-refinement and equal-compute re-prompting controls; release an open verifier useful in distribution but near chance on all six held-out constraint types; and derive an exact identity for how oracle error displaces the reported rate.

[23] QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization cs.CV | cs.AI | cs.LGPDF

Sankalp Pandey, Xuan-Bac Nguyen, Hoang-Quan Nguyen, Tim Faltermeier, Nicholas Borys

TL;DR: QuPAINT是一个用于量子材料表征的物理感知多模态推理框架，通过合成数据生成、构建指令数据集以及物理信息注意力机制，解决了二维量子材料薄片定位与层数识别中的领域偏移和条件变化问题。

Details

Motivation: 解决光学显微镜表征二维量子材料时，因合成数据与真实数据之间的领域偏移以及材料、基底、实验室和成像条件变化带来的挑战，实现可迁移的量子薄片表征。

Result: 在提出的最大真实世界基准QF-Bench上，QuPAINT-8B大幅超越先前方法，在通用和单层薄片检测上均达到SOTA性能，并在未见材料上展现出稳健的通用薄片检测能力。

Insight: 创新点包括合成数据框架Synthia、多模态指令数据集QMat-Instruct以及物理信息注意力（PIA）机制，通过注入光学先验和基于图像的监督，提升了空间定位和置信度校准的鲁棒性。

Abstract: Characterizing two-dimensional (2D) quantum materials by optical microscopy requires localizing exfoliated flakes and determining their layer thickness from subtle optical contrast and interference color to select suitable flakes for device fabrication. However, models face synthetic-to-real domain shifts and variation across materials, substrates, laboratories, and imaging conditions. We present QuPAINT, a physics-aware multimodal framework for transferable quantum flake characterization. The Synthetic Materials Framework (Synthia) generates diverse synthetic microscopy images while preserving layer-dependent optical behavior. Using these images, we construct QMat-Instruct, a multimodal instruction dataset with image-specific reasoning traces generated from verified annotations and constrained to observable optical cues. QuPAINT integrates these signals through Physics-Informed Attention (PIA), which injects substrate-relative optical priors into the visual representation to support grounded multimodal reasoning. For evaluation, we introduce QF-Bench, to our knowledge, the largest real-world benchmark for this problem, spanning diverse microscopy and substrate conditions. Using its verified annotations, we study counting, visual grounding, reasoning quality, confidence calibration, and transfer to an unseen material. QuPAINT-8B substantially outperforms prior methods and establishes state-of-the-art performance for both general and monolayer flake detection. Additional experiments show that image-grounded supervision improves strict spatial grounding and confidence calibration while preserving robust general flake detection on the unseen material.

[24] VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views cs.CVPDF

Yunsu Jeong, Hyuk Heo, Youngsang Kwak, Jaehwa Kwak, Il Yong Chun

TL;DR: 本文提出了一种名为VS-Splat的新型前馈高斯泼溅模型，用于从稀疏视图图像进行端到端的3D物体重建。该方法的核心创新在于引入了一种可学习的体素选择机制，能够仅在被选中的、可能属于物体的体素内预测高斯图元，从而避免在非物体区域浪费计算资源，提升对物体细节的表示能力。

Details

Motivation: 现有基于前馈高斯泼溅的方法通常在3D空间中均匀预测高斯图元，导致大量图元被放置在非物体区域，这可能阻碍对精细物体细节的表征。本文旨在解决这一问题，提出一种无需3D结构监督即可选择性放置图元的框架。

Result: 在三个基准数据集上的稀疏视图渲染实验表明，VS-Splat的性能优于多个最先进（SOTA）方法。此外，将其作为现有致密化方法的骨干网络，以及一个可选的扩展，都证明了其有效性，后者还提升了模型对不准确相机姿态估计的鲁棒性。

Insight: 主要创新点是提出了仅通过2D渲染监督即可识别以物体为中心的体素的可学习体素选择方法，实现了对高斯图元的非均匀、选择性预测。这为高效、精细的3D重建提供了一种新的思路，即通过注意力机制或区域选择来优化3D表示中计算资源的分配。

Abstract: Feed-forward Gaussian splatting models have demonstrated remarkable effectiveness in reconstructing three-dimensional (3D) objects from a few two-dimensional (2D) images, even if they are unseen. As existing methods typically predict Gaussian primitives uniformly across the 3D space, most primitives are placed in non-object regions. This may hinder the representation of fine object details. This paper proposes a Voxel-Selective Gaussian Splatting model (VS-Splat), a new end-to-endfeed-forward Gaussian splatting framework that predicts many primitives only within selected voxels that are likely to belong to an object, without 3D structural supervision. To achieve this, we propose a new learnable voxel selection approach that identifies object-centric voxels only with 2D rendering supervision. Our sparse-view rendering experiments with three benchmark datasets show that proposed VS-Splat outperforms several state-of-the-art methods. We further demonstrate its effectiveness as a backbone for an existing densification method and show that anoptional extension improves its robustness to inaccurate camera pose estimates.

Danning Zhang, Yijing Lin, Shuhan Zhuang, Mengqi Huang, Shaojin Wu

TL;DR: 本文提出了UFO框架，用于评估多模态图像生成中的全条件对齐问题。该框架通过原子化评估链（Chain-of-Evaluation）将全条件对齐分解为细粒度的原子评估单元（AEUs），并针对不同模态相关性类别进行验证，从而更准确地反映人类判断。实验表明，UFO在相关性上优于现有方法，并引入了专用基准UFO-Bench。

Details

Motivation: 当前多模态图像生成模型的评估方法（如基于嵌入或MLLM的方法）通常孤立地评估每个模态条件的对齐，这与多模态生成中同时对齐多个条件的目标相矛盾，导致与人类判断的一致性较差。

Result: UFO在实验中实现了与人类评估偏好的最高相关性，平均提升了15.25%。此外，作者提出了UFO-Bench基准，用于全面评估现有定制化模型在文本和视觉条件多样交互下的性能。

Insight: 创新点在于提出了首个统一的全条件对齐同时评估框架，通过原子化评估链将复杂对齐任务分解为可管理的单元，并针对不同模态设计专用验证方法。这为多模态生成评估提供了更细粒度和一致的解决方案。

Abstract: Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement of generative models, their evaluation remains largely lagging. Existing methods, whether embedding-based or Multi-modal Large Language Model (MLLM)-based, evaluate alignment with each modal condition in isolation, which contradicts the simultaneous condition alignment objective of multi-modal image generation, leading to poor consistency with human judgments. To address this challenge, we propose UFO, the first unified framework for omni-condition alignment simultaneous evaluation. Specifically, UFO introduces a novel Atomized Chain-of-Evaluation paradigm, \emph{i.e.}, it first decomposes omni-condition alignment into a sequential chain of fine-grained, disentangled Atomic Evaluation Units (AEUs), categorizes them into distinct modality-relevance classes, and then employs general or dedicated functional calls for accurate verification of different AEU types. Experimental results demonstrate that UFO achieves the highest correlation with human evaluation preferences, delivering an average improvement of 15.25%. Furthermore, we present UFO-Bench, a dedicated benchmark designed to holistically evaluate the performance of existing customization models under the diverse mutual interactions of textual and visual conditions.

[26] EgoMaize: A First-Person Maize Instance Segmentation Benchmark under Severe Field Occlusion cs.CVPDF

Jiayi Li, Zihan Zhang, Erhankang Yan, Yitian Chen, Yuze Li

TL;DR: 该论文提出了EgoMaize，一个用于第一人称视角玉米实例分割的紧凑型基准数据集，旨在解决在严重田间遮挡条件下，从近距离田间图像中预测植物所有权一致的掩码以及植物所属的茎/雄穗线索的难题。

Details

Motivation: 动机在于近距离第一人称田间图像对于移动玉米表型分析至关重要，因为许多植物水平性状依赖于冠层内结构，而这些结构难以从俯视角度观察。然而，玉米田在出苗后形成了困难的实例分割场景：茎、叶、雄穗和邻近植物细长、重复且严重遮挡。

Result: 基线结果表明，预训练的基于查询的分组、边界细化和高分辨率裁剪细化有助于任务的不同方面，但没有一种架构能完全解决精细结构恢复、同类实例所有权和遮挡推理的耦合挑战；遮挡级别分析进一步显示，随着植物可见度降低，性能下降。

Insight: 创新点在于引入了证据封闭的标注工作流来处理遮挡的玉米区域，并将不可靠的玉米区域分配为忽略而非背景，从而避免了现有仅可见标签可能导致一个物理植物被分割成不连续监督，或全非模态标签可能需要不可验证的补全的问题。数据集和代码已公开。

Abstract: Close-range first-person field images are important for mobile maize phenotyping because many plant-level traits depend on in-canopy structures that are difficult to ob serve from overhead views. However, post-seedling maize fields create a difficult in stance segmentation setting: stems, leaves, tassels, and neighboring plants are elon gated, repetitive, and strongly occluded. We introduce EgoMaize, a compact benchmark for first-person maize instance segmentation, where the task is to predict ownership consistent plant masks and plant-owned stem/tassel cues from close-range field images with severe same-class overlap. Existing visible-only labels can fragment one physi cal plant into disconnected supervision, while full-amodal labels may require unverifi able completion behind neighboring plants or field objects. EgoMaize therefore uses an evidence-closed annotation workflow for occluded maize regions and assigns unreli able maize regions to ignore rather than background. Baseline results show that pre trained query-based grouping, boundary refinement, and high-resolution crop refine ment help different aspects of the task, but no architecture solves the coupled chal lenges of fine structure recovery, same-class instance ownership, and occlusion reason ing; occlusion-level analysis further shows that performance decreases as plant visi bility becomes more limited. The dataset and code are publicly available at https: //github.com/JaaaaaaaD/EgoMaize.

[27] Context-Aware Causal Gaze Forecasting for Human-Vehicle Interaction During In-Cabin Tracking Dropouts cs.CV | cs.HCPDF

Shabnam Shabani, Ghazal Farhani

TL;DR: 本文提出了一种用于车内驾驶员视线跟踪丢失期间的因果性视线预测方法。当驾驶员头部大幅转动导致仪表盘视线跟踪器丢失视线时，系统能够基于丢失前的历史数据（视线和头部姿态）以及场景特征，在线预测丢失期间的视线方向。该方法引入了因果上下文门控预测器（CCGF），并通过学习可靠性门控来动态融合历史和场景信息。

Details

Motivation: 动机在于解决车载视线跟踪器在驾驶员进行肩部检查、后视镜观察等大幅头部转动时丢失视线跟踪的问题。这些关键时刻的视线信息对驾驶员监控系统至关重要，而在线系统无法依赖未来的观测数据进行填补，因此需要一种因果性的视线恢复方法。

Result: 在从10名驾驶员10.5小时自然驾驶数据中提取的2047个自然发生的视线丢失事件上进行了评估。在留一驾驶员交叉验证下，CCGF在使用实时场景更新（Live）时，取得了平均每位驾驶员中位误差175.7像素（10.5度）的结果，相比仅使用历史信息的因果预测降低了33%的误差。使用冻结场景（Frozen）输入时，误差增加到210.8像素（12.9度）。

Insight: 创新点在于将视线预测问题明确为因果性任务，并提出了CCGF模型，其核心是学习一个可靠性门控来动态加权历史信息和场景特征。一个关键发现是，在视线丢失期间持续更新的场景信息（Live）比仅使用丢失前最后一帧的场景信息（Frozen）能提供更有用的预测信息，这强调了动态场景上下文的重要性。

Abstract: Dashboard-mounted gaze trackers often lose sight of the driver’s eyes during large head rotations, including shoulder checks, mirror glances, and intersection scanning. These maneuvers occur when information about the driver’s visual attention is most useful. Offline gap-filling methods may reconstruct a missing interval using observations from both sides, but an online driver-monitoring system cannot rely on measurements that have not yet occurred. We therefore formulate causal gaze recovery: forecasting unavailable gaze at time t without target-tracker gaze at t or later. We introduce the Causal Context-Gated Forecaster (CCGF), which encodes a 60-frame pre-dropout history of gaze and head pose and combines it with DINOv3 scene features. A learned reliability gate controls the contribution of the history and scene representations as the dropout progresses. We evaluate two scene conditions: Live, in which the scene representation continues to update during tracker loss, and Frozen, in which the final pre-dropout representation is used throughout the missing interval. We evaluate CCGF on 2,047 eligible, naturally occurring GazeSense head_lost events drawn from 10.5 h of naturalistic driving by ten drivers. Across all recordings, head_lost accounts for 8.5 percent of GazeSense recording time. Synchronized gaze coordinates from a head-mounted Neon tracker provide supervision and evaluation targets but are never used as model inputs. Under leave-one-driver-out evaluation, CCGF achieves a mean per-driver median error of 175.7 px (10.5 deg) with Live scene updates, a 33 percent reduction relative to history-only causal forecasting. With Frozen scene input, the error increases to 210.8 px (12.9 deg), indicating that scene observations acquired during the dropout provide useful predictive information. We will release the dataset, evaluation protocol, and causal baselines.

[28] DERA: Detached Edge-Residual Adaptation for Prohibited item Detection cs.CVPDF

Yonathan Michael, Mohamad Alansari, Mohammed Bennamoun, Dwarikanath Mahapatra, Andreas Henschel

TL;DR: 本文提出了一种名为DERA的分离边缘残差自适应框架，用于解决X射线图像中违禁品检测的挑战。该框架通过结合分层视觉特征与并行的像素差边缘金字塔，从实例掩码的训练时轮廓中学习物体特定的边界先验，并通过残差头将边缘敏感特征注入早期视觉阶段。

Details

Motivation: X射线图像中的违禁品检测面临物体叠加、纹理弱和材料杂乱等挑战，这些因素模糊了语义外观和物体边界，因此需要一种方法来增强边界感知能力。

Result: 在PIDray、CLCXray和STCray基准测试中，DERA分别将基线性能提升了3.1、1.6和2.4 AP点，显示出显著的改进。

Insight: 创新点包括分离的边界先验门控边缘特征、残差头注入机制以及分阶段设计，这些方法在保持基础检测器不变的同时，仅使用14.7K可训练参数实现了高效的边界适应。

Abstract: Prohibited-item detection in X-ray imagery remains challenging due to object superposition, weak texture, and material clutter which obscure both semantic appearance and object boundaries. We propose \textbf{DERA}, a \textbf{D}etached \textbf{E}dge-\textbf{R}esidual \textbf{A}daptation framework for prohibited item detection under X-ray imagery. DERA combines hierarchical visual features with a parallel pixel-difference edge pyramid and learns an object-specific boundary prior from training-time contours of the instance masks. The detached prior gates edge-sensitive features, which are injected into the early visual stages through residual heads. This staged design preserves the foundation detector at the start of adaptation, isolates boundary supervision from semantic feature learning, and restricts the final adaptation stage to only (14.7)K trainable parameters. Evaluated on PIDray, CLCXray, and STCray, DERA improves the baseline by \textbf{3.1}, \textbf{1.6}, and \textbf{2.4} AP points, respectively.

[29] GSO-Net: Visual State Machines for Hazardous Freight Transfer Compliance at Petrochemical Logistics Nodes cs.CVPDF

Yu Xie, Bangshu Xiong, Zhibo Rao, Rui Gan, Chongxuan Liu

TL;DR: GSO-Net是一个针对石化物流节点危险货物转运合规性监控的大规模视觉基准数据集，专注于标准操作程序（SOP）的视觉理解。它包含来自64个真实高速公路物流节点的超过50,000帧图像，并定义了两个任务：微观状态与宏观步骤的联合检测，以及帧级步骤分类。实验表明，现有模型在接触级状态定位、瞬态步骤识别和阶段一致性方面存在不足。

Details

Motivation: 解决在现实部署约束下，特别是在大型基础设施网络中摄像头采用稀疏轮询调度时，如何从非完整观测和局部证据中推断危险货物转运的程序合规性问题。现有视觉基准很少涉及此类场景。

Result: 在GSO-Net基准上测试了轻量级、基于Transformer、开放词汇和整体模型。实验揭示了物体感知与转运阶段理解之间存在明显差距，当前模型在接触级状态定位、瞬态步骤识别和阶段一致性方面表现较弱，尤其是在稀疏轮询、微小关键目标和长尾操作证据下。

Insight: 创新点在于首次提出了一个专门用于石化危险货物转运场景下视觉SOP理解的公开基准数据集，并采用了将9个宏观程序步骤与15个微观操作状态关联的SOP衍生层次结构。这为细粒度状态感知和基于视觉的安全监控提供了一个实用的评估平台。

Abstract: Hazardous-freight operations at petrochemical logistics nodes are safety-critical for intelligent transportation systems, yet existing vision benchmarks rarely address procedural compliance under realistic deployment constraints. In large infrastructure networks, cameras often operate under sparse round-robin polling, so transfer status must be inferred from incomplete observations and localized evidence. We present GSO-Net, a large-scale benchmark for visual understanding of standard operating procedures (SOPs) in petrochemical unloading scenarios. To our knowledge, GSO-Net is the first public benchmark dataset dedicated to visual SOP understanding in petrochemical hazardous-freight transfer scenarios. It contains over 50,000 independently sampled frames from 64 real expressway petrochemical logistics nodes and adopts an SOP-derived hierarchy linking 9 macroscopic procedural steps with 15 microscopic operational states. Two tasks are defined: joint detection of microscopic states and macroscopic steps as the core benchmark, and frame-level step classification as a diagnostic reference. Experiments with lightweight, transformer-based, open-vocabulary, and holistic models reveal a clear gap between object perception and transfer-stage understanding. Current models remain weak on contact-level state grounding, transient step recognition, and stage consistency, especially under sparse polling, tiny critical targets, and long-tailed operational evidence. GSO-Net provides a practical benchmark for fine-grained state perception and vision-based safety monitoring in hazardous freight transportation. The dataset is publicly available at https://github.com/yuxieHarrison/GSO-Net

[30] A Multimodal Explainable Deep Learning Framework for Alzheimer’s Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data cs.CV | stat.MLPDF

Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula, Antoine Vacavant

TL;DR: 本文提出了一种用于阿尔茨海默病诊断的可解释多模态深度学习框架，该框架结合了3D T1加权MRI和临床数据。研究在ADNI和OASIS-3数据集上评估了不同模型设置（单模态与多模态融合），发现模型性能与可解释性结果高度依赖于具体诊断任务、模态、融合策略以及患者队列。

Details

Motivation: 阿尔茨海默病的及时准确诊断依赖于整合互补的临床和影像信息，但现有多模态深度学习的解释性如何在不同模态、融合策略和队列中表现尚不明确。

Result: 在ADNI内部数据集上，仅使用表格（临床）数据的模型在三分类任务中取得了最高的AUC-ROC（0.879），并在区分认知正常（CN）与轻度认知障碍（MCI）时表现最佳（0.903）。在独立测试集OASIS-3上，仅使用视觉（MRI）的模型表现最佳（三分类AUC-ROC 0.910）。没有一种融合策略能在所有任务和队列中持续优于单模态模型。

Insight: 研究发现多模态模型的性能和可解释性并非固有稳定属性，而是高度依赖于任务、队列和模型配置。SHAP和积分梯度一致识别MMSE为关键临床特征，但基于CAM的视觉解释会随配置和队列变化，这强调了在队列偏移下评估模型可解释性的必要性，而非将其视为稳定属性。

Abstract: Dementia is a major and growing global health burden, with Alzheimer’s disease (AD) accounting for most cases. Timely and accurate diagnosis is central to managing this burden and increasingly depends on integrating complementary clinical and imaging information. Multimodal deep learning can combine these modalities for AD diagnosis, but how its explanations behave across modalities, fusion strategies, and cohorts remains unclear. We developed an explainable multimodal framework pairing a 3D CNN encoder for T1-weighted MRI with a feedforward network for harmonized clinical and demographic data, comparing varied model setups on three-way and pairwise diagnostic tasks using 6,479 internal records from the ADNI and 1,703 independent records from the OASIS-3. On ADNI, the tabular-only model achieved the highest three-class AUC-ROC of 0.879 and best discriminated cognitively normal (CN) versus mild cognitive impairment (MCI; 0.903), while cross-attention performed best for MCI versus AD (0.861); CN versus AD was highly discriminative overall. On OASIS-3, the vision-only model performed best (three-class AUC-ROC 0.910); CN versus MCI remained difficult, and no fusion strategy consistently outperformed single modalities across tasks and cohorts. SHAP and Integrated Gradients identified the MMSE as the dominant tabular feature in both cohorts, with global feature rankings agreeing strongly in ADNI ($ρ=0.94$) and OASIS-3 ($ρ=0.96$); CAM-based explanations, however, changed with model configuration and cohort. These findings show that multimodal performance and explanations are task, modality, fusion, and cohort-dependent: a dominant cognitive signal persisted across cohorts, but feature contributions and CAM explanations did not, underscoring the need to evaluate explainability under cohort shift rather than as a stable, intrinsic property.

[31] Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images cs.CV | cs.AI | cs.LGPDF

Juzheng Miao, Yuchen Yuan, Cheng Chen, Pheng-Ann Heng

TL;DR: 本文提出了一种空间感知的少样本医学异常检测框架Spatial-FAD，通过结合视觉基础模型（如DINO）的空间先验与CLIP的语义对齐能力，以提升病灶定位精度。该方法引入了VFM增强适配器来注入结构亲和力先验，采用滑动窗口聚合策略生成高分辨率密集嵌入，并设计了原型增强支持记忆模块来高效利用少样本支持集。在肝脏CT、视网膜OCT和脑部MRI三个基准数据集上的实验表明，该方法在病灶分割等任务上显著优于现有最先进方法。

Details

Motivation: 现有基于CLIP的少样本医学异常检测方法虽能利用图像-文本语义对齐，但其全局对比预训练缺乏显式的空间监督，导致病灶定位不精确；而视觉基础模型（如DINO）通过自蒸馏和局部到全局一致性学习具有空间一致性的补丁表示，能更好地捕捉细粒度解剖结构。本文旨在结合两者的互补优势，以解决医学图像中少样本异常检测的精准定位问题。

Result: 在肝脏CT、视网膜OCT和脑部MRI三个基准数据集上的大量实验表明，Spatial-FAD在病灶分割等任务上显著优于最先进（SOTA）方法。具体而言，在4-shot场景下，该方法在Dice分数上平均提升超过11.4%，在AUC上平均提升1.8%。

Insight: 创新点在于将视觉基础模型（VFM）的空间先验与CLIP的语义对齐能力相结合，通过VFM增强适配器注入结构亲和力先验来引导视觉嵌入更好地贴合病灶边界；同时，采用滑动窗口聚合策略缓解补丁化和CLIP输入分辨率限制带来的空间细节丢失问题，生成高分辨率密集嵌入以提升定位粒度；此外，原型增强支持记忆模块通过存储正常与异常模式的紧凑原型，融合补丁-原型和图像-文本相似性，在降低内存成本的同时提升性能。从客观角度看，这种跨模型先验融合与高效少样本利用策略为医学图像分析提供了可借鉴的思路。

Abstract: Vision-Language Models such as CLIP enable effective few-shot medical anomaly detection (AD) via strong image-text semantic alignment. However, their globally contrastive pretraining lacks explicit spatial supervision, limiting precise lesion localization. In contrast, Vision Foundation Models (VFMs) such as DINO learn spatially coherent patch representations via self-distillation and local-to-global consistency, better capturing fine-grained anatomical structures. Leveraging this complementarity, we propose Spatial-FAD, a spatial-aware few-shot medical AD framework that improves lesion localization by combining VFM spatial priors with CLIP semantics. Specifically, we introduce a VFM-enhanced adapter that injects a structural affinity prior derived from DINO into CLIP features. This structure-guided refinement encourages visual embeddings to better adhere to lesion boundaries while maintaining semantic alignment. To address the loss of spatial detail from patchification and the limited input resolution of CLIP, we adopt a sliding-window aggregation strategy. This generates high-resolution, spatially dense embeddings to further enhance localization granularity. Moreover, we introduce a prototype-enhanced support memory scheme to efficiently exploit the few-shot support set. This module stores compact prototypes for normal and abnormal patterns, reducing memory costs while boosting performance by fusing patch-to-prototype and image-text similarities. Extensive experiments on three benchmark datasets, including Liver CT, Retinal OCT, and Brain MRI, demonstrate that Spatial-FAD significantly outperforms state-of-the-art methods, especially in lesion segmentation. Notably, in the 4-shot scenario, our method achieves an average improvement of over 11.4% in Dice score and 1.8% in AUC. Code is available at: https://github.com/JuzhengMiao/Spatial-FAD.

[32] PhysioAI: Clinical Knowledge-Guided Semantic Supervision for Skeleton-Based Physiotherapy Action Recognition cs.CVPDF

Jie Cao, Euijoon Ahn, Anwar Hassan, Jinman Kim

TL;DR: 本文提出了PhysioAI框架，通过将结构化的临床知识作为语义监督注入到骨架表示学习中，以解决康复场景下基于骨架的动作识别问题。该方法利用临床知识词典（CKD）生成语义锚点，在训练时引导模型学习，推理时仅需骨架输入，在多个康复数据集上取得了优于现有方法的结果。

Details

Motivation: 针对康复场景中公开数据集小、动作类间差异细微、且患者执行动作存在幅度、速度和协调性偏差导致类内变异大的问题，现有基于骨架的动作识别方法难以可靠识别，因此需要引入领域知识来提升模型性能。

Result: 在KiMoRe Overall数据集上达到99.03±1.34%，在Hard-67压力测试上达到94.64±7.36%，在UI-PRMD Overall数据集上达到87.44±7.69%，均超过基线方法，分别提升0.27、2.87和1.33个百分点，实现了SOTA性能。

Insight: 创新点在于将结构化的临床知识通过CLIP编码为语义锚点，作为训练时的监督信号，从而将领域知识注入到骨架表示学习中，而无需在推理时使用额外模态，有效提升了模型在细粒度康复动作识别上的泛化能力和鲁棒性。

Abstract: Skeleton-based action recognition can support automated tracking of physiotherapy exercises, particularly in remote rehabilitation settings where continuous in-person supervision is impractical. However, most existing methods are developed for large-scale daily-action benchmarks rather than rehabilitation scenarios. Public rehabilitation exercise datasets are typically small, with only subtle kinematic differences between exercise classes. For participants with motor impairments, exercise execution may also deviate from standard movement patterns in amplitude, speed, and coordination, increasing intra-class variability and making reliable recognition more difficult for skeleton-based models. We propose PhysioAI, a clinical knowledge-guided semantic supervision framework that injects structured physiotherapy knowledge into skeleton representation learning. PhysioAI combines graph-based spatiotemporal modelling of human movement with training-time semantic anchors derived from a structured Clinical Knowledge Dictionary (CKD). The CKD descriptions are encoded using a frozen Contrastive Language-Image Pre-training (CLIP) model and projected into an anchor space, where they provide class-specific semantic targets for skeleton representation learning. The resulting CKD-derived anchors are used only during skeleton-model training; inference requires only skeleton inputs. Under subject-disjoint evaluation, PhysioAI achieves $99.03\pm1.34%$ on KiMoRe Overall, $94.64\pm7.36%$ on the Hard-67 stress test, and $87.44\pm7.69%$ on UI-PRMD Overall. These results exceed the strongest comparator for each endpoint by $0.27$, $2.87$, and $1.33$ percentage points (pp), respectively. These findings demonstrate that structured clinical knowledge can serve as an effective source of training-time supervision for physiotherapy action recognition.

[33] RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images cs.CVPDF

Jiabao Wang, Wenjian Liu, Yaoming Cai, Gengyu Zhang, Boyan Zhao

TL;DR: 本文提出了一种名为RoES的旋转等变选择性频率融合网络，用于红外-可见光图像融合。该方法通过可训练的旋转增强更新器/预测器模块动态解耦低频和高频成分，并采用双分支融合模块处理这些表示，其中低频域使用旋转等变Mamba捕获长程结构依赖，高频细节则通过基于极坐标谱注意力的双傅里叶块在低频引导下进行细化。

Details

Motivation: 现有方法通常对所有特征统一施加旋转等变约束，但忽略了低频共享结构严格遵循等变约束，而高频模态特定细节需要更大灵活性以保留独特信息，因此需要一种能区分处理不同频率成分的融合方法。

Result: 大量实验表明，RoES在融合质量和下游目标检测任务中均实现了最先进的性能。

Insight: 创新点在于提出了频率选择性的旋转等变融合框架，通过动态解耦高低频成分并分别采用旋转等变Mamba和极坐标谱注意力进行针对性处理，从而在保持结构一致性的同时更好地保留模态特定细节。

Abstract: Infrared-visible image fusion facilitates robust multimodal perception by integrating complementary textural nuances from visible sensors with thermal signatures from infrared systems. Due to the task’s inherently ill-posed nature, existing methods heavily rely on structural priors but typically enforce rotation equivariance uniformly across all features. Such a holistic approach overlooks a critical distinction where low-frequency shared structures strictly adhere to equivariant constraints while high-frequency modality-specific details require greater flexibility to preserve unique information. To bridge this gap, we propose RoES, a Rotational Equivariant Selective-frequency fusion network. Instead of employing static decomposition, we introduce a trainable rotation-enhanced updater/predictor module to dynamically decouple low- and high-frequency components. The resulting representations are then processed through a dual-branch fusion module tailored for spectral consistency. Specifically, a rotation-equivariant Mamba is employed to capture long-range structural dependencies in the low-frequency domain, while a polar spectral attention-based Dual-Fourier block refines high-frequency details under explicit low-frequency guidance. Extensive experiments demonstrate that RoES consistently achieves state-of-the-art performance in both fusion quality and downstream object detection, establishing a robust solution for multimodal fusion by reconciling frequency-selective features with equivariant constraints. The source code is available at https://github.com/BryceLosky/RoES-Fusion.

[34] One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering cs.CVPDF

Jian Hu, Zixu Cheng, Da Li, Wei Li, Ziquan Liu

TL;DR: 本文提出了一种名为AutoSkill的源监督框架，用于长视频问答任务。该框架能够自动发现并路由不同的帧选择技能，根据问题类型自适应地选择关键视频帧，从而在有限的帧预算下提升长视频问答的性能。

Details

Motivation: 现有的大多数无需训练的方法对所有问题类型都采用相同的帧选择策略，但不同问题类型所需的证据差异很大。分析表明，帧选择策略的相对有效性因语义类别和基准测试而异，因此需要自适应的证据获取方法。

Result: 在五个长视频基准测试集上，AutoSkill将Qwen2.5-VL-7B和Qwen3.5-4B模型的性能分别提升了2.4%和1.2%，证明了该方法的有效性。

Insight: 主要创新点在于提出了一个自动发现和路由帧选择技能的框架，利用LLM智能体迭代地生成、评估和优化候选技能，并通过诱导共享语义分类法和重写源示例来适应目标基准，整个过程无需使用目标视频或答案。这为自适应证据获取提供了一种可扩展的解决方案。

Abstract: Long-Video Question Answering (LVQA) requires locating decisive evidence in hour-scale videos under a limited frame budget. Most training-free methods apply the same frame-selection strategy to all questions, despite substantial variation in the evidence required by different question types. Our analysis shows that the relative effectiveness of frame-selection strategies varies across semantic categories and benchmarks, motivating adaptive evidence acquisition. In this paper, we introduce AutoSkill, a source-supervised framework for automatically discovering and routing executable frame-selection skills. Starting from a small labelled source pool, LLM agents iteratively propose, implement, evaluate, and refine candidate skills. For a target benchmark, AutoSkill uses only unlabelled question and option text to induce a shared semantic taxonomy, rewrite labelled source examples into the target style, and estimate a category-to-skill mapping. Neither target videos nor target answers are used in this process. At inference time, each question is assigned one skill, which selects the frames used in a single inference of the frozen video MLLM. Across five long-video benchmark splits, AutoSkill improves Qwen2.5-VL-7B and Qwen3.5-4B by 2.4% and 1.2%, respectively, demonstrating the effectiveness of our AutoSkill.

[35] LettuceVisSim: A Simulator That Generates Lettuce Image Time-series for Vision-Based Reinforcement Learning cs.CV | cs.AI | eess.SY | math.OCPDF

Ziye Zhu, Bert van ‘t Ooster, Congcong Sun, Eldert van Henten, Sjoerd Boersma

TL;DR: 本文提出了LettuceVisSim，一个用于生成生菜图像时间序列的模拟器，旨在解决基于视觉的强化学习在受控环境农业中因缺乏标记作物图像而受限的问题。该模拟器整合了基于过程的模型、冠层布局算法和Unity渲染引擎，能够高效生成RGB和分割图像，并演示了仅通过模拟图像学习光照控制策略的可行性。

Details

Motivation: 基于视觉的强化学习在受控环境农业中具有应用潜力，但缺乏标记的作物图像数据阻碍了其发展，因此需要开发一个能够生成标记图像时间序列的模拟器来填补这一空白。

Result: 模拟器验证显示：基于过程的模型在动态植株密度管理下模拟地上部干重R²=0.84；分段三次回归将干重映射到潜在投影面积R²=0.94；冠层布局表示在12个实验数据集上验证，使用实测干重时R²=0.84，使用模拟干重时R²=0.40（排除异常值后0.76）；Unity渲染引擎生成图像时间低于10毫秒；演示实验成功通过模拟图像学习光照控制策略。

Insight: 创新点在于将基于过程的生长模型、冠层布局算法与实时渲染引擎结合，构建了一个端到端的作物图像生成模拟器，为基于视觉的强化学习提供了可扩展的数据合成解决方案，并验证了其在农业决策中的概念可行性。

Abstract: Vision-based reinforcement learning holds strong potential for decision-making in controlled environment agriculture (CEA). However, its development is hindered by the scarcity of labelled crop images. To address this gap, LettuceVisSim, a lettuce growth simulator that generates labelled time series of crop images, was developed and validated. The simulator contains a process-based model (PBM) for shoot dry weight dynamics, a canopy layout algorithm for deriving canopy layout representations from shoot dry weight, and a Unity rendering engine for image generation. Five findings support the simulator. First, the PBM reproduced shoot dry weight under dynamic plant-density management with $\mathrm{R}^{2}=0.84$. Second, a piecewise cubic regression mapped shoot dry weight to potential projected area with $\mathrm{R}^{2}=0.94$. Third, the canopy layout representation was validated using 12 experimental datasets each having different dynamic environmental and spacing conditions. It reproduced the ground coverage ratio dynamics observed in measured images, achieving $\mathrm{R}^{2}=0.84$ when driven by measured shoot dry weight and $\mathrm{R}^{2}=0.40$ (0.76 excluding one outlier) when driven by PBM-simulated values. Fourth, the Unity rendering engine converted canopy layout representations into RGB and segmentation images at less than 10~ms. Fifth, a demonstration showed that a lighting-control policy can be learned and applied by observing only crop images that were generated with LettuceVisSim, providing a proof of concept of vision-based reinforcement learning in CEA using LettuceVisSim.

[36] ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning cs.CVPDF

Khan Raiyan Ibne Reza, Sanjana Aktar Maria, Sumaiya Tabassum Nimi, Md Adnan Arefeen

TL;DR: 本文介绍了ChitraMiti-12.8k和NCTB-500两个孟加拉语平面几何推理基准数据集，并提出了一种三阶段评估协议，用于评测视觉语言模型在低资源语言下的多模态数学推理能力，特别是模型对视觉和文本模态的依赖程度。研究发现，结构化文本描述足以替代图表进行受控评估，但模型在跨模态验证方面表现不佳。

Details

Motivation: 目前对视觉语言模型在多模态数学推理，特别是需要结合图表和问题的几何推理方面的评估，在低资源语言（如孟加拉语）中仍然有限。本文旨在填补这一空白，并研究模型是否真正会核对文本与视觉信息。

Result: 在五个开源和闭源VLM上的评估表明，仅使用描述的性能与图表加描述的性能在统计上无显著差异。监督微调在ChitraMiti-1k和NCTB-500上提升了性能，但与最强的零样本模型相比仍有较大差距。模型在跨模态验证（如空间关系被替换时）上表现很差。

Insight: 创新点在于为低资源语言孟加拉语构建了大规模合成和手动标注的几何推理基准，并设计了分离模态输入的三阶段评估协议，以量化模型对模态的依赖和跨模态验证能力。这为标准化研究多模态推理和模型是否真正“看”图提供了方法。

Abstract: Evaluation of vision-language models (VLMs) for multimodal mathematical reasoning remains limited for low-resource languages and for geometry problems that require reading a diagram and a question together. We introduce ChitraMiti-12.8k, a synthetic benchmark of 12,874 Bengali planar geometry problems paired with structured 15-attribute descriptions, and NCTB-500, a complementary set of 500 diagrams manually extracted from Bengali school textbooks. Using a three-phase protocol that separates diagram-only, diagram-plus-description, and description-only inputs, we show across five open-weight and closed-source VLMs that description-only performance is statistically indistinguishable from diagram-plus-description performance, establishing structured descriptions as a sufficient textual proxy for controlled evaluation. Despite this, models remain poor at cross-modal verification, frequently misled by a swapped spatial relation even when they answer the unmodified item correctly. We further evaluate supervised adaptation on ChitraMiti-12.8k, finding that fine-tuning improves performance on both ChitraMiti-1k and NCTB-500, although a substantial gap to the strongest zero-shot model remains. Together, ChitraMiti-12.8k, NCTB-500, and our evaluation protocol offer a standardized way to study Bengali multimodal geometry reasoning and, more broadly, whether VLMs actually check their text against what they see. Our dataset and code are publicly available on Hugging Face at https://huggingface.co/datasets/RaiyanKhaan/ChitraMiti.

[37] RelateAnything: Real-Time Open-Vocabulary Relation Prediction From Any Inputs cs.CVPDF

Maëlic Neau

TL;DR: 本文提出了RelateAnything，一个实时开放词汇关系预测模型，能够从任意输入（图像和区域）中预测关系，其关系谓词词汇表在推理时以字符串形式提供，无需依赖对象标签。

Details

Motivation: 现有场景图模型受限于固定的谓词词汇（如50或56个谓词）和对象标签条件化架构，无法实现开放词汇关系预测，且缺乏自由文本验证的关系语料库和合适的评估指标。

Result: 在三个跨数据集基准和一个零样本基准上，RelateAnything的平均召回率比可比规模的最强开放词汇方法高2.3-3.5倍，参数仅53M，推理速度达20毫秒/帧，且在真实检测器下仍保持优势。

Insight: 创新点包括：采用无对象标签输入的架构，使区域来源可灵活更换；使用文本嵌入库而非学习分类器实现开放词汇；通过正未标记监督和反义词分离的文本编码器训练大规模谓词；构建了RA-4M语料库和OV-SGG-Bench基准以解决监督和评估问题。

Abstract: Open-vocabulary detection accepts any class list at inference, and promptable segmentation returns regions without class names: the taxonomy has left the model and become an input. Relation prediction has not. Scene-graph models are still trained and evaluated on the 50 or 56 predicates of one annotation style, their relation head conditioned on object labels and so tied to one detector. Three obstacles explain this, none primarily modelling: no relation corpus is both free-text and verified, a label-conditioned architecture cannot accept a vocabulary it was not trained on, and the standard metric rewards agreement with the training corpus, so a larger vocabulary scores as a regression. We present RelateAnything, a 53M-parameter model taking an image and regions from any source and returning scored relations over a predicate vocabulary supplied at inference as strings. Object labels are never an input, so the region source can change without retraining, and the vocabulary is a bank of text embeddings, not a learned classifier. It runs at 20 ms/frame. Training over 19,103 predicates requires positive-unlabeled supervision and a text encoder that separates antonyms, which contrastive encoders embed at cosine 0.95. To supply the supervision we build RA-4M, 474k images and 4.3M relations over 10,102 free-text predicates, generated against numbered box markers and geometrically verified. To measure it we build OV-SGG-Bench, six axes scored across datasets that the priors standard recall rewards cannot satisfy. On three cross-dataset benchmarks and a fourth zero-shot, RelateAnything has 2.3-3.5x the mean recall of the strongest open-vocabulary method of comparable scale, margins that survive a real detector, and leads a 3B-VLM scene-graph model on both metrics at under 2% of its parameters. In-domain measurement overstates transfer gains ~5x. Model, corpus and benchmark are public.

[38] DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers cs.CV | cs.ROPDF

Lanke Frank Tarimo Fu, Maurice Fallon

TL;DR: DRS-VPT是一种用于基础性图像到扫描配准的前馈Transformer架构。给定查询图像和参考3D点云，该模型预测扫描姿态和点图，以及每个摄像头的姿态和点图，所有姿态均以第一个摄像头的坐标系表示。它还预测一个由粗到精的金字塔状逐点和逐像素特征，用于将扫描直接重投影对齐到第一张图像。该框架统一了自动驾驶中的摄像头-LiDAR标定和室内相机到地图重定位等下游任务。

Details

Motivation: 解决图像与3D点云（如LiDAR扫描）之间的直接、统一的配准问题，旨在为自动驾驶和室内重定位等应用提供基础性的配准能力。

Result: 单个DRS-VPT模型在自动驾驶图像到LiDAR配准任务上达到了最先进的性能（SOTA），在室内重定位任务上取得了有竞争力的结果且无需训练特定地图权重，并在未见过的环境中表现出强大的零样本迁移能力。

Insight: 创新点在于提出了一种统一的Transformer架构，直接预测姿态和点图，并生成用于重投影对齐的多尺度特征；模型能够学习复杂的扫描到图像投影属性（如背面点的遮挡），展现了强大的泛化能力。

Abstract: We present DRS-VPT, a feed-forward transformer architecture for foundational image-to-scan registration. Given query images and a reference 3D point cloud, the model predicts the scan pose and point map alongside the poses and point maps of each camera, all expressed in the first camera’s frame. It additionally predicts a coarse-to- fine pyramid of per-point and per-pixel features for direct reprojective alignment of the scan to the first image. This formulation unifies downstream tasks such as camera-LiDAR calibration in autonomous driving and indoor camera-to-map relocalization. A single DRS-VPT model achieves state-of-the-art performance for image-to-LiDAR registration in autonomous driving, competitive indoor relocalization without training map-specific weights, and strong zero-shot transfer to unseen environments. We also show qualitatively that the model learns complex scan-to-image projection properties such as occlusion of back-facing points.

[39] SCORE: SubDistribution-aware Collaborative Knowledge Reinforcing for Cloth-Hybrid Lifelong Person Re-Identification cs.CVPDF

Kunlun Xu, Liangyu Ma, Jiangmeng Li, Xin Tong, Xiaode Liu

TL;DR: 本文提出了一种名为SCORE的框架，用于解决衣物混合终身行人重识别（CH-LReID）任务中的灾难性遗忘问题。该框架通过自适应子分布建模机制为每个身份分配一组分布子原型，以捕获身份内多样性，并通过分布知识强化方案在新旧子原型间进行协同对齐来保留旧知识。

Details

Motivation: 现有终身行人重识别方法主要关注衣物一致的场景，而衣物混合场景（衣物一致和衣物变化数据交替出现）更具实际挑战性，由于衣物相关与无关知识间的冲突，灾难性遗忘问题在此任务中显著加剧。

Result: 大量实验表明，所提出的SCORE框架在衣物混合终身行人重识别任务上取得了最先进的性能。

Insight: 创新点在于显式建模身份内多样性以持续巩固不同的衣物一致和衣物变化知识，具体通过自适应子分布建模和分布知识强化方案实现，这有助于缓解知识冲突并减轻遗忘。

Abstract: Lifelong Person Re-Identification (LReID) aims to train a unified person retrieval model from a non-stationary data stream. Existing LReID methods mainly focus on scenarios where the clothing of each person is consistent. Recently, the Cloth-Hybrid LReID (CH-LReID) where cloth-consistent and cloth-changing data alternately occur, has emerged as a more practical and challenging scenario. Due to the conflict between clothing-relevant and clothing-irrelevant knowledge, the well-known catastrophic forgetting problem is significantly exacerbated in this task. To address this issue, we propose a SubDistribution-aware COllaborative Knowledge REinforcing (SCORE) framework, where our key idea is explicitly modeling the intra-identity diversity to continually consolidate distinct cloth-consistent and cloth-changing knowledge. Specifically, an Adaptive SubDistribution Modeling mechanism is developed, where a set of distributional subprototypes is assigned to each identity to capture the intra-identity diversity, improving the compatibility between cloth-consistent and cloth-changing knowledge. Then, a Distributional Knowledge Reinforcement scheme is introduced, where the knowledge of old distributional subprototypes is retained in the new ones by a collaborative aligning mechanism. Extensive experiments show that our SCORE achieves the state-of-the-art performance. Our code is available at https://github.com/zhoujiahuan1991/ECCV2026-SCORE

Chenxi Yang, Yassine Ouzar, Larbi Boubchir

TL;DR: 本文针对现有深度伪造检测方法在利用远程光电容积描记（rPPG）信号时存在的局限性，通过构建基于真实rPPG数据集的高保真伪造视频，研究了伪造操作对生理信号和面部行为的同步破坏。论文提出了一种双向协同注意力融合检测器，联合建模rPPG和面部行为特征，以捕获脉搏动态与面部运动之间的跨层级依赖关系，学习鲁棒的联合真实性表征。

Details

Motivation: 现有深度伪造检测基准缺乏生理真实值，且现有检测器未能充分探索面部特征与生理动态之间的跨层级关系，通常仅依赖后期融合或单独的rPPG特征。

Result: 在构建的数据集上，模型在人脸交换任务上达到92.80% AUC，在运动迁移任务上达到96.78% AUC，优于仅使用rPPG的单模态基线和最佳的特征级融合方法。在Celeb-DF-v2数据集上的迁移学习结果达到91.20%准确率和86.08% AUC。

Insight: 创新点在于构建了具有生理真实值的高保真伪造数据集以研究伪造的跨模态不一致性，并提出了双向协同注意力融合机制来显式建模生理信号与面部行为之间的跨层级依赖，从而学习更鲁棒的联合真实性表示。该方法在跨域适应场景下也展现了良好的应用潜力。

Abstract: Recent deepfake detection studies increasingly suggest remote photoplethysmography (rPPG) signals as an authenticity cue. However, existing benchmarks lack physiological ground truth, and current detectors underexplore the cross-level relationship between facial features and physiological dynamics, often relying on late fusion or rPPG features alone. In this paper, we construct high-fidelity deepfake manipulations on established real rPPG datasets (COHFACE and UBFC-rPPG) to investigate how forgeries disrupt natural physiological signals and facial behavior at the same time. Building on this analysis, we propose a bidirectional co-attention fusion detector that jointly models rPPG and facial behavior tokens. This mechanism explicitly captures the cross-level dependencies between pulse dynamics and facial motion to learn a robust, joint authenticity representation. Extensive experiments using a subject-disjoint 5-fold evaluation demonstrate the superiority of our approach. Achieving a 92.80% AUC on constructed datasets using face swapping and 96.78% AUC on motion transfer, our model outperforms both the rPPG-only single modality baseline and the best feature-level fusion methods. Furthermore, transfer-learning result of the fusion detector on Celeb-DF-v2 while keeping both feature extractors fixed achieves 91.20% accuracy and 86.08% AUC, which suggests applicability under target-domain adaptation.

[41] Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence cs.CV | cs.MMPDF

Yifeng Luo, Yupeng Li, Ming Tang, Jianxiong Guo, Liang Lan

TL;DR: 本文提出了一种用于检测和解释虚假新闻短视频的统一系统NVKE-CEI，该系统通过结合新闻视频关键帧提取（NVKE）以及融合内容与证据信息的检测框架（CEI），有效解决了现有方法在关键帧选择和信息整合方面的不足。

Details

Motivation: 短视频平台已成为公众主要新闻来源，但也导致虚假新闻视频广泛传播；现有方法在关键帧选择上可能遗漏关键线索或缺乏时序上下文，且往往忽视多模态理解与证据检索的结合。

Result: 在广泛的实验中，NVKE-CEI在虚假新闻视频检测与解释任务上超越了现有最先进的基线方法，同时能生成高质量、基于内容的解释。

Insight: 创新点在于提出了一种基于视觉与OCR文本相似度时序变化的关键帧提取方法，以及一个融合了基于内容的和基于证据的LLM事实核查器输出的轻量级判决模型，实现了多模态信息与外部证据的有效统一利用。

Abstract: Short-video platforms have become a primary news source for the public, which has also enabled the widespread dissemination of fake news videos. We study the task of fake news video detection and explanation (FNVDE). Existing methods face two critical limitations. First, commonly used frame selection strategies may omit veracity-relevant cues or provide insufficient temporal context for understanding news videos. Second, prior methods neglect either multimodal understanding or evidence retrieval. To address these limitations, we propose NVKE-CEI, a unified system that integrates a news video keyframes extraction method (NVKE) and an FNVDE framework leveraging both content and evidence information (CEI). NVKE selects keyframes based on chronological changes in combined visual and OCR-text similarity. CEI employs two specialized LLM-based fact checkers (content-based and evidence-based) whose outputs are fused by a lightweight judge model. Extensive experiments show that NVKE-CEI outperforms state-of-the-art baselines while generating high-quality content-grounded explanations.

[42] NOVA-GS: Noise-Aware View-Consistent Gaussian Splatting for Low-Light Novel View Synthesis cs.CVPDF

Shaurya Pavan A, Vemunuri Divya Madhuri, Yash Pradeep Gawande, Kaushik Mitra

TL;DR: 本文提出了NOVA-GS，一个用于低光照条件下新视角合成的统一噪声感知3D高斯溅射框架。该方法直接从退化的低光照输入中估计相机位姿和几何，无需依赖SfM或参考数据，并通过集成的增强、去噪和一致性优化模块，有效解决了传感器噪声、低信噪比和光度不一致性带来的挑战。

Details

Motivation: 解决真实世界低光照条件下3D场景重建的挑战，包括严重的传感器噪声、低信噪比和退化的光度一致性，这些问题会破坏几何估计和新视角合成的稳定性。现有方法通常依赖良好光照的参考数据进行SfM初始化，或使用引入跨视图不一致性的逐视图增强方法。

Result: 在多个真实世界低光照数据集上的广泛实验表明，该方法在几何保真度、颜色一致性和鲁棒性方面均有提升，且无需配对监督或良好光照的参考数据。

Insight: 创新点在于提出了一个统一的噪声感知框架，将增强、去噪和几何优化整合到单一流程中；利用VGGT进行前馈估计以直接从退化输入中获取鲁棒的相机位姿和几何；引入了结构感知增强模块、基于盲点掩码的自监督去噪模块、一致性驱动的高斯溅射优化以及噪声引导的球谐正则化来抑制噪声区域中的视图相关伪影。

Abstract: Reconstructing 3D scenes under real-world low-light conditions remains challenging due to severe sensor noise, low signal-to-noise ratios, and degraded photometric consistency, which destabilize geometry estimation and novel view synthesis. Existing approaches often rely on well-lit reference data for reliable Structure-from-Motion (SfM) initialization under degraded inputs or apply per-view enhancement methods that introduce cross-view inconsistencies. To address these limitations, we propose \textbf{NOVA-GS}, a unified noise-aware framework for low-light 3D Gaussian Splatting that subsumes enhancement, denoising, and geometry optimization within a single process. Our method leverages VGGT-based feed-forward estimation to obtain robust camera poses and geometry directly from degraded inputs, eliminating the need for SfM. Building on this initialization, NOVA-GS integrates three coupled components: a structure-aware enhancement module for exposure correction, a self-supervised denoising module with blind-spot masking for pseudo-supervision, and a consistency-driven Gaussian Splatting optimization enforcing cross-view geometric coherence. We further introduce a noise-guided spherical harmonic regularization to suppress view-dependent artifacts in noisy regions. Extensive experiments on diverse real-world low-light datasets demonstrate improved geometric fidelity, color consistency, and robustness without requiring paired supervision or well-lit references. https://shaurya2524.github.io/nova-gs/

[43] Semantically Aligned Gradient-Driven Context-Preserving Image Editing cs.CVPDF

Chiranjeev Chiranjeev, Muskan Dosi, Mayank Vatsa, Richa Singh

TL;DR: 本文提出IABEdit框架，通过将可微分的语义验证嵌入训练过程，解决指令引导图像编辑中存在的语义不匹配、空间溢出和定位不准等问题。该方法兼容多种骨干网络（如Stable Diffusion的U-Net和FLUX的MMDiT），无需在推理时使用视觉语言模型，即可提升编辑的结构保真度和指令对齐度。

Details

Motivation: 现有指令引导图像编辑方法在训练时缺乏语义验证，仅依赖重建和文本条件监督，导致编辑不完整、空间溢出和定位差的问题。

Result: 在MagicBrush基准上，结构保真度（DINO-I）比最佳扩散基线提升+3.49，比最佳总体基线提升+1.26；在RealEdit和EMU Edit基准上基于嵌入指标达到指令遵循性能的SOTA；在D-LORD监控基准的重遮挡场景下，身份保持指标（DINO-P）超越专有Gemini智能体+5.13。

Insight: 创新点在于通过冻结视觉语言模型提取真实编辑的空间感知描述符，并训练对齐器从生成输出中复现它们，利用残差梯度同时指导编辑内容和位置，实现了无需推理开销的语义对齐蒸馏。

Abstract: Instruction-guided image editing has a training-time blind spot. Generative editors are never required to semantically verify whether their outputs actually satisfy the instruction. Supervision stops at reconstruction and input textual-level conditioning. This produces incomplete edits, spatial spillover, and poor localization. We present IABEdit, a model-agnostic framework that embeds differentiable semantic verification into training. A frozen vision-language model extracts spatially-aware descriptors from the ground-truth edit. A trainable aligner then reproduces them from the generated output. The residual between the two becomes a gradient that teaches the generator both what to edit and where, with no inference-time VLM cost. IABEdit is compatible with diverse backbones, including U-Net (Stable Diffusion) and MMDiT (FLUX), without altering their inference pipelines. On MagicBrush, it improves structural fidelity by +3.49 DINO-I over the best diffusion baseline and +1.26 over the best overall baseline, while remaining competitive on instruction alignment. It also achieves state-of-the-art instruction adherence performance on RealEdit and EMU Edit benchmarks based on embedding-based metrics. Most consequentially, on the D-LORD surveillance benchmark, it surpasses the proprietary Gemini agent by +5.13 DINO-P under heavy occlusion, where preserving identity is hardest. This shows that gradient-aligned VLM distillation holds up under real-world-like surveillance and occlusion conditions. Human and GPT-4o evaluations confirm perceptually precise, well-localized edits.

[44] Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations cs.CVPDF

Xavier Anadón, Rémi Pautrat, Rui Wang

TL;DR: 本文提出了多模态平面图编码器（MMFE），用于将不同形式的2D室内平面图（如矢量CAD图、栅格渲染图和传感器密度图）映射到共享的密集潜在网格中。该方法结合了冻结的DINOv3主干网络和可训练的密集预测变换器（DPT）头，通过基于单元格的信息噪声对比估计（InfoNCE）目标进行训练，以对齐跨模态的空间对应区域。

Details

Motivation: 平面图存在多种形式（如矢量图、栅格图和密度图），这种异质性使得构建能够跨模态迁移并支持几何中心任务（如对齐和检索）的学习系统变得困难。

Result: 在跨域数据集Structured3D上，MMFE显著提升了跨模态密集匹配性能，通过RANSAC实现了鲁棒的相似性对齐，并在结合学习聚合后展现出强大的检索能力。

Insight: 创新点包括：采用冻结的预训练主干与可训练DPT头结合的结构，以及使用基于单元格的InfoNCE损失来对齐跨模态密集特征；通过引入受控相似变换和特征网格变形来增强对几何畸变的鲁棒性，从而学习到模态不变的密集表示。

Abstract: Floorplans arise in many forms, from vector CAD drawings to raster renderings and sensor-derived density maps. This heterogeneity makes it difficult to build learning systems that transfer across modalities and support geometry-centric tasks such as alignment and retrieval. We introduce the Multimodal Floorplan Encoder (MMFE), which maps diverse 2D indoor representations into a shared dense latent grid. MMFE combines a frozen DINOv3 backbone with a trainable Dense Prediction Transformer (DPT) head, and is trained with a per-cell Information Noise-Contrastive Estimation (InfoNCE) objective that aligns spatially corresponding regions across modalities while using all other cells as negatives. To improve robustness to geometric distortions, we incorporate controlled similarity transformations and enforce geometric consistency through feature-grid warping. On Structured3D, a held-out out-of-domain dataset, MMFE improves cross-modal dense matching, enables robust similarity alignment with RANSAC, and yields strong retrieval when paired with learned aggregation.

[45] GRACE: Adaptive Concept Erasure with Geometry-Guided Retention in Diffusion Models cs.CVPDF

Qinghui Gong, Yihuai Liang, Yuanlun Xie, Deepak Kumar Jain, Vitomir Štruc

TL;DR: 本文提出了GRACE框架，用于在文本到图像扩散模型中实现自适应概念擦除。该方法通过几何引导的保留机制，在精确擦除敏感概念的同时，最大限度地保持模型的原始生成能力。

Details

Motivation: 现有概念擦除方法缺乏对参数更新的显式约束，容易导致过度干预和意外的语义漂移，且依赖人工构建的反事实监督，扩展性受限。

Result: 在五个SOTA概念擦除方法的平均性能对比中，该方法将细粒度NSFW减少率提高了17.86%，同时将宏观平均目标CLIP分数和面向保留的Fréchet Inception Distance (FID)分别降低了4.75%和50.58%。

Insight: 创新点包括：语义加权的敏感子空间估计以精确定位干预方向；轻量子空间约束适配器防止全局语义扰动；自动解耦的安全锚机制消除对人工提示工程的依赖；以及能量驱动的动态门控机制自适应控制推理时的干预时机和强度。

Abstract: Text-to-image (T2I) diffusion models inevitably internalize sensitive or non-compliant concepts from large-scale pretraining data, necessitating post-hoc concept erasure. However, existing erasure methods often lack explicit constraints on parameter updates, leading to over-intervention and unintended semantic drift. In addition, many methods rely on manually crafted counterfactual supervision, such as surrogate prompts, which incurs substantial data construction costs that limit scalability to new concepts. To address these limitations, we propose GRACE, a structured concept erasure framework designed to enable localized and selective intervention. Specifically, we introduce a semantically weighted sensitive subspace estimation to precisely lock intervention directions, and employ lightweight subspace-constrained adapters to prevent global semantic disturbance. To eliminate the dependency on manual prompt engineering, we design an automatically decoupled safe-anchor mechanism. To mitigate semantic drift induced by excessive intervention, we introduce an energy-driven dynamic gating mechanism that adaptively controls the timing and strength of intervention at inference. Extensive experiments demonstrate that our method achieves a superior balance between erasure effectiveness and generation fidelity. Compared with the average performance of five state-of-the-art (SOTA) concept erasure methods, our method improves the fine-grained NSFW reduction rate by $17.86%$, while reducing the macro-averaged target CLIP Score and preservation-oriented Fréchet Inception Distance (FID) by $4.75%$ and $50.58%$, respectively, indicating stronger concept suppression with substantially improved preservation of the original model’s generative utility.

[46] ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts cs.CV | cs.LGPDF

Dang Hoai Nam, Nguyen Duy Hieu, Quang Huu Hieu, Vo Nguyen Le Duy

TL;DR: 本文提出了ExpertHTR，一个统一的手写文本识别框架，通过多任务学习和稀疏专家混合模型来解决异构数据集联合训练的难题。该框架利用统一的页面-区域-行表示整合不同数据集的结构化标注，构建了四个互补的训练任务，并在稀疏MoE架构中引入条件路由和正则化机制。在七个异构手写基准测试上的实验表明，该方法超越了通用OCR和视觉语言系统，并在IAM段落级基准上达到了最先进的性能。

Details

Motivation: 手写文本识别资源通常规模小且分散，在语言、书写体、文档结构和标注格式上存在差异，导致联合页面级训练困难。本文旨在通过统一的框架整合这些异构数据集，利用互补监督和条件模型容量来解决这一问题。

Result: 在七个异构手写基准测试上的实验表明，互补监督比单独使用页面转录训练效果更好，联合多源训练在大多数数据集上带来进一步增益。稀疏专家模型在七个数据源中的六个上超越了密集基线。最终统一模型在大多数基准上显著优于评估的通用OCR和视觉语言系统，并在IAM段落级基准上达到了最先进的性能。

Insight: 创新点在于提出了一个统一的页面-区域-行表示来整合异构数据集的结构化标注，并构建了四个互补的多任务学习目标。此外，引入了一个稀疏MoE架构，其中包含一个始终激活的共享分支和条件路由的全MLP专家，通过Sparsegen和路由正则化机制来动态调整激活专家数量并防止路由过度集中。

Abstract: Handwritten text recognition resources are often small and distributed across collections that differ in language, script, document structure, and annotation format, making joint page-level training difficult. We propose ExpertHTR, a unified vision-language framework that addresses this problem through complementary supervision and conditional model capacity. Structural annotations from heterogeneous datasets are first organized through a common Page-Region-Line representation and used to construct four related training tasks for complete transcription, physical-line coverage, text localization, and localized recognition, without requiring additional manual labels. Building on a jointly trained dense model, ExpertHTR introduces a sparse Mixture-of-Experts architecture with an always-active shared branch and conditionally routed full-MLP experts. Sparsegen allows the number of active routed experts to vary with the hidden representation, while routing regularization reduces persistent concentration on a small subset of experts. Experiments on seven heterogeneous handwriting benchmarks show that complementary supervision consistently improves training with page transcription alone, while joint multi-source training provides further gains on most datasets. The proposed sparse expert model further improves the dense baseline on six of the seven sources. The final unified model also substantially outperforms the evaluated general-purpose OCR and vision-language systems on most benchmarks and achieves state-of-the-art performance on the IAM paragraph-level benchmark, while specialized HTR systems remain stronger on several challenging collections.

[47] AquaCubeAI-Powered Monitoring Turbidity on-board Φsat-2 cs.CVPDF

Pietro Di Stasio, Francesca Razzano, Elisa Liparulo, Gabriele Meoni, Nicolas Longépé

TL;DR: 本文提出了AquaCubeAI，一种轻量级机器学习方法，用于在Φsat-2卫星上直接处理多光谱图像，以实时估算沿海水域浊度，旨在减少传统卫星数据处理流程的延迟。

Details

Motivation: 传统卫星水质监测依赖数据下行和地面处理，存在延迟，难以快速响应沿海水域快速变化的浊度事件，因此需要一种能在星载平台严格的计算和带宽限制下进行实时处理的方法。

Result: 模型在模拟Φsat-2数据与CMEMS高分辨率海洋颜色浊度产品对齐的数据集上训练，采用空间块分割协议评估泛化能力，并在Intel Myriad VPU上部署验证了低功耗硬件的可行性，支持低延迟推理。

Insight: 创新点包括：可扩展的数据集生成流程、针对嵌入式约束设计的紧凑MLP回归器，以及通过参数共享实现密集空间预测的重新表述，从而支持星载决策逻辑的浊度制图和异常检测。

Abstract: Timely monitoring of coastal water quality is critical for environmental protection, yet conventional satellite workflows rely on downlink and ground processing, introducing latency that can limit responsiveness to rapidly evolving turbidity events. To address this limitation, we propose AquaCubeAI, a lightweight machine-learning approach for onboard estimation of coastal water turbidity from Φsat-2 multispectral imagery. By shifting inference from the ground segment to the satellite, AquaCubeAI aims to enable lower-latency, more responsive, and more operationally useful turbidity monitoring under the strict compute and bandwidth constraints of spaceborne platforms. The model is trained on simulated Φsat-2 acquisitions spatially aligned with Copernicus Marine Service (CMEMS) High-Resolution Ocean Color (HR-OC) turbidity products over selected localized coastal sites spanning four European marine macro-regions. To provide a realistic evaluation of generalization in the presence of spatial correlation, we adopt a spatial block splitting protocol that mitigates data leakage between training and evaluation subsets. The main contributions of this work are: (i) a scalable dataset generation pipeline pairing simulated Φsat-2 multispectral patches with CMEMS HR-OC turbidity labels across selected localized European coastal sites; (ii) a compact Multi-Layer Perceptron (MLP)-based turbidity regressor trained under a leakage-aware geospatial split and tailored to embedded constraints; and (iii) a reformulation for dense spatial prediction via parameter sharing, enabling turbidity mapping and simple threshold-based anomaly masks for onboard decision logic. Embedded deployment on an Intel Myriad Vision Processing Unit (VPU) further confirms the feasibility of low-power hardware and supports low-latency inference from multispectral inputs.

[48] Same Encoder, Different Winner: A Paired-View Framework for Cell Painting Encoder Evaluation cs.CV | cs.LG | q-bio.QMPDF

Tim Treis, Nikita Moshkov, Johan Fredin Haslum, Shantanu Singh, Fabian J. Theis

TL;DR: 本文提出了CP-BG-Bench，一个用于评估Cell Painting视觉编码器的配对视图框架，通过固定中心细胞并控制周围像素（原始裁剪C、分割S及其密度增强变体CD和SD）来创建四个匹配视图。在三个数据集和三个编码器上，使用四种标准协议进行评估，发现不同协议对同一编码器的排名存在系统性差异，这些差异可分解为三个轴：细胞与背景、形态与上下文、研究内与跨批次。

Details

Motivation: 解决Cell Painting视觉编码器评估中单一指标（如重复平均精度mAP）排名可能具有误导性的问题，旨在通过一个受控的配对视图框架，系统性地探究不同评估协议如何影响编码器性能排名，并理解背景信息在细胞图像分析中的作用。

Result: 在JUMP-CP、RxRx1和RxRx3-core数据集上，使用DINOv3 ViT-B/16、OpenPhenom和SubCell编码器，通过四种协议（重复mAP、scIB批次整合、CellProfiler特征预测、跨批次扰动召回）评估。结果显示，不同协议对编码器的排名存在显著分歧；例如，在RxRx3-core上，使用分割输入的SubCell在重复mAP上保留了94%的裁剪视图性能，但在跨批次召回R@10上仅保留32%。密度增强能恢复84%的研究内C-to-S差距，但仅恢复8%的跨批次差距。

Insight: 创新点在于提出了一个配对视图评估框架，能够系统性地解耦和量化背景信息在不同评估任务中的作用。客观分析表明，编码器性能排名高度依赖于评估协议，背景驱动的性能增益主要由实验设计而非编码器本身决定，这挑战了单一指标排名的可靠性，并为更全面的编码器评估提供了方法论。

Abstract: Vision encoders for Cell Painting are typically ranked by a single evaluation, commonly replicate mean average precision (mAP). We introduce CP-BG-Bench, a paired-view evaluation framework that holds the central cell fixed across four matched views (raw crop C, segmented S, and density-augmented variants CD and SD), ablating or augmenting surrounding pixels as a controlled intervention. Instantiating the framework on three datasets (JUMP-CP, RxRx1, RxRx3-core) and three encoders (DINOv3 ViT-B/16, OpenPhenom, SubCell) under four community-standard protocols (replicate mAP, scIB batch integration, CellProfiler feature prediction, cross-batch perturbation recall), we find that the four protocols rank the same encoders systematically differently, with disagreements decomposing along three axes: cell versus background, morphology versus context, and within-study versus across-batch. The largest effect: on RxRx3-core, SubCell with segmented inputs retains 94% of crop replicate mAP but only 32% of crop R@10, so the within-study signal preserved under segmentation is largely non-transferable; density augmentation recovers 84% of the within-study C-to-S gap but only 8% of the cross-batch gap. Segmented views predict CellProfiler features as well as or better than crops on two of three datasets, inverting the replicate-mAP ranking, and the C-to-S gap varies by an order of magnitude across datasets while remaining similar across encoders, indicating that background-driven gain is set by experimental design rather than by the encoder. Single-metric ranking of Cell Painting encoders is therefore sensitive to the protocol used, and protocol disagreements are interpretable as projections onto the three axes the paired-view design exposes. We will release the paired-view datasets, reconstruction pipelines, 36 trained checkpoints, aggregated embeddings, and the full evaluation suite.

[49] LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection cs.CVPDF

Zhuangfan Huang, Xiaosong Li, Yang Liu, Tao Ye, Haishu Tan

TL;DR: 本文提出了一种名为LGFN的轻量级门控RGB-偏振融合框架，用于伪装目标检测。该框架支持根据偏振模态可用性，选择仅RGB或RGB-偏振多模态配置。在多模态配置中，通过模态门控、门控偏振中心和RGB-偏振交叉融合模块，有效协调和融合RGB与偏振信息，无需推理时依赖样本统计或手工质量描述符。

Details

Motivation: 伪装目标检测在目标与背景高度相似时极具挑战。现有方法通常假设固定的多模态输入配置，并且将偏振模态内部的协调与RGB-偏振模态间的交互耦合在一起，限制了灵活性和效率。

Result: 在完整的230张图像的PCOD_1200测试集上，仅RGB配置在所有六个评估指标上均优于其他基于RGB的方法。在多模态配置下，该模型在通用本地重评估协议中，在所有六个指标上均超越了PolarNet和IPNet。相较于IPNet，参数量、浮点运算量和延迟分别降低了53.1%、73.6%和63.0%。

Insight: 创新点在于提出了一个支持模态可用性条件选择的轻量级融合框架，通过确定性模态路由器和条件门控机制，实现了配置的灵活切换与高效融合。其门控偏振中心模块显式协调学习到的线偏振度和偏振角表示，RGB-偏振交叉融合通过可控残差交互将协调后的表示引入RGB层次，实现了模态间信息的有效解耦与互补融合。

Abstract: Camouflaged object detection (COD) is an important engineering task in intelligent optical perception, but it remains challenging when targets closely resemble their surroundings. Polarization imaging provides complementary physical cues, whereas existing methods typically assume fixed multimodal input configurations and entangle intra-polarization coordination with interaction between red-green-blue (RGB) and polarization representations. We propose LGFN, a lightweight gated RGB-polarization fusion framework supporting separately optimized RGB-only and polarization-assisted configurations. A deterministic Modality Router selects the appropriate configuration according to polarization availability. In the multimodal configuration, an availability-conditioned Modality Gate calibrates the available polarization branches; the Gated Polarization Hub coordinates learned degree of linear polarization (DoLP) and angle of polarization (AoP) representations with explicit polarization cues; and RGB-Polarization Cross Fusion introduces the coordinated representation into the RGB hierarchy through controlled residual interaction. The multimodal configuration requires neither sample-dependent statistics nor handcrafted quality descriptors during inference. On the complete 230-image PCOD_1200 test set, the RGB-only configuration achieves a mean absolute error of 0.0090, a Dice score of 0.8806, and an intersection over union of 0.8144, obtaining the best results on all six metrics among the evaluated RGB-based methods. Under a common local reevaluation protocol, the multimodal configuration outperforms PolarNet and IPNet on all six metrics. Relative to IPNet, it reduces the parameter count, floating-point operations, and latency by 53.1%, 73.6%, and 63.0%, respectively.

[50] SCDM: Spatial-Contextual Disentanglement Mamba via Differential Inference for Efficient Image Classification cs.CVPDF

Mustafa Bora Çelik, Hayriye Aktaş Dinçer, Ayse Keles

TL;DR: 本文提出了一种名为空间上下文解耦曼巴（SCDM）的新型状态空间模型架构，用于高效的医学图像分类。该模型采用非对称双分支设计，通过正分支提取判别性特征，负分支主动建模并抑制正常解剖背景，从而分离疾病特异性信号。通过相似性驱动的排斥门和差分推理规则实现竞争性特征学习，无需额外标签或增加模型容量。

Details

Motivation: 现有状态空间模型（如VMamba）在医学图像分析中学习到的表示通常是纠缠的，缺乏将疾病特异性信号与正常解剖背景明确分离的机制，难以区分视觉上相似的病理特征。

Result: 在RSNA肺炎数据集上的评估表明，SCDM取得了有竞争力的分类性能（AUC为0.858），同时与标准VMamba和视觉Transformer基线相比，所需参数量（29.4M）和FLOPs（1.44G）显著减少。

Insight: 主要创新点在于提出了一个用于选择性表示解耦的非对称双分支架构，以及实现该解耦的相似性驱动排斥门和差分推理规则。从客观角度看，这种通过竞争性学习实现特征分离的机制，在不增加模型复杂度的前提下，有望提高模型对细微病理特征的特异性感知和定位精度。

Abstract: State Space Models (SSMs), particularly VMamba, have emerged as efficient alternatives for modeling long-range dependencies in medical image analysis. However, distinguishing subtle pathological features from visually similar anatomical backgrounds remains a significant challenge. Existing SSM architectures often learn entangled representations, lacking explicit mechanisms to separate disease-specific signals from normal anatomy. To address this limitation, we propose Spatial-Contextual Differential Mamba (SCDM), an asymmetric dual-branch architecture designed for selective representational disentanglement. SCDM introduces a Positive Branch for extracting discriminative features and a Negative Branch that actively models and suppresses normal anatomical context. This separation is achieved through a similarity-driven repulsion gate and a differential inference rule, which promote competitive feature learning without requiring additional branch labels or increasing model capacity. Evaluated on the RSNA Pneumonia dataset, SCDM achieves competitive classification performance (AUC of 0.858) while requiring significantly fewer parameters (29.4M) and FLOPs (1.44G) compared to standard VMamba and vision transformer baselines. Furthermore, activation analyses demonstrate that our differential mechanism yields highly precise localization, effectively isolating lesions by inhibiting irrelevant anatomical distractors.

[51] CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs cs.CVPDF

Jonathan Sauder, Thomas Ruckli, Gabrielė Strodomskytė, Ibrahim Souleiman Abdallah, Rahma Hassan Abdi

TL;DR: 本文提出了CoralscapesV2数据集，这是一个用于珊瑚礁全景和细粒度视觉场景理解的数据集。它扩展了原有数据集，增加了数据规模、类别数量（从39类增至95类），并首次提供了珊瑚礁场景中6.5万个详尽的鱼类实例掩码标注，支持全景分割任务。该数据集旨在为大规模珊瑚礁生态监测提供通用计算机视觉方法的基础。

Details

Motivation: 为应对全球珊瑚礁衰退，需要大规模扩展生态监测。随着数据收集范式从高度标准化的调查图像转向可扩展平台上的无约束图像，有必要设计能从通用珊瑚礁图像中获得细粒度理解的机器学习方法。

Result: CoralscapesV2构建了一个具有挑战性的基准，用于评估当代语义分割和实例分割模型。它捕获了广泛的野外场景，是首个珊瑚礁全景分割数据集。

Insight: 创新点在于通过视频进行详尽标注，揭示了仅基于静态图像标注鱼类的不足。该数据集推动了通用珊瑚礁全景分割的发展，可应用于从底栖覆盖制图到自动化量化鱼类行为等多种应用，对扩大监测规模有重要意义。

Abstract: In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scaled up dramatically. Computer vision methods are increasingly used to tackle the vast amount of data: as the paradigm of data collection in reefs shifts from highly standardized and constrained survey images to unconstrained imagery on scalable platforms, it is necessary to design machine learning methods that help to get a fine-grained understanding of reefs from general-purpose reef imagery. This paper provides CoralscapesV2, an extension of the Coralscapes dataset for general-purpose visual scene understanding in reefs. CoralscapesV2 increases the dataset size, scope, label completeness and quality for semantic segmentation, and extends the number of classes from 39 to 95 fine-grained visual categories. Furthermore, CoralscapesV2 provides 65k exhaustive fish instance mask annotations, meticulously annotated to completeness by using the video, revealing that annotation of fish based on only static images is insufficient. CoralscapesV2 is the first dataset for panoptic segmentation in coral reefs, capturing a wide range of scenarios in the wild, posing a challenging benchmark for contemporary semantic segmentation and instance segmentation models. CoralscapesV2 is an important step towards general-purpose panoptic segmentation in coral reefs, which has substantial implications for scaling up coral reef monitoring, as it can be employed in a wide range of applications from benthic cover mapping from robot or handheld videos to designing methods for automated quantification and understanding of fish behavior and fish-reef interactions.

[52] Online Video Agent Harness for Long Video Understanding cs.CV | cs.AIPDF

Sen Yang, Boqiang Duan, Jing Yang, Weihao Bo, Jie Liu

TL;DR: 本文提出了VideoXAgent，一种纯在线视频智能体框架，用于长视频理解。该框架从给定的视频文件和用户查询出发，通过任务规划与分解、按需调用异构专家工具（如脚本、视觉语言模型、检测、OCR、ASR、人脸识别等），并聚合多模态证据来生成最终答案，同时解决观察结果间的冲突。

Details

Motivation: 解决长视频理解中查询相关证据稀疏分布、将密集帧打包到单一VLM上下文会导致’上下文腐化’和高成本的问题，以及现有视频智能体依赖查询无关的离线预处理或临时工具集可能遗漏查询细节并浪费计算资源的局限性。

Result: 在Video-MME-Long、LongVideoBench-Long、LVBench和MINERVA等基准测试上，VideoXAgent与前沿的LMM和视频智能体性能相当，但上下文占用更小（每个样本约5万个token），即使在长达一小时的视频上也是如此。在MINERVA等复杂视频推理基准上，其性能与基线相当，但仅使用了密集打包1024帧基线约15%的上下文。

Insight: 创新点在于设计了一个数据驱动的原子能力分类法指导的异构专家工具套件，并采用客观证据提示和预算感知控制来减少幻觉和非终止问题。客观分析表明，强大的长视频理解能力可以通过渐进式的智能体证据寻求过程实现，而非依赖于将整个视频打包到单一上下文中，甚至视觉能力较弱或纯文本的编排器也能保持有效性。

Abstract: Long video understanding often behaves like a visual needle-in-a-haystack problem: query-relevant evidence is sparsely distributed across long temporal spans, while packing dense frames into a single VLM context incurs \textit{context rot} and high cost. Existing video agents often rely on query-agnostic offline preprocessing or ad hoc tool sets, which can miss query-specific details and waste computation. In this work, we present VideoXAgent, a purely online video-agent harness for long video understanding that starts from the given video file and user query, plans and decomposes the task, invokes specialized expert tools on demand, and aggregates multimodal evidence to produce a final answer while resolving conflicts among observations. To support this on-demand invocation, we design a suite of heterogeneous expert tools guided by a data-driven taxonomy of atomic capabilities, spanning scripts, VLMs, and domain models (e.g., detection, OCR, ASR, face recognition). The harness further enforces objective evidence prompting and budget-aware control to curb hallucination and non-termination. Across Video-MME-Long, LongVideoBench-Long, LVBench, and MINERVA, VideoXAgent is competitive with frontier LMMs and video agents under a smaller context footprint—about 50k tokens of agent context per sample, even on hour-long videos. In particular, on complex video-reasoning benchmarks such as MINERVA, it matches this level while using only about 15% of the context of a 1,024-frame dense-packing baseline. Notably, the harness remains effective with a visually weak or even text-only orchestrator, suggesting that strong long-video understanding can emerge from progressive agentic evidence seeking rather than from packing the full video into a single context. Project page: https://go-agent-x.github.io/video_agent_harness/

[53] A Dual Cross-Attention Framework for Colposcopic CIN Grading and Swede Score Prediction Using a New Multi-Center Dataset cs.CVPDF

Dania Khan, Nuzhat Aisha Shaikh, Asfina Hassan Juicy, Raiyun Kabir, S M Shahida

TL;DR: 本文提出了一种用于自动化宫颈上皮内瘤变（CIN）分级和临床Swede评分预测的新型深度学习框架。该框架采用双流交叉注意力架构，融合成对的多模态宫颈图像以模拟专家视觉推理，并引入一个自定义复合损失函数来处理严重的类别不平衡和评分不一致问题。研究还发布了一个新的多中心数据集（BUET Multi-Center Colposcopy Dataset），用于支持相关任务。

Details

Motivation: 宫颈癌是全球重大健康挑战，在中低收入国家尤为突出，主要由于缺乏训练有素的专家以及基于阴道镜检查的筛查具有主观性。因此，需要开发自动化AI工具来辅助筛查和基于风险的分诊。

Result: 在三分类CIN分级任务上，该框架取得了71.85%的准确率和86.23%的AUC-ROC，优于现有方法。在Swede评分各分项预测上，AUC-ROC值在75.7%到88.4%之间，复合损失函数带来了F1分数的稳定提升。预测的总Swede评分（0-10分）的平均绝对误差为1.489。

Insight: 主要创新点包括：1）模拟专家视觉推理的双流交叉注意力框架，用于融合成对多模态图像；2）针对Swede评分各分项类别不平衡和评分不一致问题设计的自定义复合损失函数；3）为Swede评分预测和CIN分级任务构建并公开了一个新的多中心数据集。

Abstract: Cervical cancer is a major global health challenge, with disease burden falling disproportionately on low- and middle-income countries (LMICs) due to a shortage of trained specialists and the subjective nature of colposcopy-based screening. To address this challenge, we propose a novel deep learning framework for the automated grading of Cervical Intraepithelial Neoplasia (CIN) and the prediction of clinical Swede scores. We also introduce the BUET Multi-Center Colposcopy Dataset, a novel, multi-center cohort designed and annotated for Swede score prediction and CIN grading. Our proposed dual-stream cross-attention architecture mimics the visual reasoning of an expert colposcopist by explicitly fusing paired multimodal cervigrams to evaluate comparative tissue responses. Furthermore, we introduce a custom composite loss function to address severe class imbalances and scoring inconsistencies across the five Swede score components. The proposed framework achieved 71.85% accuracy and an 86.23% AUC-ROC for three-class CIN grading, outperforming existing methods. For Swede score component prediction, the architecture achieved AUC-ROC values ranging from 75.7% to 88.4%, with the composite loss function yielding consistent F1-score improvements. Finally, the total predicted Swede Score, which ranges between 0 and 10, shows a Mean Absolute Error (MAE) of 1.489. The results show that the proposed method can pave the way towards developing AI-assisted colposcopy screening tools to support risk-based triage in resource-limited healthcare settings. The dataset and source code are publicly available(url: https://github.com/mHealthBuet/BUET-colposcopy)

[54] Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring cs.CVPDF

Jisheng Dang, Zhenxuan Wang, Bin Li, Ronghao Lin, Bin Hu

TL;DR: 本文提出了一种基于强化学习与效价-唤醒度锚定的方法，用于在文本到图像生成中平衡情感对齐与语义一致性。该方法在流匹配图像生成框架中结合了连续的效价-唤醒度条件化、组相对策略优化和一个中性的语义锚点，旨在提升情感对齐的同时避免提示词描述的物体、布局或场景发生改变。

Details

Motivation: 解决现有监督式情感注入方法在优化特征空间代理时可能出现的’情感-语义漂移’问题，即在增强情感条件化的同时引发非预期的内容变化，从而实现在不改变提示词语义的前提下进行连续的情感控制。

Result: 在3300个提示词-情感组合上的实验表明，该方法在效价和唤醒度上的误差显著低于基线模型，并且相对于EmotiCrafter提升了CLIPScore，但在无参考图像质量上存在可衡量的权衡。

Insight: 核心创新点在于将确定性概率流ODE转换为保持边缘分布的SDE以获得非退化的转移密度用于策略比估计，并引入一个在零VA条件下生成的图像作为特征空间参考（语义锚）来正则化强化学习过程，从而在连续情感图像合成中实现情感对齐与语义一致性的平衡。

Abstract: Continuous emotion control in text-to-image generation requires a model to improve affective alignment without changing the objects, layout, or scene described by the prompt. Existing supervised emotion-injection methods often optimize feature-space proxies and may therefore exhibit emotion-semantic drift, in which stronger emotional conditioning is accompanied by unintended content changes. We address this problem with a flow-matching image-generation framework that combines continuous valence-arousal (VA) conditioning, Group Relative Policy Optimization (GRPO), and a neutral semantic anchor. The deterministic probability-flow ODE is converted into a marginal-preserving SDE, yielding non-degenerate transition densities for trajectory sampling and policy-ratio estimation. A frozen CLIP-based VA regressor supplies a terminal reward measuring the distance between the predicted and target VA coordinates, while an image generated from the same prompt under zero VA conditioning provides a feature-space reference for semantic preservation. A reduced denoising schedule is used for online RL sampling, whereas the original schedule is retained at inference. Experiments on 3,300 prompt-emotion combinations show substantially lower valence and arousal errors than the VA-conditioned baseline and an improved CLIPScore relative to EmotiCrafter, with a measurable trade-off in reference-free image quality. The results support anchor-regularized Flow-GRPO as a practical approach to balancing emotional alignment and semantic consistency in continuous-affect image synthesis.

[55] Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce cs.CVPDF

Ifeoma Veronica Nwabufo, Julius Gervelmeyer, Sarah Müller, Philipp Berens

TL;DR: 该论文研究了在纵向数据稀缺的情况下，如何利用自监督预训练来改善年龄相关性黄斑变性（AMD）的疾病进展建模。通过在大规模横断面NAKO队列上预训练编码器，并在纵向AREDS数据集上预测晚期AMD发生时间，比较了不同自监督策略、模型规模和数据量下的性能。

Details

Motivation: 疾病进展建模通常需要稀缺的纵向成像数据，而横断面数据则相对丰富。研究旨在探索自监督预训练如何弥补这一差距，并确定在有限标记纵向数据下最优的预训练策略。

Result: 在标记数据极少（如数百样本）且编码器冻结的典型纵向队列场景下，自监督预训练模型能达到临床合理的判别性能，而从头训练的模型则不能；但在微调下该优势减弱。性能主要受自监督目标而非数据规模或领域匹配度影响，使得在适度横断面队列上预训练的编码器表现优于或匹配更大的领域内基础模型（如RETFound）。

Insight: 论文的创新点在于系统评估了自监督预训练在疾病进展建模中的价值，特别是在数据稀缺时。关键见解是：冻结的自监督编码器配合轻量级生存头是一种实用方案，且自监督目标的选择比预训练数据规模或领域特异性更重要。

Abstract: Modelling how a disease progresses over time requires longitudinal imaging cohorts, which are scarce and small, whereas cross-sectional data – one image per participant – is abundant. Self-supervised pre-training on such data offers a way to bridge this gap, but it is unclear which strategy best supports progression modelling, or how that answer depends on the amount of labelled longitudinal data. We study this for age-related macular degeneration (AMD), pre-training encoders on the large cross-sectional NAKO cohort and predicting time to late AMD on the longitudinal AREDS dataset. We compare in-house self-supervised encoders against a general-purpose (DINOv2) and a domain-specific (RETFound) foundation model, across contrastive, masked-autoencoding, and self-distillation objectives, under frozen and fine-tuned protocols, and across labelled training sets from 100 to 32,250 examples. Which model performs best depends on how the encoder is used. When the encoder is frozen and labels are few – the regime typical of longitudinal cohorts – pre-trained representations reach clinically reasonable discrimination from a few hundred labelled samples, while models trained from scratch do not; this advantage fades under fine-tuning. Transfer is governed by the self-supervision objective rather than corpus scale or domain match, so that an encoder pre-trained on a modest cross-sectional cohort matches or exceeds a far larger in-domain foundation model. Together, these results offer a practical recipe for building progression models where longitudinal data is scarce: a frozen self-supervised encoder with a lightweight survival head.

[56] HemaHier: Chain-Conditioned Ordinal Hierarchies for Lineage-Aware Bone-Marrow Cytology cs.CVPDF

Afshin Bozorgpour, Peter Schüffler, Edgar Jost, Dorit Merhof

TL;DR: 本文提出HemaHier，一种用于骨髓细胞学分析的序数层次化预测头，旨在利用细胞固有的谱系和成熟度结构。该方法通过链条件成熟度评分来预测单链成熟度值，并结合共享后验保证层次一致性，在三个骨髓数据集上实现了竞争性识别，同时减少了生物学严重错误并增加了谱系内成熟度排序。

Details

Motivation: 标准扁平分类器忽略了骨髓细胞学中固有的谱系和成熟度结构，将同一谱系的轻度混淆与跨谱系的严重错误同等对待，且仅预测离散标签。

Result: 在共享本体下的三个骨髓数据集上，HemaHier实现了竞争性的识别性能，同时显著减少了生物学严重错误，并提供了扁平分类器所缺乏的谱系内成熟度排序。

Insight: 创新点在于引入链条件成熟度评分来建模有序成熟轨迹，并通过共享后验耦合细粒度和谱系预测以强制层次一致性，这为结构化细胞分类任务提供了一种新颖的监督框架。

Abstract: Bone-marrow cytology is inherently structured: each cell belongs to a hematopoietic lineage, and many cell types lie on ordered maturation trajectories. Standard flat classifiers ignore this structure, treating a mild same-lineage confusion the same as a severe cross-lineage mistake and predicting only discrete labels. We propose HemaHier, an ordinal-hierarchical prediction head for a frozen or lightly adapted cytology foundation model. Its central component is a chain-conditioned maturity score that reads a single maturity value under a per-chain query, supervised only on biologically valid healthy chains, while dysplastic and off-chain cell types remain classes but are excluded from maturity supervision. Fine and lineage predictions are coupled through a shared posterior that guarantees hierarchical consistency, and a staged objective first stabilizes recognition, then adds lineage and maturity supervision. On three bone-marrow datasets under a shared ontology, HemaHier achieves competitive recognition while reducing biologically severe errors and adding a within-lineage maturity ordering that flat classifiers lack. Code is available at https://github.com/xmindflow/HemaHier.

[57] MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling cs.CVPDF

Lei Shi, Sen Peng, Zhiyang Deng, Zhonggui Chen, Xiaohu Guo

TL;DR: MGAvatar提出了一种高斯-网格混合表示方法，用于联合建模头部虚拟形象的几何与外观。该方法通过顶点绑定高斯和面绑定高斯两种模式，分别处理几何变形和外观渲染，并引入了视图条件神经颜色场和高斯偏移网络来提升渲染质量与一致性。

Details

Motivation: 现有基于高斯的头部虚拟形象方法通常依赖参数化模板（如FLAME）进行高斯初始化和变形，但这些模板缺乏个性化先验，难以准确表示头发、衣物等结构。

Result: 在多视角和单目视频上的大量实验表明，MGAvatar在渲染质量上优于现有方法，能够生成具有丰富纹理细节的高保真头部虚拟形象。

Insight: 创新点在于提出了高斯-网格混合表示，通过两种绑定模式解耦几何与外观建模，并设计了视图条件神经颜色场和高斯偏移网络来分别解决外观一致性和动态纹理捕捉问题，从而实现了更稳定、更具表现力的头部建模。

Abstract: Accurate head modeling requires a stable yet expressive geometric representation. Existing Gaussian-based head avatars commonly rely on parametric templates (e.g., FLAME) for Gaussian initialization and deformation, but these templates lack personalized priors and struggle to represent structures such as hair and clothing. To address this issue, we propose MGAvatar, a Gaussian-mesh hybrid representation that jointly models geometry and appearance through two Gaussian-mesh binding modes. Specifically, we introduce vertex-bound Gaussians and constrain their learnable parameters, enabling progressive mesh deformation to represent complex head geometry, while a pose-dependent offset module accounts for non-rigid deformations. Once geometry is stabilized, MGAvatar switches to face-bound Gaussians for appearance modeling. To improve appearance consistency across novel poses and viewpoints, we introduce a view-conditioned neural color field that alleviates artifacts caused by independently optimized Gaussian colors. In addition, we design a Gaussian offset network to predict Gaussian offset maps in the observation space, providing greater flexibility for face-bound Gaussians to capture dynamic facial textures. Extensive experiments on multi-view and monocular videos show that MGAvatar outperforms existing methods in rendering quality, producing high-fidelity head avatars with rich texture details.

[58] Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery cs.CVPDF

Bing-Zhang Fu, Zhi-Long Han, Ting-Zhu Huang, Xi-Le Zhao, Deyu Meng

TL;DR: 本文提出了一种预训练低秩张量分解（PLTD）框架，用于多维图像恢复。该框架将预训练大视觉模型（如DINOv3）与经典张量分解有机结合，通过固定预训练潜在张量捕获图像间的共同结构，并通过可学习的低秩潜在张量表征实例特定结构，从而在恢复保真度、参数效率和计算成本之间取得更好平衡。

Details

Motivation: 现有张量分解方法通常从头学习每张图像的实例特定结构，但忽略了不同图像间的共同结构，导致语义建模能力有限、计算成本高且可学习参数过多。

Result: 在多维图像恢复任务上的大量实验表明，PLTD框架相比现有最先进方法（SOTA）能持续取得更优的性能。

Insight: 主要创新点在于首次将预训练大视觉模型的知识蒸馏整合到张量分解框架中，通过固定预训练项捕获通用先验，并结合可学习的低秩项进行实例自适应，实现了性能、参数效率和计算开销的更好权衡；从客观角度看，这种结合预训练模型与经典低秩建模的思路为张量表示学习提供了新范式。

Abstract: Recently, tensor decompositions are prevalent for multi-dimensional image representation, which learn the instance-specific structure of each image from scratch. However, tensor decompositions neglect the common structure across different images, leading to limited semantic modeling capability, high computational cost, and a large number of learnable parameters. To address this challenge, we suggest the first pre-trained low-rank tensor decomposition (PLTD) framework, which organically integrates the pre-trained large vision model into the classical tensor decomposition framework. Beyond the shallow and untrained deep tensor decomposition, the suggested PLTD achieves an unprecedented balance among higher recovery fidelity, fewer learnable parameters, and smaller carbon footprint. Specifically, PLTD factorizes the target tensor into a latent tensor and a learnable transform that maps the latent tensor back to the original data domain. The latent tensor consists of two indispensable and complementary terms, i.e., a fixed pre-trained latent tensor and a learnable low-rank latent tensor. The fixed pre-trained latent tensor is distilled from a pre-trained large vision model (i.e., DINOv3) to capture the common structure of the target tensor, while the learnable low-rank latent tensor characterizes the instance-specific structure of the target tensor. To examine the potential of PLTD, we develop the corresponding multi-dimensional image recovery model and theoretically justify the advantages of this framework. Additionally, we discuss the connections between PLTD and classical tensor decomposition frameworks. Extensive experiments on multi-dimensional image recovery demonstrate that PLTD consistently achieves superior performance compared with state-of-the-art methods.

[59] VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation cs.CVPDF

Xinyi Chen, Hanxin Zhu, Xijun Wang, Xingrui Wang, Sen Liang

TL;DR: 本文提出了VideoTok4D，一种新颖的4D感知视频分词器，用于紧凑的世界表示。该方法通过时空解耦策略将视频分解为静态和动态token，利用轨迹感知的动态注意力机制聚合线索以提升跨视角运动一致性，并引入了在token空间上学习的扩散先验Co4DGen以实现高效的4D场景生成。

Details

Motivation: 当前视频分词范式主要停留在2D视觉领域，将视频视为图像序列而非底层动态3D世界的观测，导致学习到的token存在观测中心偏差，限制了其紧凑表示真实世界4D场景的能力。

Result: 大量实验表明，该方法在实现最先进性能的同时，所需存储空间比密集4D表示少4个数量级，并且紧凑的token空间显著缩短了扩散序列，实现了高效生成。

Insight: 核心创新在于将4D（3D+时间）感知引入视频分词，通过时空解耦、轨迹感知注意力以及基于token空间的扩散先验，从观测序列中学习更本质的动态世界紧凑表示，为4D场景理解和生成提供了新范式。

Abstract: Video tokenizers have emerged as a cornerstone of modern video modeling, underpinning progress in compression, reconstruction and generation by mapping high-dimensional visual signals into compact latent spaces. However, despite this progress, current tokenization paradigms largely remain within the 2D visual domain, treating videos as image sequences rather than observations of an underlying dynamic 3D world. Consequently, the learned tokens inherit this observation-centric bias, limiting their capacity to compactly represent real-world 4D scenes. To mitigate this issue, we propose VideoTok4D, a novel 4D-aware video tokenizer for compact world representation. Specifically, our approach comprises three key designs: 1) a spatiotemporal disentanglement strategy that factorizes videos into static and dynamic tokens for holistic world modeling; 2) a track-aware dynamic attention mechanism that aggregates trajectory-aligned cues to promote cross-view motion consistency; and 3) Co4DGen, a diffusion prior learned over the resulting VideoTok4D token space for efficient 4D scene generation. Extensive experiments have demonstrated that our proposed method achieves state-of-the-art performance while requiring up to 4 orders of magnitude less storage than dense 4D representations. Moreover, the compact token space substantially shortens diffusion sequences, enabling efficient generation.

[60] UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction cs.CV | cs.AI | cs.ROPDF

Xinqiang Yu, Zekun qi, Jiawei He, Wenyao Zhang, Xuchuan Chen

TL;DR: 本文提出UniPart，一种基于前馈跨模态3D Transformer的零样本语言引导3D部件分割方法，旨在通过自由文本短语在点云上选择功能部件。为扩大监督规模，构建了包含160K+ Objaverse资产和800万文本-部件对的LangPart-1M数据集，并标注了高质量子集LangPart-4K用于微调和评估。该方法在开放词汇部件基准上取得了强大的零样本性能，并能迁移到现实世界的语言条件部件抓取任务中。

Details

Motivation: 现有3D基础模型要么泛化性强但仅关注物体级别，要么关注部件但受限于封闭集分类，这削弱了零样本迁移能力。研究旨在解决细粒度机器人操作中需要理解部件而非整体物体的需求，实现自由文本条件下的3D部件分割。

Result: UniPart在开放词汇部件基准上取得了强大的零样本结果，能够迁移到现实世界的语言条件部件抓取任务，展示了零样本泛化能力。

Insight: 创新点包括提出条件化CLIP文本嵌入的跨模态3D Transformer架构，以及通过多视角一致部件生成构建大规模文本-部件对数据集LangPart-1M，为语言引导的3D部件理解提供了可扩展的监督数据和方法框架。

Abstract: Fine-grained robotic manipulation depends on understanding parts, not only whole objects. Existing 3D foundation models tend to be either generalized but object-aware, or part-aware but limited to closed-set taxonomies, which weakens zero-shot transfer. We study text-conditioned 3D part segmentation, where a free-form phrase selects a functional part on point cloud. We introduce UniPart, a feed-forward cross-modal 3D Transformer that conditions CLIP text embedding. To scale supervision, we build LangPart-1M with 160K+ Objaverse assets and 8M text to part pairs using multi-view consistent part generation. We further manually label a high-quality subset, LangPart-4K, for fine-tuning and evaluation. UniPart achieves strong zero-shot results on open-vocabulary part benchmarks and transfers to language-conditioned part grasping in real world.

[61] Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization cs.CVPDF

Minh-Loi Nguyen, Xuan-Vu Le, Thanh-Toan Do, Tam V. Nguyen, Minh-Triet Tran

TL;DR: 本文提出PhysPlan，一种无需训练的引导框架，旨在解决视频扩散模型（VDMs）生成视频时缺乏物理常识的问题。该方法通过视觉语言模型（VLM）作为认知模拟器分解输入，生成运动轨迹和3D深度几何的多模态表示，并采用以物体为中心的测试时优化，结合对象中心梯度路由和动态强度分析，有效隔离运动修改并保护静态背景。

Details

Motivation: 现有视频扩散模型虽然能合成高保真视频，但缺乏对物理定律的内在理解，常产生因果逻辑错误、结构幻觉和物理上不可信的运动。通过无需训练的测试时优化注入物理意识是一种有前景的替代方案，但现有方法依赖全局梯度更新和刚性调度启发式，会破坏被动背景且无法建模复杂的动态状态变化。

Result: 在PhyGenBench和Physics-IQ基准测试上的广泛评估表明，PhysPlan显著优于基础和可控的视频扩散模型基线，为提升视频生成的物理理解提供了有前景的方法。

Insight: 创新点在于将范式从随机视觉插值转向智能物理模拟，利用VLM作为迭代认知模拟器生成多模态表示，并引入对象中心梯度路由以隔离运动修改、锁定被动环境，以及动态参数化框架超参数以适应不同严重程度的物理变形。

Abstract: Video diffusion models (VDMs) have demonstrated remarkable capabilities in synthesizing high-fidelity, photorealistic video content. However, they fundamentally lack an intrinsic understanding of physical laws and frequently produce visually appealing but causally illogical sequences characterized by structural hallucinations and physically implausible dynamics. Injecting physical awareness via training-free test-time optimization is a promising alternative, yet existing methods rely on global gradient updates and rigid scheduling heuristics that inadvertently corrupt passive backgrounds and fail to model complex dynamic state changes. To address this, we propose PhysPlan, a novel training-free guidance framework that shifts the paradigm from stochastic visual interpolation to agentic physics simulation. First, a VLM operates as an iterative cognitive simulator, decomposing multimodal inputs into a Chain-of-Visual-Thought to create a multimodal representation of kinematic trajectories and 3D depth geometries. Second, these signals drives an object-centric test-time optimization. Unlike prior training-free methods that rely on global gradients and rigid scheduling heuristics, PhysPlan introduces Object-Centric Gradient Routing to isolate kinematic modifications and completely lock the passive environment. Furthermore, our Kinetic Intensity Profiling dynamically parameterizes framework hyperparameters to accommodate the varying severity of physical deformations. Extensive evaluations on the PhyGenBench and Physics-IQ benchmarks demonstrate that PhysPlan significantly outperforms both foundational and controllable VDM baselines, offering a promising approach for improving the physical understanding of video generation.

[62] DementiaCare-Bench: A Modality-Validated Video Benchmark cs.CV | cs.MAPDF

Afrouz Sheikholeslami, Yuankai Qi, Xuyun Zhang, Luping Zhou, Amin Beheshti

TL;DR: 本文提出了DementiaCare-Bench，一个用于评估视频语言模型在理解痴呆症行为和心理症状方面能力的基准数据集。该基准包含专业护理培训视频片段和基于逐字稿生成的问题，并测量了模型对视频内容的实际依赖程度。研究发现，现有模型在需要时序视频理解的任务上表现不佳，但通过轻量级微调可以显著提升性能。

Details

Motivation: 痴呆症护理中最困难的部分是行为和心理症状，理解这些症状需要结合行为本身及其触发背景。目前缺乏评估视频语言模型在此类任务上能力的基准，因此需要构建一个能真实测量模型对视频信息依赖度的评测工具。

Result: 在12个当前视频语言模型上的测试显示，最佳模型总体准确率达到85%，但在需要时序视频理解的问题上平均下降17个百分点。一个领先的开源模型在判断护理人员反应是否合适时表现接近随机猜测。通过LoRA微调的DemCare-VLM模型将视频依赖度从-3.3提升至+4.5分。

Insight: 创新点在于构建了一个模态验证的视频基准，通过设计四种视觉条件来精确测量而非假设模型对视频的需求。基准揭示了模型在时序推理和情境理解上的不足，并证明轻量级微调可以有效修复这些缺陷，为护理辅助AI的发展提供了可衡量的改进路径。

Abstract: Dementia affects an estimated 57 million people worldwide, and for most families the hardest part of care is not memory loss but the behavioral and psychological symptoms of dementia (BPSD): agitation, wandering, resistance to care, sundowning. Understanding these symptoms requires more than recognizing the behavior itself; it also requires knowing what happened beforehand. The same behavior may call for a different response depending on its trigger. Video-language models (VLMs) could potentially support caregivers, yet no existing benchmark evaluates this capability. To fill this gap, we present DementiaCare-Bench: 56 professionally produced caregiver training videos segmented into 94 clips across nine BPSD categories, with 2023 questions generated by a multi-agent pipeline that grounds every clinical claim in a verbatim transcript span. Each question is then probed under four visual conditions and labelled by the least it requires, so its visual demand is measured rather than assumed. Measurement contradicts intent: we wrote 77.7% of the questions to require ordered frames, and 34.8% do. Across 12 current VLMs the pattern is uniform. The best reach 85% overall, but that average is carried by questions a language model can answer from clinical knowledge alone; accuracy falls by 17 points on average on questions that require the ordered clip, and a leading open model scores at chance on judging whether a caregiver’s response was appropriate. A lightweight LoRA fine-tune, DemCare-VLM, moves video dependence from -3.3 to +4.5 points, so what the benchmark exposes can be repaired and not only measured.

[63] Label-Guided Knowledge Distillation for 3D-CNNs in Action Recognition cs.CV | cs.AIPDF

Yanjiang Shi, Peng Zhao, Nan Qi, Guiqin Wang

TL;DR: 本文提出了一种用于3D-CNN动作识别的标签引导知识蒸馏方法（LGKD），通过样本级和类别级蒸馏，利用真实标签引导学生模型从教师模型中学习特征表示，以解决现有视频特征蒸馏方法忽视时间维度差异的问题。

Details

Motivation: 现有视频分析中的特征蒸馏方法大多是图像分析方法的简单改编，往往忽略了视频特征在时间维度上的差异，因此需要一种更有效的蒸馏方法来提升学生模型的性能。

Result: 在UCF101和HMDB51两个基准动作识别数据集上进行了全面实验，取得了具有竞争力的结果，证明了方法的有效性和优越性。

Insight: 创新点在于引入真实标签进行引导，并设计了样本级蒸馏（利用标签和教师概率分布指导学习关键时间特征并减少噪声）和类别级蒸馏（通过原型网络捕获同类样本间的关系知识，学习高维语义信息以提升泛化能力）的两级蒸馏机制。

Abstract: As a key model compression technique, knowledge distillation aims to transfer knowledge from a high-capacity teacher model to a lightweight student model for enhancing the latter’s performance. In this work, we reviewed the feature knowledge distillation for 3D-CNNs and observed that most feature distillation methods in video analysis are simple adaptations of those used in image analysis, often neglecting the differences of video features in the temporal dimension. To address this issue, we proposed Label-Guided Knowledge Distillation (LGKD) to guide the distillation of student model features using ground truth labels. Our method entails two components: sample-wise distillation and class-wise distillation, enabling the student model to learn feature representation of the teacher model at two levels. Sample-wise distillation utilizes label information and the teacher’s probability distribution to guide the learning of features that significantly impact temporal accuracy while mitigating noise. Meanwhile, class-wise feature distillation employs a prototype network to further capture the relational knowledge among samples within the same category, enhancing the student’s ability to learn higher-dimensional semantic information and improving model generalization. To demonstrate the effectiveness and superiority of our method, we conducted comprehensive experiments on two benchmark action recognition datasets, UCF101 and HMDB51, achieving competitive results.

[64] Pixel Decodability Is Not a Compression Signal: Causally Evaluating Importance Proxies for Visual KV-Cache Eviction cs.CVPDF

Chenyu Zhou, Qiliang Jiang, Shuning Wu, Xu Zhou

TL;DR: 该论文通过因果评估方法，研究了视觉语言模型中视觉键值缓存（KV-cache）的像素可解码性是否可作为有效的缓存淘汰信号。研究发现，像素可解码性（即缓存内容可被解码器重构为像素的程度）与计算单元对任务答案的因果贡献度是解耦的，不能作为有效的压缩信号来指导缓存淘汰。

Details

Motivation: 动机是探究视觉语言模型的视觉键值缓存中，像素可解码性（即缓存内容保留了多少原始视觉信息）是否可以作为衡量其重要性并指导缓存淘汰（eviction）的有效代理指标，以实现模型推理时的KV缓存压缩。

Result: 在预先注册的因果评估设置下，像素可解码性在超块（super-patch）粒度上对KV淘汰的排序效果不优于随机选择；在令牌（token）粒度上，仅在大缓存预算下获得微弱的反向重要性信号，且在所有预算下都远逊于注意力大小（attention magnitude）这一指标。

Insight: 核心创新点在于通过因果干预（如单超块KV消融）和预先注册的评估设计，严格证明了像素可解码性是一个与任务功能正交的信息维度，不能作为KV缓存压缩的有效信号。这为未来设计缓存淘汰策略提供了关键的负面结果和评估方法论借鉴。

Abstract: Vision-language models retain a substantial amount of pixel-decodable visual content in their visual key-value cache. We show, in our setting, that this retention is task-inert: across our preregistered tests, how much a unit retains never positively tracks whether the computation that answers the question causally relies on it. We measure retention with a learned pixel-inversion decoder and causal use with single-super-patch KV ablation, the teacher-forced drop in gold-answer log-probability, and relate the two within images under a preregistered, sign-calibrated, held-out design. Retention is decoupled from attention and, in a well-powered null, from causal utilization. Utilization is not inert to every proxy: attention weakly but significantly tracks it, the only signal we find that does and the design’s positive control. We characterize pixel-decodable retention as an informational axis of the visual KV cache, orthogonal to the functional one. How much task-inert content a cache holds differs by architecture in our model pair: the encoder-free model retains 2.7 times more than the encoder-based one. The engineering consequence is a controlled negative result. At super-patch granularity, deconfounded pixel-decodable retention ranks KV eviction no better than random; at token granularity it acquires only a weak inverse-importance signal at larger budgets, dominated at every budget by attention magnitude. In our setting, pixel-decodable reconstructability is not a competitive KV-compression signal at any granularity we test.

cs.AR [Back]

[65] Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge cs.AR | cs.CV | cs.DCPDF

Luca Crupi, Lorenzo Lamberti, Alessandro Giusti, Daniele Palossi

TL;DR: 本文提出了一种面向边缘智能视觉系统的自适应AI方法，通过设计一种新颖的多出口计算方案，并将其部署在超低功耗的GWT GAP9 SoC上。该方法在MobileNetV2 CNN中引入多个出口，并采用基于置信度的门控机制，动态自主地决定是否继续或停止推理，从而在ImageNet-100分类任务上实现了计算成本、推理时间和能耗的显著降低。

Details

Motivation: 解决传统TinyML系统在边缘设备上使用固定深度模型导致的资源浪费和实时性能限制问题，特别是在电池供电的物联网设备中，多出口方案因严格的存储和计算约束而很少被采用。

Result: 在GAP9 SoC上，与标准MobileNetV2相比，平均计算成本降低41%（从313 MMAC降至185 MMAC），推理时间减少29%（从49 ms降至35 ms），能耗节省24%（从2.1 mJ降至1.6 mJ每帧），精度损失约1%（全深度模型精度为80.5%）。与部署在GAP9上的第三方SOTA自适应CNN相比，计算效率提升超过2倍（从8.1 MAC/cycle增至17.2 MAC/cycle）。

Insight: 创新点在于为边缘物联网设备设计了轻量级多出口执行方案，结合置信度门控实现动态推理，在严格资源约束下平衡了效率与精度；客观分析认为，该方法将高端设备的多出口策略成功适配到超低功耗边缘芯片，展示了硬件-算法协同优化的潜力。

Abstract: Traditional TinyML systems for edge devices achieve high accuracy by relying on fixed-depth models that require a constant number of multiply-accumulate (MAC) operations regardless of the input complexity. This approach wastes critical resources in battery-powered Internet-of-Things (IoT) devices and limits the real-time performance of edge cyber-physical systems. Multi-exit execution schemes mitigate these issues and are widely used on high-end devices such as GPUs, but are rarely exploited on edge IoT devices because they require substantial rethinking given their strict memory and computational constraints. We address these aspects by designing and deploying, on an ultra-low-power GWT GAP9 System-on-Chip (SoC), a novel multi-exit computational scheme, demonstrating it on a MobileNetV2 convolutional neural network (CNN) for the ImageNet-100 classification task. Our approach introduces multiple exits at different CNN depths, each with a confidence-based gating mechanism that dynamically and autonomously decides whether to continue or stop inference. Comparing our multi-exit strategy to the standard MobileNetV2 on a GAP9 SoC, we show a 41% reduction in the average computational cost (from 313 MMAC to 185 MMAC), a 29% lower inference time (from 49 to 35 ms), and an energy saving of 24% (from 2.1 to 1.6 mJ per frame). All these improvements come with a ~1% loss in accuracy compared to the full-depth MobileNetV2, which achieves 80.5%. Finally, comparing our adaptable multi-exit scheme with a third-party state-of-the-art adaptive CNN, also deployed on the GAP9, we achieve more than 2x its computational efficiency, increasing it from 8.1 to 17.2 MAC/cycle.

cs.AI [Back]

[66] Harness or Model? Isolating the Harness Effect in Agentic Coding with a Contamination-Controlled Private Suite cs.AI | cs.CL | cs.SEPDF

Mohsen Arjmandi

TL;DR: 这篇论文通过一个受控的、未被污染的私有测试套件（包含256个仓库和竞赛任务），研究了在智能体编码系统中，不同工具链（harness）对相同大语言模型性能的影响。核心发现是，在Claude Opus 4.8和GPT-5.5模型上，对比其原生工具链与一个名为deepagents的通用工具链，平均任务解决率没有显著差异，但成本效益有所不同。

Details

Motivation: 业界通常认为，AI供应商提供的原生工具链（包含工具、提示词和控制流）与其自家模型是最优组合，能解决更多任务。本研究旨在量化验证这一假设，隔离并测量工具链本身对智能体编码性能的影响。

Result: 在私有测试套件上，对于Claude Opus 4.8，原生工具链与deepagents的平均解决率分别为48.8%和50.0%，差异不显著（95% CI [-10.0, +7.5]）。对于GPT-5.5，两者分别为55.6%和54.4%，差异同样不显著（CI [-4.4, +6.9]）。然而，在Opus上，任务类型（仓库任务 vs. 竞赛任务）对结果有显著交互效应。从成本角度看，使用deepagents解决每个任务的平均成本是原生工具链的1.2到1.6倍。

Insight: 主要创新点在于设计了一个污染受控的私有基准来严格隔离和评估“工具链效应”，挑战了“原生工具链必然更优”的普遍假设。客观来看，研究揭示了工具链性能可能高度依赖于任务类型，并且成本效益分析是评估智能体系统的重要维度，而不仅仅是解决率。论文还公开了编排器、评分预言机和分析代码，促进了可复现性。

Abstract: An agentic coding system couples a language model to a harness: the tools, prompts and control flow that turn a chat model into an autonomous software engineer. Vendors ship harnesses tuned to their own models, and practitioners assume the vendor-native pairing solves more tasks. We measure that assumption with paired same-model contrasts on a private, contamination-controlled suite of 256 repository and post-cutoff contest tasks. The same 80 tasks ran under claude-agent-sdk and under deepagents on claude-opus-4-8, and under the openai-codex SDK and deepagents on gpt-5.5, with gemini-3.5-flash and deepseek-v3.2 as side cells. 792 of 800 planned runs were graded by an isolated oracle. Neither contrast resolves an average advantage for either harness: -1.25 pp for Opus 4.8 (48.8% vs 50.0%, task-bootstrap 95% CI [-10.0, +7.5]) and +1.25 pp for GPT-5.5 (55.6% vs 54.4%, CI [-4.4, +6.9]). The Opus average combines opposite strata: the native harness trails by 9.0 pp on the 61 repository tasks and leads by 23.7 pp on the 19 contest tasks (label-permutation p = 0.003). The partition was chosen after seeing the data and needs a designed replication. Correctness and completion also separate: 22 of 81 runs cancelled at the wall-clock ceiling had produced a passing patch. Re-priced from raw per-turn usage at frozen list prices, the neutral harness cost 1.3 to 1.6 times as much per solved task on Opus 4.8 and 1.2 times on GPT-5.5. These are observed-usage estimates. On the Anthropic account 58 runs left no usage record, and allocating that spend to either cell would move the Opus ratio between 0.7 and 2.3, so the billed ordering is unresolved. This revision corrects an August 2026 manuscript whose cost figures rested on a usage-semantics defect in our own telemetry (Section 5.1). We release the orchestrator, grading oracle, reanalysis code and derived aggregates. The tasks stay private.

[67] Can LLMs in Draft-Verify-Revise Pipelines Resolve Deictic Ambiguity? cs.AI | cs.CLPDF

Obinna I. Ekekezie

TL;DR: 本文研究了在LLM的草稿-验证-修订（draft-verify-revise）推理流程中，上下文依赖表达（如“previous”）在不同阶段可能被不同模型以不同方式解析，导致指代偏移（deictic shift）的问题。作者通过合成数据集和实验，评估了不同模型和推理配置在解决此类歧义时的性能。

Details

Motivation: 动机是探究在LLM多阶段推理流程中，上下文在不同阶段间传递时，模型对上下文依赖表达（如指示代词）的解析可能不一致，从而产生指代偏移，影响最终输出的正确性。

Result: 在合成数据集上的实验显示，平衡准确率从低于随机水平的0.156到接近完美的0.942不等。GPT-5.2在无额外推理时表现差（0.156），但在高推理努力下提升至0.942；Gemini 3 Pro在所有推理努力水平下均保持在0.94以上，且在低推理努力下以约5%的成本超越了高推理努力下的GPT-5.2。

Insight: 创新点在于系统性地识别并量化了LLM多阶段流程中的指代偏移问题，并评估了不同模型和推理配置的解决能力。客观分析表明，模型在出错时倾向于依赖表面线索而非操作推理，这提示上下文工程师应在流程各阶段明确指代对象以避免歧义。

Abstract: Draft-verify-revise is a common LLM orchestration pattern for scaling inference-time compute. One LLM drafts, a second critiques the draft and provides feedback, and a third uses that feedback to revise the draft into the final output. As context cascades between stages, LLMs at different stages can resolve a context-dependent expression such as “previous” differently. When that happens, the expression undergoes a deictic shift, a change in what it refers to. This phenomenon was studied with a synthetic dataset of 10 base examples, each rendered in three conditions. Holding the shared components constant, the conditions varied whether the draft stage LLM (the assistant) or the verify stage LLM (the grader) resolved the expression correctly, and how much independent reasoning the revise stage LLM (the meta-evaluator) needed to determine which reading was correct. Six models from three providers were tested across 21 reasoning effort configurations using e-values for sequential testing, in a primary experiment and an ablation experiment that removed error classification labels from the grader’s feedback. A separate LLM analyzed the meta-evaluator’s stated rationale for each wrong verdict. Balanced accuracy (the unweighted mean of sensitivity and specificity) ranged from 0.156, below chance, to near-perfect. GPT-5.2 rose from 0.156 without reasoning to 0.942 at its highest reasoning effort level, while Gemini 3 Pro stayed above 0.94 at every level. Gemini 3 Pro at low reasoning effort outscored GPT-5.2 at xhigh reasoning effort for roughly 5% of the cost per trial. When the meta-evaluator erred, it tended to rely on surface cues rather than operational reasoning. Context engineers implementing draft-verify-revise pipelines should be wary of deictic shifts and make the intended referent explicit at each stage.

[68] SteerDuplex: Steerable Duplex Speech Dialogue Models cs.AI | cs.CLPDF

Utkarsh Tyagi, Ramaneswaran Selvakumar, Advait Gosai, Sonal Kumar, Nikhil Barhate

TL;DR: 本文提出了SteerDuplex，一个基于Moshi的全双工语音对话模型，旨在解决现有模型在可引导性方面的不足。通过监督微调和两阶段强化学习，模型在语音引导、交互时机和响应连续性方面得到显著提升。同时，作者还引入了SteerBench基准测试来系统评估全双工语音对话的可引导性。

Details

Motivation: 现有全双工语音对话模型在低延迟、打断处理和反馈方面已有进展，但在可引导性方面存在明显不足，即无法可靠地根据用户指令调整对话行为（如语气、角色、语速和语音风格）。

Result: 在作者提出的SteerBench基准测试上，监督训练将音频引导的平均通过率比最强的开源基线提高了44.5个百分点。在Audio MultiChallenge任务上，平均通过率比最强基线提高了7个百分点。强化学习进一步将干净源打断响应率从72.5%提升至82.5%，并将合成暂停打断率从26.5%降低至9%。

Insight: 论文的创新点在于提出了一个针对全双工语音对话可引导性的分类法，并构建了SteerDuplex模型和SteerBench基准。其采用的两阶段强化学习结合了可验证的交互检查和基于评判的语义反馈，有效优化了交互时机和响应连续性，但奖励分析也揭示了可能通过不完整响应进行奖励黑客攻击的风险，强调了评估时机增益时必须同时考虑响应完整性。

Abstract: Full-duplex spoken dialogue models support low-latency turn taking, interruption handling, and backchanneling, yet a key capability remains underexplored: steerability, the ability to reliably shift conversational behavior along attributes such as tone, persona, speaking rate, and voice style in response to user instructions. We introduce a taxonomy of text- and audio-based steerability that identifies substantial gaps in current full-duplex models. To address this gap, we introduce SteerDuplex, a Moshi-based full-duplex speech model fine-tuned on natural conversations and synthetic dialogues targeting instruction following, vocal delivery, reasoning, and duplex interaction. We further apply two-stage reinforcement learning (RL) with hybrid rewards, combining verifiable interaction checks and judge-based semantic feedback to improve timing and response continuity. To evaluate full-duplex spoken steerability, we introduce SteerBench, a benchmark with 390 spoken prompts and 1,067 human-authored binary audio and text rubrics spanning tone, persona, style/accent, and speed/length. On SteerBench, supervised training improves audio-steering average pass rate by 44.5 percentage points over the strongest evaluated open baseline. On Audio MultiChallenge, task average pass rate improves by 7 points over its strongest evaluated open baseline. RL further raises source-clean interruption response from 72.5% to 82.5% and reduces synthetic pause barge-in from 26.5% to 9%. Steering and aggregate task scores remain comparable or higher, while reward probes reveal reward hacking through incomplete responses. Our model and benchmark support systematic research on spoken steerability, with reward analysis showing why timing gains must be evaluated alongside response completeness.

cs.SD [Back]

[69] Unlabeled Echoes: Pseudo-Labels and Genus-Aware Smoothing for Bat Call Recognition cs.SD | cs.CV | q-bio.QMPDF

Frank Fundel, Alexandra Howard

TL;DR: 该论文提出了一种利用模型生成的伪标签进行半监督学习的方法，用于解决蝙蝠叫声识别中标注数据稀缺的问题。通过在欧洲18个物种的数据集上验证，伪标签方法仅使用10%的标注数据就能显著提升性能，并成功迁移到包含9个蝙蝠类群的南非野外音频数据。此外，论文还引入了基于属感知的平滑技术，进一步提升了模型性能。

Details

Motivation: 被动声学监测产生了大量蝙蝠录音，但专家标注成本高昂，导致大量未标注数据无法有效利用。论文旨在探索如何利用这些未标注数据，通过半监督学习提升蝙蝠物种识别的准确性。

Result: 在欧洲数据集上，伪标签方法仅使用10%的标注数据，就恢复了全监督方法性能差距的61.5%，优于其他半监督学习方法。迁移到南非野外音频数据后，物种准确率提升了10.69个百分点，物种宏观F1分数提升了4.96个百分点。结合属感知平滑和均匀平滑，物种宏观F1分数达到79.16，比硬标签高出4.73个百分点。

Insight: 论文的创新点在于证明了简单的模型生成伪标签在生态数据规模下非常有效，能够将大量未标注数据转化为有效的监督信号。同时，提出的属感知平滑技术，通过将不确定的预测概率向同属物种引导，在不增加标注成本的情况下注入了有用的生物学结构，提升了模型的鲁棒性和准确性。

Abstract: Passive acoustic monitoring produces far more bat recordings than experts can label. We show that simple model-generated pseudo-labels turn this surplus into effective supervision. We compare pseudo-labeling with other semi-supervised learning methods on an 18-species European corpus using only 10% of its training labels, then transfer the strongest approaches to South African field audio containing nine bat taxa and a nuisance class. Pseudo-labeling outperforms the other semi-supervised learning methods on every European measure, recovering up to 61.5% of the gap to full supervision. It transfers to field audio with gains of 10.69 points in species accuracy and 4.96 points in species macro-F1. We also introduce genus-aware smoothing, which directs uncertain target mass toward congeneric species. Combined with uniform smoothing, it reaches 79.16 species macro-F1, 4.73 points above hard targets. Simple pseudo-labels are therefore highly effective at this ecological data scale, while genus-aware targets inject useful biological structure at no annotation cost. https://code4conservation.github.io/UnlabeledEchoes/

[70] What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability cs.SD | cs.CV | cs.LGPDF

Lucia Cascone, Valeria Fraenza, Michele Nappi, Fabio Narducci, Benedetto Simone

TL;DR: 本文提出了STAG框架，用于对基于音频的多模态大语言模型（MLLM）生成的描述进行词元级别的时频谱定位，以解释模型决策。该框架通过估计每个生成词元的时间支持、测量频带相关性，并结合成时频谱相关性图，从而揭示输入音频中支持每个输出词元的证据。

Details

Motivation: 基于音频的MLLM能够生成复杂声学场景的详细自然语言描述，但尚不清楚输入音频的哪些部分支持每个生成的词元，这尤其具有挑战性，因为声学证据分布在时间和频率上，且并发声音事件可能在时间上重叠但占据不同的频谱区域。

Result: 在四个定位基准测试中，STAG与十种事后解释方法相比，在每个数据集上都取得了最佳的事件定位性能，并且无需参数更新即可应用于八个音频-语言骨干模型。反事实删除实验进一步表明，移除识别出的证据会选择性降低对相应事件的置信度，并经常将其从重新生成的描述中移除。

Insight: 创新点在于首次提出了针对音频MLLM的事后词元级别时频谱定位框架，通过结合时间支持和频带相关性来生成解释，为模型的可解释性提供了行为支持，证明了其忠实性和选择性。

Abstract: Audio-based Multimodal Large Language Models (MLLMs) can generate detailed natural-language descriptions of complex acoustic scenes, yet it remains unclear which parts of the input audio support each generated token. This is particularly challenging because acoustic evidence is distributed across time and frequency, and concurrent sound events may overlap temporally while occupying different spectral regions. We introduce STAG, to our knowledge the first post-hoc framework for token-level spectro-temporal grounding of captions generated by audio-based MLLMs. STAG estimates the temporal support for each generated token using target-token-specific vocabulary projections of the encoded audio representations, measures frequency-band relevance through controlled spectral occlusion, and combines the two signals into a spectro-temporal relevance map. We evaluate STAG against ten post-hoc explanation methods across four grounding benchmarks, where it achieves the best event-localization performance on every dataset, and apply it to eight audio-language backbones without parameter updates. Counterfactual deletion further shows that removing the identified evidence selectively reduces confidence in the corresponding event and frequently removes it from the regenerated caption. These results provide behavioral support for the faithfulness and selectivity of the explanations.

cs.RO [Back]

[71] MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment cs.RO | cs.CVPDF

Guangyu Chen, Qiwei Liang, Shaolong Zhu, Tianxing Chen, Zikuan Xiao

TL;DR: MoPA是一个用于移动操作任务的框架，通过子系统特定的感知对齐来协调基座运动和手臂控制。它采用双感知流从共享的视觉-语言上下文中提取独立的感知表示，并通过感知到动作的适配在结构化混合Transformer解码器中联合更新查询库和对应的动作流，同时学习耦合的条件流匹配来协调生成动作块。

Details

Motivation: 现有策略通常为不同子系统采用专门的动作生成，但将异构动作分支建立在共享的感知表示上，这使得子系统特定的感知-动作对应关系是隐式的。MoPA旨在明确地对齐移动性和操作性的感知条件，同时在动作层面保持协调。

Result: 在ManiSkill-HAB基准测试中，MoPA在所有三个任务套件上都达到了最先进的性能。在四个真实世界任务中，MoPA实现了76.3%的平均全任务成功率，比最佳基线高出12.5个百分点。

Insight: 核心创新在于通过双感知流和感知到动作的适配，显式地对齐了不同子系统的感知与动作，同时通过耦合的条件流匹配确保动作的协调生成。这为处理移动操作中多尺度感知和耦合动作模态的问题提供了新的结构化方法。

Abstract: Mobile manipulation requires perceptual evidence at different spatial scales for base motion and arm control, while the two action modalities remain kinematically coupled. Existing policies often employ specialized action generation for different subsystems but condition heterogeneous action branches on a shared perceptual representation, leaving subsystem-specific perception-action correspondence implicit. We present MoPA, a framework that aligns perceptual conditioning with mobility and manipulation while preserving coordination at the action level. Dual Perceptual Streams employ two mutually masked query banks to extract separate perceptual representations from a shared vision-language context. Perception2Action Adaptation jointly updates each query bank and its corresponding action stream at every layer of a structured Mixture-of-Transformers decoder, while enabling information exchange between the two action streams. Coupled conditional flow matching learns a joint vector field for coordinated generation of both action chunks. On the ManiSkill-HAB benchmark, MoPA achieves state-of-the-art performance across all three task suites. Across four real-world tasks, MoPA achieves a mean full-task success rate of 76.3%, outperforming the best baseline by 12.5 percentage points. Ablation studies and further analyses validate the effectiveness of the proposed design. Website is available at: https://mopa-policy.github.io/.

Long Giang Vu, Chengkai Yao, Yuxin Liu, FNU Aryan, Rajath Chandrashekar Aralikatti

TL;DR: 本文提出了AnchorVLN，一个用于开放词汇视觉语言导航（VLN）的系统，其核心原则是‘视觉语言模型（VLM）负责语义提议，几何模块负责度量决策’。该系统实现为EMBODIED-NAV-MCP，一个由VLM代理通过一组可调用工具驱动的模型上下文协议（MCP）服务器。在CMU VLN挑战赛2026的两个任务上进行了评估，结果表明该系统在指令跟随任务上达到64.4%的准确率，并且在物体参照任务中，几何锚定显著降低了定位误差。

Details

Motivation: 解决开放词汇视觉语言导航中，现有基于视觉语言模型（VLM）的方法难以直接输出可靠度量信息（如距离、方位）的问题，同时避免为不同机器人、任务或词汇修改控制栈的复杂工程。

Result: 在CMU VLN挑战赛2026的两个任务上评估：指令跟随任务（15个场景，30个问题）达到64.4%准确率；物体参照任务（45个问题）中，几何锚定方法在10个问题上超过了挑战赛的重叠阈值，而直接坐标估计方法为0个，并将中位中心误差从3.37米降低到2.48米。

Insight: 创新性地提出了‘语义-几何分离’的设计原则，通过工具调用接口强制分离VLM的语义推理与下游自主系统的几何决策，实现了无需修改控制栈的开放词汇导航。该方法将几何锚定作为提升空间关系推理精度的关键模块。

Abstract: Vision-Language Navigation (VLN) in unseen indoor environments is useful in real-world robotics, where an agent must follow natural-language instructions, locate objects, and answer spatial questions without a pre-built map or fixed object vocabulary. Multimodal vision-language models (VLMs) provide strong open-vocabulary grounding and zero-shot reasoning, but struggle to emit reliable metric quantities such as range, bearing, and comparative spatial relations directly from images. Existing approaches address this by folding geometry into hand-engineered pipelines or asking models to output waypoints, requiring changes to the control stack for different robots, tasks, or vocabularies. We introduce AnchorVLN, an open-vocabulary VLN system built on a simple rule: the VLM proposes semantics; geometry decides metrics. It is realised as EMBODIED-NAV-MCP, a Model Context Protocol (MCP) server driven by a VLM agent through a compact set of callable tools. Since no tool accepts distance in metres or bearing in radians, the schema enforces the semantic-geometry boundary without modifying the downstream autonomy stack. We benchmark both tasks of the CMU Vision-Language Navigation Challenge 2026: 30 instruction-following questions over 15 scenes and a frozen 45-question object-reference set. The full system achieves 64.4 percent on instruction following, dropping by 13.3 percentage points without controller modeling (t = 2.77). On object reference, geometric anchoring clears the challenge overlap threshold on 10 of 45 questions, versus 0 of 45 for direct coordinate estimation, reducing median center error from 3.37 m to 2.48 m.

cs.LG [Back]

[73] Physics-Guided Synthetic High-Frequency Ultrasound Generation for Skin Layer Segmentation cs.LG | cs.CVPDF

Junkyung ju, Kyungho Yoon, Minwoo Shin

TL;DR: 本文提出了一种物理引导的合成高频超声图像生成框架，用于解决皮肤层分割任务中标注数据稀缺的问题。该框架通过构建多层声学皮肤模型，并利用k-Wave模拟生成成对的合成超声图像、密集层掩码和模拟元数据。实验表明，使用合成数据进行预训练，再在真实数据上微调，可以达到与仅使用真实数据训练相当的性能，并在多数架构中提升了分割指标。

Details

Motivation: 高频超声可实现皮肤浅表结构的无创可视化，但自动皮肤层分析受限于密集标注数据的稀缺。现有真实数据集通常只标注表皮和皮下低回声带等浅层目标，而对真皮、皮下组织、筋膜和肌肉等深层结构的密集标注很少。

Result: 在真实Mendeley HFUS数据上微调后，合成预训练模型取得了与仅用真实数据训练相当的性能，并在四种可训练架构中的三种上提升了平均Dice/IoU指标。

Insight: 创新点在于提出了一个物理引导的合成数据生成框架，用于生成具有可迁移解剖和纹理信息的合成超声图像，以辅助真实数据的皮肤层分割任务。客观来看，该方法为解决医学图像分析中标注数据不足问题提供了一种基于物理模拟的数据增强新思路，但合成与真实图像的表观差距仍需进一步缩小以获得更大收益。

Abstract: High-frequency ultrasound (HFUS) enables noninvasive visualization of superficial skin structures, but automated skin-layer analysis is limited by the scarcity of densely annotated data. Existing real HFUS datasets commonly provide annotations for superficial targets such as the epidermis and subepidermal low-echogenic band (SLEB), while dense labels for deeper structures such as dermis, subcutaneous tissue, fascia, and muscle are rarely available. We propose a physics-guided synthetic HFUS generation framework for skin layer segmentation. The framework constructs multilayer acoustic skin phantoms, assigns layer dependent acoustic properties, and uses k-Wave simulation to generate paired synthetic HFUS images, dense layer masks, and simulation metadata. To evaluate whether the generated data provide transferable supervision, we use it for downstream segmentation pretraining and fine-tune the models on real Mendeley HFUS data. Synthetic pretraining followed by real fine-tuning achieved real-domain performance comparable to real-only training and improved mean Dice/IoU in three of four evaluated trainable architectures. These results suggest that physics-guided synthetic HFUS images contain transferable anatomical and textural cues for real-domain skin layer segmentation, although further reduction of the synthetic-real appearance gap is needed to enable greater gains. The code and data are available at: https://github.com/Finn-02/synthetic-hfus-skin-layer-segmentation.

Table of Contents

cs.CL [Back]

[1] Extracting Dataset Mentions in Forced Displacement and FCV Documents: A Weakly Supervised Framework with LLM-Based Label Refinement cs.CL | cs.AI | cs.IR | econ.EMPDF

[2] R2VC: Modular Fact-Checking with Retrieval, Verification, and Confidence Calibration cs.CL | cs.LGPDF

[3] Chopthin-Consensus Power Sampling: A Diversity-Preserving Approach to LLM Decoding cs.CL | cs.AI | stat.MLPDF

[4] Repair Before Reinforce: Context-Augmented Knowledge Graph Reasoning for Multi-Hop Question Answering cs.CL | cs.AIPDF

[5] HypoKG: Evidence-Disciplined Biomedical Hypothesis Generation Beyond Endpoint Knowledge cs.CL | cs.AI | q-bio.QMPDF

[6] AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization cs.CLPDF

[7] Zipbench: Low-Cost Framework for Compressing Comprehensive Benchmarks of Large Language Models cs.CLPDF

[8] Agent as Policy for Robotic Manipulation cs.CLPDF

[9] Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picture cs.CL | cs.AI | cs.HCPDF

[10] Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy cs.CL | cs.AI | cs.IRPDF

[11] LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification cs.CL | cs.AIPDF

[12] Parameter-Efficient Retrievers for Polish and European Languages cs.CLPDF

[13] Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage cs.CL | cs.LGPDF

[14] Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models cs.CL | cs.AIPDF

[15] Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents cs.CL | cs.SDPDF

[16] Expert-Space Exploration in MoE Reinforcement Learning cs.CLPDF

[17] SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking cs.CLPDF

cs.CV [Back]

[18] Does Video Memory Use What It Retrieves? A Causal Audit of Memory Specificity cs.CVPDF

[19] Feature Recovery for Object Understanding After Irreversible Fire Damage cs.CVPDF

[20] Single-Query Person-Centric Bimanual Hand-Object Interaction Detection cs.CVPDF

[21] When Ground-Truth Fidelity Matters: An Orchestrated UAS Framework for Wheat Streak Mosaic Virus Detection Using Vision Transformers and Machine Learning cs.CVPDF

[22] Physics as the label for measuring and correcting materials reasoning in multimodal models cs.CV | cond-mat.mtrl-sciPDF

[23] QuPAINT: Physics-Aware Multimodal Reasoning for Quantum Material Characterization cs.CV | cs.AI | cs.LGPDF

[24] VS-Splat: Voxel-Selective feed-forward Gaussian Splatting for end-to-end 3D object reconstruction from sparse-views cs.CVPDF

[25] UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation cs.CV | cs.AIPDF

[26] EgoMaize: A First-Person Maize Instance Segmentation Benchmark under Severe Field Occlusion cs.CVPDF

[27] Context-Aware Causal Gaze Forecasting for Human-Vehicle Interaction During In-Cabin Tracking Dropouts cs.CV | cs.HCPDF

[28] DERA: Detached Edge-Residual Adaptation for Prohibited item Detection cs.CVPDF

[29] GSO-Net: Visual State Machines for Hazardous Freight Transfer Compliance at Petrochemical Logistics Nodes cs.CVPDF

[30] A Multimodal Explainable Deep Learning Framework for Alzheimer’s Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data cs.CV | stat.MLPDF

[31] Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images cs.CV | cs.AI | cs.LGPDF

[32] PhysioAI: Clinical Knowledge-Guided Semantic Supervision for Skeleton-Based Physiotherapy Action Recognition cs.CVPDF

[33] RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images cs.CVPDF

[34] One Skill Does Not Fit All: Automatic Discovery and Taxonomy-Guided Routing of Frame-Selection Skills for Long-Video Question Answering cs.CVPDF

[35] LettuceVisSim: A Simulator That Generates Lettuce Image Time-series for Vision-Based Reinforcement Learning cs.CV | cs.AI | eess.SY | math.OCPDF

[36] ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning cs.CVPDF

[37] RelateAnything: Real-Time Open-Vocabulary Relation Prediction From Any Inputs cs.CVPDF

[38] DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers cs.CV | cs.ROPDF

[39] SCORE: SubDistribution-aware Collaborative Knowledge Reinforcing for Cloth-Hybrid Lifelong Person Re-Identification cs.CVPDF

[40] Beyond Ambiguous Visual Cues: Studying Physiological Disruptions and Cross-Modal Inconsistencies in Deepfake Videos cs.CVPDF

[41] Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence cs.CV | cs.MMPDF

[42] NOVA-GS: Noise-Aware View-Consistent Gaussian Splatting for Low-Light Novel View Synthesis cs.CVPDF

[43] Semantically Aligned Gradient-Driven Context-Preserving Image Editing cs.CVPDF

[44] Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations cs.CVPDF

[45] GRACE: Adaptive Concept Erasure with Geometry-Guided Retention in Diffusion Models cs.CVPDF

[46] ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts cs.CV | cs.LGPDF

[47] AquaCubeAI-Powered Monitoring Turbidity on-board Φsat-2 cs.CVPDF

[48] Same Encoder, Different Winner: A Paired-View Framework for Cell Painting Encoder Evaluation cs.CV | cs.LG | q-bio.QMPDF

[49] LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection cs.CVPDF

[50] SCDM: Spatial-Contextual Disentanglement Mamba via Differential Inference for Efficient Image Classification cs.CVPDF

[51] CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs cs.CVPDF

[52] Online Video Agent Harness for Long Video Understanding cs.CV | cs.AIPDF

[53] A Dual Cross-Attention Framework for Colposcopic CIN Grading and Swede Score Prediction Using a New Multi-Center Dataset cs.CVPDF

[54] Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring cs.CVPDF

[55] Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce cs.CVPDF

[56] HemaHier: Chain-Conditioned Ordinal Hierarchies for Lineage-Aware Bone-Marrow Cytology cs.CVPDF

[57] MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling cs.CVPDF

[58] Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery cs.CVPDF

[59] VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation cs.CVPDF

[60] UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction cs.CV | cs.AI | cs.ROPDF

[61] Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization cs.CVPDF

[62] DementiaCare-Bench: A Modality-Validated Video Benchmark cs.CV | cs.MAPDF

[63] Label-Guided Knowledge Distillation for 3D-CNNs in Action Recognition cs.CV | cs.AIPDF

[64] Pixel Decodability Is Not a Compression Signal: Causally Evaluating Importance Proxies for Visual KV-Cache Eviction cs.CVPDF

cs.AR [Back]

[65] Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge cs.AR | cs.CV | cs.DCPDF

cs.AI [Back]

[66] Harness or Model? Isolating the Harness Effect in Agentic Coding with a Contamination-Controlled Private Suite cs.AI | cs.CL | cs.SEPDF

[67] Can LLMs in Draft-Verify-Revise Pipelines Resolve Deictic Ambiguity? cs.AI | cs.CLPDF

[68] SteerDuplex: Steerable Duplex Speech Dialogue Models cs.AI | cs.CLPDF

cs.SD [Back]

[69] Unlabeled Echoes: Pseudo-Labels and Genus-Aware Smoothing for Bat Call Recognition cs.SD | cs.CV | q-bio.QMPDF

[70] What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability cs.SD | cs.CV | cs.LGPDF

cs.RO [Back]

[71] MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment cs.RO | cs.CVPDF

[72] AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation cs.RO | cs.CVPDF

cs.LG [Back]