cs.CL [Total: 19]
cs.CV [Total: 58]
cs.SE [Total: 3]
q-bio.NC [Total: 1]
cs.MA [Total: 1]
cs.RO [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 2]
cs.CR [Total: 1]
q-bio.QM [Total: 1]
cs.AI [Total: 5]

cs.CL [Back]

[1] Taming Visual Neglect: A Variational Information Bottleneck Framework for Adaptive Attention in Multimodal In-Context Learning cs.CLPDF

Kaito Tanaka, Yuji Nishimura, Keisuke Matsuda, Aya Nakayama

TL;DR: 本文提出VIB-ICL框架，通过信息瓶颈原理解决多模态上下文学习中视觉信息利用不稳定的问题。该框架引入跨模态信息增益量化视觉信息的额外价值，并推导出理论边界证明视觉信息非冗余时多模态学习优于纯文本学习。基于此，作者提出注意力重分配原则并实现为VIB-ICL算法，动态调整视觉注意力权重。

Details

Motivation: 大型视觉语言模型虽具备上下文学习能力，但视觉上下文何时及为何能提升多模态学习效果尚不明确，且模型存在时而有效利用、时而完全忽略视觉信息的矛盾现象。

Result: 在五个基准测试中，VIB-ICL算法实现了最高4.7%的准确率提升，并将所需演示样本减少35%，验证了理论预测的有效性。

Insight: 创新点在于将视觉信息忽略现象重新解释为信息冗余下的信息瓶颈最优解，并推导出可量化的跨模态信息增益与封闭形式的注意力重分配原则，为多模态学习提供了可动态调整的理论指导框架。

Abstract: Large vision-language models exhibit strong in-context learning (ICL) capabilities, yet when and why visual context helps multimodal ICL remains poorly understood. Empirical studies show a puzzling dichotomy: models sometimes effectively leverage visual demonstrations, yet often neglect them entirely. We propose VIB-ICL, an information-theoretic framework that resolves this dichotomy through the Information Bottleneck principle. We introduce the Cross-Modal Information Gain (CMIG), which quantifies the additional mutual information that visual context provides about the target beyond textual context. We derive a generalization bound showing that multimodal ICL’s excess risk over text-only ICL is governed by the CMIG, proving that multimodal ICL provably outperforms text-only ICL when visual information is non-redundant. We further prove that visual context neglect, often viewed as a failure mode, is the Information Bottleneck-optimal solution when visual information is redundant, yielding a closed-form Attention Reallocation Principle that prescribes how visual attention weights should be adaptively adjusted. We instantiate this principle in the VIB-ICL algorithm, which estimates CMIG via variational bounds and dynamically reallocates attention. Experiments on five benchmarks demonstrate consistent improvements of up to 4.7% accuracy gains and 35% reduction in required demonstrations, validating our theoretical predictions.

[2] From Triage to Discharge: A Survey of NLP Tasks, Methods, and Open Challenges in the Emergency Department cs.CLPDF

Dipankar Srirag, Aditya Joshi, Salil Kanhere, Padmanesan Narasimhan

TL;DR: 这篇论文是关于自然语言处理（NLP）在急诊科（ED）应用的综合调查，覆盖了从分诊到出院的三个阶段：分诊、诊断和处置。它分析了46篇论文，探讨了分诊分类、临床总结、自动诊断、报告生成和出院文档等任务，并总结了建模范式、评估实践以及新兴基准和共享任务。

Details

Motivation: 急诊科在时间压力下运作，产生多模态数据，如临床对话、分诊记录和出院文档。尽管NLP（特别是预训练Transformer和大型语言模型）的进展为支持急诊护理的语言和时间密集型阶段提供了新机会，但现有调查要么映射更广泛的医院工作流程，要么专注于特定任务，缺乏对急诊科NLP的全面分析。

Result: 调查识别了跨任务的共同趋势，包括从任务特定神经架构向预训练语言模型的转变、对交互式临床系统日益增长的兴趣，以及对临床接地评估的更多关注。它还详细介绍了新兴基准和共享任务，但未提供具体定量结果或SOTA比较。

Insight: 创新点在于首次系统性地将NLP任务映射到急诊科完整工作流程（分诊、诊断、处置），并识别了领域特定挑战，如有限泛化性、嘈杂临床输入和工作流约束，为未来ED-NLP研究提供了方向。从客观角度看，该调查整合了多任务视角，强调了临床实际应用和评估的重要性，对推动医疗AI落地具有借鉴意义。

Abstract: Emergency departments (EDs) operate under time pressure, generating multimodal data such as clinical conversations, triage notes, and discharge documents. Recent advances in natural language processing (NLP), particularly pretrained transformers and large language models, have created new opportunities to support language and time-intensive stages of emergency care. Yet existing surveys map clinical NLP across the broader hospital workflow or focus on specific tasks. This survey analyses 46 papers spanning the three phases of ED: triage, diagnosis, and disposition, covering tasks such as triage classification, clinical summarisation, automatic diagnosis, report generation, and discharge documentation. We examine modelling paradigms, evaluation practices, and emerging benchmarks and shared tasks. Across tasks, we identify common trends, including a shift from task-specific neural architectures to pretrained language models, growing interest in interactive clinical systems, and increasing attention to clinically grounded evaluation. Finally, we detail open challenges such as limited generalisability, noisy clinical inputs, and workflow constraints that inform future ED-NLP research.

[3] ADE: Agentic Data Evolution Framework for Human-Centered Objectives cs.CLPDF

Yang Yu, Yilin Jiang, Zexuan Fei, Yiming Luo, Xingkai Song

TL;DR: 本文提出了一种名为Agentic Data Evolution（ADE）的数据中心化框架，旨在解决大语言模型在面向人类中心目标对齐时，因目标不可执行和上下文依赖而难以可靠验证和扩展监督的问题。该框架通过将合成监督组织为演化数据快照，并采用观察-变异-选择（OVS）闭环流程与稳态准入机制，保守地筛选更新以确保持续跨轮次改进。

Details

Motivation: 当对齐目标不可执行且依赖上下文时，大语言模型的人类中心目标对齐面临验证不可靠和监督难以扩展的挑战；现有合成数据方法虽能扩大覆盖范围，但弱验证将瓶颈从生成转移至选择，噪声信号会破坏迭代优化并可能导致隐性退化。

Result: 在DEV300基准上，ADE将内在胜率从50%提升至75.81%，外在胜率从55.20%提升至68.86；盲测专家评估显示，66.11%偏好演化后的答案，这些性能增益在不同后训练方法、模型规模和超越目标弱可验证教育任务的其他基准上均保持一致。

Insight: 创新点在于将合成监督组织为演化数据快照，并引入观察-变异-选择（OVS）闭环流程与稳态准入机制作为质量棘轮，保守地控制更新以确保持续改进；从客观角度看，该框架提供了一种系统化的数据演化方法，通过内在趋势跟踪和外在后训练评估的互补验证，增强了弱可验证目标下的对齐鲁棒性和可扩展性。

Abstract: Aligning large language models to human-centered objectives is difficult when targets are non-executable and context-dependent, limiting reliable verification and scalable supervision. Although synthetic data expands coverage, weak verification shifts the bottleneck from generation to selection. Noisy signals destabilize iterative refinement and can cause silent regressions. We propose Agentic Data Evolution (ADE), a data-centric framework that organizes synthetic supervision as evolving data snapshots. ADE improves data snapshots through a closed-loop Observation-Variation-Selection (OVS) procedure, where a steady-state admission mechanism acts as a quality ratchet that conservatively gates updates for sustained cross-round improvement. We validate these improvements through complementary intrinsic trend tracking and extrinsic post-training evaluation. On DEV300, ADE raises the intrinsic win rate from 50% to 75.81% and the extrinsic win rate from 55.20% to 68.86%, consistent performance gains across diverse benchmarks. Blind expert evaluation further confirms this, with a 66.11% preference for evolved answers. These gains extend across post-training methods, model scales, and tasks beyond the target weakly verifiable educational objectives. Resources are available at https://github.com/ZeroLoss-Lab/Agentic-Data-Evolution.

[4] From Preferences to Principles: Rubric-Based Alignment for Grounded Knowledge Answers cs.CLPDF

Aman Saini, Priyanshu Kumar, Eric Peng, Kai Yuan, Harsh Girase

TL;DR: 本文提出了一种基于评分标准的奖励框架，用于开放域问答任务。该方法通过检索证据生成查询特定的评分标准，并将其分解为多个质量维度，从而在训练后提供细粒度的监督。

Details

Motivation: 开放域问答中，高质量的回答需要同时满足多个难以用单一标量目标捕捉的质量方面，因此设计有效的奖励信号具有挑战性。

Result: 在三个评估轴（构成、事实依据和指令遵循）上平均，该方法比指令调优基线提高了6.5%，比扁平评分标准变体提高了4%，在所有评估数据集上均取得一致提升。

Insight: 基于检索证据的评分标准提高了事实支持性，而将评分标准分解为特定质量维度进一步改善了连贯性、组织性和对查询要求的遵循，表明基于证据的多维评分标准能为复杂开放域问答提供更有效的奖励监督。

Abstract: Designing effective reward signals for open-domain question answering is challenging because high-quality responses must simultaneously satisfy multiple aspects of answer quality that are difficult to capture with a holistic scalar objective. We introduce a rubric-based reward framework that generates query-specific rubrics grounded in retrieved evidence and decomposed into multiple quality dimensions, providing fine-grained supervision during post-training. Averaged across three evaluation axes (composition, grounding, and instruction-following), our approach improves over the instruction-tuned baseline by 6.5% and over flat rubric variants by 4%, with consistent gains across all evaluation datasets. Conditioning rubrics on retrieved evidence improves factual support, while decomposing rubrics into quality-specific dimensions further improves coherence, organization, and adherence to query requirements. Our results show that grounded, multi-dimensional rubrics provide more effective reward supervision for complex open-domain question answering.

[5] SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding cs.CL | cs.AIPDF

Yuchuan Wu, Xuan Luo, Yinglian Zhu, Meng Fang, Xiangyang Xue

TL;DR: 本文提出SAGE框架，将中国古代文档理解任务从直接回答转变为基于证据的推理过程。该框架采用多智能体协作机制，通过任务规划、证据获取、声明验证和受限重规划等步骤，实现有界证据搜索和答案修正。在AncientDoc基准测试中，SAGE在多个LVLM骨干模型上均优于直接回答基线，且较小模型的表现超越了大尺寸单体LVLM。

Details

Motivation: 针对当前大视觉语言模型在处理中国古代文档时存在的单次生成模式不透明、回答过度自信且缺乏证据支撑的问题，旨在通过结构化推理框架提升模型的可解释性和答案可靠性。

Result: 在AncientDoc基准测试中，SAGE在三种LVLM骨干模型上均持续优于匹配的直接回答基线；使用Qwen3.5-9B的SAGE在多数评估指标上超越了更大规模的单体LVLM，证明了结构化证据推理相比单纯模型缩放的重要性。

Insight: 创新点在于将文档理解重构为基于证据的推理任务，并设计多智能体协作框架实现有界证据搜索和答案修正；客观来看，其受限共享状态运行时和工具介导的证据获取机制为复杂跨模态推理任务提供了可解释且可靠的解决方案。

Abstract: Chinese ancient document understanding demands complex visual, linguistic, and historical reasoning. Current Large Vision-Language Models (LVLMs) typically rely on an opaque, single-pass generation paradigm, often producing overconfident and weakly grounded responses. To address this, we propose SAGE, an evidence-grounded multi-agent framework that reformulates Chinese ancient document understanding as evidence-grounded inference rather than direct answer generation. SAGE coordinates specialized agents for task-aware planning, tool-mediated evidence acquisition, claim-level verification, and bounded replanning under a constrained shared-state runtime. This design supports bounded evidence seeking, answer revision, and abstention when grounding is insufficient. Experiments on the AncientDoc benchmark show that SAGE consistently outperforms matched direct-answering baselines across three LVLM backbones. Remarkably, SAGE with Qwen3.5-9B surpasses much larger monolithic LVLMs on most evaluated metrics, highlighting the importance of structured, evidence-grounded inference beyond model scaling.

[6] Curved Inference II: Sleeper Agent Geometry - Extending Interpretability Beyond Probes cs.CLPDF

Rob Manson

TL;DR: 本文扩展了Anthropic的Sleeper Agents研究，提出了一种无需人工后门或线性探针的自然主义方法，通过分析推理过程中的几何结构（曲率、显著性和语义表面积）来检测模型中的欺骗性行为。研究表明，即使线性方法失效，复杂的推理过程也会产生固有的几何模式，为无监督检测提供了新途径。

Details

Motivation: 现有基于线性探针的后门检测方法依赖于线性可分性，这可能是人工插入后门导致的假象，而非自然训练中产生的复杂欺骗行为的真实属性。因此，需要一种更自然的方法来模拟和检测真实场景中的欺骗性推理。

Result: 在五种提示策略和两个模型系列中，几何结构（如语义表面积）能可靠预测语义分类，且存在统计显著差异。某些策略的检测结果从非显著（p=0.555）提升到显著（p=0.048），表明几何特征可揭示被分类噪声掩盖的签名。

Insight: 创新点在于引入了语义表面积（A’）这一新指标，在未归一化的残差空间中捕捉意义构建的幅度和方向变化，从而无需后门、标签或探针即可检测欺骗。研究证明推理本身的形状编码了语义模式，即使模型已学会抑制线性欺骗指标，这为线性方法失效时的可扩展无监督检测提供了路径。

Abstract: This paper extends Anthropic’s Sleeper Agents research [1], which showed artificial backdoors persist through safety training & can be detected by linear probes with >99% accuracy [2]. However, probe-based detection relies on linear separability that may be an artefact of backdoor insertion rather than a property of naturally occurring deceptive alignment. Sophisticated deceptive behaviours emerging through natural training are unlikely to produce such convenient linear signals. We introduce a naturalistic methodology using multi-turn context windows that simulates realistic deceptive reasoning without artificial triggers or supervised backdoor insertion. Rather than binary trigger-response patterns, we examine how semantic complexity emerges through gradual context development. Building on our Curved Inference framework, we analyse curvature, salience, & introduce semantic surface area (A’), a new metric of representational work capturing both the magnitude & directional change of meaning construction in unnormalised residual space. Without backdoors, labels, or probes, we apply this framework to naturalistic deceptive prompts & classify model outputs via LLM consensus. Geometric structure reliably predicts semantic classification, with statistically significant differences in surface area across five prompt strategies & two model families. Critically, measurement precision can reveal geometric signatures hidden by classification noise - some strategies improve from non-significant (p = 0.555) to significant (p = 0.048). This validates that sophisticated reasoning creates intrinsic geometric patterns that persist even when detection appears to fail, suggesting the shape of inference itself encodes semantic patterns regardless of whether models have learned to suppress linear indicators of deception - a scalable, unsupervised path for detection when linear methods fail.

[7] PARTAB: Partition-Aware Reasoning with Structured Evidence for Scalable Table Understanding cs.CL | cs.AI | cs.IRPDF

Md Mahadi Hasan Nahid, Davood Rafiei

TL;DR: PARTAB是一个用于可扩展表格理解的框架，它通过构建结构化证据接口，将查询相关证据表示为语义连贯的行链接表格区域，并在生成答案前对列组和行级分区进行分层选择，以解决大语言模型在处理大规模复杂表格时因无关上下文和证据定位困难导致的性能下降问题。

Details

Motivation: 现有方法通常对整个表格或单一简化视图进行推理，这可能会模糊重要的行列关系，而大语言模型在处理大规模复杂表格时，其有效性会因无关上下文和证据定位困难而降低。

Result: 在涵盖问答、事实核查和数值推理的多个表格推理基准测试中，PARTAB持续优于全表提示和几种最近的表格推理方法，在WikiTableQuestions和TabFact上实现了强劲性能，同时在数值推理上保持竞争力。

Insight: 论文的创新点在于引入了语义分区和有针对性的证据选择，这改善了证据定位，显著减少了推理上下文，并在复杂表格上提供了更大的收益，展示了结构化、分区感知的证据构建对于可扩展表格推理的价值。

Abstract: Large Language Models (LLMs) have shown strong capabilities in table reasoning, but their effectiveness degrades as tables grow in size and complexity due to irrelevant context and difficulty localizing the evidence required for reasoning. Existing approaches typically reason over either the full table or a single reduced view, which can still obscure important row-column relationships. We introducePARTAB (Partition-Aware Reasoning overTables), a framework that constructs a structured evidence interface between the LLM and the table. PARTAB represents query-relevant evidence as semantically coherent, row-linked table regions and performs hierarchical selection over column groups and row-level partitions before composing the selected evidence for answer generation. We evaluate PARTAB on multiple table reasoning benchmarks, covering question answering, fact verification, and numerical reasoning. PARTAB consistently improves over full-table prompting and several recent table reasoning methods, achieving strong performance on WikiTableQuestions and TabFact while remaining competitive on numerical reasoning. Additional analyses show that semantic partitioning and targeted evidence selection improve evidence localization, substantially reduce the reasoning context, and provide larger benefits on complex tables. These results demonstrate the value of structured, partition aware evidence construction for scalable table reasoning.

[8] MC-CXR: A Multi-Context Chest X-ray Benchmark for Context-Induced Disruption in Vision-Language Models cs.CLPDF

Junhyeok Lee, Songsoo Kim, Kyu Sung Choi

TL;DR: 本文提出了MC-CXR基准测试，用于评估视觉语言模型在解读胸部X光片时，当外部上下文信息（如文本报告或先前影像）与当前图像信息冲突时，模型是否会被误导而改变其原本正确的判断。该基准包含240个病例扩展出的2522个实例，通过配对扰动来隔离上下文诱导的干扰。

Details

Motivation: 现有基准仅评估模型在孤立情况下的回答正确性，而无法衡量当看似合理的上下文与图像信息冲突时，模型是否能保持其仅基于图像的正确决策。这在临床实际应用中（如结合检索报告、初步笔记或既往影像）至关重要。

Result: 在MC-CXR基准上评估了十个开源通用、医疗领域和闭源的VLM。结果显示，面对误导性文本上下文，模型的平均‘转向错误’率在45.6%到78.1%之间；面对误导性视觉上下文，该率在35.7%到61.7%之间。在被误导的预测中，74.6%与误导性文本标签一致，而视觉上下文仅为17.6%，存在57.0个百分点的显著差距。

Insight: 论文的创新点在于构建了一个专门评估上下文诱导干扰的基准，并定义了‘转向错误率’和‘上下文对齐错误率’两个配对指标。核心发现是视觉语言模型在面对冲突上下文时存在显著的文本-视觉不对称性，模型更容易被文本上下文误导，这对临床应用中可靠的多模态集成提出了重要警示。

Abstract: Vision-language models (VLMs) are increasingly used in clinical pipelines where a chest X-ray is interpreted alongside retrieved reports, preliminary notes, or prior imaging. Existing benchmarks measure whether models answer correctly in isolation, but not whether they preserve a correct image-only decision when plausible context conflicts with the image. We introduce Multi-Context Chest X-ray (MC-CXR), a benchmark of 240 cases expanded into 2,522 instances that isolates context-induced disruption through paired perturbation. Each case fixes the current image and target finding while presenting matched reliable and misleading context across text and prior CXR, with visual overlays where available. MC-CXR defines three task families and two paired metrics, the switch-to-wrong rate and the context-aligned error rate. We evaluate ten VLMs spanning open-source general, medical-domain, and closed-source systems. Image-only accuracy is necessary but insufficient. Mean switch rates range from 45.6-78.1% across misleading textual sources and 35.7-61.7% across misleading visual sources. Among switched predictions, 74.6% align with the misleading label for text versus 17.6% for visual context, a 57.0-point gap (95% CI 50.9-62.8). This text-visual asymmetry is observed under the standardized direct-answer protocol. The dataset is available on PhysioNet.

[9] TrustDABench: Benchmarking Reliability and Robustness of LLMs for Structured Data Analysis cs.CL | cs.SEPDF

Boshen Shi, Yize Liu, Chen Zhao, Ce Chi, Zhendong Wang

TL;DR: 该论文提出了TrustDABench基准，用于评估大型语言模型在结构化数据分析任务中的可靠性和鲁棒性。基准基于‘证据路径’视角，通过19种扰动操作符和基于智能体LLM的生成框架，创建了2,340个人工验证的扰动实例。对八个代表性LLM的评估结果显示，当前模型在可靠性和鲁棒性方面仍有很大提升空间，并揭示了模型在检测冲突证据、避免无支持的分析路径以及对表格形式变化的敏感性方面存在系统性缺陷。

Details

Motivation: 随着LLMs越来越多地用于分析电子表格和CSV等结构化数据，生成看似正确的答案并不等同于提供可信的分析。一个可信的结果应建立在从用户问题到相关数据证据的有效路径之上。这引出了两个诊断性问题：当有效路径不存在时，LLM能否拒绝回答或请求澄清；以及当相同证据以不同表格形式表达时，它能否保持正确的分析。

Result: 在TrustDABench基准上评估了八个代表性LLM。最佳可靠性结果（平均MRS）仅为24.21%，由GPT-5.5取得；最佳鲁棒性结果（平均ASR）仍有9.10%，由Claude-Sonnet-5取得。结果表明，当前模型在可靠性和鲁棒性方面存在显著不足，远未达到理想水平。

Insight: 论文的创新点在于从‘证据路径’的视角形式化了结构化数据分析的可信度问题，并据此构建了一个系统性的基准测试。其提出的基于智能体LLM的扰动生成框架，能够自动化地创建多样化的测试实例。研究发现揭示了模型在证据边界识别和表示不变推理方面的关键弱点，为未来开发更可靠的表格数据分析模型指明了方向，即需要更强的证据边界识别能力和对数据表示形式变化的鲁棒性。

Abstract: LLMs are increasingly used to analyze spreadsheets, CSV files, and other structured data, but producing a correct-looking answer is not the same as producing a trustworthy analysis. A trustworthy result should be supported by a valid path from the user question to the relevant data evidence. This requirement creates two diagnostic questions: whether an LLM can refuse to answer or ask for clarification when such a path does not exist, and whether it can preserve the correct analysis when the same evidence is expressed in different table forms. We introduce TrustDABench, a benchmark that operationalizes these questions as reliability and robustness. Starting from the evidence-path view, we derive 19 perturbation operators and instantiate them through an Agentic-LLM-based generation framework. TrustDABench contains 2,340 human-verified perturbed instances, and we evaluate eight representative LLMs. The results show substantial headroom: the best reliability result is only 24.21% average MRS, achieved by GPT-5.5, while the best robustness result still has 9.10% average ASR, achieved by Claude-Sonnet-5. The failures are systematic: models rarely detect conflicting evidence, often continue along executable but unsupported analysis paths, and remain sensitive to perturbations that change observation boundaries or cross-table relations. These findings suggest that stronger evidence-boundary recognition and representation-invariant reasoning are still needed for reliable structured-data analysis.

[10] RecurSE: Bounded Recursive Self-Evaluation for LLM Rubric Judges cs.CLPDF

Kaiyuan Liu, Ziyuan Zhuang, Rongxiang Weng, Jieping Ye

TL;DR: 该论文提出了一种名为RecurSE（递归自我评估）的方法，用于在无需外部黄金监督的情况下改进大型语言模型（LLM）作为评估者（judge）的能力。该方法通过一个可训练的评估者（基于规则评估候选回答）和一个同步的策略复制检查器（基于元规则审计评估者的推理过程以提供标量过程奖励）的配对，形成一个有界的递归自我改进（RSI）闭环。研究探讨了自我改进何时发生以及何时必须停止，并引入配对优势有效性（PAV）作为无偏验证监控器来确定最佳早停窗口。实验表明，该方法在多个模型和基准上实现了泛化性能提升。

Details

Motivation: 当前改进LLM-as-judge（即使用LLM作为评估者）通常依赖于昂贵的人工标注、奖励模型或从更强教师模型的蒸馏。本工作的动机是消除对RL训练奖励的外部黄金监督，利用模型自身的评估能力为其优化生成学习信号，实现一个闭环的、有界的递归自我改进设置。

Result: 在Qwen3.5-9B、Gemma-4-E4B-it和Qwen3.6-27B等模型上，RecurSE方法在医学、成对比较、摘要和专业等保留基准测试中取得了一致的泛化性能提升。消融实验表明，同步的评估者-检查器协同进化优于冻结的检查器、外部元评估者、自我一致性以及缩放教师蒸馏。此外，由该评估者筛选的偏好对能有效增强下游策略对齐。

Insight: 论文的核心创新点在于提出了一个结构化解耦的递归自我评估框架（RecurSE），通过将检查器的标量分数与评估者的裁决令牌在接口上隔离，消除了导致自我奖励膨胀的令牌复制捷径。另一个关键创新是引入了配对优势有效性（PAV）作为无偏验证监控器，联合跟踪评估者准确性和检查器保真度，以可靠地确定最佳早停窗口，从而为有界的递归自我改进提供了可行的监控机制。

Abstract: LLM-as-judge is essential for evaluating open-ended text and steering post-training, yet improving the judge itself typically relies on expensive annotations, reward models, or distillation from stronger teachers. In this work, we eliminate external gold supervision from the RL training reward: the model’s own evaluative capability generates learning signals for its optimization – a closed-loop setting of bounded recursive self-improvement (RSI) termed Recursive Self-Evaluation (RecurSE). We study two central questions: when can self-improvement occur, and when must it stop? First, RecurSE pairs a trainable judge evaluating candidate responses under per-rule rubrics (Pass 1) with a synchronized policy-copy checker that audits the judge’s reasoning against meta-rubrics to supply a scalar process reward (Pass 2). To enable learning, interface decoupling structurally isolates the checker’s scalar score from the judge’s verdict tokens, eliminating a degenerative token-copying shortcut that inflates self-assigned rewards. Second, because unanchored recursive learning is inherently bounded, Pairwise Advantage Validity (PAV) serves as an unbiased validation monitor that jointly tracks judge accuracy and checker fidelity to reliably identify the optimal early-stopping window. Across Qwen3.5-9B, Gemma-4-E4B-it, and Qwen3.6-27B, RecurSE achieves consistent generalization gains across held-out medical, pairwise, summarization, and professional benchmarks. Ablations demonstrate that synchronized judge-checker co-evolution outperforms frozen checkers, external meta-judges, self-consistency, and scaled teacher distillation. Furthermore, preference pairs curated by our judge effectively enhance downstream policy alignment. Bounded RSI for LLM-as-judge is thus viable when self-produced reward validity is explicitly decoupled and monitored.

[11] Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026 cs.CL | eess.ASPDF

Enes Yavuz Ugan, Fabian Retkowski, Yuka Ko, Thai-Binh Nguyen, Maike Züfle

TL;DR: 本文介绍了KIT团队在BeTraC 2026挑战赛轻量级赛道上的提交方案，提出了一种可扩展的数据增强流程，用于端到端的医疗对话语音到SOAP格式摘要生成。该方法通过合成语音生成和自动生成SOAP监督，统一了异构医疗对话数据集，从而增强了语音基础模型的适应性。

Details

Motivation: 动机是利用大型语言模型的指令跟随能力，实现临床记录自动化，以减轻医护人员负担。进一步目标是直接从语音生成临床笔记，避免中间转录，以保留副语言线索并减少处理时间。

Result: 作为BeTraC 2026挑战赛的参赛方案，其具体定量结果未在摘要中明确提及，但该方法旨在实现端到端的语音到SOAP生成。

Insight: 创新点在于提出了一个统一异构医疗数据集的可扩展数据增强流程，结合合成语音和自动SOAP监督，使语音基础模型能直接适应端到端的临床记录生成任务，这有助于保留语音中的副语言信息。

Abstract: With the advent of Large Language Models and its instruction following capabilities a promising application is the task of summarization. Within this domain of task the extractive sub-task of clinical protocolling has emerged as a topic of particular interest as it can significantly reduce the downtime and protocolling burden of health-care workers thus enabling them to focus on their core work helping humans. A further step towards automation is the direct generation of clinical notes from speech without intermediate transcripts, reducing processing time while preserving information such as coughing or other paralinguistic cues that may be lost in transcript-based systems. To this end, we present KIT’s submission to this years BeTraC challenge in the lightweight track. Our main contribution is a scalable data augmentation pipeline that unifies heterogeneous medical dialogue datasets through synthetic speech generation and automatically generated SOAP supervision, enabling robust adaptation of a speech foundation model for end-to-end speech-to-SOAP generation.

[12] FARCA: Fact-Aligned Reliability-Aware Credit Assignment for Reinforcement Learning with Factual Supervision cs.CL | cs.AIPDF

Qiming Xie, Wenjie Zheng, Xiangqing Shen, Rui Xia

TL;DR: 本文提出FARCA框架，旨在解决强化学习中基于事实监督的信用分配问题，通过细粒度对齐事实验证与策略更新，并引入反事实证据归因来评估验证可靠性，从而减少幻觉风险并提升模型的事实性。

Details

Motivation: 针对现有基于可验证奖励的强化学习方法中，过程级事实监督因信号聚合粗糙和缺乏可靠性评估，导致事实验证与策略更新不匹配的问题，即噪声事实信用分配。

Result: 在不同模型和多个事实推理基准测试上的实验表明，FARCA显著提升了模型的事实性，同时保持了通用推理能力。

Insight: 创新点在于将事实监督转化为局部化、可靠性加权的词元级训练信号，通过细粒度信用定位和反事实证据归因来调制奖励和策略优势，减少不可靠信号对策略优化的影响。

Abstract: To reduce the hallucination risk caused by outcome-driven rewards in large language models trained through reinforcement learning with verifiable rewards, existing mitigation approaches introduce process-level factual supervision. However, due to coarse-grained aggregation of factual signals and the lack of reliability assessment for these signals, they create a mismatch between fact verification and policy updates. We term this noisy factual credit assignment and decompose it into two aspects: credit localization ambiguity and credit reliability ambiguity. To address these issues, we propose FARCA (Fact-Aligned Reliability-Aware Credit Assignment), a policy optimization framework that transforms factual supervision into localized, reliability-weighted token-level training signals. FARCA achieves fine-grained credit localization by aligning the granularity of fact verification with that of policy updates. It further introduces counterfactual evidence attribution, which uses the dependence of a factual judgment on key evidence as an empirical proxy for verification reliability to compute reliability weights. These weights modulate factual rewards and local policy advantages, reducing the influence of potentially unreliable signals on policy optimization. Experiments across different models and multiple factual reasoning benchmarks show that FARCA significantly improves model factuality while preserving general reasoning capabilities.

[13] Is Discrete Difficulty Sufficient? Leveraging Continuous Difficulty for Efficient Self-Consistency in LLMs cs.CLPDF

Sihyeong Yeom, Geon Park, Geunyeong Jeong, Taewoong Yoon, Jaewook Lee

TL;DR: 本文提出了一种名为灵活自洽（FSC）的解码策略，旨在解决自洽（SC）方法因生成多条推理路径而导致计算开销过大的问题。FSC通过预训练的探针将问题难度估计为连续信号，并据此动态调整生成的推理路径数量，从而在保持与SC相当准确性的同时显著减少计算开销。

Details

Motivation: 自洽（SC）解码策略在复杂推理问题上表现出色，但生成多条推理路径会消耗大量计算资源。现有方法通常将难度划分为少数离散级别，未能充分捕捉推理复杂度的连续变化特性，因此需要一种能更精细地根据连续难度动态调整资源分配的方法。

Result: 实验结果表明，在各种模型和基准测试中，FSC在保持与SC相当准确性的同时，实现了高达76%的token节省。

Insight: 创新点在于将问题难度建模为连续信号而非离散类别，并利用预训练探针预测输出熵作为模型不确定性的指标，从而实现对采样预算的灵活控制。这提供了一种更高效、自适应的资源分配机制，可推广到其他需要动态调整计算资源的推理任务中。

Abstract: Self-Consistency (SC) is a decoding strategy that samples diverse reasoning paths and selects the most consistent answer, demonstrating strong performance on complex reasoning problems. However, the excessive token consumption incurred by generating multiple reasoning paths has been identified as a major limitation of SC. To improve computational efficiency, several studies have proposed strategies that adjust the number of reasoning paths or allocate resources differentially according to problem difficulty. Nevertheless, most existing methods categorize difficulty into a few fixed levels, failing to fully capture the continuously varying nature of reasoning complexity. In this work, we propose Flexible Self-Consistency (FSC), which estimates problem difficulty as a continuous signal and dynamically adjusts the number of generated reasoning paths accordingly. FSC predicts the output entropy of an input question using a pre-trained probe and leverages it as an indicator of model uncertainty to flexibly control the sampling budget. Experimental results show that, across various models and benchmarks, FSC maintains accuracy comparable to SC while achieving token savings of up to 76%.

[14] Beyond Information Seeking: Severity-Aware Question Supervision for Proactive Medical Dialogue cs.CLPDF

Chenxuan Li, Xinrong Chen, Luyan Zhang, Peidong Jia, Zhongyu Zhao

TL;DR: 本文提出了一种名为预期严重性风险（ESR）的新监督目标，用于主动医疗对话中的问题选择。该方法不仅考虑问题对减少诊断不确定性的信息量，还考虑其对下游诊断决策（特别是严重错误后果）的预期影响。通过在DDxPlus数据集上训练Qwen3-4B模型，ESR显著减少了高严重性诊断遗漏，并提高了整体诊断准确性。

Details

Motivation: 现有主动医疗对话系统主要基于信息寻求，优先选择最能减少诊断不确定性的问题。然而，这种方法忽略了不同诊断错误（如遗漏严重病症）可能带来的不同临床后果，动机是推动系统超越单纯的不确定性减少，转向考虑后果的证据获取。

Result: 在DDxPlus数据集上对Qwen3-4B模型进行训练，匹配ESR监督将平均高严重性诊断遗漏从0.0645降至0.0455（减少29.5%），平均诊断准确率从0.9123提升至0.9320，同时每个对话仅需额外0.14个问题。固定预算分析表明，在控制问题数量时，ESR与信息寻求目标行为不同；与预期0/1风险控制相比，ESR能更好地改善高严重性错误分布。

Insight: 核心创新点是将严重性感知的终端风险（即不同诊断错误的后果差异）整合到问题选择的监督目标中，提出了ESR目标。技术亮点包括：1）在问题选择时通过仅训练时使用的总体统计量对可能答案进行边缘化，以处理答案未知的挑战；2）将ESR排名蒸馏为仅前缀的语言策略，使部署时无需教师侧计算，实现了高效推理。

Abstract: Proactive medical dialogue requires an agent to decide what to ask from incomplete patient information. Existing information-seeking approaches commonly prioritize questions that most reduce diagnostic uncertainty. While effective for acquiring informative evidence, this criterion overlooks an important property of medical diagnosis: different diagnostic errors can carry substantially different consequences. Missing a severe condition may matter more than reducing uncertainty among less consequential alternatives. Question acquisition should therefore consider not only how informative new evidence is, but also how it is expected to affect the downstream diagnostic decision. To this end, we propose Expected-Severity-Risk (ESR), a consequence-aware question-supervision objective that values each candidate by its expected reduction in severity-aware terminal risk. Because questions must be selected before their answers are observed, ESR marginalizes over possible answers using train-only population statistics. Its rankings are then distilled into a prefix-only language policy, so next-question selection requires no teacher-side computation at deployment. Across three Qwen3-4B training seeds on DDxPlus, matched ESR supervision reduces mean high-severity diagnostic miss from .0645 to .0455 (-29.5%) and improves mean diagnostic accuracy from .9123 to .9320 while requiring only 0.14 additional questions per dialogue. Fixed-budget analyses show that the two objectives remain behaviorally distinct when question count is controlled, while a matched expected-0/1-risk control shows that severity-aware weighting improves the high-severity error profile beyond generic decision-aware supervision. These results support moving proactive medical dialogue beyond uncertainty reduction toward consequence-aware evidence acquisition.

[15] Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation cs.CLPDF

Ismail Hossain, Nafi Ullah Shafin, Mohammad Abdullah Al Mumin

TL;DR: 本文系统评估了后训练量化对孟加拉语大语言模型理解能力的影响，在三个模型家族（Qwen-2.5-7B、LLaMA-3.1-8B、GPT-OSS-20B）上比较了全精度和三种量化格式（GPTQ-Int8、GPTQ-Q8、GGUF-W8A16）在五个孟加拉语自然语言理解基准（Bangla MMLU、CommonsenseQA-BN、OpenBookQA-BN、PIQA-BN、BoolQ-BN）上的零样本性能。

Details

Motivation: 量化技术能降低大语言模型的内存占用并加速推理，但现有研究主要基于英语基准，对于形态复杂、资源匮乏的语言（如孟加拉语）的影响尚不明确，本文旨在填补这一研究空白。

Result: 在五个孟加拉语NLU基准上的评估表明，不同模型家族对量化的响应差异显著：GPT-OSS在推理密集型任务（GGUF-W8A16格式）下准确率下降高达57.35%，而Qwen和LLaMA在GPTQ格式下保持稳定，甚至在某些情况下量化版本略优于全精度版本；理解型任务（BoolQ-BN）在所有模型和格式下均保持稳定。

Insight: 研究表明，量化技术可以成功应用于孟加拉语模型部署，但模型架构和量化方法的选择比单纯的比特宽度更为关键；这是首次针对孟加拉语NLU的量化格式对照比较，为在受限硬件上选择模型提供了实践指导。

Abstract: Post-training quantization lowers the memory footprint of Large Language Models (LLMs) and speeds up inference, which is why it is now common for on-device deployment. Most of what we know about its effects, however, comes from English benchmarks. It is not clear whether the same holds for morphologically complex, low-resource languages such as Bangla, and this gap is what we address here. We evaluate three model families—Qwen-2.5-7B, LLaMA-3.1-8B, and GPT-OSS-20B—in full precision and in three quantized formats (GPTQ-Int8, GPTQ-Q8, GGUF-W8A16) across five Bangla natural language understanding benchmarks (Bangla MMLU, CommonsenseQA-BN, OpenBookQA-BN, PIQA-BN, and BoolQ-BN), using zero-shot evaluation through lm-evaluation-harness. To our knowledge this is the first controlled comparison of quantization formats on Bangla NLU. The three families do not respond the same way: GPT-OSS loses up to 57.35% accuracy on reasoning-heavy tasks under GGUF-W8A16, while Qwen and LLaMA hold steady under GPTQ, and in a few cases the quantized version edges out the full-precision one. BoolQ-BN, a comprehension task, stays stable across all three families regardless of format. Taken together, these results suggest quantization can work well for Bangla deployment, but the choice of architecture and quantization method matters more than the bit width alone. We discuss what this means for practitioners choosing a model to run on constrained hardware.

[16] The Annotation Bottleneck in Persian Text NLP: Persian as an Annotation-Scarce Language cs.CLPDF

MohammadHossein Mortazavi, Mostafa Salehi, Hadi Veisi

TL;DR: 本文提出波斯语在自然语言处理中更准确地应被描述为‘标注稀缺’而非‘低资源’语言，通过分析34个代表性文本资源、网络可见性测量、语音语料库发展以及波斯语-英语任务标注量对比，指出其标注资源在任务和领域覆盖上不均衡，而非整体标注量不足。

Details

Motivation: 旨在澄清波斯语在NLP资源生态中的真实状况，区分‘低资源’标签的笼统性，强调其标注资源在特定任务和领域的稀缺性与不均衡性。

Result: 定量分析显示波斯语网络内容占比约0.7%-0.9%，位列前20大可见语言；标注资源密度因任务而异：句法和新闻NER相对丰富，而自然语言推理低于网络比例基线。

Insight: 创新点在于将语言资源问题细化为‘标注稀缺性’，并引入任务归一化比较方法；客观分析揭示了资源不均衡、方案不兼容、访问障碍等具体瓶颈，为资源建设提供方向性指导。

Abstract: Persian (Farsi) is often described as a low-resource language in natural language processing, but that label collapses distinct shortages into a single category. This paper argues that Persian is more precisely described as annotation-scarce, provided that the term is understood as a property of its NLP resource ecology rather than an intrinsic property of the language. The review covers 34 representative Persian text resources available by July 2026 and adds three quantitative cross-checks. First, independent web measurements place Persian among roughly the twenty most visible content languages: W3Techs reports Persian on about 0.9% of websites with a known content language, while Common Crawl CC-MAIN-2026-30 identifies Persian as the primary language of 0.7039% of HTML pages. Second, a selective speech review shows a long resource trajectory from FARSDAT to recent corpora containing hundreds or thousands of hours of speech. Third, a matched Persian-English comparison normalizes task-specific annotation volumes by relative Common Crawl web presence. The resulting ratios vary sharply: Persian syntax and news NER are comparatively dense, whereas natural-language inference falls below the web-proportional baseline. The evidence therefore does not support a simple claim that Persian is globally deficient in labeled volume. Instead, annotation scarcity is expressed through uneven task and domain coverage, incompatible schemes, access and documentation friction, and limited supervision for specialist domains, preference data, and varieties beyond standard Iranian Persian.

[17] Lost in Speech: Trilingual Spoken Hallucination Detection Across Audio and Transcripts cs.CLPDF

Meruyert Aristombayeva, Jason S. Lucas, Chaewan Chun, Dongwon Lee

TL;DR: 该论文提出了首个多语言口语幻觉检测基准，涵盖英语、俄语和哈萨克语的新闻样本，包含三种类型和三种严重程度的受控幻觉。研究评估了基于转录文本和直接音频处理的多语言编码器及多模态解码器模型，发现基于转录的检测通常优于直接音频处理，且合成训练的检测器在真实虚假新闻上具有强迁移能力。

Details

Motivation: 解决基于文本的幻觉检测已广泛研究，但口语幻觉检测（尤其是低资源语言）仍未被充分探索的问题，旨在填补这一研究空白。

Result: 在合成基准上，基于转录的检测宏F1分数优于直接音频处理；在真实虚假新闻上，合成训练的检测器迁移效果强（原始文本上宏F1为0.82-0.88），俄语来源分析揭示了与真实性相关和模型依赖的机器风格信号。

Insight: 创新点包括构建首个多语言口语幻觉基准，结合合成与真实数据，并量化了合成基准中的关键混淆因素；客观分析显示，研究强调了跨模态（音频与文本）和跨语言（包括低资源语言）检测的挑战与差异。

Abstract: While text-based hallucination detection has been extensively studied, spoken hallucination detection remains largely unexplored, particularly for low-resource languages. We present the first multilingual spoken hallucination benchmark comprising 12,013 news samples across English, Russian, and Kazakh with controlled hallucinations of three types and three severity levels. Samples comprise original articles and aligned hallucinated counterparts in text and audio. We complement the synthetic corpus with 290 fact-checked fake news items collected natively in Russian (225) and Kazakh (65), translated into the other language and rendered through the same TTS-ASR pipeline. We assess fine-tuned multilingual encoders and, in zero-shot in-context settings, multimodal decoder models on transcript-based versus direct audio processing. Transcript-based detection generally outperforms direct audio processing, with binary-task degradation for strong encoders tracking per-language ASR error. On real-world fakes, synthetic-trained detectors transfer strongly (macro-F1 0.82-0.88 on original text), while Russian provenance analysis reveals both veracity-related and model-dependent machine-style signals, quantifying a key confound in synthetic hallucination benchmarks.

[18] SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents cs.CLPDF

Shidong Yang, Ziyu Ma, Tongwen Huang, Xucong Wang, Renda Li

TL;DR: 本文提出了SkillForge框架，旨在解决强化学习智能体无法跨任务积累可复用知识的问题。该框架通过环境交互对技能进行验证和精炼，使技能库能够持续进化并保持质量。在ALFWorld、WebShop和AppWorld上的实验表明，SkillForge持续优于现有的SkillRL方法。

Details

Motivation: 现有基于技能的强化学习方法（如SkillRL）将技能库视为只增不减的仓库，缺乏对已存储技能有效性的持续验证，导致智能体无法有效积累和复用知识。

Result: 在ALFWorld、WebShop和AppWorld基准测试上的大量实验表明，SkillForge持续超越了SkillRL方法，证明了持续验证技能对于训练更强LLM智能体的有效性。

Insight: 核心创新点在于提出了基于证据的技能验证和多路径技能归纳机制，使技能库在持续增长的同时能维持质量，并通过显式的技能调用决策，使强化学习能同时优化环境动作和技能调用。

Abstract: Large language model (LLM) agents are trained with reinforcement learning (RL) for complex decision-making tasks. However, most RL-trained agents remain episodic and cannot accumulate reusable knowledge across episodes. Recent skill-based approaches, such as SkillRL, attempt to address this issue by extracting skills from raw trajectories, but treat the skill bank as an append-only repository without verifying whether stored skills remain effective. In this paper, we propose SkillForge, a framework for continuous skill evolution that enables skills to be verified and refined through environment interaction. By making skill usage explicit during agent interaction, RL can directly optimize both environment actions and skill invocation decisions. SkillForge further introduces evidence-based skill verification and multi-pathway skill induction, allowing the skill bank to continuously grow while maintaining its quality. Extensive experiments on ALFWorld, WebShop, and AppWorld show that SkillForge consistently outperforms SkillRL, demonstrating the effectiveness of continuously verified skills in training stronger LLM agents.

[19] BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes cs.CLPDF

Fei Tang, Huawen Shen, Zhiqiong Lu, Zhengxi Lu, Pengyuan Lyu

TL;DR: 本文提出了BrowserForge框架，通过并行浏览器沙箱在开放网络上大规模生成网页交互轨迹数据，以解决现有网页智能体训练数据规模小、网站覆盖窄的问题。该框架包含开放网络源采集、沙箱集群管理和双智能体循环三个组件，最终构建了一个包含20多万条来自不同网站轨迹的数据集，并用其微调模型提升了在多个基准测试上的性能。

Details

Motivation: 现有基于像素的网页智能体训练依赖高质量交互轨迹，但公开数据集通常只包含数千条来自固定、狭窄网站集的轨迹，自动化合成管道也受限于预定义网站列表，导致智能体接触的网站多样性严重不足，难以规模化获取数据。

Result: 在BrowserForge生成的数据集上微调一个紧凑的多模态模型，将在线Mind2Web基准上的成功率从25.66%提升至33.33%，并在静态多模态Mind2Web基准上持续提高了步骤准确率，且性能增益随数据规模扩大而增长。

Insight: 创新点在于通过并行浏览器沙箱在开放网络上大规模、自动化地收集多样化网页交互数据，并采用双智能体循环（提议者-解决者）将原始页面转化为可执行任务以生成验证轨迹；客观来看，其强调开放网络源和广泛网站覆盖是提升智能体泛化能力的关键，且训练时仅使用截图，避免了依赖页面结构带来的脆弱性。

Abstract: Web agents that act from rendered pixels avoid the fragility and heavy token cost of reading a page’s HTML or accessibility tree, but training them depends on large amounts of high-quality interaction trajectories, and how to produce such data at scale remains an open problem. Public datasets typically contain only a few thousand trajectories drawn from a fixed and narrow set of websites, and even recent automated synthesis pipelines stay bound to predefined site lists or tutorial sources, so the number of distinct websites the agent ever sees barely grows. We present BrowserForge, a framework that generates web interaction data at scale by driving many browser sandboxes in parallel over the open web. BrowserForge couples three components: an open-web sourcing stage that exposes the agent to hundreds of thousands of real, openly reachable websites; a sandbox cluster manager that schedules hundreds of concurrent browsers with high utilization; and a Proposer-Solver dual-agent loop that turns a raw page into an executable task and then collects a verified trajectory for it. A rule-plus-model cleaning pipeline removes failed runs and rewrites the surviving reasoning into a single unified chain-of-thought style. Page structure such as the accessibility tree is used only as a synthesis-time signal; the agent we train and release acts purely from the screenshot. The resulting corpus contains 203,238 trajectories, each collected from a distinct website, larger and more diverse than prior trajectory datasets. Fine-tuning a compact multimodal model on this corpus raises its success rate on the live Online-Mind2Web from 25.66% to 33.33% and consistently improves step accuracy on the static Multimodal-Mind2Web, with the gain growing as the corpus scales. Controlled analyses further confirm that open-web sourcing and broad website coverage are key contributors to the observed improvement.

cs.CV [Back]

[20] The Blending Ratio Is Not Where the Performance Is: Diagnosing Prototype Blending for Few-Shot Adaptation of Vision-Language Models cs.CV | cs.LGPDF

Liangzhi Li, Bowen Wang, Yiming Qian, Thorsten Neumann, Xia Xie

TL;DR: 本文研究了少样本视觉语言模型适应中，原型混合比例（blending ratio）对性能的影响。通过理论分析和大量实验，作者发现传统方法中通过验证集调优的混合比例并非性能提升的关键，且存在可免费获得的近优解。此外，验证集无关的线性探针方法甚至优于基于验证集调优的混合方法，表明性能瓶颈在于模型类别而非超参数选择。

Details

Motivation: 论文旨在探究少样本适应方法中，零样本文本原型与标记图像特征均值混合比例的实际作用。传统方法依赖验证数据（甚至测试集）调优该比例，但作者质疑其必要性，并试图回答：最优比例是否存在、能否无需验证数据估计、以及它是否真正决定性能。

Result: 在包含10个数据集、5个骨干网络（如SigLIP）、多种样本数和种子的4800个实验单元中，理论最优混合比例（基于支持集的James-Stein估计）与测试集Oracle比例相比性能落后8.5个百分点。而仅使用支持集的留一法估计比例与Oracle差距仅0.9个百分点。验证集无关的线性探针方法（如CLAP和LP++）平均优于Oracle调优混合1.9和1.5个百分点，在K≥4时所有基线均超越Oracle。

Insight: 创新点在于揭示了原型混合比例并非性能核心因素：理论最优比例因忽略类别无关偏移而失效，且可通过支持集免费近优估计。更重要的洞察是，性能上限由模型类别决定，而非超参数调优；验证集无关的线性方法能更有效利用模型能力，为少样本适应提供了更简洁高效的解决方案。

Abstract: Many few-shot adaptation methods for vision-language models classify with a convex combination of the zero-shot text prototype and the mean of the K labelled image features, with a single blending ratio routinely tuned on held-out labels, often on the test set itself. We ask what the family’s own bias-variance justification invites: what is the right ratio, can it be estimated without validation data, and is finding it where the performance is? First, the ratio minimising prototype mean-squared error has a closed form whose support-set plug-in is exactly a positive-part James-Stein coefficient shrinking towards the text prototype. Across 4,800 cells (ten datasets, five backbones including SigLIP, five shot counts, five seeds, four prompt tiers) this theoretically optimal ratio is a reliable estimate of the wrong quantity: on the 950 primary-tier cells where it is defined it trails a test-set-oracle ratio by 8.5 points. It saturates near 1, discarding the text prior for a nearest-class-mean classifier, because 78% of the text-image prototype distance it treats as bias is a class-independent offset that the arg max largely cancels. We prove the mechanism and bound its share of the damage at 26% by a counterfactual. Second, leave-one-out on the support set alone sets a ratio landing within 0.9 points of the oracle blend, so it is estimable without validation data. Third, validation-free linear probes beat even the oracle-tuned blend: CLAP by +1.9 points and LP++ by +1.5 on average, and at K >= 4 all four validation-free baselines sit above the oracle, the linear probes by margins excluding zero. These results locate the ceiling in the model class, not the hyperparameter: the ratio can be set near-optimally for free, and it is still not where the performance is. Code, cached features, per-cell records: https://huggingface.co/datasets/Liangzhi-Li/clipbench-blending

[21] Scaling Reinforcement Learning for Diffusion Models via Velocity Matching cs.CV | cs.LGPDF

Jaemoo Choi, Wei Guo, Yuchen Zhu, Arash Vahdat, Molei Tao

TL;DR: 本文提出了一种名为基于奖励的速度匹配（RVM）的新方法，用于扩散模型的奖励微调。该方法绕过了传统基于似然的策略梯度方法，直接对速度场进行更新，通过强化高奖励生成方向、抑制低奖励方向，并可选地使用锚定项控制与参考速度的漂移，从而在显著降低训练成本的同时，达到或超越基于轨迹的方法的性能。

Details

Motivation: 现有扩散模型奖励微调方法大多继承自大语言模型的策略梯度框架，需要处理扩散模型生成样本难以计算似然的问题，导致需要构建轨迹似然或近似端点似然，引入了额外的计算和算法复杂性。本文旨在证明这种基于似然的机制并非必要。

Result: 在各种大规模扩散模型奖励微调任务中，RVM在显著降低训练成本的情况下，与基于轨迹的策略梯度方法（如RAM和DiffusionNFT）竞争或表现更优。在视频生成任务中，引入新的动态跟踪奖励（dynamic-tracking reward）在改善运动的同时提升了整体VBench性能。

Insight: 核心创新点在于将扩散模型的奖励微调问题重新表述为在原生速度表示下的优化，而非基于似然的策略优化，从而简化了更新机制。RVM提供了一个通用框架，可以涵盖近期的一些微调方法作为特例。研究发现，一旦速度更新被简化，具体的损失变体不如奖励和锚定设计重要，这为奖励设计提供了新的方向。

Abstract: Reward fine-tuning is becoming an important tool for adapting diffusion models to human preferences and task-specific objectives, but existing methods largely inherit policy-gradient machinery from large language models. Unlike autoregressive models, diffusion models do not provide tractable likelihoods for generated samples. As a result, current approaches either construct trajectory likelihoods from stochastic denoising transitions or approximate endpoint likelihoods with evidence lower bound, introducing additional computation and algorithmic complexity. We demonstrate that this likelihood-based machinery is not necessary for effective diffusion reward fine-tuning. We propose reward-based velocity matching (RVM), a simple trajectory-free update that acts directly on the velocity field. RVM reinforces directions associated with high-reward generations, suppresses those with low reward, and involves an optional anchor term controlling drift from a reference velocity. Notably, it provides a general framework that recovers recent fine-tuning methods, including RAM and DiffusionNFT, as special cases. Across various large-scale diffusion models reward fine-tuning tasks, RVM is competitive with or outperforms trajectory-based policy-gradient methods under substantially reduced training cost. We further find that, once the velocity update is simplified, the particular loss variant matters less than reward and anchor design. For video generation, standard preference rewards can favor visually clean but nearly static outputs; introducing a new dynamic-tracking reward that substantially improve motions while improving overall VBench performance. These results suggest that scalable reward fine-tuning for diffusion models is better posed in the native velocity representation than as likelihood-based policy optimization.

[22] DriftAD: Visually-Guided Text Drift for Few-Shot Industrial Anomaly Detection cs.CVPDF

Wenyang Liu, Tianyi Liu, Dongshuo Zhang, Kejun Wu, Adams Wai-Kin Kong

TL;DR: 本文提出了DriftAD，一个用于少样本工业异常检测（FSAD）的新框架。该框架通过视觉引导的文本漂移（VGTD）模块，动态调整CLIP的文本嵌入，使其成为适应不同网络层和空间位置的异常描述符，从而解决现有方法使用静态文本提示无法捕捉局部缺陷变化的问题。

Details

Motivation: 现有基于CLIP的少样本异常检测方法通常使用静态的全局文本提示，无法有效捕捉工业缺陷的局部和尺度依赖的物理变化。

Result: 在MVTec-AD和VisA基准测试上，DriftAD在1-shot、2-shot和4-shot设置下，在图像级和像素级指标上均达到了最先进的（SOTA）性能。

Insight: 核心创新在于提出了视觉引导的文本漂移（VGTD）机制，使文本描述能根据局部视觉上下文进行动态、分层和空间自适应的调整，并结合异常信号放大（ASA）和漂移引导空间门控（DGSG）模块来增强检测能力。

Abstract: Few-shot anomaly detection (FSAD) has recently benefited from vision-language models such as CLIP, which enable anomaly de?tection by aligning visual features with text descriptions of normal and abnormal states. However, existing methods typically rely on static text prompts that are applied uniformly across the entire feature hierarchy and spatial dimensions. This rigid global-to-local matching fails to capture the highly localized and scale-dependent physical variations of industrial defects. To address this, we propose DriftAD, a FSAD framework built on three key modules. First, an Anomaly Signal Amplification (ASA) module enhances subtle defect signals through spatial and frequency branches before text-visual matching. Second, Visually-Guided Text Drift (VGTD) dynamically transforms frozen CLIP text embeddings, steering them into layer?wise, spatially-adaptive anomaly descriptors conditioned on local visual context at each encoder depth. Third, Drift-Guided Spatial Gating (DGSG) uses the drifted abnormal descriptor as a spatial probe to selectively enhance anomaly-relevant visual features. Addi?tionally, a drift separation loss prevents representational collapse of the drifted descriptors, and a gate supervision loss enforces spatially discriminative gating in DGSG. Extensive experiments on MVTec?AD and VisA demonstrate state-of-the-art performance across all 1-, 2-, and 4-shot settings on both image-level and pixel-level metrics. Code is available at https://github.com/wenyang001/DriftAD.

[23] More Motion Is Not Always Better Motion: Corpus Composition Governs Whether Augmentation Helps SMPL-Based Parkinsonian Gait Severity Estimation cs.CVPDF

Michael Caiola, Andrew C. Weitz

TL;DR: 该研究探讨了在基于SMPL模型的帕金森病步态严重程度（MDS-UPDRS）评估中，运动数据增强的有效性。研究发现，增强效果并非取决于数据量大小，而是取决于训练语料库是否包含步态速度的对比变化。研究使用三个冻结的MotionAGFormer编码器作为特征提取器，在隐藏的多站点测试集上达到了0.58的宏观F1分数。

Details

Motivation: 动机是探究在基于SMPL的运动表示中，用于训练编码器的运动语料库的组成如何影响帕金森病步态严重程度评估模型的性能，特别是数据增强（增加更多运动数据）是否总是有益。

Result: 在隐藏的多站点测试集上，最佳模型达到了宏观F1分数0.58。通过仅改变训练语料库组成的六个数据池进行实验，其分数在0.32到0.53之间波动，只有一个超过了不使用外部运动数据（分数0.51）的基线。结果表明，性能差异的关键在于语料库是否包含步行速度的对比，而非数据量。

Insight: 核心创新点在于揭示了对于此类任务，运动数据增强的有效性高度依赖于语料库的组成特性（即包含步态速度的对比），而非简单地增加数据量或数据来源。这挑战了“更多数据总是更好”的常见假设，并为构建有效的训练语料库提供了具体指导（需要包含关键的变化维度）。同时，研究指出直接修改已学习的运动表示本身，反而会损害性能。

Abstract: We grade MDS-UPDRS gait severity from SMPL motion using three frozen MotionAGFormer encoders as featurizers, reaching macro-F1 0.58 on a hidden, multi-site test set. Because the system’s members differ only in their lifting corpus, evaluating encoders singly on that test set isolates what that corpus contributes. Six pools drawn from one inertial dataset, varying only in which walking tasks they include, score between 0.32 and 0.53, and just one of them beats the 0.51 of an encoder given no outside motion at all. What separates them is not how much data they hold but whether they carry a contrast in walking speed, the variation this representation appears to depend : a further pool adding a third collection site at fixed task composition does worse still. The same rule explains why exact synthetic motion and monocularly reconstructed web video both fail to help. Modifying the learned representation itself, rather than the corpus behind it, cost every variant that attempted it.

[24] Too much of a good thing – when knowledge distillation promotes overfitting, and how to avoid it cs.CV | cs.AIPDF

Irene Trigueros-Lorca, Leonardo Concepción, Christian Wagner, Isaac Triguero, Daniel Molina

TL;DR: 本文研究了知识蒸馏（KD）在中间网络层应用时的行为，特别是针对细粒度、数据稀缺场景。通过提出一种基于同构块的学生网络设计，在对应教师网络块之间进行蒸馏，发现在经典数据集上仅蒸馏最后一个块就足够且通常最佳，而在细粒度数据稀缺设置中，中间监督能显著提升性能。

Details

Motivation: 传统知识蒸馏仅应用于网络的最终输出，而中间层块级蒸馏的行为及其在特定条件（如每类实例数少的细粒度数据集）下的优势尚未得到充分研究。

Result: 在11个数据集上的实验表明，对于经典数据集，仅蒸馏最后一个块就足够且往往最佳；而对于细粒度、数据稀缺的设置，中间监督能带来显著收益，甚至一个额外的蒸馏点就能大幅缩小差距。

Insight: 创新点在于提出了一种基于同构块的学生网络设计，实现教师与学生对应块之间的知识蒸馏，并通过可解释性分析（如注意力图、Centered Kernel Alignment和Grad-CAM）指导监督配置，表明适当引导的中间块级蒸馏是构建紧凑、数据高效模型而不牺牲准确性的关键。

Abstract: The growing size of Convolutional Neural Networks has led to increasingly large and costly models. Knowledge Distillation (KD) addresses this by transferring knowledge from a large network (teacher) to a small one (student), also reducing the training data required. KD is traditionally applied only at the network’s final output. However, its behaviour when applied at intermediate network layers has received little attention. This raises the question of whether intermediate block-wise KD, which provides supervision throughout the network, could offer an advantage under specific conditions, such as few instances per class, which is common in fine-grained datasets. This work proposes a student design based on simple, homogeneous blocks mirroring those of the teacher, distilling knowledge between corresponding blocks. Across eleven datasets, we show that on classic datasets, distilling only the last block is sufficient – and often best–, whereas fine-grained, data-scarce settings benefit substantially from intermediate supervision, with even a single additional distillation point narrowing the gap considerably. We further study how this supervision should be guided, exploring configurations of varying granularity and informed by an explainability analysis based on attention maps, Centered Kernel Alignment, and Grad-CAM, alongside the impact of teacher and student fine-tuning strategies. This work shows that intermediate block-wise distillation, guided appropriately, is key to building compact data-efficient models without sacrificing accuracy.

[25] Primate vision reveals a missing principle for robust dynamic AI cs.CV | q-bio.NCPDF

Matteo Dunnhofer, Christian Micheloni, Kohitij Kar

TL;DR: 该论文通过比较人类感知、猕猴下颞叶皮层神经活动与多种图像/视频神经网络（识别、分割、光流处理、预测世界建模）的表征，探究了智能视觉系统如何结合物体外观与运动信息以实现鲁棒动态视觉。研究发现，预测世界模型在跨外观泛化能力和与猕猴IT皮层神经活动的匹配度上表现最佳，但所有模型均未能完全复现大脑皮层从早期外观主导到后期外观不变运动编码的渐进整合过程。

Details

Motivation: 研究旨在解决智能视觉系统如何在物体外观变化时，仍能鲁棒地整合外观与运动信息这一核心问题，以揭示鲁棒动态视觉的计算原理。

Result: 预测世界模型在跨外观泛化能力和与猕猴下颞叶皮层（IT）神经表征的匹配度（神经保真度）上均优于其他视频建模方法，但所有模型均未能复现大脑皮层中运动信息渐进整合的表征转变。

Insight: 论文提出的核心创新点是揭示了’将运动信息渐进整合到物体表征中’是实现鲁棒动态视觉的一个关键计算原则，并指出预测学习是实现该计算的人工系统的一条有前景的路径。

Abstract: How does an intelligent visual system combine what objects look like with how they move while remaining robust as appearance changes? We addressed this question by comparing human perception and neural activity in macaque inferior temporal cortex with representations from image- and video-based neural networks spanning recognition, segmentation, optic-flow processing and predictive world modeling. Temporal integration improved object representations, but most video recognition models generalized poorly when appearance was disrupted while motion structure was preserved. Humans and macaque IT remained robust. Notably, predictive world models combined strong cross-appearance generalization with the closest correspondence to IT, outperforming other video-modeling approaches in neural fidelity. Yet no model reproduced the cortical transformation from early appearance-dominated responses toward later appearance-invariant motion coding. These results identify progressive integration of motion into object representations as a principle of robust dynamic vision and implicate predictive learning as a promising route toward realizing this computation in artificial systems.

[26] LUCAID: Agentic Multimodal AI for Lung Cancer Precision Pathology cs.CV | cs.AI | cs.LGPDF

Marie-Lisa Eich, Kai Standvoss, Timo Milbich, Alexander Möllers, Miriam Hägele

TL;DR: 本文介绍了LUCAID，一个用于肺癌精准病理学的智能体多模态AI系统。该系统通过集成九个模块覆盖了从质量控制、肿瘤检测与分割、组织学分型、肿瘤微环境分析、肿瘤细胞定量到预测性生物标志物评分和结构化报告生成的全流程诊断工作流。LUCAID在临床验证中表现出色，与专家小组裁定的参考标准在临床可操作决策上的一致性达到93.0%，显著高于经验丰富的病理学家。

Details

Motivation: 当前肺癌组织诊断复杂，治疗决策依赖于组织形态学、免疫组化和分子特征的整合，但病理评估仍主要依赖视觉和半定量方法，存在观察者间差异。现有AI工具仅覆盖部分任务，难以达到可推广的专家级性能，且缺乏前瞻性临床验证。

Result: 分析模块在大规模专家标注的基准上取得了0.82-0.95的F1分数。在前瞻性临床验证中，LUCAID与专家小组裁定的参考标准在临床可操作决策上的一致性达到93.0%，而五位经验丰富的胸科病理学家的一致性为68.3-81.1%，表明其达到了SOTA水平。

Insight: 论文宣称的创新点在于开发了一个集成智能体AI系统，将诊断推理与覆盖全工作流的多个模块耦合，实现了端到端的自动化分析和交互式查询。从客观角度看，其前瞻性临床验证和超越人类专家的性能是推动AI在精准病理学中实际应用的关键创新。

Abstract: Lung cancer tissue diagnostics is complex, as therapy decisions in precision oncology rely on the integration of histomorphological, immunohistochemical, and molecular features. Yet pathological assessment remains largely visual and semi-quantitative and shows interobserver variability, while existing artificial intelligence (AI) tools cover only selected tasks, rarely reach generalizable expert-level performance, and lack prospective clinical validation. To address these challenges, we developed and clinically validated LUCAID, an agentic AI system for precision lung cancer pathology. An integrative agent couples diagnostic reasoning with nine modules that cover the full routine workflow, from quality control, tumor detection and segmentation, histological subtyping, tumor microenvironment profiling, tumor cellularity quantification, and predictive biomarker scoring (PD-L1, MET, TROP-2) to automated structured report generation. LUCAID enables users to interactively query the module outputs and generate reports that contextualize the results. Against large-scale expert ground-truth annotations, the analysis modules achieved F1 scores of 0.82-0.95. In prospective clinical validation, LUCAID reached 93.0% concordance with an expert-panel adjudicated reference standard across clinically actionable decisions, compared with 68.3-81.1% for five experienced thoracic pathologists.

[27] Infant Care Video Dataset for Classification of Interventions Using Transformers cs.CV | cs.AI | cs.LGPDF

Igor Bogdanov, James Green

TL;DR: 该论文提出了婴儿护理视频数据集（ICVD），用于自动识别新生儿重症监护室（NICU）中的护理干预措施。该数据集包含4,144个模拟12类干预措施的视频，并利用视频Transformer模型（TimeSformer和MotionFormer）建立了强大的基线性能，验证了时序建模的必要性。

Details

Motivation: 新生儿重症监护室（NICU）的医疗记录工作繁重且不完整，护士花费大量时间记录，而高达60%的干预措施未被记录。论文旨在通过视频自动检测干预措施，以减轻临床负担并改进现有实践。

Result: 在提出的ICVD数据集上，使用TimeSformer和MotionFormer模型在12类婴儿护理干预分类中分别达到了93.97%和93.17%的top-1准确率。消融研究表明，时序模型相比逐帧方法（23.17%准确率）有70.80%的性能提升，验证了时序建模的有效性。

Insight: 论文的主要创新点是创建了一个系统化、隐私合规的模拟婴儿护理视频数据集（ICVD），并利用视频Transformer架构建立了高性能基线。客观分析认为，其通过控制变量（如摄像机角度、肤色）的数据集构建方法，以及明确展示时序建模相对于静态帧分析的巨大性能优势，对开发自动化临床文档系统具有重要借鉴意义。

Abstract: Healthcare documentation in the neonatal intensive care unit (NICU) presents significant challenges, with nurses spending approximately 25% of their time on record-keeping, while up to 60% of interventions remain undocumented. Motivated by the need to detect interventions from video automatically, we present the Infant Care Video Dataset (ICVD), a collection of 4,144 videos spanning 12 simulated intervention classes designed for developing automated documentation systems. Our manikin-based approach systematically varies conditions, such as camera angle and clinician skin tone, while ensuring privacy compliance. Using video transformer architectures (TimeSformer and MotionFormer), we establish strong baseline performance (93.97% and 93.17% top-1 accuracy) among the 12 infant care classes. Our ablation study comparing temporal models with a framewise approach (23.17% accuracy) demonstrates a 70.80% performance gap, validating the need for temporal modeling. The ICVD provides a foundation for developing automated documentation systems to reduce clinical burden in neonatal care environments and improve existing practices.

[28] Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges cs.CVPDF

Joana Konadu Owusu, Shivanand Venkanna Sheshappanavar

TL;DR: 本文是一篇关于跨模态物体计数方法的综述性论文，系统梳理了该领域从特定类别密度回归到基于基础模型的开集计数方法的演变。论文指出当前评估体系滞后于方法宣称的通用性，并提出了一个五维分类法来审计文献，揭示了六大结构性矛盾，最后提出了构建稳健评估基础设施和未来研究方向（如组合场景理解）的路线图。

Details

Motivation: 动机在于指出当前开集物体计数方法在宣称通用性方面进展迅速，但其评估基础设施（如依赖少数饱和基准）未能有效揭示模型在语义基础、时序身份和空间遮挡推理等方面的系统性失败，存在评估与能力宣称脱节的问题。

Result: 论文未提出具体的新模型或定量性能结果，而是通过引入新的诊断数据集揭示了现有方法的系统性失败，并基于提出的五维分类法对多个应用领域（如显微、遥感、人群计数、农业）的文献进行了审计分析。

Insight: 主要创新点在于提出了一个系统性的五维分类法（模态、机制、提示、监督级别、泛化设置）来形式化分析跨模态计数领域，并从中提炼出六大结构性矛盾，为未来研究（如组合场景理解、主动计数智能体、统一多模态评估协议）指明了方向，核心见解是必须构建稳健的评估基础设施以区分真实开放世界泛化与基准特定优化。

Abstract: Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods now enumerate instances from various visual and textual prompts. While this shift marks major conceptual progress, our survey argues that claims of universal generality have outpaced the evaluative infrastructure. Most progress metrics rely on a few saturated benchmarks that models exploit for statistical regularities. Newly introduced diagnostic datasets reveal systematic failures in semantic grounding, temporal identity, and spatial reasoning with occlusion. To address these failures, we introduce a five-axis taxonomy (modality, mechanism, prompting, supervision level, and generalization setting). We use this taxonomy to audit the literature across application domains, including microscopy, remote sensing, crowd counting, and agriculture. This formalizes prevailing challenges into six structural contradictions. From these, we propose a roadmap for compositional scene understanding, active counting agents, and unified multimodal evaluation protocols. The main imperative is to build a robust evaluation infrastructure to distinguish open-world generalization from benchmark-specific optimization, rather than simple incremental engineering.

[29] DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models cs.CVPDF

Jeong-gi Kwak, Sho Kagami, Yuki Ono, Kwang Moo Yi

TL;DR: 本文提出了一种名为DDMS的判别性蒸馏方法，将多视图基础特征（如DINO）的知识重新蒸馏到单视图模型中，以增强特征的3D一致性和局部判别性。该方法通过融合预训练的2D基础特征与多视图几何特征构建多视图教师模型，并利用判别性排序目标进行精炼，最终获得既保持原始语义结构又具备更强3D感知能力的基础特征。

Details

Motivation: 现有基础视觉特征（如DINO）在多视图几何估计器中发挥关键作用，但单视图模型缺乏3D一致性，限制了其在3D计算机视觉任务（如图像间语义和几何对应）中的应用。

Result: 通过直接特征分析、密集预测迁移和显式3D提升与渲染等多角度实验验证，该方法显著提升了特征的3D一致性和局部判别性，同时保持了原始表示的语义可迁移性，在多个评估中均表现出更强的3D感知能力。

Insight: 创新点在于将多视图模型的3D几何知识通过判别性蒸馏框架融入单视图模型，实现了特征空间对齐下的3D一致性增强；客观分析认为，该方法巧妙结合了特征融合与排序目标，为提升基础特征的几何感知能力提供了新思路。

Abstract: Foundational visual features such as DINO have played a critical role across modern computer vision, and have recently become key components in multi-view feed-forward geometry estimators. In this work, we demonstrate that by re-distilling these multi-view models—their internal knowledge of 3D geometry—into a single-view estimator, we can obtain enhanced 3D consistent foundational features. Our key idea is to construct a multi-view teacher by fusing pretrained 2D foundation features with multi-view geometric features, and refining the fused representation with a discriminative ranking objective. Through our discriminative distillation framework, we enforce the learned features to be both 3D consistent and locally distinctive, while keeping them aligned with the feature space of the original foundation model to preserve the semantic structure of the pretrained representation. Consistency and local discriminability are critical for 3D computer vision problems such as forming semantic and geometric correspondences across images. To demonstrate the effectiveness of our method, we perform comprehensive experiments spanning multiple angles: direct feature analysis, dense prediction transfer, and explicit 3D lifting and rendering. Across these evaluations, our method consistently produces stronger 3D-aware foundation features that improve multi-view consistency and local discriminability while preserving the semantic transferability of the original representation.

[30] LUX: A Lesion-Aware Graph-Conditioned Visual - Language Architecture for Explainable Endoscopic Captioning cs.CVPDF

Alexis Ivan Escamilla-Lopez, Gilberto Ochoa-Ruiz, Salvador Hinojosa, Sharib Ali

TL;DR: 本文提出了一种名为LUX的图条件视觉-语言架构，用于可解释的内窥镜图像描述生成。该方法通过从Grad-CAM和CBAM激活图中构建以病灶为中心的场景图，将病理区域表示为节点并编码其空间和临床关系，然后将图嵌入集成到T5解码器的交叉注意力层中，使生成的词语能够关注特定的病灶节点，从而实现语言内容与病理证据的直接对齐。

Details

Motivation: 解决溃疡性结肠炎内窥镜图像解释的复杂性和主观性问题，现有视觉-语言模型依赖全局视觉嵌入，忽略了病理证据的局部性和关系性，限制了临床可靠性和可解释性。

Result: 在BLEU、METEOR、ROUGE-L和CIDEr指标上优于强基线模型和SOTA医学描述模型，尤其在CIDEr上提升显著；减少了幻觉临床发现，并通过生成标记与局部病理区域更强的对应关系改善了病灶级定位。

Insight: 创新点在于将病灶中心场景图与视觉-语言模型结合，通过图嵌入增强交叉注意力，实现标记级可解释性和关系推理；客观分析认为其将局部病理关系结构化并整合到生成过程中，是可借鉴的医学图像理解方法。

Abstract: The interpretation of endoscopic imagery in ulcerative colitis is complex and subjective, with variability in human assessment and subtle mucosal inflammation. Although deep learning has advanced automated analysis, most vision-language models rely on global visual embeddings that overlook the localized and relational nature of pathological evidence, limiting clinical reliability and interpretability. We introduce LUX (Lesion-aware Unified eXplainable captioning), a graph-conditioned vision-language architecture for explainable endoscopic image captioning. LUX constructs a lesion-centric scene graph from Grad-CAM and CBAM activation maps, representing pathological regions as nodes and encoding their spatial and clinical relationships. These graph embeddings are integrated into the cross-attention layers of a T5 decoder, enabling generated words to attend to specific lesion nodes rather than only to global image features. This provides direct alignment between linguistic content and pathological evidence, supporting token-level interpretability and relational reasoning. LUX outperforms strong baseline and state-of-the-art medical captioning models across BLEU, METEOR, ROUGE-L, and CIDEr, with particularly strong gains in CIDEr. It also reduces hallucinated clinical findings and improves lesion-level grounding through stronger correspondence between generated tokens and localized pathological regions.

[31] Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition cs.CVPDF

Mauro Comi, Jordi Serrano Berbel, Kevis-Kokitsi Maninis, Philipp Henzler, Manuel Sanchez

TL;DR: Gen2Physics是一个统一的自动化框架，旨在将生成的高保真3D网格模型转化为具备物理属性的资产。该框架通过多视角材料分解，将网格自动分解为不同材料的组成部分，并赋予物理属性，从而使其能够直接用于物理仿真。

Details

Motivation: 当前最先进的生成模型虽然能产生高保真3D网格，但这些输出缺乏物理属性，无法直接用于交互式仿真、游戏或机器人应用。Gen2Physics旨在解决这一限制，使生成的网格能够与标准物理引擎兼容。

Result: 在ABO-500和PartNet-Material基准测试中，Gen2Physics将材料分割的mIoU从先前方法的15.6提升至48.3，翻了一倍多。同时，它在质量估计精度上与体积方法相当，并且是唯一能输出密封的、按材料划分的子网格的方法。

Insight: 创新点在于直接操作网格而非体积表示，集成了微调的视觉Transformer进行密集材料分割、鲁棒的2D到3D一致性投影，以及利用视觉语言模型进行上下文推理以分配物理属性和推断内部几何结构（实心或空心）。这使得表面补丁能够被转换为具有不同密度的体积，从而实现物理上合理的动态仿真。

Abstract: While state-of-the-art generative models produce high-fidelity 3D meshes, these outputs lack the physical properties required for interactive simulation, gaming, or robotics. We introduce Gen2Physics, a unified and automated framework that grounds generated meshes in physics by automatically decomposing them into their constituent material components. Unlike prior approaches, which focus on volumetric representations incompatible with standard physics engines, Gen2Physics operates directly on meshes to produce immediately simulation-ready assets. Our pipeline integrates a fine-tuned Vision Transformer for dense material segmentation, a robust 2D-to-3D consistency projection, and a Vision-Language Model (VLM) guided refinement that leverages contextual reasoning to assign physical properties and infer internal geometry (solid vs. hollow). By converting surface patches into volumes with distinct densities, our method enables physically plausible dynamic simulations. Experimental results on the ABO-500 and PartNet-Material benchmarks demonstrate that Gen2Physics more than doubles the material segmentation accuracy of prior physics-grounding pipelines (15.6 to 48.3 mIoU), while matching the mass-estimation accuracy of volumetric methods and being the only approach to output watertight per-material sub-meshes.

[32] AffineTok: Semantic Affine Consistency for Diffusion-Friendly Visual Tokenizer cs.CVPDF

Junqiu Yu, Pandeng Li, Yikai Wang, Jiaxing Zhao, Yujie Wei

TL;DR: 本文提出了一种名为AffineTok的视觉分词器，旨在通过增强语义仿射一致性（SAC）来优化扩散模型的去噪过程。核心是引入两个训练组件（GSCT和PMSA）来组织潜在空间的语义，使得从带噪潜在中恢复干净图像的语义内容更容易。在ImageNet 256基准上，该方法显著提升了生成质量并达到了新的SOTA水平。

Details

Motivation: 现有视觉分词器在向潜在空间注入语义监督以辅助下游扩散模型时，对语义应如何组织以真正促进去噪过程缺乏深入探索。作者指出，现有方法直接预测带噪潜在的平均语义，而真正需要对齐的是干净潜在平均后的语义，这之间的不一致性影响了生成效果。

Result: 在ImageNet 256基准上，与基线相比，AffineTok在20个训练周期时将gFID降低了26%；经过持续训练后，在不使用无分类器引导的情况下达到了1.21的gFID（新的SOTA），在使用引导时达到1.10。所提出的度量M_SAC与生成质量（SiT-XL gFID）的皮尔逊相关性高达0.960，验证了其有效性。

Insight: 创新点在于明确了语义恢复目标，并提出了语义仿射一致性（SAC）这一关键要求，将其分解为最优语义预测误差和两个预测间的一致性误差。通过引入GSCT协调干净潜在的语义组织，以及PMSA对齐后验均值潜在的语义，在训练中系统性增强SAC，从而显著提升扩散模型的生成性能。

Abstract: Visual tokenizers increasingly inject semantic supervision into latent spaces to make downstream diffusion easier. Yet how these semantics should be organized to facilitate denoising remains underexplored. In this paper, we define the semantic recovery objective: the denoising process should recover the semantic content of the clean image from noisy latent, and a good tokenizer should make it easier. Existing approaches train a projector to predict the semantics directly from the noisy latent. We argue that this predicts the average of clean-image semantics, whereas what really needs to be aligned is the semantics of averaged clean latents. More importantly, we demonstrate that the semantic recovery error orthogonally decomposes into the error of the optimal semantic prediction directly from the noisy latent and the error between these two predictions. We therefore identify their consistency as the missing requirement and call it Semantic Affine Consistency (SAC). To examine whether this overlooked requirement is closely related to downstream generation, we introduce M_SAC, a tokenizer-side proxy for SAC. Across the evaluated tokenizers and diffusion model scales, M_SAC closely tracks generation quality, reaching a Pearson correlation of 0.960 with SiT-XL gFID, thereby motivating SAC-guided tokenizer training. We then introduce AffineTok, which promotes SAC through two complementary, training-only components. Global Semantic Coordination Token (GSCT) coordinates the semantic organization of clean latents, keeping semantic averaging meaningful, while Posterior-Mean Semantic Alignment (PMSA) predicts posterior-mean latents from noisy inputs and supervises their semantics. On ImageNet 256, compared with the baseline, AffineTok reduces gFID by 26% at 20 epochs and, with continued training, achieves a new state-of-the-art gFID of 1.21 without classifier-free guidance and 1.10 with guidance.

[33] LG-GER: Language-Guided Group Emotion Recognition via Multimodal Evidence Distillation cs.CVPDF

Ahmed Shehab Khan, Zhiyuan Li, Yan Tong

TL;DR: 本文提出LG-GER，一种用于群体情感识别的语言引导蒸馏框架。该方法利用多模态大语言模型为训练图像生成带有情感信号和置信度的密集空间证据，并通过四种互补损失将其蒸馏到单一视觉语言模型主干中。在推理时，该方法无需检测器、MLLM或多流融合，实现了高效部署，并在两个基准数据集上取得了有竞争力或更优的结果。

Details

Motivation: 当前群体情感识别方法依赖检测器驱动的多流管道，且仅使用图像级监督训练，缺乏对关键区域及其贡献强度的指导。本文旨在解决这一问题，通过引入语言引导的密集证据来提供更精细的监督信号。

Result: 在GroupEmoW和GAF 3.0两个基准数据集上进行了评估，LG-GER取得了与最先进方法相当或更优的结果，而这些最先进方法在推理时仍需检测和多流处理。

Insight: 创新点在于利用MLLM生成结构化的空间证据（边界框与情感信号配对）作为监督信号，并通过多任务损失蒸馏到单一VLM主干中，从而在推理时摆脱了对检测器和复杂多流融合的依赖，实现了高效且性能优越的群体情感识别。

Abstract: Inferring the collective emotional state of a group of people from a single image, a task known as group emotion recognition (GER), requires integrating spatially distributed cues such as faces, poses, interactions, and scene context. Current methods rely on detector-driven multi-stream pipelines. These are trained with only image-level supervision that lacks guidance on which regions matter or how strongly each contributes. We propose LG-GER, a language-guided distillation framework that uses a multimodal large language model (MLLM) to generate dense, spatially grounded evidence, i.e., bounding boxes paired with emotion signals and confidence scores, for the training images. This structured evidence is distilled into a single vision-language model (VLM) backbone through four complementary losses: classification, region-text grounding, spatial emotion, and spatial confidence regression. At inference, LG-GER requires no detectors, no MLLM, and no multi-stream fusion, making GER practical for real-time and resource-constrained deployment. LG-GER has been evaluated on two benchmark GER datasets (GroupEmoW and GAF~3.0) and achieves competitive or superior results compared to state-of-the-art methods that require detection and multi-stream processing at inference.

[34] GlanceWAM: Sparse Test-Time Imagination for World-Action Models cs.CVPDF

Linhan Wang, Zijian An, Mingyuan Zhang, Chen Dai, Yi Xu

TL;DR: GlanceWAM是一种用于世界-动作模型（WAMs）的稀疏测试时想象方法，旨在解决视频生成模型在机器人学习中实时控制与任务成功率之间的权衡问题。该方法通过异步生成未来单帧的视觉想象并在潜在空间中直接解码动作块，实现了低延迟和高成功率。

Details

Motivation: 现有世界-动作模型在控制速率下同步生成视频会导致高延迟，而放弃测试时视觉想象则会牺牲任务成功率，因此需要一种能同时实现实时推理和保持高成功率的方法。

Result: 在RoboCasa厨房基准测试的24个任务上达到72.2%的成功率（优于同步Cosmos Policy的67.1%和无想象协同训练的64.4%），在LIBERO上达到99.0%的成功率，在NVIDIA A100 GPU上以每块48毫秒的速度执行（比同步基线快24倍）。

Insight: 创新点在于将想象与控制解耦，通过异步提议者在慢时钟上提前生成单帧未来视觉想象，并结合非干扰注意力掩码隔离视频表示以及抗陈旧性的水平训练来适应异步前瞻老化，从而打破了速度与成功率之间的困境。

Abstract: Video generative models provide rich physical priors for robot learning, yet existing world-action models (WAMs) face a fundamental trade-off: synchronous video generation at control rate is latency-prohibitive, while abandoning test-time visual imagination sacrifices task success. We show that visual imagination achieves both real-time inference and superior success rates when generated asynchronously off the critical path and consumed directly in latent space. We introduce GlanceWAM, which decouples imagination from control within a single video DiT: an asynchronous proposer glances ahead on a slow clock to imagine a single lookahead frame seconds into the future in the background, while an action head decodes action chunks at control rate (48 ms) purely in latent space without blocking. Enabled by a non-interfering attention mask that isolates video representations and staleness-robust horizon training that accommodates asynchronous lookahead aging, GlanceWAM breaks the speed-success dilemma. Trained purely on demonstrations, it attains 72.2% on the 24-task RoboCasa kitchen benchmark (surpassing synchronous Cosmos Policy at 67.1% and imagination-free co-training at 64.4%) and 99.0% on LIBERO, executing at 48 ms per chunk on an NVIDIA A100 GPU (24x faster than synchronous baselines). Code is available at https://github.com/linhanwang/GlanceWAM.

[35] Continual Visual Learning under Evolving Semantic Concept Shift cs.CV | cs.CLPDF

Ismail Lamaakal, Chaymae Yahyati, Yassine Maleh, Khalid El Makkaoui, Ibrahim Ouahbi

TL;DR: 本文提出了一种名为SemReWrite的框架，用于处理视觉基础模型在长期运行中面临的语义概念演变问题，即预测任务的语义定义（如分类体系）会随时间变化，导致相同视觉证据需要不同的解释。该框架通过选择性更新过时的视觉-语义映射，同时保留仍然有效的知识，以应对类别分裂、合并、边界修订等多种语义转变。

Details

Motivation: 现有视觉基础模型通常假设预测任务的语义含义是固定的，仅处理外观变化；但在长期视觉系统中，分类体系、策略和概念定义本身可能演变，导致语义概念偏移，需要模型适应新的语义解释而不遗忘旧知识。

Result: 在涵盖ImageNet、iNaturalist、CUB-200-2011和DomainNet的EvoShift-Bench基准上，SemReWrite在Rewrite Accuracy (RA)、Preservation Accuracy (PA)、Obsolete Retention (OR)和Selective Revision Score (SRS)等指标上，比提示替换、传统微调、参数高效适应和持续学习策略更好地平衡了学习修订语义和保留未受影响知识。

Insight: 创新点包括：引入语义概念演变设置和EvoShift-Bench基准；提出SemReWrite框架，通过语义差异分析和稀疏修订监督定位受影响的视觉区域，并采用输入依赖的低秩重写机制与结构化语义记忆、保留和过时决策抑制；定义了针对选择性语义修订的评估指标（如RA、PA、OR、SRS），为持续视觉学习提供了新方向。

Abstract: Visual foundation models are commonly adapted under the assumption that the appearance of incoming data may change while the semantic meaning of the prediction task remains fixed. In long-lived visual systems, however, taxonomies, policies, and concept definitions can themselves evolve, causing the same visual evidence to require a different interpretation. We study this setting as evolving semantic concept shift and introduce SemReWrite, a framework for selectively updating obsolete visual–semantic mappings while preserving knowledge that remains valid. SemReWrite represents changes between old and revised semantic specifications, combines semantic discrepancy with sparse revised supervision to localize affected visual regions, and uses an input-dependent low-rank rewriting mechanism together with structured semantic memory, preservation, and obsolete-decision suppression. We further introduce EvoShift-Bench, spanning ImageNet, iNaturalist, CUB-200-2011, and DomainNet, with semantic transitions including class split, merge, boundary revision, insertion, partial redefinition, recurrence, and mixed semantic–appearance shift. To explicitly evaluate selective semantic revision, we introduce Rewrite Accuracy (RA) and Preservation Accuracy (PA) for affected and unaffected regions, respectively, Obsolete Retention (OR) for measuring residual outdated semantic associations, and the Selective Revision Score (SRS), which jointly summarizes rewriting and preservation performance. Experiments show that SemReWrite achieves a stronger balance between learning revised semantics and retaining unaffected knowledge than prompt replacement, conventional fine-tuning, parameter-efficient adaptation, and continual-learning strategies.

Yuanhao Sun, Huawei Ji, Yuan Jin, Cheng Deng, Luoyi Fu

TL;DR: 本文提出了一种名为HAP（Head-Adaptive Visual Token Pruning via Cross-Modal Alignment）的视觉令牌剪枝方法，旨在高效压缩视觉语言模型中冗长的视觉令牌序列以降低计算成本。该方法通过引入PAQ（Prompt-Grounded Attention Quality）指标来量化每个注意力头与提示的对齐质量，并基于此进行分阶段的令牌剪枝，从而在保持模型性能的同时显著减少计算量。

Details

Motivation: 现有视觉语言模型将高分辨率图像编码为长视觉令牌序列，导致高昂的预填充计算成本。现有剪枝方法通过平均所有注意力头的文本到视觉注意力来评分令牌，但忽略了注意力头之间的错位问题，这会放大背景令牌并淹没细粒度线索。

Result: 在18个基准测试中，该方法实现了最先进的性能-计算权衡。具体而言，在LLaVA-1.5-7B模型（9个任务）上，仅保留5.6%的令牌即可维持99.1%的原始性能，比最强基线AutoPrune高出4.2个百分点。

Insight: 创新点在于提出了PAQ指标来评估每个注意力头与提示的对齐质量，并基于此进行加权聚合以更准确地评分令牌重要性，避免了均匀平均导致的信号稀释。这为跨模态对齐下的高效令牌剪枝提供了新思路。

Abstract: Recent Vision-Language Models encode high-resolution images into long visual token sequences, incurring prohibitive prefill costs. To compress them, existing methods score each visual token by averaging text-to-visual attention uniformly across all heads, which assumes every head matches the query. However, our empirical analysis shows that misaligned heads dominate the average, amplifying background tokens and drowning out fine-grained cues. To address this, we propose PAQ (Prompt-Grounded Attention Quality), a metric quantifying how well each head aligns the prompt with image regions. Built on PAQ, our pruning proceeds in three stages. Given a target FLOPs budget, we first partition the transformer layers into groups and allocate a visual token budget to each. Within each group, we then aggregate per-head attention maps via PAQ-weighted softmax into a group-level matrix. Finally, we score visual tokens by this matrix’s magnitude and retain the allocated budget per group. By weighting heads with PAQ, our method scores tokens by attention signals that more faithfully reflect prompt relevance, rather than diluting them through uniform averaging. Across 18 benchmarks, our method delivers state-of-the-art trade-offs. Specifically, on LLaVA-1.5-7B (9 tasks), retaining only \textbf{5.6%} tokens preserves \textbf{99.1%} of the original performance, surpassing the strongest baseline AutoPrune by 4.2 points. Code is available in https://github.com/baokou-fw2/HAP.

Linzhe Jiang, Jiayuan Huang, Changhao Zhang, Chunyang Jiang, Zhehua Mao

TL;DR: 本文提出了RefineRank方法，用于解决手术视频时空定位任务中现有方法在问题理解和精确定位之间的权衡问题。该方法通过一个可训练的轻量级模块RefineNet，结合冻结的医学视觉语言模型和开放集检测器的输出，对候选框进行坐标修正和质量评分，从而提升定位精度。

Details

Motivation: 现有方法存在权衡：视觉语言模型能理解问题上下文但坐标不精确，而开放集检测器能提供定位候选框但其置信度不能反映哪个框能回答问题。RefineRank旨在候选框层面弥合这一差距。

Result: 在MedVidBench官方排行榜上，RefineRank取得了0.421的STG mIoU，为展示的最高STG分数。在可控评估中，坐标修正将候选框理论上限从0.6772提升至0.7302，结合评分排序将STG mIoU从0.2719提升至0.4534，优于单独训练的基线方法。

Insight: 创新点在于设计了一个小型模块，在不重新训练骨干网络的情况下，通过联合坐标修正和排序，将问题理解与精确定位相协调。其解码规则固定，结合了原始和修正候选框的联合池，并通过单一模块预测修正和评分，实现了性能提升。

Abstract: Surgical spatio-temporal grounding (STG) requires locating, at each video time specified by a procedural question, the object that the question asks about. Existing approaches face a trade-off: vision language models understand the question context but produce imprecise coordinates, whereas open-set detectors provide localized candidate boxes whose confidence does not reflect which box answers the question. We introduce RefineRank, which closes this gap at the candidate-box level. A compact trainable module, RefineNet, combines the language and regional features of a frozen medical vision language model with the proposals of a frozen open-set detector: it predicts a bounded coordinate correction and a quality score for every candidate box, and a fixed decoding rule returns the original or refined box with the highest score. On the MedVidBench Official Rankings (Verified), RefineRank records 0.421 STG mIoU, the highest displayed STG score, while its global multi-metric rank is 11. In a controlled evaluation on separate training and evaluation videos, coordinate correction raises the candidate oracle upper bound from 0.6772 to 0.7302, and ranking the joint pool of original and refined candidates by their RefineNet scores improves STG mIoU from 0.2719 to 0.4534, whereas separately trained selectors over the same pool reach at most 0.4186. These results show that a small box-level module can reconcile question understanding with precise localization without retraining either backbone. Code is available at https://github.com/linzhe001/RefineRank.

[38] Luce: Relightable Gaussians for 3D Asset Generation cs.CV | cs.AI | cs.GRPDF

Mayank Singh, Michele Stoppa, Alvise Memo, Rui Yu, Harsha Kalli

TL;DR: 本文提出了Luce，一种用于从单张图像生成高质量、可重光照3D资产的统一表示方法。它将几何与基于物理的渲染材质统一在一个体素化的多模态高斯云中，并通过变分自编码器将其压缩到一个统一的、材质感知的潜在空间。一个整流流变换器从单张图像生成该潜在表示，最终解码为可重光照的PBR高斯模型和可选的带法线贴图的纹理网格。

Details

Motivation: 为了支持可重光照和集成到标准渲染管线，高保真的图像到3D生成需要一个能同时捕捉几何和外观，并包含反照率、金属粗糙度、表面法线等PBR模态的3D表示。

Result: 在Toys4K数据集上，Luce实现了单图像到3D生成的SOTA性能，将FID指标比最强基线提升了28%。在一个AI生成图像的基准测试上，Luce的CLIP图像对齐分数（0.8519）也优于最佳基线（0.8299）。

Insight: 创新点在于将多种PBR材质模态与几何统一在体素化的多模态高斯云表示中，并使用材质感知的潜在空间和整流流变换器进行生成，从而能保留文本、徽标等精细细节，生成几何准确、材质忠实且可重光照的资产。

Abstract: High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration into standard rendering pipelines, the representation should include physically based rendering (PBR) modalities such as albedo, metallic-roughness, and surface normals. We propose Luce, a 3D representation that unifies geometry and PBR materials within a voxelized multimodal Gaussian cloud, using dedicated Gaussian primitives for each modality. A variational autoencoder compresses this representation into a unified material-aware latent space. A rectified-flow transformer generates this latent from a single image, conditioned on multi-layer features from a pretrained image encoder that preserve both semantic context and fine spatial detail. The latent then decodes into relightable PBR Gaussians and an optional textured mesh with a tangent-space normal map. On Toys4K, Luce achieves state-of-the-art single-image-to-3D generation, improving FID by 28% over the strongest baseline. We further introduce a benchmark of AI-generated images, on which Luce improves the CLIP image-alignment score over the best baseline (0.8519 vs. 0.8299). Luce generates relightable, geometrically accurate, and materially faithful assets that preserve fine details such as text, logos, and inscriptions.

[39] Boot-and-Feedback Framework for Generalist-Expert Model Collaboration in Breast Ultrasound Diagnosis cs.CV | cs.MMPDF

Ming Cheng, Hongyu Sun, Zhaolin Chen, Jun Liu, Hossein Rahmani

TL;DR: 本文提出了一种名为Boot-and-Feedback（BooF）的通用模型与专家模型协作框架，用于提升乳腺超声（BUS）诊断的准确性和可解释性。该框架通过引导多模态大语言模型（MLLM）避免幻觉生成可靠描述，并利用反馈机制让视觉专家模型自适应地融合文本信息，从而协同工作。

Details

Motivation: 解决乳腺超声诊断中深度学习模型可靠性、可解释性不足，以及当前多模态大语言模型因缺乏领域知识而产生误导性描述，进而损害临床有效性的问题。

Result: 在多个乳腺超声数据集上的大量实验表明，BooF框架在诊断准确性和可解释性方面显著优于当前最先进（SOTA）的方法。

Insight: 创新点在于提出了一个两阶段（引导与反馈）的协同框架，通过结合BI-RADS词典和初步视觉专家预测来引导MLLM，并设计了轻量级的注意力门控跨模态融合模块，使专家模型能自适应地利用文本反馈并过滤噪声。

Abstract: Breast ultrasound (BUS) is widely used for breast cancer diagnosis yet remains operator-dependent. While deep learning shows promise, ensuring diagnostic reliability and interpretability is challenging. Recent Multimodal Large Language Models (MLLMs) often generate spurious descriptions due to limited domain knowledge, which mislead downstream expert models and compromise clinical validity. To address these challenges, we propose the Boot-and-Feedback (BooF) model collaboration framework for synergistic MLLM-expert interaction. Specifically, in the Boot Stage, the MLLM is guided by the BI-RADS lexicon and preliminary benign-malignant vision-expert predictions, enabling it to transfer general reasoning to BUS analysis while avoiding hallucinations. Subsequently, the Feedback Stage integrates these descriptions with visual features via a lightweight Attention-Gated Cross-Modality Fusion Module. This allows the expert to leverage textual feedback while adaptively filtering noise. Extensive experiments on multiple BUS datasets demonstrate that BooF substantially outperforms state-of-the-art methods in terms of diagnostic accuracy and interpretability.

[40] IterCAD: Iterative Program Repair for CAD Code Generation from Orthographic Views cs.CV | cs.AIPDF

Yuchuan Wu, Ke Niu, Haiyang Yu, Zhuofan Chen, Xiangyang Xue

TL;DR: 本文提出IterCAD，一种迭代式程序修复框架，用于从正交视图生成可执行的参数化CAD代码。该方法将CAD代码生成重新定义为渐进式程序修复过程，通过反复分析当前CAD结果、推理其与目标视图的差异，并决定是否修订代码或停止优化，从而逐步修正结构和参数错误。

Details

Motivation: 现有视觉语言方法通常将正交视图到CAD代码的生成视为一次性生成任务，导致模型无法检查中间CAD结果并纠正早期错误，常产生不可执行代码或几何不一致的输出。

Result: 在CADExpert基准测试中，IterCAD相比强有力的一次性基线方法，持续提升了代码可执行性和几何保真度。

Insight: 创新点在于引入迭代修复范式，构建了包含可修复中间状态和正确状态的监督数据集IterCAD-RS，并采用三阶段训练策略（初始生成、修订学习和多轮强化学习优化），实现了视觉理解、几何验证和代码优化之间的闭环反馈机制。

Abstract: Generating executable parametric CAD code from dimension-annotated orthographic drawings is a challenging task requiring geometric understanding, procedural reasoning, and precise numerical prediction. Existing vision-language approaches typically formulate this problem as one-shot generation, preventing the model from inspecting intermediate CAD results and correcting early mistakes, often leading to non-executable code or geometrically inconsistent outputs. In this paper, we propose IterCAD, an iterative framework that reformulates orthographic-view-to-CAD generation as a progressive program repair process. Instead of predicting the final CAD code in a single pass, IterCAD repeatedly analyzes the current CAD result, reasons about its discrepancy with the target views, and explicitly decides whether to REVISE the code or STOP the refinement process. To make iterative repair learnable, we further construct IterCAD-RS, a structured revise-or-stop supervision set containing both repairable intermediate CAD states and already-correct states, and develop a three-stage training strategy for initial generation, revision learning, and multi-turn RL optimization. By closing the loop between visual understanding, geometric verification, and code refinement, IterCAD progressively corrects structural and parametric errors. Experiments on CADExpert show that IterCAD consistently improves code executability and geometric fidelity over strong one-shot baselines.

[41] Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation cs.CVPDF

Haojin Li, Hengzhuo Wang, Chang Liu, Zhiheng Ma, Heng Li

TL;DR: 本文提出了一种基于低秩速度场的无监督4D医学图像插值方法，通过将运动建模为Tucker低秩速度场，将运动分解为全局共享的空间基和紧凑的样本特定核心，从而在仅使用起始和结束体积进行训练的情况下，合成具有稳定边界和生理一致运动的中间体积。该方法采用从粗到细的多尺度方案建模运动，并在推理时组合尺度变形以合成任意时间点的体积。

Details

Motivation: 解决仅使用端点（起始和结束体积）进行无监督训练的4D医学图像插值问题，该弱约束设置通常导致中间体积具有不稳定边界和非生理运动，限制了可解释性和下游分析。

Result: 在ACDC和4D-Lung数据集上的实验表明，该方法取得了最先进的性能，与使用中间帧监督训练的方法相比仍具有竞争力，并生成了具有改进结构连贯性和更稳定解剖轮廓的中间体积。

Insight: 创新点在于引入低秩速度场作为结构先验，约束运动到一个结构化的Tucker低秩速度场空间，这鼓励了空间相关、解剖一致的变形，同时抑制了体素级高频伪影；理论分析表明低秩参数控制速度场的平滑能量，解释了低秩建模促进更平滑运动的原因。

Abstract: Endpoint-only unsupervised 4D medical image interpolation synthesizes intermediate volumes from sparsely sampled sequences with only the start and end volumes available for training; however, this weakly constrained setting often yields intermediates with unstable boundaries and non-physiological motion, limiting interpretability and downstream analysis. We propose low-rank velocity fields as a structural prior, constraining motion to a structured Tucker low-rank velocity field space that decomposes motion into globally shared spatial bases and a compact sample-specific core, thereby encouraging spatially correlated, anatomy-consistent deformation while suppressing voxel-wise high-frequency artifacts. To capture global coordination and local non-rigid details, we model motion in a coarse-to-fine multi-scale scheme and compose scale-wise deformations at inference to synthesize volumes at arbitrary times. We further provide a theoretical analysis showing that, under Tucker parameterization, low-rank parameters control the smoothness energy of the velocity field, explaining why low-rank modeling promotes smoother motion. Experiments on ACDC and 4D-Lung demonstrate state-of-the-art performance, remaining competitive with methods trained with intermediate-frame supervision, and producing intermediates with improved structural coherence and more stable anatomical contours.

[42] ConsensusTAS: Self-Supervised Temporal Action Segmentation for Long-Horizon Construction Videos cs.CVPDF

Xiaoshan Zhou, Yafei Sun

TL;DR: 本文提出了一种名为ConsensusTAS的自监督学习方法，用于对长时程施工视频进行时序动作分割，将连续视频流分割成不同的活动阶段。该方法无需标注，通过利用候选分割的内部一致性来实现。

Details

Motivation: 在协作人机工作中，识别连续的施工活动至关重要，但现有研究多局限于活动分类，而非从长序列中识别细粒度的活动转换。由于标注长施工视频中的动作时间边界非常耗时，因此需要一种无需标注的解决方案。

Result: 该方法在三个公共数据集（GTEA、Breakfast和Assembly101的静态摄像头视频）上评估，均优于最先进的方法，具体指标为：GTEA上F1@10为73.08，Breakfast上F1@10为64.33，Assembly101上F1@50为33.50。在真实施工视频的后验评估中也成功分割了砌砖等复合活动。

Insight: 创新点在于提出了一种完全自监督、无需标注的时序动作分割框架，通过候选分割的内部共识进行学习。其优势在于计算效率高，可在CPU上运行，无需依赖计算密集型的大型视觉语言模型，为移动机器人平台的视频监控和人机协作提供了实用价值。

Abstract: Recognizing sequential construction activities is important for collaborative human-robot work; for example, robots are able to understand workers’ current and upcoming actions and provide timely tool delivery or physical support. However, despite extensive research on construction worker activity recognition, existing studies have been limited to classifying activity categories, such as climbing, lifting, and walking, instead of recognizing fine-grained activity transitions from long-horizon sequences. Addressing this problem is challenging because annotating action temporal boundaries in long construction videos is time-consuming. In this study, we propose ConsensusTAS, a label-free, self-supervised learning approach to segment continuous video streams into distinct activity phases by exploiting the internal consensus of candidate segmentations. We evaluated our algorithm on three public datasets, where it outperformed state-of-the-art methods, achieving an F1@10 of 73.08 on GTEA, an F1@10 of 64.33 on Breakfast, and an F1@50 of 33.50 on static-camera videos from Assembly101. We also tested it on real-world construction videos, where post-hoc evaluation showed that the model successfully recognized and segmented actions within the composite activity of bricklaying, such as spreading mortar on a brick, placing the brick, pressing, and aligning. Compared with other temporal action segmentation models that require computationally intensive large vision-language models, our method can run on a CPU, which provides practical value for video surveillance and human-robot collaboration on mobile robotic platforms.

Junjie Zhou, Ke Mei, Lei Li, Tianyi Wang, Fengyun Rao

TL;DR: 本文介绍了WeMM-Embedding，一个支持文本、图像、视频、视觉文档及任意交错多模态输入的通用多模态嵌入模型家族，包含2B、4B和9B参数变体。它采用两阶段训练，并在多个公开基准测试中取得领先性能，特别是在MMEB-v2基准上，9B变体实现了80.6的SOTA总分。模型已在微信多个应用场景中大规模部署，并开源了权重和代码。

Details

Motivation: 通用多模态嵌入是现代AI系统的核心组件，用于在共享空间中表示异构内容，以支持检索、推荐、分类和智能体等应用。

Result: 在多个公开基准测试中取得领先性能，其中2B变体在MMEB-v2上超越了此前领先的8B开源基线，9B变体则实现了80.6的SOTA总分。在内部26个任务基准和14个在线A/B测试中也表现出色。

Insight: 创新点包括支持灵活输出维度和任意交错多模态输入，以及采用两阶段训练策略（大规模多模态对齐 + 使用精选数据、细粒度相关性监督和跨尺度知识转移的微调阶段）。客观来看，其模型家族设计和在微信生态中的大规模实际部署验证具有借鉴意义。

Abstract: Universal multimodal embeddings are becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space for applications such as retrieval, recommendation, classification, and agentic systems. In this report, we present WeMM-Embedding, a family of universal multimodal embedding models supporting text, images, videos, visual documents, and arbitrarily interleaved multimodal inputs with flexible output dimensions. The family comprises 2B, 4B, and 9B variants and is trained in two stages: a large-scale multimodal alignment stage, followed by a refinement stage using curated data, fine-grained relevance supervision, and cross-scale knowledge transfer. Across extensive evaluations, WeMM-Embedding achieves leading performance on multiple public benchmarks. Notably, the 2B variant already surpasses the previously leading 8B open-source baseline on MMEB-v2, while the 9B variant further achieves a new state-of-the-art overall score of 80.6. WeMM-Embedding also demonstrates strong practical performance across WeChat applications, with substantial gains on a 26-task in-house benchmark and consistent improvements across 14 online A/B tests. It has been deployed at scale across recommendation and search applications, including WeChat Channels, Official Accounts, Moments, and e-commerce services. We have released the model weights and code to facilitate future research at https://github.com/Tencent/WeMM-Embedding.

[44] Joint-Embedding Prediction of Masked Point Tubes for Self-Supervised Learning on 4D Point Cloud Videos cs.CV | cs.LGPDF

Jheng-Ling Lee, Shang-Tse Chen

TL;DR: 本文提出了一种基于联合嵌入预测（JEPA）的自监督学习框架，用于4D点云视频表示学习。该方法通过掩码时空区域并预测其在特征空间中的表示，而非重建原始坐标，旨在捕获空间结构和时间动态。实验表明，该框架在动作和手势识别基准上提升了下游任务的性能。

Details

Motivation: 解决4D点云视频标注成本高的问题，并避免基于重建的预训练方法过度关注低层几何细节，从而更好地与下游语义识别任务对齐。

Result: 在动作和手势识别基准测试中，该方法提高了下游任务的微调性能、有限标签学习和跨数据集迁移能力，表明其作为替代重建中心预训练的有效性。

Insight: 创新点在于将JEPA风格框架应用于4D点云视频，通过潜在点管预测和Sketched Isotropic Gaussian Regularization稳定嵌入，避免表示塌陷，同时捕获时空信息。

Abstract: Self-supervised representation learning for 4D point cloud videos is challenging because annotations are costly and reconstruction-based pretraining can overemphasize low-level geometric details. We propose a JEPA-style framework that learns from unlabeled spatiotemporal point clouds through latent point-tube prediction. Instead of reconstructing raw coordinates, the model masks spatiotemporal regions and predicts their target representations from visible context representations in feature space. To stabilize latent prediction, we incorporate Sketched Isotropic Gaussian Regularization, which encourages non-collapsed embeddings without relying on explicit reconstruction targets. This formulation aims to capture both spatial structure and temporal dynamics while keeping the pretraining objective aligned with downstream semantic recognition. Experiments on action and gesture recognition benchmarks show that the learned representations improve downstream fine-tuning, limited-label learning, and cross-dataset transfer. These results suggest that JEPA-style latent prediction is a promising alternative to reconstruction-centered pretraining for 4D point cloud videos.

[45] VisCache: Visual KV Cache Pruning for Efficient Vision Large Language Model Inference cs.CV | cs.AIPDF

Lyuke Wang, Zhuo Li, Guangxu Zhu

TL;DR: 本文提出VisCache，一种无需训练的视觉KV缓存剪枝框架，旨在解决视觉大语言模型（VLLM）长上下文推理中计算和内存开销巨大的问题。该框架通过两阶段协同工作：首先使用轻量级VLM过滤时间冗余，选择性地转发关键帧；其次引入PruneKV算法，根据注意力动态进行细粒度KV压缩，采用抛物线式分层预算分配和非对称更新机制，在剪枝键的同时融合值以保留关键上下文信息。

Details

Motivation: 动机在于现有KV压缩方法通常对视觉令牌和层进行均匀剪枝，导致大量信息丢失和性能下降，而VLLM的长上下文推理因视觉KV缓存的计算和内存开销而极其昂贵，因此需要一种更高效的压缩方法。

Result: 实验表明，VisCache显著提升了推理效率，在仅保留19-28% KV缓存的情况下，实现了高达2.35倍的加速和显著的内存减少，同时保持了有竞争力的性能，在多个基准测试中优于现有基线，为长上下文VLLM推理建立了新的帕累托前沿。

Insight: 创新点包括：1）无需训练的即插即用框架，结合粗粒度关键帧选择和细粒度KV剪枝；2）PruneKV算法通过抛物线分层预算分配和非对称更新（剪枝键、融合值），针对VLLM注意力动态进行定制化压缩，有效平衡效率与性能。

Abstract: While Vision Large Language Models (VLLMs) have achieved remarkable success in multimodal reasoning, their long-context inference remains prohibitively expensive due to the massive computation and memory overhead of visual Key-Value (KV) caches. Existing KV compression methods often apply uniform pruning across visual tokens and layers, leading to substantial information loss and degraded performance.To address this challenge, we propose \textbf{VisCache}, a plug-and-play framework for coarse-to-fine \textbf{Vis}ual KV \textbf{Cache} pruning without training, which consists of two synergistic stages. First, a lightweight VLM filters temporal redundancy by selectively forwarding semantically informative keyframes. Second, we introduce {PruneKV}, a surgical KV compression algorithm tailored to the attention dynamics of VLLMs. Unlike rigid pruning strategies, PruneKV adopts a parabolic layer-wise budget allocation together with an asymmetric update mechanism that selectively prunes keys while fusing values, thereby preserving critical contextual information. Extensive experiments demonstrate that VisCache substantially improves inference efficiency, achieving up to {2.35$\times$ speedup} and significant memory reduction while maintaining competitive performance with only {19–28%} KV cache retention. VisCache consistently outperforms existing baselines, establishing a new Pareto frontier between efficiency and performance for long-context VLLM inference. Code is available at https://github.com/Wlklk/VisCache

[46] DRRG: A Discrete Diffusion Framework for Radiology Report Generation cs.CVPDF

Shaoyang Zhoua, Yingshu Li, Yunyi Liu, Lijun Pu, Lingqiao Liu

TL;DR: 本文提出了一种用于放射学报告生成（RRG）的离散扩散框架DRRG，该框架采用迭代去噪生成文本，而非传统的自回归逐词生成方式。DRRG引入了临床实体感知的互补掩码和概念条件模块，以提升报告质量和临床一致性。在MIMIC-CXR和CheXpert Plus数据集上的实验表明，该方法在多项指标上超越了现有方法。

Details

Motivation: 现有自回归方法逐词生成报告，无法修正早期错误，容易导致错误传播，且与放射学报告迭代优化的实际过程不符。离散扩散大语言模型通过迭代去噪生成文本，天然支持报告迭代优化，但尚未在RRG领域得到充分探索。

Result: 在MIMIC-CXR数据集上，DRRG在BLEU-4、CheXpert-F1、RadGraph-F1、GREEN和RaTEScore等多项指标上超越了对比方法，尽管使用了更小的LLM解码器。在CheXpert Plus数据集上，DRRG也取得了最高的BLEU-4和CheXpert-F1分数。

Insight: 创新点在于将离散扩散模型引入RRG任务，实现了报告的迭代双向优化；同时设计了临床实体感知的互补掩码以增强对关键实体的监督，以及概念条件模块将图像衍生的临床概念注入视觉表征，从而提升报告的临床准确性和一致性。

Abstract: Purpose: Automatic radiology report generation (RRG) has been widely explored to improve reporting accuracy and reduce radiologists’ workload. Most existing methods rely on autoregressive (AR) frameworks that generate reports token by token and cannot revise earlier content, making them prone to error propagation and inconsistent with the iterative refinement process of radiological reporting. In contrast, discrete diffusion large language models (DLLMs) generate text through iterative denoising, naturally enabling report refinement. However, DLLMs have not been extensively investigated for RRG. In this study, we developed and evaluated a discrete diffusion framework for RRG that enables iterative refinement rather than conventional left-to-right autoregressive decoding. Materials and methods: We developed DRRG, a DLLM-based framework that formulates RRG as iterative masked-token denoising. DRRG incorporates a clinical-entities-aware complementary mask to improve token supervision coverage and emphasize clinically important entities, together with a concept-conditioning module that injects image-derived clinical concepts into visual representations. DRRG was trained and evaluated on MIMIC-CXR and CheXpert Plus. Results: On MIMIC-CXR, DRRG achieved BLEU-4 of 0.210, CheXpert-F1 of 0.549, RadGraph-F1 of 0.281, GREEN of 0.360, and RaTEScore of 0.604, outperforming the compared methods on most reported metrics, despite employing a substantially smaller LLM decoder. On CheXpert Plus, DRRG achieved the highest BLEU-4 (0.119) and CheXpert-F1 (0.347) among the compared methods. Conclusion: Discrete diffusion provides an effective alternative to autoregressive radiology report generation by enabling iterative, bidirectional report refinement. Incorporating clinically focused masking and image-derived concept conditioning improves report quality and clinical consistency.

[47] Graph-Supervised Hierarchical Clinical Alignment for Radiology Report Generation with Large Language Models cs.CVPDF

Yingshu Li, Yunyi Liu, Zhanyu Wang, Zailong Chen, Lingqiao Liu

TL;DR: 本文提出了一种名为Graph-Supervised Hierarchical Clinical Alignment的方法，用于提升基于大语言模型的放射学报告生成（RRG）的临床准确性。该方法将图像-报告监督重新构建为一个层次化的临床对齐问题，利用临床知识图谱作为训练时的结构化先验，将监督分解为疾病中心对齐和全局临床语义对齐两个层次，以解决现有方法在报告级别监督与疾病级别发现之间的粒度不匹配问题。

Details

Motivation: 当前基于大语言模型的放射学报告生成方法虽然在报告流畅性上有所提升，但由于监督主要施加在报告层面，与报告中基于疾病的具体发现之间存在粒度不匹配，导致生成的报告在临床忠实性上仍面临挑战。

Result: 在MIMIC-CXR、IU-Xray和COV-CTR数据集上的实验表明，该方法在常规指标和临床指标上均能持续提升性能。值得注意的是，其3B参数模型超越了多个使用更大（7B/13B）骨干网络的先前系统。

Insight: 核心创新在于将监督结构从报告级别重构为层次化的临床对齐，并利用训练时专用的知识图谱定义疾病监督单元及其关系，无需推理开销。同时，结合实例条件判别匹配与疾病条件软正则化，解决了标准对比对齐在病理重叠时产生假阴性的问题，从而学习到细粒度且临床一致的跨模态表示。这表明，改进监督结构比单纯增加模型规模对RRG任务更有效。

Abstract: Radiology report generation (RRG) has recently benefited from large language models, which substantially improve report fluency. However, clinically faithful generation remains challenging because current supervision is still imposed mostly at the report level. This creates a granularity mismatch: radiology reports are composed of disease-grounded findings, while existing methods are trained mainly with whole-report objectives. To address this problem, we propose Graph-Supervised Hierarchical Clinical Alignment, which reformulates image-report supervision as a hierarchical clinical alignment problem. Our method structures this alignment as a disease-conditioned process, where supervision is decomposed into two levels: Disease-Centric Alignment for fine-grained disease-specific correspondence, and Global Clinical Semantic Alignment for report-level semantic coherence. A clinical knowledge graph is used as a training-time-only structural prior that defines disease-specific supervision units and their clinical relationships, introducing no additional overhead at inference. Because standard contrastive alignment could produce false negatives when studies share overlapping pathologies, we combine instance-conditioned discriminative matching with disease-conditioned soft regularization, enabling fine-grained yet clinically consistent cross-modal representations. Experiments on MIMIC-CXR, IU-Xray, and COV-CTR show that our method consistently improves performance on both conventional and clinical metrics. Notably, our 3B model surpasses several prior systems with larger 7B/13B backbones, suggesting that improving supervision structure, rather than increasing model size, can be more effective for RRG.

[48] PlaceSeek: Human-Centered Geospatial Retrieval of Urban Outdoor Places via Semantic Grounding and Affective Alignment cs.CV | cs.AI | cs.IRPDF

Ziqi Cui, Shangyu Lou

TL;DR: 本文提出了PlaceSeek，一个以人为中心的城市户外场所检索框架。它通过自然语言查询来定位街景图像，并引入意图感知机制，将查询分解为功能性和情感性子意图，分别通过语义基础模块和情感对齐模块进行验证和重排序。

Details

Motivation: 现有的地理空间检索主要围绕兴趣点（POI）和元数据，难以满足开放式、情感化或活动导向的查询需求。本文旨在解决如何根据人类对场所的活动支持和感知进行更人性化的检索。

Result: 在米兰31,956个街景位置和10个自然语言查询上，PlaceSeek的Precision@5达到88.0%，平均匹配分数为3.39/4.0，nDCG@5为0.920，优于CLIP、微调CLIP、SigLIP和基于VQA的基线方法。

Insight: 创新点在于将用户查询分解为功能与情感意图，并分别进行物理证据验证和感知偏好对齐。客观来看，其核心洞察是复杂的城市空间查询需要同时建模可验证的视觉证据和人类感知偏好，这为下一代地理空间检索系统提供了框架。

Abstract: People search for urban outdoor places not only by category or function, but also by what activities a place can support and how it is perceived. Existing geospatial retrieval remains largely POIcentric and metadata-driven, making it difficult to satisfy openended, affective, or activity-oriented needs. We present PlaceSeek, a human-centered outdoor place retrieval framework that maps natural-language queries to geolocated street-view imagery. PlaceSeek introduces an intent-aware retrieval mechanism that decomposes user queries into functional and affective sub-intents. A Semantic Grounding Module verifies whether candidate street-view results contain the physical evidence needed to support the intended activity, while an Affective Alignment Module re-ranks physically valid candidates using a LoRA-adapted vision-language model trained on human urban perception judgments. We evaluate PlaceSeek on 31,956 street-view locations in Milan across 10 naturallanguage queries annotated by five human evaluators. PlaceSeek achieves 88.0% Precision@5, a mean match score of 3.39/4.0, and 0.920 nDCG@5, outperforming CLIP, fine-tuned CLIP, SigLIP, and a VQA-based baseline. Ablation results show that physical grounding is essential for retrieval validity, while affective alignment improves ranking quality among physically valid candidates. These findings highlight that complex urban spatial queries require modeling both verifiable visual evidence and human perceptual preferences. PlaceSeek provides a potential framework for human-centered nextgeneration geospatial retrieval systems.

[49] EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI cs.CVPDF

Junlong Li, Junxi Li, Jianjun Gao, Chen Cai, Lap-Pui Chau

TL;DR: 本文提出了EgoErrorVQA任务，用于从第一人称视角评估视觉智能体对程序性任务的理解能力，特别是检测程序性错误的能力。同时，开发了一个基于Agent2Agent协议的用户友好评估器，并引入了Ego-ADR解耦推理框架来提升模型性能。

Details

Motivation: 现有视觉智能体和视觉语言模型（VLM）的基准测试忽略了从第一人称视角评估其程序性理解能力，尤其是检测程序性错误这一对日常辅助至关重要的能力。

Result: 在EgoErrorVQA任务上，使用开放式和多项选择题评估了一系列模型，揭示了它们在处理程序性错误和错误类型上的持续弱点。提出的Ego-ADR框架在可比设置下超越了所选基线模型，并在多个指标上达到了最先进（SOTA）水平。

Insight: 主要创新点在于首次提出了专注于第一人称程序性错误理解的EgoErrorVQA评估任务，并设计了基于A2A协议的标准化评估流程。从方法角度看，Ego-ADR框架通过解耦复杂的程序性推理来增强模型对错误的理解，这是一种有效的性能提升策略。

Abstract: The majority of our everyday activities are procedural and consist of sequences of interdependent steps. However, existing benchmarks for Visual Agents and Visual Language Models (VLMs) overlook the evaluation of their procedural comprehension ability from an egocentric visual perspective, particularly for detecting procedural errors, a critical capability for everyday assistance. To bridge this gap, the EgoErrorVQA task is firstly proposed for egocentric procedural comprehension with explicit procedural errors modeling. Besides, we develop a user-friendly evaluator agent based on the Agent2Agent (A2A) protocol, enabling rigorous and standardized evaluation of visual agents through VQA-based interaction. A range of models are evaluated using both open-ended and multiple-choice questions, revealing persistent weaknesses in handling procedural errors and error types. Moreover, we introduce Ego-ADR, an Adaptive Decoupled Reasoning framework that decouples complex procedural reasoning to enhance models’ understanding of procedural errors. It achieves consistent performance gains over the selected baselines and attains state-of-the-art results on several metrics under comparable settings. Code: https://github.com/z1oong/EgoErrorVQA

[50] Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation cs.CVPDF

Tianyi Xiong, Zhengyuan Yang, Xiaofei Wang, Chung-Ching Lin, Ruichun Ma

TL;DR: 本文提出了RubSE框架，通过使用评分标准（rubrics）作为结构化视觉修复上下文，指导视觉语言模型在UI到代码生成任务中进行自我演化，以解决视觉修复耦合问题，实现更稳定和高效的代码迭代优化。

Details

Motivation: 针对现有视觉语言模型在UI到代码生成中自我演化不稳定、存在视觉修复耦合（局部代码编辑可能传播并破坏其他已正确区域）的问题，旨在设计一种能够引导模型进行范围化视觉修复的框架。

Result: 在六个视觉语言模型和三个UI到代码基准测试上的评估表明，RubSE在最终轮和最佳轮设置中显著优于朴素自我演化方法，实现了更稳定的优化轨迹和更高的性能上限，并能缓解轨迹崩溃问题。

Insight: 创新点在于引入评分标准作为结构化视觉反馈，通过生成类型化候选评分标准、选择优先修复目标并存储历史记录来引导每次修订，从而解耦视觉修复过程；同时，更强的评分标准生成器可以将有效的视觉修复指导迁移到较弱的代码改进模型中。

Abstract: Large vision-language models have shown strong progress in UI-to-code generation, yet their test-time self-evolution remains unstable. We first identify a fundamental obstacle, termed visual repair coupling: a local code edit may propagate through layout, style, and component dependencies, correcting one visual mismatch while degrading regions that were previously faithful. To address this issue, we present RubSE, a Rubric-guided Self-Evolution framework that uses rubrics to represent visual feedback as a structured visual-repair context. At each refinement round, RubSE generates typed candidate rubrics, selects one prioritized repair target, and stores previously selected rubrics as history, thereby steering each revision toward a well-scoped visual repair while discouraging repeated or over-broad changes. Evaluations across six VLMs and three UI-to-code benchmarks demonstrate that RubSE substantially outperforms naïve self-evolution in final-round and best-round settings, achieving more stable refinement trajectories and a higher trajectory-level performance ceiling. Further analysis shows that RubSE mitigates trajectory collapse by improving recovery from severe visual regressions, and that stronger rubric generators can transfer effective visual-repair guidance to weaker code improvers.

[51] What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models cs.CVPDF

Ryo Kamiya, Hiroshi Kera, Kazuhiko Kawamoto

TL;DR: 本文提出了一种名为PromptSpLiCE的后处理方法，用于分析视觉语言模型（如CLIP）在提示学习（prompt learning）后文本嵌入的变化。该方法通过将每个类别的文本嵌入表示为固定自然语言词典中概念的稀疏组合，从而量化提示学习前后概念分布的变化。研究发现，在11个图像分类数据集上，提示学习导致概念分布发生显著改变，且这种改变与准确率提升正相关。

Details

Motivation: 动机在于解决提示学习中连续提示向量难以用自然语言解释的问题，旨在通过概念分析揭示提示学习如何改变模型对类别的语义理解，从而提供更可解释的洞察。

Result: 在CoOp提示学习方法上，对11个图像分类数据集的评估显示，提示学习后概念分布变化显著：初始前10概念中平均仅1.6个保留在前10；概念分布变化与准确率增益呈正相关。

Insight: 创新点包括提出一种基于稀疏组合的后处理概念分析方法（PromptSpLiCE），实现了对提示学习效果的可解释性量化；同时，通过局部梯度表达式提供了几何直觉，解释了为何与当前提示不同的图像对齐概念方向可能具有更高的损失敏感性。

Abstract: Prompt learning adapts vision-language models such as CLIP by optimizing continuous prompt vectors, but the learned prompts are difficult to interpret in natural language. We present PromptSpLiCE, a post-hoc method that expresses each class-conditioned text embedding as a sparse combination of concepts from a fixed natural-language dictionary. Using the same dictionary before and after prompt learning allows us to compare changes in their concept profiles. We evaluate PromptSpLiCE on CoOp, a representative prompt-learning method, across 11 image-classification datasets. The concept profiles change substantially: on average, only 1.6 of the initial top-10 concepts remain in the top 10 after learning. Across datasets, profile change is positively associated with accuracy gain. We also derive a local gradient expression that provides geometric intuition for why image-aligned concept directions distinct from the current prompt can have greater loss sensitivity.

[52] ViSculpt: Visual-Centric Agentic Geometry Editing cs.CV | cs.GR | cs.HCPDF

Bo Pang, Jiaqi Pan, Xiaocheng Zhang, Jiacheng Xu, Guoping Wang

TL;DR: 本文提出了ViSculpt，一个免训练的、以视觉为中心的多智能体系统，用于在Blender中直接编辑现有的3D网格。该系统通过模拟人类艺术家的迭代工作流程，让多模态LLM智能体观察视口、推理当前网格状态，并通过模拟用户交互执行局部编辑，而非生成脚本或重新生成几何体。

Details

Motivation: 解决现有基于LLM脚本生成的3D创建方法不适用于感知驱动的、对任意现有网格进行编辑的问题，因为这类编辑需要保持视觉基础并保护未修改区域。目标是实现更符合艺术家工作流的、对现有3D资产进行直接、局部、语言驱动的原位编辑。

Result: 在一个精心策划的基准测试上的实验提供了初步证据，表明该智能体方法能够遵循自然语言指令，执行具有代表性的局部网格编辑，并保持输入资产的整体身份。

Insight: 创新点在于提出了一种互补的语言驱动3D编辑范式：在原生3D编辑工作流中直接、原位修改现有网格。其核心是以视觉为中心、免训练的多智能体架构，通过模拟GUI交互来执行感知驱动的编辑，这为专业图形软件中的智能几何编辑探索了新方向。

Abstract: 3D geometry editing is a critical yet labor-intensive part of the graphics pipeline, requiring artists to translate creative intent into precise operations in complex professional software. Large language models (LLMs) have shown promise for script-based 3D creation, but script generation is less suited to perception-driven editing of arbitrary existing meshes, where execution must remain visually grounded and untouched regions should be preserved. We present a \emph{visual-centric}, training-free multi-agent system that edits existing 3D meshes directly in Blender by emulating the iterative workflow of human artists. Rather than generating scripts or regenerating geometry, our system operates through the Blender GUI: multimodal LLM agents observe the viewport, reason about the current mesh state, and execute localized edits through simulated user interactions. Experiments on a curated benchmark provide initial evidence that this agentic approach can follow natural language instructions, perform representative localized mesh edits, and preserve the overall identity of the input asset. Our results highlight a complementary regime for language-driven 3D editing: direct in-place modification of existing meshes within the native 3D editing workflow. We view this work as an exploratory step toward visual-centric agentic geometry editing in professional graphics software.

[53] SandwichQuant: Which Parameters Matter Before and After Quantization? cs.CVPDF

Peng Xia, Junbiao Pang

TL;DR: 本文提出SandwichQuant，一种从参数子空间角度研究量化校正的方法，发现归一化仿射参数子空间在量化校正中具有高效性。该方法采用两阶段归一化仿射校正框架，在量化前提升模型鲁棒性，量化后补偿残差误差，在视觉模型和大语言模型的不同低比特量化设置中均取得一致改进。

Details

Motivation: 现有量化校正方法通常优化权重、量化参数或重建目标，但导致有效校正的底层参数子空间尚不明确，本文旨在从参数子空间视角探究量化校正，揭示不同参数组的校正能力非均匀性。

Result: 在视觉模型和大语言模型上的大量实验表明，该方法在各种低比特量化设置下均能取得一致性能提升，验证了子空间对齐校正的有效性。

Insight: 创新点在于将可训练参数分解为骨干权重、归一化仿射参数和量化参数，发现低维归一化仿射子空间在预算匹配下提供高效校正方向，并据此设计了两阶段量化前后自适应校正框架。

Abstract: Quantization correction methods usually optimize weights, quantization parameters, or reconstruction objectives, while the underlying parameter subspaces responsible for effective correction remain unclear. In this work, we study quantization correction from a parameter subspace perspective and reveal that correction capability is highly non-uniform across parameter groups. By decomposing trainable parameters into backbone weights, normalization-affine parameters, and quantization parameters, we show that the low-dimensional normalization-affine subspace provides a highly efficient correction direction under matched budgets. Based on this finding, we propose SandwichQuant, a two-stage normalization-affine correction framework that performs adaptation before and after quantization. The pre-stage improves quantization robustness, while the post-stage compensates residual errors after the quantized graph is fixed. Extensive experiments on vision models and large language models demonstrate consistent improvements under various low-bit quantization settings, validating the effectiveness of subspace-aligned correction.

[54] Beauty is in the ELBO of the Beholder: A Variational Account of Processing Fluency in Face Perception cs.CV | q-bio.NCPDF

Francisco M. López, Jochen Triesch

TL;DR: 本研究通过训练无监督的变分自编码器（VAE）探索面部吸引力与感知流畅性之间的关系，发现人类对面部吸引力的评分与VAE证据下界（ELBO）在率失真空间中的方向高度一致，且吸引力方向在不同随机初始化和训练数据间具有强可迁移性。

Details

Motivation: 基于面部吸引力与对称性、平均性等统计规律相关的经典美学理论，研究旨在通过生成模型实证检验‘美取决于面部感知的流畅性’这一假设。

Result: 在芝加哥面部数据库的597张人脸图像上评估，VAE的ELBO方向与人类吸引力评分高度对齐，且吸引力方向在形状和潜在空间中均表现出更高的原型性。

Insight: 将经典美学理论与学习到的生成模型（如VAE）联系起来，为美学愉悦的处理流畅性理论提供了变分解释的实证支持，揭示了无监督学习模型能够捕捉人类审美偏好。

Abstract: Facial attractiveness has been linked to statistical regularities such as symmetry and averageness, suggesting that beauty may depend on the ease with which a face is perceived. We empirically test this hypothesis by training variational autoencoders on four face datasets without attractiveness supervision and evaluating their representations on the 597 faces from the Chicago Face Database. Across models, human attractiveness ratings closely aligns with the direction defined by the VAE evidence lower bound (ELBO) in rate-distortion space. Independently learned latent spaces contain an attractiveness direction that transfers strongly across random initializations and training data. We also find that attractive faces are more prototypical in both shape and latent space. Our results connect classic accounts of aesthetics with learned generative models and provide empirical support for a variational interpretation of the processing fluency theory of aesthetic pleasure.

[55] NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation cs.CVPDF

Yumeng He, Yichen Song, Xiaotian Yang, Weijia Zhang, Zanwei Zhou

TL;DR: NeoWorld-Pro是一个从单目图像重建交互式3D场景的框架，它将场景重建重新定义为可执行程序的生成过程。该框架利用多模态大语言模型的零样本推理和代码合成能力，将单张RGB图像转换为指定物体几何、关节结构和物理属性的程序，并通过物理引擎循环验证和迭代优化程序，确保物理合理性和交互性。

Details

Motivation: 当前基于图像生成URDF的方法缺乏物理基础和场景级交互性，难以将原始视觉观察转化为可用于具身AI仿真的高质量资产，因此需要一种新方法来解决单目场景重建的物理合理性和交互性问题。

Result: 实验表明，NeoWorld-Pro在单目重建任务上优于开环方法和现有方法，并能支持稳定的堆叠和细粒度操作等复杂下游任务。

Insight: 创新点在于将场景重建重新定义为程序生成问题，并引入物理引擎循环验证机制来迭代优化生成结果，确保了物理合理性和交互性，这为从视觉数据创建可交互仿真环境提供了新思路。

Abstract: The advancement of Embodied AI necessitates high-quality simulation assets that faithfully mirror the real world. However, transforming raw visual observations into simulation-ready scenes remains challenging due to the lack of physical grounding and scene-level interactivity in current image-to-URDF methods. We propose NeoWorld-Pro, a framework that reformulates monocular scene reconstruction as procedural programming for interactive 3D environments. Leveraging the zero-shot reasoning and code synthesis capabilities of MLLMs, NeoWorld-Pro converts a single RGB image into executable programs specifying object geometry, articulation, and physical properties. A physics-in-the-loop mechanism then iteratively refines the generated programs by validating their execution in a physics engine, enforcing physically plausible articulations, valid object compositions and interactions, and accurate spatial relationships. Experiments show that NeoWorld-Pro outperforms open-loop and prior monocular reconstruction methods, while enabling complex downstream tasks such as stable stacking and fine-grained manipulation.

[56] Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR cs.CVPDF

Sheethal Bhat, Bogdan Georgescu, Awais Mansoor, Mathias Zinnen, Pranjal Sahu

TL;DR: 本文提出了一种基于示例的鲁棒性异常检测方法Exemplar Med-DETR，用于在标注数据极少的条件下（少于10%）进行胸部X光图像的异常检测。该方法通过结合示例特征生成和领域感知对比优化，能够有效适应新的疾病发现而无需大量重新训练。

Details

Motivation: 动机在于解决医学目标检测中标注成本高昂的问题，并克服现有视觉语言方法因医学领域缺乏高质量、大规模基础数据而难以迁移，以及少样本学习方法泛化能力有限且需要大量重新训练的局限性。

Result: 该方法在私有和公共胸部X光数据集上，使用少于10%的标注数据，达到了接近最先进水平的检测性能。

Insight: 创新点在于扩展了先前的EM-DETR框架，引入了可扩展的少样本检测架构，通过示例特征生成和领域感知对比优化，实现了对新疾病发现的高效适应，减少了重新训练的需求，提升了标注效率。

Abstract: Reducing annotation requirements remains a key challenge in developing robust medical object detectors. To address this, Vision-Language (VL) object detection methods leverage grounding text information to enable powerful zero-shot and few-shot object detectors in the natural image domain [1, 2, 3, 4]. However, transferring these methods to the medical domain is challenging due to the absence of comparable quality and quantity of the grounding data. Regardless, significant contextual and non-imaging information exists in medical images that remains underutilized. Few-shot learning (FSL) techniques partially address this limitation but struggle to general ize to unseen medical findings and require extensive retraining when new findings are introduced [5, 6]. To overcome these challenges, we extend our prior EM-DETR framework [7] and introduce a scalable FS detection approach designed for efficient abnormality detection in Chest X-Ray (CXR) images under minimal supervision. The proposed architecture incorporates exemplar-based feature generation and domain-aware contrastive optimization, enabling effective adaptation to novel disease findings without exhaustive retraining. Our method achieves near state-of-the-art (SOTA) detection performance using less than 10% of the annotated data, demonstrating its potential for practical, annotation-efficient clinical deployment across both proprietary and public CXR datasets.

[57] Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation cs.CVPDF

Yeonkyeong Lee, Hyunsung Go, Jongmin Kim, Sewoong Lim, Donghoon Lee

TL;DR: 本文提出了一种名为KATok的自适应视频分词器，用于在潜在扩散模型中实现紧凑的视频表示。该模型基于Transformer的变分自编码器，通过联合学习自适应令牌选择器来评估每个令牌的内容丰富度，从而丢弃信息量低的令牌，实现数据依赖的压缩。为了解决令牌丢弃可能引起的空间错位问题，论文提出了级联和联合生成两种位置预测策略以确保空间一致性。实验表明，该模型在保持高质量重建和生成的同时，达到了最先进的压缩比。

Details

Motivation: 传统变分自编码器在视频数据上使用固定压缩比，无法适应时空内容的变化复杂性，导致次优表示。因此，需要一种自适应压缩方法，以动态处理视频中不同复杂度的内容。

Result: 模型在视频数据上实现了高质量的重建和生成，达到了最先进的压缩比。定量和定性结果均表明，通过减少时空冗余和移除信息量低的令牌，性能得到了显著提升。

Insight: 创新点在于引入了自适应令牌选择器，能够联合学习并动态评估令牌的重要性，实现数据依赖的压缩。此外，提出的位置预测策略有效缓解了自适应分词可能带来的空间一致性问题，为视频压缩和生成任务提供了新的思路。

Abstract: Latent diffusion models have emerged as a dominant framework for high-fidelity image and video synthesis, operating in compact latent spaces with variational autoencoders (VAEs) to enhance computational efficiency without compromising visual quality. However, conventional VAEs are suboptimal for video data as they employ fixed compression ratios that cannot adapt to the varying complexity of spatio-temporal content. We present KATok (Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation), a transformer-based VAE that incorporates an adaptive token selector which is jointly learned with latent tokens. By evaluating each token’s content-richness as keep-or-drop probability, the token selector effectively discards uninformative tokens, naturally allowing data-dependent compression. Applying adaptive tokenization to diffusion models may cause spatial misalignment, as token dropping can disturb the original spatio-temporal structure. To alleviate this issue, we propose two position-prediction strategies: cascaded and joint generation, to ensure spatial consistency. We empirically show that our model achieves strong reconstruction and generation quality at a state-of-the-art compression ratio. Further analysis on video data reveals that this improvement is primarily achieved by reducing spatio-temporal redundancy and removing uninformative tokens, as supported by both quantitative and qualitative results.

[58] Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning cs.CV | cs.AI | cs.HC | cs.LGPDF

Alperen Kantarci, Visvanathan Ramesh, Gemma Roig

TL;DR: 本文提出了一种多模态框架，用于预测在线辅导视频中的学生参与度。该框架整合了从预训练视频、音频和图像编码器提取的时空特征，以及头部姿态、注视、面部动作单元、情感和基于小波的音频特征等结构化行为模态，并通过Perceiver IO潜在瓶颈进行融合。此外，模型将学生和教师个性建模为可学习嵌入上的变分后验，以实现跨参与者的部分池化，并采用证据回归和谱归一化高斯过程分类头进行不确定性感知预测，以提高鲁棒性和校准性。

Details

Motivation: 在线辅导视频中的学生参与度预测困难，因为参与度是一个多维结构，包含不同的行为、情感和认知状态，且存在高人际变异性和标注主观性。

Result: 在CASED挑战测试集上的基准测试显示，所有参与方法都接近随机性能，揭示了数据集的难度。在此高度模糊的情况下，该框架取得了有竞争力的性能，同时独特地提供了良好校准的不确定性指标。

Insight: 创新点包括：整合多种行为信号和表达线索的多模态框架；通过Perceiver IO融合异构模态；将个性建模为变分后验以实现部分池化；采用不确定性感知预测头以提高鲁棒性和校准性，强调了可靠风险量化在实际教育工具部署中的重要性。

Abstract: The prediction of student engagement from the online tutoring videos is difficult because engagement is a multidimensional construct comprising distinct behavioral, emotional, and cognitive states. A reliable prediction requires bringing together different types of behavioral signals as well as expressive cues. Through our analysis of the CASED dataset, it is clear that engagement prediction gets even harder due to the high inter-person variability as well as the subjectivity of the engagement annotation. To tackle these challenges, we develop a multimodal framework that integrates the implicit spatiotemporal features extracted from pretrained video, audio, and image encoders along with structured behavioral modalities like head pose, gaze, facial action units, emotion, and wavelet-based audio features. We integrate these modalities via a Perceiver IO latent bottleneck. Moreover, student and instructor personalities are modeled as variational posteriors over learnable embeddings to enable partial pooling across participants. We employ evidential regression and spectral-normalized Gaussian process classification heads for uncertainty-aware prediction to further improve robustness and calibration. Benchmark on the CASED challenge test set shows that all participating methods converge near random-chance performance, revealing the difficulty of the dataset. In this highly ambiguous regime, our framework achieves competitive performance while uniquely offering well-calibrated uncertainty metrics, demonstrating that reliable risk-quantification is an essential prerequisite for deploying engagement models in real-world educational tools.

[59] Variance-Guided Spatial Attention Fusion for Robust End-to-End Driving under Asymmetric Sensor Degradation cs.CV | cs.ROPDF

Weizhi Tao, Zengwang Jin, Xiao Wang, Hailong Huang

TL;DR: 本文提出了一种名为方差引导空间注意力融合（VG-SAF）的框架，用于提升端到端自动驾驶系统在相机和激光雷达传感器非对称退化（如局部或整体损坏）下的鲁棒性。该框架通过物理基础的增强器生成密集可靠性监督，利用跨分支蒸馏预测像素级可靠性，并通过混合注意力机制融合模态信息，最终在CARLA基准测试中显著提升了驾驶性能。

Details

Motivation: 现有端到端多模态驾驶系统在传感器非对称退化（例如整个模态损坏或仅局部区域损坏）时表现脆弱，关键在于缺乏密集的可靠性监督、校准以及与物理故障严重程度的关联，导致不可靠特征影响规划器决策。

Result: 在CARLA Longest6基准测试中，VG-SAF在仅相机、仅激光雷达以及联合退化场景下，均显著优于基线方法，具体体现在驾驶分数、路线完成度和违规分数的全面提升。

Insight: 创新点包括：1) 使用物理基础的增强器模拟传感器故障并生成连续空间掩码，提供无需额外标注的密集监督；2) 通过跨分支密集蒸馏在log空间预测像素级可靠性，确保与故障严重程度的单调响应；3) 设计混合注意力机制，结合局部空间门和跨模态信任softmax，动态抑制不可靠特征并仲裁模态间信息；4) 引入拉普拉斯不确定性头，系统性地量化路径点不确定性以应对训练范围外的严重退化。

Abstract: End-to-end multimodal driving has progressed rapidly by fusing camera and LiDAR streams. Existing pipelines remain fragile under asymmetric sensor degradation, where either an entire modality or only a localized region is corrupted while other regions remain useful. The key difficulty is not simply to add an uncertainty head, but to obtain dense reliability supervision, calibrate this reliability against physical fault severity, and use it before unreliable features bias the planner. We propose Variance-Guided Spatial Attention Fusion (VG-SAF), in which dense heteroscedastic reliability estimates act as interpretable spatial gates. The framework couples three components. First, a physically grounded augmentor simulates representative camera and LiDAR failures and emits a continuous spatial mask, providing dense supervision without additional annotation. Second, modality-specific experts predict per-pixel reliability scales through cross-branch dense distillation in log space, enforcing a monotone severity-to-scale response. Third, calibrated reliability maps drive a hybrid attention mechanism that suppresses unreliable cells with a local spatial gate and arbitrates between modalities through a cross-modal trust softmax. A Laplace uncertainty head emits a systemic waypoint uncertainty scale that signals severe or combined sensor degradation, including severities outside the training ranges. On the CARLA Longest6 benchmark, VG-SAF consistently improves closed-loop robustness over the baselines across camera-only, LiDAR-only, and joint degradation regimes, as measured by driving score, route completion, and infraction score.

[60] Vision Language Model Fusion for Explainable Face Recognition cs.CVPDF

Ana Estrada-Real, Lydia Alapatt, Christoph Busch, Christian Rathgeb

TL;DR: 该论文研究了如何通过融合多个视觉语言模型（VLMs）来提升人脸验证系统的准确性和可解释性。它提出了一个融合框架，其中两个源模型提供相似度分数和文本解释，第三个VLM作为决策模型，整合多种模态信息（分数、解释、人脸图像）。研究发现，多VLM融合不仅能提高识别性能，还能提供更丰富、互补的解释，增强系统的透明度和可审计性。

Details

Motivation: 负责任地部署人脸验证系统不仅需要高精度决策，还应提供可解释和可审计的证据，使用户能够理解、评估和质疑系统决策。现有基于单一视觉语言模型的方法可能在决策准确性和解释质量上存在局限，因此研究多模型融合以同时提升这两方面性能。

Result: 提出的多模态VLM融合方法在识别准确率上超越了当前最先进的VLMs和特定领域的人脸识别模型，同时生成的融合解释预计比单个VLM生成的解释更鲁棒。

Insight: 创新点在于将多个VLMs的输出（决策分数、自然语言解释、原始图像）进行融合，利用不同模型的互补性来提升整体性能与可解释性；这为构建负责任、可解释的人脸验证系统提供了一种新范式，强调多模态证据整合对于透明度和错误分析的价值。

Abstract: Responsible deployment of face verification systems requires more than accurate decisions: systems should also provide interpretable and auditable evidence that enables users to understand, assess, and challenge their decisions. Vision-language models (VLMs) provide a promising foundation for explainable face recognition by combining visual analysis with natural-language reasoning. However, relying on a single model may further limit the decision accuracy as well as provided explanations. This work therefore investigates whether multiple VLMs can be combined to improve recognition accuracy, and to enrich the explanations associated with those decisions. This work evaluates four VLMs as standalone face verification systems and subsequently proposes a fusion framework, where two source models provide similarity scores and textual justifications and a third VLM acts as a decider model. Four different fusion scenarios are considered, progressively providing the decider model with scores, justifications, face images, and combinations of these modalities. Overall, the findings suggest that the value of multi-VLM fusion extends beyond recognition performance. VLMs can provide complementary justifications and perspectives that enable richer explanations of face recognition decisions, supporting greater transparency, auditability, and error analysis. This is relevant to the development of responsible explainable face verification systems, where users and operators should be able to understand not only the final decision but also the evidence and potential sources underlying it. The proposed multimodal VLM, which combines decision scores, explanations, and face images, achieves higher recognition accuracy than state-of-the-art VLMs and domain-specific face recognition models, while also providing fused explanations that are expected to be more robust than those generated by individual VLMs.

[61] Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment cs.CVPDF

Baoliang Chen, Qing Lin, Sijie Mai

TL;DR: 本文提出了一种交互感知学习框架，用于AI生成图像质量评估（AIGIQA），该框架通过对抗性和协作性推理路径来建模感知保真度和提示对齐这两个质量维度之间的竞争与合作关系。该方法采用门控交互模块动态路由特征，并利用任务感知提示调节门控行为，从而在多个AIGIQA基准测试中实现了最先进的准确性，并提供了可解释的交互模式。

Details

Motivation: 现有AIGIQA模型通常将感知保真度和提示对齐视为独立维度，但重新审视人类评分后发现这两个维度相互依赖，在评分过程中存在竞争与合作交互，因此需要一种能够自适应协商其相互作用的统一模型。

Result: 在多个AIGIQA基准测试上的实验表明，该方法不仅达到了最先进的准确率，还产生了可解释的交互模式，更接近人类判断。

Insight: 创新点在于揭示了感知与对齐维度的交互关系，并设计了门控交互模块来动态建模这种关系，通过对抗与协作路径实现自适应学习，为多维度质量评估提供了新思路。

Abstract: AI-generated image quality assessment (AIGIQA) requires jointly reasoning about perceptual fidelity and prompt alignment, two quality dimensions that are often treated as independent in existing AIGIQA models. However, by re-examining human ratings, we uncover a previously overlooked phenomenon: the two dimensions are interdependent and exhibit both competitive and cooperative interactions during human rating. This observation suggests that a unified model should neither collapse the two dimensions nor rigidly separate them, but rather adaptively negotiate their interplay. Motivated by this insight, we introduce an interaction-aware learning framework that models perception-alignment relations through adversarial and collaborative inference pathways. Instead of designing a rigid dual-branch architecture, our method employs a gated interaction module that dynamically routes features according to the inferred relationship between the two dimensions. Task-aware prompts further modulate the gating behaviour, enabling the model to switch between competition and cooperation when necessary. Experiments across multiple AIGIQA benchmarks demonstrate that our approach not only achieves state-of-the-art accuracy but also yields interpretable interaction patterns, offering a more faithful approximation of human judgment. The codes are available at https://github.com/LQAMEI/ACL-IQA.

[62] Markerless Pose Estimation for Resistance Training Technique Assessment cs.CV | cs.AIPDF

Joseph Turner, Jeff Clark, Nawid Keshtmand

TL;DR: 该论文提出了一种基于无标记姿态估计的框架，用于评估阻力训练（如深蹲、卧推和硬拉）的技术动作。通过BlazePose从普通视频中提取解剖标志点并转换为关节角度轨迹，利用均方根误差（RMSE）与参考动作进行比较，实现了在非实验室环境下的定量技术评估。

Details

Motivation: 解决阻力训练中因技术不当导致受伤风险高的问题，实验室运动分析难以普及，因此探索无标记姿态估计作为可行的替代方案，以实现便捷的技术评估。

Result: 框架在深蹲和硬拉中恢复了有意义的运动学模式，支持重复动作间的定量比较和技术变异性识别；性能受相机方向和视觉遮挡影响较大，非矢状面视图会扭曲2D关节角度估计。

Insight: 创新点在于将无标记姿态估计应用于阻力训练评估，证明了其在实验室外进行生物力学分析的可行性；但需注意2D估计的局限性，未来可结合多视角或3D方法提升鲁棒性。

Abstract: Resistance training can be a high risk activity, and safe form is essential to avoiding injury. Laboratory-based movement analysis provides quantitive technique assessment, yet is not easily accessible. Markerless pose estimation infers body landmarks from images or video without physical markers and could offer a feasible alternative for technique assessment. We present a pose estimation framework to evaluate resistance-training technique from ordinary video footage. Using BlazePose, anatomical landmarks were extracted from squat, bench press, and deadlift videos and converted into joint-angle trajectories, with the squat serving as the primary case study. Trajectories were assessed against a defined reference repetition using root mean square error (RMSE). Results show that the framework recovers meaningful kinematic patterns for the squat and deadlift, enabling quantitative comparison between repetitions and identification of technique variability within a set. Performance depended strongly on camera orientation and visual occlusion, with non-sagittal views distorting 2D joint-angle estimates. The findings demonstrate that markerless pose estimation can support accessible biomechanical assessment outside laboratory environments.

[63] DoublesEval: Diagnosing Multi-Agent Tactical Reasoning in Vision-Language Models via Professional Doubles Badminton cs.CVPDF

Jintao Cheng, Weibin Li

TL;DR: 该论文提出了DoublesEval，一个利用专业羽毛球双打作为结构化测试平台，用于诊断视觉语言模型在多智能体战术推理能力上的评估框架。该框架将比赛回合分解为关键战术时刻，从四个维度评估模型，并针对发现的推理失败模式，提出了一种无需参数更新的轻量级测试时一致性检查器TacticCheck。

Details

Motivation: 视觉语言模型擅长描述可见场景内容，但在理解动态多智能体交互（其动作语义依赖于协调的角色和时空依赖关系）方面存在困难。论文旨在形式化并诊断这种多智能体战术推理能力。

Result: 在零样本协议下评估了四个代表性的开源VLM，发现模型在所有诊断维度上都表现较弱，尤其在空间状态、交互绑定和终端证据方面存在明显瓶颈。提出的TacticCheck方法为所有评估模型带来了稳定的性能提升，但与鲁棒的战术推理能力之间仍存在显著差距。

Insight: 创新点在于将复杂的多智能体交互问题形式化为一个结构化的、可诊断的评估任务（DoublesEval），并提出了一个无需训练、仅利用模型自身低级预测进行答案重排的轻量级测试时一致性检查方法（TacticCheck），为模型推理失败提供了可解释的诊断。

Abstract: Visual Language Models (VLMs) excel at describing visible scene content but struggle to reason about dynamic multi-agent interactions, where action semantics depend on coordinated roles and spatial-temporal dependencies. We formalize this capability as \textbf{multi-agent tactical reasoning} and introduce \textbf{DoublesEval}, a diagnostic evaluation framework that leverages professional doubles badminton as a structurally tractable testbed. DoublesEval employs a key-moment-based protocol that decomposes rallies into tactically salient instants and probes models across four interpretable dimensions: atomic recognition, intra-segment composite understanding, cross-segment causal reasoning, and high-level tactical abstraction. This design isolates \emph{where} reasoning fails, rather than merely measuring answer correctness. To address observed failure modes, we propose \textbf{TacticCheck}, a lightweight constraint-guided test-time consistency checker that reranks candidate answers using the model’s own lower-level tactical predictions, requiring no parameter updates or ground-truth labels at inference time. Evaluating four representative open-source VLMs on 60 curated rallies (yielding $\sim$9.6K structured instances) via a zero-shot protocol, we find that models remain weak across all diagnostic levels, with especially clear bottlenecks in spatial state, interaction binding, and terminal evidence. TacticCheck delivers consistent gains across all evaluated models, while still leaving a substantial gap to robust tactical reasoning. These results highlight the need for structured, interaction-aware evaluation paradigms for next-generation VLMs. The source code is available in \href{https://github.com/Chengjt1999/DoublesEval}{\textcolor{blue}{our GitHub repository}}.

[64] VizAnchor: Decoding Manipulation Intent from Tampering Visualizations via Dual-Anchor Reasoning cs.CV | cs.HCPDF

Xiaotian Zhang, Huayuan Ye, Haiyang Zhang, Chenhui Li, Changbo Wang

TL;DR: 本文提出了VizAnchor框架，用于理解数据可视化中的篡改意图。该框架通过构建语义锚点和空间锚点来恢复原始图表信息并定位篡改区域，然后利用三个专门代理分析篡改、重建视觉叙事并推断误导意图。

Details

Motivation: 现有方法仅关注定位篡改区域或恢复隐藏信息，无法解释可视化如何被篡改以及为何会导致误导性解读，因此需要一种能够理解篡改意图的框架。

Result: 评估表明，VizAnchor能够准确定位篡改，并对篡改操作、误导因素及误导意图生成可靠的解释。

Insight: 创新点在于通过双锚点证据构建和基于视觉语言模型（VLM）的推理，将篡改定位与意图解释相结合，并引入专门代理进行多角度分析，为可视化安全提供了更全面的理解方法。

Abstract: Data visualizations are widely used for communicating information, but they are also vulnerable to intentional manipulations that induce misleading interpretations. Existing methods focus on locating tampered regions or recovering hidden information, without explaining how the visualization has been manipulated or why the resulting changes may mislead viewers. We propose \textbf{VizAnchor}, a framework for visualization manipulation understanding through dual-anchor evidence construction and VLM-based reasoning. In the first stage, VizAnchor constructs a semantic anchor to recover authentic chart information and a spatial anchor to localize tampered regions. In the second stage, three specialized agents decode the manipulation. The misleader grounding agent analyzes a four-panel visual prompt to predict the misleader information. The chart narrative reconstruction agent takes the original and tampered charts as inputs and reconstructs their respective visual narratives. Finally, the intent inferring agent integrates the visual evidence and misleader information to infer the misleading intent. We further construct a dataset for tampering localization and a dataset for misleading intent inferring. Evaluation shows that VizAnchor accurately localizes manipulations and produces faithful explanations of their manipulation, misleaders, and misleading intents.

[65] Low-Rank Ternary Adaptation for Fine-Tuning Transformers cs.CV | cs.LGPDF

Alexandru-Dragos Manolache, Yunqiang Li, Jan van Gemert

TL;DR: 本文提出了一种低秩三元自适应方法，用于在保持三元权重的前提下微调Transformer模型。该方法通过克罗内克分解将三元权重的离散更新表示为两个小型三元矩阵的元素级乘积，从而避免了现有方法所需的去量化过程，并支持直接合并为三元模型。

Details

Motivation: 现有基于低比特LoRA的方法无法直接微调三元权重，要么需要去量化将低比特基础权重恢复为高精度以与自适应权重合并，要么仅更新量化参数，导致无法获得保持三元性的合并模型。

Result: 在语言和视觉领域的六个模型（包括三元化的LLaMA-3 1B/3B和三元ViT-B/16）上的实验表明，该方法能够恢复量化带来的大部分性能损失，并优于强大的低比特和三元的基线方法。

Insight: 创新点在于提出了三元乘法自适应，通过低秩克罗内克分解在保持三元域的同时实现参数高效且表达力强的离散权重更新，从而无需去量化即可直接合并为三元模型，这在模型压缩和高效微调方面具有借鉴意义。

Abstract: Ternary transformers offer extreme memory and compute efficiency, but existing low-bit LoRA-based methods cannot directly fine-tune ternary weights. Current approaches either require dequantization, restoring low-bit base weights to higher precision to merge with adaptation weight, or update only quantization parameters, preventing a merged model that remains ternary. We propose ternary multiplicative adaptation, which represents discrete updates of ternary weights such as sign flips or zeroing through a low-rank Kronecker factorization into two small ternary matrices applied element-wise to ternary weights. This design is parameter-efficient and expressive, preserves the ternary domain, and supports direct merging without dequantization. Experiments on six models across language and vision, including ternarized LLaMA-3 1B and 3B and a ternary ViT-B/16, demonstrate that our method recovers much of the performance lost to quantization and outperforms strong low-bit and ternary baselines. Code is available at https://github.com/alexmanoo/ternary_adaptation.

Urwa Fatima, Mohammad Zohaib, Francesca Odone, Nicoletta Noceti

TL;DR: 本文提出了一种受心理学互视注意理论启发、可解释的社会参与度分析模型，通过显式建模双人视觉注意并聚合为个体与群体参与度的可解释指标，结合了先进的头部朝向估计与轻量级几何推理，为非技术用户提供直观解释。

Details

Motivation: 旨在从非语言视觉数据中理解社会互动，以支持行为分析与活动监控，解决现有端到端方法缺乏可解释性的问题。

Result: 在多样化数据上通过定量实验评估了方法，并通过定性可视化展示了其在辅助教师、看护人员和社会工作者理解群体互动动态方面的实际效用。

Insight: 创新点在于将心理学理论转化为可计算的互视注意模型，构建模块化框架以提升可解释性，同时保持轻量级推理，便于实际应用部署。

Abstract: Understanding social interactions from non-verbal visual data is important for behavior analysis and activity monitoring. We propose an interpretable computational model of social engagement inspired by psychological theories of mutual visual attention. Rather than learning interaction patterns end-to-end, our framework explicitly models dyadic visual attention and aggregates these cues into interpretable measures of individual and group engagement. The resulting modular framework combines state-of-the-art head orientation estimation with lightweight geometric reasoning, producing explanations that remain accessible to non-technical users. We evaluate the proposed approach on a variety of data through quantitative experiments and demonstrate its practical usefulness with qualitative visualizations designed to support teachers, caregivers, and social workers in understanding group interaction dynamics.

[67] X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis cs.CV | cs.ROPDF

Sonali Godavarthy, Matthias Neuwirth-Trapp, Tim-Felix Faasch, Maarten Bieshaar, Michael Moeller

TL;DR: 本文提出了X-MULTI方法，旨在改进文本到图像生成中的成像因子解耦问题。该方法利用预训练的视觉语言模型（VLM）为训练期间合成的新因子组合提供监督信号，以解决现有方法MULTI无法直接监督未见组合的局限性。同时，论文还提出了改进的因子对齐精度度量I-FAA，以解决原有FAA指标中严重的跨因子相关性泄漏问题，从而更准确地评估解耦质量。

Details

Motivation: 解决现有成像因子解耦方法MULTI的两个独立局限性：一是其像素级重建目标仅对训练数据中观察到的因子组合进行监督，无法为未见的新组合提供直接训练信号；二是其评估指标FAA存在严重的跨因子相关性泄漏，不能真实反映解耦质量。

Result: 实验表明，与MULTI相比，X-MULTI在未见的新因子组合上实现了更好的因子对齐效果。同时，I-FAA指标有效减少了FAA中的相关性泄漏，为因子对齐提供了更鲁棒的评估。

Insight: 主要创新点在于：1）引入预训练VLM作为监督源，为合成的新因子组合提供训练信号，实现了对未见组合的泛化能力；2）设计了I-FAA评估指标，通过因子特定的数据增强策略打破相关性，提供了更严谨的解耦质量评估方法。从客观角度看，利用VLM的先验知识进行监督是一种有效的跨模态知识迁移策略，而针对评估指标本身的设计缺陷进行系统性改进也颇具借鉴意义。

Abstract: Imaging factor disentanglement in text-to-image generation aims to independently control image acquisition properties such as types of camera lenses, sensor types, viewpoints, and domains to enable combinatorial generalization. This should let the model synthesize novel factor combinations unobserved in the training data, such as pairing a fisheye lens with an event sensor never observed in training data. Recent work, MULTI, introduced learnable, factor-specific embeddings to disentangle imaging factors, along with the Factor Alignment Accuracy (FAA) metric to evaluate disentanglement quality. We identify and address two independent limitations. First, MULTI’s pixel-level reconstruction objective supervises the model only on observed imaging factor combinations, providing no direct training signal for novel combinations. We therefore propose X-MULTI, which uses a pretrained vision-language model (VLM) to supervise novel factor combinations synthesized during training. Second, we show the FAA metric exhibits severe cross-factor correlation leakage, misrepresenting true disentanglement quality. We therefore propose Improved-FAA (I-FAA), which employs factor-specific augmentation strategies to break these correlations and enables more rigorous evaluation. Experiments demonstrate that X-MULTI achieves improved factor alignment on novel combinations compared to MULTI. Moreover, we show that correlation leakage in FAA distorts the evaluation of true factor disentanglement and I-FAA reduces this leakage and therefore provides a more robust assessment of factor alignment.

[68] On-Policy Self-Distillation in Diffusion Models cs.CVPDF

Wei Zhou, Xiongwei Zhu, Lingdong Kong, Bo Chen, Lei Zhang

TL;DR: 本文提出了DiffusionOPSD，一种用于扩散模型的在线策略自蒸馏框架，旨在将图像级别的奖励引导转化为对中间去噪预测的显式监督目标。该方法通过冻结的行为策略生成轨迹并提供查询状态和锚点，利用奖励梯度构建有界的正负目标，然后通过有限拟合和指数移动平均更新来训练策略。

Details

Motivation: 强化学习虽然可以将扩散模型与人类偏好和任务特定目标对齐，但端点奖励无法指定中间去噪预测应如何改变。因此，需要一种方法将图像级奖励转化为对中间预测的明确监督。

Result: 在SD 3.5-M和Z-Image-Turbo模型上，该方法在20个奖励匹配设置中的19个取得了最佳最终保持分数，优于最强竞争方法达44.0%，并相比DiffusionNFT减少了40%到63%的训练GPU小时。

Insight: 创新点在于将在线策略自蒸馏引入扩散模型后训练，通过将图像级奖励转化为持续刷新的中间监督目标，实现了更高效和可分析的对齐。这为扩散模型的高效和可诊断对齐开辟了新路径。

Abstract: Reinforcement learning can align diffusion models with human preferences and task-specific objectives, but endpoint rewards do not specify how an intermediate denoising prediction should change. We introduce DiffusionOPSD as an on-policy self-distillation framework that converts image-level reward guidance into explicit targets for clean-output predictions at sampled queries. At each outer iteration, a frozen behavior policy generates trajectories and supplies query states and anchors. Reward gradients construct bounded positive and negative targets around each anchor. The trainable policy fits these targets as detached supervision through finite fitting before an exponential moving average update refreshes the behavior policy. This setup lets us measure target construction and finite realization separately. Controlled same-query experiments show that larger target-construction gains do not necessarily translate into larger realized gains after a single fitting update. Across SD 3.5-M and the step-distilled Z-Image-Turbo, our approach achieves the best final held-out scores in 19 of 20 reward-matched settings across two backbones and ten evaluators. It outperforms the strongest competing method by up to 44.0% and reduces training GPU-hours relative to DiffusionNFT by 40% on SD 3.5-M and 63% on Z-Image-Turbo. These results support on-policy self-distillation as an efficient and analyzable approach to diffusion post-training by converting image-level reward guidance into explicit and continually refreshed intermediate supervision, thereby opening a path toward more efficient and diagnosable alignment.

[69] ReGround-Surg: Reliability-Guided Anchor Grounding for Referring Surgical Video Segmentation cs.CVPDF

Jiaxin Wen, Ming Yin, Lu Liu, Zeyu Fu

TL;DR: 本文提出ReGround-Surg，一个轻量级的可靠性引导锚点定位框架，用于改进基于SAM2的参考手术视频分割。该方法通过预测文本条件空间可靠性图，并利用该图在两个互补分支（门控侧适配器和可靠性加权视觉到文本注意力模块）中增强相关视觉区域并抑制无关证据，以解决现有两阶段方法对初始定位掩码质量敏感、易导致错误传播的问题。

Details

Motivation: 解决基于SAM2的两阶段参考手术视频分割方法（如ReSurgSAM2）对初始锚点掩码质量高度敏感的问题。在手术视频中，由于器械视觉相似、遮挡以及复杂的组织-工具交互，一旦初始定位错误，后续跟踪会传播误差，严重影响分割性能。

Result: 在Ref-EndoVis17和Ref-EndoVis18数据集上的实验表明，该方法在三个评估划分上均优于现有最先进方法（SOTA），且速度下降可忽略不计。

Insight: 核心创新在于引入文本条件空间可靠性图作为引导信号，并设计两个互补分支（Gated Side Adapter和Reliability-Weighted Vision-to-Text Attention）协同利用该图，分别从视觉特征增强和跨模态注意力抑制两个角度提升锚点定位的鲁棒性。这是一种轻量级且高效的改进策略。

Abstract: Referring surgical video segmentation requires segmenting a target instrument or tissue region across video frames according to a natural language expression. Recent Segment Anything Model 2 (SAM2) based two-stage methods (e.g., ReSurgSAM2) first ground the referred target in an initial or selected frame, then propagate the selected mask via tracking. Although effective, their performance is highly sensitive to the quality of the initial grounded mask: once an incorrect anchor is selected, subsequent tracking tends to propagate the error. This issue is especially challenging in surgical videos due to visually similar instruments, occlusion, and complex tissue-tool interactions. To address this issue, we propose ReGround-Surg, a lightweight reliability-guided anchor grounding framework to improve SAM2-based referring surgical video segmentation. It first predicts a text-conditioned spatial reliability map from the referring expression and current-frame visual features. The map is then reused in two complementary branches: a Gated Side Adapter enhances expression-relevant visual regions before text-to-vision fusion, while a Reliability-Weighted Vision-to-Text Attention module suppresses off-target visual evidence during prompt-token aggregation. Experiments on Ref-EndoVis17 and Ref-EndoVis18 show consistent improvements over state-of-the-art methods across three evaluation splits with negligible speed reduction. Code is publicly available at https://github.com/JiaxinWen1/ReGround-Surg.

[70] TurboT2VA: Fast Large-Scale Text-to-Video-Audio Generation via Score-Regularized Consistency Distillation cs.CVPDF

Xiaoda Yang, Yuxiang Liu, Kaiwen Zheng, Yuan Liu, Yibo Lai

TL;DR: 本文提出了TurboT2VA，一个用于加速大规模文本-视频-音频联合生成模型的蒸馏与推理框架。该框架通过分数正则化一致性蒸馏技术，显著降低了19B参数模型的推理延迟，在保持生成质量的同时实现了高达54.67倍的加速。

Details

Motivation: 解决大规模文本-视频-音频联合生成模型因采样轨迹长、多模态计算异构而导致的推理成本过高、延迟过长的问题。

Result: 在LTX-2基准上，四步蒸馏将512×768分辨率下的生成延迟从50.52秒降至2.51秒，实现20.1倍加速，同时保持了视觉质量、音频保真度、多样性和音视频同步性。在高分辨率（1024×1792）部署下，结合优化的推理栈，在单张NVIDIA H20上实现了从318.74秒到5.83秒的延迟降低，生成器部分加速达54.67倍。

Insight: 创新点在于提出了针对多模态不平衡优化的逐模态归一化方法，以及一个包含离散一致性预热、连续一致性精炼和联合一致性-分布匹配的渐进式课程学习策略。此外，还开发了一个架构感知的推理栈，融合了量化、算子融合、文本压缩和模态感知稀疏注意力等技术，在保持跨模态密集交互的同时大幅提升效率。

Abstract: Joint text-to-video-audio generation produces synchronized visual and acoustic content, but the long sampling trajectories and heterogeneous multimodal computation of large models make inference prohibitively expensive. We present TurboT2VA, a distillation and inference framework for accelerating a 19B-parameter joint video-audio model. Large-scale T2VA distillation is challenged by modality-imbalanced optimization, the difficulty of continuous-time consistency training at scale, and the quality–diversity trade-off. TurboT2VA addresses these issues with per-modality normalization and a progressive curriculum comprising discrete consistency warm-up, continuous consistency refinement, and joint consistency–distribution matching. The curriculum first establishes a stable, diverse generation trajectory and only then introduces distribution-level refinement. On LTX-2, four-step distillation reduces generator latency from 50.52s to 2.51s at the standard evaluation resolution of 512$\times$768, achieving a 20.1$\times$ speedup while maintaining strong visual quality, audio fidelity, diversity, and video-audio synchronization. We further develop an architecture-aware inference stack that combines guarded W8A8 and fused operators, padded-text compaction, and modality-aware sparse attention while preserving dense cross-modal and text-conditioning paths. Under the high-resolution deployment setting at 1024$\times$1792, the complete stack reduces generator latency from 318.74s to 5.83s on one NVIDIA H20, achieving a 54.67$\times$ generator-only speedup. Inference code and generation demos are available at https://github.com/thu-ml/TurboDiffusion/tree/main/turbot2va.

[71] Interpretable Fundus Image Classification via Ring-Based Retinal Vasculature Features cs.CV | stat.MLPDF

Xiaoyan Li, Shixin Xu, Arvind Gupta, Huaxiong Huang

TL;DR: 本研究提出了一种基于环状视网膜血管结构的可解释眼底图像分类框架，通过量化血管几何、颜色外观、氧合相关血管外观及血管-背景熵等生理学特征，在三个公开数据集上实现了强分类性能。

Details

Motivation: 针对当前眼底图像分类方法依赖深度隐式表示、可解释性有限的问题，旨在开发一种基于视网膜血管生理学特征的可解释分类框架。

Result: 在HRF数据集上，使用自动生成的血管掩膜达到了91.1%的准确率，与在大规模视网膜图像数据上预训练的视觉Transformer模型RETFound在相同评估设置下性能相当。

Insight: 创新点在于利用环状结构的血管特征量化空间变化，提供可解释的生理学描述符；客观分析表明该方法不依赖大规模任务特定训练数据，且能避免预训练模型对采集相关空间线索和非血管特征的敏感性。

Abstract: Retinal fundus photography is widely used for screening and monitoring ocular diseases, but many modern classification pipelines rely on deep latent representations and provide limited interpretability. This study develops an interpretable fundus image classification framework based on a ring-structured representation of the retinal vasculature centered on the optic disc. The method quantifies vessel geometry, color appearance, oxygenation-related vascular appearance, and vessel–background entropy within concentric retinal regions. These physiologically motivated descriptors are derived from vessel masks, image intensities, and optical-density measurements and aggregated across rings to capture spatial variation in vascular properties. Using only quantitative vascular descriptors, the proposed method achieved strong classification performance across three public fundus datasets. On HRF, it achieved 91.1% accuracy using automatically generated vessel masks, matching RETFound, a vision transformer pretrained on large-scale retinal fundus image data, under the same evaluation setting. Additional analyses suggest that pretrained image models are sensitive to acquisition-related spatial cues, including fundus scale and retinal position within the field of view, as well as broader non-vessel image characteristics. This framework may support interpretable disease classification, quantitative retinal phenotyping, and retinal biomarker discovery without requiring large task-specific training datasets.

[72] Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training cs.CVPDF

Wenxuan Shen, Dongna Jin, Dongping Chen

TL;DR: 该论文提出了Game2World引擎，一个旨在将互联网上丰富的游戏视频转化为高质量世界模型训练数据的全栈框架。其核心是通过自动提取和合成UI覆盖层，解决原始游戏画面中屏幕界面与游戏世界纠缠的问题，并构建了一个包含合成配对视频和真实剪辑的数据集。基于此数据集，论文还提出了一个无需掩码的UI移除模型GameCleaner。

Details

Motivation: 游戏视频是训练视频世界模型的可扩展数据源，但原始画面中混杂的游戏特定UI（如平视显示器HUD）会引入偏差和无关动态，阻碍模型学习。论文旨在解决如何从“野外”游戏视频中自动移除UI，以获取干净的游戏世界数据用于训练。

Result: 在UI移除评估中，GameCleaner在合成视频上平均AAR达到95.36，比最强的时序掩码基线高出57.3%；在真实游戏剪辑上获得最佳AAR 80.05，背景保留率达99.8%。初步实验表明，使用无UI游戏数据训练的世界模型，其VideoReward指标比使用带UI数据训练的模型提升了6.83%。

Insight: 主要创新点在于：1) 系统性地形式化了游戏UI的识别与移除问题，并构建了包含详细分类的UI资产库和配对数据集Game2World；2) 提出了GameCleaner模型，它结合多模态语义理解和视频编辑能力，无需依赖掩码就能直接识别并移除多样化的HUD元素，同时保持底层场景内容和时序动态的完整性，为利用海量互联网游戏视频提供了可扩展的方案。

Abstract: Video games provide a scalable source of training data for video world models, offering diverse environments, complex interactions, and abundant in-the-wild gameplay videos. However, raw gameplay footage entangles the game world with screen-space interfaces, introducing game-specific biases and irrelevant dynamics that hinder world-model training. To address this problem, we introduce GameUI-Taxonomy and G2WEngine, a full-stack framework that formalizes gameplay UI grounding and removal. G2WEngine automatically extracts reusable UI assets from real gameplay videos and synthesizes temporally coherent UI overlays on clean footage. Using this engine, we construct Game2World, comprising 96K synthetic paired videos with precise reconstruction targets and 1,079 in-the-wild clips from 303 games for realistic evaluation. Its asset library contains 5,132 verified UI elements across 21 taxonomy categories, collected from 1,010 representative gameplay frames. Based on Game2World, we propose GameCleaner, a mask-free gameplay UI removal model that combines multimodal semantic understanding with video editing capabilities. Unlike mask-based methods, GameCleaner directly identifies and removes diverse HUD elements while preserving the underlying scene content and temporal dynamics. In a controlled pilot, world models trained on UI-free gameplay improve overall VideoReward by 6.83% over those trained on UI-overlaid data. On UI-removal evaluation, GameCleaner achieves an average AAR of 95.36 on synthetic videos, outperforming the strongest temporal mask baseline by 57.3%, and obtains the best in-the-wild AAR of 80.05 with 99.8 background preservation. These results demonstrate the scalable potential of transforming Internet gameplay videos into high-quality world-model training data. Code, dataset, and model will be available at https://github.com/Dongping-Chen/Game2World.

[73] MoTE: Mixture of Task Experts for Multi-Task Video Understanding cs.CV | cs.LGPDF

Muhammad Asad Ali, Umar Khan, Nadia Robertini, Didier Stricker

TL;DR: 本文提出了一种名为MoTE（Mixture of Task Experts）的解码器架构，用于多任务视频理解。它将大型语言模型的前馈网络转换为任务特定的专家，同时共享多模态主干网络，每个样本仅激活一个任务路由，从而在保持计算效率的同时提升性能。

Details

Motivation: 现有的密集Transformer解码器在多任务视频语言模型中共享前馈网络，导致任务行为纠缠且难以进行可控的能力扩展；而稀疏混合专家解码器的token级学习路由与任务级目标不自然对齐。因此，需要一种任务结构化的路由机制来解决这些问题。

Result: 在五个COIN基准测试上，使用显式任务路由的五专家模型（每个样本激活约20亿LLM参数）的平均top-1准确率超过了最近的VideoLLM基线模型，并且在相同专家拓扑结构下优于密集全专家激活和学习的稀疏路由控制方法。

Insight: 创新点在于提出了样本级的任务路由机制，将LLM前馈网络转换为任务专家，实现了任务间的解耦和计算效率的提升；这为多任务视频语言学习提供了一种可解释且计算高效的解码器替代方案。

Abstract: Procedural video-language models must solve heterogeneous tasks from the same visual evidence, including action recognition, forecasting, and procedure prediction. Dense transformer decoders share the same feed-forward networks across tasks, which can entangle task behavior and make controlled capability expansion difficult. Sparse Mixture-of-Experts (MoE) decoders provide conditional computation, but token-level learned routing is not naturally aligned with task-level procedural objectives. We propose MoTE (Mixture of Task Experts), a decoder architecture that converts large language model feed-forward networks into task-specific experts while keeping the multimodal backbone shared. Each example follows one sample-level task route, so active task-expert computation remains independent of the number of stored task experts. We instantiate this design as VideoLLM-MoTE and evaluate it on five COIN benchmarks using explicit task routes. The five-expert model activates ~2B LLM parameters per sample and achieves higher average top-1 accuracy than recent VideoLLM baselines. Under the same expert topology, it improves over dense all-expert activation and learned sparse-routing controls. These results show that task-structured routing provides an interpretable and compute-efficient decoder alternative for multi-task video-language learning.

[74] TorchMorph: CUDA-accelerated Morphological Transforms cs.CVPDF

Kai Zhao

TL;DR: TorchMorph是一个轻量级的PyTorch扩展库，旨在为GPU训练循环提供高效、多维度的形态学变换和距离变换操作。它通过实现融合的CUDA内核，支持批量处理和多达八个空间维度，并提供了与scipy.ndimage兼容的API，以简化现有代码的迁移。

Details

Motivation: 现有的Python生态系统中的形态学变换参考实现（如scipy.ndimage）仅限于CPU、单数组操作，无法在GPU训练循环中直接使用，而现有的GPU视觉库（如基于PyTorch的）功能有限，通常只支持二维空间和平坦结构元素。TorchMorph旨在填补这一空白，提供GPU加速的、多维度的形态学操作。

Result: 在批处理执行模式下，TorchMorph在灰度形态学操作上比scipy.ndimage的吞吐量高出高达1.1e3倍，在精确欧几里得距离变换上高出350倍；其Sinkhorn求解器比POT库快42倍。二进制和倒角操作符与SciPy结果完全一致，所有浮点值操作符与CPU参考的绝对误差在1.8e-6以内。

Insight: 论文的创新点在于设计了一个与scipy.ndimage API完全兼容的CUDA加速PyTorch扩展，支持高维批量处理，并通过融合内核实现高性能。从客观角度看，其将传统图像处理算子高效集成到现代深度学习框架中，解决了GPU训练中数据来回传输的瓶颈，具有实际工程价值。

Abstract: Morphological transforms are long-standing tools for shape and mask processing, but the de facto reference implementation in the Python ecosystem, i.e. scipy.ndimage, is CPU-only, single-array, and therefore unusable inside a GPU training loop without an expensive device-to-host round trip. GPU vision libraries built on PyTorch cover a narrow subset of these operators, typically restricted to two spatial dimensions and flat structuring elements. We present TorchMorph, a lightweight PyTorch extension that closes this gap. TorchMorph exposes 22 public operators covering binary morphology, greyscale morphology, exact and approximate distance transforms, and entropy-regularised optimal transport, all implemented as fused CUDA kernels that operate directly on (B, C, Spatial…) CUDA tensors with up to eight spatial dimensions. The API deliberately mirrors scipy.ndimage argument-for-argument, including border modes, structuring-element origins and pre-allocated outputs, so that existing pipelines port with a change of import. We describe the layered architecture and the kernel designs behind each operator family. Against single-threaded CPU references, batched execution reaches up to 1.1e3 times the throughput of scipy.ndimage on greyscale morphology and up to 350x on exact Euclidean distance transforms, while the Sinkhorn solver runs up to 42x faster than POT. Binary and chamfer operators reproduce their SciPy counterparts exactly, and every float-valued operator agrees with the CPU reference to within 1.8e-6 absolute error. TorchMorph is released under the MIT licence at https://intcomp.github.io/tm.

[75] LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training cs.CV | cs.AI | cs.LGPDF

Andreas Hochlehnert, Marianna Nezhurina, Mehdi Cherti, Andrej Radonjic, Thaddäus Wiedemer

TL;DR: LAION-BVD是一个大规模开放视频数据集，包含从CommonCrawl收集的13亿个平台特定视频URL，实际下载了8000万个视频，总时长达到1000万小时。该数据集专为跨视频、音频和图像模态的多模态预训练而设计，通过内容感知场景检测提取片段并合成生成视频和音频字幕。基于此数据集训练的模型在标准视频-文本和音频-文本基准测试中取得了有竞争力的性能，并且随着训练规模或模型规模的增加性能持续提升。

Details

Motivation: 旨在解决大规模、高质量开放多模态视频数据稀缺的问题，为研究社区提供一个前所未有的、可公开访问的视频数据集，以支持跨模态学习的研究与发展。

Result: 在该数据集上训练的模型在标准视频-文本和音频-文本基准测试中取得了有竞争力的性能，并且性能随训练或模型规模扩大而持续提升。此外，从视频中提取的场景变化帧用于图像-文本训练，在图像-文本检索任务上也取得了强劲的表现。

Insight: 主要创新点在于构建了一个规模空前（1000万小时）的开放多模态视频数据集，并采用了内容感知场景检测来提取有意义的片段，同时合成了视频和音频字幕。从客观角度看，其通过提取场景变化帧作为图像-文本数据源，提供了一种与标准网络图像语料库视觉分布不同的新数据来源，这为多模态模型训练提供了新的数据视角和可能性。

Abstract: We present LAION-BVD, a large-scale open video dataset for multimodal learning, which contains 1.3B platform-specific video URLs collected from CommonCrawl. From these, we download 80M videos with a total duration of 10 million hours. The dataset is designed for multimodal pre-training across the video, audio, and image modalities. Using content-aware scene detection, we extract clips for which we synthetically generate video and audio captions. Models trained on these data achieve competitive performance on standard video-text and audio-text benchmarks, with consistent improvements as training or model scale increases. Additionally, we explore video frames as an alternative source of image-text data by extracting scene-changing frames. These frames exhibit a visual distribution distinct from standard web image corpora, and models trained on this dataset achieve strong image-text retrieval performance. We release LAION-BVD to the research community. It significantly expands open access to multimodal videos at an unprecedented scale.

[76] MoE-based Feature Adapter for Prompt-free Binary Coronary Artery Segmentation in X-ray Angiography cs.CVPDF

Lin Xi, Yingliang Ma

TL;DR: 本文提出了一种基于混合专家（MoE）的无提示特征适配器，用于X射线血管造影视频中的冠状动脉二值分割。该方法利用多个轻量级专家模块，通过输入依赖的top-k路由机制自适应地细化血管相关特征，同时控制计算成本。实验表明，该方法在MOSXAV数据集上优于现有基线模型，并在跨数据集（XACV）评估中展现出更好的泛化能力。

Details

Motivation: X射线血管造影中冠状动脉的准确分割对于定量分析和图像引导介入至关重要，但由于血管细、对比度低，以及导管、导丝和复杂解剖背景的干扰，现有U-Net和Transformer模型的共享特征适配路径难以应对血管造影外观的异质性。

Result: 在MOSXAV数据集上的实验显示，该方法超越了代表性基线模型；在XACV数据集的外部评估中，其跨数据集泛化性能得到提升，表明MoE适配器学习能实现鲁棒的冠状动脉分割。

Insight: 创新点在于将参数高效的Vision Transformer适配器与MoE结合，通过输入依赖的top-k路由动态选择专家，自适应地细化特征，在保持计算效率的同时增强模型对异质性血管造影的适应能力，为医学图像分割提供了可扩展的适配器设计思路。

Abstract: Accurate segmentation of coronary arteries in X-ray angiography videos is essential for quantitative coronary analysis and image-guided interventions. However, accurate segmentation remains challenging because coronary vessels are thin and exhibit low contrast, while the presence of catheters, guidewires, and complex anatomical background structures can further interfere with vessel delineation. Existing U-Net- and Transformer-based models provide strong baselines, but their shared feature-adaptation pathways may be insufficient for heterogeneous angiographic appearances. In this paper, we propose a prompt-free mixture-of-experts (MoE) feature adapter for binary coronary artery segmentation. Built upon parameter-efficient Vision Transformer adapters, the proposed method uses multiple lightweight experts with input-dependent top-$k$ routing to adaptively refine vessel-related features while limiting active computational cost. Experiments on MOSXAV and external evaluation on XACV show that the proposed method outperforms representative baselines and improves cross-dataset generalisation. These results suggest that MoE-based adapter learning is effective for robust coronary artery segmentation in X-ray angiography videos.

[77] From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms cs.CVPDF

Jiangning Zhang, Haojun Chen, Yong Liu

TL;DR: 这篇论文首次提出一个统一框架来系统研究智能眼镜作为第一人称智能平台的发展。它从数据流、硬件能力、基础能力、应用场景和部署评估等多个维度，对智能眼镜从感知到行动的完整闭环进行了全面的梳理和形式化分析。

Details

Motivation: 当前智能眼镜的研究在设备、任务和基准测试方面呈现碎片化，缺乏一个统一的系统视角。核心挑战在于构建一个能够持续、可靠、可纠正且可治理的“感知-状态-交互-行动”闭环系统，而不仅仅是孤立地完成识别、回答、记忆或行动等单一任务。

Result: 论文是一项综述性研究，并未报告具体的定量实验结果。它通过引入一个从L0（捕获）到L5（具身耦合）的六级能力框架，以及一个九维部署框架和基于声明的评估协议，旨在使不同智能眼镜系统更具可比性、可部署性和可复现评估性。

Insight: 创新点在于首次为智能眼镜领域提出了一个统一的、系统性的分析框架，将硬件能力、软件能力、应用场景和部署评估整合在一起。其核心洞察是将智能眼镜视为一个完整的“第一人称智能平台”，强调构建可持续、可治理的感知-行动闭环，这为未来可信赖的具身智能系统发展提供了清晰的路线图。

Abstract: Smart glasses are evolving from capture and display accessories into first-person intelligence platforms that connect human perception, persistent context, and digital or physical action. Their on-body viewpoint aligns with the wearer’s vision, audition, motion, and hand-object interaction, but must operate under tight energy, thermal, privacy, and feedback constraints. Despite rapid progress in augmented reality, egocentric vision, multimodal models, human-computer interaction, and embodied intelligence, the literature remains fragmented across devices, tasks, and benchmarks. \textit{The key challenge is not whether a model can recognize, answer, remember, or act in isolation, but whether a complete system can sustain a reliable, temporally valid, correctable, and governable perception-state-interaction-action loop.} This survey is \textit{the \textbf{first} to systematically study smart glasses through such a unified framework}. We formalize first-person data flow and constrained task utility, characterize devices along eight verifiable hardware capability axes, organize the literature around seven interdependent foundational capabilities, and introduce an L0-L5 framework spanning capture, reactive perception, contextual assistance, persistent state, governed action, and embodied coupling. Across nine application scenes, we connect tasks with datasets, systems, products, stakeholders, failure consequences, and evidence gaps. We further present a nine-dimensional deployment framework, a claim-conditioned evaluation protocol, and an evidence ladder from controlled measurement to longitudinal field validation and audit. Together, these elements make smart glasses more comparable, deployable, and reproducibly evaluated, while outlining a roadmap toward trustworthy first-person intelligence.

cs.SE [Back]

[78] Evaluating Language Models on Cross-Language Code Functional Equivalence cs.SE | cs.AI | cs.CLPDF

Hui Sun, Anderson Uchôa, Rohit Gheyi, Wesley K. G. Assunção

TL;DR: 本文研究了大型语言模型（LLMs）在判断跨编程语言（CPP、Java、Python）的人类编写代码的功能等价性上的能力。作者引入了PolyHuman数据集进行评估，发现当前LLMs（包括GPT-4-mini、Claude Opus 4.7、Gemini 3 Flash）在功能等价性判断上并不可靠，其性能随问题难度增加而下降，并表现出模型特定的语言敏感性及基于表面相似性的推理倾向。

Details

Motivation: 现有评估主要关注单语言设置或依赖合成生成的代码，这引发了对LLMs是否真正理解程序语义的担忧。本文旨在探究LLMs能否在需要超越表面相似性的深层推理的人类编写代码场景中，准确判断跨语言功能等价性。

Result: 在PolyHuman数据集上的评估表明，LLMs在功能等价性判断上存在困难依赖性崩溃（更难的问题导致模型更易将不等价代码误判为等价），最佳模型对编程语言具有特定敏感性（尤其对Python表现出更保守的行为），并部分依赖基于相似性的线索。GPT-4-mini在相同设置下还表现出显著的运行间不稳定性。

Insight: 论文的创新点在于构建了人类编写的跨语言代码数据集PolyHuman，并系统评估了LLMs在真实语义理解任务上的局限性。从客观角度看，其失败案例的手动分析和对模型间差异的比较，揭示了当前SOTA LLMs在程序语义推理方面存在的普遍且根本的不足，而非特定模型的问题。

Abstract: Background: Large Language Models (LLMs) have demonstrated strong performance across a variety of code-understanding tasks, leading many to believe that they can reason about program semantics. However, existing evaluations primarily focus on single-language settings or rely on synthetically generated code, raising concerns about whether current results reflect true semantic understanding. Aims: We investigate whether LLMs can accurately judge functional equivalence across different programming languages in human-written code, a setting that requires deeper reasoning beyond superficial similarity. Method: We introduce PolyHuman, a dataset of human-written programs in CPP, Java, and Python. Using this dataset, we evaluate intra- and inter-language equivalence detection across open-weight and proprietary LLMs, selecting GPT-o4-mini as a representative model to assess stability. We then manually analyze 81 cases of systematic disagreement in which models incorrectly judge functional equivalence, examining the code logic and the generated Chain-of-Thought reasoning. Finally, we categorize these failures and compare them across GPT-o4-mini, Claude-Opus-4.7, and Gemini-3-Flash to determine whether they reflect model-specific issues or broader limitations of state-of-the-art LLMs. Results: We identify a difficulty-dependent breakdown in equivalence judgment (harder problems make the model increasingly prone to misclassifying non-equivalent code as equivalent), a model-specific sensitivity to programming language for the best-performing model (particularly a more conservative behavior on Python), and a partial reliance on similarity-based cues. GPT-o4-mini also shows substantial run-to-run instability under identical settings, indicating inconsistent rather than absent capability. Conclusions: Current LLMs do not reliably capture functional equivalence within or across languages.

[79] DeepRepoQA: Code Repository Question Answering with Deep Agent Exploration cs.SE | cs.CL | cs.PLPDF

Weihan Peng, Yuling Shi, Yingwei Ma, Longfei Yun, Beijun Shen

TL;DR: 本文提出了DeepRepoQA，一种用于代码仓库问答的新型框架，旨在解决开发者对软件仓库的深层理解问题。该框架基于LLM智能体，通过蒙特卡洛树搜索（MCTS）机制在仓库结构上进行系统化的树搜索，实现对多文件、复杂软件架构和长距离代码依赖的深度推理。

Details

Motivation: 现有仓库理解方法主要依赖浅层代码检索，缺乏对多文件、复杂架构和长距离代码依赖的深度推理能力，因此需要一种能进行系统化探索的问答框架。

Result: 在SWE-QA基准测试上的综合实验表明，DeepRepoQA相比强基线取得了显著的性能提升，验证了MCTS引导的系统化探索在多跳仓库推理中的有效性。

Insight: 创新点在于将MCTS与LLM智能体结合，实现动态搜索和导航代码仓库的agentic框架，为多跳推理提供了可扩展的解决方案；从客观角度看，该方法将强化学习中的搜索策略应用于代码理解任务，是一种有前景的跨领域技术融合。

Abstract: Answering developer questions about a software repository is a critical yet under-explored problem in software engineering. While existing repository understanding methods have advanced the field, they predominantly rely on surface-level code retrieval and lack the ability for deep reasoning over multiple files, complex software architectures, and grounding answers in long-range code dependencies. To address these limitations, we propose DeepRepoQA, a novel question answering (QA) framework for repository-level code understanding. DeepRepoQA builds on an agentic framework where LLM agents find answers through a systematic tree search over the repository structure. A Monte-Carlo Tree Search (MCTS) mechanism is employed to empower agents to dynamically search, navigate, and inspect code, enabling effective multi-hop reasoning over long-range code dependencies. Comprehensive experiments on the SWE-QA benchmark demonstrate substantial performance gains over strong baselines, validating the effectiveness of systematic MCTS-guided exploration for multi-hop repository reasoning.

[80] Ockhamareto: Pareto-Gated Segment-Level Credit Assignment for Concise Unit-Test Generation with Reinforcement Learning cs.SE | cs.CLPDF

Dong Huang, Mark Harman, Jie M. Zhang, Zhijiang Guo, Mingzhe Du

TL;DR: 本文提出了Ockhamareto，一个用于单元测试生成与选择的单次GRPO强化学习框架。它基于奥卡姆剃刀和帕累托最优原则，通过帕累托门控奖励和令牌级分段信用分配机制，旨在生成更简洁（测试用例更少）且更有效（杀死更多变异体）的测试套件。

Details

Motivation: 动机在于解决现有强化学习方法在单元测试生成中，难以在测试套件的有效性（如变异分数）和效率（如测试数量）之间取得最佳权衡的问题，旨在自动生成既简洁又高覆盖的测试。

Result: 在UnLeakedTestBench等多个基准测试（HumanEval+, MBPP+, CodeContests, TestGenEval-Lite）上，Ockhamareto在帕累托意义上严格优于最强的RL基线MIST-RL。具体而言，在N=5时获得了49.9% vs 31.3%的更高变异分数，同时平均使用更少的测试（2.60 vs 4.67），实现了3.4倍的每测试权衡改进，并在所有模型规模（4B, 9B, 27B）上均优于现有最优方法。

Insight: 核心创新点在于将奥卡姆剃刀（追求简洁）和帕累托最优（多目标权衡）原则形式化地融入强化学习信用分配。具体包括：1）帕累托门控奖励，仅奖励在（变异分数，-测试数量）空间上非支配的轨迹；2）令牌级分段信用，将每个测试杀死的变异体边际贡献归因到其对应代码块的令牌上。此外，研究发现帕累托前沿上的最优权衡点（膝点）与函数大小等简单代理指标无关，这论证了计算完整帕累托前沿的必要性。

Abstract: We introduce \textbf{Ockhamareto}, a single-shot GRPO framework for unit-test generation and selection, based on the principles of \emph{Ockham’s Razor} and \emph{Pareto Optimality}. Ockhamareto has two principal components: (i)~~a \emph{Pareto-gated Bonus} that rewards only rollouts non-dominated in~~(mutation, $-$#tests) space, and (ii)~~\emph{Token-level Segment Credit}, which attributes each test’s marginal mutation kills back to the tokens of its unit-test block. On the \emph{UnLeakedTestBench~~(ULT)}, Ockhamareto \emph{strictly Pareto-dominates} the strongest RL baseline(\emph{MIST-RL}). Furthermore, it dominates on {\em each and all} optimization objectives, catching more bugs ($49.9%$ vs $31.3%$ mutation score at $N{=}5$), using \emph{fewer} tests ($2.60$ vs $4.67$ on average), thereby achieving $3.4\times$ the per-test trade-off improvement. The advantage is found in all four benchmarks(\emph{HumanEval+}, \emph{MBPP+}, \emph{CodeContests}, \emph{TestGenEval-Lite}): Ockhamareto leads both mutation and coverage metrics on every one, always with the smallest suite. Ockhamareto also outperforms the state-of-the-art at all model scales, adding $+30$–$35$~pp mutation at 4B, 9B, and 27B model sizes. We also show that the knee point of the optimal trade-off between efficiency and effectiveness on the Pareto front is not correlated with obvious more easily computed proxy metrics, such as function size. This finding motivates the Pareto front computation; it is needed to identify this crucial engineering trade-off for each function under test.

q-bio.NC [Back]

[81] A Human-Factors Guided Cognitive Model of Visuospatial Complexity in Embodied Active Vision q-bio.NC | cs.AI | cs.CVPDF

Vasiliki Kondyli, Jakob Suchan, Mehul Bhatt

TL;DR: 本文提出了一种新颖的多模态数据分析框架，重点关注动态自然环境中具身感知与交互中的复杂性。该框架基于具身认知和主动视觉理论，将复杂性视为由定量、结构、动态、听觉和交互等多种属性构成的整体，并以日常驾驶为例阐述了其在表征视空间复杂性方面的应用。

Details

Motivation: 现有研究主要关注视觉复杂性，但缺乏一个能够全面分析动态、自然环境中多模态（视觉、听觉、空间）复杂性的理论框架，特别是从具身和主动视角出发，整合认知人因的模型。

Result: 论文未提供具体的定量实验结果，但论证了所提模型为表征视空间复杂性及其交互（特别是在驾驶场景中）提供了理论框架，并为创建和评估以认知人因为中心的基准数据集奠定了基础。

Insight: 创新点在于将复杂性分析从单一的视觉属性扩展到多模态、多属性的整体框架，并强调具身交互和认知人因的核心作用，为从以人为本的视角自动化解释3D动态环境复杂性提供了可解释的计算分析语义模板。

Abstract: We propose a novel framework for the analysis of multimodal data – encompassing visual, auditory, and spatial stimuli – foregrounding the role of complexity in embodied perception and interaction in dynamic, naturalistic settings. Grounded in theories of embodied cognition and active vision, we argue that embodied perceptual complexity emerges from an agent’s dynamic engagement with the environment and must be analyzed holistically, as a combination of qualitative and quantitative attributes pertaining to, for instance, visuospatial and auditory features. Building on previous work on visual complexity, we expand this into a categorization of diverse complexity attributes – quantitative, structural, dynamic, auditory, and interactional – that together characterize multimodal complexity. We demonstrate how this model provides a theoretical framework for characterizing aspects of visuospatial complexity and their interactions, specifically in the context of everyday driving. We also discuss practical applications of the proposed model for creating and evaluating benchmark datasets (e.g., in driving) that centralize cognitive human factors, as well as applications aimed at systematically investigating the effect of visuospatial complexity on human active vision from the viewpoint of visual perception research. The proposed framework lays the foundation for automated methods that interpret complexity in 3D dynamic environments from a human-centered perspective, serving as a semantic template for explainable computational analysis of visuospatial complexity with a categorical focus on cognitive human factors.

cs.MA [Back]

[82] Markets, Not Planners: Decentralized Orchestration of LLM Agents with Private Information cs.MA | cs.CLPDF

Xiao Liu, Haoyang Li, Songwei Li, Hongbo Fang, Fengli Xu

TL;DR: 本文提出了AgentLance，一个去中心化的、基于重复劳动力市场的LLM智能体编排框架，以解决集中式编排存在的瓶颈、信息私密性要求和易受操纵等问题。该框架通过让智能体基于私有成本出价竞标任务，分配器结合出价和公共声誉记录选择中标者，并采用VCG式支付规则来激励成本感知的投标。复杂任务通过分层委托机制处理。

Details

Motivation: 随着由不同方构建、具有不同能力和成本的LLM智能体激增，编排它们更像是在经济体中调配劳动力，而非计算机调用子程序。现有的集中式编排存在单点瓶颈、需要获取智能体私有信息（如执行成本）以及易被操纵（例如，单个插入的偏好就能使受青睐智能体的任务份额翻倍）等问题。

Result: 在数学推理、代码生成、知识密集型问答和智能体任务等多个领域，AgentLance能够将任务匹配到具有专长的智能体，并在成本敏感性提高时将工作转向更便宜的智能体。它持续优于单一模型、集中式编排以及市场基线方法。通过诊断并纠正市场失灵（如成本自我估计不准确和次优投标），在受控实验中获得了进一步的性能提升。

Insight: 核心创新在于将经济学的重复劳动力市场机制引入LLM智能体编排，通过去中心化的竞标和声誉系统实现高效、抗操纵的任务分配，并设计了分层委托来处理复杂任务。这为构建更高效的智能体经济提供了一条路径，其VCG支付规则和诊断/纠正市场失灵的框架具有借鉴意义。

Abstract: As LLM agents proliferate, built by different parties and with different capabilities and costs, orchestrating them is more like assembling labor across the economy than a computer calling a subroutine. Existing orchestration is typically centralized, with a single planner assigning every task, but this creates a bottleneck as agent pools grow, requires private information (e.g., agents’ execution costs), and can easily be manipulated, such that a single inserted preference nearly doubles a favored agent’s task share under a centralized LLM allocator. We introduce AgentLance, a repeated labor market in which agents bid on tasks using their private costs and self-maintained strategy notes, an allocator selects winners from bids and public reputation records, and a VCG-style payment rule rewards cost-aware bidding. Complex tasks are handled by hierarchical delegation: winning agents can decompose work and subcontract it through the same mechanism. Across mathematical reasoning, code generation, knowledge-intensive QA, and agentic tasks, AgentLance matches agents to their specializations, shifts work toward cheaper agents as cost sensitivity rises, and consistently outperforms single-model, centralized-orchestration, and market baselines. Diagnosing market failures, including inaccurate cost self-estimation and sub-optimal bidding, then correcting them in controlled experiments yields further gains, charting a path toward more efficient agent economies.

cs.RO [Back]

[83] Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning cs.RO | cs.CVPDF

Sixiang Chen, Jiaming Liu, Jixian Wu, Yichen Guo, Tinghao Wang

TL;DR: 本文针对动作条件世界模型在策略学习中的有效性提出质疑，指出现有模型在遵循非专家动作方面存在不足。作者提出了WorldEcho诊断框架来评估模型在更广泛动作分布下的表现，并提出了WorldSync方法从三个互补维度增强模型的动作跟随能力。实验表明，WorldSync能提升诊断指标，并作为更可靠的模拟器来迭代改进策略，从而提高策略成功率。

Details

Motivation: 动机在于验证动作条件世界模型的一个核心未经验证的假设：生成的未来能否忠实地反映任意有效的动作。现有基准通常局限于专家演示，导致对非专家动作跟随能力的评估不足。

Result: 在RoboTwin基准和真实机器人任务上的实验表明，WorldSync改善了WorldEcho诊断指标，并作为一个更可靠的模拟器用于迭代策略改进，使策略达到了更高的成功率。

Insight: 创新点在于提出了一个专门的诊断框架（WorldEcho）来系统评估世界模型在广泛动作分布下的动作跟随能力，并提出了一个多维度对齐方法（WorldSync）来增强模型的分布覆盖、表征基础和干预效果对齐，从而提升其作为策略学习模拟器的可靠性。

Abstract: Action-conditioned world models are increasingly used as learned simulators for policy evaluation and improvement, yet their effectiveness rests on an unverified assumption: generated futures faithfully reflect arbitrary valid actions. Existing benchmarks are typically confined to expert demonstrations, leaving off-expert action following inadequately evaluated. To address this gap, we introduce WorldEcho, which probes action following over a broader action distribution using visual integrity and SE(3) trajectory alignment. Our diagnosis shows that current world models reasonably execute expert actions but struggle with diverse off-expert trajectories, either ignoring the commanded actions or producing visually invalid rollouts. We further propose WorldSync, which strengthens action following along three complementary axes: distributional coverage, representational grounding, and intervention-effect alignment. It broadens the training distribution over action consequences, grounds intermediate video representations in action-induced robot dynamics through an Action-Forcing Expert, and aligns predicted changes under action interventions with the corresponding changes in ground-truth futures. Experiments on RoboTwin benchmarks and real-robot tasks show that WorldSync improves WorldEcho metrics and serves as a more reliable simulator for iterative policy improvement, enabling policies to achieve higher success rates.

cs.IR [Back]

[84] Wontopos Tablet 2: Measuring Multilingual and Multimodal Memory Retrieval Without Lexical Matching cs.IR | cs.CL | cs.CVPDF

Sunwoo Kim

TL;DR: 本文评估了Wontopos Tablet 2，一个用于语言模型的生产级长期记忆引擎，在文本基准和跨语言图像检索任务上的性能。该引擎的检索路径不依赖词汇匹配、关键词评分或自身的语言模型。论文重点指出，仅靠基准测试分数本身意义有限，因为读者模型或重问预算等变量的变化会显著影响结果，且现有报告常忽略这些因素。在多模态评估中，该引擎在无文本图像检索上大幅优于BM25等基线方法，并展示了更好的跨语言一致性，但也揭示了低资源语言性能下降、添加标题损害跨语言检索等挑战。

Details

Motivation: 论文旨在评估一个不依赖词汇匹配的长期记忆引擎在跨语言和多模态检索任务中的实际性能，并批判性地指出当前基准测试报告的局限性，即未考虑读者模型、重问预算等关键变量对结果的影响。

Result: 在LongMemEval-S（500题）上准确率为95.7%，在BEAM-1M（700题，221万记忆）上为67.5%。在多模态检索中，在70个存储-查询语言单元上平均召回率@5达95.2%，而BM25仅为19.0%；在14种语言的300张Crossmodal-3600图像上，跨语言性能波动（14.0）低于密集基线方法（27.5和27.7）。但低资源语言（如斯瓦希里语53.0%，泰卢固语64.0%）性能显著下降。

Insight: 创新点在于采用无词汇匹配的检索路径，并系统揭示了基准测试中常被忽略的变量（如读者模型、重问预算）对结果的重大影响，强调评估需控制这些因素。客观来看，其多模态跨语言检索设计提供了更稳健的性能，但对低资源语言和标题添加的负面效应揭示了实际部署中的挑战。

Abstract: We measure tablet-2, a production long-term memory engine for language models, on the text benchmarks the field already uses and on cross-lingual retrieval of photographs stored with no text at all. Its retrieval path contains no lexical matching, no keyword scoring, and no language model of its own. On LongMemEval-S (500 questions) it scores 95.7% [93.4, 97.1]; on BEAM-1M (700 questions, 2.21M stored memories) 67.5% [64.8, 70.2]. Those are question-sampling intervals, not the run-to-run spread, which is an order of magnitude narrower. Most of the paper is about how little they mean alone. Holding engine, corpus, settings and judge fixed, changing only the reader moves LongMemEval-S by 2.0 points; changing only the re-ask budget moves BEAM-1M by 8.9. Neither is stated in the reports we compare against, and the second exceeds most gaps there, so we give that table as a placement and not a ranking. For the multimodal axis we run two controls. Against BM25, configured as strongly as we could, we reach 95.2% mean recall@5 over 70 store-and-query language cells where BM25 reaches 19.0% and is exactly zero in 54. On captionless photographs a lexical method has no document to score at all. Open dense baselines on 300 Crossmodal-3600 photographs in 14 languages show that density confers no language independence: one scores 91.0% on English and 4.7% on Russian from identical image vectors, and a multilingual variant collapses on Telugu and Swahili. Our spread across languages is 14.0 against their 27.5 and 27.7. Three results run against us and are reported at equal weight: low-resource languages degrade sharply (Swahili 53.0%, Telugu 64.0%), attaching captions lowers cross-lingual retrieval by 11.4 points, and one setting omitted into one stage of our own retrieval cost 37 points of Korean top-1 accuracy while leaving nine languages untouched.

cs.LG [Back]

[85] Discovering Cross-Language Reasoning Invariance in LLMs with Geometry-Invariant Sparse Autoencoders cs.LG | cs.AI | cs.CLPDF

Igor Bogdanov, Changcheng Huang

TL;DR: 本文研究了多语言大语言模型解决跨语言数学问题时是否依赖共享特征。作者在MGSM数据集上对五个模型进行分析，通过CKA识别跨语言对齐层，并提出了几何不变稀疏自编码器（GI-SAE）来增强特征相似性。研究发现，尽管GI-SAE提高了几何相似性，但跨语言特征共享的功能可互换性因模型和架构而异，且几何相似性并不总意味着更好的功能互换。

Details

Motivation: 探究多语言大语言模型在解决相同数学问题时，是依赖跨语言的共享特征，还是仅通过语言特定的计算产生相似输出，以理解其内部表示机制。

Result: 在MGSM数据集上对Qwen、Gemma、Llama和Phi等模型进行实验，GI-SAE在几乎所有层都提高了CKA和Jaccard相似度，但功能可互换性（通过KL散度衡量）未一致提升；跨语言特征共享的效果因模型和架构不同而异，例如在Qwen中增强，在Gemma中无功能益处，在Llama和Phi中效果混合。

Insight: 创新点在于引入几何不变稀疏自编码器（GI-SAE），通过结合重构损失和InfoNCE损失来训练编码器，使相同问题的激活在不同语言和位置下更相似；客观分析表明，该方法主要放大模型已有的跨语言结构，但功能可互换性受模型特定模式影响，揭示了跨语言推理不变性的复杂性。

Abstract: Multilingual language models can solve the same mathematical problem in different languages, but it remains unclear whether they rely on shared features or on language-specific computations that only produce similar outputs. We study this question in five models from four families using the Multilingual Grade School Math (MGSM) dataset, with problems solved in English, German, French, Spanish, Russian, and Chinese, retaining problems with valid reasoning traces in all six languages and replaying those traces through the model to record representations at multiple layers. For each model, we first use Centered Kernel Alignment (CKA) to identify layers with cross-language alignment. At each selected layer, we train two sparse autoencoders (SAE): a baseline reconstruction-only model and a contrastive variant introduced in this work, the Geometry-Invariant SAE (GI-SAE). GI-SAE supplements the reconstruction loss with an Information Noise-Contrastive Estimation (InfoNCE) loss that trains the encoder to produce similar activations for traces of the same problem, regardless of language or token position. We then test whether the resulting shared features are functionally interchangeable by swapping their values between languages during the model’s forward pass and measuring the resulting change in output, quantified by Kullback-Leibler (KL) divergence per feature. Although GI-SAE yields higher CKA and Jaccard similarity at nearly every layer, higher geometric similarity does not consistently imply greater functional interchangeability. We find that cross-language feature sharing is model- and architecture-dependent in this sample and appears at different depths in different models. GI-SAE primarily amplifies cross-language structure already present: the pattern is model-specific, with strengthening in Qwen, no functional benefit in Gemma, and mixed layer-dependent effects in Llama and Phi.

[86] Joint Distribution Alignment for Universal Domain Adaptation cs.LG | cs.CVPDF

Shizhe Li, Hongshan Pu, Mengying Xie, Yi Xiang, Xiaowei Yang

TL;DR: 本文提出了一种用于通用域适应（UniDA）的新算法JAUA，该算法通过最小化卡方散度来对齐源域和目标域的联合分布，并采用渐进式伪标签方法为目标域未标记样本分配伪标签。论文为UniDA提供了泛化误差上界的理论分析，并在六个公共图像数据集上验证了方法的优越性。

Details

Motivation: 传统无监督域适应（UDA）假设源域和目标域标签空间完全相同，仅处理样本分布漂移。然而，现实应用中两域标签空间可能不同，即存在样本分布漂移和类别空间差异的通用域适应（UniDA）场景，且现有工作缺乏理论分析。

Result: 在六个公共图像数据集上的实验结果表明，JAUA算法在处理UniDA问题上表现出优越性。

Insight: 创新点包括为UniDA提供了泛化误差上界的理论分析，并提出通过最小化卡方散度对齐联合分布的JAUA算法，以及渐进式伪标签方法。从客观角度看，将理论分析与具体算法设计结合，并针对标签空间差异场景进行联合分布对齐，是其主要贡献。

Abstract: Unsupervised domain adaptation (UDA) has been widely concerned in the fields of machine learning, pattern recognition, and computer vision. Traditional UDA learning usually assumes that the label spaces of the source and target domains are exactly the same and only needs to solve the problem of sample distribution drift existing between two domains. However, in real world applications, the label spaces between two domains may be different. In this case, there are both sample distribution drift and class spatial difference between domains, namely Universal Domain Adaptation (UniDA) learning scenario. At present, existing works rarely offer theoretical analysis for universal domain adaptation. In this paper, we provide an upper bound of the generalization error for universal domain adaptation. According to the proposed generalization error bound, we propose a novel UniDA algorithm called Joint Distribution Alignment for Universal Domain Adaptation (JAUA), which aligns the joint distributions by minimizing the distribution discrepancy calculated by Chi-Square divergence. Furthermore, we propose a progressive pseudo-labeling method to assign the pseudo labels to unlabeled target samples. The experiment results on six public image datasets demonstrate the superiority of JAUA in handling the UniDA problem.

cs.CR [Back]

[87] Not All Tokens Are Equal: Region-Aware Consistency Repair of Backdoors in MLLMs cs.CR | cs.AI | cs.CLPDF

Jiali Wei, Ming Fan, Mingkun Zhang, Haoyu Wang, Jun Sun

TL;DR: 本文提出了一种名为RACER的模型级后门修复框架，专门针对多模态大语言模型（MLLMs）中的后门风险。该方法基于一个关键观察：后门会导致内部表征出现层间不一致异常，且这种异常具有模态依赖性，主要集中在编码触发特征的令牌区域。RACER通过解耦视觉和文本令牌区域、分别归一化其层间不一致性，并利用模态感知权重在深层窗口内重组，构建了一个区域感知的不一致性目标，以更好地捕捉局部后门诱导的异常。通过最小-最大优化，该目标驱动最坏情况扰动合成和对抗性微调来修复模型，抑制后门行为所依赖的深层表征方向性偏移。该方法仅需100个干净样本，无需了解触发器、攻击目标甚至模型是否包含后门。

Details

Motivation: MLLMs在面向用户的应用中部署日益增多，但其构建流程中可能继承后门风险（触发器可能存在于图像、文本或两者中）。现有的模型级后门移除方法主要针对传统分类器设计，对MLLMs效果有限；而MLLM特定的防御主要在推理时运行，仅过滤可疑输入而不移除模型中嵌入的后门。为填补这一空白并从源头消除MLLMs中的潜在后门，本文提出了RACER框架。

Result: 在三个开源MLLMs上，针对涵盖图像、文本和多模态触发器的36种后门设置进行评估，RACER将平均攻击成功率（ASR）降低至1.1%，其中32种设置达到0%，同时在干净任务和后门模型上均保持了实用性能。

Insight: 创新点在于发现了后门导致的层间不一致异常具有模态依赖性，并集中于触发特征编码的令牌区域，从而提出了区域感知的不一致性目标。该方法通过解耦和归一化不同模态的令牌区域，更精准地定位和修复后门，且无需先验知识（如触发器信息），仅需少量干净样本即可实现高效修复。

Abstract: MLLMs are increasingly deployed in user-facing applications, yet they inherit backdoor risks from the pipelines used to construct them: triggers may reside in images, texts, or both. Existing model-level backdoor removal methods, largely designed for conventional classifiers, show limited effectiveness on MLLMs, while MLLM-specific defenses mainly operate at inference time, filtering suspicious inputs without removing the backdoor embedded in the model. To address this gap and eliminate latent backdoors from MLLMs at their source, we present RACER, a model-level repair framework motivated by a key observation: backdoors induce abnormal layer-to-layer evolution in internal representations, which we term the layer-wise inconsistency anomaly. Importantly, this anomaly is modality-dependent, concentrating primarily in the token region encoding the trigger features that the backdoor model actually relies on. RACER therefore decomposes the fused representation into visual and textual token regions, normalizes their layer-wise inconsistency separately, and recomposes them using modality-aware weights over a deep-layer window, yielding a region-aware inconsistency objective that better captures localized backdoor-induced anomalies. Through a min-max optimization, this objective drives worst-case perturbation synthesis and adversarial fine-tuning against the resulting perturbation to repair the model, suppressing the deep representational directional shifts on which backdoor behaviors rely. RACER requires only 100 clean samples and no knowledge of the trigger, attack objective, or even whether the input model contains a backdoor. Evaluations on three open-source MLLMs across 36 backdoor settings spanning image, text, and multimodal triggers show that RACER reduces the average ASR to 1.1%, reaching 0% in 32 settings, while preserving clean-task utility on both backdoor and clean models.

q-bio.QM [Back]

[88] InfoDPP-PAC: Principled Patch Selection for Whole Slide Image Analysis q-bio.QM | cs.CV | cs.IT | cs.LGPDF

Prateek Mittal, Ayush Srivastava, Joohi Chauhan

TL;DR: 本文提出了InfoDPP-PAC，一个用于全切片图像分析的原则性补丁选择框架。它结合了教师引导的高斯过程相关性建模、行列式对数行列式多样性、子模贪婪优化和基于集中度的自适应停止规则，旨在从包含数千个候选组织补丁的WSI中选择一个高质量、低冗余且具有代表性的补丁子集。

Details

Motivation: 解决全切片图像分析中，由于仅有幻灯片级监督而难以从数千个候选组织补丁中进行有效选择的问题。现有方法（如均匀提取、启发式方法、注意力模型和核心集方法）在控制冗余、解耦补丁重要性与下游分类器、以及建模任务相关补丁质量方面存在不足。

Result: 在202张HISTAI胃肠道全切片图像上，自适应规则平均比固定全预算少使用83.7%的补丁，同时保留了97.9%的全预算综合选择质量。在匹配预算下，InfoDPP-PAC在14个基线方法中获得了最高的平均教师相关性分数，其多样性和综合分数接近最强的核心集方法。

Insight: 主要创新点在于提供了一个受控的质量-多样性-基数选择框架，其理论贡献包括揭示了DPP式选择中的对数行列式多样性项是所选子集与潜在相关性函数之间的高斯过程互信息，并推导了残差信息增益的PAC式证书，允许保留的补丁数量随幻灯片自适应变化而非预先固定。

Abstract: Each WSI slide contains thousands of candidate tissue patches, while supervision is usually available only at slide level. Existing bag-construction strategies like Uniform extraction and handcrafted heuristics do not control redundancy while attention-based multiple-instance models couple patch importance to a particular downstream classifier, and coreset methods optimise embedding-space coverage without modelling task-relevant patch quality. We introduce InfoDPP-PAC, a principled patch-selection framework that combines teacher-seeded Gaussian process relevance modelling, determinantal log-determinant diversity,submodular greedy optimisation, and a concentration-based adaptive stopping rule. The main theoretical result shows that the log-determinant diversity term used in DPP-style selection is the Gaussian process mutual information between a selected subset and the latent relevance function. We further derive a PAC-style certificate for residual information gain, allowing the number of retained patches to vary by slide rather than being fixed a priori. The empirical study evaluates whether the selected subset is diverse, spatially and morphologically covering, non-redundant, and enriched for the teacher-derived relevance signal. It does not claim end-to-end diagnostic improvement after retraining a downstream MIL model. On 202 HISTAI gastrointestinal whole-slide images, the adaptive rule uses 83.7% fewer patches on average than a fixed full budget while retaining 97.9% of full-budget composite selection quality. At a matched budget, InfoDPP-PAC achieves the highest mean teacher-derived relevance score among fourteen baselines, with diversity and composite scores close to the strongest coreset methods. The results support InfoDPP-PAC as a controlled quality-diversity-cardinality selection framework, rather than as a downstream clinical predictor.

cs.AI [Back]

[89] LLM Agents Perform Controlled Experiments Using Simulation Models cs.AI | cs.CL | cs.MA | cs.SEPDF

Yuchen Xia, Michael Weyrich, Nasser Jazdi, Johannes Stümpfle, Johannes Sigel

TL;DR: 本文提出了一种多智能体框架，使LLM智能体能够利用科学仿真模型进行受控实验，以支持制药工艺设计。该系统将语言模型与高保真仿真模型在交互式智能体框架中结合，通过构建结构化任务表示、设计实验、执行对比仿真、解释结果并综合基于证据的建议，来优化工艺参数。

Details

Motivation: 尽管LLM在推理、规划和工具使用方面表现出强大能力，但许多科学和工程任务需要理解系统对干预的响应，这依赖于受控实验，而不仅仅是生成合理的文本或代码。

Result: 在工业应用场景中，该系统相比纯语言推理，在输出特异性、用户评定的正确性和有用性方面均有提升。消融研究和可视化案例分析进一步证明了仿真集成实验推理的有效性和实用性。

Insight: 创新点在于将LLM与高保真仿真模型耦合在一个交互式多智能体框架中，支持通过干预、比较和观察进行推理，从而产生更具体和可操作的输出，为过程参数优化提供基于证据的建议。

Abstract: Large language models (LLMs) have shown strong capabilities in reasoning, planning, and tool use, but many scientific and engineering tasks require more than plausible text and code generation. They require understanding how a system responds to intervention, which in practice depends on controlled experimentation. In this work, we propose a multi-agent framework that enables LLM agents to conduct controlled experiments with scientific simulation models for pharmaceutical process design. Given a user query and a baseline configuration, the system constructs a structured task representation, designs experiments, executes comparative simulation, interprets the resulting outcomes, and synthesizes evidence-based recommendations for process parameter optimization. By coupling language models with high-fidelity simulation models in an interactive agent framework, the proposed system supports reasoning through intervention, comparison, and observation. As a result, it produces more specific and actionable outputs than language-only reasoning. In an industrial application setting, this advantage is reflected in higher output specificity as well as improved user-rated correctness and helpfulness. Ablation studies and visualized case analyses further demonstrate the effectiveness and practical utility of simulation-integrated experimental reasoning.

[90] Memory Is Not Always Needed: Characterizing Conditional Memory in Scientific Reasoning cs.AI | cs.CL | cs.LGPDF

Zhen Bi, Xueshu Chen, Yan Wang, Zhizhi Peng, Haosen Hong

TL;DR: 本文研究了条件记忆在科学推理中的作用，提出了一种知识边界感知路由器，用于动态决定是否激活记忆、在哪些层节点注入记忆信号以及信号强度，以优化科学推理性能。

Details

Motivation: 科学推理需要语言模型检索专业知识并可靠地融入多步计算，但条件记忆的效用取决于输入和计算：它可能修复缺失的科学关联，也可能引入干扰或干扰模型已有的正确推理，因此需要系统研究何时、何地以及何种程度使用条件记忆。

Result: 在生物和化学推理基准测试中，涵盖两个骨干模型系列和六种任务类型，实验表明记忆效果因输入、任务和注入位置而异；与静态和激活率匹配的随机路由相比，该方法更一致地保留有益的记忆贡献，同时抑制记忆引起的性能下降。

Insight: 创新点在于通过知识边界表征和可控干预，提出选择性记忆分配原则，并设计基于任务特定输入代理的路由器，动态管理记忆参与，以提高科学推理的可靠性；客观分析认为，该方法为条件记忆的精细化控制提供了可借鉴的框架。

Abstract: Scientific reasoning requires language models to retrieve specialized knowledge and incorporate it reliably into multi-step computation. Conditional memory provides an explicit lookup pathway that complements dense neural representations, but its usefulness is inherently input- and computation-dependent: retrieved information may repair missing scientific associations, yet it may also introduce distracting shortcuts or interfere with reasoning that the base model can already perform correctly. In this work, we systematically investigate when, where, and to what extent conditional memory should participate in scientific reasoning. We characterize the scientific knowledge boundary and controlled interventions on memory-enabled knowledge-circuit nodes. Based on these analyses, we propose a Knowledge Boundary-Aware Router that uses task-specific input proxies available before generation to determine whether memory is activated, which layer-stage nodes receive memory signals, and how strongly these signals contribute. Experiments on biological and chemical reasoning benchmarks, covering two backbone families and six task types, show that memory effects vary substantially across inputs, tasks, and injection locations. Compared with static and activation-rate-matched random routing, our approach more consistently preserves beneficial memory contributions while suppressing memory-induced regressions, establishing selective memory allocation as an important principle for reliable scientific reasoning.

[91] RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguards cs.AI | cs.CLPDF

Houcheng Jiang, Boxuan Zhang, Qiyong Zhong, Junfeng Fang, Xiang Wang

TL;DR: 本文提出RePolicy，一种基于强化学习的智能体安全防护框架，用于在动态策略库下评估语言模型智能体的完整执行轨迹并调用适用的安全策略。该方法通过监督初始化、GRPO强化学习算法结合可验证奖励和策略上下文扰动进行训练，在六个智能体安全基准测试中展现出强大的安全检测性能和稳健的策略调用能力。

Details

Motivation: 现有基于提示或监督微调的策略感知安全防护方法难以适应未见过的轨迹和变化的策略上下文，因此需要一种能够动态调用安全策略并生成基于策略的推理与安全判断的智能体安全保障机制。

Result: 在六个智能体安全基准测试中，RePolicy实现了强大的整体安全检测性能，并在变化的策略上下文中展现出稳健的策略调用能力。

Insight: 创新点在于将强化学习应用于安全策略的动态调用，结合可验证奖励和策略上下文扰动进行训练，并构建了PolicyTraj-20K数据集支持监督初始化，提升了智能体安全保障系统对未知轨迹和动态策略的适应性。

Abstract: Safeguarding language model agents requires assessing complete execution trajectories under context-dependent safety policies. Existing policy-aware safeguards mainly rely on prompting or supervised fine-tuning, limiting their ability to adapt to unseen trajectories and changing policy contexts. We propose RePolicy, an agent safeguard that learns safety-policy invocation through reinforcement learning. Given an agent trajectory and a dynamic policy library, RePolicy invokes the applicable policy and uses its content to produce a policy-grounded rationale and safety judgment. We construct PolicyTraj-20K to support supervised initialization, followed by GRPO with verifiable rewards and policy-context perturbation. Experiments across six agent safety benchmarks show that RePolicy achieves strong overall safety-detection performance and robust policy invocation under varying policy contexts.

[92] When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMs cs.AI | cs.CVPDF

Zhengxiang Wang, Owen Rambow

TL;DR: 本文提出了一个用于评估大型视觉语言模型（LVLMs）在交互式视觉定位任务中性能的基准框架，该任务模拟了现实世界中目标信息不完整、模糊且需要通过对话交互逐步建立的情境。研究发现，当前LVLMs在该任务上的表现显著低于人类基线水平，尤其是在需要主动提问获取目标信息的场景下表现最差，且模型置信度校准不佳。

Details

Motivation: 现有视觉定位评估通常基于一次性、信息完整的指代表达式，忽略了现实参考中目标信息不完整、模糊且需通过交互建立的核心特性。本文旨在填补这一空白，系统评估LVLMs在交互式视觉定位中的能力。

Result: 在四个基于人类数据的视觉场景和四种交互协议下，当前LVLMs的表现显著低于任务级别的人类基线。当没有初始描述、必须通过提问获取目标信息时，性能最低。模型置信度也普遍高于其实际准确率，校准性差。后续研究在不同描述来源、推理努力、重复交互等条件下确认了这些模式。

Insight: 论文的创新点在于提出了一个受控的交互式视觉定位评估框架，强调了主动提问驱动定位（信息寻求与综合）是当前LVLMs面临的重要挑战。从客观角度看，该工作将视觉定位从静态的单轮任务扩展到了动态的多轮对话交互场景，为评估和提升LVLMs的交互式视觉理解能力提供了新的基准和洞见。

Abstract: Visual grounding is typically evaluated as a one-shot mapping from an informative referring expression to a visual target. This formulation misses a central property of real-world reference: target information is often incomplete, ambiguous, and established through interaction. We introduce a controlled evaluation framework for interactive visual grounding in large vision-language models (LVLMs), varying how much target information is provided upfront and how much must be acquired through dialogue. Across four human-grounded visual contexts and four interaction protocols, current LVLMs perform significantly below task-level human baselines. Interaction can help when follow-up questions refine or repair an initial target description. Performance is lowest when no initial description is provided and target information must be acquired through questions, indicating that proactive question-driven grounding remains difficult. LVLMs are also poorly calibrated, often reporting confidence that exceeds their empirical accuracy. Follow-up studies confirm these patterns across varied description sources (human versus AI), reasoning efforts, repeated interactions, description providers, and visual contexts. Overall, interactive visual grounding remains an important challenge, requiring visual matching, information seeking and synthesis.

[93] Real-World Knowledge-Guided Change Data Synthesis for Remote Sensing cs.AI | cs.CVPDF

Yaoyi Qi, Xingxing Weng, Chao Pang, Yongkang Cui, Xiangyu Hao

TL;DR: 本文提出了KnowChange框架，利用预训练的视觉-语言模型作为知识源，从变化前场景和期望变化类型中推理出合理的变化位置和类别转换，从而在统一框架内灵活合成多样变化类型的数据。实验表明，KnowChange生成的数据在合成到真实迁移和合成数据增强方面均优于现有合成数据集。

Details

Motivation: 现有变化数据合成方法通常依赖手工规则模拟变化，其类别转换覆盖有限且预定义转换设计限制了适应不同变化类型的灵活性，因此需要更灵活、多样化的合成方法。

Result: 在合成到真实迁移和合成数据增强的广泛实验中，KnowChange生成的数据一致优于现有合成数据集，尽管生成规模较小。

Insight: 创新点在于利用预训练视觉-语言模型的知识引导变化模拟，并与通用合成模型结合，实现灵活、多样的变化数据合成；该知识引导模拟可无缝集成到现有合成流程中，提升合成数据的下游效用。

Abstract: Change data synthesis provides a cost-effective solution for expanding training data and improving the performance of change detection models. However, existing synthesis methods typically rely on handcrafted rules to simulate changes, where limited coverage of class transitions restricts the diversity of synthesized data, while predefined transition designs limit their flexibility in accommodating varied change types. In this work, we introduce KnowChange, a knowledge-guided change data synthesis framework that leverages pretrained vision-language models as knowledge sources to reason about plausible change locations and class transitions from pre-change scenes and desired change types. By integrating knowledge-guided change simulation with generalizable synthesis models, KnowChange enables flexible synthesis of diverse change types within a unified framework. Extensive experiments demonstrate that KnowChange-generated data consistently outperforms existing synthetic datasets in both synthetic-to-real transfer and synthetic data augmentation, despite being generated at a compact scale. Further analyses show that the knowledge-guided change simulation can be seamlessly integrated into existing synthesis pipelines and enhance the downstream utility of synthesized data.

Table of Contents

cs.CL [Back]

[1] Taming Visual Neglect: A Variational Information Bottleneck Framework for Adaptive Attention in Multimodal In-Context Learning cs.CLPDF

[2] From Triage to Discharge: A Survey of NLP Tasks, Methods, and Open Challenges in the Emergency Department cs.CLPDF

[3] ADE: Agentic Data Evolution Framework for Human-Centered Objectives cs.CLPDF

[4] From Preferences to Principles: Rubric-Based Alignment for Grounded Knowledge Answers cs.CLPDF

[5] SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding cs.CL | cs.AIPDF

[6] Curved Inference II: Sleeper Agent Geometry - Extending Interpretability Beyond Probes cs.CLPDF

[7] PARTAB: Partition-Aware Reasoning with Structured Evidence for Scalable Table Understanding cs.CL | cs.AI | cs.IRPDF

[8] MC-CXR: A Multi-Context Chest X-ray Benchmark for Context-Induced Disruption in Vision-Language Models cs.CLPDF

[9] TrustDABench: Benchmarking Reliability and Robustness of LLMs for Structured Data Analysis cs.CL | cs.SEPDF

[10] RecurSE: Bounded Recursive Self-Evaluation for LLM Rubric Judges cs.CLPDF

[11] Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026 cs.CL | eess.ASPDF

[12] FARCA: Fact-Aligned Reliability-Aware Credit Assignment for Reinforcement Learning with Factual Supervision cs.CL | cs.AIPDF

[13] Is Discrete Difficulty Sufficient? Leveraging Continuous Difficulty for Efficient Self-Consistency in LLMs cs.CLPDF

[14] Beyond Information Seeking: Severity-Aware Question Supervision for Proactive Medical Dialogue cs.CLPDF

[15] Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation cs.CLPDF

[16] The Annotation Bottleneck in Persian Text NLP: Persian as an Annotation-Scarce Language cs.CLPDF

[17] Lost in Speech: Trilingual Spoken Hallucination Detection Across Audio and Transcripts cs.CLPDF

[18] SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents cs.CLPDF

[19] BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes cs.CLPDF

cs.CV [Back]

[20] The Blending Ratio Is Not Where the Performance Is: Diagnosing Prototype Blending for Few-Shot Adaptation of Vision-Language Models cs.CV | cs.LGPDF

[21] Scaling Reinforcement Learning for Diffusion Models via Velocity Matching cs.CV | cs.LGPDF

[22] DriftAD: Visually-Guided Text Drift for Few-Shot Industrial Anomaly Detection cs.CVPDF

[23] More Motion Is Not Always Better Motion: Corpus Composition Governs Whether Augmentation Helps SMPL-Based Parkinsonian Gait Severity Estimation cs.CVPDF

[24] Too much of a good thing – when knowledge distillation promotes overfitting, and how to avoid it cs.CV | cs.AIPDF

[25] Primate vision reveals a missing principle for robust dynamic AI cs.CV | q-bio.NCPDF

[26] LUCAID: Agentic Multimodal AI for Lung Cancer Precision Pathology cs.CV | cs.AI | cs.LGPDF

[27] Infant Care Video Dataset for Classification of Interventions Using Transformers cs.CV | cs.AI | cs.LGPDF

[28] Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges cs.CVPDF

[29] DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models cs.CVPDF

[30] LUX: A Lesion-Aware Graph-Conditioned Visual - Language Architecture for Explainable Endoscopic Captioning cs.CVPDF

[31] Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition cs.CVPDF

[32] AffineTok: Semantic Affine Consistency for Diffusion-Friendly Visual Tokenizer cs.CVPDF

[33] LG-GER: Language-Guided Group Emotion Recognition via Multimodal Evidence Distillation cs.CVPDF

[34] GlanceWAM: Sparse Test-Time Imagination for World-Action Models cs.CVPDF

[35] Continual Visual Learning under Evolving Semantic Concept Shift cs.CV | cs.CLPDF

[36] HAP: Head-Adaptive Visual Token Pruning via Cross-Modal Alignment cs.CVPDF

[37] RefineRank: Joint Box Refinement and Ranking for Surgical Spatio-Temporal Grounding cs.CV | cs.AIPDF

[38] Luce: Relightable Gaussians for 3D Asset Generation cs.CV | cs.AI | cs.GRPDF

[39] Boot-and-Feedback Framework for Generalist-Expert Model Collaboration in Breast Ultrasound Diagnosis cs.CV | cs.MMPDF

[40] IterCAD: Iterative Program Repair for CAD Code Generation from Orthographic Views cs.CV | cs.AIPDF

[41] Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation cs.CVPDF

[42] ConsensusTAS: Self-Supervised Temporal Action Segmentation for Long-Horizon Construction Videos cs.CVPDF

[43] WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report cs.CV | cs.CL | cs.IRPDF

[44] Joint-Embedding Prediction of Masked Point Tubes for Self-Supervised Learning on 4D Point Cloud Videos cs.CV | cs.LGPDF

[45] VisCache: Visual KV Cache Pruning for Efficient Vision Large Language Model Inference cs.CV | cs.AIPDF

[46] DRRG: A Discrete Diffusion Framework for Radiology Report Generation cs.CVPDF

[47] Graph-Supervised Hierarchical Clinical Alignment for Radiology Report Generation with Large Language Models cs.CVPDF

[48] PlaceSeek: Human-Centered Geospatial Retrieval of Urban Outdoor Places via Semantic Grounding and Affective Alignment cs.CV | cs.AI | cs.IRPDF

[49] EgoErrorVQA: Assess Egocentric Comprehension Capabilities through Procedural Errors for Ego-Agentic AI cs.CVPDF

[50] Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation cs.CVPDF

[51] What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models cs.CVPDF

[52] ViSculpt: Visual-Centric Agentic Geometry Editing cs.CV | cs.GR | cs.HCPDF

[53] SandwichQuant: Which Parameters Matter Before and After Quantization? cs.CVPDF

[54] Beauty is in the ELBO of the Beholder: A Variational Account of Processing Fluency in Face Perception cs.CV | q-bio.NCPDF

[55] NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation cs.CVPDF

[56] Example-based Robust Abnormality Detection with Minimal Annotations using Exemplar Med-DETR cs.CVPDF

[57] Keep-or-Drop? Adaptive Tokenizer for Compact Video Representation cs.CVPDF

[58] Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning cs.CV | cs.AI | cs.HC | cs.LGPDF

[59] Variance-Guided Spatial Attention Fusion for Robust End-to-End Driving under Asymmetric Sensor Degradation cs.CV | cs.ROPDF

[60] Vision Language Model Fusion for Explainable Face Recognition cs.CVPDF

[61] Bridging Adversarial and Collaborative Learning for AI-Generated Image Quality Assessment cs.CVPDF

[62] Markerless Pose Estimation for Resistance Training Technique Assessment cs.CV | cs.AIPDF

[63] DoublesEval: Diagnosing Multi-Agent Tactical Reasoning in Vision-Language Models via Professional Doubles Badminton cs.CVPDF

[64] VizAnchor: Decoding Manipulation Intent from Tampering Visualizations via Dual-Anchor Reasoning cs.CV | cs.HCPDF

[65] Low-Rank Ternary Adaptation for Fine-Tuning Transformers cs.CV | cs.LGPDF

[66] Human-Inspired Social Engagement Analysis via Interpretable Mutual Visual Attention cs.CVPDF

[67] X-MULTI: VLM-based Imaging Factor Disentanglement for Factor-Aware Image Synthesis cs.CV | cs.ROPDF

[68] On-Policy Self-Distillation in Diffusion Models cs.CVPDF

[69] ReGround-Surg: Reliability-Guided Anchor Grounding for Referring Surgical Video Segmentation cs.CVPDF

[70] TurboT2VA: Fast Large-Scale Text-to-Video-Audio Generation via Score-Regularized Consistency Distillation cs.CVPDF

[71] Interpretable Fundus Image Classification via Ring-Based Retinal Vasculature Features cs.CV | stat.MLPDF

[72] Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training cs.CVPDF

[73] MoTE: Mixture of Task Experts for Multi-Task Video Understanding cs.CV | cs.LGPDF

[74] TorchMorph: CUDA-accelerated Morphological Transforms cs.CVPDF

[75] LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training cs.CV | cs.AI | cs.LGPDF

[76] MoE-based Feature Adapter for Prompt-free Binary Coronary Artery Segmentation in X-ray Angiography cs.CVPDF

[77] From Seeing to Acting: Smart Glasses as First-Person Intelligence Platforms cs.CVPDF