cs.CL [Total: 49]
cs.CV [Total: 118]
eess.IV [Total: 1]
cs.GR [Total: 3]
eess.SP [Total: 1]
cs.HC [Total: 2]
eess.AS [Total: 1]
cs.MA [Total: 2]
cs.RO [Total: 6]
cs.AI [Total: 8]
cs.SE [Total: 1]
cs.LG [Total: 10]

Abstract: Can financial vision-language models (VLMs) turn chart evidence into reliable action recommendations? Existing hallucination evaluations are mostly claim-centric; they assess whether generated statements are supported, but not whether evidence remains traceable through rationale, confidence, and final action. We introduce E2A-Bench, a 969-query benchmark for financial chart reasoning, constructed from 323 HS300 constituents under three input modalities with deterministic OHLCV-derived evidence anchors. E2A-Bench evaluates grounding, reasoning-action consistency, evidence-confidence calibration, and directional coverage through UCR, RCI, ECI, and NDR, where NDR measures coverage-aware evidence-to-action reliability rather than realized trading performance. Evaluating 20 VLMs reveals three failures hidden by scalar hallucination scores: the lowest-UCR model ranks near the bottom by NDR due to only 6.4% directional coverage; oracle-aided verification reduces unsupported claims but can collapse coverage; and financial fine-tuning amplifies the BUY:SELL ratio by factors of 4.21 to 4.68 across strict base-fine-tuned pairs. These results show that financial VLM evaluation should trace the full evidence-to-action chain rather than rely on a single hallucination score. Code and data: https://github.com/wanng-ide/E2A-Bench

Eduin E. Hernandez, Luis F. Garcia, Nurassyl Askar, Sergio A. Diaz, Stefano Rini

TL;DR: 该论文将多跳知识图谱问答（KGQA）重新定义为问题条件化的图导航问题，提出THESEUS框架以实现可追溯的推理路径。作者通过构建带标注路径的数据集、设计评估协议以及改进现有路径推理代理，推动KGQA系统向可解释性方向发展。

Details

Motivation: 现有KGQA系统通常只预测最终答案，缺乏对中间推理步骤的显式建模和验证，无法确保答案来自可靠的多跳推理。

Result: 论文在KINSHIP和MQuAKE数据集上构建了导航就绪的KGQA资源，并设计了评估路径保真度、语言变化鲁棒性以及多跳/多答案问题性能的协议。

Insight: 创新点在于将KGQA重构为可追溯的图导航任务，并通过使用完整问题嵌入（而非符号化单关系查询）来引导基于路径的KG完成代理，增强了自然语言语义对推理轨迹的指导能力。

Abstract: Multi-Hop Knowledge Graph Question Answering (KGQA) tasks require models to assemble relational evidence along paths in a KG to answer natural-language questions. However, existing KGQA systems typically focus on predicting the final answer without explicitly modeling or validating the intermediate reasoning steps, obscuring whether the correct answers arise from faithful multi-hop reasoning. To address this limitation, we re-frame multi-hop KGQA as a question-conditioned graph navigation problem. We refer to this formulation as THESEUS - Traceable Hop-wise Evidence SEarch in a Unified Semantics. In this setting, an agent receives a KG, a question, and a topic entity, and traverses a sequence of relations towards the answer, making the reasoning path explicit. To systematically study this formulation, we provide three key contributions. (i) We augment the existing KINSHIP and MQuAKE resources into navigation-ready KGQA datasets with annotated evidence paths and paraphrased questions. (ii) We design evaluation protocols to measure path fidelity, robustness to linguistic variation, and performance across multi-hop and multi-answer questions. (iii) We adapt established path-based KG completion agents - MINERVA, MultiHopKG, and SQUIRE - to operate on full question embeddings rather than symbolic single-relation queries, enabling their trajectories to be guided by natural-language semantics. Together, these contributions advance KGQA research toward systems where traceability is fundamental: answers are accompanied by explicit reasoning paths whose agreement with reference evidence can be systematically evaluated.

[22] CompCQR: Compositional Query Generation for Training-Free Conversational Search cs.CL | cs.AIPDF

Yunah Jang, Kang-il Lee, Joongbo Shin, Kyomin Jung

TL;DR: 本文提出了一种名为CompCQR的新型免训练对话查询生成方法，用于解决信息检索场景中多轮对话查询的歧义性问题。该方法通过组合少量原子成分来生成大量查询，并利用LLM推理构建高质量的文档集，从而在减少LLM调用次数的同时，显著提升了检索性能。

Details

Motivation: 在信息检索的多轮对话中，用户查询通常具有歧义性和上下文依赖性，不适合直接用作检索查询。现有的基于LLM的对话查询改写方法虽然性能强大，但存在重复调用LLM以及与下游检索器不对齐的问题。

Result: 该方法在四个广泛使用的对话基准测试中取得了强劲性能，相对于之前的最先进基线，相对MRR提升了高达22.5%，同时LLM调用次数大幅减少。

Insight: 创新点在于观察到检索器对内容顺序高度敏感，并据此提出了一种组合式查询生成策略，通过最小化LLM使用来生成大量查询，同时利用LLM推理构建平衡精确率和召回率的文档集，实现了跨开源/闭源LLM以及稠密/稀疏检索器的泛化。

Abstract: Multi-turn interactions with LLMs are becoming increasingly common in information-seeking scenarios. However, user queries are often ambiguous and context-dependent, making them ill-suited for direct use as retriever queries. Conversational query reformulation (CQR) addresses this issue by rewriting the current utterance into a stand-alone query grounded in the dialogue history. Recent LLM-based CQR approaches achieve strong performance; however, their repeated LLM invocations and misalignment with downstream retrievers remain challenges. In this work, we begin from the observation that retrievers are highly sensitive to content ordering: simply reordering the same content can lead to changes in retrieval coverage and performance. Based on this, we propose a novel training-free method that generates a very large number of queries with minimal LLM usage by compositionally combining a small set of atomic components. We further apply LLM reasoning to construct a high-quality document set that balances precision and recall while capturing the user’s core intent. Our framework generalizes across both open- and closed-source LLMs as well as dense and sparse retrievers. It achieves strong performance on four widely used conversational benchmarks, with up to 22.5% relative MRR improvement over the previous state-of-the-art baseline with far fewer LLM calls.

[23] TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendation cs.CLPDF

Yuchen Guan, Jiaye Liu, Yifei Han, Zhenxi Zhang, Yixuan Weng

TL;DR: 本文提出了TATK框架，用于解决基于LLM的序列推荐系统中，文本生成接口与全目录Top-K排序任务不匹配的问题。TATK结合了Top-K学习和知识驱动的验证，通过上下文感知的元数据知识图谱提示和位置感知的Top-K奖励来优化训练，并在单次LLM前向传播后对候选集进行结构感知的重排序。

Details

Motivation: 动机在于，当前基于大语言模型的序列推荐器通常将下一项预测视为文本生成任务，但这种接口与需要从全目录中进行Top-K排序的实际推荐需求严重不匹配。

Result: 在Amazon Reviews 2023的三个数据集上，使用Gemma-2-2B-It和Qwen2.5-3B-Instruct作为骨干模型进行评估。TATK在所有36个报告指标上均优于基准方法，在NDCG@10指标上，Qwen模型提升了8.05%、4.26%和3.78%，Gemma模型提升了27.03%、10.52%和10.23%，同时推理延迟仅为基础方法的1.17倍。

Insight: 创新点在于提出了一个三元感知框架，将Top-K学习与知识驱动的验证耦合，通过结构感知的重排序来提升推荐质量。客观分析表明，其核心洞察是：当候选项目具有可靠的知识图谱支持时，结构证据最为有效；而当元数据关系稀疏或嘈杂时，应进行门控处理。

Abstract: LLM-based sequential recommenders usually cast next-item prediction as text generation, but this interface is poorly matched to full-catalog top-K ranking. We propose TATK, a Triple-Aware framework that couples Top-K Learning (TKL) with Knowledge-Grounded Verification (KGV) for LLM-based sequential recommendation. Top-K Learning combines context-aware metadata-KG prompt grounding with position-aware top-K rewards, aligning training with ranking utility; Knowledge-Grounded Verification then applies structure-aware reranking over the top-M candidates after a single LLM forward pass, using the same metadata-derived item graph. We evaluate TATK on Musical Instruments, CDs and Vinyl, and Video Games from Amazon Reviews 2023 under a matched R2ec-style full-catalog protocol. Experiments use Gemma-2-2B-It and Qwen2.5-3B-Instruct backbones, compare against sequential, generative, KG-augmented, and reasoning-enhanced baselines, and include component, reward-shape, sequence-perturbation, reranking, relation-quality, and candidate-pool diagnostics. TATK improves over the matched R2ec reproduction on all 36 reported metrics. On NDCG@10, it improves Qwen by 8.05%, 4.26%, and 3.78% on the three datasets, and improves Gemma by 27.03%, 10.52%, and 10.23%, while keeping inference within 1.17x of Base RecPO latency. The diagnostics show that structural evidence is most useful for recoverable top-M candidates with reliable KG support, and should be gated when metadata relations are sparse or noisy.

[24] Optimizing Sparse Outcomes Through Dense Behavioral Signals via Value-Guided Preference Distillation cs.CLPDF

Ziyi Zhu, Daniel R. Cahn, Thomas D. Hull, Caitlin A. Stamatis, Olivier Tieleman

TL;DR: 本文提出了一种通过价值引导偏好蒸馏来优化稀疏长期对话结果的方法。该方法将多轮对话对齐问题构建为多目标强化学习任务，训练一个多头价值模型来预测用户在不同前瞻视野下的行为向量。通过结合密集的辅助行为信号进行信用分配，有效优化了稀疏的长期结果，并通过反事实用户模拟和对话级结果模型构建了安全评估框架。最终，通过参考锚定偏好优化将多目标价值偏好蒸馏到策略中，显著提升了用户留存率和积极行为指标。

Details

Motivation: 传统的多轮对话智能体对齐通常关注于匹配单轮的人类偏好，但直接优化长期稀疏结果往往效果不佳且容易导致奖励黑客问题。因此，需要一种能够有效进行信用分配并优化长期稀疏结果的方法，同时避免因优化单一代理目标而导致的策略退化风险。

Result: 在线A/B测试证实，经过蒸馏的策略显著改善了长期用户留存率，同时增强了积极行为和治疗过程标记。该方法在计算预算仅为在线强化学习一小部分的情况下，达到了与之相当的性能水平。

Insight: 创新点在于将长期对话优化构建为多目标强化学习问题，并利用密集的辅助行为信号进行有效的信用分配。此外，通过结合反事实用户模拟和已验证的对话级结果模型，建立了一个安全评估框架，用于在部署前识别潜在的策略退化风险。最后，提出的参考锚定偏好优化方法能够高效地将多目标价值偏好蒸馏到策略中，实现计算效率与性能的平衡。

Abstract: Aligning multi-turn dialogue agents is usually framed as matching turn-level human preferences, yet direct optimization of long-term outcomes is often ineffective and prone to reward hacking. We formulate long-horizon dialogue optimization as a multi-objective reinforcement learning problem and train a multi-head value model that predicts a vector of observed user behaviors across multiple look-ahead horizons. Our findings demonstrate that a scalarized composite of dense auxiliary behavioral signals enables effective credit assignment and optimization of sparse outcomes. However, optimizing unconstrained single-objective proxies might induce policy degradations that are harmful when the agent is exposed to real users. To identify these failure modes prior to deployment, we establish a safety framework combining counterfactual user simulation with a validated dialogue-level outcome model to evaluate preference weightings and policy optimization methods. Finally, we demonstrate that distilling multi-objective value preferences into the policy via reference-anchored preference optimization matches on-policy online RL at a small fraction of its compute budget. Live A/B testing confirms that our distilled policy significantly improves long-term user retention, while simultaneously enhancing the positive behaviors and therapeutic-process markers.

[25] Building Legal Reward Models for Grounding and Abstention cs.CL | cs.AIPDF

Rilton Franzone, Valentin Noël, Puyu Wang, Philip Torr, Fabio J. Fehr

TL;DR: 本文提出了一种构建法律奖励模型的方法，用于评估检索增强生成（RAG）系统中基于证据的推理和证据不足时的弃权能力。作者通过将现有法律问答数据集转化为上下文偏好数据，构建了LegalRewardBench（LRB）基准，并发现上下文DPO和长度平衡增强能显著提升模型在嘈杂和证据不足检索条件下的法律生成评估性能，且模型展现出跨司法管辖区的迁移能力。

Details

Motivation: 现有奖励模型主要针对通用偏好优化，而非上下文证据的准确性，这限制了其在需要基于检索证据进行推理和弃权的法律等高风险领域RAG设置中的评估能力。

Result: 在LRB基准上的实验表明，结合长度平衡的法律和通用上下文偏好数据的最强配置，比基线性能提升高达+25.6个百分点。模型在维多利亚刑法数据上精炼后，在美国法律基准（如Housing Statute QA）上的评估性能也提升了+16.2个百分点，显示出跨司法管辖区迁移的有效性。

Insight: 创新点在于提出了一个将法律QA数据集转化为上下文偏好数据的可复现框架，并构建了专门的LRB基准。客观分析认为，其核心洞察是强调了在RAG中构建领域特定（如法律）奖励模型时，偏好数据的构造（如长度平衡）对提升模型基于证据的推理和弃权评估至关重要，且领域精炼模型具有可迁移性。

Abstract: Large language models are increasingly used in high-stakes domains such as law, where systems must ground their reasoning in retrieved evidence and abstain when that evidence is insufficient. However, existing reward models are largely optimised for general preferences rather than contextual grounding, limiting their ability to evaluate these behaviours in retrieval-augmented generation (RAG) settings. We introduce a framework for transforming existing legal QA datasets into contextual preference data and use it to construct LegalRewardBench (LRB), a benchmark for evaluating grounded legal generation under noisy and insufficient retrieval conditions. Across general and legal contextual evaluation, we find that contextual DPO improves grounded evaluation, but performance is sensitive to preference-data construction. Length-balanced augmentation substantially improves grounded legal evaluation, with the strongest configuration combining length-balanced legal and general contextual preference data and improving performance by up to $\mathbf{+25.6}$pp over baseline. We further find evidence of cross-jurisdiction transfer: models contextually refined primarily on Victorian criminal-law data improve grounded evaluation on external US legal benchmarks, including a $\mathbf{+16.2}$pp improvement on \textsc{Housing Statute QA}. Together, these results provide a reproducible foundation for constructing and evaluating grounded legal reward models in retrieval-augmented settings.

[26] Func-R1: Incentivizing Mathematical Function Reasoning in Multimodal Large Language Models cs.CLPDF

Mingze Yin, Xiaohan Wang, Dian Li, Haichao Yao, Yilin Zhao

TL;DR: 本文提出Func-R1方法，旨在解决多模态大语言模型在视觉数学函数推理中存在的模态干扰问题。该方法通过解耦架构和分层后训练框架，结合感知对齐理论优化策略，提升模型对视觉线索的感知与逻辑推理能力。在多个基准测试中，Func-R1在开源MLLMs中达到最优性能，并在MathVerse函数任务上超越GPT-5。

Details

Motivation: 针对多模态大语言模型在数学函数推理中忽视或误解关键视觉线索的模态干扰现象，研究旨在增强模型在视觉上下文中的精确感知与符号逻辑融合能力。

Result: 在多样化基准测试中，Func-R1在开源MLLMs中取得最优性能，在MathVerse函数导向任务上比GPT-5提升8.4%，达到SOTA水平。

Insight: 创新点包括显式解耦架构与分层后训练框架，以及感知对齐理论优化策略，可借鉴于提升多模态任务中视觉与文本模态的协同推理鲁棒性。

Abstract: Performing deliberate mathematical reasoning in visual contexts is a hallmark of advanced Multimodal Large Language Models (MLLMs) and requires a sophisticated synthesis of perceptual grounding and symbolic logic. However, in the realm of mathematical functions, our investigation reveals a critical modality interference phenomenon: even advanced models, while performing textual computational reasoning, tend to disregard or misinterpret essential visual cues. To address this challenge, we propose Func-R1, which synergistically harmonizes precise visual perception and rigorous logical reasoning. Concretely, built upon an explicitly decoupled architecture, we employ a hierarchical post-training framework to progressively identify critical visual evidence and conduct in-depth theoretical reasoning. Furthermore, the Perception-Aligned Theoretic Optimization (PATO) strategy is proposed to steer policy updating towards internalizing fundamental theoretical properties while dynamically rectifying heterogeneous visual information throughout the reasoning process. Extensive experiments across diverse benchmarks demonstrate that Func-R1 delivers the optimal performance among open-source MLLMs, even surpassing GPT-5 with an 8.4% improvement on MathVerse’s function-oriented tasks.

[27] MedTRACE: Tool-Augmented Multimodal Clinical Reasoning Agents for Evidence-Grounded Decision-Making cs.CLPDF

Ji Lu, Lifei Liu, Haoran Yu, Xianglong Wang, Yiru Fang

TL;DR: 本文提出了MedTRACE，一种工具增强的多模态临床推理智能体，用于基于证据的决策。它通过特定模态编码器构建统一的患者状态表示，并执行假设形成、工具感知审议和证据验证的迭代循环，动态调用视觉定位、证据检索和结构化解析工具来获取诊断相关证据。最终输出诊断结果、支持证据、可审计的推理轨迹和校准后的置信度。

Details

Motivation: 现有的多模态临床决策模型通常直接将异构输入映射到诊断，而没有明确评估证据充分性、工具使用需求或诊断不确定性。本文旨在解决这一问题，开发一个能够主动获取和验证证据的推理系统，以提高临床决策的准确性、可解释性和可靠性。

Result: 在多个多模态临床诊断基准测试中，MedTRACE将诊断准确率提高了5.4%，AUROC提高了4.7个百分点。同时，证据选择F1分数提高了8.2个百分点，视觉定位IoU提高了6.5个百分点，预期校准误差降低了31.6%，无支持诊断错误减少了27.8%，超越了现有最强基线。

Insight: 论文的核心创新在于提出了一个主动证据获取与验证的迭代推理框架，将工具调用（如检索、解析）与假设形成、证据一致性验证紧密结合。这为构建可解释、可靠的多模态AI决策系统提供了一种通用范式，其证据记忆和置信度校准机制也值得借鉴。

Abstract: Multimodal clinical decision-making requires reliable reasoning over heterogeneous evidence from electronic health records, medical images, and physiological signals. Existing models typically map these inputs directly to diagnoses without explicitly assessing evidence sufficiency, tool-use requirements, or diagnostic uncertainty. This paper presents MedTRACE, a tool-augmented multimodal clinical reasoning agent for evidence-grounded decision-making. MedTRACE uses modality-specific encoders to construct a unified patient-state representation and performs an iterative loop of hypothesis formation, toolaware deliberation, and evidence verification. It dynamically invokes visual grounding, evidence retrieval, and structured parsing tools to locate diagnosis-relevant regions, retrieve clinical knowledge and similar cases, and extract structured findings. The acquired evidence enters an evidence memory, where a consistency verifier confirms or revises the current hypothesis. MedTRACE outputs a diagnosis together with supporting evidence, an auditable reasoning trace, and calibrated confidence. Experiments on multiple multimodal clinical diagnosis benchmarks show that MedTRACE improves diagnostic accuracy by 5.4% and AUROC by 4.7 percentage points over the strongest baseline. It also improves evidenceselection F1 by 8.2 percentage points and visual-grounding IoU by 6.5 percentage points, reduces expected calibration error by 31.6%, and decreases unsupported diagnostic errors by 27.8%. These results demonstrate that active evidence acquisition and verification improve the accuracy, interpretability, and reliability of multimodal clinical decisionmaking.

[28] Enemray: Toward Capable Language Models for Hassaniya cs.CL | cs.AIPDF

Cheikh Ahmed

TL;DR: 本文介绍了Enemray，一个专注于哈桑尼亚语（Hassaniya）的语言模型，旨在实现哈桑尼亚语的通用交互。该模型围绕稳定性-可塑性目标进行训练：在保持原有指令调优模型的通用推理、多语言、指令遵循和安全行为的同时，获得强大的哈桑尼亚语言和文化能力。开发流程将语言获取与行为专门化分离，通过分层选择性持续预训练、参数更新转移和监督后训练来实现。

Details

Motivation: 解决哈桑尼亚语缺乏强大语言模型的问题，目标是开发一个既能处理哈桑尼亚语通用交互，又保留基础模型通用能力的模型。

Result: 在评估中，Enemray在英语到哈桑尼亚语翻译上优于对比的开源和专有模型，在毛里塔尼亚翻译错误检测上获得最高分，同时在数学推理、知识、代码生成和函数调用等通用能力上基本保持了基础模型的性能。

Insight: 创新点包括稳定性-可塑性训练目标、分离语言获取与行为专门化的开发流程，以及整合新收集、重建和构建指令数据的大规模监督语料库，为低资源语言模型开发提供了可借鉴的方法。

Abstract: We introduce Enemray, a Hassaniya-centric language model that enables general-purpose interaction in Hassaniya. Enemray is trained around a stability–plasticity objective: acquire strong Hassaniya linguistic and cultural competence while preserving the general reasoning, multilingual, instruction-following, and safety behaviors of a capable instruction-tuned model. The development pipeline separates language acquisition from behavioral specialization. A separately assembled continual-pretraining corpus provides broad exposure to natural Hassaniya and Mauritanian text; layer-selective continual pretraining learns a compact language-specific parameter update; that update is transferred into the instruction-tuned parameter space; and supervised post-training develops conversational, cultural, literary, task-oriented, and cross-lingual behavior. The supervised corpus integrates selected public Hassaniya and Mauritanian resources with a substantially larger body of newly collected, reconstructed, curated, and constructed instruction data, while policy-generated replay provides a retention signal from the reference model’s own behavior distribution. The resulting collection is substantially larger and broader in purpose than existing Hassaniya text resources. In evaluation, Enemray achieves the strongest English to Hassaniya translation among the compared open and proprietary models and the highest overall score on Mauritanian translation error detection, while retaining most of the general capabilities of its instruction-tuned base model on mathematical reasoning, knowledge, code generation, and function calling. This report describes the motivation, data construction, model design, training methodology, and evaluation of Enemray.

[29] ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement cs.CLPDF

Siwei Wu, Jincheng Ren, Yizhi Li, Haau-Sing Li, Chengran Yang

TL;DR: 本文提出了ModularRSI，一个用于实现通用化递归自我改进（RSI）的模块化框架。该框架通过对比同一任务的成功与失败轨迹，跨任务聚合证据以识别重复的行为缺陷，并将可改进的代理系统分解为五个功能模块进行独立演化。实验表明，该方法在未见过的领域内和跨领域任务上均能带来持续改进，且改进后的系统能迁移到不同的基础模型上。

Details

Motivation: 现有基于评估基准或其子集的递归自我改进方法难以区分可复用的改进与基准特定的适应，且单轨迹更新容易混淆系统缺陷与实例特定的推理细节，导致改进难以泛化。同时，整体式系统的优化难以定位重复行为缺陷，并可能使无关机制纠缠在一起。

Result: 在TB2.0和SWE-Bench Verified基准上的实验显示，该方法在未见过的领域内和跨领域任务上均取得了持续的性能提升，达到了先进的水平（SOTA），并且演化后的系统能够成功迁移到不同的基础模型。

Insight: 创新点在于提出了一个基准无关、对比式且模块化的通用化系统演化框架。通过任务对比和跨任务证据聚合来识别系统缺陷，并将系统分解为独立演化的功能模块（如代理循环、工具使用等），最后进行集成，这有助于实现更清晰、可归因且可泛化的改进。

Abstract: Recent work extends recursive self-improvement (RSI) to agent harnesses for long-horizon coding and terminal tasks, enabling agents to improve execution mechanisms from experience. However, generalizable harness RSI remains challenging. First, evolving harnesses on evaluation benchmarks or their subsets makes it difficult to distinguish reusable improvements from benchmark-specific adaptation. Second, single-trajectory updates can conflate systematic harness deficiencies with instance-specific reasoning and solution details, producing modifications that transfer poorly to unseen tasks. Third, localizing recurring behavioral deficiencies within monolithic harnesses is difficult, while whole-harness optimization can entangle unrelated mechanisms and complicate attribution and validation. We propose ModularRSI, a benchmark-disjoint, contrastive, and modular framework for generalizable harness evolution. ModularRSI contrasts successful and failed trajectories for the same task and aggregates evidence across tasks to identify recurring behavioral deficiencies. It decomposes the evolvable harness into five functional modules: Agent Loop, Tool Use, Observation Management, Context Management, and Task Completion Detection. Each module evolves independently within a restricted modification scope, followed by an integration stage that combines the evolved modules into a unified harness and resolves potential conflicts. To support benchmark-disjoint evolution, we curate 2,000 executable evolution tasks from external sources that are disjoint from downstream evaluation benchmarks. Experiments on TB2.0 and SWE-Bench Verified show consistent improvements on unseen in-domain and cross-domain tasks, with the evolved harness also transferring across different foundation models.

[30] One Example Is Enough to Pass Fairness Benchmarks: Rethinking Fairness Evaluation for Aligned LLMs cs.CL | cs.AIPDF

Naihao Deng, Samee Arif, Shuaichen Chang, Yulong Chen, Rada Mihalcea

TL;DR: 本文指出当前主流的公平性基准测试（如BBQ）过于简单，仅需一个示例即可显著提升模型性能，无法有效评估大语言模型的公平性对齐。通过实验证明，在Qwen 2.5 7B Base模型上使用单个BBQ示例进行GRPO微调或上下文学习，即可将平均准确率从79.9%分别提升至92.9%和99.0%，接近甚至超越大规模RLHF模型的表现。

Details

Motivation: 针对现有公平性基准测试（如BBQ）可能因设计缺陷而无法真实反映大语言模型的公平性对齐水平，论文旨在揭示这些基准的局限性，并呼吁构建更全面的评估体系。

Result: 在BBQ基准上，使用单个示例进行GRPO微调或ICL，可使Qwen 2.5 7B Base模型的平均准确率大幅提升至92.9%和99.0%，分别缩小了与大规模RLHF模型（96.1%）80%的差距并实现超越；该现象在不同模型家族中具有普适性。

Insight: 论文创新性地揭示了BBQ类基准仅测量单一结构性线索（如模型生成的推理轨迹中‘缺失证据’模式），而非真正的公平性能力；主张公平性评估需覆盖更广泛的维度，避免以偏概全。

Abstract: Warning: This submission studies stereotypes and biases, and contains toxic and offensive examples, used for illustration purposes only. Fairness benchmarks such as BBQ have become the de facto standard for fairness evaluation across major model families. We argue that these benchmarks are too easy to support their role: training Qwen 2.5 7B Base with Group Relative Policy Optimization (GRPO) on a single BBQ example, or placing that example in context as a one-shot demonstration for in-context learning (ICL), lifts mean BBQ accuracy from 79.9% to 92.9% and 99.0%, respectively, closing 80% of the gap to its large-scale RLHF counterpart (96.1%) with GRPO, and surpassing it with ICL. These effects generalize across model families. A cross-conditioning analysis shows the improvement is carried by the reasoning traces generated by the model, and one example suffices to elicit a category-agnostic ``missing evidence’’ reasoning pattern. We argue that BBQ-style multiple-choice abstention benchmarks measure a single structural cue, and a model that solves them does not thereby become fair. We call for evaluation suites that cover a broader spectrum of fairness alignment.

[31] Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning cs.CL | cs.AI | cs.LG | cs.MAPDF

Jiayi Yuan, Hangoo Kang, James Jihao Liu, Yejin Choi, Vikram Iyer

TL;DR: 本文提出了一种名为MoDA（Mode-conditioned Diversity Alignment）的在线后训练强化学习算法，旨在解决大语言模型对齐训练中常见的模式崩溃问题，即输出多样性丧失。该算法通过将单个共享LLM策略与抽象编号角色（模式）条件化，激励不同角色探索高质量输出空间中的互补区域，从而联合优化生成质量和多样性。

Details

Motivation: 动机在于解决LLM对齐训练导致的模式崩溃问题，该问题会损害模型在推理时的表达能力，尤其限制了需要开放式探索和多元视角的应用，如科学构思和创意写作。

Result: 在涵盖七个通用能力任务和四个特定领域多样性任务（科学构思和创意写作）的基准测试中，MoDA在Infinite-Chat保留提示上将SBERT多样性提高了265%，同时将平均通用能力pass@1比Qwen3-8B基线提高了10.3%。与最强的DivPO基线相比，MoDA将SBERT多样性从0.274提升至0.482（+75.9%），E-Vendi从2.86提升至4.4（+53.8%），同时平均通用能力pass@1提高了7.0%。

Insight: 创新点在于从多智能体强化学习（MARL）的协调视角出发，提出了模式条件化的角色竞争机制，无需手工设计角色或修改架构即可促进多样性探索；同时引入了提示自适应的质量门控机制，仅对达到质量阈值的响应给予多样性奖励，有效防止了损害响应质量的奖励黑客行为。

Abstract: A notable byproduct of LLM alignment training is mode collapse: the progressive loss of output diversity that narrows a model’s expressivity at inference time. This degradation is especially limiting for applications requiring open-ended exploration and pluralistic perspectives, such as scientific ideation and creative writing. We present MoDA (Mode-conditioned Diversity Alignment), an online post-training RL algorithm that jointly optimizes generation quality and diversity, inspired by the coordination perspective in multi-agent reinforcement learning (MARL). MoDA trains a single shared LLM policy conditioned on abstract numbered roles, where each role acts as an agent competing to produce outputs distinct from the others. This formulation encourages mode-conditioned agents to explore complementary regions of the high-quality output space without requiring hand-crafted personas or architectural modifications. MoDA employs a prompt-adaptive quality gating mechanism that calibrates a reference quality threshold and grants diversity rewards only to responses that meet the threshold, preventing reward-hacking behaviors that compromise response quality. To study quality-diversity tradeoffs, we evaluate MoDA on a comprehensive suite of benchmarks spanning seven general capability tasks and four domain-specific diversity tasks in scientific ideation and creative writing. MoDA improves SBERT diversity by 265% on the Infinite-Chat held-out prompts, while increasing average general capability pass@1 by 10.3% over the Qwen3-8B baseline. Compared with the strongest DivPO baseline, MoDA improves SBERT diversity from 0.274 to 0.482 (+75.9%) and E-Vendi from 2.86 to 4.4 (+53.8%), while improving average general capability pass@1 by 7.0%. Overall, MoDA provides a drop-in alternative to standard post-training methods that preserves and expands the model’s expressive output space while improving quality.

[32] Beyond Depth and Width: The Information-Slack Dilemma in Streaming Test-Time Compute cs.CLPDF

Xiaotian Zhang

TL;DR: 本文探讨了在流式测试时计算中，当证据以不同顺序到达时，相同任务和计算预算需要不同推理策略的问题，即信息-松弛困境。论文提出将证据依赖的计算任务作为分析单元，研究何时启动、如何支持其结果以及何时提交结果，并倡导一个在演化证据下进行计算的研究议程，优先考虑在受控证据修订下的选择性恢复。

Details

Motivation: 解决在流式处理中，早期计算基于不完整或可修订证据与等待更多信息但减少计算松弛之间的权衡问题，即信息-松弛困境，旨在优化计算策略以实现更可靠、及时的响应。

Result: 论文未提及具体定量实验结果或基准测试，而是提出了一个研究议程和评估框架，强调分离早期执行效应、部署价值与预测策略的附加价值，并考虑共享资源成本。

Insight: 创新点在于将证据依赖的计算任务作为分析单元，系统化研究信息-松弛困境，并倡导优先选择性恢复的研究议程，目标是在声明资源范围内实现更可信、准时的响应，而非最大化提前计算。

Abstract: The same task and compute budget can require different reasoning policies when evidence arrives in a different order. Early computation has more time to finish but rests on incomplete or revisable evidence; waiting improves information while shrinking computational slack. We call this the information-slack dilemma. We take the evidence-dependent computational job as the unit of analysis: when to start it, what supports its result, and when that result can be committed. Advance computation is valuable only insofar as its benefits survive the costs of verification, invalidation, and recovery. This applies to grounded incremental processing and reusable preparation as well as future-dependent speculation. We propose a research agenda on computation under evolving evidence, prioritizing selective recovery under controlled evidence revisions. Evaluation should separate earlier-execution effects, deployment value against a full-input alternative, and the added value of predictive policies, while accounting for shared-resource costs. The objective is not maximal advance computation, but more trustworthy, on-time responses within a declared resource envelope.

[33] SALUTE: Benchmarking and Adapting LLMs for the Defense Domain cs.CLPDF

Hyeongcheol Park, Sumin In, Suyeon Myeong, Hogun Park, Sangmin Kim

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Defense is a knowledge-intensive domain that requires precise understanding of specialized terminology, doctrinal concepts, operational procedures, and evolving military events. Although recent work has explored language technologies for military applications, existing efforts remain fragmented: they are often task-specific, rely on limited adaptation pipelines, or lack comprehensive defense-domain evaluation. In this paper, we present SALUTE, an end-to-end framework for benchmarking and adapting LLMs for the defense domain. SALUTE integrates Salute-Corpus, a curated corpus from open-access U.S. military doctrine and government documents; Salute-Conv, a grounded instruction dataset from doctrinal sources and decade-long defense news; Salute-Pref, a defense-aware preference dataset; and Salute-Bench, a rigorously filtered benchmark for evaluating defense-domain understanding and reasoning over doctrine and defense news. Based on these resources, we train Salute-LLM through multi-stage post-training with continual pretraining, supervised fine-tuning, and preference alignment. Extensive experiments show that Salute-LLM achieves strong defense-domain performance while retaining competitive general capabilities, demonstrating the effectiveness of SALUTE as an end-to-end framework for defense-domain LLM adaptation.

[34] ABSOL: Aggregated Bayesian Subsampling Orchestrated with LLMs cs.CL | cs.LGPDF

Jackson Hassell, Chen Shen, Estevam Hruschka

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Large language models are increasingly used as natural-language interfaces to structured data, yet they remain unreliable when answers require consistent evidence conditioning, dependency-aware reasoning, and uncertainty estimation. Bayesian networks provide an explicit probabilistic reasoning layer, but learning useful structures from data remains costly and fragile at scale. We introduce ABSOL, a hybrid LLM-guided Bayesian network structure-learning framework that uses LLMs as bounded semantic guides. Across five discrete BN benchmarks spanning 27 to 1041 nodes, ABSOL is the only evaluated method to produce a viable graph on every benchmark, and achieves the highest Edge F_1 on every benchmark larger than 27 nodes with GPT-5.4. The four LLM augmentations, which contribute complementary semantic evidence to the statistical backbone, improve Edge F_1 over the non-LLM aggregation backbone by +0.23 on average. Complementary post-hoc refinement experiments suggest that these gains depend in part on limiting the LLM’s authority over the final structure. Together, these results show that language-derived semantic knowledge can substantially improve scalable probabilistic structure learning when used as bounded guidance within a statistically grounded reasoning pipeline. The code for ABSOL is available at github.com/megagonlabs/absol-bn.

[35] Salesforce Koa: An Enterprise Language Model for Agentic Tool Use cs.CL | cs.AI | cs.LGPDF

Zixiang Chen, Sufeng Niu, Yingchi Liu, Wenting Zhao, Akshara Prabhakar

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We present Salesforce Koa, an enterprise language model built by post-training the open-weight Nemotron-3-Super-120B foundation model with reinforcement learning using Group Relative Policy Optimization (GRPO). Salesforce Koa is trained on public and synthetically generated data, with no customer data, to improve tool use and agentic capabilities while preserving strong general-purpose performance. Its distinctive component is a simulation-to-reward pipeline that expands workflow specifications into persona-conditioned multi-turn tasks with task-resolution rewards grounded in successful tool use for data-dependent requests. For enterprise domains, these specifications are written in Agent Script, Salesforce’s declarative language for building Agentforce agents; for public tool-use domains, we synthesize the workflow structure directly. The same simulation and grounded-reward machinery drives GRPO across both. Across public tool-use, agentic-reasoning, and enterprise Customer Relationship Management (CRM) benchmarks, Salesforce Koa improves over its open-weight base, with the clearest gains on multi-turn tool use, and surpasses a strong proprietary baseline while remaining below the strongest frontier models. These results show that specification-driven reinforcement learning is a practical path to specializing open-weight foundation models for enterprise agentic tasks.

[36] DA-DLM: Explicitly Modeling Token Dependencies in Diffusion Language Models cs.CLPDF

Pengyu Ji, Zichen Zhang, Xiang Hu, Kewei Tu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Diffusion Language Models (DLMs) generate text by iteratively denoising a masked sequence, independently predicting multiple tokens at each step. This conditional independence discards inter-token dependencies and degrades coherence-an issue that parallels the multi-modality problem in Non-Autoregressive Translation (NAT). Drawing on the Directed Acyclic Transformer (DAT), which tackles this problem in NAT via a Directed Acyclic Graph (DAG), we propose DA-DLM, a model that adapts DAG-based dependency modeling to DLMs’ iterative setting through a position-oriented DAG design. The position-oriented DAG binds node groups to fixed output positions so that tokens fixed in earlier steps anchor neighboring predictions via learned transitions, and evolves with denoising to focus on remaining uncertainty as anchors accumulate. On language modeling, open-ended generation, and summarization, DA-DLM consistently outperforms Block Diffusion, especially under fewer denoising steps, and matches autoregressive models while preserving the parallel generation advantage. Our code is publicly available at https://github.com/jipy0222/DA-DLM.

[37] Improving Mathematical Reasoning Capabilities in Large Language Models via Reasoning Process Error Classification cs.CLPDF

Runa Yoshida, Kosuke Nishida, Kyosuke Nishida

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: The reasoning ability of large language models (LLMs) is a critical factor for practical LLM-based applications. To investigate the current reasoning capability of LLMs, we clarify the types of errors that arise in LLMs’ reasoning processes on mathematical datasets. We focus on problems where LLMs produce an incorrect answer. We define errors in the reasoning process as reasoning errors and manually analyze the features of reasoning errors. We defined and classified 21 error classes and identified the frequently occurring classes among them. Beyond qualitative evaluation, we leverage the evaluation results to improve the reasoning capability. We designed a prompt that explicitly focuses on eight error classes. The experiments demonstrate that this prompt effectively improves reasoning performance. Furthermore, the results suggest that the frequent reasoning errors identified in this paper are common across LLMs of comparable scale.

[38] EMR: Self-Evolving Medical Multi-Agent System via Experience Mining and Reuse cs.CL | cs.AIPDF

Dongsheng Shi, Yue Li, Xin Yi, Linlin Wang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Large language model (LLM) driven multi-agent systems have shown promise in complex clinical reasoning, yet existing approaches rely on static strategies and lack persistent clinical memory, preventing self-evolving from prior diagnostic successes and failures. We present EMR, a self-evolving medical multi-agent system via Experience Mining and Reuse. EMR introduces a hierarchical clinical experience library that organizes accumulated knowledge into three levels: clinical principles, diagnostic patterns, and representative cases. During inference, EMR emulates multidisciplinary consultation: a planner agent coordinates domain-specific department agents for specialized reasoning, while a summary agent synthesizes their analyses into a final decision. Critically, EMR automatically extracts correct diagnostic insights and failure-related warnings from multi-agent reasoning trajectories, incrementally updating the experience library to guide future cases. Experiments on medical reasoning benchmarks demonstrate that EMR consistently outperforms state-of-the-art medical multi-agent baselines. Further analysis reveals that the hierarchical experience enables cross-specialty generalization and transfer across diverse LLM backbones, offering a scalable and in

[39] MUSE: A Theory-Harnessed Story Engine for Vibe Narrativizing cs.CLPDF

Jianxiang Ma, Xiaocui Yang, Daling Wang, Yuesong Hou, Mingfu Zhang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: LLMs can generate fluent prose. Story quality depends on how decisions about plot, character, and language work together across planning, drafting, and revision. Guiding these decisions presents two bottlenecks: the quality of story guidance and its sustained use. We formulate Vibe Narrativizing as the task of turning natural-language writing requirements into a finished story and present MUSE, a Theory-Harnessed Story Engine. MUSE organizes story knowledge as guidance for specific decisions and carries those decisions into subsequent creative work. Knowledge engineering develops Robert McKee’s story theory through rule atomization, semantic consolidation, and mechanism abstraction; a single source of truth and layered disclosure organize the resulting guidance. Typical examples complement principles that depend on context and aesthetic judgment. An agent harness organizes design, character performance, scene composition, and revision through intermediate deliverables that preserve story decisions. Context engineering supplies each role with the relevant guidance and decisions, while a masterwork corpus provides inspiration and prose references. A worked example follows one requested object from its thematic role to the characters’ climactic actions. Across four base models, MUSE improves WritingBench by 1.6-4.8 points over zero-shot generation and raises LongStoryEval by more than ten points on three. ConStory-Bench consistency error density remains in the low single digits for all four models, below every reproduced story-system baseline on three. Component ablations locate the largest quality contribution in structural design, voice-specific effects in the character path, and further gains in revision. Code is available at https://github.com/RoadtoAGI/MUSE.

[40] Semiotic Relations and Proof Methods: A Cross-Genre Study of Argument Structure with Large Language Models cs.CLPDF

Edirlei Soares de Lima, Marco A. Casanova, Antonio L. Furtado

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: When a direct proof of a statement $S$ seems hard or even impossible to obtain, there may exist another statement (or set of statements) $S^{}$, somehow related to $S$, on the basis of which $S$ can be proved. In order to investigate what options can be used to move from $S$ to $S^{}$, four kinds of semiotic relations inspired by the four master tropes of semiotic research are briefly reviewed. Specifically, our syntagmatic, paradigmatic, antithetic and meronymic relations correspond, respectively, to metonymy, metaphor, irony and synecdoche. It is suggested that these four semiotic relations determine the options to move from $S$ to $S^{*}$, leading to proof by inference, proof by analogy, proof by contradiction, and proof by case analysis. To examine how the four relations are actually used across different kinds of argument, we complement the framework with an empirical study. We turn the four relations into explicit operational definitions and apply them to a cross-genre corpus of mathematical, legal, and everyday argument using a panel of large language models. We find that the relations are used very unevenly across genres: mathematical proofs draw on all four, whereas legal and everyday reasoning rely almost entirely on inference.

[41] Don’t Count the Edits, Judge by the Outcome Alone: Reward-Based Evaluation for Grammatical Error Correction cs.CL | cs.AIPDF

Hayeong Ryu, Sunhee Jo, Seunguk Yu, YoungBin Kim

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Grammatical error correction (GEC) evaluation has traditionally relied on reference or edit overlap, which can penalize valid rewrites that differ from gold corrections. Reference-free metrics reduce this dependence, but evaluating whether a fluent output is a valid correction of the source remains challenging. We propose SURE, a source-conditioned reward evaluator trained on within-source preferences spanning minimal-edit and rewrite-oriented corrections. SURE jointly learns an overall reward with criteria-level supervision for grammaticality, faithfulness, and fluency, together with span-level grounding for source-side error resolution. Experiments on SEEDA show that SURE performs competitively against strong baselines, with particular gains on rewrite-style corrections and more disentangled criteria-level diagnostics. Our code is available at https://github.com/hayeonggg/SURE.

[42] Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection cs.CL | cs.AI | cs.CV | cs.LGPDF

Ana-Maria Luisa Mocanu, Sebastian Mocanu, Ciprian-Octavian Truică, Elena-Simona Apostol

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Detecting sexism on the internet is a fundamentally subjective task; our team, VANGUARD, addresses this challenge in the EXIST 2026 Task 2 by proposing a human-centered multimodal framework that analyses and incorporates the psychological and demographic characteristics of human annotators into the detection pipeline. We fuse five input modalities through a cross-attention architecture with Feature-wise Linear Modulation conditioning. Meme text is extracted and visually described with Gemma 4, then augmented by automatic translation between English and Spanish with NLLB-200. Text and image representations are produced by LoRAadapted XLM-RoBERTa and CLIP encoders and fused with sensor features encoded by a pretrained autoencoder. To model annotator subjectivity, we frame Subtask 2.1 as a label distribution learning problem, optimizing a Kullback-Leibler divergence loss over the full annotator label distribution. At inference time, predictions are produced by soft-voting between the deep multimodal network and a complementary SVM trained on stylometric and physiological features. Our best submission ranks 29th out of 114 on Subtask 2.2 (source intention) under soft evaluation, and the normalized ICM scores remain above the baseline on Subtasks 2.1 and 2.2, indicating that annotator-centered conditioning contributes a usable signal. We release our full pipeline and analysis to support reproducible human-centered modeling.

[43] Before You Poll with LLMs: A Deliberative Diagnostic Framework cs.CL | cs.AI | cs.CYPDF

Ahmed Wali, Hassaan Tayyab

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Can LLMs reason through new information like humans, or do they merely retrieve cached opinions? This is critical for silicon sampling, where LLM personas simulate public opinion at scale. Current evaluations test only whether personas hold the right opinions – a static snapshot. But opinion research increasingly depends on dynamic fidelity: whether personas update beliefs in response to new arguments, as humans do during deliberation. No existing benchmark tests this. We introduce the Deliberative Polling Diagnostic Framework, which compares human and LLM belief shifts after identical informational interventions. Grounded in deliberative polling, it surfaces failures invisible to static evaluation: models that produce plausible partisan opinions can still misrepresent how those opinions change. Applying the framework to five frontier models using data from America in One Room (526 personas, 72 questions), we find that every model fails, each in a unique manner. GPT-5.1 exhibits reversal: its personas become more hostile toward the opposing party after balanced information, while humans become less so. This reversal is selective (80% on outgroup vs. 26% on policy questions) and symmetric across partisan identities. Gemini 2.0 Flash, Claude Sonnet 4.5, and Llama 3.3 70B exhibit overshoot, shifting correctly but at 5-7x human magnitude. DeepSeek V3 exhibits rigidity with near-zero change. Targeted ablations reveal that policy content triggers these failures and that they are identity-specific: GPT-5.1 reverses on outgroup questions but overshoots on ingroup; Gemini shows the inverse. We term this signature self-sycophancy: conformity to the model’s internal stereotype of the persona rather than reasoning from the information provided. Our framework offers a concrete protocol: run the deliberative diagnostic before trusting LLM personas to mimic revised beliefs.

[44] Learning to Coach for Experiential Learning cs.CLPDF

Guanheng Chen, Tianzhu Ye, Li Dong, Xun Wu, Shaohan Huang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Language models can learn from experience, but raw solution trajectories are often too long and noisy to provide effective guidance. In this work, we propose Learning to Coach (L2C), a framework that trains a dedicated LLM-as-a-Coach to extract actionable experiential knowledge from an actor model’s previous trajectory. The actor remains frozen, while the LLM-as-a-Coach is trained to maximize a reward given by the correctness of the actor’s guided response. We study two such rewards: a same-instance reward, which improves subsequent responses on the original problem, and a cross-instance reward, which elicits knowledge that transfers to other instances. Across mathematical reasoning and interactive text-games, L2C consistently outperforms self-refinement and an untrained LLM-as-a-Coach. Running experiential learning for more iterations further improves accuracy and uses additional inference compute more effectively than enlarging the actor’s decoding budget. The trained LLM-as-a-Coach also transfers to out-of-distribution tasks and adapts its guidance to the specific actor it coaches.

[45] K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations cs.CL | cs.AI | cs.LGPDF

Laura M. Vowels, Matthew J. Vowels, Shivali Sharma, Apoorv Jha, Rehnuma Choudhury

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: % !TEX root = ../main.tex People increasingly use large language models (LLMs) for mental health support, yet their safety in evolving, high-risk conversations remains poorly characterised. We developed K-Bench, a clinician-calibrated, protected benchmark evaluating 125 model configurations representing 33 base models from 14 providers across a fixed cohort of 200 multi-turn vignettes involving suicide, self-harm, domestic violence, substance misuse, and no-risk presentations. Synthetic patient conversations showed substantial distributional overlap with real human-AI conversations. A frozen GPT-4o judge achieved 94.2% exact agreement with clinician consensus across 6,751 eligible item comparisons from 151 clinician-rated transcripts. Leading models combined strong supportive conversation with combined-risk scores above 95, whereas risk exploration exposed substantial variation among lower-performing configurations. Therapeutic prompting produced configuration-specific gains concentrated among weaker models, while elevated reasoning produced no average improvement. K-Bench combines broader clinical coverage and configuration-scale comparison with a continuously updated public leaderboard whose operational test materials are protected from direct optimisation. The leaderboard is available at www.k-bench.ai.

[46] Inoculation Midtraining with Learned Neologisms cs.CLPDF

Kyle O’Brien, Edward James Young, Puria Radmard, Nathalie Kirch, Cameron Tice

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Large language models (LLMs) often learn both desirable and undesirable properties during post-training. We study whether midtraining, an earlier training stage, can shape which of these properties later generalise. We introduce Inoculation Midtraining, a technique that teaches a base model that unsafe behaviour belongs to a designated context, as indicated by the neologism (a new token) introduced during midtraining, and then post-trains the model on unsafe data within that context. We then evaluate the model outside the context, with the neologism excluded from the system prompt. Across supervised fine-tuning and reinforcement learning post-training regimes, we find that Inoculation Midtraining can reduce misalignment while preserving the transfer of benign data properties (e.g., speaking in German or Shakespearean prose). However, our approach does not outperform standard Inoculation Prompting, is sensitive to training configuration, and produces a leaky boundary that nearby contextual cues can reactivate. These results show that inoculation with a learned association introduced via midtraining can shape selective generalisation. Still, more work is needed before this approach can become a load-bearing component in a developer’s safety framework.

[47] HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses cs.CL | cs.CE | cs.MA | cs.NEPDF

Jieyuan Liu, Mengzhou Hu, Jefferson Chen, JungHo Kong, Pratibha Jagannatha

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Scientific agents contribute to hypothesis discovery by synthesizing evidence, assessing proposals, and developing new explanations. Recent systems combine scientific agents with evolutionary search through critique, comparison, and revision. However, how different forms of agent collaboration affect hypothesis quality remains an open question. Answering this question requires separating the effects of agents’ scientific capabilities from those of their collaboration. A framework must therefore preserve agents’ scientific roles and support rules for combining, revising, and retaining hypotheses. Building on this view, we introduce HypoEvolve, which makes collaboration explicit through successive updates to a hypothesis population. Specifically, we propose a generational genetic algorithm to coordinate specialized large language model (LLM) agents that integrate mechanistic arguments, reconsider assumptions, and assess evidence and testability. Each generation specifies how scientific judgments and new proposals reshape the population, making collaboration effects on hypothesis quality directly testable. Moreover, we design our evaluation around scientifically meaningful hypotheses that explain how a proposed intervention could work. Drug repurposing links these explanations to target-level biological claims assessed against external evidence. Specifically, we adapt DepMap and Open Targets into complementary external measures grounded in experimental, genetic, and clinical evidence. Across 34 cancer types, HypoEvolve achieves the highest scores against six baselines on both measures. DepMap selectivity reaches 0.171, versus 0.115 for the strongest baseline. Gains over single-pass generation also generalize to held-out cancer types. HypoEvolve advances a vision of autonomous science in which AI research teams achieve a capacity for discovery beyond that of individual models.

[48] Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States cs.CL | cs.LGPDF

Zixuan Wang, Yufan Zhou, Jinzhou Tang, Xinle Yu, Chengjun Wu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: As language models become more capable, long-term collaboration in learning, reasoning, and decision-making calls for a deeper understanding of the people they serve. Yet training such human-aware language models faces a fundamental supervision gap because current datasets for LLM assistant training contain few if any well-informed responses explicitly grounded in users’ unspoken beliefs and goals. Scaling such supervision is inherently constrained, as users’ underlying states are not directly observable. We thus propose the Mind2Dialogue framework to mitigate this gap by simulating users’ mental states and turning them into privileged supervision for human-aware training. Specifically, we first propose a psychology-guided simulator that preserves personal characteristics while updating mental states through interaction to generate coherent conversations. The key idea is to enforce a shared evolving mental state that drives user behavior and guides an Oracle assistant’s responses. Our privileged distillation then trains models on the Oracle’s well-informed responses to assist users without direct access to their mental states at deployment. Moreover, we propose to evaluate human-aware learning by combining personalization and theory of mind, examining how models understand people and act on that understanding. Training on the full Mind2Dialogue corpus improves every reported personalization metric over the corresponding Qwen, Llama, and OLMo instruction-tuned baselines, including gains of 26.6 to 40.9 percentage points in preference-following generation. The gains extend to belief and action reasoning on Qwen and Llama, beyond personalized assistance. Looking forward, Mind2Dialogue makes user simulation a foundation for genuine AI collaborators that understand beliefs and intentions behind people’s words and support their long-term goals across education, work, and everyday life.

[49] Discovery Foundation Models: Toward Open-Ended Discovery Intelligence cs.CLPDF

Ling Yang, Zhenfei Yin, Yingcheng Wu

Rajiv Ranjan

TL;DR: 本文探讨了地球基础模型是否应显式保留物理场类型（如标量场、矢量场、张量场）的几何变换特性，而非仅依赖标准嵌入与数据增强。核心贡献是一个分阶段的证伪研究计划：首先在计算可控的ERA5数据集上比较传统嵌入、增强匹配嵌入、类型等变嵌入及Hodge/Helmholtz变体在时空、方向及低数据条件下的性能，仅当显式几何类型化带来可复现改进时，才推进到多模态地球基础模型的构建。

Details

Motivation: 当前地球观测基础模型学习到的高维语义嵌入缺乏固有的物理变换规律，而物理场（标量、矢量、张量等）在旋转、反射和局部坐标系变换下行为不同。本文旨在验证显式保持这些几何类型区分是否能带来实际性能提升，而非假设更复杂的架构必然更好。

Result: 摘要未提供具体定量结果，但提出了一个评估框架：将在ERA5数据集上系统比较传统嵌入、增强匹配、类型等变及Hodge/Helmholtz变体模型在空间、时间、方向变换及低数据场景下的表现，以确定显式几何类型化是否产生可复现的改进。

Insight: 创新点在于提出了一个分阶段、可证伪的研究方法，而非直接设计复杂架构；强调将物理场的几何类型（如标量、极矢量、轴矢量、协向量）显式融入基础模型，以探索其相对于现有仅考虑球面几何或隐式学习的方法是否具有实际优势。

Abstract: Earth-observation (EO) foundation models have become exceptionally effective at learning se mantic, high-dimensional geospatial embeddings, while modern weather and climate models have demonstrated that Earth-specific geometry, spherical operators, meshes, and hybrid physical solvers can materially improve prediction. Yet these two advances are not equivalent. A conventional latent embedding has no inherent physical transformation law, whereas scalar fields, tangent polar-vector fields, axial/pseudovector quantities, covectors, and higher-order tensors transform differently under rotations, reflections, and changes of local coordinate frame. This proposal asks whether a general purpose Earth foundation model should preserve those distinctions explicitly, or whether standard embeddings plus augmentation already learn everything that matters. The central contribution is therefore not a more complicated architecture by assumption, but a staged falsification program. A compute-conscious ERA5 dry run first compares conventional, augmentation-matched, typed equivariant, and Hodge/Helmholtz variants under spatial, temporal, orientation, and low-data shifts. Only if explicit geometric typing yields reproducible improvements does the program advance toward a multimodal Earth foundation model in which semantic embeddings coexist with physically typed fields. The proposed gap is narrower and more defensible than claiming that current models ignore geometry entirely: several systems already respect spherical domain geometry, and emerging work explicitly learns scalar/vector fields on spheres. The unresolved question is whether foundation-scale, multimodal, parity-aware field typing produces practical gains beyond those existing approaches.

Flavian Pegado, Ronit Hire, Shreyas Rajesh, Soham Phade

TL;DR: 本文提出了BLInD模型，这是一个仅依赖车辆历史状态（如速度、曲率、转向灯、车辆类型）来预测未来自车轨迹的多模态概率分布的紧凑网络。它无需摄像头、激光雷达、地图或物体跟踪输入，具有低延迟特性，适用于安全关键部署。模型在多个公开数据集上验证了其泛化能力，并集成到自动紧急制动（AEB）任务中，显著降低了误报率。

Details

Motivation: 解决现有学习型分布模型依赖场景上下文，而仅基于车辆状态的模型通常只能预测单一路径的问题，旨在开发一个不依赖外部传感器、能同时实现多模态预测、泛化能力强且适合实时部署的驾驶员意图预测模型。

Result: 在Wayve、Waymo和nuScenes数据集上，流匹配模型取得了最佳Top-k ADE/FDE结果（例如Wayve上为0.15/0.37米），自回归模型也达到了相当的覆盖率。在AEB触发任务中，与基线策略相比，AR模型将误报率降低了13.7倍（至0.11%），流匹配模型降低了25.1倍（至0.06%），同时保持了高真阳性率。模型在NVIDIA DRIVE Orin ECU上的推理时间分别为0.87毫秒（AR）和2.9毫秒（流匹配）。

Insight: 创新点在于首次同时实现了仅基于车辆历史状态（blind）、学习得到的多模态轨迹分布，并证明了其跨域泛化能力。这为下游系统（如AEB）提供了一个可控且合理的意图采样接口，其紧凑和低延迟的设计使其非常适合在汽车ECU上实时部署。

Abstract: We present BLInD (Blind Learned Intent Distribution), a compact network that maps recent vehicle-state history (e.g. speed, curvature, indicator, and vehicle type) to a top-k distribution of future ego trajectories, with no camera, LiDAR, map, or object-track inputs. We find that vehiclestate history alone is sufficient to learn a useful multimodal distribution over near-term ego trajectories, and its low-latency nature makes it well-suited for safety-critical deployment. We investigate two distribution architectures, autoregressive (AR) and flow-matching, and train on both mixed-platform opensource and Wayve datasets. Both generalize without datasetspecific adaptation; the flow-matching model achieves best topk ADE/FDE of 0.15/0.37 m on Wayve, 0.15/0.36 m on Waymo, and 0.28/0.59 m on nuScenes, with the AR model reaching comparable coverage. Integrating the distributions into an AEB trigger task, a strict all-candidates policy reduces false positives from 1.51% to 0.11% with AR (13.7x reduction, 94.9% TP) and to 0.06% with flow-matching (25.1x reduction, 98.7% TP) compared to a 1-CTRV policy with 100% true positive score. BLInD runs in 0.87 ms with the AR head and 2.9 ms with the flow-matching head on an NVIDIA DRIVE Orin ECU making it compatible with real-time deployment on automotive ECUs. While existing learned distribution models rely on scene context and blind vehicle-state models typically collapse to a single path, BLInD is learned, blind, and cross-domain simultaneously, a combination not demonstrated by prior work. These results show that such a distribution provides a controllable and plausible intent sampling interface for downstream systems, with AEB as one instantiation.

[92] SGWIB:Sliced Gromov-Wasserstein Information Bottleneck for Video Highlight Detection cs.CV | cs.AIPDF

Hanjuan Huang, Yung-Chieh Yeh, Hsing-Kuo Pao

TL;DR: 本文提出了一种名为SGWIB的视频高光检测方法，该方法基于信息瓶颈原则，通过引入切片Gromov-Monge间隙（SGMG）正则化器来保持片段间的时间结构，并利用上下文解耦模块减少特定领域（如体育）的上下文偏差。

Details

Motivation: 视频高光检测需要既学习判别性的片段表示，又保持片段间的时间关系。传统信息瓶颈方法直接应用于此任务会忽略片段间的关系结构并扭曲时间组织，因此需要一种结构感知的表示学习方法。

Result: 在MrHiSum和MoSu数据集上的实验表明，SGWIB在Kendall’s tau、Spearman’s rho、mAP@50和mAP@30指标上均优于其他单模态方法，在MrHiSum数据集上视觉模型将先前最佳结果分别提升了0.031、0.031、0.87和0.75，达到了新的SOTA水平。

Insight: 创新点在于提出了结构感知的SGMG正则化器来在信息瓶颈框架中保持时间结构，并设计了上下文解耦模块以减少领域特定偏差，这为视频理解任务中学习结构保持的紧凑表示提供了新思路。

Abstract: Video highlight detection aims to identify temporally important segments that capture the most informative or engaging events in a video. Reliable prediction therefore requires not only discriminative segment representations but also preservation of the temporal relationships among neighboring and distant segments. The information bottleneck principle has proven effective for learning compact and task-relevant representations, yet it has not been explored for video highlight detection, and applying conventional formulations directly would overlook inter-segment relational structure and distort highlight relevant temporal organization during compression. We therefore introduce the Sliced Gromov-Monge Gap (SGMG), a structure aware regularizer that measures the excess relational distortion induced by a prescribed source-to-bottleneck mapping relative to an optimal sliced structural correspondence. Building on SGMG, we develop SGWIB, an information-bottleneck framework for single-modal video highlight detection that learns compact bottleneck representations while preserving inter-segment temporal structure. We further introduce Home-Away-Related Contextual Pseudo-Labels and a contextual disentanglement module that reduce sports-specific contextual bias by separating highlight oriented information from contextual patterns. Experiments on MrHiSum and MoSu show that SGWIB attains the best Kendall’s tau, Spearman’s rho, mAP@50, and mAP@30 among the compared single-modal methods on both datasets. On MrHiSum, the visual model improves the strongest previous results by 0.031, 0.031, 0.87, and 0.75 on these four metrics, respectively. These results show that structure-aware information-bottleneck regularization combined with contextual disentanglement improves segment-level highlight prediction.

[93] LPA-CWM: A Learned Physical Adjudicator for Motion Reasoning with Counterfactual World Models cs.CV | cs.AI | cs.ROPDF

Kunwei Wu, Xiang Liu, Guocai Yao, Junming Chen, Zhikang Chen

TL;DR: 本文提出LPA-CWM，一种用于反事实世界模型中运动推理的学习物理仲裁器。该方法通过轻量级学习模块评估不同掩码干预下生成响应的可靠性，并加权聚合以提升运动轨迹提取的准确性。

Details

Motivation: 现有反事实世界模型在聚合不同目标帧掩码下的预测响应时，采用均匀加权忽略了响应可靠性的差异，导致运动推理性能受限。

Result: 在DAVIS和Kinetics子集上，LPA-CWM相比均匀加权的CWM分别将平均DCA指标提升了60.0%和29.0%，并在TAP-Vid First基准上提高了跟踪精度。

Insight: 创新点包括将响应聚合建模为候选可靠性学习问题，引入轻量级学习仲裁器；同时提出了完整性感知运动对应评估协议，综合衡量轨迹的定位、完整性、可见性与连续性。

Abstract: Counterfactual world models (CWM) extract motion from pretrained video predictors by comparing factual and intervened predictions. However, responses generated under different target-frame masks vary in reliability, while uniform aggregation weights them equally. We formulate response aggregation as candidate reliability learning and propose LPA-CWM with a lightweight Learned Physical Adjudicator (LPA). Trained on dense MOVi-F trajectories, the 3.0M-parameter LPA compares visual context and response structure across an unordered candidate set to predict relative weights, while the CWM predictor and intervention generator remain frozen. The weighted responses undergo windowed localization and one paired re-evaluation to recover motion. We also introduce Completeness-aware Motion Correspondence (CMC), a ground-truth-anchored evaluation protocol that jointly measures localization, trajectory completeness, visibility, and continuity, counting missing predictions as failures on visible dynamic points. On the evaluated DAVIS and Kinetics subsets, LPA-CWM improves $\mathrm{DCA}_{\mathrm{avg}}$ over Uniform CWM by 60.0% and 29.0%, respectively, and also improves tracking accuracy under TAP-Vid First. A quick overview is available at https://LPA-CWM.github.io.

[94] RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes cs.CV | cs.AI | cs.LGPDF

Abhirama Subramanyam Penamakuri, Shreya Shukla, Anand Mishra

TL;DR: 本文提出了一种无需训练的时尚图像描述框架RA-CoA，通过检索增强的属性链方法，将时尚图像描述分解为检索相关属性集和属性级推理两个阶段，以提升细粒度属性描述的准确性。

Details

Motivation: 针对时尚图像描述需要细粒度视觉推理和领域特定术语，以及时尚库存快速更新带来的可扩展性挑战，现有通用视觉语言模型在属性覆盖和精度上不足，易产生幻觉或误识别细节。

Result: 在不同视觉语言模型家族和提示范式下的广泛评估表明，RA-CoA显著提升了描述质量，在METEOR分数上平均比零样本描述提高了26.3%。

Insight: 创新点在于将时尚图像描述解耦为检索和推理两个可解释阶段，无需微调即可提升细粒度属性精度；客观分析认为其模型无关性和训练免费设计增强了实际应用的适应性和可扩展性。

Abstract: Fashion Image Captioning (FIC) plays a vital role in enhancing user experience and product search in e-commerce platforms. Unlike natural scene image captioning, FIC requires fine-grained visual reasoning and knowledge of domain-specific terminology to capture subtle attributes such as neckline and closure types, graphic patterns, and dress silhouettes. Moreover, as fashion inventories evolve rapidly with new trends, styles, and frequently emerging vocabulary, developing training-free captioning solution becomes essential for scalability and real-world adaptability. Instruction-tuned vision-language models (VLMs) offer a promising solution to fashion image captioning dueto their strong zero-shot capabilities and natural language fluency. However, these general-purpose models often lack attribute-level coverage and precision, and tend to hallucinate or misidentify fine-grained fashion details, making them less suitable for high-fidelity applications like product cataloging or personalized recommendations. To address this, we propose RA-CoA (Retrieval-Augmented Chain-of-Attributes), a novel, training-free framework that disentangles fashion image captioning into two interpretable stages: (i) retrieval of relevant attribute sets from a product knowledge base, and (ii) attribute-level reasoning to generate the final caption. RA-CoA is a model-agnostic approach that works with frozen VLMs to improve fine-grained attribute precision in product captions without the need for fine-tuning. Extensive evaluations across diverse VLM model families under different prompting paradigms demonstrate that RA-CoA significantly improves caption quality, achieving an average gain of 26.3% METEOR score over zero-shot captioning. We make our code publicly available.

[95] Adapting Open-Weight MLLMs to Generate Point Prompts for Electron Microscopy Segmentation cs.CVPDF

Samia Mohinta, Albert Cardona

TL;DR: 该论文探索了利用开源多模态大语言模型（MLLMs）为电子显微镜图像分割自动生成点提示的方法。通过将图像和自然语言指令与掩码质心坐标配对，训练LoRA适配器，使冻结的MLLM能够根据语言请求输出坐标，进而驱动微SAM分割器。实验表明，经过微调的Qwen3-VL等模型在分割性能上显著提升，并能泛化到未见数据集和语言表述。

Details

Motivation: 解决在电子显微镜图像分割中，如何自动化生成点提示以替代人工输入的问题，探索开源MLLMs作为可解释的、语言驱动的定位与分割桥梁的可行性。

Result: 在三个线粒体数据集上，经过监督微调和奖励优化的Qwen3-VL模型将分割AP50从0.247提升至0.736，接近自动提示生成（APG）的0.773；其他MLLMs也达到或超过APG水平。虽然性能仍低于专用监督检测器（AP50 0.904），但MLLMs生成的坐标更接近标注点集和实例数量，且展现出良好的跨数据集和语言表述泛化能力。

Insight: 创新点在于首次将开源MLLMs适配为电子显微镜图像的点提示生成器，通过LoRA微调实现语言指令到坐标的映射，构建了一个可检查的、语言导向的定位-解码链路，为自动化生物医学图像分析提供了新思路。

Abstract: Promptable models such as microSAM segment electron microscopy (EM) images from point prompts, but automation requires generating prompts without user input. We ask whether open-weight multimodal large language models (MLLMs) can generate them from natural-language requests by returning coordinates to a frozen segmenter. To that end, we convert masks from three mitochondria datasets into training examples, pairing images and instructions with centroid coordinates, then train LoRA adapters while freezing the MLLM backbone and microSAM. We find that Qwen3-VL reaches segmentation AP${50}$ $0.736$ after supervised fine-tuning and reward optimization, up from $0.247$ without adaptation, while automatic prompt generation (APG) achieves $0.773$. In addition, two other MLLMs improve, reaching or exceeding APG. When compared with a supervised centroid-heatmap detector that reaches AP${50}$ $0.904$ for this mitochondria task, Qwen3-VL more closely matches the annotated point set and instance counts. Moreover, training on two public datasets transfers to an unseen third, while training on all three transfers to an independent EM volume. Robustness tests show stable performance under unseen formulations of the natural-language request, while the coordinates can be reused by a second segmenter. To our knowledge, this is the first feasibility study of open-weight MLLMs as EM point generators, providing an inspectable, language-directed link between localization and mask decoding.

[96] Talking to Me or Someone Else? Rethinking Talk-to-Me Detection in Egocentric Videos cs.CV | cs.AIPDF

Feiyu Du, Xi He, Jia Li, Yapeng Tian, Weili Wu

TL;DR: 本文重新审视了第一人称视角视频中的‘对我说话’检测问题，将其重新定义为在线、帧级别的预测任务，并考虑了多种非TTM状态。作者构建了一个包含约90万帧标注的在线TTM数据集，并提出了一个融合多模态社交线索的模型。

Details

Motivation: 现有TTM研究多为离线的片段级识别，与在线交互需求不匹配，且忽略了第一人称视频中多样化的非TTM说话状态。

Result: 在扩展的Ego4D社交交互基准上，提出的多模态模型（融合音频、视觉和语音语义线索）在TTM检测上达到了75.5%的帧级F1分数，优于强基线。

Insight: 将TTM检测从二元分类重构为包含多种非TTM状态（如对他人说话、自言自语、背景）的在线帧级任务，并构建相应数据集；通过融合多模态社交线索提升性能，为分析不同说话状态对识别的影响提供了系统方法。

Abstract: Online understanding of who is talking to the camera wearer is a key capability for egocentric social interaction. However, existing talk-to-me (TTM) studies are commonly formulated as offline clip-level recognition, which is poorly aligned with online interaction and overlooks the diverse non-TTM speaking states that naturally arise in egocentric videos. In this paper, we revisit this problem by reformulating it as an online, frame-level prediction task. Instead of treating TTM as a binary problem against a single negative class, we model it in the presence of diverse and previously underexplored non-TTM states, such as talking-to-others, self-talking, and background conditions. To support this new formulation, we construct an Online TTM Dataset consisting of 406 egocentric video clips with approximately 900K annotated frames, each labeled with frame-level social interaction categories (e.g., background, TTM, talking-to-others, self-talking), by extending the Ego4D social interaction benchmark. In this benchmark, we evaluate five adapted baselines and develop a new model that integrates social cues across modalities. Experimental results show that our multimodal model, which jointly leverages audio, visual, and speech-semantic cues, achieves 75.5% frame-level F1 on TTM, outperforming strong baselines and enabling a systematic analysis of how different speaking states affect TTM recognition.

[97] SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance cs.CVPDF

Zhewen He, Junyi Yu, Haomian Huang, Zhenhua Li, Yi Fang

TL;DR: 本文提出SignMimic方法，用于解决手语视频模仿生成任务：给定驱动视频和单个参考帧，合成目标手语者复现源动作的视频，同时保持身份和语言形式。该方法通过分解刚性运动、非刚性变形和视角相关补全三个子问题，结合几何与语言先验，实现了高质量、稳定的手语动作生成。

Details

Motivation: 现有手语视频生成方法将刚性运动、非刚性变形和视角相关补全耦合在单一生成器中，导致手形漂移和时空不稳定问题。本文旨在通过解耦这些因素，提升生成视频的质量和稳定性。

Result: 在ASL 50K、How2Sign、CSL News等多个大规模数据集上，SignMimic在视频质量、身份相似性和帧连续性方面达到SOTA水平，且在生成视频上进行反向翻译（SLT）时损失最小。消融实验验证了刚性正则化、非刚性适应和补全模块的作用。

Insight: 创新点包括：（1）基于TNet的SE(3)刚性正则化稳定全局姿态；（2）在正则空间通过NIF2D进行非刚性适应以保持手/脸等精细发音器官和协同发音；（3）在条件视频扩散前使用Pose-MAE风格补全。这种分解式架构为动作生成任务提供了可借鉴的模块化设计思路。

Abstract: We study the challenge of sign language video mimicking: given a driving video and a single reference frame, synthesize a video where the target signer reproduces the source motion while preserving identity and linguistic form. Prior pipelines entangle rigid motion, non-rigid deformation, and view-dependent completion in a monolithic generator, causing handshape drift and spatio-temporal instability. We present SignMimic, which (i) applies a TNet-based model to study SE(3) rigid canonicalization to stabilize global pose, (ii) performs non-rigid adaptation in a canonical space to preserve fine-grained articulators (hands/face) and coarticulation via NIF2D, and (iii) uses Pose-MAE-style completion before conditional video diffusion. This factorization injects geometric and linguistic priors, yielding shape and spatio-temporal consistency. On several large-scale datasets (ASL 50K, How2Sign, CSL News), SignMimic achieves state-of-the-art-level performance on video quality, identity similarity, and frame continuity while also achieving minimal loss when performing back translation (SLT) on generated videos. Ablations confirm the role of rigid canonicalization, non-rigid adaptation, and completion. Code, model checkpoints, and video examples will be released.

[98] SPARK: Representation-Level KV Memory Alignment for Safer Vision-Language Models cs.CVPDF

Mohd Azfar, Izhar Dad Khan

TL;DR: 论文提出了SPARK框架，旨在通过修复视觉语言模型（VLM）预填充阶段形成的多模态键值（KV）记忆来增强模型安全性，而无需在推理时修改模型参数。该方法通过两阶段过程识别并投影掉与有害意图相关的表征方向，并混合修复后和原始的记忆，从而有效抵御跨模态的越狱攻击。

Details

Motivation: 视觉语言模型（VLMs）容易受到将有害意图分布在文本和图像中的越狱攻击，使得单模态安全机制失效。论文旨在探究是否可以直接在多模态KV记忆中缓解这种漏洞，而不在推理时修改模型参数。

Result: 在LLaVA-OneVision-7B、Chameleon-7B、Qwen2-VL-7B和InternVL2-4B等多个模型上，SPARK显著降低了多模态攻击成功率。例如，在LLaVA-OneVision-7B上，纯图像越狱攻击成功率降至4.7%，而MMMU性能仅下降0.6个百分点（47.8 vs. 48.4），语言质量接近基线。在MM-SafetyBench上，攻击成功率从39.2%降至12.4%。即使在白盒自适应联合提示-图像攻击下，攻击成功率也被限制在20.3%，而未防御模型为54.6%。

Insight: 论文的创新点在于提出了一个无需修改模型参数、直接在预填充阶段对多模态KV记忆进行针对性修复的两阶段框架。其核心洞察是，通过识别并投影掉与有害意图相关的表征子空间，并利用图像结构先验锚定修复后的键，可以有效地缓解多模态越狱行为，同时保持模型的通用能力。该方法避免了在推理时使用显式的有害分类器，而是通过基于干预相关子空间能量的头级系数来混合记忆。

Abstract: Vision-language models (VLMs) remain vulnerable to jailbreaks that distribute harmful intent across text and images, making unimodal safety mechanisms insufficient. We investigate whether this vulnerability can be mitigated directly in the multimodal key-value (KV) memory formed during prefill, without modifying model parameters at inference time. We introduce SPARK, a two-stage framework for targeted KV-memory repair. Stage 1 uses a disposable diagnostic adapter to identify harm-associated directions in multimodal key and value representations. Stage 2 projects out these directions, learns a lightweight residual repair, and anchors repaired keys with an image-structural prior to preserve visual grounding. Rather than applying the intervention uniformly, SPARK mixes repaired and original memory using a head-wise coefficient g_h* determined by intervention-relevant subspace energy E_h, requiring no explicit harm classifier at inference. Across LLaVA-OneVision-7B, Chameleon-7B, Qwen2-VL-7B, and InternVL2-4B, SPARK reduces multimodal attack success while preserving general capability. On LLaVA-OneVision-7B, image-only jailbreak attack success falls to 4.7%, while MMMU remains within 0.6 points of the undefended model (47.8 vs. 48.4) with near-baseline language quality. On MM-SafetyBench, attack success decreases from 39.2% to 12.4%. Even under white-box adaptive joint prompt-image attacks, attack success is limited to 20.3%, compared with 54.6% for the undefended model. These results suggest that multimodal jailbreak behavior can be substantially mitigated by selectively repairing intervention-relevant KV subspaces at prefill, particularly when harmful evidence is carried by the visual modality.

[99] S3-Tracker: Self-Supervised Surgical Tissue Tracking With Contrastive Random Walks cs.CV | cs.LG | cs.ROPDF

Jiaming Zhang, Zijian Wu, Mehran Armand, Septimiu Salcudean

TL;DR: 本文提出了一种名为S3-Tracker的自监督手术组织跟踪方法，通过对比随机游走从无标注的内窥镜视频中学习全局像素对应关系并推断点轨迹，旨在解决手术环境下软组织变形导致的稳健点跟踪问题。

Details

Motivation: 内窥镜视频中的稳健点跟踪对于计算机辅助干预和自主机器人手术至关重要，但监督方法依赖大量标注数据，而手术条件使得可靠的轨迹标注具有挑战性。

Result: 该方法在无需标注的情况下进行训练，其性能与现有的半监督方法相当，并能隐式处理组织变形。

Insight: 创新点在于提出了一种自监督的Track-Any-Point方法，利用对比随机游走建立像素对应关系，这展示了在手术环境中实现自监督点跟踪的可行性，并有望减少对标注数据的依赖。

Abstract: Robust point tracking in endoscopic videos is essential for computer-assisted intervention and autonomous robotic surgery, enabling continuous registration between intraoperative video and preoperative imaging despite soft tissue deformation. However, supervised tracking methods depend on large annotated datasets, while surgical conditions make reliable trajectory annotation challenging. We propose a self-supervised Track-Any-Point approach that learns from unlabeled surgical videos by establishing global pixel correspondences and inferring point trajectories through contrastive random walks. Trained without annotations, our method achieves performance comparable to existing semi-supervised approaches while implicitly handling tissue deformation. These findings demonstrate the feasibility of self-supervised point tracking in surgical environments and its potential to reduce reliance on annotated data.

[100] Vision-Language Models for Criterion-Level Grading of Handwritten Examinations in Outcome-Based Education cs.CVPDF

Md Khalid Syfullah, Asif Hasan Tonmoy, Saad Ahmed, S. M. Jahangir Alam

TL;DR: 本研究评估了多种视觉语言模型（VLM）在手写考试基于学习成果的准则级评分任务上的表现。通过比较包括Qwen2.5-VL、InternVL3、Pixtral在内的20种模型配置，研究发现，经过LoRA微调的Qwen2.5-VL模型在评分准确性上超越了人类评分员之间的平均一致性水平。同时，研究揭示了模型在评分可靠性、可重复性以及解释质量方面存在的挑战。

Details

Motivation: 在基于成果的教育中，准则级评分将考试表现与学习成果关联，但人工评分存在工作量大和评分者间差异的问题。本研究旨在探索VLM模型自动化此评分过程的潜力，以减轻教师负担并提高评分一致性。

Result: 在1982条准则级记录上，使用LoRA微调的Qwen2.5-VL模型取得了最佳性能：其与主评分员的二次加权Kappa（QWK）为0.727，平均绝对误差为0.435分，优于人类评分员对间的平均QWK（0.551）。然而，模型在多次运行中的评分一致性（50.2-63.6%的准则分数发生变化）和生成的解释质量方面表现不佳。

Insight: 研究强调了针对具体评分标准进行模型校准的重要性，以及确保评分可重复性的必要性。LoRA微调在指令调优的VLM上表现优于部分微调和少样本提示。一个关键发现是，模型在评分准确性上可能达到实用水平，但其解释生成能力需要单独验证，且注意力引导的归因方法在本任务中未显示出统计显著优势。

Abstract: Criterion-level grading connects examination performance to learning outcomes, but manual marking introduces workload and variation between markers. This study evaluates vision-language models (VLMs) for handwritten outcome-based assessment across five dimensions: accuracy, human agreement, repeated-run reliability, error concentration, and explanation quality. Using 1,982 criterion-level records from 485 undergraduate examination answers, we compare 20 configurations spanning Qwen2.5-VL, InternVL3, Pixtral, a Donut baseline, and a cascade ensemble. Evaluation setups include zero-shot prompting, few-shot prompting, partial fine-tuning, and Low-Rank Adaptation (LoRA). Two independent faculty markers regraded all 291 test criteria, providing a human agreement baseline on the same assessment materials. Qwen2.5-VL with LoRA achieved Quadratic Weighted Kappa (QWK) of 0.727 and mean absolute error of 0.435 marks against the examiner, compared with mean human-pair QWK of 0.551. This comparison reflects calibration to the examiner’s training marks. LoRA outperformed partial fine-tuning for all three instruction-tuned VLMs, while few-shot prompting reduced QWK in every configuration with valid prompted scores. Aggregate reliability and exact repeatability diverged: intraclass correlations ranged from 0.790 to 0.874, yet 50.2-63.6% of criteria changed marks across five sampled runs. Attention-guided deletion showed no statistically significant advantage over random masking, and four faculty reviewers reached no consensus on explanation usefulness. These findings highlight the need for rubric-specific calibration, repeatable scoring, review of consequential errors, and separate validation of explanations. The released evaluation protocol supports criterion-level assessment research and grading tools with teacher oversight.

[101] Learning Continuous Source Responses For Generalizable AI-Generated Image Detection cs.CVPDF

Manni Cui, Ruiqi Liu, Zijian Yu, Hao Tan, Zibo Wei

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Advances in image generation have made synthetic images increasingly difficult to distinguish from real photographs, raising concerns about the trustworthiness of visual media. Existing AI-generated image detectors often perform well on in-domain data, but their robustness and cross-generator generalization remain limited. These limitations are commonly attributed to overfitting to shortcut cues. Although many methods seek to suppress shortcut learning, most retain binary classification as the training task without reconsidering how the task itself shapes the learned representations. We introduce CuRe, a framework for learning Continuous Source Responses that revisits authenticity detection from the perspective of the training task. CuRe reformulates backbone adaptation as regression of real-generated mixing ratios, providing finer supervision that encourages the model to capture authenticity-related variation beyond binary endpoint separation. We further select a compact source-response subspace to suppress nuisance variation and limit the final classifier’s access to potential shortcut cues. Across ten public benchmarks, CuRe achieves an average balanced accuracy of 89.7%, exceeding the second-best method by 5.2 percentage points. Further experiments demonstrate consistent generalization gains across visual backbones and strong robustness to common image degradations. Code is available at https://github.com/manic-cui/CuRe

[102] Two-Stage Mixture-of-LoRA for Multi-Task Medical Vision-Language Learning cs.CVPDF

Zhanghao Chen, Yuanyuan Li, Zhenyu Lu, Shuo Gao, Guangquan Zhou

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Medical vision-language models (VLMs) allow a single model to perform clinical image analysis tasks ranging from diagnosis classification to report generation. However, joint adaptation is challenged by heterogeneous output formats, conflicting task gradients, and imbalanced training data. Hence, we present \textbf{Two-Stage Mixture-of-LoRA}, a framework built on MedGemma-1.5-4B. The framework uses a shared-specific Mixture-of-LoRA architecture comprising one shared LoRA and six task-specific expert LoRAs, together with a two-stage training procedure. In Stage 1, we jointly train the shared LoRA and all task-specific expert LoRAs on all tasks. In Stage 2, we first freeze the backbone, the shared LoRA, and all non-target experts, and refine one task expert at a time. Classification and regression then receive an additional modality-balanced continuation, in which smaller modality groups are repeated to match the largest group. In the FLARE 2026 Task 3 test sets, the proposed method achieves 0.85 balanced accuracy for classification, 0.48 micro-F1 for multi-label classification, 0.79 detection F1, and 17.39 regression MAE. Code is available at https://github.com/YuanYL03/MICCAI-FLARE-2026-Challenge-Task3-2D.

[103] Rethinking Camouflage Image Generation towards a Training-Free Paradigm cs.CVPDF

Haodong Yang, Zhongling Huang, Gong Cheng

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Camouflage image generation (CIG) aims to synthesize realistic camouflaged images by blending foreground objects into concealment-compatible background contexts. Achieving this objective requires jointly satisfying three coupled requirements: foreground preservation to retain target integrity, semantic compatibility to select plausible concealment contexts, and appearance assimilation to reduce visual discrepancies. Recent approaches predominantly rely on task-specific training on camouflage datasets to address these requirements, incurring substantial computational cost and limiting generalization beyond the training domain. To address these limitations, we formulate training-free CIG as a concealment-oriented paradigm that preserves the target while reducing its perceptual separability from the synthesized surroundings, rather than maintaining its visual prominence, without parameter updates. We instantiate this paradigm with FreeCam based on a frozen inpainting diffusion framework to preserve the foreground. Within this framework, a Contextual Reasoning Module exploits frozen multimodal priors to infer an environment favorable to concealment, thereby promoting semantic compatibility, while an Intrinsic Appearance Module extracts low-level color and texture cues from the foreground to guide background synthesis toward appearance assimilation. Extensive experiments demonstrate that FreeCam achieves state-of-the-art generation quality and camouflage effectiveness without task-specific training, while its generated images provide synthetic supervision for camouflaged object detection and reduce target detectability under general object detectors.

[104] Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection cs.CVPDF

Sam Williams, Yuan Xiang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Real-time pedestrian detection in driving scenes is constrained by three coupled failure modes: tiny targets lose discriminative evidence, occlusion weakens geometric support, and weather or illumination changes distort appearance statistics. We formulate the detector through a unified \emph{contour-guided spectral routing} view rather than treating frequency processing, attention, and boundary reasoning as independent add-ons. The detector routes information in a prescribed order: spatial evidence is first augmented with global spectral context, deep representations then exchange spatial and spectral cues, and cross-scale fusion is finally conditioned on boundary–semantic disagreement. This ordering yields a compact representation pipeline in which low-frequency context stabilizes global structure while high-frequency evidence protects small-object contours. We further retain a wavelet-subband training transformation that perturbs low- and high-frequency coefficients independently, targeting appearance shifts caused by fog, rain, snow, and low illumination. The formulation exposes a single routing variable at each stage and distinguishes reusable signal transforms from the task-specific policy that decides where each signal is injected. On CityPersons, the proposed detector obtains 70.4 AP${50}$ and 44.2 AP${50:95}$, compared with 68.1 and 42.2 for RT-DETR, while the full wavelet-augmented configuration reaches 71.1 and 44.6.

[105] A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification cs.CV | cs.AI | eess.IVPDF

Leon Fernando, C Dombawala, P. Hettigoda, Vanodhya G. Warnasooriya, Ishara Neranjana

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Person re-identification (ReID) is essential for multi-camera surveillance and tracking, yet remains difficult due to viewpoint and illumination changes, occlusion, background clutter, and low resolution imagery. We propose a generative AI integrated multimodal ReID framework designed explicitly for robustness under missing cues and low latency deployment. The key idea is a cost aware early-exit cascade that prioritizes inexpensive, high confidence evidence and only triggers expensive modalities for ambiguous cases. Our system integrates (i) global visual embeddings from segmented person regions, (ii) automatically generated fine grained semantic attribute descriptions generated by vision-language models (VLMs), and (iii) optional facial embeddings when face observations are reliable. To optimize the balance between accuracy and latency, we use a cost aware early-exit cascade instead of fusing all modalities. Specifically, we first inspect the top-k retrieval results to determine whether the query is unambiguous. If the best match is clearly separated from the remaining candidates, we stop early and return the result to minimize latency; in ambiguous cases, we keep multiple hypotheses and invoke additional modalities (face/semantic) with adaptive reliability weighting to refine the decision. We report person re-identification performance using mAP and Rank-1 accuracy on the Market-1501 and DukeMTMC-reID benchmarks. The proposed adaptive early-exit cascade resolves 60.7% of DukeMTMC-reID queries and 68.4% of Market-1501 queries without invoking semantic reasoning, reducing computational overhead while maintaining competitive retrieval performance.

[106] Lightweight Generalized DeepFake Face Detection with WAVIE: Wavelet Augmented Vision Intermediate Embeddings cs.CV | cs.AIPDF

Arya Pulkit, Aditya Ruhela, Akarshan Kapoor, Arnav Bhavsar

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Deepfake detection systems often exhibit significant performance degradation when deployed on unseen manipulation methods, limiting their reliability in real-world multimedia environments. This lack of generalization poses critical challenges for misinformation mitigation, digital forensics, and human-centric AI systems. Existing detectors perform well on the forgery methods they are trained on, but their accuracy drops sharply on unseen pipelines. To bridge this generalization gap, we propose WAVIE (Wavelet Augmented Vision Intermediate Embeddings), an end-to-end architecture that combines complementary spatial and frequency cues on top of a frozen CLIP backbone. WAVIE projects intermediate transformer embeddings through a lightweight learnable module, applies a three-level Daubechies-6 (db6) discrete wavelet transform (DWT), refines the low-frequency branch while preserving the high-frequency branch, reconstructs the feature via inverse DWT, and performs classification. Trained only on FaceForensics++, WAVIE achieves AUROC = 0.852 on Celeb-DF-v1, 0.852 on Celeb-DF-v2 and 0.831 on WildDeepFake (WDF) at the frame level, outperforming several state-of-the-art generalization baselines. Extensive ablation studies confirm the importance of both the wavelet module and the intermediate-feature aggregation for cross-dataset performance, highlighting the necessity of jointly leveraging spatial and frequency domains. These results position WAVIE as a strong baseline for deepfake detection in the wild.

[107] Context-Aware Mutual Learning for Blind Image Inpainting and Beyond cs.CVPDF

Haoru Zhao, Yufeng Wang, Zhaorui Gu, Bing Zheng, Haiyong Zheng

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Blind image inpainting, aiming to recover contaminated images in the case of unknown masks, is a challenging task. Motivated by the perspective of human vision and knowledge, blind image inpainting can be decomposed into two stages: mask estimation and image inpainting based on the estimated mask. The two-stage idea exhibits evident advantages in enhancing inpainting quality and augmenting the generalization capability of unknown real-world contamination by explicitly employing the estimated mask for image inpainting compared to one-stage scheme. This two-stage idea has also been intuitively implemented. However, existing two-stage methods excessively emphasize the unilateral relationship of mask estimation to image inpainting, and may overlook the mutual relations between them. Specifically, mask estimation can provide more contextual semantics for image inpainting to strengthen the understanding of semantics, and image inpainting can offer more contextual details (e.g., textures and edges) for mask estimation to improve the learning of details. In this work, we propose a novel Context-Aware Mutual Learning (CAML) framework for blind image inpainting that joints mask estimation and image inpainting to mutually exploit contextual information. In the CAML framework, we design the Inpainting-Guided Context-Mutual (IGCM) learner to acquire the complementary contextual details from image inpainting for assisting mask estimation, and the Estimation-Guided Context-Mutual (EGCM) learner to strengthen the understanding of contextual semantics from mask estimation for assisting image inpainting. Ablation studies validate the efficacy of our CAML. Extensive experiments show that our CAML achieves state-of-the-art performance on both blind image inpainting and additional vision tasks, i.e., snow removal, shadow removal, and watermark removal, indicating its superiority.

[108] From Visual Attribution to Clinical Reasoning: Explainable Parkinson’s Disease Screening from Hand-Drawn Patterns cs.CV | cs.AIPDF

Aritra Dey, Utsav Kumar Nareti, Chandranath Adak, Soumi Chattopadhyay, Krishna Gopal Sasmal

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Parkinson’s disease (PD) manifests early neuromotor impairments that become observable in controlled hand-drawn patterns such as spirals and meanders, where tremor-induced oscillations, stroke irregularity, and curvature instability reflect underlying motor degradation. In this work, we present an explainable framework for PD screening from offline hand-drawn patterns that integrates discriminative visual modeling with clinically grounded reasoning. The predictive model captures distributed structural distortions and fine-grained texture variations. It is evaluated under subject-disjoint protocols to ensure reliable generalization. To move beyond black-box classification, we introduce a multi-stage explainability pipeline that combines visual attribution with structured symptom abstraction. Salient regions are identified using attention- and gradient-based localization, followed by extraction of clinically meaningful motor descriptors quantifying contour roughness, curvature irregularity, stroke variability, and tremor-frequency energy. These descriptors are subsequently translated into coherent clinical rationales through a language-based reasoning module, linking model evidence to established PD symptomatology. By bridging visual attribution and clinical interpretation, the proposed framework advances interpretable document intelligence for neurological screening using hand-drawn patterns. Experimental results on publicly available Parkinson’s disease handwriting datasets demonstrate competitive predictive performance and clinically consistent explanations.

[109] AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video cs.CVPDF

Jiaming Tan, Mingliang Zhai, Zhen Li, Yuwei Wu, Chuanhao Li

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Interactive video world models must maintain broad scene context under camera motion while producing high-fidelity observations with low latency. Existing approaches face a representation trade-off: perspective models operate on local views and must preserve off-screen content over long rollouts, whereas broader spatial coverage is typically obtained by synthesizing full-sphere videos or constructing explicit 3D representations. Motivated by the complementary roles of global context and selective local acuity in visual perception, we present AlayaVista, a camera-controllable streaming video world model that decouples panoramic world evolution from perspective observation synthesis. Given a single perspective image, AlayaVista constructs a 360-degree scene prior using a pretrained panorama expansion model and then evolves the scene as a camera-conditioned panoramic latent state. A latent viewport renderer maps this state to the requested perspective video latents, while a perspective refiner restores details, suppresses artifacts, and performs super-resolution. To support efficient streaming, we adapt the panoramic generator to chunk-autoregressive generation and distill both panoramic generation and perspective refinement into few-step processes. To provide the supervision required by this design, we construct MUGEN, a large-scale real-world panoramic video dataset containing 1,318 hours of videos at resolutions of at least 4K, together with rich semantic and geometric annotations.

[110] DynEoMT: Learning Object Dynamicity from Online Segmentation Queries cs.CV | cs.ROPDF

Calvin Galagain, Martyna Poreba, François Goulette

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Video segmentation models recognize and track objects over time, but they do not indicate whether each segmented region moves independently of the observing camera. This dynamicity attribute cannot be inferred from semantics alone and is confounded by camera ego-motion. We introduce \method, an online framework that augments query-based video segmentation with region-level dynamicity prediction. It jointly produces the original segmentation outputs and a dynamic or static state for each predicted region. At inference, DynEoMT uses only the current frame and propagated queries, without optical flow, depth, camera pose, previous RGB frames, or feature maps. Because established video segmentation benchmarks do not annotate this attribute, we also introduce a class-agnostic offline supervision pipeline using camera-compensated optical flow and confidence-aware temporal filtering. Across VIPSeg, OVIS, YouTube-VIS 2022, and VSPW, DynEoMT achieves balanced accuracies of 84.3, 68.0, 68.6, and 87.6, respectively, while largely preserving segmentation performance. These results show that segmentation-region dynamicity can be learned from propagated queries, enabling its online prediction without a dedicated motion-processing pipeline at inference. The complete code will be released as open source to enable full reproduction of the method and experiments.

[111] PRI-Net: A Lightweight Multimodal Framework for 3D UAV Localization cs.CV | eess.SPPDF

Zhixuan Chen, Jialiang Lu, Zhong Ye, Yinghui He, Guanding Yu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Accurate 3D localization of unmanned aerial vehicles (UAVs) remains challenging for existing multimodal approaches due to sparse LiDAR geometry, modality-imbalanced fusion, and redundant feature transmission over constrained edge-to-server links. To address these limitations, we propose PRI-Net, an efficient and lightweight multimodal fusion framework for UAV localization that integrates point cloud splatting, residual attention fusion, and an information bottleneck. Specifically, a 3D point cloud splatting (3DPCS) strategy is introduced to transform sparse LiDAR observations into geometrically consistent dense depth maps. A residual attention fusion (RAF) module is then designed to alleviate modal bias by using an image branch for coarse estimation and a gated fusion branch for refinement. In addition, a multimodal information bottleneck (MIB) module compacts features by filtering task-irrelevant redundancy. Experiments show that PRI-Net achieves high localization accuracy with lightweight architectures, while reducing feature dimensionality and improving edge-to-server UAV sensing efficiency and robustness.

[112] PuzzleMate: Benchmarking MLLMs for Egocentric Puzzle Assistance cs.CVPDF

Avijit Dasgupta, Shayon Dasgupta, Zakaria Laskar, C. V. Jawahar, Karteek Alahari

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Personal AI assistants hold the potential to evolve from digital interfaces into embodied companions capable of guiding users through complex physical activities. For these assistants to become integral to daily life, they must do more than identify objects; they must provide precise, step-by-step instructions that align with a user’s real-time progress. While Multimodal Large Language Models (MLLMs) show promise in general visual understanding, their ability to deliver grounded, sequential guidance for fine-grained manipulation tasks remains largely unverified. In this paper, we choose the jigsaw puzzle as a strategic testbed for this capability. Unlike general object recognition, puzzle solving demands high-precision spatial reasoning, the ability to distinguish between minute geometric variations, and a rigorous adherence to sequential logic. We investigate this capability through PuzzleMate, a novel framework focused on jigsaw puzzle solving captured through an egocentric viewpoint. We deploy PuzzleMate in a user-in-the-loop study to evaluate how well state-of-the-art MLLMs perceive the current puzzle state and generate actionable next-step instructions. Our analysis reveals seven key bottlenecks that limit their effectiveness. Building on these insights, we propose a benchmark that enables systematic evaluation of MLLMs’ reasoning capabilities for puzzle solving. Our findings reveal a substantial performance gap in current models like GPT-5.2 and Gemini-2.5-Pro; while these MLLMs are highly capable, they struggle to navigate the intricate reasoning and sequential logic essential for jigsaw puzzle assistance.

[113] Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World cs.CV | cs.AIPDF

Guocun Wang, Kenkun Liu, Guorui Song, Jing Lin, Zhe Huang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Unified motion generation and understanding is crucial for embodied AI systems that can both synthesize and interpret human actions in open-world environments. Existing motion-language models often treat motion as an auxiliary modality of a language model, leading to text-dominated representations and limited cross-modal interaction. Moreover, the next-token prediction paradigm is not naturally suited to long motion sequences, where autoregressive generation may accumulate prediction errors. To address these challenges, we propose Open-UniMo, a unified Large Motion-Language Model (LMLM) trained on million-scale open-world motion-language data. Open-UniMo promotes modality parity by extending Qwen’s vocabulary of about 150K text tokens with 64K motion tokens, enabling motion and language to share a unified token space. We further introduce motion-consistent Chain-of-Thought reasoning as an intermediate representation to bridge language semantics and motion dynamics. Open-UniMo is trained with a two-stage pipeline, where supervised fine-tuning establishes CoT-guided bidirectional motion-language mapping and Group Relative Policy Optimization (GRPO) improves semantic alignment while mitigating cumulative errors in autoregressive motion-token generation. To support comprehensive evaluation, we propose Open-MoBench, a VLM-guided benchmark for assessing text-to-motion (T2M) generation, motion-to-text (M2T) understanding, and bidirectional consistency. Extensive experiments show that Open-UniMo achieves state-of-the-art performance on both conventional metrics and Open-MoBench. Furthermore, ablation studies reveal that M2T understanding is not primarily limited by motion-token vocabulary size; instead, coupling M2T with the learnable T2M generation path yields stronger cross-modal representations, demonstrating that generation can facilitate understanding in AR-based motion-language modeling.

[114] Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing cs.CVPDF

Yakoub Bazi, Mohamad M. Al Rahhal, Mohamed A. Mekhtiche, Mansour Zuair

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Change visual question answering (Change VQA) requires understanding semantic changes across bi-temporal remote sensing images. Although vision language models (VLMs) have shown promising performance on this task, they remain unreliable when answering questions that require explicit transition statistics, area measurements, or spatial information. To address this limitation, we propose a selective tool use framework in which a single VLM either answers directly or invokes a deterministic change analysis tool to obtain question specific evidence. Specifically, the selected tool operates on bi-temporal semantic maps and returns a structured observation, which the same VLM uses to generate its final answer. To support this framework, we construct a tool augmented extension of CDVQA covering eight question families and three tools for transition, spatial, and temporal analysis. Tool use supervision and observations are derived automatically from the original semantic annotations, without additional manual labeling. We then adapt Qwen3.5-4B using Low Rank Adaptation (LoRA) to jointly learn direct answering, tool invocation, and evidence conditioned answering. Experiments on 7,164 test questions show that selective tool use with reference semantic maps improves overall accuracy from 73.77% to 88.79% and average family accuracy from 69.11% to 89.65%. When the semantic maps are predicted automatically, the framework achieves 77.47% overall accuracy and 75.06% average family accuracy. These results demonstrate the benefit of question-specific semantic evidence for Change VQA, while highlighting the influence of semantic prediction quality on the resulting performance. Code and tool-augmented annotations will be made publicly available at https://github.com/yakoubbazi/ToolChangeVQA.

[115] Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing cs.CV | cs.AIPDF

Sehwan Park, Taehoon Kim, Geonhee Han, Dohyun Kim, Seung Wook Kim

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: While Vision-Language Models (VLMs) excel at visual reasoning, generating structured, editable Scalable Vector Graphics (SVG) remains a fundamental challenge. Existing pipelines predominantly yield flat, semantically agnostic collections of paths, where editing a single object requires manually identifying its constituent paths. To address this, we propose a VLM-driven agentic framework for semantic compositional SVG generation. Our pipeline recursively parses visual scenes into semantic and geometric hierarchies via top-down decomposition, visual grounding, and prompt-driven amodal occlusion recovery, ensuring each component is geometrically complete. Furthermore, we introduce the Semantic SVG Benchmark with human-annotated semantic groups and novel sub-component metrics (Semantic Recall/Precision, PERE) to explicitly evaluate structural compositionality and functional editability. Experiments show that our natively predicted structures surpass the upper bounds of existing flat-generation methods in both grouping quality and editability, while maintaining state-of-the-art visual fidelity.

[116] From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography cs.CV | physics.med-phPDF

Ali Abbasian Ardakani, Afshin Mohammadi, Taha Yusuf Kuzan, Beyza Nur Kuzan, Alisa Mohebbi

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Purpose: To compare four multimodal large language models (MLLMs) with radiologists of varying expertise in breast density assessment, BI-RADS assessment, biopsy candidacy determination, and continuous malignancy probability estimation using digital mammography (DM) and contrast-enhanced mammography (CEM). Methods: This study included 179 women with paired DM/CEM examinations and reference standards. Four MLLMs (ChatGPT-5.2, Gemini-3.1 Pro, Sonnet-4.6, Muse Spark) interpreted images with and without masks; three radiologists interpreted non-masked images. Results: For binary density classification on DM, radiologist accuracies ranged from 55.81% to 78.60%, exceeding most MLLM values (62.33%-71.63%), while masks added limited benefit. Five-category BI-RADS accuracies were higher for radiologists on DM (56.74-67.44%) and CEM (62.33-82.79%) compared with MLLMs (DM 31.16-45.12%; CEM 40.00-55.81%). Binary biopsy-candidacy accuracies were likewise higher for radiologists (DM 85.12-89.77%; CEM 86.98-92.09%) than for MLLMs (DM 61.39-75.35%; CEM 69.30-82.79%), although CEM improved performance across all readers. Lesion masks substantially improved MLLM continuous malignancy-probability accuracies from 64.65%-71.63% to 72.56-78.60% on DM and from 67.91%-77.21% to 72.56%-81.86% on CEM, approaching radiologist ranges (DM 63.72-82.79%; CEM 81.86-88.84%). The corresponding AUCs for the top masked models overlapped those of the human readers. Overall, Muse Spark, followed by Sonnet-4.6, demonstrated the strongest performance among the MLLMs across domains. Conclusion: Radiologists generally outperformed MLLMs in categorical tasks, while selected masked models approached human performance for continuous malignancy probability estimation, suggesting a potential adjunctive role.

Weihong Qi, Chen Ling

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Visual content shapes audience perception and opinion on social media, and computational social science increasingly relies on automated tools to analyze images at scale. Yet a measurement gap persists: existing tools rely on predefined categories or produce only coarse image-level labels, while measuring which specific objects appear in an image, how prominently, and where in the frame remains difficult at scale. We introduce Perceive, Refine, Reason (PRR), a calibrated pipeline that turns flexible vision-language detectors into auditable measurement instruments for social-scientific research. PRR combines natural-language category prompts with pixel-level spatial refinement via the Segment Anything Model (SAM) and a multimodal LLM arbitration layer whose reasoning chains externalize domain knowledge and lower the expertise threshold for human-in-the-loop validation. A complementary three-tier auditability framework applies quantification learning to profile per-category reliability, support task-aligned configuration, and statistically correct prevalence estimates. Across four vision-language detectors and nine sociological categories, the pipeline yields substantial precision gains over zero-shot baselines, including a 43.3-point improvement for the strongest backbone. Applying PRR to 103,920 Facebook images from U.S. legislators during the 2024 election cycle and linking detections to DW-NOMINATE ideology scores, we find that more conservative legislators display U.S. flags as larger visual elements, with a weaker tendency toward peripheral placement, a spatial pattern invisible to binary detection. PRR provides computational social scientists with a model-agnostic toolkit for accessible, spatially-grounded, and correctable visual measurement.

[118] CrossDistill: Balancing Quality and Diversity via Trajectory-Level Hybrid Few-Step Distillation cs.CVPDF

Yuxi Liu, Haoyu Li, Yixiang Cai, Tengxu Sun, Zekun Zhang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Few-step distillation accelerates diffusion models but must balance diversity and fidelity: trajectory-based distillation preserves mode coverage, while distribution matching sharpens samples but can reduce diversity. We show that this tension can be exploited in a noise-regime-dependent way: high-noise steps largely determine global modes, whereas low-noise steps refine local details. We propose CrossDistill, a trajectory-level hybrid distillation framework that splits the sampling trajectory at a crossover point, applies a trajectory-preserving objective on the high-noise interval and a distribution-matching objective on the low-noise interval, and couples the two stages through the crossover state. In contrast to loss-level mixing, and complementarily to training-time two-stage recipes, CrossDistill explicitly assigns complementary objectives along the noise axis, so that global branching is preserved before local statistics are sharpened. CrossDistill is a noise-level scheduling policy: PCM and DMD are plug-in instantiations, while the noise partition, crossover coupling, and objective ordering are the key design elements. Experiments on text-to-video diffusion models and qualitative image-to-video results show that CrossDistill expands the few-step quality-diversity frontier, retaining seed-level variation while achieving competitive visual fidelity.

[119] From Visual Feedback to Textual Reviews: A Multi-Agent Vision-Language Framework for Image-Grounded Review Assistance cs.CV | cs.AIPDF

Utsav Kumar Nareti, Ayush Bansal, Kumari Priya, Chandranath Adak, Soumi Chattopadhyay

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Visual feedback in the form of user-uploaded images and videos is becoming increasingly common in e-commerce platforms because it provides authentic evidence of product quality, defects, packaging conditions, and real-world usage. However, visual feedback alone often lacks the contextual explanations and subjective opinions necessary for informed decision-making, while many users provide limited textual feedback due to the effort required to compose detailed reviews. To bridge this gap, we introduce image-grounded review assistance, a novel task that aims to generate editable review drafts from user-uploaded product images. Unlike conventional image captioning, which focuses on objective visual description, the proposed task requires product-specific understanding, sentiment estimation, and evidence-driven review composition under challenging real-world conditions, including degraded image quality, excessive zoom-in, target ambiguity, and partial product visibility. We propose a multi-agent vision-language framework consisting of four specialised roles: product grounding, visual sentiment estimation, visual evidence generation, and review synthesis. The framework employs explicit intermediate representations, including product entities, predicted ratings, and evidence summaries, to improve interpretability and visual grounding. Experiments on a curated subset of the Amazon Reviews Electronics dataset demonstrate the feasibility of generating coherent, product-aware, and sentiment-aware review drafts from visual feedback. To the best of our knowledge, this is the first study to formulate image-grounded review assistance as a multi-agent vision-language reasoning problem, providing a practical step toward AI-assisted review authoring in e-commerce systems.

[120] Zero-shot video highlight detection based on text descriptions and synthetic images cs.CVPDF

Michal Byra, Alberto Presta, Grzegorz Stefanski, Krzysztof Arendt

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Detecting video highlights, the most informative or engaging moments in a video, is important for applications such as video summarization and content recommendation. We propose a zero-shot framework that combines CLIP, large language models (LLMs), and diffusion models. Given lightweight video metadata, such as a title or category, an LLM generates textual descriptions of likely highlight events. These descriptions are further converted into synthetic visual prototypes using a diffusion model. Textual and visual representations are matched to video frames using CLIP, enabling frame-level highlight detection without highlight annotations or dataset-specific training. Experiments on TVSum and SumMe demonstrate strong zero-shot performance, with particularly favorable results on TVSum. The proposed approach provides an effective framework for metadata-conditioned zero-shot video highlight detection.

[121] MoVT: Video-Augmented Motion Tokenizer for Text-to-Motion Generation cs.CVPDF

Beibei Jing, Tianle Guo, Youjia Zhang, Zikai Song, Yawei Luo

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Text-driven 3D human motion generation models face significant challenges in responding to diverse and unconstrained textual prompts, primarily due to the limited availability of 3D motion training data. To address this, we introduce MoVT, a novel framework that effectively leverages the extensive range of human action videos to enhance text-to-motion generation. At the core of our approach is the cross-modal augmented motion tokenizer, which projects discrete 3D motion tokens into the 2D domain. This projection allows us to enrich the motion codebook with complex, real-world motion patterns derived from videos. The enriched discrete tokens are then mapped back to the 3D domain, resulting in aligned 3D and 2D codebooks with an enhanced capacity to represent intricate motions. These enhanced codebooks are integrated into a generative masked transformer, which predicts masked motion token indices in a modality-agnostic manner. This enables the use of text-index pairs, generated from the 2D codebook and annotated motion videos, to further enhance the generator. Extensive empirical evaluations show that MoVT performs favorably against prior state-of-the-art methods across multiple key metrics.

[122] PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models cs.CV | cs.ROPDF

DeepCybo Team, Yu Bin, Haipeng Cao, Zheng Chang, Kai Chen

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We present PhysBrain 1.5, a unified model for understanding physical environments, generating actions, and predicting future states. Motivated by the physical loop of observation, interaction, and environmental change, we bring these capabilities into a common learning framework. Starting from a general vision–language model, we encode language responses, end-effector motion, and dense visual targets as discrete sequences and jointly optimize them with autoregressive next-token prediction. Pre-training draws its embodied supervision entirely from human interaction videos, using task-centered episodes to pair semantic and spatial context with recovered motion and subsequent observations. We then adapt the model through supervised fine-tuning on a mixture of human demonstrations, robot trajectories, and simulated experience. Across 28 embodied understanding benchmarks, our 8B model achieves an average score of 72.5, setting a new open-source state of the art and performing on par with leading proprietary models such as GPT-6-Astra and Gemini 3.6 Flash. It achieves the best open-source results on 14 benchmarks while retaining general multimodal capabilities. Beyond these understanding evaluations, qualitative examples show the model’s ability to produce end-effector trajectories and predict future scenes through spatially aligned RGB, depth, and robot-mask outputs.

[123] G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity cs.CVPDF

Shuo Zhang, Xin Su, Wei Wang, Jun Liu, Xinrui Zeng

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We study relative position encoding for multi-view vision Transformers under camera heterogeneity, including varying fields of view (FoVs) or projection models. Existing rotary relative position encodings commonly use image-plane positional coordinates, producing projection-dependent relative phases and inconsistent geometric cues for cross-projection attention. We introduce G-ray, a ray-level relative position encoding whose rotary phases are parameterized by camera-local ray angles. The same camera-local ray pair induces the same relative phase across projections, providing projection-invariant positional consistency. G-ray can be used directly or integrated with existing encodings, retaining complementary geometric cues without additional learned parameters. We validate G-ray in three host encodings, RoPE, GTA, and RayRoPE, across 3D reconstruction and novel-view synthesis (NVS). Across three heterogeneous 3D reconstruction benchmarks at 50 views, G-ray leads all six averaged metrics and reduces mean pointmap relative error by 45.8% over MapAnything, with calibration supplied to both. Trained exclusively on homogeneous pinhole images, the 3D reconstruction model handles mixed pinhole and non-pinhole inputs without retraining and remains competitive on homogeneous pinhole 3D reconstruction protocols. For NVS, GTA and RayRoPE improve with G-ray under joint viewpoint and FoV variation. The project’s webpage is available at https://g-ray-project.github.io/.

[124] TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals cs.CV | cs.LGPDF

Zihan Xue, Po-Yi Lu, Serhii Honcharenko, Zih-Ching Chen, Hsuan-Tien Lin

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: In-context learning (ICL) enables models to infer tasks from demonstrations, but existing benchmarks generally lack matched text and image versions needed to compare ICL performance across modalities. We introduce TwinICL, a procedurally generated benchmark providing such pairs for controlled comparison. Across six open-weight models and 38 tasks, multimodal ICL consistently underperforms text-only ICL, with gaps varying by task family. To test whether this gap can be recovered, we target visual access, task framing, and reasoning through three interventions. Their combination recovers strong multimodal ICL performance on a diagnostic subset, despite limited or inconsistent individual effects. To distinguish difficulties in executing tasks from those in inferring them, we evaluate models with explicit task instructions, revealing a modality gap even when the task is known. We then examine how adding demonstration inputs and outputs reshapes this gap, highlighting demonstrations’ dual role as additional context to process and evidence about the task. The dataset is available at https://github.com/lab-flair/TwinICL.

[125] Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras cs.CVPDF

Hanzhang Tu, Zhanfeng Liao, Wei Min, Jiajun Zhang, Yebin Liu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Live free-viewpoint visualization of real humans is critical for immersive communication and interactive digital experiences. Existing methods either rely on computationally expensive optimization or require calibrated cameras and low-resolution inputs, making real-time high-resolution deployment impractical. In this work, we present Tele360, the first real-time feed-forward system for dynamic human reconstruction and live free-viewpoint visualization from sparse, unposed RGB streams. Our system jointly estimates camera poses and reconstructs a dynamic 3D Gaussian representation for each time instance in a single forward pass. To achieve this, we start by designing a lightweight sparsity-aware multi-view transformer backbone that tokenizes foreground human regions while preserving global context through a shared scene token. We then employ a fully transformer-based Gaussian decoder to mitigate convolution-induced over-smoothing while keeping decoding sparse and efficient. In addition, we introduce a hybrid feature pyramid that injects multi-scale appearance cues into geometry prediction. We further introduce a lightweight differentiable Levenberg-Marquardt camera refinement layer to enhance multi-view consistency and geometric alignment. Moreover, to stabilize learning under sparse, unposed inputs, we transfer multi-view geometry priors from a large visual-geometry foundation model via teacher-student distillation. Finally, the predicted Gaussian maps are streamed with video codecs to remote devices for interactive free-viewpoint rendering. Extensive experiments show that Tele360 achieves state-of-the-art visual quality on studio benchmarks while supporting real-time 2K input-to-rendering at over 25 FPS on a single consumer GPU. Additional captured sequences illustrate its performance across varied subjects, clothing, and motions under our multi-camera setup.

Jianhe Zhao, Yanhua Qiu, Zhiyu Zhang, Zibo Zhao, Jinhua Xie

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Continuous-environment vision-and-language navigation (VLN-CE) requires interpreting natural-language instructions in unseen 3D environments and executing continuous low-level actions. Existing methods often depend on LiDAR, panoramic cameras, or extra sensors; separate geometric-mapping and semantic-navigation visual representations can cause long-trajectory spatial-semantic inconsistencies. We propose LG-VLN, a monocular zero-shot framework with shared visual features and LangGraph-based state orchestration. An online feed-forward 3D reconstruction network predicts depth, camera poses, and dense point clouds for agent-pose estimation and global map fusion. Geometry and navigation share dense CleanDIFT features: semantic consistency rejects incorrect inter-frame correspondences, while target-instance constraints define visual references whose similarity combines with local BLIP-2 image-text relevance to form a semantic value map. LangGraph represents instruction parsing, geometric perception, semantic value updates, path planning, action execution, and failure recovery as a directed state graph with conditional transitions, persistent state, and modular recovery mechanisms. On a fixed 550-episode subset of the R2R-CE val-unseen split, LG-VLN achieves 21.3% success and 12.1% success weighted by path length. Ablations show shared semantic features improve navigation, further boosted by combining visual similarity and image-text relevance. Results establish shared visual representations and explicit state orchestration as effective for zero-shot VLN-CE using monocular RGB alone. Code will be publicly released for reproducibility.

[127] AdaVSkip: Adaptive Visual Token Skipping Across Layers For Efficient MLLMs Inference cs.CV | cs.AIPDF

Yuyao Sun, Tao Deng, Shuang Li, Deqing Wang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal large language models (MLLMs) require substantial computation to process numerous visual tokens across all transformer layers. Most methods for efficient MLLM inference exploit horizontal redundancy by compressing visual tokens. Beyond token reduction, recent studies exploit vertical redundancy through early exit or fixed-layer skipping. However, we find that the extent and distribution of this redundancy vary across inputs and differ between self-attention and MLP modules. Motivated by these observations, we propose AdaVSkip, which equips each layer with two lightweight routers that independently determine whether visual tokens pass through by or skip the self-attention and MLP modules. These decisions collectively define an input-specific visual-computation path, but their discrete and non-differentiable nature makes learning effective paths challenging. To address this challenge, we develop a progressive two-stage training framework that updates only the routers while keeping the backbone frozen. Stage I establishes an initial routing policy through supervised training with input-specific targets derived from module-wise necessity scores. To further align the routing policy with task performance, Stage II uses reinforcement learning to optimize routing decisions with direct feedback from generated answers. It combines an answer correctness reward with a skip-consistency reward that discourages excessive retention of visual-token computation. Across three MLLM backbones, AdaVSkip maintains strong task performance with substantially less computation. On LLaVA-NeXT-7B, AdaVSkip reduces FLOPs by 53.2% while preserving the original model’s average performance. Combining it with visual token compression increases this reduction to 91.2%, while retaining 97.2% of the original performance on average.

[128] SparseTalk - Sparsifying 3D Gaussian Language Fields for Efficient 3D Visual Question Answering cs.CV | cs.LGPDF

Davit Soselia, Joseph JaJa, Amitabh Varshney

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: 3D Gaussian language fields provide an explicit, spatially grounded representation for 3D visual question answering (VQA), but their dense semantic features can require tens of thousands of embeddings per scene, resulting in substantial storage, memory, and inference costs. We investigate how much of this representation is actually necessary for downstream reasoning. Starting from a full embedding representation, we systematically sparsify its semantic embeddings, including the previously underexplored regime below a single image-equivalent block down to 8 visual tokens. We compare random, geometric, semantic, and joint spatial-semantic selection strategies and introduce an object-based sparsification method that distributes the token budget across detected object instances while retaining background context. Experiments on ScanQA and MV-ScanQA reveal substantial redundancy in dense Gaussian language fields. Strong VQA performance is retained with only a few hundred semantic embeddings, corresponding to less than 1% of the original representation. Object-based selection performs well relative to others, with only modest observed changes down to 256 tokens. At this budget, SparseTalk retains 0.80% of SplatTalk’s 32,076-token inference input and 0.332% of the mean 77,207-Gaussian dense field, increasing inference throughput while reducing decoded-feature memory 125-fold.

[129] Weakly Supervised Spatial Grounding for Discriminative Attention-Based Ultrasound-Histopathology Alignment in Prostate Cancer Grading cs.CVPDF

Obed Korshie Dzikunu, Emma Willis, Mohammad Mahdi Abootorabi, Mohamed Harmanani, Zhuoxin Guo

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Unpaired cross-modal distillation transfers grade structure from histopathology into a micro-ultrasound (micro-US) encoder by aligning a pooled needle-region embedding to a frozen histopathology teacher under grade-group correspondence alone. A single objective is thereby required to serve two distinct functions: rendering patch features discriminative of tissue state, and selecting which patches enter the pooled representation. We decouple them. Weak spatial supervision derived from percentage involvement, recorded routinely at biopsy, constrains the predicted proportion of malignant tissue within each core, acting on the encoder features independently of the alignment objective. The alignment loss then operates on features that differ across a core, and attention concentrates on a subset of patches rather than remaining near-uniform. On 7,166 biopsy cores from 811 patients across seven centers under patient-level 5-fold cross-validation, the method reaches 67.1 macro AUC and 68.5 csPCa AUC, against 61.2 and 52.8 for the existing unpaired alignment method and 63.1 and 62.6 for the strongest unimodal baselines. Ablation against existing attention regularizers designed to prevent attention-uniformity collapse shows that such regularizers do not substitute for label-derived supervision: they constrain the attention distribution, whereas the signal required acts on the features that attention reads.

[130] PACE: Progressive Angular-to-Norm Contrastive Embedding cs.CV | cs.AI | cs.CL | cs.LGPDF

Yanping Li, Wei Zhou, Yawen Liu, Yibo Wang, Ke Zhu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal embedding models encode heterogeneous inputs into a shared embedding space, enabling efficient similarity computation across modalities and tasks. Most existing methods optimize cosine-based contrastive objectives, which promote stable training but restrict semantic compatibility to angular geometry, precluding embedding norms from serving as an additional semantic signal. However, directly optimizing the more expressive dot-product similarity, which leverages both angular and norm information, underperforms cosine-based training and exhibits unstable training dynamics. We attribute this discrepancy to premature optimization-space expansion, manifested as angular–norm entanglement and directional anisotropy in the representation space and further compounded by full-parameter fine-tuning. In this paper, we propose PACE, a two-stage framework that progressively expands both the representation and trainable parameter spaces. Stage I combines cosine-based objective with low-rank adaptation to establish a reliable angular geometry within constrained optimization spaces. Stage II switches to dot-product similarity and full-parameter fine-tuning, enabling embedding directions and norms to jointly encode semantic information. We further introduce Focal Embedding Loss, a confidence-adaptive objective that downweights queries with high positive retrieval confidence while emphasizing ambiguous queries with competitive negatives. Experiments across multiple backbone scales and diverse multimodal embedding tasks consistently validate the effectiveness of PACE.

[131] GRAVA: Grounded Reasoning-to-Action Representation and Learning for Autonomous Driving cs.CV | cs.ROPDF

Xiao Liu, Haoyu Li, Jianghao Leng, Lin Wang, Chao Sun

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Driving vision-language-action (VLA) models increasingly reason before acting, but their intermediate reasoning is often weakly grounded in physical scene evidence and loosely connected to executable behavior. We present GRAVA, a framework built around Grounded Reasoning-to-Action (GRA), which unifies grounding, reasoning, and action generation in a single autoregressive stream. GRA links action-relevant language references to 2D visual regions and ego-centric physical states, organizes object interactions and decisions in a trajectory-anchored typed graph, and serializes this structure into grounded reasoning. A single VLM generates this reasoning followed by a compact Executable Planner action that is deterministically decoded into a continuous trajectory. We further introduce an agentic GRA data construction pipeline that combines forward scene grounding with backward trajectory anchoring, and use it to build GR-NavSim with 2.2M grounded question-answer pairs and 70K GRA reasoning traces. A progressive training strategy develops grounded cognition through pre-training, establishes the reasoning-to-action interface through imitation, and improves driving behavior through reinforcement learning and exploration. Using about 60% of the available human driving demonstrations for action supervision, GRAVA-8B achieves state-of-the-art performance among purely autoregressive driving models on the full NAVSIM benchmark. On an internal long-tail benchmark, full GRA improves key-object compliance and Closed-loop Driving Score by 19.3% and 20.5% over action-only prediction, respectively. These results show the benefit of preserving action-relevant physical evidence from grounded reasoning through executable action generation.

[132] Does Attention-Guided Masking Really Help Object Discovery in Object-Centric Learning? cs.CVPDF

Youliang Tao, Yanhua Han, Bin Zhao, Juho Kannala, Joni Pajarinen

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Object-Centric Learning (OCL) aims to decompose images into objects without human annotations. A major family of mainstream methods uses Slot Attention to aggregate image features into object-level representations and then from them reconstructs masked image content, i.e., Random Masking (RM), to provide self-supervision. The recent method DIAS simply masks image patches at uniform randomness yet achieves competitive object discovery accuracy. Since attention during aggregation already possesses object discovery ability, we explore using it to develop a better image patch masking strategy, i.e., Attention Guided Masking (AGM), thereby providing better self-supervision. Results on six recognized datasets show that AGM does not always outperform RM. Under unconditional slot initialization, AGM substantially improves background segmentation on datasets with realistic textures (COCO and VOC); Regardless of conditional or unconditional slot initialization and across datasets, foreground object discovery remains comparable or decreases. We suggest peer researchers in the OCL community that attempts to exploit internal attention semantics to improve OCL with masked decoding are risky. Our source code, model checkpoints and evaluation logs will be released upon acceptance.

[133] Reconstructing Is Not Acting: Action-Centric Latent Dynamics Modeling cs.CVPDF

Dingjie Fu, Dianxing Shi, Yangyang Xu, Jun Yu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Latent action models (LAMs) learn action representations from unlabeled videos by inferring latent actions from visual transitions and reconstructing future states. However, we identify a fundamental $\textbf{reconstruction-action mismatch}$: lower reconstruction error does not necessarily yield better latent dynamics or downstream performance. We attribute this mismatch to two underconstrained aspects of reconstruction-based latent dynamics modeling: (i) the inverse dynamics model (IDM) is not explicitly encouraged to distinguish action-related transitions from nuisance appearance, and (ii) the forward dynamics model (FDM) can underutilize the inferred latent action by exploiting predictive shortcuts from the current state. To address both limitations, we propose $\textbf{ACT-LAM}$, a lightweight action-centric framework that strengthens both action extraction and action utilization. Specifically, its Action Query IDM (AQ-IDM) employs learnable action queries and gated aggregation to selectively extract rich action-related transition cues without strong information bottlenecks. And its Action Token FDM (AT-FDM) projects latent actions into action tokens that progressively interact with evolving state representations, enabling continuous state-aware action conditioning. ACT-LAM further streamlines feature processing to concentrate model capacity on latent dynamics modeling. Extensive experiments on several robotic datasets and the VP$^2$ benchmark demonstrate stronger latent action consistency, forward dynamics, and downstream visual planning performance with fewer trainable parameters and lower computational overhead. In particular, ACT-LAM surpasses the previous state of the art by $\textbf{7.6%}$ on the aggregated VP$^2$ success rate. Codes at $\href{https://github.com/DingjieFu/ACT-LAM}{url}$.

[134] Long-to-Short Video Evidence Reasoning for Grounded Question Answering cs.CVPDF

Kaiyan Chen, Junbin Xiao, Xun Yang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We present LOVER, a \underline{L}ong to sh\underline{O}rt \underline{V}ideo \underline{E}vidence \underline{R}einforced model for grounded question answering (GQA). LOVER highlights three innovations over existing reinforcement-learning (RL) based video reasoning models: (1) \textbf{Long-to-short Video Evidence Curriculum Learning}, which organizes RL training according to evidence duration and progressively adapts the model from long-range grounding to short-term reasoning; (2) \textbf{GQA Rewards}, which underscore the benefit of IoP reward over IoU for evidence spotting rather than strict temporal span overlap; (3) \textbf{Adaptive Timestamp Rendering}, which adaptively renders timestamps onto video frames using background-aware position and color selection to enhance temporal observability. The three designs are model-agnostic and reciprocal. They effectively improve QA, grounding, and grounded QA performance over different backbones. Notably, LOVER built on Time-R1 achieves new state-of-the-art (SOTA) results among open-source models on popular GQA benchmarks: NExT-GQA and ReXTime. Comprehensive ablation studies further validate the effectiveness of our three innovative components.

[135] Unsupervised Point Cloud Registration via Training-Time Semantic Guidance cs.CVPDF

Kezheng Xiong, Shiyun Xu, Sheng Ao, Siqi Shen, Cheng Wang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Unsupervised registration of large-scale LiDAR point clouds remains challenging due to the geometric ambiguity inherent in outdoor scenes, which degrades pseudo-label quality and leads to suboptimal convergence, particularly for sparse, low-resolution scans such as those from nuScenes. We reveal that registration models intrinsically encode semantic awareness that strongly correlates with registration accuracy, albeit without explicit semantic supervision. However, this native awareness is fragile: noisy supervision arising from geometric ambiguity in unsupervised settings rapidly erodes the learned semantic structure, causing performance collapse. To this end, we propose CAESAR, a teacher-student framework guided by an off-the-shelf 3D segmentation model exclusively during training. We observe that potential inlier matches are often buried just beneath a few spurious neighbors in the noisy feature space, motivating Dual-Cue Guided Re-Matching to recover them through reselection rather than simply rejecting. Building on this, a train-only Semantic-Geometric Label Mining performs lightweight, batch-specific teacher refinement and mines reliable pseudo-labels under semantic guidance. We further introduce Semantic Predictive Distillation to consolidate the student’s semantic awareness in the feature space. Extensive experiments on KITTI and nuScenes demonstrate state-of-the-art performance, with pronounced gains on the challenging nuScenes benchmark. Crucially, CAESAR incurs zero inference overhead and requires no semantic annotations on the registration data. Code will be released.

[136] Closed-form Bayesian homography estimation from noisy point correspondences cs.CV | stat.MEPDF

Hanne Beuter, Sebastian Dorn

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: While homographies are fundamental to many computer vision tasks, the majority of conventional estimation techniques provide only point estimates without directly quantifying uncertainty introduced by noisy observations. Uncertainty, though, propagates to subsequent processing steps such as camera calibration and 3D reconstruction and is particularly relevant in safety-critical and socially relevant fields including medical imaging, autonomous driving, and defense. We present a fast Bayesian formulation for homography estimation from point correspondences that explicitly incorporates measurement uncertainty and prior knowledge while providing a posterior distribution over the homography parameters. A closed-form solution of the posterior mean of the homography is derived in homogeneous coordinates and supplemented by an iterative Bayesian approach to handle non-linearities. Synthetic experiments demonstrate the applicability to projective transformations and show improved estimation accuracy over DLT under varying noise conditions. Image stitching experiments further demonstrate applicability to real image correspondences while additionally providing uncertainty information.

[137] Pre-PEFT Probing: Weight Statistics and Perturbation Robustness for Layer Selection in VLM Vision Encoders cs.CV | cs.AIPDF

Qingtao Xia, Jiahua Bao, Siyao Cheng, Jie Liu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We propose a pre-fine-tuning probing method for Parameter-Efficient Fine-Tuning (PEFT) layer selection, aiming to obtain more stable and higher gains with fewer trainable parameters when adapting large vision–language models (VLMs). Unlike the common practice of applying LoRA and other adapters to all layers at once—where layer selection often relies on heuristic rules—we focus on the vision encoder and directly evaluate the “adaptability’’ of each Transformer layer. Specifically, we characterize each layer from two perspectives: (i) the statistical properties of its Q/K/V projection weights (e.g., norms and condition numbers); (ii) robustness under controlled parameter perturbations. We then systematically compare these indicators with the downstream performance gains brought by applying PEFT to a single layer. Across experiments covering seven benchmarks and five PEFT variants, we observe a consistent correlation: layers (or matrices) with larger weight norms and higher condition numbers are usually more robust to perturbations and are more likely to yield larger fine-tuning gains. These results show that distribution-statistics analysis and perturbation tests before fine-tuning can provide practical signals for adaptation-layer selection, thereby maintaining or improving performance while reducing trainable parameters.

[138] A 25-$μ$s/inf Event-driven Graph Neural Network Processor with Spatiotemporal Caching and Spline Convolution for Ultra-low-latency AI at the Edge cs.CV | cs.ARPDF

Adrian Kneip, Martin Lefebvre, Daniel Gehrig, Victoria Catalán Pastor, Davide Scaramuzza

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Dynamic-vision-sensor (DVS) cameras generate events on a per-pixel basis with a $μ$s-level temporal resolution, calling for new algorithm-hardware co-design approaches compared to standard frame-based vision. While event-driven graph neural networks (EV-GNNs) emerge as a promising algorithmic solution, they raise new HW challenges by mixing dense-regular compute operations and sparse-irregular memory accesses. We present ETHEREAL, the first EV-GNN accelerator that scales to 640$\times$480 resolutions, thanks to a neighbor-parallel spline convolution engine and a 2D/3D-split memory hierarchy with a novel region-of-interest spatiotemporal caching mechanism. Measurement results demonstrate end-to-end inference with 25.6$μ$s latency and 1.7$μ$J energy per event on state-of-the-art workloads

[139] AlignUS: MRI-Guided Ultrasound Representation Learning for ALS Classification from Tongue Images cs.CVPDF

Kadija Abdel Ghader, Emani Babe, Lorenzo Pettinari, Meya Haroune, Sidaty El Hadramy

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Amyotrophic lateral sclerosis (ALS) is a progressive neurodegenerative disease in which early assessment remains challenging, particularly in low-resource settings where MRI is often unavailable. High-resolution ultrasound (HRUS) of the tongue offers a portable and low-cost alternative for evaluating bulbar involvement, but learning reliable diagnostic models is limited by small datasets and the difficulty of extracting robust representations from ultrasound alone. We propose AlignUS, a cross-modal knowledge distillation framework that transfers anatomical knowledge from MRI to a HRUS-based classifier while requiring only HRUS at inference time. The model combines classification loss, supervised contrastive learning, and feature-level distillation to align HRUS representations with MRI embeddings. AlignUS achieves a patient-level balanced accuracy of 0.958, macro-F1 of 0.963, and ROC-AUC of 0.990, aggregated across four patient-level cross-validation folds, with consistent improvements over HRUS baselines and cross-modal alternatives. These results demonstrate that MRI-derived supervision can substantially improve ultrasound-based ALS assessment while preserving low-cost, inference-time independence from MRI.

[140] Learning from Reliable Negatives: Confidence-Anchored Test-Time Adaptation for GUI Grounding cs.CVPDF

Yizhou Liu, Fei Tang, Yuchen Yan, Zhengxi Lu, Songqin Nong

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Graphical User Interface (GUI) grounding is essential for autonomous agents to map natural language instructions to precise screen coordinates. However, existing supervised fine-tuning and reinforcement learning methods are constrained by the high cost of annotation, creating a scalability bottleneck. In this paper, we introduce a label-free test-time training paradigm driven by two key insights: (1) confidence patterns in coordinate tokens are a better indicator than full-sequence confidence, and (2) in sparse GUI coordinate spaces, negative samples offer more reliable learning signals than potentially noisy positive ones. We first propose Confidence-Anchored Learning (CAL), which utilizes coordinate-token confidence to filter pseudo-labels and assign distance-based binary rewards. Building on this, we develop Confidence-Anchored Negative Learning (CANL), which exclusively optimizes the model using negative samples to bypass the risks of incorrect positive samples. Experimental results demonstrate that CANL-7B achieves 92.1% on ScreenSpot-V2. On more challenging ScreenSpot-Pro, CANL-7B reaches 33.8%, an 8.9% absolute improvement over the base model. Our findings establish coordinate-token confidence as a powerful alternative to manual annotations for scalable GUI agent development.

[141] Hypergraph-Regularized Gramian Volumes for Multimodal Retrieval cs.CVPDF

Anindya Nag, Ambuj Mehrish, Sebastiano Vascon

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Volume-based multimodal retrieval jointly scores a text query with a candidate’s video, audio, and subtitle embeddings. While this approach captures higher-order within-candidate alignment, the score remains candidate-local, and semantically related training samples primarily serve as contrastive negatives. This work introduces Hypergraph-Regularized Gramian Volumes (HyVol), a training-time module that incorporates these semantic relations prior to evaluating the original volume loss. Document hyperedges connect the observed modalities of each candidate, whereas semantic hyperedges link candidates whose detached captions are mutual top-k neighbors. A shallow gated hyper-graph network applies residual corrections to the modality embeddings. Presence masks exclude unavailable streams from message passing, and identity padding preserves the determinant of the observed Gram submatrix without feature imputation. As refinement operates on embeddings rather than scores, the same construction applies to both Gram and HyperGram. We remove the hypergraph after training, leaving the backbone-only architecture, original scoring function, and retrieval cost unchanged. We train both backbones on a 150K-clip subset of VAST-27M and evaluate zero-shot performance on six benchmarks. Under the paired protocol, HyVol improves R@1 across all five retrieval benchmarks, with video-to-text gains reaching +8.3 on MSR-VTT and +7.6 on VATEX. Under missing-modality masking, the V2T margin remains positive in all experimental settings, although the T2V margin becomes slightly negative in four.

[142] Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation cs.CV | cs.AI | cs.LGPDF

Xinyue Xu, Hongbin Lin, Juangui Xu, Hualiang Wang, Lehan Wang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Medical imaging modalities such as ultrasound and X-ray are widely used in clinical practice, where diagnosis follows a structured, evidence-driven workflow aligned with standardized criteria. While multimodal large language models (MLLMs) show promise for automated medical report generation, most existing systems rely on end-to-end multimodal fusion without modeling clinically defined intermediate attributes, leading to limited grounding and interpretability. To address this issue, we propose CORAL (COncept-grounded ReAsoning with Localization), a multimodal framework that integrates spatial grounding and concept-level supervision into a unified reasoning process. CORAL employs a prompt-driven medical segmentation model to localize lesions and predicts multi-class clinical attributes through a Concept Bottleneck module. The resulting textual concept tokens are combined with mask-modulated visual features within an MLLM to enable structured report generation and diagnostic prediction. Experiments on BUS-CoT and IU X-ray datasets demonstrate consistent improvements in diagnostic accuracy, concept consistency, and report quality over strong general-purpose and medical MLLMs, indicating that concept-grounded reasoning better aligns generation with clinical decision processes.

[143] Query-Conditioned Spherical Centroid Aggregation for Multimodal Retrieval cs.CVPDF

Ambuj Mehrish, Anindya Nag, Sebastiano Vascon

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal retrieval integrates video, audio, subtitles, and text; however, recent geometric aggregators, such as Gramian volumes, hyperbolic volumes, and spectral objectives, treat all modalities symmetrically. Under a unified evaluation protocol, their joint scores frequently lag behind the strongest single-modality pathway by 1.9 to 27.6 R@1. Controlled analyses attribute this outcome to uniform modality influence. This work introduces Spherical Centroid Aggregation with Learned Adaptive Relevance (SCALAR), a query-conditioned aggregator that assigns relevance-based weights to each available modality before computing a spherical centroid. SCALAR accommodates arbitrary modality subsets and is trained on masked, reduced-arity views using rank-8 LoRA adapters. Across five benchmarks, SCALAR achieves positive aggregation gain on four, reaching +4.0 R@1, while none of the evaluated prior aggregators is positive on more than one. A uniform-weight ablation reproduces the degradation observed with symmetric aggregation. With only 4.8 million trainable parameters, SCALAR attains the highest text-to-video R@1 on three and performs within seed variation of the best result on a fourth. Under test-time modality dropout, SCALAR’s representation-stage score surpasses the released GRAM checkpoint at every evaluated masking rate and benchmark by 3.2 to 10.9 R@1. Finally, as modalities are removed, rerankers trained exclusively on complete modality sets increasingly converge toward their video-only pathways, diminishing these representation-level gains and underscoring a limitation of standard two-stage retrieval pipelines.

[144] Robust Multi-Model Fitting through Learning Neighbor Regions cs.CVPDF

Chang Nie, Guangming Wang, Zhe Liu, Hesheng Wang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multi-model fitting involves fitting multiple models accurately in a noisy environment. It is the basis for computer vision tasks such as scene reconstruction and mixed reality. However, its performance is often limited by insufficient feature utilization, inefficient optimization, model overlap, and the non-differentiable pipelines. To overcome these limitations, we introduce a robust coarse-to-fine framework called Learning Neighbor Regions (LNR). Recognizing that substantial computational resources are wasted on numerous bad minimum sets, we propose the coarse-level module. This module utilizes a neural network to extract and analyze geometric feature of both local point-wise relationships and global contextual information in minimum sets, outputting confidence to pre-select a small number of good minimum sets, thereby enhancing overall efficiency before solving hypotheses. To address model overlap, LNR encodes neighbor region features for each hypothesis in its fine-level module. These region features consist of geometric features of neighboring data points, which can be used by multiple regions simultaneously. This design allows the neural network to individually refine and score each hypothesis. Importantly, LNR is trained to learn directly from data point features rather than from the hypothesis parameters, thus avoiding differentiating the sampling process and the model solvers. Extensive experiments on four classic multi-model fitting tasks demonstrate that LNR achieves state-of-the-art performance. The analysis suggests that LNR can be easily adapted to various robust multi-model fitting tasks.

[145] CapsuleMotion: A Lightweight Real-Time Visual Motion Predictor for Capsule Endoscopy cs.CVPDF

Oliver Bause, Julia Werner, Oliver Bringmann

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Video Capsule Endoscopy (VCE) is a non-invasive medical examination that allows for the observation of the small intestine, which is otherwise difficult to access. A fundamental challenge persists in the form of their limited size in order to still be swallowable. The resulting restricted battery capacity, however, contradicts with the power-intensive nature of image capture and transmission. Therefore, we propose CapsuleMotion, a patient-specific dynamic capsule behavior that utilizes the available energy in a goal-oriented manner to increase the likelihood of a complete screening of the gastrointestinal tract. By investigating and combining metrics from the on-device image compression, CapsuleMotion predicts the motion between two successive frames. The camera’s frame rate will be modified in accordance with the predicted magnitude of motion. Furthermore, prior to entering the small intestine, the capsule operates in a low power mode with a significantly reduced frame rate. In this mode, the LocalizationNet is employed to determine the current organ, provided that motion was predicted. The proposed framework is evaluated on the Rhode Island VCE dataset and deployed on an ultra-low power single-core RISC-V demonstrator with an integrated hardware accelerator. CapsuleMotion demonstrated the capability to reduce electric energy consumption by up to 20.66% in comparison with conventional capsules that lack a dynamic frame rate. Additionally, the accuracy of detecting the entry point of the small intestine has been improved.

[146] MarKey: Marginal Utility Guided Greedy Keyframe Selection for Long Video Understanding cs.CV | cs.CLPDF

Hongchang Shi, Jinpeng Hu, Ao Wang, Wenzheng Zhou, Hui Ma

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Long-video understanding remains challenging for multimodal large language models (MLLMs) because densely encoding long frame sequences is computationally expensive, while uniform sampling under a limited visual budget can miss sparse yet decisive evidence. Recent training-free keyframe selection methods have enabled more efficient inference and yielded promising performance gains. However, many existing methods score frames largely in isolation without explicitly considering how each candidate complements the currently selected subset, potentially resulting in redundant selections and incomplete evidence coverage. To address this limitation, we propose MarKey, a training-free framework that formulates keyframe selection as subset-aware greedy optimization. At each iteration, MarKey scores each candidate using a tractable surrogate that jointly accounts for query relevance, marginal coverage gain, and context-dependent redundancy, and selects the frame with the highest utility. To make this iterative subset-aware evaluation efficient, MarKey uses a compact set of representative anchors to approximate full-video coverage and a bounded window of previously selected frames to limit context-dependent comparisons. Experiments on six benchmarks spanning holistic video understanding, human-centric video understanding, and open-ended video understanding demonstrate that MarKey consistently outperforms existing methods. Further analyses show robust gains across different MLLM backbones, model scales, and frame budgets.

[147] ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentation cs.CVPDF

Qiangqiang Zhou, Wenjun Tang, Yong Chen, Dandan Zhu, Jiawei Xu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Open-vocabulary camouflaged object segmentation (OVCOS) aims to segment unseen camouflaged objects under text guidance. We observe that SAM3 still suffers from a pronounced semantic gap between global textual semantics and fine-grained pixel-level visual cues in OVCOS. Meanwhile, fully fine-tuning the text encoder introduces heavy parameter overhead and risks overfitting to training categories, which compromises open-vocabulary representation flexibility. To address these issues, we propose ViCo-SAM3, a Vision-Conditioned alignment framework designed for OVCOS. Specifically, we introduce vision-conditioned (ViCo) module, which dynamically modulates text embeddings with global visual context, enabling textual representations to adapt to the current image content and thereby effectively bridging the semantic gap between vision and text. Building on this, we further design a vision-conditioned cross-modal binding (ViCoBind) module to enhance cross-modal interaction and semantic alignment between visual and textual representations. Without bells and whistles, ViCo-SAM3 achieves state-of-the-art performance on the OVCamo benchmark and demonstrates strong generalization.

[148] A Conservative OCR-Enabled Workflow for R214 Sodium Screening of South African Packaged Foods cs.CV | cs.AIPDF

Mayimunah Nagayi, Alice Scaria Khan, Tamryn Frank, Rina Swart, Clement Nyirenda

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Using food package images to monitor sodium and salt content against South Africa’s R214 sodium limits is challenging when screening decisions require product identity, nutrition facts panel evidence, reporting basis, and category-specific thresholds. This study presents a conservative image-based workflow that combines region detection, optical character recognition (OCR), product identity and sodium evidence extraction, R214 category assignment, deterministic threshold comparison, and independent vision language model comparison. The evaluation used 442 packaged food products and 3 929 full package images from a real-world South African food packaging dataset. A YOLO26s small detector generated 4 195 region crops, and strict post-processing produced one sodium evidence row per product. The integrated workflow produced 290 OUTSIDE R214 SCOPE, 139 REVIEW, seven SCREEN-PASS, and six SCREEN-FAIL outcomes. The independent Qwen2.5-VL 7B vision language model workflow produced 387 OUTSIDE R214 SCOPE, 31 REVIEW, twenty SCREEN-PASS, and four SCREEN-FAIL outcomes. The workflows agreed on exact R214 category assignment for 415 of 442 products (93.9%) and on whether the assigned category was within R214 scope for 416 of 442 products (94.1%). Final screening outcome agreement was 307 out of 442 products, or 69.5%. Manual verification on 60 products showed lower strict outcome agreement than regulated status agreement, while all manual INSUFFICIENT DATA cases were kept out of SCREEN-PASS and SCREEN-FAIL by both automated workflows. The findings show that conservative image-based screening can organise package evidence, identify clear cases, and assign uncertain cases to REVIEW rather than forcing SCREEN-PASS or SCREEN-FAIL decisions.

Shengjie Jin, Zelong Sun, Hengbo Xu, Yanbiao Ma, Zhiwu Lu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Vision-Language Models (VLMs) enable autonomous GUI navigation, but agents still struggle to process and learn from dense, continuous visual histories. This bottleneck hinders both immediate error correction within a single episode (intra-trial) and experience distillation across multiple attempts (cross-trial). We trace these challenges to an empirical informational asymmetry in GUI navigation: while expected transitions can often be compressed into lightweight textual summaries, unexpected outcomes benefit from preserved screenshots as causal evidence for accurate diagnosis. Building on this insight, we propose AnchorGUI, a unified framework driven by the Cognitive State Anchor (CSA). The CSA acts as a per-step primitive that actively compares expected and observed transitions, converting passive multimodal trajectories into explicit prediction-error signals. These signals orchestrate a dual-scale learning mechanism via an asymmetric memory. For intra-trial correction, a sliding window selectively retains visual evidence for detected mismatches, providing immediate, visually-grounded feedback. For cross-trial distillation, this asymmetric memory focuses the computationally expensive credit assignment search space on likely failure steps. Experiments across four benchmarks validate the effectiveness of our approach. On AndroidWorld, AnchorGUI achieves a 57.3% success rate with a $2.4\times$ token reduction per step. Furthermore, cross-trial distillation reaches 69.2% success (+11.9% gain), significantly outperforming standard reflection methods while maintaining sub-linear context scaling.

[150] CatchMonitor: a machine learning system for automated fish discard quantification cs.CVPDF

Geoff French, Michal Mackiewicz, Mark Fisher, Helen Holah, Rebecca Lamb

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We report on the continued development of CatchMonitor, resulting in a prototype computer vision system designed to automatically quantify discarded fish from video footage collected from Remote Electronic Monitoring (REM) systems on fishing trawlers. The analysis of trawler surveillance footage is a challenging problem due to the real-world conditions on board fishing vessels. Building on our prior work we improve the accuracy of species identification through the application of semi-supervised learning. We utilise a simple and robust object tracking approach, upon which we build our prototype discard quantification system. Finally we analyse the variability of manual discard quantification performed by multiple expert human analysts, using it as a benchmark against which we compare the performance of our system.

[151] BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender cs.CVPDF

Yolo Y. Tang, Daiki Shimada, Jiayue Meng, Jing Bi, Pinxin Liu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal agents can create complex videos in software such as Blender by coding without relying on diffusion models. Yet video understanding benchmarks still evaluate models mainly through question answering. If an agent truly understands a video, it can reconstruct it programmatically. We introduce BVB, Blender-VideoBench, a benchmark that tests this ability by asking agents to reconstruct real-world videos as animated Blender scenes. To ensure fair comparison, each agent programs the reconstruction through a lightweight harness, Mini-BVB, in an identical sandbox under a shared cost limit. The benchmark renders each reconstruction from its animated camera and evaluates it on two axes: (1) Dual VQA measures how many spatiotemporal facts the reconstruction preserves. (2) Latent Similarity measures how closely the reconstruction matches the source video perceptually. Our overall score, a square-root mean, favors balanced performance. We evaluate 51 configurations from 10 model families and analyze semantic retention, perceptual similarity, reasoning effort, and cost. The best model reaches 88.6 Latent Similarity but retains only 53.7% of the source-correct spatiotemporal answers. Additional reasoning improves visual similarity but does not close this gap in factual accuracy. In a blind study with 15 raters and five configurations, Latent Similarity correlates strongly with human preference. These results show that programmatic reconstruction is a viable test of agentic video understanding, and that semantic retention remains the main challenge.

[152] PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection cs.CV | cs.AI | cs.MMPDF

Bo Zheng, Kangran Zhao, Xiaoyu Zhang, Weinan Guan, Zhiheng Li

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: As generative models continue to advance, AI-generated content (AIGC) is becoming increasingly realistic, weakening the artifact cues commonly exploited by existing detectors. Nevertheless, faithfully reproducing the physical behavior of real-world events remains challenging for current generators. We therefore explore detecting AIGC by assessing whether the depicted event satisfies measurable constraints derived from physical laws. We introduce PIVOT, a physics-grounded AIGC detector, instantiated here for audio-video clips, that estimates physical quantities from video and audio, selects physical laws relevant to each clip, and verifies their measurable constraints. Beyond a real/fake decision, PIVOT returns supporting evidence that records the verification outcome, relevant time window, and supporting quantities for each applicable law. Although instantiated and evaluated here on audio-video data, the framework can, in principle, extend to other AIGC modalities whenever the physical quantities required for verification can be estimated reliably. We also introduce PhysForensics-Bench, comprising paired real and generated audio-video clips from nine event-centric scene families and two recent audio-video generators. On PhysForensics-Bench, PIVOT achieves 70.30% accuracy and 64.29% F1 score on Real+Seedance, and 72.16% accuracy and 65.82% F1 on Real+VEO. In comparison, direct inspection with Gemini 3.1 Pro obtains 53.96% accuracy and 60.09% F1 on Real+Seedance, and 57.22% accuracy and 63.44% F1 on Real+Veo. These results demonstrate the practical promise of physical-consistency verification as a structured and inspectable source of evidence that complements artifact-based AIGC detection.

[153] What a gated sensing pipeline never looks at: bandwidth reduction and the misses behind it cs.CVPDF

Raghu Venkat, Tricha Anjali

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: An airborne sensor on a contested link cannot send video, so the appealing move is to send findings instead and report the ratio between the two. We evaluate a gated sensing pipeline that does this, combining learned object detection and image-text comparison with deterministic scheduling, gating, evidence accumulation and transmission rules. On staged footage with the semantic stage live it sends 38,736 bits over 211 s, a reduction of 41,977x, and names 1 of 4 staged events with no false report. That detection has since been superseded: a correction to how the tracker measures speed removed the measurement artefact the normality model had been learning from, and the flight no longer warms. Under the corrected code the pipeline names 1 of 7 staged events across four flights, and we report both. On a control flight where nothing was staged it reports nothing, a reduction of 155,830x: the largest number in the study and the least informative, because a reduction ratio measures the scene. The mechanisms that produce the reduction also decide which observations ever reach a decision, so the two cannot be reported apart. We give a tick-level trace of one flight (3,187 rows) that places each of three missed events at the stage where it stopped progressing: one produced no track, one failed the structural place test at 0.129, and one passed 539 structural ticks but reached only 3.192 against a boundary of 3.807. We also report one instance of a known failure mode, an online normality model absorbing the object it will later judge, measured against the threshold that object then failed. The evidence is one detection and six misses across four staged flights, beside one clean control, and we treat it as a case study. We give the reproduction protocol and generated results, identify which supporting artifacts are not distributed, and state which experiments did not run.

[154] A Unified Vision-Language Model for PSMA PET/CT Report Generation, Visual Question Answering, and Lesion Segmentation cs.CV | cs.AIPDF

Yang Xing, Jiong Wu, Savas Ozdemir, Yang Zhou, Boxiao Yu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Accurate PSMA PET/CT interpretation is central to prostate cancer management, yet existing PET/CT AI models typically address isolated tasks. We propose a unified PSMA PET/CT vision-language model for report generation, visual question answering, and lesion segmentation. The framework adopts an LLaVA-style architecture, comprising a PET/CT vision encoder, an MLP-Mixer projection module, a LoRA-tuned large language model, and a 3D segmentation branch. Training followed a four-stage strategy: vision encoder pretraining, projection-layer alignment, VLM fine-tuning, and final multitask tuning. Language tasks used 5,747 PSMA PET/CT datasets with paired reports, while segmentation used the PSMA subset of AutoPET. The model outperformed PET2REP and a CT-based baseline across standard report-generation metrics, improved performance across VQA question types, and achieved higher Dice and lesion-level overlap F1 than SegAnyPET and nnUNet. These results support the feasibility of a unified framework for structured, interactive, interpretable PSMA PET/CT analysis with voxel-level grounding within a single multitask model architecture.

[155] ModaLens: Measuring Image Sensitivity in Report-Conditioned Medical VLMs cs.CV | cs.AIPDF

Sebastián Andrés Cajas Ordóñez, Maximin Lange, Quang Bui, Anqi Peter Li, Felipe Ocampo Osorio

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: A radiology report can already answer a clinical question, so it is hard to tell whether a vision-language model also uses the image. ModaLens, a paired image-swap audit, measures how report availability changes image sensitivity: MedGemma-27B on 3,199 paired MIMIC-CXR cases from 293 patients, all 14 questions per case (13 finding-specific and one composite), each image replaced by one from another study, usually of the same patient, with question and report fixed. Under an explicit answer instruction, the model’s generated answer changes on 4.26 percent of trials with the report and 20.94 percent without it, a paired increase of 16.7 points (patient-clustered 95 percent CI 15.6 to 17.7), so report availability reduces image-swap sensitivity under this protocol; the original prompt with a lowercase first-token readout gives 4.70 percent against 17.07 percent, and substitutions also move continuous answer scores where the binary prediction does not change. The labels are derived from reports, which limits conclusions about visual correctness; the direction replicates in two further model lineages. Code, the exact prompts and a run record for every number are at https://github.com/criticaldata/MODALENS.

[156] VideoScout: Learning Agentic Active Exploration with Adaptive Reasoning Pacing for Long Video Understanding cs.CV | cs.AIPDF

Weixin Xu, Zhenyu Yang, Bing Wang, Shengsheng Qian, Changsheng Xu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress on short video understanding yet remain limited on long videos due to the limited visual context window. Prevailing approaches rely on uniform frame sampling or recent coarse-to-fine agentic zooming, both of which struggle to localize sparse, decisive evidence in sufficiently long videos. We formulate long video understanding as a \textbf{Sequential Evidence Acquisition (SEA)} problem, in which an agent reads the video turn by turn along the temporal axis, deciding at each turn how fast to watch, what evidence to retain, when to revisit uncertain segments, and when to stop and answer. Inspired by this view, we propose \textbf{VideoScout}, a multi-turn reasoning agent that instantiates the SEA paradigm through adaptive reasoning pacing. Specifically, by dynamically controlling the viewing pace, VideoScout enables efficient traversal of long videos within a bounded visual context window, allowing the agent to access more video content while balancing content analysis depth with reading efficiency. To train VideoScout, we construct VideoScout-66K, a set of over 66K high-quality exploration turns from 10K answer-verified trajectories, and adopt a two-stage pipeline: cold-start supervised fine-tuning teaches the agent per-turn output format, while the Decoupled Clip and Dynamic sAmpling Policy Optimization (DAPO) algorithm performs trajectory-level reinforcement learning with a composite reward that jointly considers answer accuracy, output format compliance, and the temporal alignment between the agent’s viewing progress and the teacher’s answer timing measured by intersection-over-union (IoU). Extensive experiments on long video understanding and reasoning benchmarks demonstrate that our 7B model achieves strong performance compared with existing trained 7B agentic models.

[157] Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models cs.CV | cs.CLPDF

Alessandro Gambetti, Qiwei Han

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Long-text image–text congruence scoring is increasingly important for vision-language systems that must evaluate whether detailed textual descriptions match visual content. However, raw similarity scores from dual-encoder models are difficult to interpret as calibrated congruence measures, especially under the modality gap between image and text embeddings. This paper proposes Congruency Score (CS), a lightweight calibration layer that maps image–text similarity evidence into a bounded score. Using DOCCI and Urban1k, we evaluate four frozen vision-language backbones and show that observed reductions in post-projection centroid distance do not uniformly improve image–text retrieval performance. Human-grounded evaluations on DOCCI further reveal a trade-off: direct post-hoc calibration preserves high association with human judgments, whereas selected projection-based configurations can reduce threshold-relevant slope and intercept distortions at the cost of retrieval performance and association strength. These results establish long-text image–text congruence scoring as a calibrated score-estimation problem, where retrieval performance, human association, and threshold calibration must be evaluated as distinct objectives. CS provides a lightweight way to expose and operationalize this separation.

[158] From Model Patterns to Abstract Semantics in Compositional Zero-Shot Learning cs.CVPDF

Weize Li, Zhicheng Zhao, Fei Su

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Compositional Zero Shot Learning aims to recognize unseen compositions by recombining learned primitives. Recent methods rely on vision language models and attempt to explicitly model contextual variations of primitives through multiple representations. However, such approaches are limited by fixed variant capacity and competition between abstract and concrete semantics. In this work, we present a new perspective that views primitive variations as the context-driven activation of concrete visual cues rather than independent entities. Based on it, we propose CLEAR, a CLoze-style rEAsoning-based Re-ranking framework inspired by human perceptual processes. CLEAR extracts conditional variants from the primitive candidate set in a coarse-to-fine manner, performs cloze-style reasoning to infer high-level semantics, and re-ranks predictions to correct biases toward salient concrete primitives. Extensive experiments demonstrate that CLEAR consistently improves the Base Model and outperforms state-of-the-art methods on the challenging C-GQA and MIT-States datasets. Code is available at https://github.com/buptLwz/CLEAR.

[159] Circuit-MLLM: Topological Logic-Guided Latent-Space Visual Reasoning for Circuit Schematic Understanding cs.CV | cs.AI | cs.LGPDF

Jinyuan Deng, Yuqi Jiang, Wenjing Huang, Xin Li, Qi Sun

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Through pre-training on extensive text and image datasets, current multi-modal large language models (MLLMs) achieve strong performance on general tasks. However, circuit schematics present a unique challenge for MLLMs due to their dense component layouts and distinct topological logic, demanding fine-grained structural parsing to extract the electrical semantics. To address this, we propose Circuit-MLLM, a multimodal reasoning framework that reformulates circuit topology analysis as a process of device localization, path tracing, and sequential reasoning within the latent space. We introduce a circuit knowledge mining mechanism that deeply aligns the model’s latent representations with structurally rich features derived from multi-granularity circuit vision experts, enabling the model to effectively internalize topological semantics. Building upon these internalized semantics, we devise a topology-guided sequencing strategy that decouples reasoning from the rigid raster-scan order, enforcing stepwise inference along the circuit’s topological logic in latent space. Across diverse circuit analysis tasks, Circuit-MLLM consistently outperforms strong baselines, notably achieving a 25% higher average score than GPT-5.1, which demonstrates the effectiveness of our framework in circuit schematic topology analysis. Code is publicly available at https://github.com/IC-Yuan/Circuit-MLLM.

[160] Benchmarking Intra-Patient 3D Deformable Multimodal Image Registration cs.CV | cs.AIPDF

Matteo Barbieri, Giammarco La Barbera, Juan Pablo De La Plata, Sabine Sarnacki, Isabelle Bloch

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Multimodal image registration is a key component of many clinical workflows, yet it remains challenging because corresponding anatomical structures often exhibit substantially different image intensities across modalities. In this work, we present a comprehensive benchmark of intra-patient 3D multimodal deformable registration methods across three datasets covering different anatomical regions and difficulty levels, including both synthetic deformation recovery and real clinical scenarios. We evaluate classical optimization-based approaches and modern learning-based methods, including recent deep learning and foundation models, using complementary metrics: Average Dice similarity coefficient (DSC), average 95th-percentile Hausdorff distance (HD95), and a modality-independent structural similarity measure based on the MIND self-similarity context (MIND-SSC). Results show high variability across datasets, with learning-based methods demonstrating superior performance on large synthetic benchmarks, while only limited improvements are observed in real pelvic registration. A key finding of this study is the consistent disagreement between geometric metrics (DSC, HD95) and image-based similarity metrics (MIND-SSC), highlighting that improved overlap does not necessarily imply better global multimodal correspondence. Furthermore, anatomy-guided approaches achieve the highest overlap scores but exhibit degraded performance outside of segmented regions, revealing a trade-off between label-driven alignment and global structural coherence. Overall, our results indicate that no current method achieves robust performance across anatomies and modalities. We demonstrate that intra-patient 3D multimodal registration requires multi-criteria evaluation, including deformation-based metrics, and remains an open problem.

[161] Don’t Send What You Don’t Need: Question-Guided Token Pruning as a Privacy Defense for Vision-Language Models cs.CV | cs.AI | cs.CRPDF

Md Khalid Syfullah, Alvi Ataur Khalil

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Visual Question Answering (VQA) with Vision-Language Models (VLMs) is increasingly used in privacy-sensitive and bandwidth-constrained settings. Federated Learning (FL), Split Learning (SL), and U-Shaped Split Learning (USL) keep raw data local, but transmitting all visual tokens across a model partition remains costly and can expose private information. We propose QPriv-VL, a question-guided, privacy-aware token-pruning framework for FL, SL, and USL that prunes visual tokens before transmission based on task utility and privacy sensitivity. Its core component is a lightweight Dynamic Threshold Predictor (DTP) that jointly estimates a sample-specific pruning ratio and a token-level retention mask in one forward pass. DTP combines question relevance, computed from cross-modal similarity between visual patches and the pooled question embedding, with a sensitivity signal derived from frozen DINOv2 features. This allows the model to suppress potentially sensitive regions while preserving patches useful for answering the question, without requiring sensitivity labels. We evaluate QPriv-VL on GQA, OK-VQA, VQAv2, SLAKE, VQA-RAD, and PathVQA against four privacy attack families: FSHA, FORA, iDLG, and attribute-inference membership inference attacks. DTP matches or outperforms fixed-ratio pruning while using substantially fewer transmitted tokens. On VQA-RAD, it reduces membership-inference attack success from 0.99 to 0.76-0.79, lowers FSHA and FORA reconstruction PSNR relative to fixed-ratio pruning, and preserves competitive VQA accuracy using about 40% of the original visual-token budget. A sensitivity exclusion ratio of 1.20 +/- 0.18 indicates preferential removal of privacy-sensitive patches, while explainability analysis shows that retention adapts to question semantics rather than generic visual saliency.

[162] MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery cs.CVPDF

Shuaiyu Chen, Wei Han, Peng Ren, Chunbo Luo, Zeyu Fu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Accurate marine pollution detection (MPD) is essential for protecting coastal ecosystems and marine biodiversity. Vision Mamba models have shown promise in remote-sensing semantic segmentation by efficiently capturing long-range dependencies and global context, yet their potential for MPD remains underexplored. MPD is particularly challenging because of low signal-to-noise ratios, fragmented pollution patterns, and indistinct boundaries caused by the visual similarity between pollutants and the surrounding sea. To address these issues, we propose MambaMPD, an enhanced Mamba-based framework incorporating two complementary structural priors: Frequency-Aware Augmentation (FAA) and multi-scale Edge-Guided Attention (EGA). FAA integrates wavelet transforms into the encoder to decompose features into multi-scale frequency subbands, enabling the model to capture low-frequency contextual semantics and high-frequency structural details needed to identify small, low-contrast, and irregular pollution patterns. EGA adaptively fuses hierarchical, Laplacian-derived boundary cues with deep semantic representations, refining encoder features before decoding to sharpen boundaries and reduce ambiguity in visually confusing, spatially fragmented scenes. Together, these modules improve sensitivity to subtle pollution signals while preserving fine boundary structures. A U-Net-style decoder with squeeze-and-excitation attention and deep supervision progressively restores and refines semantic and spatial information across scales. Extensive experiments on two benchmark MPD datasets show that MambaMPD achieves higher mIoU than competing methods while requiring substantially less computation than foundation-model-based approaches. On MADOS, it improves F1 by 3.6% over OSDMamba; on M4D, it raises Oil Spill IoU by 6.82% over TransOilSeg.

[163] V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments cs.CVPDF

Ziqian Fan, Shibo Xu, Junjie Li, Xiangyu Zhao, Shengyuan Ding

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: While In-Context Learning (ICL) enables models to adapt from exemplars without parameter updates, multimodal ICL remains largely underexplored, particularly regarding video demonstrations in interactive environments. For multimodal agents, learning from videos presents unique challenges: they must translate in-context demonstrations into executable policies, ground these policies in novel visual states, and iteratively refine actions based on environmental feedback. We introduce V-ICAL, a novel benchmark designed to evaluate video-based ICL for multimodal agents. Comprising 342 interactive tasks across 37 environments, V-ICAL utilizes human-curated demonstration videos as task-specific behavioral exemplars, evaluating agents through sustained interaction from a target initialization. The benchmark seamlessly connects in-context knowledge induction with core agentic capabilities, including state grounding, temporal memory, planning, and adaptation in dynamic environments. Extensive evaluations across 19 state-of-the-art multimodal agents reveal significant limitations: the best-performing model, Seed-2.1-Pro, achieves a score of only 54.4/100, while other leading models (e.g., Gemini-3.1-Pro, GPT-5.6) fail to surpass 50, far below the human baseline of 83.6. Controlled comparisons further demonstrate that current agents struggle to reliably translate video exemplars into effective policies, failing to yield consistent performance gains. Ultimately, V-ICAL exposes a critical gap in the ICL capabilities of multimodal agents, underscoring an urgent need for future research.

[164] VC-Attention: Value Smoothing and Softmax Casting for Low-bit Attention cs.CVPDF

Xingyang Li, Dongyun Zou, Shining Zhang, Jiacheng Chen, Haocheng Xi

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Diffusion Transformers deliver state-of-the-art video generation, but their long spatiotemporal sequences make attention the dominant deployment cost, and a deployable low-bit kernel must be accurate and fast. Accuracy is limited by outliers: a block’s quantization scale is set by its largest entries, leaving typical entries confined to a narrow range of representable values. Prior work smooths queries and keys, but value outliers follow no fixed channel or spatiotemporal structure and remain the dominant source of output error. Speed is limited by softmax: low-bit Tensor Cores accelerate only the two matrix multiplications, so the high-precision exponential between them becomes the longest pipeline stage on datacenter GPUs. We propose VC-Attention, a training-free low-bit attention framework that addresses both by pairing Value smoothing with a fused probability Cast. V-Smooth reorders value tokens by lightweight online clustering, so the tokens in a hardware block quantize well together. It quantizes only the residual after subtracting the block mean, and restores that mean from the row sum the online softmax already maintains. ExpCast-FP8 maps log-domain scores directly to E4M3 probability codes with one fused multiply-add, eliminating the FP32 exponential and the format conversion. We implement VC-Attention for B200, B300, H200, RTX PRO 6000, and RTX 5090. Across Wan2.2, LongCat-Video, HunyuanVideo-1.5, and MiniMax-H3, VC-Attention improves fidelity over low-bit baselines, speeds up the attention kernel over BF16 FlashAttention-4 by 1.46-1.59x on datacenter Blackwell and Hopper and by 2.3-3.6x on workstation cards, and generates a clip 1.13-1.19x and 1.36-1.70x faster end to end.

[165] Integrating Multi-view Multi-light Surface Reconstruction into Cultural Heritage Workflows cs.CVPDF

Baptiste Brument, Robin Bruneau, Benjamin Coupry, Vincent Demoulin, Jean Mélou

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Cultural heritage documentation increasingly relies on image-based 3D surface reconstruction, with photogrammetry software making such workflows accessible to archaeologists, conservators, and heritage technicians. These tools have been successful for conventional multi-view acquisition, but they do not routinely exploit richer multi-view, multi-light data, despite its potential for improving fine-scale surface reconstruction. This limitation is particularly relevant in heritage contexts, where controlled-light acquisition devices such as RTI domes are already used to capture illumination-varying image sets. The challenge is therefore to connect these existing acquisition practices with recent computer vision methods in a form that can be used within operational heritage workflows. In this work, we address this need by integrating state-of-the-art components from computer vision for multi-view, multi-light surface reconstruction into Meshroom, an open-source photogrammetry framework. Rather than proposing a new reconstruction algorithm, our contribution is to assemble and expose existing advanced methods, namely a complete photometric stereo ecosystem (calibrated, self-calibrated and universal), automatic object masking, and multi-view normal-and-reflectance integration, within a usable heritage-oriented workflow. The proposed system thus provides an intermediate software layer between computer vision research code and practical cultural heritage applications, making recent techniques easier to use and evaluate.

Xiaofeng Mao, Peijia Lin, Shaohao Rui, Yibo Zhang, Haibin Wan

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Video diffusion models are stochastic and hard to control: precise content often requires repeated sampling without guaranteed success, and long-horizon scenes drift in appearance, interactions, and temporal coherence. Agentic visual creation provides explicit references, editable 3D scenes, or executable game states for stable control, but does not by itself guarantee high object or character fidelity. Combining the two can enable stable, high-quality generation. To realize this combination, we present LynnReal-Omni, a native multimodal video generation framework built on a 32B shared multimodal diffusion transformer that unifies text-to-video, image-conditioned generation, reference-guided generation, structural control, editing, degraded video restoration, and long-video generation. It accepts heterogeneous visual inputs, including appearance references, editable 3D renders, and game recordings, allowing agents to compose visual conditions within a unified model. We also train a dedicated 27B Flash shared multimodal diffusion transformer for real-time rendering. We build a systematic data pipeline for video cleaning, subject association, multimodal annotation, and aligned control construction, yielding a curated corpus of multi-shot audiovisual segments, and introduce MSAVP, a 100-prompt, 20-metric evaluation design that separates instruction following, generating plausibility, visual quality, temporal behavior, and audio coordination. LynnReal-Omni-Flash further reduces inference cost through model and decoding acceleration, including a lightweight VAE decoder; on one H100, warm generation and decoding of a 22-frame 540p video take 843 ms with LynnReal-Omni and 377 ms with Flash. These results provide a foundation for real-time streaming video generation, making LynnReal-Omni a unified, controllable, and efficient basis for agentic visual creation.

[167] Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer’s Disease Classification from Structural MRI cs.CV | cs.AIPDF

Paul-Gabriel Nicolae, Irina Georgiana Mocanu

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Deep networks trained on structural MRI for Alzheimer’s disease (AD) staging often reach reasonable accuracy while attending to anatomically irrelevant regions, and multimodal models that add clinical tables frequently rely on variables that were used to assign the diagnostic label in the first place. We study both issues with a deliberately lightweight slice-based encoder (ResNet18 with a one-layer Transformer over slices) on 1,075 baseline T1-weighted scans from ADNI-1. First, we use FastSurfer segmentations as an anatomical reference: YOLOv8 models trained on segmentation-derived labels localize Alzheimer-relevant structures with mAP_50 above 0.96, and a Grad-CAM comparison shows that the image-only classifier frequently attends to the skull, orbits and background. Second, we adapt a CLIP-style image - tabular contrastive framework and organize ADNIMERGE variables along a label-leakage spectrum. Fusion with cognitive scores yields 87.3% three-way accuracy, which we treat as a leakage-driven upper bound rather than an imaging result; fusion with regional volumes yields 73.0%. We observe that the choice of contrastive target changes what the image encoder learns: on MCI vs. CN, the image-only head reaches 52.4% when the encoder is aligned to cognitive scores and 73.8% when aligned to volumes, although no tabular input is used at inference. Third, restricting the input to a per-subject crop of the medial temporal lobe raises image-only three-way accuracy from 58.7% to 65.1%. All results come from single runs on a small balanced test set, and we report confidence intervals and the protocol differences that prevent direct comparison with published numbers.

eess.IV [Back]

[168] Deformable 2D Gaussian Splatting for Efficient 4K Video Compression eess.IV | cs.CVPDF

Chenhao Zhang, Fengqing Zhu

[172] From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity eess.SP | cs.AI | cs.CV | cs.IT | cs.LGPDF

Yu Ma, Zhen Gao, Li Qiao, Xiaoyuan Zhang, Mahdi Boloursaz Mashhadi

[175] Exploring Multimodal Turn-Taking Cues in Face-to-Face Conversation using Voice Activity Projection eess.AS | cs.CL | cs.SDPDF

Willem Berner, Julio Cesar Cavalcanti, Kalle Åström, Gabriel Skantze

[184] FedV-KGQA in Practice: Design Lessons and an Interactive Prototype cs.AI | cs.CL | cs.IRPDF

Md Saikat Islam Khan Bappy, Oshani Seneviratne

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Knowledge graph question answering usually assumes that one system can reach the whole graph. In practice, facts are often held by organizations that share entity identifiers but own disjoint relation types, so no single party sees a complete reasoning chain. This poster presents the empirical findings of FedV-KGQA on multi-hop question answering over such vertically partitioned graphs. Each silo enriches its local graph and trains a knowledge graph embedding on its own triples. A server then concatenates the silo-specific entity views, anchors the projected question at the topic entity, and ranks candidates by similarity. Raw triples and relation embeddings never leave a silo. Comparing the FedV-KGQA experiments with one another yields three results. First, federated fusion recovers most of the centralized accuracy, while a single silo recovers little. Second, anchoring and enrichment matter more than the choice of embedding model. Third, the cheapest encoder depends on the target accuracy rather than on parameter count. This poster paper contributes that cross-experiment comparison, four design lessons drawn from it, and an interactive prototype that runs real inference and traces the full pipeline, per question, on released checkpoints.

[185] VeriDx: Earning the Right to Diagnose with Disease-Centric Verification cs.AI | cs.CLPDF

Zhong Cao, Shuying Chen

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: A correct diagnosis can still be reached for the wrong reasons. In clinical reasoning, every disease hypothesis creates obligations: key evidence must be checked, alternatives must be ruled out, contradictions must be resolved, useful tests must be considered, and closure must be justified. Current evaluations of medical LLMs mostly focus on final answers, local steps, or isolated facts, and therefore miss these hypothesis-induced commitments. We introduce \textbf{VeriDx}, a disease-centric verification framework that links free-form diagnostic reasoning to structured disease profiles. VeriDx tracks whether each hypothesis is satisfied, unresolved, or violated its clinical obligations, exposing failures such as missing critical tests, unresolved differentials, ignored contradictions, unsupported claims, and premature closure. We instantiate VeriDx for complex respiratory diagnosis using guideline-derived disease profiles and expert-annotated longitudinal cases. Our results show that many diagnostic errors are not isolated mistakes, but broken commitments made earlier in the reasoning process.

[186] Question’s Gambit: The First Move Matters in Agentic Deep Search cs.AI | cs.CL | cs.IRPDF

Radin Hamidi Rad, Amin Bigdeli, Negar Arabzadeh, Sajad Ebrahimi, Charles L. A. Clarke

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Deep research agents answer complex questions through iterative loops of searching, reading, and reasoning. Recent work on reasoning-intensive benchmarks such as BrowseComp-Plus shows that well-configured lexical retrieval can surface high-quality evidence, yet agents may still fail to connect documents carrying evidence to the gold documents. We identify a deep research agent’s first retrieval move as an important design decision for this setting. We introduce Question’s Gambit, a first-move retrieval module that decomposes the question into a set of clues, reformulates them into complementary searches, consolidates the retrieved results, and reranks the candidate pool before the agent begins its iterative search-and-reasoning process. This produces an opening context designed to support both clue aggregation and final-answer verification. We further evaluate on MultiHop-RAG to test whether these benefits transfer beyond BrowseComp-Plus to a more conventional multi-hop question structure. Experiments on BrowseComp-Plus show that Question’s Gambit improves retrieval recall and downstream agent accuracy over strong baselines, improving answer accuracy from 83.1% to 90.5% with gpt-5.5 over Pi-Serini, the strongest reported agentic baseline. Our results confirm that effective agentic deep research depends not only on the tools available inside the loop, but also on the quality of the first move. We published our implementation publicly at https://github.com/radinhamidi/Question-s-Gambit.

[187] Self-Orchestrating Language Models: Leveraging Semantic Dependence for Efficient Inference cs.AI | cs.CLPDF

Tian Jin

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Large language models (LLMs) demonstrate impressive capabilities, but their deployment presents significant efficiency challenges. Autoregressive decoding imposes substantial inference latency and under-utilizes hardware accelerators in low batch size regimes. Discrete diffusion models can generate in parallel but struggle to match autoregressive quality without many diffusion denoising steps. Long-context reasoning creates memory bottlenecks that strain even state-of-the-art accelerators. My thesis is that language models can direct their own inference execution strategy by annotating semantic dependence – which tokens depend on which others – in their generation. I call such models self-orchestrating language models. For each system, I design a runtime that acts on these annotations to parallelize autoregressive decoding, evict intermediate context, or derive denoising orders, achieving Pareto-optimal quality-efficiency trade-offs. I demonstrate this approach through three self-orchestrating systems. First, PASTA uses semantic dependence to parallelize autoregressive decoding, training the model to annotate which output chunks can generate independently. Second, TIP uses semantic dependence to evict intermediate reasoning steps from the KV cache, reducing memory consumption while preserving accuracy. Third, Planned Diffusion uses semantic dependence to derive a denoising order for discrete diffusion, autoregressively generating a plan that specifies which chunks to denoise in parallel.

[188] Converting Sequenced Fuzzy Cognitive Maps to Causal Virtual Worlds with Large Video Generators cs.AI | cs.CL | cs.IRPDF

Akash Kumar Panda, Olaoluwa Adigun, Bart Kosko

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We show how users can create and manipulate causal virtual worlds with large-language-model (LLM) and large-video-model agents. The approach uses feedback fuzzy cognitive maps (FCMs) both to model the granular causal structure of the virtual world and to guide its causal evolution. The local causal rules are partial or fuzzy while the FCM’s feedback structure produces global equilibria that define causal scenarios. A sequence of \emph{dynamical} meta-rules of the form ``If $\mathcal{A}$ then $\mathcal{B}$” define the causal scenes of the virtual-world video. The if-part causal pattern $\mathcal{A}$ perturbs the FCM’s virtual world at the user’s or agent’s discretion. The FCM’s transient feedback dynamics define the meta-rule’s causal arrow of implication. The then-part $\mathcal{B}$ is the resulting equilibrium attractor such as a FCM limit cycle or fixed point. Our algorithm extracts these meta-rules from the FCM and guides the LLM agent to write a script based on the FCM meta-rule sequence. The large video generator converts the meta-rule into a video scene in accord with the flow of the dynamics. We applied the agent-based technique to a simple FCM that describes an undersea world of dolphins and sharks. Google’s Gemini 3.1 generated the script and Google’s Veo 3.1 generated the dolphin-shark video. The approach is general and can scale by mixing larger FCMs and AI agents to produce more immersive virtual worlds.

[189] Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings cs.AI | cs.CLPDF

Mingzhou Jiang, Peixi Wu, Hang Cheng, Yunhao Zhou, Biao Yang

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Universal multimodal embedding (UME) learns unified representations across modalities, enabling a single model to support diverse retrieval tasks. Recent methods use Chain-of-Thought (CoT) reasoning to better interpret multimodal inputs before generating embeddings for complex retrieval tasks and further optimize this reasoning process through GRPO with retrieval-based rewards. However, two limitations hinder corpus-scale deployment. GRPO assigns all CoT tokens the same advantage, without identifying input-supported claims or evidence that distinguishes the positive from negatives. Moreover, generating a complete CoT before each embedding introduces substantial latency, even when a partial trace already provides sufficient retrieval evidence. To address these limitations, we propose Reason What Matters (ReWAM), a retrieval-grounded reasoning framework that uses retrieval feedback to guide both credit assignment and reasoning computation. Specifically, we introduce Retrieval-aware Self-Distillation (RASD), which constructs privileged guidance from input-supported evidence that distinguishes the positive item from retrieved hard negatives. An on-policy self-teacher uses this guidance to refine trajectory-level feedback into token-specific supervision for retrieval-relevant reasoning. We further develop Retrieval-adaptive Inference (RAI), which uses a retrieval confidence head to estimate the remaining retrieval utility of a partial CoT. It stops unproductive traces early and accelerates useful continuations with speculative decoding. Extensive experiments on MMEB-V2 and MRMR demonstrate that ReWAM achieves state-of-the-art retrieval performance while delivering up to 5x the inference throughput of competitive explicit-CoT UME methods. These results bridge the gap between retrieval quality and inference efficiency, making reasoning-enhanced UME practical for large-scale deployment.

[190] Beyond Safe Answers: Segment-Aware Listwise Alignment for Reasoning Safety in Large Reasoning Models cs.AI | cs.CLPDF

JungMin Yun, Junehyoung Kwon, Hayeong Ryu, Byeonggeuk Lim, Hoejoon Kwon

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: Large Reasoning Models (LRMs) pose a dual-surface safety challenge: both intermediate reasoning traces and final answers can contain harmful content. Existing alignment methods often operate at the whole-response level, allowing unsafe reasoning to be masked by a safe-looking final answer. We propose Segment-aware Listwise Target DPO (SaLT-DPO), which addresses this gap through three mechanisms: (1) segment-aware listwise alignment that decomposes responses into reasoning and answer segments, independently scores each segment’s safety, and aligns length-normalized segment rewards with soft target distributions over multiple candidates; (2) joint safety coherence regularization that applies a weakest-link principle to promote safety consistency across both segments; and (3) utility anchoring on benign prompts to mitigate over-refusal and reasoning degradation. Experiments on three LRMs show that SaLT-DPO consistently reduces unsafe rates for both reasoning and answer segments while mitigating degradation in benign compliance and preserving general reasoning performance. Ablation studies demonstrate the complementary contributions of its components.

[191] Option-Aware Retrieval and Task-Specific VLM Adaptation for Medical VQA cs.AI | cs.CL | cs.CVPDF

Tristan Kirscher, Niklas C. Koser, Soren Pirk

TL;DR: Error

Details

Motivation: Error

Result: Error

Insight: Error

Abstract: We describe our submission to the MedReason 2026 challenge, covering multiple-choice (MCQ) and open-ended (OE) medical visual question answering (VQA) under fully offline, containerized inference. Our first finding is that MCQ retrieval must compare answer \emph{semantics} rather than answer labels: labels are independently assigned per question, so copying a retrieved neighbor’s label transfers no useful information, whereas scoring each current option’s text against correct-answer text from similar training cases raises retrieval-only accuracy from 20.0% to 57.5% on a 200-case retrieval-excluded development holdout. Our second finding attributes the submitted system’s accuracy: holding the task-specific MCQ Low-Rank Adaptation (LoRA) adapter fixed and varying the number (k) of in-prompt retrieved examples changes accuracy by at most one case — 187/200 (93.5%) at both (k=0) and the adapter’s training-time (k=1), 188/200 (94.0%) at the packaged runtime’s default (k=3) — and the submitted confidence-gated override adds no net accuracy on top of (k=3), selecting the VLM in 198/200 cases. With the final MCQ adapter fixed, retrieval changes accuracy by at most one case, and gating provides no net gain. On 20 OE cases, token-F1 and RaTEScore~\cite{zhao2024ratescore} decrease as (k) grows, but paired sign tests on token-F1 differences are nonsignificant ((p \ge 0.29)); a single-annotator comparison found 6/20 wrong-anchor errors for the final configuration and 14/20 for an earlier configuration that jointly differed in routing, adapter, and prompting. The system reaches 94.0% MCQ accuracy on the development holdout and 93.20% on the organizer’s official pre-evaluation, versus 29.43% for the off-the-shelf reference baseline, while both of the organizer’s open-ended scores are lower than that baseline’s (ground-truth agreement 1.245 versus 1.588, visual accuracy 1.995 versus 2.696, each out of 4).

cs.SE [Back]

[192] woma: a real-time foundation model and its fine-tuned models for endoscopy cs.SE | cs.CV | cs.LGPDF

Thang Tran, Lan Dang

cs.CL [Back]

[1] PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems cs.CL | cs.CVPDF

[2] TestHallVQA: Exploring LVLMs’ Document-Level Reasoning under Redundant Contexts from Scientific Exams cs.CLPDF

[3] Lexical Prompt Compression for Large Language Models: A Training-Free, Deterministic Pipeline with Empirical Pareto Analysis Across Eleven Task Categories cs.CLPDF

[4] Clinical Reasoning Under a Partially Observed Objective in Cone Beam CT Report Generation cs.CL | cs.CVPDF

[5] RFCLLM: Evaluating LLMs’ Reasoning Ability of Network Protocol State Machines cs.CLPDF

[6] From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models cs.CLPDF

[7] Hindsight Bias in Clinical Temporal Reasoning: How Future Data Exposure Affects Large Language Model Judgment cs.CL | cs.AIPDF

[8] Inside VLM Chart Reading: Tracing Value Reading from Vertical Bar Charts Across Space and Depth cs.CLPDF

[9] SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection cs.CLPDF

[10] DARE: Dialectical Agentic Reasoning for Structured Knowledge Fact Checking cs.CLPDF

[11] When Consistency Does Not Mean Reliability: Evaluating Local LLM Judges Against Human Ratings cs.CLPDF

[12] Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice cs.CLPDF

[13] SHIFT-M3: Pre-fusion Alignment-based Consistency Screening for Multimodal ECG Record Integrity cs.CLPDF

[14] North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+) cs.CLPDF

[15] Thought without systematicity? Evaluating reasoning models on rule induction tasks cs.CL | cs.AI | cs.LGPDF

[16] Unlocking the Unsolvable: Teacher-Guided Curriculum for Data-Efficient RLVR cs.CLPDF

[17] GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning cs.CL | cs.AI | cs.CVPDF

[18] One Size Does Not Fit All: Setting Inference Depth from the Questions a Deployment Actually Asks cs.CL | cs.LGPDF

[19] Learning to Refer from Estimated Listener Gaze cs.CLPDF

[20] E2A-Bench: Benchmarking Evidence-to-Action Reliability in Financial Chart Reasoning cs.CLPDF

[21] Theseus in the Graph: Towards Traceable Multi-Hop Graph Navigation cs.CL | cs.LGPDF

[22] CompCQR: Compositional Query Generation for Training-Free Conversational Search cs.CL | cs.AIPDF

[23] TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendation cs.CLPDF

[24] Optimizing Sparse Outcomes Through Dense Behavioral Signals via Value-Guided Preference Distillation cs.CLPDF

[25] Building Legal Reward Models for Grounding and Abstention cs.CL | cs.AIPDF

[26] Func-R1: Incentivizing Mathematical Function Reasoning in Multimodal Large Language Models cs.CLPDF

[27] MedTRACE: Tool-Augmented Multimodal Clinical Reasoning Agents for Evidence-Grounded Decision-Making cs.CLPDF

[28] Enemray: Toward Capable Language Models for Hassaniya cs.CL | cs.AIPDF

[29] ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement cs.CLPDF

[30] One Example Is Enough to Pass Fairness Benchmarks: Rethinking Fairness Evaluation for Aligned LLMs cs.CL | cs.AIPDF

[31] Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning cs.CL | cs.AI | cs.LG | cs.MAPDF

[32] Beyond Depth and Width: The Information-Slack Dilemma in Streaming Test-Time Compute cs.CLPDF

[33] SALUTE: Benchmarking and Adapting LLMs for the Defense Domain cs.CLPDF

[34] ABSOL: Aggregated Bayesian Subsampling Orchestrated with LLMs cs.CL | cs.LGPDF

[35] Salesforce Koa: An Enterprise Language Model for Agentic Tool Use cs.CL | cs.AI | cs.LGPDF

[36] DA-DLM: Explicitly Modeling Token Dependencies in Diffusion Language Models cs.CLPDF

[37] Improving Mathematical Reasoning Capabilities in Large Language Models via Reasoning Process Error Classification cs.CLPDF

[38] EMR: Self-Evolving Medical Multi-Agent System via Experience Mining and Reuse cs.CL | cs.AIPDF

[39] MUSE: A Theory-Harnessed Story Engine for Vibe Narrativizing cs.CLPDF

[40] Semiotic Relations and Proof Methods: A Cross-Genre Study of Argument Structure with Large Language Models cs.CLPDF

[41] Don’t Count the Edits, Judge by the Outcome Alone: Reward-Based Evaluation for Grammatical Error Correction cs.CL | cs.AIPDF

[42] Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection cs.CL | cs.AI | cs.CV | cs.LGPDF

[43] Before You Poll with LLMs: A Deliberative Diagnostic Framework cs.CL | cs.AI | cs.CYPDF

[44] Learning to Coach for Experiential Learning cs.CLPDF

[45] K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations cs.CL | cs.AI | cs.LGPDF

[46] Inoculation Midtraining with Learned Neologisms cs.CLPDF

[47] HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses cs.CL | cs.CE | cs.MA | cs.NEPDF

[48] Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States cs.CL | cs.LGPDF

[49] Discovery Foundation Models: Toward Open-Ended Discovery Intelligence cs.CLPDF

cs.CV [Back]

[50] What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth cs.CVPDF

[51] Don’t Just Look, Intervene: Perturbation Based Region Labeling for VQA Images cs.CVPDF

[52] Part Grounding, Not Action Knowledge: Locating the Bottleneck in VLM Affordance Prediction cs.CV | cs.LG | cs.ROPDF

[53] Occlusal Geometry in Closed Form for Orthodontic Report Generation cs.CV | cs.CLPDF

[54] ArtSociety: Multi-Agent Multimodal Collaboration for Art Emotion Understanding cs.CVPDF

[55] SJD-SV: Speculative Jacobi Decoding with Semantics Verification for Autoregressive Image Generation cs.CVPDF

[56] Pixel-wise Planarity for High-Precision Monocular Plane Segmentation cs.CVPDF

[57] Evaluation of MLLM-Agnostic Plug-and-Play Keyframe Selection Methods for Long Video Understanding cs.CV | cs.AIPDF

[58] Preserving Subject-Clarity in Image Outpainting with Multiscale Wavelet Supervision cs.CVPDF

[59] (How) Do MLLMs Report Bistable Images Like Humans? cs.CV | cs.AIPDF

[60] Sampling headroom is not selection gain: a compute-value audit of test-time scaling for video world models cs.CV | cs.AIPDF

[61] A Comprehensive Review of Multimodal Facial State Analysis: Tasks, Methods, and Resources cs.CVPDF

[62] Interpretable Temporal Video Reasoning with EventGraph and EventField cs.CV | cs.CL | cs.IRPDF

[63] BEACON: Behavior and Appearance Control for Subject-Specific Video Generation cs.CV | cs.AIPDF

[64] TryOnReward: Learning Foveated Consistency for Reinforcement Fine-Tuning of Virtual Try-On cs.CV | cs.AIPDF

[65] SomBench: Benchmark Dataset for Advancing Machine Learning in Lunar Science cs.CV | cs.LGPDF

[66] Structure-Token Evidence-Anchored Reasoning for Scientific Chart Understanding cs.CVPDF

[67] Frame-Synchronous Hand Gesture Detection by Projected Winding Order cs.CV | cs.GR | cs.HC | cs.LGPDF

[68] RxScribe Bench: A Multi-Axis Benchmark for Evaluating Vision-Language Models on Indian Outpatient Prescriptions cs.CVPDF

[69] Multimodal-Multiresolution Foundation Model for Lunar Remote Sensing cs.CV | cs.AI | cs.LGPDF

[70] LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents cs.CV | cs.AIPDF

[71] Target-Checked Reliability Score Refinement for Video Question Answering cs.CVPDF

[72] Harnessing Image Question Dependence for Better VLM Test-time Reinforcement Learning cs.CV | cs.LGPDF

[73] Adaptive Conformal Redistribution for Inter-class Transitional Uncertainty in Medical Image Classification cs.CV | cs.AI | cs.LG | stat.CO | stat.MLPDF

[74] GroundBench: A Factorized, Counterfactual Benchmark for Locating VLM Affordance Failures cs.CV | cs.LG | cs.ROPDF

[75] Task-Based CT Protocol Optimization Using Reinforcement Learning and Virtual Imaging Trials cs.CV | cs.AI | cs.LGPDF

[76] Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation cs.CV | cs.AIPDF

[77] Global-Local Contextual Progressive Expansion Network for Martian Landslide Segmentation in Multimodal Remote Sensing Imagery cs.CVPDF