cs.CL [Total: 18]
cs.CV [Total: 33]
cs.SD [Total: 1]
cs.RO [Total: 2]
cs.LG [Total: 3]
eess.AS [Total: 2]
cs.AI [Total: 5]
eess.IV [Total: 1]

cs.CL [Back]

[1] Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking cs.CLPDF

Parinthapat Pengpun, Simran Khanuja, Graham Neubig

TL;DR: 该论文研究了多模态实体链接任务中罕见实体性能下降的问题，并提出了一种新的、基于知识图谱结构而非流行度的罕见性度量方法。作者引入了一个无需训练、结合推理和检索的框架，通过视觉语言模型迭代搜索维基百科并动态收集证据，以提升对罕见实体的链接准确率。

Details

Motivation: 现有多模态实体链接系统在罕见实体上性能显著下降，但先前工作主要依赖基于流行度的指标（如页面浏览量）来定义罕见性，这忽略了知识图谱结构信息。论文旨在拓宽对罕见性的理解，并解决由此暴露出的不同失败模式。

Result: 在涵盖五种语言（印地语、印尼语、日语、泰米尔语、越南语）的多语言多模态实体链接基准MERLIN上，所提出的最佳系统整体准确率比现有最优方法提升了6.9%，在罕见实体切片上的准确率提升最高达23.3%。

Insight: 创新点在于使用知识图谱结构指标（如文档完整性和连接性）来更全面地识别罕见实体，并设计了一个将推理能力与动态检索相结合的简单框架。客观来看，其核心洞察是推理和检索在解决罕见实体问题上具有互补性，单独使用任一方均不足，而迭代式的结合策略能有效提升性能。

Abstract: Multimodal entity linking grounds entity mentions in text and images to knowledge-base entries. These systems degrade on rare entities, but prior work measures rarity primarily through popularity-based metrics such as pageviews. We broaden this view using knowledge-graph structural metrics that capture how well an entity is documented and connected. These metrics identify many rare entities that popularity metrics miss. Across the resulting rare-entity slices, state-of-the-art accuracy drops by 15.4-39.9%, showing that different rarity definitions expose different failure modes. To address these failures, we introduce a simple, training-free framework in which a reasoning-capable vision-language model iteratively searches and reasons over Wikipedia, gathering evidence dynamically. Controlled experiments show that reasoning and retrieval are complementary. Reasoning alone does not significantly improve accuracy on rare entities. Retrieval without reasoning improves rare-entity accuracy but can hurt overall accuracy. Their combination performs best. On MERLIN, a multilingual multimodal entity linking benchmark over five languages (Hindi, Indonesian, Japanese, Tamil, Vietnamese), our best system improves over the state of the art by 6.9% overall and by up to 23.3% on rare-entity slices. We release MERLIN-Rare, rare-entity test slices for targeted evaluation, with our framework.

[2] Data-Efficient Language Modeling: From Frontier Advancement to Principle-Guided Model Improvement cs.CL | cs.AIPDF

Shuxing Yang, Kaihao Zhu, Junjie Yang, Rui Zhao, Junyao Wu

TL;DR: 该论文提出了一种数据高效的语言建模方法，通过三个阶段（前沿模型构建、原理发现、原理指导的模型改进）在BabyLM 2026 Strict-Small数据集（1000万词语料库）上实现了递归自我改进的研究过程。研究发现，精确重复和对齐重述会产生不同的上下文使用模式，并提出了一个可测试的数据高效学习原则：围绕预测所需的上下文依赖组织经验，并分别设计可见信息、监督和保留机制。最终模型在九项指标综合评估中超越了普通延续模型，总体分数从42.02提升至42.25，并在2026年9月8日的公开Strict-Small快照中取得了最高总体分数。

Details

Motivation: 解决在有限文本数据下进行语言建模的挑战，要求模型能够有效利用上下文、泛化到新输入并保留有用能力，从而推动数据高效学习的研究。

Result: 在BabyLM 2026 Strict-Small基准测试中，通过原理指导的改进，模型总体分数从42.02提升至42.25，并在公开快照中取得了最高总体分数，超越了普通延续模型。

Insight: 创新点包括提出数据高效学习原则（组织上下文依赖、分离设计信息组件）以及递归自我改进（Research RSI）的研究框架，通过结合前沿进展、原理发现和指导性改进来系统提升模型性能。

Abstract: Learning from limited text requires models to use context, generalize to new inputs, and retain useful capabilities. Qiushi Engine conducted a long-horizon, end-to-end autonomous research program on BabyLM 2026 Strict-Small, within 10 million corpus words and 100 million cumulative word presentations. Three stages connected frontier advancement, principle discovery, and principle-guided model improvement. Stage I combined compact restatements, budget reinvestment, and residual incremental learning to build a frontier model. Stage II found that exact repetition and aligned restatement produce different patterns of context use, depending on target relations and prediction windows. In controlled tasks, recovering familiar performance did not ensure that unseen inputs could still use learned computations. These findings support a testable data-efficient learning principle: organize experience around the contextual dependencies needed for prediction; separately design visible information, supervision, and preservation; test learning, generalization, and retention. Stage III retained source text, masked more local clues, supervised selected targets, and preserved predictions on ordinarily masked inputs. Two continuation seeds from the same parent outperformed ordinary continuation on the complete nine-metric aggregate. Overall rose from 42.02 to 42.25 across two generations; the second achieved the highest Overall in the public Strict-Small snapshot of 8 September 2026. Further studies addressed compression, relational anchors, shared representations, and measurement. Models are available on Hugging Face; code and research records accompany the GitHub repository. Together, these stages illustrate Research RSI: recursive self-improvement of the research process. Scientific understanding and method innovations change subsequent questions and designs; new experiments test and refine them.

[3] Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System cs.CLPDF

Ming Li, Dai Li, Xuying Ning, Bo Sun, Rui Li

TL;DR: 本文提出了Auto-RecSys，一个用于工业级推荐系统模型长期实验的自主研究系统。它通过分布式异步执行、集中式跨服务器内存和认知-程序分离的设计，解决了工业规模下反馈周期长和系统复杂性的挑战。系统采用双循环自进化架构，通过执行进化循环和想法进化循环，显著减少了每次实验周期所需的人力时间并提高了执行可靠性。

Details

Motivation: 旨在将自动化研究智能体范式扩展到工业级推荐系统，解决因模型训练周期长导致的反馈循环缓慢，以及大规模配置、脆弱基础设施依赖等系统复杂性带来的挑战。

Result: 在推荐模型上的评估表明，Auto-RecSys显著减少了每个实验周期所需的人力时间，并且随着其操作手册的成熟，执行可靠性得到提升。

Insight: 创新点在于为工业级场景设计了三个核心机制（分布式异步执行、集中式内存、认知-程序分离）和双循环自进化架构（执行进化与想法进化），将LLM的推理能力与确定性脚本的执行可靠性相结合，实现了可扩展且鲁棒的自动化实验流程。

Abstract: Auto-research agents have shown the potential to automate hypothesis generation, experiment execution, and iterative refinement. However, scaling this paradigm to industry-scale recommendation models introduces two challenges: (1) long feedback loops, where model training can take days, making serial iteration prohibitively slow and requiring parallel exploration across multiple research directions; and (2) system complexity, where large configurations, fragile infrastructure dependencies, and multi-day GPU jobs require robust and recoverable execution. We present Auto-RecSys, an autonomous research system for long-horizon experimentation on industry-scale recommendation models. Auto-RecSys addresses these challenges through three harness designs: (1) distributed asynchronous execution for running multiple experiments in parallel across servers, (2) centralized cross-server memory for persistent and recoverable execution across sessions and failures, and (3) cognitive-procedural separation, where natural-language skill files guide LLM reasoning while deterministic scripts enforce operational correctness. Auto-RecSys further employs a dual-loop self-evolving architecture: an Execution Evolution Loop in which model-specific playbooks accumulate operational knowledge by recording failed attempts and crystallizing successful pipelines, and an Idea Evolution Loop in which experimental outcomes inform subsequent ideation. Evaluated on recommendation models, Auto-RecSys significantly reduces the human time required per experiment cycle and improves execution reliability as its playbooks mature.

[4] SearchAtlas: Analyzing Agentic Search Strategies via Evidential Query Graphs cs.CLPDF

Jiacheng Sang, Mengyuan Li, Sanxing Chen, Yukun Huang, Yu Feng

TL;DR: SearchAtlas是一个用于分析LLM搜索代理策略的框架，它将原始的、冗长的搜索轨迹转换为结构化的证据查询图，以揭示证据如何从查询传播到最终答案。该框架通过自动化解析管道实现了高精度（平均边F1为86.0%），并在三个基准测试上分析了五个搜索代理，揭示了它们在搜索规模和证据聚合方面的系统性差异。

Details

Motivation: 当前对LLM搜索代理的评估主要关注最终答案的准确性，而忽略了搜索过程本身。理解搜索策略需要分析可信证据如何被检索以解决查询约束，但这些信息被埋藏在难以解析的原始搜索轨迹中。

Result: 在人工标注的图上，自动化解析管道达到了平均边F1为86.0%的精度，且在不同运行中保持一致。对五个搜索代理在三个基准上的分析揭示了系统性的过程差异，并且SearchAtlas识别出的过程失败（如碎片化答案支持、未验证的参数知识）与错误答案的关联性，比基于原始轨迹或有序查询列表的LLM判断更强。

Insight: 创新点在于提出了将搜索轨迹结构化为证据查询图的方法，以提供过程层面的可解释性。客观来看，该框架能够暴露传统准确性评估所忽略的关键过程缺陷（如证据传播中断），并证明过程诊断分数捕获了无法简化为答案准确性的信息，为评估和调试搜索代理提供了新工具。

Abstract: LLM search agents are often evaluated on final-answer accuracy, overlooking the process. Analyzing a search strategy requires understanding how credible evidence is retrieved to address question constraints. This valuable information is buried in raw search trajectories that are long and difficult to parse. We introduce SearchAtlas, a framework that converts search trajectories into structured graphs whose edges represent how evidence is propagated across the reasoning trace, from the query that retrieves it to the final answer. Our automated parsing pipeline achieves a mean edge F1 of 86.0% against human-annotated graphs and remains consistent across repeated runs. We analyze five search agents on three benchmarks, revealing systematic differences in search scale and evidence aggregation. SearchAtlas exposes fragmented answer support, question constraints that do not reach the answer, and unverified parametric knowledge entering the response. These process failures are strongly associated with incorrect answers, even more so than an LLM judge given either the raw trajectory or the ordered query list, suggesting that the constructed graphs provide useful interpretability. Moreover, an audit of cases in which process-diagnostic scores disagree with final-answer correctness shows that they capture information not reducible to answer accuracy.

[5] Structurally Speaking: Motif-Oriented Graph Captioning through Bidirectional Graph-Text Translation cs.CL | cs.LGPDF

Hsiao-Ying Lu, Dongyu Liu, Kwan-Liu Ma

TL;DR: 这篇论文研究图结构描述生成（graph captioning）问题，提出了一种名为Structurally Speaking的轻量级结构化提示方法，旨在生成以图结构基元（motif）为导向的、更简洁且可解释的图描述，而不是冗长的边列表。该方法将图描述视为图与文本之间的双向翻译任务，确保描述既能保留足够的拓扑结构以恢复原图，又能通过紧凑的基元级描述来表达图。

Details

Motivation: 现有方法（如直接提示GPT-5.1）生成的图描述往往冗长且基元解释不一致，它们通常只是将邻接矩阵翻译成边列表，而不是帮助读者理解图结构。论文的动机是生成更有用的图描述，将连通性抽象为可识别的结构基元（如枢纽、路径、环、团、桥），因为这些基元提供了更易于阅读、比较和恢复的紧凑结构单元。

Result: 在合成的基于基元的数据集上的实验表明，与直接提示GPT-5.1相比，所提出的结构化提示方法能生成更短、基元一致性更高的图描述，同时保持可比的图恢复能力。

Insight: 论文的创新点在于将图描述形式化为双向图-文本翻译任务，并引入轻量级的结构化提示协议来引导从显式连通性到基元级抽象的翻译。从客观角度看，其核心洞察是：为LLM提供明确的从拓扑到基元的推理指导，无需模型微调，就能使生成的图描述更具可解释性，这为利用提示工程改善结构化数据生成任务提供了借鉴。

Abstract: Graph captions should help readers understand graph structure, rather than simply translate adjacency matrices into long textual edge lists. A useful graph caption abstracts connectivity into recognizable motifs, such as hubs, paths, cycles, cliques, and bridges, because these motifs provide compact structural units that are easier to read, compare, and recover. In this paper, we study motif-oriented graph captioning as a bidirectional graph-text translation task, where captions must both preserve enough topology for graph recovery and express the graph through concise motif-level descriptions. We show that direct prompting of GPT-5.1 often produces graph-recoverable captions by enumerating node-to-node connections, but these captions are verbose and can contain inconsistent motif interpretations. To address this gap, we introduce Structurally Speaking, a lightweight structured prompting protocol that guides translation between explicit connectivity and motif-level abstraction. Experiments on a synthetic motif-based dataset show that structured prompting produces shorter and more motif-consistent captions while maintaining comparable graph recovery. These results suggest that explicit topology-to-motif reasoning guidance can make LLM-generated graph captions more interpretable without model fine-tuning.

[6] Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction cs.CL | cs.AI | cs.LGPDF

Han-Jun Choi, Byunggill Joe, Saim Shin, Jin Yea Jang

TL;DR: 本文提出了一种基于语义感知完整度估计的多模态情感分析框架，通过量化不完整数据中保留的情感相关信息来指导缺失语义的重建，并设计了一种稳定多任务学习的训练策略，联合优化情感预测和完整度估计任务。

Details

Motivation: 针对现实场景中多模态数据部分缺失或噪声导致以文本为中心的融合方法性能下降的问题，特别是当情感相关线索缺失时，需要更鲁棒的方法来处理不完整模态。

Result: 在三个基准数据集上的大量实验和深入分析表明，该方法能够实现更准确的语义重建，从而获得更精确的情感预测性能。

Insight: 创新点在于引入了语义感知的完整度估计来量化不完整数据的信息保留程度，并提出了稳定多任务学习的训练策略，以联合优化情感预测和完整度估计，提升模型在不完整模态下的鲁棒性。

Abstract: Recent multimodal sentiment analysis studies increasingly adopt text-centric fusion approaches to exploit the rich sentiment information inherent in the textual modality. However, these approaches often suffer from performance degradation during inference due to partially missing or noisy data in real-world scenarios, especially when sentiment-related cues are missing. To address this issue, we introduce a new completeness estimation approach that quantifies the degree of sentiment-relevant information preserved in incomplete data to guide the reconstruction of missing semantics. Furthermore, we propose a training strategy that stabilizes multi-task learning while jointly optimizing sentiment prediction and completeness estimation. Extensive experiments and in-depth analyses on three benchmark datasets demonstrate that the proposed approach enables more accurate semantic reconstruction, leading to more precise sentiment prediction.

[7] Distribution-aware Language Neuron Identification in Multilingual Large Language Models cs.CLPDF

Minjun Kim, Inho Won, Junghun Yuk, Dongyeon Kim, Jihyo Kim

TL;DR: 本文提出了一种分布感知的语言神经元识别方法，用于更有效地识别多语言大语言模型中对特定语言敏感的神经元。该方法通过分析不同语言激活分布之间的成对重叠系数来量化神经元的语言特异性，相比现有基于熵的方法能更好地捕捉语言表征的分布特性。在两个多语言大模型和两个保留语料库上的实验表明，该方法能更精准地隔离语言特异性因果效应，在保持非目标语言性能的同时，使单个神经元对目标语言的破坏性最高提升4.9倍。

Details

Motivation: 现有方法通过计算神经元激活概率的语言熵来识别语言特异性神经元，但未能充分捕捉多语言大语言模型中语言表征的分布性和相互关联性。

Result: 在两个多语言大模型和两个保留语料库上的实验表明，该方法能更有效地隔离语言特异性因果效应，在保持非目标语言性能的同时，使单个神经元对目标语言的破坏性最高提升4.9倍。

Insight: 创新点在于利用全激活范围（包括负值）内不同语言激活分布之间的成对重叠系数来量化语言特异性，通过聚类语言来识别神经元，这比仅基于正激活概率熵的方法更能反映多语言表征的分布关系。

Abstract: Multilingual large language models (mLLMs) contain a small fraction of feed-forward neurons that are sensitive to particular languages, commonly termed language-specific neurons. Existing work measures language specificity using the entropy of each neuron’s language-wise probabilities of being active, where a neuron is considered active when its activation value is positive. However, this approach may not fully capture the multilingual nature of mLLMs, where language representations are distributional and mutually related. We propose Distribution-aware Language Neuron selection, which leverages pairwise relationships between per-language activation distributions over the full activation range, including negative values. Specifically, we quantify each neuron’s language specificity by clustering languages using pairwise overlap coefficients between their activation distributions. Across two mLLMs and two held-out corpora, our identifier more effectively isolates language-specific causal effects, yielding up to 4.9$\times$ higher on-target language damage per neuron while preserving off-target language performance.

[8] Rubric-Aligned Disentangled Evaluation of Human Simultaneous Interpreting cs.CLPDF

Ziyu Zhang, Satoshi Nakamura

TL;DR: 本文针对人类同声传译（SI）的评估，构建了一个包含1,101个专业标注片段的语料库，涵盖意义传递（LQ）、表达质量（EXP）和感知延迟（LAT）三个维度。研究发现，传统的结构化LLM提示和标量监督方法会导致维度耦合，与人工评分相关性低。为此，作者提出了一种基于LoRA适配的COMET-KIWI编码器的双回归头模型，在保留的测试集上显著提升了与人工评分的一致性。

Details

Motivation: 目前缺乏能够按照评估标准（如意义传递、表达质量、时间同步性）进行细粒度、分段自动评估人类同声传译的指标，现有自动方法（如结构化LLM提示）存在维度耦合问题，无法有效分离不同评估维度。

Result: 在保留的演讲级别测试集上，提出的双回归头模型与人工评分的皮尔逊相关系数分别达到0.388（LQ）和0.301（EXP），优于冻结的COMET-KIWI基线模型。考虑到人工评分者间一致性本身较低，作者将结果与人类一致性进行对比解读，旨在为形成性评估提供稳定的排序信号。

Insight: 创新点在于构建了首个针对同声传译多维度评估的专业标注语料库，并揭示了传统LLM提示方法在细粒度评估中的局限性。提出的双回归头架构在保持骨干网络能力不变的情况下，通过分离监督结构有效解耦了评估维度，为面向标准的自动评估提供了新思路。

Abstract: Human simultaneous interpreting (SI) is commonly assessed with analytic rubrics separating meaning transfer, delivery quality, and temporal synchrony, yet no automatic metric is designed for rubric-aligned segment-level SI evaluation. We construct a professionally annotated corpus of 1,101 SI segments with scores for meaning transfer (LQ), delivery quality (EXP), and perceived latency (LAT). We show that structured LLM prompting and scalar supervision collapse rubric dimensions, yielding near-zero correlation with human ratings and strong cross-dimension coupling. To isolate supervision structure under identical backbone capacity, we introduce dual regression heads on a LoRA-adapted COMET-KIWI encoder. On a held-out talk-level test set, the model achieves Pearson correlations of 0.388 (LQ) and 0.301 (EXP), improving over frozen COMET-KIWI. Given low absolute rater agreement, we interpret results relative to human consistency and target stable ranking signals for formative assessment.

Jianjiang Yang, Peihang Li, Shanqing Xu, Mengchen Qian, Lu Zhang

TL;DR: 该论文提出了OmniHallu，一个统一的多模态大语言模型幻觉检测框架，覆盖图像、视频和音频模态的理解与生成任务。它构建了包含10,000个样本的OmniHallu-Bench基准数据集，并采用多智能体架构将模型输出分解为原子声明进行验证。论文还提出了一个偏好优化的可训练验证器，能大幅减少对专家模型的调用。

Details

Motivation: 现有研究通常针对单一模态或任务类型进行幻觉检测，泛化能力有限。该研究旨在解决多模态大语言模型在跨模态理解和生成任务中输出与输入语义相矛盾或失真的幻觉问题，并建立一个统一的检测框架。

Result: 论文在涵盖六个跨模态任务的OmniHallu-Bench上进行了广泛实验，揭示了与模态相关的性能梯度。提出的可训练验证器在性能损失最小的情况下，将专家模型调用减少了66%。

Insight: 主要创新点在于构建了统一的跨模态幻觉检测框架和基准数据集，以及采用多智能体分解验证与结构化推理的架构。从客观角度看，其提出的可训练验证器在效率与性能间取得了良好平衡，为实际部署提供了实用方案。

Abstract: While Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse tasks, they suffer from hallucinations where generated outputs contradict or misrepresent input semantics. Existing research typically addresses hallucination detection within a single modality or task type, limiting generalizability. We introduce OmniHallu, a unified hallucination detection framework spanning both comprehension and generation tasks across image, video, and audio modalities. We contribute OmniHallu-Bench, a 10,000-sample benchmark with claim-level human annotations covering six cross-modal tasks: image-to-text (I2T), video-to-text (V2T), audio-to-text (A2T), text-to-image (T2I), text-to-video (T2V), and text-to-audio (T2A). Our multi-agent architecture decomposes model outputs into atomic claims, verifies them through modality-specific experts, and aggregates evidence via structured reasoning. We further propose a preference-optimized trainable verifier that approximates the multi-agent decision boundary, reducing expert calls by 66% with minimal performance loss. Extensive experiments reveal a consistent modality-dependent performance gradient and provide fine-grained insights into cross-modal hallucination patterns.

[10] Can LLMs Normalize Databases? A Benchmark and Multi-Agent Framework for Schema Normalization cs.CLPDF

Dong-Jae Koh, Huisu Kim, SeongHwan Yoon, Lasse M. Jantsch, Chun-Hee Lee

TL;DR: 本文研究了大型语言模型（LLMs）在数据库规范化任务中的可靠性，并提出了一个名为DNBENCH的基准测试，包含3,275个样本，用于评估LLM从1NF到BCNF的规范化能力。针对LLM在依赖推断、模式分解和表间约束重建方面的常见失败，作者提出了一个名为MARS的多智能体框架，将证据提取、违规诊断和分解规划与模式生成和验证分离，从而显著提升了性能。

Details

Motivation: 动机是探究LLMs在生成必须满足数据库级约束的结构化输出时的可靠性，特别是在数据库规范化这一涉及函数依赖、无损连接分解和表间约束推理的复杂任务中。

Result: 在DNBENCH基准测试（包含Single、Complex和Real World三个难度级别）上，提出的MARS框架相比单提示基线，将DNB-SCORE提高了82.0%。

Insight: 论文的创新点在于创建了一个专门评估LLM数据库规范化能力的基准测试（DNBENCH），并提出了一个解耦推理过程的多智能体框架（MARS），将复杂的规范化任务分解为证据提取、诊断、规划和验证等子任务，这为LLM处理复杂、约束驱动的结构化输出问题提供了可借鉴的系统化方法。

Abstract: Large Language Models (LLMs) are increasingly used to generate structured outputs, but their reliability remains unclear when those outputs must satisfy database-level constraints. We study this issue through database normalization, involving reasoning about functional dependencies, lossless join decompositions, and inter-table constraints. We introduce a Database Normalization Benchmark (DNBENCH), comprising 3,275 samples for evaluating LLM-driven database normalization from 1NF to BCNF. DNBENCH uses a three-axis protocol to measure semantic equivalence, structural accuracy, and logical validity. Across Single, Complex, and Real World levels, DNBENCH uncovers recurring failures in dependency inference, schema decomposition, and inter-table constraint reconstruction. We further propose Multi-Agent Reasoning for Schemas (MARS), which separates evidence extraction, violation diagnosis, and decomposition planning from schema generation and verification. MARS improves the DNB-SCORE by 82.0% over the single-prompt baseline. All artifacts will be released upon acceptance.

[11] The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods cs.CLPDF

Ioanna Kaffeza, Efthymios Georgiou, Alexandros Potamianos

TL;DR: 本文批判性地分析了多模态情感分析（MSA）中基于优化的模态平衡方法，通过统一评估框架和理论诊断揭示了这些方法的局限性，并提出了基于留出判别性模态评估的研究方向。

Details

Motivation: 针对多模态情感分析中模态不平衡问题，现有基于优化的平衡方法（如梯度或损失平衡）存在过度承诺但实际效果有限的问题，本文旨在揭示其根本缺陷并推动更有效的解决方案。

Result: 在CMU-MOSI和CMU-MOSEI数据集上的实验表明，现有平衡策略均无法稳定优于简单的晚期特征拼接方法，且性能对超参数敏感，即使进行比率校准也无法获得一致增益。

Insight: 核心创新在于从理论上诊断了优化方法失败的原因（混淆了拟合速度与判别贡献），并提出了根本性观点：损失不等于效用，梯度不等于重要性，这为未来基于留出性能的模态效用估计研究奠定了基础。

Abstract: Multimodal Sentiment Analysis (MSA) remains constrained by modality imbalance, yet the field continues to rely on optimization-based balancing methods that promise more than they deliver. We provide three contributions: 1) a unified evaluation framework testing gradient and loss-based balancing strategies under controlled settings; 2) a theoretical diagnosis explaining why these methods fail, as they conflate fitting speed with discriminative contribution; and 3) a research agenda toward held-out discriminative modality valuation. Experiments on CMU-MOSI and CMU-MOSEI reveal three shortcomings: no strategy reliably outperforms Late Concatenation; performance is sensitive to hyperparameters; and even ratio calibration fails to yield consistent gains. The core issue is fundamental: loss is not utility, and gradients are not importance. Modality imbalance remains unresolved, motivating utility estimation from held-out performance.

[12] MultiHuSE: A Multimodal Dataset for Humour Styles and Emotions cs.CL | cs.CV | cs.MMPDF

Mary Ogbuka Kenneth, Foaad Khosmood, Abbas Edalat

TL;DR: 本文介绍了MultiHuSE，一个多模态幽默风格与情感数据集，包含2,407个高清视频，由50位不同背景的演员表演1,463个文本样本，涵盖四种心理幽默风格（亲和、攻击、自我提升、自我贬低）和中性内容，部分样本还标注了情感。该数据集独特地捕捉了同一文本的多演员演绎，支持表达多样性的系统分析。基线实验表明，在多模态融合下，幽默风格分类准确率（80.1%）优于单模态方法（77.4%），尤其在亲和幽默上提升显著（66%到74%）。

Details

Motivation: 现有计算幽默识别方法多关注二元分类，缺乏捕捉幽默心理维度与表达变化的数据集，因此需要构建一个多模态数据集来支持对语言、表达风格、情感和文化背景的综合理解。

Result: 在幽默风格分类任务中，多模态融合模型达到80.1%的准确率，优于单模态方法（文本77.4%），其中亲和幽默的准确率从66%提升至74%，文本模态表现最强，但融合带来有意义的改进。

Insight: 创新点在于构建了首个包含多演员对同一文本演绎的多模态幽默数据集，支持表达多样性的系统分析；多模态融合能有效提升幽默风格分类性能，尤其对特定幽默类型（如亲和幽默）有显著增益，为心理学理论与AI交互研究提供了实证基础。

Abstract: Computational recognition of verbal humour remains a challenging task, requiring an understanding of language, delivery style, emotions, and cultural context. Most existing approaches focus on binary classification and lack datasets that capture psychological dimensions of humour alongside variations in expression. We introduce MultiHuSE, a multimodal dataset comprising 2,407 high-definition videos of 50 demographically diverse actors performing 1,463 text samples across four psychological humour styles (affiliative, aggressive, self-enhancing, and self-deprecating), as well as neutral content. A subset is additionally annotated for underlying emotions. The dataset uniquely captures multiple actor interpretations of the same texts, enabling systematic analysis of expressive diversity. Baseline experiments show that multimodal fusion outperforms unimodal approaches (80.1% vs. 77.4% accuracy) in humour style classification, with particularly strong gains for affiliative humour (66% to 74%). While text provides the strongest individual signal, fusion models deliver meaningful improvements. We hope that MultiHuSE provides empirical support for psychological theories linking humour and emotion, while also opening new avenues for research in human communication, well-being, and AI-driven interaction. The dataset is available for academic use under an End-User Licence Agreement.

[13] SEAR: Segment-Evidence-Aware Routing for Weak-to-Strong Multilingual Speech MCQ cs.CL | cs.SDPDF

Huy Hoang Le, Long-Bao Nguyen, Minh Tri Dao

TL;DR: 本文介绍了为MLC-SLM挑战赛Task 2设计的SEAR系统，该系统通过一个分段证据感知的数据与后训练流程，对Qwen3-Omni-30B-A3B-Instruct模型进行适配。系统利用语言模型将带时间戳的ASR转录转换为连贯的事件片段，并以此合成多模态多选题，通过数据筛选和分治训练策略（弱项用于监督微调，强项用于强化学习），在最终官方评估集上取得了90.92%的准确率。

Details

Motivation: 解决多语言语音多选问答任务中，如何有效利用带时间戳的ASR转录信息，并构建高质量、多样化的多模态训练数据，以提升模型在弱（文本可答）和强（依赖音频）问题上的性能。

Result: 在MLC-SLM挑战赛Task 2的最终官方评估集上取得了90.92%的准确率。

Insight: 创新点在于提出了分段证据感知的数据构建与后训练流程，将ASR时间戳转化为结构化事件片段用于数据合成，并采用基于文本探针的数据划分策略，对弱项和强项问题分别进行监督微调和基于GSPO的强化学习，同时引入了去偏优势、序列级重要性校正等稳定化技术。

Abstract: This paper describes our system for Task2 of the second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge. We adapt Qwen3-Omni-30B-A3B-Instruct with a segment-evidence-aware data and post-training pipeline. A language model converts timestamped ASR into coherent event spans, which are expanded by a boundary margin and cropped from the original recording. We then synthesize complementary semantic MCQs with Qwen3.6-27B and acoustic MCQs with Gemini3.1 Flash-Lite, followed by structural, grounding, answer-consistency, and target-model trainability checks, yielding 359,825 verified MCQs across 21 language and accent variants. A text-only probe partitions the data into weak, text-answerable items used for supervised fine-tuning and strong, audio-dependent items used for reinforcement learning with Group Sequence Policy Optimization (GSPO), stabilized by debiased advantages, sequence-level importance correction, and dynamic filtering. Our system obtains 90.92% accuracy on the final official evaluation set.

[14] ReGround: Grounding Reviewer Comments in Multimodal Evidence cs.CL | cs.IRPDF

Serwar Basch, Lizhen Qu, Iryna Gurevych

TL;DR: 本文提出了ReGround数据集，用于解决审稿人评论在长篇幅多模态论文中的证据定位问题。该数据集包含10,267条审稿人评论与16,274个证据的关联，覆盖3,656篇匿名投稿。研究将定位任务构建为检索问题，并评估了多种检索方法，发现全文检索效果不佳，证据类型推断是主要瓶颈，且多模态证据能提供文本遗漏的补充信息。

Details

Motivation: 现有基准主要关注显式信息检索查询，未能有效处理审稿人评论与论文具体部分（包括文本、图表等多模态内容）的关联问题，而作者反驳中常包含用于回应评论的提交内容引用，为高精度标注提供了来源。

Result: 在ReGround数据集上的实验表明，基于全文内容的检索性能较差，证据类型推断是主要瓶颈；多模态证据（如图表）能提供文本遗漏的互补信号，凸显了该任务的挑战性。

Insight: 创新点在于利用作者反驳中的显式引用构建大规模高质量数据集，将审稿评论定位形式化为多模态检索任务，揭示了证据类型推断和多模态融合在科学文档理解中的重要性，为实际应用提供了新基准。

Abstract: Reviewer comments naturally relate to specific parts of the reviewed paper, yet grounding these comments to the underlying evidence is difficult due to long multimodal documents. Existing benchmarks do not capture this setting and largely focus on explicit, information-seeking queries. We introduce ReGround, a large-scale dataset for reviewer comment grounding that links 10,267 reviewer comments to 16,274 evidence in the original anonymous submission of 3,656 papers. We build on a simple observation: author rebuttals often include explicit references to content of the submission used to address reviewer comments, providing a high-precision annotation source. We cast grounding as a retrieval task and evaluate a wide range of retrieval methods. Results show that retrieval over the entire paper content performs poorly, evidence-type inference is a major bottleneck, and multimodal evidence provides complementary signals that text alone misses. Our dataset exposes grounding reviewer comments as a difficult and practically important problem for scientific document understanding.

[15] Negative Self-Distillation: Learning to Reason by Avoiding Flaws cs.CL | cs.LGPDF

Rongcan Pei, Zhepei Wei, Shuyao Xu, Xinyu Zhu, Wei-Lin Chen

TL;DR: 本文提出了一种名为负自蒸馏（NSD）的新框架，用于改进大型语言模型在复杂推理任务上的性能。该方法通过让模型远离自身生成的错误推理轨迹（而非模仿特权信息下的解决方案）来优化模型，并引入动态门控机制来隔离推理关键标记，避免损害基础语言能力。

Details

Motivation: 针对现有在线自蒸馏（OPSD）方法在复杂推理任务中因强制模型模仿特权信息下的自信推理轨迹而抑制不确定性表达、惩罚自我纠正行为，导致性能严重下降的问题，旨在开发一种无需真实答案或外部监督的自我改进范式。

Result: 在实验中，NSD在复杂推理任务上持续优于OPSD及其他无标签、自举的强化学习基线方法，实现了更好的性能表现。

Insight: 创新点在于从“避免错误”而非“模仿正确”的角度进行模型优化，并设计了动态门控机制来解决错误推理标记与基础语言标记混淆的问题，从而在提升推理能力的同时保护模型的语言先验。

Abstract: On-Policy Self-Distillation (OPSD) has emerged as a popular paradigm for large language model (LLM) self-improvement, allowing models to act as their own teachers by leveraging privileged information such as ground-truth solutions. However, recent findings indicate that OPSD can severely degrade the performance of LLMs on complex reasoning tasks: By forcing the student to imitate an artificially confident reasoning trace conditioned on privileged information, OPSD inadvertently suppresses expressions of uncertainty and penalizes the exploratory, self-corrective behaviors required to solve challenging problems. To address this, we introduce Negative Self-Distillation (NSD), a new framework that optimizes LLMs by diverging from flawed reasoning rather than imitating privileged solutions. Instead of relying on ground-truth answers or external supervision, NSD uses the model itself to generate a question-specific negative condition (eg, acting as a ``careless reasoner’’) and pushes the student’s distribution away from this self-generated negative teacher. Naively applying unlearning objectives to achieve this divergence is problematic, as flawed reasoning tokens are confounded with basic linguistic tokens; indiscriminately penalizing both risks catastrophically degrading the model’s foundational language capabilities. We resolve this by designing a dynamic gating mechanism that automatically identifies and isolates reasoning-critical tokens, ensuring gradient updates target only behavioral flaws while preserving the model’s linguistic priors. Empirically, NSD consistently outperforms OPSD and other label-free, self-bootstrapping reinforcement learning (RL) baselines.

[16] The Eloquence submission for Task 2 of the Interspeech 2026 MLC-SLM challenge cs.CLPDF

Jordi Luque, Lorenzo Concina, Marco Matassoni, Alessio Brutti, Filippo Vella

TL;DR: 本文介绍了Eloquence团队在Interspeech 2026 MLC-SLM挑战赛任务2中的三种方法，该任务涉及21种语言的多语言多项选择题问答。方法包括：对Voxtral-Mini-3B模型进行LoRA微调并采用数据增强技术；对冻结的Voxtral-24B模型应用多模态上下文学习以纠正标签偏差；以及一个基于三层语音锚定记忆的无训练检索系统。所有方法均显著超越了官方基线。

Details

Motivation: 解决在21种语言的多语言MCQA任务中，如何有效利用语音和文本信息进行准确问答的问题，并探索不同技术路径以提升性能。

Result: 在评估第二阶段，LoRA微调方法达到0.72宏准确率；多模态上下文学习方法达到0.81，为最佳结果；无训练检索系统达到0.68。所有系统均大幅超越官方基线。

Insight: 创新点包括：结合跨语言数据增强、ASR转录增强和时间戳感知音频裁剪的微调策略；利用多模态上下文学习纠正大模型的标签偏差；以及构建融合声学身份、语义内容和知识图谱的语音锚定记忆进行无训练检索。这些方法为多模态、多语言QA提供了可借鉴的技术思路。

Abstract: This paper details the Eloquence team’s approach to Task 2 of the 2nd MLC-SLM challenge at Interspeech 2026, which involves multilingual Multiple-Choice Question Answering (MCQA) across 21 languages. Three approaches are explored. First, we fine-tune Voxtral-Mini-3B via LoRA with cross-lingual data augmentation, ASR transcript augmentation and timestamp-aware audio cropping, achieving 0.72 macro-accuracy on evaluation Phase 2. Second, we apply multimodal in-context learning (ICL) to the frozen Voxtral-24B model to correct a strong label bias, reaching 0.81, our best result. Third, a training-free retrieval system based on a three-layer voice-anchored memory combining acoustic identity, semantic content, and a knowledge graph achieves 0.68. All three systems substantially outperform the official baseline.

[17] Augustinian BabyLM: What Ostensive Definition Can and Cannot Teach a Small Language Model cs.CLPDF

Lisa Bylinina

TL;DR: 这篇论文探讨了在小型语言模型（BabyLM）中，通过视觉基础（ostensive definition）初始化词嵌入对模型学习的影响。作者在DeBERTa模型上进行了实验，将视觉相关的词汇（如物体名称）在训练前用图像区域特征初始化，而其他词汇则随机初始化。研究发现，这种视觉初始化对模型在抽象语法知识基准测试上几乎没有影响，但在物体属性知识（如颜色、材质、大小和形状）的零样本任务中表现出持续优势，且这种优势仅限于被初始化的词汇。

Details

Motivation: 动机是研究圣奥古斯丁的单词学习理论（通过指示定义）在语言模型中的应用，探索视觉基础初始化是否能提升模型对具体词汇的理解，特别是物体属性知识，同时评估其对抽象语法学习的影响。

Result: 在BabyLM基准测试中，视觉初始化对大多数抽象语法知识任务无显著影响；但在COMPS物体属性知识基准和定制的Visual-Property Swap基准上，视觉初始化模型在零样本设置中表现出持续且可复现的优势，且仅限于被初始化的词汇。合成基础化实验进一步证实了这种因果效应。

Insight: 创新点在于将视觉基础初始化引入小型语言模型，揭示了其对具体词汇属性学习的促进作用，但对抽象语法学习帮助有限；这提示当前评估基准可能无法全面捕捉视觉初始化带来的隐性收益，为多模态语言模型设计提供了新视角。

Abstract: A language model normally begins training with random word embeddings: whatever ‘banana’ means must be learned from training corpora. I implement St. Augustine’s picture of word learning, meaning by ostension, for a small masked language model (DeBERTa) trained on 10M words: before training, visually grounded tokens receive embeddings derived from the image regions they label; other tokens start random. Visual initialization leaves a measurable imprint that lasts until the end of training. At the same time, the effect remains invisible under most BabyLM benchmarks, which probe abstract grammatical knowledge: visual initialization does not affect performance there. The only zero-shot exception is object-property knowledge (COMPS, Misra et al. 2023), where seeding helps in every configuration. To follow up on this result, I build a corpus-tailored version of the Visual-Property Swap benchmark (Lin et al., 2026), which tests color, material, size, and shape knowledge, with per-item training frequency and seeded status. Here, vision-seeded models have a persistent, seed- replicated advantage, confined to the seeded words. As a causal test, I show that synthetic grounding of previously unseeded words transfers the advantage to exactly those words. Function words and abstract vocabulary also receive strong visual seeds and retain them throughout training, and the training objective draws on them: held-out mask-prediction loss falls for these words in every seed. However, no benchmark I run registers this. What evaluation would pick this up remains an open question.

[18] Domain-Specific Hallucination Detection in Large Language Models cs.CL | cs.AI | cs.LGPDF

Varun Teja Chundru, Debasmita Biswas

TL;DR: 本文提出了一种用于检测大语言模型生成文本中幻觉（不忠实陈述）的多信号检测流水线。该流水线结合了微调的DeBERTa-v3分类器、蒙特卡洛Dropout不确定性量化和温度缩放校准技术。在HaluEval基准测试中，该方法在通用领域任务上取得了优异性能，并进一步通过直接偏好优化（DPO）有效降低了生成模型的幻觉率。研究还发现，通用领域的检测模型在生物医学等特定领域表现不佳，凸显了领域特定微调的必要性。

Details

Motivation: 大语言模型生成的流畅文本中常包含不忠实的陈述（即幻觉），这限制了其可靠应用。现有方法在检测幻觉，尤其是在特定领域（如生物医学）的泛化能力上存在不足。

Result: 在HaluEval基准测试的通用领域任务上，该流水线取得了F1=0.915和AUROC=0.977的综合性能，在问答、摘要和对话子任务上F1分别为0.97、0.96和0.82。使用蒙特卡洛Dropout推理将准确率提升至93.2%。在SciFact生物医学基准上进行跨领域评估时，通用模型性能显著下降（F1=0.52），而使用PubMedBERT进行领域特定微调后，性能提升至F1=0.63和AUROC=0.81。此外，对Qwen2.5-0.5B生成器应用DPO后，其幻觉率从85.5%相对降低了55.9%，降至37.7%。

Insight: 论文的创新点在于构建了一个结合了微调分类、不确定性量化和校准的多信号检测流水线，实现了高性能的响应级幻觉检测。关键洞见是：1）模型确实在进行真正的蕴含推理，而非利用表面模式（上下文消融实验证实）；2）少量训练数据（25%）即可获得大部分性能（77%），数据效率高；3）通用领域的检测器在特定领域泛化能力差，强调了领域匹配的预训练模型进行微调是最高效的适应策略。

Abstract: Large language models generate fluent text that can contain unfaithful claims – a phenomenon known as hallucination. We present a multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo (MC) Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection. Evaluated on the HaluEval benchmark, our pipeline achieves F1=0.915 and AUROC=0.977 on general-domain tasks, with per-task F1 scores of 0.97 (QA), 0.96 (Summarization), and 0.82 (Dialogue). MC Dropout inference further improves accuracy to 93.2%. A context ablation study confirms the model performs genuine entailment reasoning rather than exploiting surface patterns, with summarization F1 dropping 24% when knowledge context is removed. Learning curve analysis reveals that 25% of training data captures 77% of full-data performance. Beyond detection, we apply Direct Preference Optimization (DPO) to a Qwen2.5-0.5B generator, reducing its hallucination rate from 85.5% to 37.7% (55.9% relative reduction) as measured by our detector. Cross-domain evaluation on the SciFact biomedical benchmark shows that general-domain training transfers poorly (F1=0.52), motivating domain-specific fine-tuning. PubMedBERT fine-tuned on SciFact achieves F1=0.63 and AUROC=0.81, demonstrating that domain-matched pre-training is the strongest adaptation strategy. Code and models are available at https://github.com/varunteja99/hallucination-detection-nlp

cs.CV [Back]

[19] MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery cs.CVPDF

Boshu Jia, Rongyu Chen, Linlin Yang, Zihao Liu, Yingjie Chen

TL;DR: 本文提出了一种用于单目3D手部和身体网格恢复的多假设学习与选择框架MHE-Former。该框架基于Transformer，通过熵最大化生成多样且合理的假设，并利用视觉语言模型（VLM）的上下文感知能力进行假设选择，以解决严重遮挡和歧义性问题。

Details

Motivation: 解决单目3D手部和身体网格恢复中因严重遮挡和歧义性导致的传统确定性方法预测过于自信、只能回归单一最优解的问题。

Result: 在多个数据集上的广泛实验表明，该框架在准确性和多样性方面达到了最先进的性能（SOTA），用户偏好研究进一步验证了假设选择过程的实用性。

Insight: 创新点在于将探索-利用范式引入歧义性网格恢复，提出了基于熵最大化的多假设Transformer框架（MHE-Former）以及利用VLM进行上下文感知的假设选择过程，实现了高效训练、标签友好且用户可控的多样化预测。

Abstract: Monocular 3D hand and body mesh recovery often suffers from severe occlusion and ambiguity. Traditional deterministic methods typically regress a single optimal solution, leading to overconfident predictions. In this paper, we introduce an exploration–exploitation paradigm for ambiguous mesh recovery with multi-hypothesis learning and selection. Specifically, during exploration, based on our probabilistic formulation and entropy maximization, we propose a novel multi-hypothesis method referred to as MHE-Former. It is a Transformer-based multi-hypothesis framework, ensuring high training efficiency and label friendliness while generating plausible and diverse hypotheses. During exploitation, we propose Hypothesis Selection, a context-aware process for multiple predictions. Especially leveraging VLM’s powerful visual understanding and reasoning capabilities, it allows users to choose the most plausible and desired estimate with additional evidence and natural language intent. Extensive experiments demonstrate that our framework achieves state-of-the-art performance in accuracy and diversity across multiple datasets. The user preference study further shows the practicality of our hypothesis selection process.

[20] Rethinking Handwritten Character Recognition cs.CV | eess.IVPDF

Ranjit Raut, Aarav Subedi, Ashim Shrestha

TL;DR: 本文提出GraphemeNet，一种统一的多文字手写字符识别架构，通过显式编码笔画结构几何规律作为归纳偏置，以提高准确性和参数效率。该架构由两个正交二元轴控制：轴1通过持久支架注入（PSI）操作笔画级几何规律，轴2根据字形识别是否需要空间关系推理，选择全局平均池化与门控融合或跨尺度注意力与笔画拓扑模块（STM）。

Details

Motivation: 非拉丁手写字符识别研究不足，主流方法将其视为通用图像分类，依赖模型规模隐式学习笔画结构，而显式编码文字几何规律作为架构归纳偏置可能更准确且参数更少。

Result: 在八个书写系统的十四个基准测试中，该架构仅随文字变化支架和解码器拓扑，普遍优于已发布的基线，证明了结构先验效率原则在多文字HCR中的广泛适用性。

Insight: 创新点包括持久支架注入（PSI）将笔画支架作为加权残差注入每个编码器阶段，持续锚定学习特征到文字几何；以及根据任务需求动态选择全局池化或跨尺度注意力机制，结合线性胶囊路由（LCR）实现高效路由。

Abstract: Non-Latin handwritten character recognition (HCR) remains understudied. Dominant methods consider it as generic image classification, which uses model scale to implicitly learn stroke structure. Structural-prior efficiency—the principle that explicitly encoding script-geometric regularities as architectural inductive biases can be both more accurate and require fewer parameters. We introduce GraphemeNet, a unified multi-script architecture, governed by two orthogonal binary axes. Axis 1 operationalises stroke-level geometric regularity via Persistent Scaffold Injection (PSI): a script-specific asymmetric convolution injects a stroke scaffold as a weighted residual at every encoder stage, continuously anchoring learned features to script geometry—distinct from skip connections, auxiliary losses, or attention reweighting. Axis 2 selects between global average pooling with gated fusion and cross-scale attention with a Stroke Topology Module (STM), depending on whether glyph discrimination requires spatial relational reasoning. A Linear Capsule Routing (LCR) with $O(n)$ routing is shared universally. On fourteen benchmarks across eight writing systems, the architecture generalises with only scaffold and decoder topology varying per script, consistently challenging, outperforming published baselines, and establishing structural-prior efficiency as a broadly applicable principle for multi-script HCR.

[21] Meta-Learning for Data-Efficient Plant Growth Estimation via Vision Transformers and Fuzzy Clustering cs.CV | cs.LGPDF

Sheikh Hasan Elahi, Rusith Chamara Hathurusinghe Dewage, Habib Ullah, Muhammad Salman Siddiqui, Rakibul Islam

TL;DR: 本文提出了一种结合视觉Transformer特征嵌入、模糊C均值聚类任务构建和基于梯度的元学习的少样本回归框架，用于解决植物生长估计中标注数据稀缺的问题。该方法利用未标注图像池通过聚类构建结构化任务，实现在少量标注样本下的高效学习。

Details

Motivation: 植物生长估计对温室监测至关重要，但获取标注数据成本高且耗时，因此需要开发数据高效的少样本学习方法。

Result: 在两个植物数据集上的实验表明，结构化任务设计与元学习结合能够在严重标签稀缺下实现可靠的植物生长估计；二阶元学习方法（如MAML++变体）在少样本场景下优于经典基线。

Insight: 创新点在于提出在嵌入空间进行基于聚类的任务构建是性能提升的关键驱动因素；同时发现簇内支持集选择的影响有限且依赖于数据集，这为少样本回归的任务设计提供了新见解。

Abstract: Accurate plant growth estimation is essential for greenhouse monitoring, yet obtaining labeled data remains costly and time-consuming. To address this, we propose a few-shot regression framework that combines Vision Transformer (ViT) feature embeddings, clustering-based task construction, and gradient-based meta-learning, and show that task construction in embedding space is a primary driver of performance. The approach leverages an unlabeled image pool to organize data into structured tasks using fuzzy c-means clustering, enabling efficient learning from a small number of labeled samples. We systematically evaluate meta-learning methods and show that second-order methods (e.g., Model-Agnostic Meta-Learning variants such as MAML++) outperform classical baselines in the few-shot regime. Furthermore, intra-cluster support selection has a limited and dataset-dependent impact. Experiments on two plant datasets show that structured task design combined with meta-learning enables reliable plant growth estimation under severe label scarcity.

[22] Evaluation of Vision-Language Models Across Diverse Coastal Environments cs.CV | cs.ROPDF

Seth Knoop, Chad R. Samuelson, Gabriel R. Slade, Brady Moon, Joshua G. Mangelson

TL;DR: 该论文评估了七种现代视觉语言模型在多样化海岸环境中的表现，通过文本到掩码、掩码到掩码和掩码到文本三种对齐实验，发现模型对海岸概念的识别最具挑战性，性能差异主要受分割和语言表示影响。

Details

Motivation: 视觉语言模型在海岸环境中的性能尚未得到充分探索，论文旨在填补这一空白，通过引入一个密集标注的海岸数据集来系统评估模型。

Result: 在夏威夷瓦胡岛三个区域收集的包含18个语义类别、超过7400个标注实例的数据集上评估，结果显示模型对广阔景观类别的识别通常比传统物体和海岸类别更准确，海岸概念表现最差，但环境背景本身并未导致一致的性能差异。

Insight: 创新点在于首次系统评估VLMs在海岸环境中的性能，并指出性能下降的关键因素在于分割质量和语言表示，而非单纯的环境差异；通过替代文本标签可显著提升某些海岸概念的识别，这为改进模型在特定领域的应用提供了方向。

Abstract: Vision-language models (VLMs) enable robotic per- ception by associating visual observations with natural-language concepts. Yet their performance in coastal environments remains largely unexplored. We introduce a densely labeled coastal dataset containing more than 1,000 images collected across seven missions in three regions of Oahu, Hawaii, with 18 semantic classes and over 7,400 annotated instances. We evaluate seven modern VLMs through three complementary experiments mea- suring text-to-mask, mask-to-mask, and mask-to-text alignment. Broad landscape classes are generally recognized more accurately than conventional object and coastal classes, with coastal con- cepts presenting the greatest challenge. However, comparisons of shared conventional classes across coastal and terrestrial datasets reveal no consistent performance difference attributable solely to environmental context. Mask-to-mask matching also remains similar across conventional and coastal classes, while alternative textual labels substantially improve recognition of several coastal concepts. These results suggest that lower performance on coastal classes (at least on the objects/query categories evaluated) is heavily influenced by segmentation and linguistic representation.

[23] BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generation cs.CV | cs.CLPDF

Karish Gupta, Matthew Alex, Alex Li, Yang Wu, Yun-Wei Chu

TL;DR: 本文提出了一种名为BodyCam-VQA的自适应视觉问答框架，旨在通过多模态推理和探测问题生成来增强警用随身摄像机视频的描述能力。该框架针对BWC视频中常见的低质量、快速移动和高噪声音频等挑战，采用结构化推理方法提取细粒度视觉证据，以弥补传统字幕系统在关键法医细节上的不足。

Details

Motivation: 警用随身摄像机视频对于确保执法透明度、问责制和保护公民权利至关重要，但其多模态视频格式（如低视觉质量、快速移动和高噪声音频）使得有效处理这些数据成为挑战。现有视觉语言模型经常忽略关键的法医细节，如证据存在或警民互动的细微差别，这影响了公正的法律结果和人员安全。

Result: 实验使用了多种问题生成模型，包括基础模型和微调的开源模型，以观察不同实现之间的性能差异。结果表明，该VQA驱动架构为执法事件提供了更可靠、客观和详细的记录，可作为AI辅助法医清晰度的强大工具。

Insight: 创新点在于将自适应VQA框架应用于高风险的执法场景，通过结构化推理和探测问题生成来提取传统字幕系统无法捕获的细粒度视觉证据。从客观角度看，该方法强调了多模态推理在复杂、嘈杂视频数据中的重要性，并为特定领域（如执法）的视觉语言模型应用提供了新思路。

Abstract: Police body-worn camera (BWC) footage has emerged as a critical aspect of law enforcement that ensures legal transparency, officer accountability, and the protection of civil rights. However, effectively processing this data remains a significant challenge due to its multimodal video format. BWC videos, in many cases, comprise chaotic scenes with low visual quality, rapid movement/interactions, and high-noise audio that make visual understanding a challenge for even SOTA multimodal models. Current Vision-Language Models (VLMs) frequently overlook critical forensic details, such as the presence of valuable evidence or the latent nuances of suspect-officer interactions, which are vital for fair legal outcomes and civilian/officer safety. To address these limitations, we propose an Adaptive Visual Question Answering (VQA) framework engineered for high-stakes law enforcement. Our framework employs a structured reasoning approach to extract fine-grained visual evidence that traditional captioning systems fail to capture. We experiment with multiple question generation models, including foundation models and fine-tuned open-weight models, to observe performance variation among question generation model implementations. Our results demonstrate that this VQA-driven architecture provides a more reliable, objective, and detailed record of enforcement events, ultimately serving as a powerful tool to protect both law enforcement officers and the public through AI-assisted forensic clarity.

[24] HiPerViT: A Hierarchical Perceiver-Vision Transformer Architecture for Multi-Scale Texture Recognition cs.CVPDF

João Pedro C. A. de Sá, Odemir Martinez Bruno

TL;DR: 本文提出了HiPerViT，一种用于多尺度纹理识别的分层感知器-视觉Transformer架构。该方法通过将紧凑的双线性描述符编码为统计令牌，并将其与一阶空间表示通过感知器式潜在蒸馏相结合，将显式的二阶统计先验注入到基于Transformer的识别流程中。

Details

Motivation: 现代视觉模型在纹理识别方面仍面临挑战，因为判别性证据通常由高阶空间统计而非仅由物体形状携带。标准的以物体为中心的表示无法显式暴露此类统计结构，限制了在细粒度识别场景中的纹理敏感性。

Result: 在六个纹理识别基准测试（包括DTD、GTOS-Mobile和1200Tex）上，HiPerViT在报告的评价协议下相比仅视觉的强基线模型取得了一致的改进，例如在DTD上提升了3.05个百分点，在GTOS-Mobile上提升了10.48个百分点，在1200Tex上提升了10.10个百分点。

Insight: 创新点在于将二阶统计信息作为一等表示信号进行显式令牌化，并通过感知器式潜在蒸馏实现空间令牌与二阶特征共现统计的直接交互。分析表明，性能提升主要源于二阶统计信息的显式可用性，而非特定的融合拓扑结构，这为以纹理为中心的视觉识别提供了一种有效且鲁棒的设计原则。

Abstract: Texture recognition remains challenging for modern vision models because discriminative evidence is often carried by higher-order spatial statistics rather than by object shape alone. While Vision Transformers provide strong long-range modeling capacity, their standard object-centric representations do not explicitly expose such statistical structure, which limits texture sensitivity in fine-grained recognition settings. We present HiPerViT, a compact vision-only architecture that injects an explicit second-order statistical prior into a transformer-based recognition pipeline. The method combines global and local image views with a compact bilinear descriptor encoded as a statistical token, and integrates this token with first-order spatial representations through Perceiver-style latent distillation. This design enables direct interaction between spatial tokens and second-order feature co-occurrence statistics, providing the model with explicit access to texture-relevant information without requiring multimodal pretraining or ensemble construction. Across six texture recognition benchmarks, HiPerViT achieves consistent improvements over strong vision-only baselines under the reported evaluation protocols, including gains of +3.05 percentage points on DTD, +10.48 on GTOS-Mobile, and +10.10 on 1200Tex. Beyond benchmark performance, our analyses show that these gains are largely invariant to the backbone depth used to extract second-order statistics and to the ordering of interaction and distillation stages. This pattern suggests that the primary source of improvement is not a specific fusion topology, but the explicit availability of second-order statistical information as a first-class representational signal. These results support explicit statistical tokenization as an effective and robust design principle for texture-centric visual recognition.

[25] CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation cs.CVPDF

Yang Wu, Stefano Petrangeli, Ishita Dasgupta, Yu Shen

TL;DR: CamPilot是一个多智能体框架，旨在通过整合电影摄影规划和镜头控制来生成更连贯、逻辑结构更优且符合人类审美的电影。它采用基于GRPO的学习范式，从14K部真实世界专业电影中学习镜头工作规划，内化运动模式和构图原则，以支持对拍摄技术和跨镜头关系的推理，从而实现可控的摄像机视点生成。

Details

Motivation: 当前基于大语言模型的视频生成在文本到视频创建方面虽有进步，但在专业电影制作层面仍显不足，其电影摄影语言不如人工设计的镜头工作精细，且多镜头连续性面临挑战。

Result: 实证结果表明，CamPilot在电影摄影控制和生成质量上优于最先进的文本到电影生成方法，突显了专业镜头设计对电影生成的影响。研究还建立了CamEval基准，用于评估镜头工作质量和电影参与度。

Insight: 论文的创新点在于提出了一个多智能体协作框架，通过从大规模专业电影数据中学习来内化镜头运动模式与构图原则，实现了对拍摄技术和跨镜头关系的可控生成，从而提升了生成电影的连贯性与美学质量。

Abstract: The integration of large language models (LLMs) into video generation has enabled rapid text-to-video creation and improved visual quality. However, it still falls short of professional filmmaking, where cinematographic language is less refined than human-crafted camera work and multi-shot continuity remains challenging. To address these limitations, we introduce CamPilot, a multi-agent framework that integrates cinematographic planning and camera-work control to produce more coherent, logically structured, and human-aesthetic movies. CamPilot adopts a GRPO-based learning paradigm to learn camera work planning from 14K real-world professional movies, internalizing motion patterns and composition principles that support reasoning over shooting techniques (e.g., camera angle, motion, and focal behavior) and cross-shot relationships for controllable camera-viewpoint generation. Multiple agents further collaborate and evolve to improve overall output quality. To support this work and further studies in this domain, we establish CamEval, a benchmark for evaluating camera work quality and cinematic engagement. Empirical results show that CamPilot outperforms state-of-the-art text-to-movie generation methods on cinematographic control and quality, highlighting the impact of professional camera design on movie generation.

[26] New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

Sourajit Saha, Shubhashis Roy Dipta, Nobin Sarwar, Shaswati Saha, Yuxuan Jiang

TL;DR: 本文研究视觉语言模型在物理推理任务中是否能够根据已有证据决定何时直接回答问题，以及何时需要选择额外的实验来获取更多信息。作者设计了一个受控评估基准，通过匹配的问题对来测试模型在改变观测测量或问题时的决策能力。

Details

Motivation: 现有物理推理基准通常只评估最终答案，无法直接衡量模型在证据选择方面的决策能力，因此需要一个新的评估方法来分离证据选择和最终答案的评估。

Result: 在六个开放模型和144个物理参数集上的实验表明，直接响应时模型在95.1%到100%的图像对中重复相同动作，即使正确动作已改变；最佳模型在推理后也仅能在5.9%的图像对中正确做出两项决策。

Insight: 论文的创新点在于设计了一个专门评估物理实验选择决策能力的基准，揭示了传统答案准确性可能忽略的物理推理局限性，如测量解释、物理推理和响应格式方面的失败。

Abstract: A model first sees an image from one physical measurement experiment, such as how far a block coasted, and must answer a question about a new trial, such as whether the block will pass a target after a fixed push. The initial experiment may provide enough information to answer, or the model may need another measurement, such as the object’s mass, friction, restitution, or spring stiffness. We study whether vision language models can decide when to answer immediately and, when more evidence is needed, which experiment to perform. Current physical reasoning benchmarks usually evaluate only the final answer, so they do not directly measure this decision-making ability. We introduce a controlled evaluation where each problem provides one measurement image and four possible physical worlds created by combining two possible masses and two possible values of another relevant property. The model must either stop and answer or select the cheapest additional experiment that can resolve the question. We construct matched problem pairs where changing either the observed measurement or the question changes the optimal action. Since all possible worlds and experiment costs are known, we can explicitly determine the optimal choice. Across six open models and 144 physical parameter sets, direct responses repeat the same action for 95.1% to 100% of image pairs even when the correct action changes. Brief reasoning improves action switching, but the best model makes both decisions correctly for only 5.9% of image pairs. Additional analysis reveals failures in measurement interpretation, physical reasoning, and response formatting. By evaluating evidence selection separately from final answers, our benchmark reveals limitations in physical reasoning that conventional answer accuracy can overlook.

[27] Toward Interpretable Multimodal Fusion: Heat Conduction Modeling for Hyperspectral and LiDAR Joint Classification cs.CV | cs.AIPDF

Kan Wei, Jiahui Cui, Jing Yao, Xinyu Zhao, Lei Wang

TL;DR: 本文提出了一种名为M2Heat的物理启发式多模态融合框架，用于高光谱（HS）和激光雷达（LiDAR）数据的联合分类。该框架通过模拟热传导过程，利用物理驱动的视觉热传导模块（vHeat）和增强的频率值嵌入（FVEs）来捕捉长程依赖和各向异性交互，并结合跨频率融合（CFF）策略生成判别性特征。

Details

Motivation: 现有多模态融合方法难以在保持计算效率的同时，有效建模长程依赖和复杂的各向异性交互，这限制了高光谱与激光雷达数据融合在土地覆盖分类中的性能提升。

Result: M2Heat在Trento、Houston2013和Augsburg三个基准数据集上取得了具有竞争力的总体性能，表明其有效性。

Insight: 创新点在于将热传导物理模型引入多模态融合，通过vHeat模块和FVEs实现具有物理可解释性的全局依赖建模，且计算复杂度低于二次方；同时，CFF模块提供了一种混合空间-频率融合策略，增强了特征的鲁棒性和判别力。

Abstract: The fusion of hyperspectral (HS) and Light Detection and Ranging (LiDAR) data plays a crucial role in enhancing land-cover classification by jointly exploiting spectral, spatial, and structural cues. However, existing multimodal fusion methods still struggle to model long-range dependencies and complex anisotropic interactions while maintaining computational efficiency. This paper introduces M2Heat, a physics-inspired framework that investigates multimodal fusion through the lens of heat conduction. At its core, a physics-driven visual heat conduction module (vHeat) and enhanced Frequency Value Embeddings (FVEs) simulate anisotropic information flow, enabling the capture of global dependencies with sub-quadratic complexity and physical interpretability. This mechanism, combined with a hybrid spatial-frequency fusion strategy named Cross-Frequency Fusion (CFF) module, produces highly discriminative and robust feature representations. M2Heat achieves competitive overall performance on three benchmarks, i.e., Trento, Houston2013, and Augsburg, while providing an interpretable heat-conduction-guided perspective for multimodal feature fusion. These results indicate the potential of heat-conduction-guided neural operators for efficient and interpretable RS multimodal fusion. The source code is publicly available at https: /github.com/Weikan0425/M2Heat_HSI_LiDAR.

[28] TailProp: content-adaptive light- and heavy-tailed propagation for vision cs.CV | cs.LGPDF

Jiahao Kong, Zihan Li

TL;DR: 本文提出TailProp，一种基于尾部传播算子（TPO）的分层视觉骨干网络，通过结合高斯和柯西稳定过程传播器作为互补基，实现内容自适应的轻尾和重尾传播，以替代传统的令牌混合机制。该方法在图像分类、目标检测、语义分割、鲁棒性和跨骨干网络恢复等任务中均优于匹配的传播基线。

Details

Motivation: 现有视觉传播模型通常在特定动力学族内构建和适应传播，而视觉表示在不同样本、通道和网络阶段可能需要显著不同的空间交互，因此需要探索跨机制的自适应传播。

Result: TailProp-B在ImageNet-1K上达到84.4%的Top-1准确率，在3x Mask R-CNN设置下获得50.3/44.8的框/掩码AP，在ADE20K上达到50.8% mIoU，均优于基线模型。

Insight: 创新点在于使用高斯和柯西稳定过程作为互补传播基，并通过内容条件化的通道系数自适应融合它们，在DCT域中直接融合响应以实现高效计算；消融实验表明，这种互补双基传播设计是视觉表示学习的有效原则，而非单基传播或同族分支所能替代。

Abstract: Science-inspired vision models show that explicit propagation dynamics can provide structured and interpretable alternatives to conventional token mixing. Existing formulations, however, typically construct and adapt visual propagation within a particular dynamical family, while visual representations can require substantially different spatial interactions across samples, channels, and network stages. We explore cross-regime adaptive propagation and introduce TailProp, a hierarchical vision backbone built upon the Tail Propagation Operator (TPO). TPO uses Gaussian and Cauchy stable-process propagators as complementary bases with rapidly decaying and heavy-tailed spatial influence, and predicts a content-conditioned channel-wise coefficient to adaptively combine them. Because this coefficient is spatially shared, the two responses are fused directly in the DCT domain with a single DCT/IDCT pair, yielding $O(N^{1.5})$ spatial mixing for square feature maps with $N=HW$ and fixed channel width. Across image classification, object detection, semantic segmentation, robustness, and cross-backbone restoration, TailProp consistently outperforms matched propagation baselines; TailProp-B reaches 84.4% Top-1 accuracy on ImageNet-1K, 50.3/44.8 box/mask AP under the 3x Mask R-CNN schedule, and 50.8% mIoU on ADE20K. Controlled ablations further show that these gains are not explained by single-basis propagation, an additional same-family branch, or within-family adaptive order alone, supporting complementary two-basis propagation as an effective design principle for visual representation learning.

[29] Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions cs.CV | cs.AI | cs.ETPDF

Dieuwertje Alblas, Alma M. Liezenga, Jan Erik van Woerden, Fedor Taggenbrock, Dalia Aljawaheri

TL;DR: 本文探讨了利用视觉语言模型（VLMs）加速分类模型验证与确认（V&V）过程的方法，特别是在国防领域。作者提出了一种基于VLM的错误切片检测（ESD）方法，能够自动分组和标记分类模型的系统性错误，并在非军事和军事数据集上进行了初步评估。

Details

Motivation: 当前分类模型的V&V过程依赖耗时的手动错误样本检查，本文旨在利用VLMs的语义嵌入能力来自动化这一过程，以加速V&V，尤其关注国防领域因训练数据不足和上下文多样性低带来的挑战。

Result: 在非军事数据集上，该方法成功识别了操作相关的人工添加扰动；在军事上下文中，它能基于图像周围环境进行聚类和描述，但存在聚类描述重叠的问题。结果尚未支持完全自动化的V&V，但表明VLMs有潜力加速未来V&V流程。

Insight: 创新点在于将VLMs应用于V&V的错误切片检测，通过语义嵌入提取人类可解释的系统性错误，为国防等数据稀缺领域提供了自动化V&V的新思路，尽管仍需解决嵌入变异和聚类重叠等问题。

Abstract: Verification and validation (V&V) of classification models is crucial to enable a wide range of sensor processing applications. Currently, the V&V process relies on time-consuming manual inspection of erroneous samples to find meaningful patterns. This work explores the use of Vision Language Models (VLMs) to speed up this laborious process. VLMs are trained to embed images into a semantically meaningful vector representation, from which human-interpretable systematic errors can be distilled. Deploying such VLM-based methods in a defence context introduces two major challenges: (1) the defence domain is underrepresented in the training data of VLMs, and (2) surroundings and context are less diverse than for other domains. This study provides an initial assessment of the suitability of VLM-based methods for V&V of defence applications. We propose a VLM-based error slice detection (ESD) method that independently groups and labels systematic errors made by a classification model. We demonstrate that this method is able to identify operationally-relevant artificially added perturbations in a non-military dataset. In a military context, our method clusters and describes images based on their surroundings, but also exhibits overlap between cluster descriptions. We further investigate the difference in embedding variation between our military and non-military dataset, which remains a topic of interest. Although the results do not yet warrant fully automated V&V through VLM-based ESD, they show that VLMs could be used to accelerate V&V processes in the future.

[30] Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval cs.CV | cs.AIPDF

Yilin Long, Chenming Zhu, Zitang Gou, Jingli Lin, Tai Wang

TL;DR: 本文提出了EgoGenEval基准，用于评估视觉生成模型在自我运动（ego-motion）下的物理一致性，发现现有模型难以同时保持相机运动准确性和场景状态稳定性。研究还通过构建EgoGen-Train数据集进行监督微调实验，表明成对监督目标存在局限性，并提出了轨迹中心范式的改进方向。

Details

Motivation: 当前视觉生成器能产生高保真图像，但在自我运动下常违反物理一致性，限制了其在空间推理和具身规划中的应用。现有基准主要关注单张图像质量，缺乏对此问题的系统性评估。

Result: 在包含1400个案例和2360个目标视图的EgoGenEval基准上评估了16个无姿态条件生成器和2个有姿态条件参考模型，结果显示所有模型在相机运动接地（CMG）和场景状态保持（SSP）两个指标上均无法同时表现良好。监督微调实验表明，即使使用全部训练数据，场景状态保持的改进也远低于相机运动接地。

Insight: 创新点在于提出了首个几何基础、无需姿态先验的基准来量化评估自我运动下的物理一致性，并揭示了成对教师强制目标的固有局限，为开发结合自条件展开与显式姿态/可见性监督的轨迹中心范式提供了动机。

Abstract: Recent visual generators produce high-fidelity images yet often violate physical consistency under ego-motion, limiting their use for spatial reasoning and embodied planning. Existing benchmarks largely focus on isolated images or single-step quality, leaving this challenge underexplored. We introduce EgoGenEval, a geometry-grounded, pose-free benchmark designed to evaluate the physical consistency of visual generators under ego-motion, and organize our study into two parts. (1) EgoGenEval contains 1,400 cases and 2,360 target views spanning single-step and multi-step ego-motion. It separately measures Camera Motion Grounding (CMG) and Scene State Preservation (SSP), with both metrics validated against blinded human judgments. Evaluating 16 pose-free generators together with two pose-conditioned references reveals that current models struggle to execute camera motion while maintaining scene state, and that no system performs well on both axes at once. (2) To examine whether benchmark-derived data can improve these capabilities, we build EgoGen-Train from the same geometry-grounded pipeline and run controlled SFT studies. These show that pairwise supervision does not reliably improve camera-motion grounding and scene-state preservation together: even at the full training pool and the longest budget, scene preservation gains a fraction of what camera motion does. This points to the pairwise teacher-forced objective itself as the binding constraint, motivating a trajectory-centric paradigm that couples self-conditioned rollouts with explicit pose and visibility supervision.

[31] CEM-TUDASR: Computationally efficient multi-modality transformer based unsupervised domain adaptive super-resolution approach cs.CVPDF

Anjali Sarvaiya, Jay Kadel, Kishor Upla, Kiran Raja

TL;DR: 本文提出了一种名为CEM-TUDASR的计算高效、基于Transformer的无监督域自适应超分辨率框架，用于提升无线胶囊内窥镜（WCE）图像质量。该方法利用域自适应退化网络从传统内窥镜HR图像合成逼真的WCE风格LR图像，以弥合域差距并实现有效的非配对学习。SR生成器集成了深度注意力块和融合注意力块，以捕获长程上下文依赖和精细局部结构，同时保持感知和结构保真度。

Details

Motivation: 无线胶囊内窥镜（WCE）因微型光学、传感器限制和无线传输约束，产生低分辨率图像，降低了诊断关键结构的可见性。本文旨在无需配对的LR-HR训练数据，开发一种计算高效的WCE图像增强方法。

Result: 在KID和GIANA数据集上进行跨数据集评估，无参考质量指标（BRISQUE, PIQE, NIQE, EndoQM）显示CEM-TUDASR持续优于现有无监督SR方法。定性结果也显示其在恢复黏膜纹理、血管模式和临床相关解剖细节方面有改进。模型参数量仅267万，计算量为169.94 GFLOPs，在保持计算效率的同时实现了高质量重建。

Insight: 创新点包括：1）域自适应退化网络，用于合成逼真的域特定LR图像以弥合域差距，实现有效的无监督学习；2）集成深度注意力块和融合注意力块的SR生成器，有效结合全局上下文与局部细节；3）整个框架在保持高重建质量的同时，具有计算高效性，适合资源受限的临床和嵌入式应用。

Abstract: Wireless Capsule Endoscopy (WCE) enables non-invasive visualization of the gastrointestinal tract, but its miniaturized optics, sensor limitations, and wireless transmission constraints result in low-resolution images with reduced visibility of diagnostically important structures. This paper proposes CEM-TUDASR, a computationally efficient unsupervised Transformer-based super-resolution framework for WCE image enhancement without paired low-resolution (LR) and high-resolution (HR) training data. A domain-adaptive degradation network synthesizes realistic WCE-like LR images from HR conventional endoscopy images, reducing the domain gap and enabling effective unpaired learning. The SR generator integrates Deep Attention Blocks (DABs) and a Fusion Attention Block (FAB) to capture long-range contextual dependencies and fine local structures while preserving perceptual and structural fidelity. The model is trained on a curated dataset derived from Kvasir Capsule and evaluated on KID and GIANA for cross-dataset generalization. No-reference quality metrics, including BRISQUE, PIQE, NIQE, and the domain-specific EndoQM, show that CEM-TUDASR consistently outperforms existing unsupervised SR methods. Qualitative results further demonstrate improved restoration of mucosal textures, vascular patterns, and clinically relevant anatomical details. Cross-domain experiments on retinal images additionally demonstrate the adaptability of the framework. With only 2.67 million parameters and 169.94 GFLOPs, CEM-TUDASR achieves high-quality reconstruction while maintaining computational efficiency, making it suitable for resource-constrained clinical and embedded endoscopic applications.

[32] Tri-DehazeGS: Scene–Medium Decoupled Gaussian Splatting with Transmittance-Aware Optimization cs.CVPDF

Kui Jiang, Yang Gu, Jiacheng Liu, Shiyu Liu, Youyu Chen

TL;DR: 本文提出Tri-DehazeGS，一种场景-介质解耦的高斯泼溅框架，用于从有雾的多视角图像中恢复干净的3D场景。该方法使用高斯基元表示干净场景，通过独立的视图共享三平面场建模参与介质，并利用物理散射模型合成有雾观测。此外，还引入了介质解耦透射率梯度补偿（MD-TGC）来优化低透射率区域的梯度，从而改善重建质量。

Details

Motivation: 现有基于散射感知的高斯泼溅方法在图像空间引入退化或将介质相关变量绑定到高斯基元，导致干净场景辐射与大气效应纠缠不清。此外，低透射率区域为高斯优化提供的监督信号较弱，导致远处或浓雾区域重建不足。

Result: 在真实和合成的有雾基准测试上的实验表明，Tri-DehazeGS改善了干净新视角的重建质量。

Insight: 核心创新在于将场景表示（高斯泼溅）与介质建模（三平面场）解耦，并通过MD-TGC机制在冻结介质后补偿被雾抑制的梯度，实现了对低透射率区域的优化再平衡，这为恶劣天气条件下的3D重建提供了新思路。

Abstract: Recovering clean 3D scenes from hazy multi-view images is challenging because haze attenuates scene radiance and introduces atmospheric scattering. Recent scattering-aware Gaussian Splatting methods introduce physical haze models into reconstruction, but they often apply degradation in image space or bind medium-related variables to Gaussian primitives, which can entangle clean scene radiance with atmospheric effects. Moreover, low-transmittance regions provide weakened supervision for Gaussian optimization, causing distant or dense-haze areas to be under-reconstructed. We argue that clean reconstruction under haze requires both scene–medium disentanglement and transmittance-aware optimization rebalancing. To this end, we propose Tri-DehazeGS, a scene–medium decoupled Gaussian Splatting framework. It represents the clean scene with Gaussian primitives, models the participating medium using an independent view-shared tri-plane field, and composes hazy observations through a physical scattering model. We further introduce Medium-Decoupled Transmittance Gradient Compensation (MD-TGC), which compensates haze-suppressed gradients after medium freezing without altering forward rendering. Experiments on real and synthetic haze benchmarks show that Tri-DehazeGS improves clean novel-view reconstruction. Code is available at https://github.com/aptx46/Tri-DehazeGS.

[33] HALDETECT at ImageEval 2026 Shared Tasks: Answer-First Contrastive Grounding with QLoRA cs.CV | cs.AIPDF

Syed Mohaiminul Hoque, Md Sakhawat Hossain

TL;DR: 本文介绍了HALDETECT系统，该系统针对ImageEval 2026共享任务中的英文幻觉检测赛道（Task 1b），旨在从图像和三个文化上合理的陈述中识别出唯一基于视觉的陈述。该方法将任务构建为对比决策，采用先输出答案后解释的推理结构，并围绕颜色/纹理、形状/形式和上下文进行推理。最佳提交的适配器使用4位QLoRA对Qwen2.5-VL-7B-Instruct进行微调，同时冻结视觉编码器，在1000项测试集上达到对比不稳定性（CI）0.035，在八支队伍中排名第三。

Details

Motivation: 大型多模态模型倾向于流畅地产生视觉细节的幻觉，这限制了其在细粒度解释任务中的部署。因此，需要开发能够准确检测幻觉的系统，以提升模型在视觉基础任务中的可靠性。

Result: 在ImageEval 2026的Task 1b测试集上，HALDETECT系统达到了对比不稳定性（CI）0.035，在八支参赛队伍中排名第三。开发实验表明，答案顺序的影响可能超过模型规模，而微调（adaptation）的效果优于仅使用提示（prompting）。

Insight: 创新点包括将幻觉检测任务构建为对比决策，并采用’答案优先’（Answer-First）的推理结构。客观分析认为，使用QLoRA进行高效参数微调（冻结视觉编码器）是有效的技术路径，但实验也揭示了模型性能对随机种子和数据规模的敏感性，表明结果的可复现性需要谨慎评估。

Abstract: Large multimodal models tend to hallucinate visual detail fluently, which limits their deployment for fine-grained interpretation. We present HALDETECT, our system for the English hallucination-detection track (Task 1b) of ImageEval 2026, in which a system must identify, from an image and three culturally plausible statements, the single visually grounded one. We frame the item as one contrastive decision, emit the answer before its explanation, and structure reasoning around colour/texture, shape/form, and context. Our best submitted adapter fine-tunes Qwen2.5-VL-7B-Instruct with 4-bit QLoRA while freezing the vision encoder and reaches Contrastive Instability (CI) 0.035 on the 1,000-item test set; we placed third of eight teams. Development experiments show that answer order can matter more than model scale and that adaptation beats prompting alone. Retrospective paired analysis of the released gold labels confirms the QLoRA gain over the best prompt but not the small gap between the devtest-selected and best-test adapters, and reseeding all four training sizes shows that the apparent data-scaling curve does not survive a seed change. The 35 residual errors are culturally plausible function, material, and recognition distinctions; naive adapter voting does not help.

[34] Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation cs.CVPDF

Zixuan Duan, Xunzhi Xiang, Yabo Chen, Xin Zhang, Changhan Liu

TL;DR: 本文提出Uncertainty DMD方法，以解决自回归视频生成模型在少步蒸馏中出现的多样性崩溃问题。该方法通过在生成过程的关键阶段注入不确定性，即对首帧块进行时间步扰动以增加初始多样性，并对后续帧块采用随机缓存写入机制以保持自回归条件中的随机性，从而恢复视频的动态变化和多样性。

Details

Motivation: 动机是解决自回归视频生成模型在少步蒸馏（如DMD）后出现的多样性崩溃问题，即不同噪声样本在相同提示下生成高度相似且动态减弱的视频，这源于不确定性在自回归过程中的结构化崩溃。

Result: 实验表明，Uncertainty DMD在保持可比单样本视觉质量的同时，一致地提升了生成视频的多样性和运动动态，但摘要未具体提及基准测试或与SOTA的比较结果。

Insight: 创新点在于识别出自回归视频蒸馏中多样性崩溃的根本原因——结构化不确定性崩溃，并提出一种无需架构改动、仅引入轻量扰动操作的训练与推理统一框架，通过针对性注入不确定性来恢复生成过程的随机性。

Abstract: Few-step distillation improves the efficiency of autoregressive (AR) video generation, but often causes diversity collapse: under the same prompt, different noise samples tend to produce highly similar videos with weakened motion dynamics. We analyze this degradation in Distribution Matching Distillation (DMD)-distilled AR video generators and find that, in the autoregressive setting, it takes the form of a structured uncertainty collapse: the mode-seeking bias of DMD maps different noise samples to nearly identical first chunks, and the deterministic AR cache then propagates this collapsed state to all subsequent chunks, turning a local loss of stochasticity at the rollout root into a global suppression of temporal variation. Based on this analysis, we propose Uncertainty DMD, a simple uncertainty-injection framework that restores stochasticity at two key stages of AR generation: a timestep perturbation for the first chunk to increase first-chunk diversity, and a stochastic cache-writing mechanism for later chunks to preserve uncertainty in autoregressive conditioning. The method requires no architectural changes and introduces only lightweight perturbation operations. The same perturbation mechanisms are used during both training and inference. Experiments show that Uncertainty DMD consistently improves diversity and motion dynamics while maintaining comparable per-sample visual quality.

[35] From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models cs.CV | cs.AIPDF

Meng Luo, Yicheng Liu, Jiahao Wang, Yuanxing Zhang, Xin Tao

TL;DR: 本文提出了VWG-Bench，一个用于全面评估视频生成模型‘随视频思考’能力的基准测试，涵盖9个推理维度和38个细粒度任务。同时，作者开发了Vid-PRE，一个与模型无关的提示词重写器，通过强化学习优化提示，以显著提升现有视频生成模型在复杂逻辑任务上的推理性能。

Details

Motivation: 当前视频生成模型在视觉质量和时序连贯性上表现良好，但其是否真正具备‘随视频思考’的能力（如执行符号规则、遵循物理定律、实现有意图的目标）仍是一个开放性问题。现有基准测试往往混淆视觉质量与认知正确性，无法对此进行有效评估。

Result: 对主流模型的评估揭示了显著差距：模型在渲染质量上得分很高，但在逻辑密集和规则约束的任务上持续失败。实验表明，提出的Vid-PRE方法无需修改生成器架构，即可在多个生成器上带来显著的推理能力提升。

Insight: 主要创新点在于：1) 提出了一个全面、多维度、细粒度的视频世界通用基准测试VWG-Bench；2) 设计了一个三层‘VLM-as-Judge’评估协议，独立评估视频流畅度、任务规则遵循度和样本目标实现度；3) 提出了Vid-PRE，一种利用纯文本奖励进行强化学习训练的提示词增强方法，将推理负担卸载给专门的视觉语言模型，从而稳定、可扩展地提升视频生成模型的推理能力。

Abstract: Video generation has advanced to produce visually compelling and temporally coherent results. Yet, whether these models can genuinely think with video–executing symbolic rules, respecting physical laws, and pursuing intentional goals–remains an open question. Existing benchmarks only partially address this, often conflating visual quality with cognitive correctness. We introduce VWG-Bench (Video World Generalist Benchmark), a comprehensive benchmark spanning 9 reasoning dimensions and 38 fine-grained tasks. To enable precise diagnosis, we design a three-level VLM-as-Judge protocol that independently assesses video-level fluency, task-level rule adherence, and sample-level goal realization. Evaluations of leading models reveal a striking gap: while models achieve strong rendering scores, they consistently fail on logic-heavy and rule-constrained tasks. To address this, we propose Vid-PRE (Video Prompt Reasoner and Enhancer), a model-agnostic prompt rewriter that offloads the cognitive burden of reasoning to a dedicated VLM. Trained via reinforcement learning with purely text-based rewards, Vid-PRE produces concise, constraint-aware prompts without the instability of video-level reward signals. Experiments show that Vid-PRE yields substantial reasoning improvements across multiple generators without architectural modifications. Together, VWG-Bench and Vid-PRE offer a rigorous diagnostic lens and a scalable path toward true think-with-video capabilities. All data and code are publicly available at https://huggingface.co/datasets/KlingTeam/VWG-Bench.

[36] Your Model Already Knows Don’t Teach It, Learn to Ask It: Soft Prompting for Few-Shot Adaptation of Vision-Language Models cs.CV | cs.AI | cs.LG | eess.IV | stat.MLPDF

Gautam Rajendrakumar Gare, Siyi Li, Hewei Wang, Cesar Daniel Hernandez, Wei Zhao

TL;DR: 本文提出了一种针对视觉语言模型（VLMs）的少样本适应方法——软提示（soft prompting），通过优化少量连续提示令牌而非微调模型权重，在仅使用10张标注图像的情况下，有效适应航空、工业和医疗等域外场景的少样本目标检测任务。该方法在保持预训练主干冻结的同时，通过优化放置在视觉与文本令牌交叉模态边界处的提示令牌，实现了与LoRA相当的性能，且参数效率极高（平均仅7,168个参数），同时避免了灾难性遗忘问题。

Details

Motivation: 解决视觉语言模型在少样本、域外场景（如航空、工业、医疗图像）下的适应问题，现有方法如离散提示优化和LoRA微调存在参数效率低或导致遗忘的局限，因此重新探索软提示作为一种更高效的替代方案。

Result: 在Roboflow20-VL基准测试中，使用1-3个学习到的提示令牌（平均7,168参数）在10-shot设置下达到14.2 mAP，与最佳LoRA配置相当，但参数减少超过20,000倍；在NaturalBench VQA上，软提示完全保持预训练性能，而LoRA导致准确率下降35%-56%。此外，软提示在Qwen3.5-9B上无需重新训练即可迁移（提升0.8 mAP），在RoboCasa操作任务中与LoRA基线相当。

Insight: 创新点包括：1）将提示令牌放置在视觉与文本令牌的交叉模态边界处，性能优于其他位置；2）从空令牌初始化提示优于语义或随机初始化。客观来看，该方法揭示了现代VLMs已编码大量领域知识，关键是通过学习如何“提问”（即优化提示）来激活这些知识，而非重新训练模型权重，这为高效适应提供了新思路。

Abstract: We address few-shot object detection with vision-language models (VLMs) in out-of-domain settings such as aerial, industrial, and medical imagery, using only ten annotated images for supervision. Existing adaptation methods are discrete prompt optimization and LoRA fine-tuning. We revisit a third option: soft prompting, where a small number of continuous prompt tokens are optimized while the pretrained backbone remains frozen. We identify two key design choices. First, placing prompt tokens at the cross-modal boundary between visual and text tokens outperforms other placements (10.0 vs. 8.4 mAP). Second, initializing prompts from the empty space token outperforms semantic and random initialization. With these choices, one to three learned tokens (7,168 parameters on average) match the best LoRA configuration on Roboflow20-VL (14.2 mAP, 10-shot) while training over 20,000x fewer parameters. Soft prompting remains harder to optimize, exhibiting higher variance across random seeds. Unlike LoRA, however, it causes no forgetting: the LoRA rank matching our accuracy reduces NaturalBench VQA accuracy by 35% relative, rising to 56% at the largest rank, whereas soft prompting leaves pretrained performance unchanged. The learned tokens behave like prompts rather than weights. They transfer to a newer model without retraining (+0.8 mAP on Qwen3.5-9B) and can be verbalized into readable prompts competitive with prompt-search methods (matching DetPO and outperforming GEPA). The approach also extends beyond detection. On RoboCasa manipulation tasks, the frozen $π_{0.5}$ vision-language-action policy benefits from soft prompting, matching the LoRA baseline on two of three tasks when tokens are placed at the gradient bottleneck. These results suggest modern VLMs already encode much of what is needed for specialized domains; the challenge is learning how to ask.

Yifei Liu, Qiong Cao, Hongwei Yi, Huaiguang Jiang, Changxing Ding

TL;DR: 本文提出了一种名为MOCO的新型扩散框架，用于生成由多模态输入（如语音音频、文本描述和轨迹数据）驱动的3D虚拟人运动。该框架通过解耦运动生成过程，在去噪步骤中独立处理各模态输入，并依据空间规则组合身体部位，从而无需对齐的多模态数据即可生成连贯自然的运动。

Details

Motivation: 现有方法因缺乏对齐的多模态数据，通常通过顺序或加权和组合单模态运动，导致运动不匹配或不真实。本文旨在解决多模态输入下生成自然、同步的3D虚拟人运动这一挑战。

Result: 在专门构建的多模态基准测试中，MOCO超越了现有基线方法，推动了多模态运动生成领域的发展。

Insight: 创新点在于解耦运动生成过程，通过迭代去噪步骤使各模态在整体运动背景下逐步协调，从而生成连贯同步的行为。这种方法避免了依赖对齐数据，提升了运动的自然性和流畅性。

Abstract: It is natural for humans to walk and talk simultaneously. This paper tackles the challenge of replicating such natural behaviors in 3D avatar motion generation driven by concurrent multimodal inputs, such as a text description of a man walking alongside speech audio. Existing methods, constrained by the scarcity of aligned multimodal data, typically combine motions from individual modalities sequentially or through weighted sums. However, they often result in mismatched or unrealistic movements. To overcome these limitations, we propose MOCO, a novel diffusion-based framework capable of processing multiple simultaneous inputs, including speech audio, text descriptions, and trajectory data, to generate coherent and lifelike motions without requiring aligned multimodal data. Our key innovation lies in decoupling the motion generation process. During each denoising step, the diffusion model independently generates motions for each modality from the input noise and assembles the body parts according to predefined spatial rules. The resulting combined motion is then diffused and serves as the input noise for the subsequent denoising step. This iterative approach enables each modality to refine its contribution within the context of the overall motion, progressively harmonizing movements across modalities. Consequently, the generated motions become increasingly natural and fluid with each iteration, achieving coherent and synchronized behaviors. We evaluate our approach using a purpose-built multimodal benchmark. Experimental results demonstrate that MOCO outperforms existing baselines, advancing the field of multimodal motion generation for 3D avatars.

[38] Vision Transformer-Based Multi-Level Feature Fusion for Multi-Label Sewer Defect Classification cs.CVPDF

Xu Fang, Zhuoran Wang, Qing Li, Shengyu Zhang, Guanzhi Deng

TL;DR: 该研究提出了Sewer-Transformer-ML，一种基于分层视觉Transformer并融合多级特征的模型，用于多标签下水道缺陷分类。同时，为资源受限场景设计了两种轻量级架构Sewer-MobileNet-ML和Sewer-Mobile-TransNet。在Sewer-ML测试集上，基础模型取得了领先的公开排行榜性能，而轻量模型在显著减少参数的同时保持了高精度。

Details

Motivation: 现有深度学习方法在大规模多标签下水道缺陷分类场景中难以平衡分类精度与计算复杂度，本研究旨在解决这一问题，并为资源受限的巡检场景提供高效解决方案。

Result: 在Sewer-ML测试集上，Sewer-Transformer-ML-Base的F2_CIW达到65.68%，F1_Normal达到92.68%，在公开排行榜上排名第一，F2_CIW指标超出第二名7.6个百分点。Sewer-MobileNet-ML仅用1700万参数实现了65.73%的F2_CIW，参数量相比基础模型减少约95%。在标准Sewer-Capsule数据划分下，Sewer-Mobile-TransNet的分类准确率达到96.43%。

Insight: 创新点在于提出了一个分层视觉Transformer与多级特征融合的框架，并针对不同特征类型（Transformer特征与多尺度CNN特征）探索了有效的融合策略（直接拼接与基于注意力的融合）。研究还表明，在Sewer-ML数据集上进行预训练能有效提升小训练集下的模型性能，为轻量化模型设计和跨基础设施巡检平台的适应提供了计算基础。

Abstract: Automated classification of sewer defects is essential for infrastructure condition assessment and maintenance decision-making, but existing deep learning methods struggle to balance classification accuracy and computational complexity in large-scale multi-label scenarios. This study develops Sewer-Transformer-ML, a hierarchical vision Transformer with multi-level feature fusion, together with two lightweight architectures, Sewer-MobileNet-ML and Sewer-Mobile-TransNet, for resource-constrained inspection scenarios. On the Sewer-ML test set, Sewer-Transformer-ML-Base achieved an $F2_{\text{CIW}}$ of 65.68% and an $F1_{\text{Normal}}$ of 92.68%, ranking first on the public leaderboard and exceeding the second-ranked method by 7.6 percentage points in $F2_{\text{CIW}}$. Sewer-MobileNet-ML achieved an $F2_{\text{CIW}}$ of 65.73% with only 17 M parameters, representing an approximately 95% parameter reduction relative to the base model. Under the standard Sewer-Capsule data split, Sewer-Mobile-TransNet achieved 96.43% classification accuracy. When the training set was reduced to 1,177 images, pretraining on Sewer-ML consistently improved model performance. Ablation experiments further showed that direct concatenation was more effective for Transformer features, whereas attention-based fusion better supported multiscale CNN features. These findings provide a computational basis for automated sewer inspection, lightweight model design, and adaptation across civil infrastructure inspection platforms.

[39] BruNet: A Cross-Domain Transfer Framework for Bruise Segmentation cs.CVPDF

Qiming Wang, Richard J. Motley, Ebube E. Obi, Xianfang Sun, Paul L. Rosin

TL;DR: 本文提出BruNet，一种结合ViT视觉编码器（自监督DINOv3或预训练LingBot-Vision）与SAM掩码解码器的分割框架，用于解决医学图像中瘀伤分割的挑战。该模型在皮肤病变数据集HAM10000上训练，并在未微调的情况下在独立瘀伤数据集上评估，展示了强大的跨域泛化能力。

Details

Motivation: 解决瘀伤分割任务中数据有限、边界模糊和外观多变等挑战，现有研究多关注检测、分类或颜色分析，缺乏像素级定位方法。

Result: 在瘀伤数据集上，BruNet优于基于CNN的模型、SOTA分割模型、ChatGPT-4o/5辅助的SAM2零样本基线以及医学专用MedSAM模型，实现了跨域泛化的SOTA性能。

Insight: 创新点在于首次提出自动瘀伤分割方法，结合自监督或预训练ViT编码器与SAM解码器，通过跨域迁移学习解决数据稀缺问题，为医学图像分割提供新思路。

Abstract: Segmenting bruises is a challenging task in medical imaging due to limited data and annotations, diffuse boundaries, and highly variable appearance. In this work, we propose BruNet, a segmentation framework that combines a ViT-based visual encoder (a self-supervised DINOv3 or a pretrained LingBot-Vision backbone) with a SAM-based mask decoder. BruNet is trained on the HAM10000 skin lesion dataset and evaluated on a separate bruise dataset without additional fine-tuning. Although a small number of prior studies have explored machine learning and computer vision for bruise analysis, existing work has primarily focused on detection, classification, or colour analysis rather than pixel-level localisation. To the best of our knowledge, this is the first study to address automatic bruise segmentation. Our results show that BruNet outperforms CNN-based models, state-of-the-art segmentation models, ChatGPT-4o/5-assisted SAM2 zero-shot baselines, and the medical-oriented MedSAM model, demonstrating strong cross-domain generalisation to bruise segmentation.

Boya Wang, Ruizhe Li, Chao Chen, Xin Chen

TL;DR: 本文提出了一种名为DINO-Med的统一、基于patch的适应框架，用于多模态医学图像分析，并以肝纤维化分期为案例研究。该框架通过免训练的配准、自动定位和掩码过滤的patch提取处理原始多模态成像，并采用分层策略将patch级特征聚合到受试者级诊断中。

Details

Motivation: 由于自然彩色图像与多通道医学扫描之间存在显著的领域差距，将DINOv3等自然图像基础模型适应到多模态医学成像具有挑战性。本文旨在解决这一领域适应问题，以提升医学图像分析性能。

Result: 在CARE 2025 Liver Track 4队列的360名受试者上，通过10次随机训练（90%）/测试（10%）分割评估，基于DINOv3的框架显著优于所有基线，在轻度纤维化（S1）和肝硬化（S4）类别上分别达到78.4%和75.8%的最佳分类准确率。

Insight: 创新点包括统一的patch级适应框架，结合免训练配准和分层聚合策略；通过对比不同特征表示（如Radiomics、ResNet、SAM-Med2D和DINOv3），验证了基础模型在医学图像分析中的有效性，特别是DINOv3特征的优越性。

Abstract: Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural color images and multi-channel medical scans. We present a unified, patch-based framework that processes raw multimodal imaging through training-free registration, automated localization, and mask-filtered patch extraction. This architecture culminates in a hierarchical strategy that aggregates patch-level insights into subject-level diagnostics. Using liver fibrosis staging as a case study, we evaluate four patch-level feature representations: handcrafted Radiomics features, learned ResNet features, pre-trained foundation model SAM-Med2D features, and frozen DINOv3 features. To ensure a controlled comparison, all models utilize the same lightweight MLP head and are evaluated across both rigid and deformable registration settings. Our training protocol focuses on mild fibrosis (S1) and cirrhosis (S4) classes only, enabling a single classifier to address both substantial fibrosis detection and cirrhosis staging. Evaluated via 10 random train (90%)/ test (10%) splits on 360 subjects from the CARE 2025 Liver Track 4 cohort, our DINOv3-based framework significantly outperforms all baselines, achieving the best classification accuracy of 78.4% for S1 and 75.8% for S4.

[41] Recursive Code World Models: Building Complex Worlds through Recursive Scene Programs cs.CVPDF

Zhiqi Li, Yuxuan Liao, Bo Zhu

TL;DR: 本文提出递归代码世界模型（RCWM），通过递归场景程序（RSP）表示和递归求解器，从单张参考图像重建复杂3D世界。该方法采用全局-局部-全局递归策略，在保持场景整体几何关系的同时，对细粒度结构进行感知与编辑循环，实现了优于现有基于代码的图像到场景重建方法的效果。

Details

Motivation: 现有代码世界模型将世界表示为可执行程序，但缺乏构建复杂世界的有效方法。本文旨在解决从单张图像重建复杂3D世界的挑战，通过递归结构实现细粒度重建与整体一致性的平衡。

Result: 在复杂场景重建任务中，RCWM超越了先前的基于代码的图像到场景重建方法。消融实验表明递归构建具有优势，且更深的递归调用能提升细尺度重建质量。

Insight: 创新点在于将递归构造原则引入代码世界模型，通过全局-局部-全局递归循环和参考对齐视图传播，实现了多尺度感知与编辑的统一框架，为从视觉证据构建复杂可执行世界提供了新范式。

Abstract: Code world models represent worlds as executable programs, but this representation alone does not determine how to construct a complex world. We introduce Recursive Code World Models (RCWM), a framework for reconstructing complex 3D worlds in code from a single reference image. RCWM couples a Recursive Scene Program (RSP) representation with a construction solver that recursively calls itself. An RSP represents the executable world as compositional scene code, while each solver call follows the same complete process: establish the whole, recursively reconstruct unresolved parts, and revisit the whole to refine their composition. This global-local-global recursion gives fine-scale structures their own perception-and-editing loops while preserving scene-wide geometry and relationships. Reference-aligned views propagate a shared camera projection across levels, while parent revisitation addresses boundaries, spatial relations, and shared errors that emerge after local refinement. A vision-language coding agent directly compares reference images with scene renders to guide refinement, recursive descent, and return. Across complex scenes, RCWM outperforms prior code-based image-to-scene reconstruction methods. Ablation studies further support the benefits of recursive construction and suggest that deeper calls can improve finer-scale reconstruction. RCWM provides a recursive construction principle for building complex executable worlds from visual evidence.

[42] Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation cs.CVPDF

Niange Yu, Ye Tian, Biaolong Chen, Miao Lu, Aixi Zhang

TL;DR: 本文提出了一种名为DIAL（Dual-phase Intrinsic Attention Leveraging）的框架，用于解决多主体视频生成中保真度强度不可控和潜在语义漂移的挑战。该方法通过分析扩散变换器（DiTs）的内部机制，发现其注意力块能自然形成内在空间定位图（ISGM），并利用该图在低噪声阶段引导注意力以精确控制保真度，在高噪声阶段自动构建偏好对进行强化学习，从而锚定参考主体并减轻语义漂移。

Details

Motivation: 解决多主体视频生成中存在的两个关键问题：无法精确控制生成视频对参考主体的保真度强度，以及在生成过程中可能发生的语义漂移（即主体特征或身份的不一致）。

Result: 在OpenS2V-Eval基准测试上的大量实验表明，DIAL框架显著优于基线模型，在身份一致性方面持续提升，并实现了可控的保真度强度。

Insight: 核心创新点在于发现并利用了扩散变换器内部注意力机制自然形成的“内在空间定位图”（ISGM），这是一种无需额外标注或训练的内在信号。基于此，提出了一个双阶段框架（DIAL），将同一信号同时用于推理时的精确引导和训练时的低成本强化学习偏好对构建，实现了对生成过程更高效、更可控的干预。

Abstract: Multi-subject video generation faces two key challenges: uncontrollable fidelity strength and potential semantic drift. We address these by analyzing the internal mechanisms of Diffusion Transformers (DiTs). We found that certain attention blocks naturally form an Intrinsic Spatial Grounding Map (ISGM) that precisely locates reference subjects. Building on this insight, we propose Dual-phase Intrinsic Attention Leveraging (DIAL), a framework that uses these internal signals for both training and inference. In low-noise stages, we use ISGM to guide the attention mechanism, allowing precise control over fidelity strength during inference without retraining. In high-noise stages, we use these same maps to automatically build preference pairs at no additional cost for Reinforcement Learning (RL). This RL procedure effectively anchors the model’s attention to reference subjects and mitigates semantic drift. Extensive experiments show that DIAL significantly outperforms baseline models on the OpenS2V-Eval benchmark, consistently improving identity consistency and enabling controllable fidelity strength.

[43] World in World: Explore the World with World Models cs.CVPDF

Chenxi Song, Yanming Yang, Chi Zhang

TL;DR: 本文提出了一种名为World in World的无训练推理时接口，用于增强自回归视频世界模型的交互式长时程探索能力。该方法通过将异构控制证据（如源视频观测、目标视角投影、几何渲染和检索生成状态）转换为带相机和时间标签的干净视觉状态，并利用冻结因果视频模型的原生自注意力机制进行读取，从而支持相机控制重渲染、长时程重访和人体运动转移等多种任务。

Details

Motivation: 自回归视频世界模型虽然支持交互式长时程探索，但在灵活控制方面仍面临挑战，特别是在从新视角探索源视频时，需要保持生成序列与记录事件的同步、将观测内容置于请求视角、合理补全新暴露区域以及在重访时恢复先前生成的外观。现有方法通常通过特定任务模块或额外训练来解决这些需求，而本文旨在提出一种无需训练的统一接口来应对这些挑战。

Result: 在多样化视角变化下的相机控制视频重渲染任务中，World in World在感知质量、时间一致性和相机跟随准确性方面进行了评估，但摘要中未明确提及具体定量结果或与SOTA的比较。

Insight: 创新点包括：1) 提出一种无训练推理时接口，将异构控制证据统一转换为视觉状态，利用冻结模型的自注意力实现灵活控制；2) 引入对应路由器（correspondence router）结合持久点身份和几何信息建立令牌对应关系，指导查询匹配源视频令牌；3) 提出证据感知注意力CFG（EWA），基于同一去噪前向传播的注意力响应独立调节每个辅助通道的贡献，从而支持多种控制任务而无需修改骨干网络。

Abstract: Autoregressive video world models enable interactive, long-horizon exploration, but flexible control remains challenging. Exploring a source video from new viewpoints requires the generated rollout to remain synchronised with the recorded event, place observed content in the requested view, plausibly complete newly exposed regions, and recover previously generated appearance on revisits. Existing methods typically address these requirements through task-specific modules or additional training. We present World in World, a training-free inference-time interface that converts heterogeneous control evidence into camera- and time-labelled clean visual states, which are read through the native self attention of a frozen causal video model. The evidence comprises source-video observations, target-view scene projections, geometry renderings that guide completion of newly exposed subject regions, and retrieved generated states beyond the rolling cache. Each evidence source carries token-level support and its own availability schedule. A correspondence router combines persistent point identities with geometry to establish token correspondences, guiding supported queries towards matching source-video tokens. Evidence-wise attention CFG (EWA) then independently regulates each auxiliary channel’s additional contribution using attention responses from the same denoising forward pass. The shared interface supports camera-controlled rerendering, long-horizon revisiting, and human-motion transfer with the same frozen backbone. We evaluate World in World on camera-controlled video rerendering under diverse viewpoint changes, assessing perceptual quality, temporal consistency, and camera-following accuracy.

[44] OmniKVQuant: KV Cache Quantization for Omni-LLMs cs.CVPDF

Suho Yoo, Hyunjong Ok, Jongmin Choi, Jihoo Jung, Joon Son Chung

TL;DR: 本文提出了OmniKVQuant，一种针对全模态大语言模型（Omni-LLMs）的KV缓存量化框架。该框架通过解决多模态输入下KV缓存量化面临的关键问题，能够在Qwen2.5-Omni和Qwen3-Omni等模型上实现2位KV缓存，同时保持性能，并提供了配套的Triton解码内核以避免构建密集缓存。

Details

Motivation: 随着全模态大语言模型处理音频、视频和文本，其KV缓存的内存开销急剧增长。现有的、在纯文本LLMs中有效的KV缓存量化方法（如TurboQuant）在全模态场景下的应用尚未被探索，且面临特定挑战。

Result: 在Qwen2.5-Omni和Qwen3-Omni模型上，OmniKVQuant实现了2位KV缓存，并在七个音视频基准测试中基本保持了模型性能。

Insight: 论文的创新点在于识别并解决了多模态KV缓存量化中的两个关键问题：时间键漂移和异构值几何。具体方案包括：为输入流的每个短窗口设置独立的键量化范围，以及按模态分别对值进行旋转。此外，其配套的Triton内核实现了在注意力计算中即时解包2位缓存，避免了构建FP16密集缓存的开销。

Abstract: As Omni-modal large language models (Omni-LLMs) take in audio, video and text together, their KV cache memory cost grows. KV cache quantization is the de facto approach in text-only LLMs, but its application to Omni-LLMs remains unexplored. In this paper, we analyze how TurboQuant, a representative rotation-based KV cache quantization method, behaves on multimodal caches and identify two critical issues: temporal key drift and heterogeneous value geometry. To address these, we propose OmniKVQuant, a training-free framework that (i) sets the key quantization range over each short window of the input stream; and (ii) rotates values separately per modality. On Qwen2.5-Omni and Qwen3-Omni, OmniKVQuant enables 2-bit KV caches while substantially preserving performance across seven audio-visual benchmarks. We further provide a fused Triton decode kernel that unpacks the 2-bit cache during attention, so no dense FP16 cache is ever built. Code: https://github.com/kaistmm/OmniKVQuant

[45] MMGait: Benchmarking and Unifying Gait Recognition across Heterogeneous Modalities cs.CVPDF

Saihui Hou, Chenye Wang, Qingyuan Cai, Aoqi Li, Yongzhen Huang

TL;DR: 论文提出了MMGait基准测试，这是一个大规模多传感器步态识别数据集，包含可见光、红外、深度、LiDAR和雷达等多种模态数据。同时，论文提出了OmniGait++模型，旨在通过一个统一的身份空间，将单模态、跨模态和多模态步态识别任务整合起来。

Details

Motivation: 现有步态识别研究主要围绕RGB视频或其衍生的轮廓和姿态进行，无法系统性地检验人类行走产生的异构光度、几何和运动线索。因此，需要建立一个涵盖多种传感器的基准测试来推动该领域发展。

Result: 在MMGait基准上，实验表明OmniGait++模型在许多共享设置下与任务特定专家模型保持竞争力，并能扩展到固定配对模型无法处理的高基数模态融合场景。

Insight: 创新点在于提出了一个统一的Omni-Modal Gait Recognition框架，通过共享身份编码器和锚点引导的融合模块，用一个联合训练的检查点覆盖所有识别设置，并能灵活处理不同组成和数量的模态子集，解决了传统方法中模态组合需要单独训练专家的可扩展性问题。

Abstract: Gait recognition is commonly studied using RGB videos or their derived silhouettes and poses. Yet human walking produces heterogeneous photometric, geometric, and motion cues that cannot be systematically examined with RGB-centered benchmarks. We present MMGait, a large-scale multi-sensor benchmark that brings visible, infrared, depth, LiDAR, and radar observations into sequence-level correspondence. It provides diverse modalities spanning appearance, contours, geometry, motion, and body structure. Under a shared impostor-augmented protocol, we evaluate single-modal recognition, cross-modal recognition via directed retrieval, and multi-modal recognition using task-specific experts. Across settings, modality rankings vary with probe conditions, cross-modal alignment remains difficult, and fusion often provides complementary gains. This analysis exposes a scalability problem: individual modalities, modality pairs, and fusion configurations are typically handled by separately trained experts. We formulate Omni-Modal Gait Recognition, which unifies single-modal, cross-modal, and multi-modal recognition within a shared identity space. OmniGait++ uses modality-specific front ends followed by a shared identity encoder to preserve modality-dependent cues while learning comparable identity descriptors. An anchor-guided fusion module aggregates modality subsets of varying size without frame-level synchronization. A jointly trained checkpoint covers all three recognition settings and accommodates modality subsets of different compositions and cardinalities. Experiments show OmniGait++ remains competitive with task-specific experts in many shared settings and extends to higher-cardinality fusion unavailable to fixed-pair models. The results establish MMGait as a common testbed for heterogeneous gait sensing and demonstrate the feasibility of unified recognition under varying modality availability.

[46] Multimodal Taxonomic Conditioning for Generative Plankton Imagery cs.CV | cs.LGPDF

Daniela Ivanova, Ozgu Goksu, Nicolas Pugeault

TL;DR: 本文提出了一种基于多模态分类条件化的浮游生物图像生成方法，以解决自动化浮游生物成像数据集中长尾分布问题。通过改进CLIP编码器以适应深层次、不规则的分类体系，并结合参数高效的扩散变换器生成合成图像，评估了合成样本的分布保真度和下游分类器效用。

Details

Motivation: 自动化浮游生物成像产生严重长尾分布的数据集，其中生态学上最关注的稀有类群图像过少，难以可靠地训练或评估分类器。

Result: 论文评估了合成样本在分布保真度和下游分类器效用方面的质量，但摘要中未提及具体基准测试或与现有方法的定量比较结果。

Insight: 创新点包括将CLIP编码器通过排名对比目标扩展到深层次、不规则分类体系，并采用参数高效的扩散变换器进行条件化图像生成，为长尾数据增强提供了新思路。

Abstract: Automated plankton imaging produces severely long-tailed datasets, where the rare taxa of greatest ecological interest have too few images to train or evaluate classifiers reliably. We generate synthetic plankton imagery conditioned on taxonomy: a CLIP encoder is adapted on a large plankton corpus with a ranked contrastive objective extended to deep, ragged taxonomies, then frozen to condition a parameter-efficient diffusion transformer. We evaluate synthetic sample quality on distributional fidelity and downstream classifier utility.

[47] Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation cs.CV | cs.LGPDF

Jintao Zhang, Kai Jiang, Jintao Chen, Xu Wang, Deyuan Liu

TL;DR: 本文介绍了Vidu S2系统，它包含两个核心模型：Vidu S2-Avatar（实时交互数字角色生成模型）和Vidu S2-Editing（实时视频编辑模型）。该系统探索了实时空间视频生成的可行性，相比前代Vidu S1，在实时性、交互性和编辑能力上均有显著提升。

Details

Motivation: 旨在解决现有视频生成模型在实时交互、动态参考更新和实时视频流编辑方面的不足，推动数字角色和视频编辑技术向实时、可交互的方向发展。

Result: 实验表明，Vidu S2在所有基线模型上均表现更优，Vidu S2-Avatar支持实时720p视频生成，并能根据动态参考和复杂指令（如跳舞）生成内容。

Insight: 主要创新点在于将实时交互、动态参考更新和实时视频流编辑功能整合到一个统一的系统中，特别是实现了对视频流的实时风格渲染、服装/角色/背景替换等编辑操作，这为实时内容创作和交互应用提供了新的技术路径。

Abstract: We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing. Compared with Vidu S1, Vidu S2-Avatar supports real-time 720p video generation, generation with dynamic references that can be updated at any moment, and stronger instruction following, such as dancing. Vidu S2-Editing supports editing a video stream in real time, including style rendering, clothing replacement, character replacement, and background replacement. Experiments show that Vidu S2 outperforms all baselines. A playable online demo is available at https://vidu.com/vidu-stream.

[48] MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird’s-Eye-View Images cs.CV | cs.ROPDF

Vladislav Diuzhev, Dmitry Yudin

TL;DR: 本文提出MC-DeTra模型，旨在统一自动驾驶中的目标检测与轨迹预测任务。该模型在BEV图像上通过引入运动一致性机制，利用历史运动、周围交通占用以及航向与运动方向对齐等辅助监督信号，提升动态目标的轨迹预测精度，同时保持检测性能。

Details

Motivation: 现有统一感知与预测的模型（如DeTra）在动态移动目标的轨迹预测上精度不足，且缺乏公开实现。本文旨在通过重新实现DeTra并引入运动一致性监督，解决动态目标轨迹预测的难题。

Result: 在Waymo Open Dataset上，采用严格的检测条件预测协议评估，MC-DeTra提升了动态及社会情境下的轨迹预测性能，同时保持或改进了检测精度。

Insight: 创新点在于提出仅用于训练、不影响推理延迟的运动一致性辅助损失（历史运动监督、交通占用监督、航向与运动方向对齐约束），通过梯度校准分析揭示了多任务在共享骨干网络中的竞争关系，并识别了关键信号贡献。

Abstract: Unified models for object detection and trajectory forecasting aim to merge perception and prediction for autonomous driving, refining actor trajectories directly over shared bird’s-eye-view (BEV) images rasterized from LiDAR and high-definition maps. Their accuracy on dynamic, moving actors, however, remains the hardest part of the task, and the strongest such model, DeTra, has no public implementation. We contribute an openly released DeTra reimplementation with documented approximations, and on top of it MC-DeTra: a family of motion-consistency mechanisms that add supervision through two annotation-derived auxiliary signals – each actor’s observed past motion and the occupancy of the surrounding traffic that forms its social context – and one inter-output consistency constraint that aligns an actor’s predicted heading with its predicted direction of motion. Every proposed loss is train-only and inference-safe: it shapes the shared BEV representation during training and is removed at test time, adding no inference latency. On the Waymo Open Dataset, evaluated under a strict, detection-conditioned forecasting protocol, MC-DeTra improves dynamic, socially-situated trajectory forecasting while preserving or improving detection accuracy; a gradient-based loss-calibration analysis exposes how the auxiliary objectives compete at the shared backbone, and our ablation identifies which signals contribute most. We release code, configurations, and evaluation tooling at https://github.com/diuzhevVlad/MC-DeTra.

[49] Language-Augmented Semantic Priors for B-Spline Surface Fitting cs.CV | cs.AIPDF

Yunzhong Lou, Yusheng Luo, Jiahao Li, Yu Song, Xiangdong Zhou

TL;DR: 本文提出了一种名为LASP的语言增强语义先验框架，旨在通过大型语言模型从建模历史中推断出结构化的B样条先验参数，以弥合高层设计意图与几何求解器可执行配置之间的鸿沟。该框架作为现有求解器之上的语义推理层，通过两阶段训练方案结合局部几何规律与长程上下文依赖，生成可解释且语义一致的先验，从而引导传统B样条拟合过程更准确地实现设计目标。

Details

Motivation: 传统CAD系统中的几何内核在曲面拟合和参数化时严重依赖预定义的启发式初始化，而建模历史中编码的程序语义和设计意图在几何生成过程中被忽视，导致拟合结果次优且语义不一致。

Result: 实验表明，与传统机器学习方案相比，语言驱动的推理可以作为几何求解的强大归纳偏置，在现代CAD系统中建立了语言引导几何优化的新范式。

Insight: 创新点在于利用LLM将建模历史转化为捕获设计意图的文本描述，并预测结构化B样条先验参数，这提供了一种不修改几何内核、而是通过语义推理层增强现有求解器的新方法，实现了设计语义与几何求解的更好结合。

Abstract: The use of B-splines and Non-Uniform Rational B-Splines surfaces constitutes the mathematical foundation of contemporary computer-aided design (CAD) systems. Despite long-term progress, geometric kernels in traditional CAD still rely heavily on predetermined heuristic initialization for surface fitting and parameterization. Meanwhile, the procedural semantics and design intent encoded in modeling histories are largely ignored during geometry generation. This disconnect creates a gap between high-level design intent and solver-executable geometric configuration, often leading to suboptimal and semantically inconsistent fitting results. To bridge this gap, we introduce LASP, a Language-Augmented Semantic Priors framework that leverages large language models (LLMs) to infer structured, solver-usable B-spline priors from procedural modeling histories. Rather than modifying the geometric kernel itself, LASP operates as a semantic reasoning layer above existing solvers. It first translates modeling histories into rich textual descriptions that capture design intent, geometric context, and functional relationships, and then uses a fine-tuned LLM to predict structured B-spline prior parameters. LASP is trained through a two-stage scheme that combines local geometric regularities with long-range contextual dependencies, producing priors that are both interpretable and semantically coherent. This approach furnishes inductive signals that direct the conventional B-spline fitting process toward solutions that more accurately encapsulate the intended design objectives and demonstrate heightened semantic coherence. Compared to traditional machine learning schemes, the experiments demonstrate that language-driven reasoning can serve as a powerful inductive bias for geometric solving, establishing a new paradigm of language-guided geometric optimization in modern CAD systems.

[50] SenseNova-U1.5: Towards Native Unified Visual Intelligence cs.CVPDF

Haiwen Diao, Jiahao Wang, Chenjing Ding, Hanming Deng, Jiangnan Chen

TL;DR: 论文介绍了SenseNova-U1.5，这是一个80亿参数的原生统一多模态模型，采用无编码器和无VAE的架构，旨在理解和生成视觉内容。它通过空间一致的图像块重建强化视觉接口，并利用精心策划的数据、改进的任务表述和高达4K的原生分辨率进行训练。后训练阶段通过多专家策略蒸馏整合了美学、文本渲染、信息图生成和图像编辑等专家能力。

Details

Motivation: 旨在构建一个端到端的原生统一多模态模型，以在单一框架内实现视觉内容的感知、推理和生成，解决传统方法中编码器和VAE带来的复杂性。

Result: 在广泛的评估中，SenseNova-U1.5在图像保真度、文本渲染、复杂构图、多参考编辑和交错生成方面取得显著进步，同时改善了指令跟随能力并保持了主体身份、几何结构和未修改区域。

Insight: 创新点包括采用无编码器和无VAE的原生统一架构，通过空间一致的图像块重建和高达4K的原生分辨率增强视觉接口，以及利用多专家策略蒸馏整合后训练专家能力，证明了多模态理解可以迁移到视觉规划和生成任务中。

Abstract: We launch SenseNova-U1.5, an 8B-MoT native unified multimodal model that understands, reasons about, and generates visual content within an encoder-free and VAE-free architecture. We strengthen its visual interface through spatially coherent patch reconstruction and scale its training with carefully curated generation and editing data, improved task formulation, structural prompt enhancement, and native resolutions of up to 4K. For post-training, we optimize specialized experts for visual aesthetics, bilingual text rendering, infographic generation, and image editing, and consolidate their capabilities through multi-expert on-policy distillation. Across extensive evaluations, SenseNova-U1.5 largely advances image fidelity, text rendering, complex composition, multi-reference editing, and interleaved generation, while improving instruction following and preserving subject identity, geometry, and unmodified regions. Despite limited exposure to structured formats in its generation data, SenseNova-U1.5 generalizes effectively to long, complex, and structured visual instructions, further proving that multimodal understanding can transfer to visual planning and creation. Together, these findings position native unified modelling as a promising path towards systems that perceive, reason and create within a fully end-to-end framework. We will open-source training code, including supervised fine-tuning, reinforcement learning, and on-policy distillation.

[51] Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding cs.CV | cs.HCPDF

Weitong Cai, Hang Zhang, Yukai Huang, Yiqiao Xie, Shan Gao

TL;DR: 本文提出了一种面向边缘设备的预算感知长视频理解框架Caption-once, Frames-on-Demand (CFD)。该框架基于视觉-文本二元性洞察，在边缘侧通过一次离线视频描述生成构建双轨叙事索引，在云端查询时通过一个轻量级的视觉需求路由器，仅在需要感知细节时触发有界的关键帧检索，从而在保证理解精度的同时，大幅减少在线视觉处理开销。

Details

Motivation: 解决在边缘设备上处理长视频时，面临的计算和带宽资源紧张问题。传统方法要么通过子采样视觉令牌丢失时间结构，要么仅依赖文本记忆丢失细粒度视觉属性。

Result: 在长视频基准测试上的实验表明，该方法在精度和效率之间取得了良好的权衡，同时显著减少了在线视觉处理。

Insight: 核心创新点在于提出了视觉-文本二元性洞察，并据此设计了预算感知的智能体框架。具体包括：1）一次离线描述生成、多次查询复用的双轨叙事索引；2）查询条件化的轻量级视觉需求路由器，将视觉访问转化为可控的、按需的成本。这为资源受限环境下的长视频理解提供了新的系统设计思路。

Abstract: Long-video understanding on edge devices must reason over hours of content under tight compute and bandwidth budgets. Subsampling visual tokens loses temporal structure, while text-only video memories lose fine-grained visual attributes. We observe a visual-textual duality: language memories carry long-range temporal structure better than dense frames, while pixels remain decisive for attribute-level perception. Building on this insight, we propose Caption-once, Frames-onDemand (CFD), a budget-aware edge-cloud agentic framework. The edge runs a single offline captioning pass that builds a dual-track narrative index, an event-level story skeleton plus a clip-level micro-log, cached and reused across queries without re-captioning. At query time, a cloud-side MLLM reasons over the index in a story-first loop centered on a lightweight Visual-Need Router: a per-query gating module that triggers bounded keyframe retrieval only for perceptual questions (appearance, on-screen text, attribute disambiguation) and keeps temporal-structural questions in language space. The router turns visual access into a first-class, query-conditioned cost, capping per-query frame consumption regardless of video length. Experiments on long-video benchmarks demonstrate strong accuracy-efficiency trade-offs while substantially reducing online visual processing.

cs.SD [Back]

[52] Xiaomi-CocktailASR-1 Technical Report cs.SD | cs.CL | eess.ASPDF

Yiru Zhang, Hang Su, Lichun Fan, Ying Zeng, Chang Liu

TL;DR: 本文提出了Xiaomi-CocktailASR-1，一种基于大语言模型的端到端目标说话人自动语音识别架构。它利用参考语音作为声纹提示，无需语音分离即可直接从混合语音中转录目标说话人的内容，并在保持单说话人场景竞争力的同时，具备目标说话人缺失时的拒识能力。

Details

Motivation: 解决现有基于LLM的ASR模型普遍缺乏对多说话人场景（鸡尾酒会问题）支持的问题，同时克服现有目标说话人ASR方法导致的单说话人性能下降以及无法在目标说话人缺失时进行拒识的缺陷。

Result: 在多种合成和真实世界的多说话人基准测试上进行了广泛实验，结果表明Xiaomi-CocktailASR-1取得了最先进的性能，通过统一的架构有效平衡了多说话人和单说话人的识别准确率以及拒识能力。

Insight: 核心创新在于提出了一种统一的、基于LLM的端到端TS-ASR架构，它利用参考语音作为提示直接处理混合语音，避免了先分离后识别的流程，并集成了竞争性的单说话人性能、目标缺失拒识以及思维链推理模式，为鸡尾酒会问题提供了一个综合解决方案。

Abstract: Recently, large language model (LLM) based ASR models have achieved significant progress, yet they generally lack support for multi-speaker scenarios, where the cocktail party problem remains a critical bottleneck for further advancing ASR. Existing TS-ASR methods, including end-to-end architectures with speaker embeddings and latest LLM-based explorations suffer from degraded single-speaker performance and the inability to reject when the target speaker is absent. In this paper, we propose Xiaomi-CocktailASR-1, an LLM-based end-to-end TS-ASR architecture. By utilizing reference speech as voiceprint prompts, it directly transcribes the target speaker’s speech without requiring speech separation. Xiaomi-CocktailASR-1 maintains competitive performance in single-speaker scenarios, comparable to mainstream ASR models. It also features a negative sample rejection capability, outputting empty text when the target speaker is absent from the mixed speech. Additionally, Xiaomi-CocktailASR-1 supports a Chain-of-Thought (CoT) reasoning mode to provide explicit reasoning steps. Extensive experiments on various synthetic and real-world multispeaker benchmarks demonstrate that Xiaomi-CocktailASR-1 achieves state-of-the-art performance, effectively addressing the cocktail party problem through a unified architecture that balances multispeaker and single-speaker recognition accuracy, along with rejection capability.

cs.RO [Back]

[53] HuRo: Robotizing Human Videos for Scalable VLA Pretraining cs.RO | cs.CV | cs.LGPDF

Jinho Jeong, Se June Joo, Jaehyun Kang, Dongyun Kim, Yena Kim

TL;DR: 本文提出了HuRo数据集构建方法，通过系统化地将异构人类视频转换为机器人对齐的观测和动作轨迹，用于大规模视觉-语言-动作（VLA）策略的预训练。实验表明，增加机器人化预训练规模能显著提升真实世界操作任务的完成率与分布外（OOD）鲁棒性。

Details

Motivation: 为解决真实机器人数据昂贵且稀缺的问题，利用丰富多样的人类视频作为替代监督信号，并系统探究机器人化的人类视频能否为VLA策略预训练提供有效且可扩展的监督。

Result: 在四个真实世界操作任务上，增加机器人化预训练规模使总体任务完成率从51.5%提升至80.3%，在空间和视觉偏移下的OOD完成率从34.9%提升至72.2%。消融实验表明视觉机器人化提升了OOD鲁棒性，且使用重定向动作的端到端预训练优于仅视觉迁移。

Insight: 创新点在于开发了一个统一的机器人化流水线，能同时处理观测与动作的对齐，并推断不同标注层级间缺失的中间信号；客观分析认为，该方法为利用海量人类视频进行机器人策略学习提供了一种可扩展且高效的解决方案，弥合了人机具身鸿沟。

Abstract: Human video datasets have emerged as a compelling alternative to expensive real-robot data, offering rich diversity at scale. To bridge the human-to-robot embodiment gap, existing approaches either robotize videos in task-matched settings or address observation and action alignment separately at scale. In this work, we systematically examine whether robotized human videos can provide effective and scalable supervision for pretraining vision-language-action (VLA) policies. To this end, we develop a robotization pipeline that converts heterogeneous human videos into robot-aligned observations and action trajectories while inferring missing intermediate signals across annotation levels. Using this pipeline, we construct the HuRo dataset, comprising about 630K robotized episodes and 142M processed frames from five human-video sources. Across four real-world manipulation tasks, increasing robotized pretraining scale improves overall completion from 51.5% to 80.3% and OOD completion under spatial and visual shifts from 34.9% to 72.2%. Ablations further show that visual robotization improves OOD robustness and that end-to-end pretraining with retargeted actions outperforms visual-only transfer. Code and data are released on our website: https://3587jjh.github.io/HuRo.

[54] IMLE-VLA: Fast Single-Step Action Generation for Vision-Language-Action Policies cs.RO | cs.CVPDF

Kian Hosseinkhani, Qinhe Peng, George Shramko, Mehran Aghabozorgi, Jianing Qian

TL;DR: 本文提出了IMLE-VLA，一种用于视觉-语言-动作策略的快速单步动作生成方法。该方法用基于条件隐式最大似然估计的单步条件生成器，替代了现有方法中依赖迭代多步采样的扩散或流匹配动作头，从而显著提升了推理速度、动作平滑度和任务成功率。

Details

Motivation: 现有基于预训练视觉-语言骨干网络的VLA策略，其连续动作头通常依赖扩散或流匹配模型，需要进行迭代多步采样，这造成了推理瓶颈，导致机器人运动不连贯、任务完成速度慢。

Result: 在LIBERO基准测试的40个任务上，IMLE-VLA取得了98.0%的平均成功率，达到最高水平，同时推理频率也领先。在LIBERO-plus的扰动测试中，它保持了鲁棒性。真实世界实验表明，其运动更平滑（急动度降低2.2至3.0倍），任务完成更快，推理时间减少了3.9至6.6倍。

Insight: 核心创新在于使用条件隐式最大似然估计训练单步条件生成器，这既避免了朴素回归头的模式坍塌问题，提供了多模态动作覆盖，又彻底消除了多步采样，实现了推理速度的显著提升，同时保持了模型的泛化能力。

Abstract: Vision-language-action (VLA) policies leverage pretrained vision-language backbones to achieve strong cross-task generalization. A leading design couples this backbone with a dedicated continuous action head trained via diffusion or flow matching. However, such heads rely on iterative multi-step sampling, for example 10 Euler steps in $π_{0.5}$. This creates an inference bottleneck that produces stop-and-go movement in the robot and slower task completion. We introduce IMLE-VLA, which replaces the iterative action head with a single-step conditional generator trained via conditional Implicit Maximum Likelihood Estimation (cIMLE). The cIMLE objective promotes multimodal action coverage, avoiding the mode collapse of naive regression heads while eliminating multi-step sampling entirely. When IMLE-VLA is applied to $π_{0.5}$, it increases inference frequency 3.67x (55 Hz vs. 15 Hz), enabling up to 11x higher action throughput. On the 40-task LIBERO benchmark, IMLE-VLA achieves the highest average success rate (98.0%) among all baselines while leading in inference frequency. Under the test-time perturbations of LIBERO-plus, IMLE-VLA retains $π_{0.5}$’s robustness while other baselines degrade sharply, confirming that the cIMLE head preserves generalization. Real-world experiments on a Franka Emika Panda across four tasks demonstrate smoother motion (2.2x to 3.0x lower jerk) and faster task completion, with IMLE-VLA outperforming $π_{0.5}$ on every task and reducing average VLA inference time per episode by 3.9x to 6.6x. Videos and code are available at https://kianhk6.github.io/IMLE-VLA/

cs.LG [Back]

[55] Beyond Solver Verdicts: Generative Reward Models for Autoformalization cs.LG | cs.CLPDF

Vikash Singh, Debargha Ganguly, Aman Goel, Ali Torkamani, Xiaoxue Han

TL;DR: 本文针对神经符号系统中形式化翻译的参考等价性验证问题，提出了生成式验证（GenV）方法，通过将离线Z3等价性预言机蒸馏为无参考的连续参考等价性评分，有效检测了判决保持不忠实性（VPU）这一漏洞，并在实验中展示了高精度的验证性能和下游任务增益。

Details

Motivation: 神经符号系统依赖数学求解器保证推理正确性，但求解器无法判断形式化翻译是否严格保持与指定形式化的参考等价性，这导致判决保持不忠实性（VPU）漏洞，即错误编码可能成功执行并匹配预期判决。

Result: 在参考等价性验证中，基于预言机挖掘的验证器（GenV+HN）达到0.961 AUROC，能够零样本泛化到未见过的翻译器和不同形式风格，并在代理测试时计算分配中带来11.3个百分点的下游准确率提升。

Insight: 创新点在于提出生成式验证（GenV），利用语言模型原生词汇空间将等价性预言机蒸馏为连续评分，无需显式定位训练即可通过机制分析（如决策投影logit透镜和稀疏自编码器）提取精确的空间错误坐标，解决了传统结构验证启发式方法在VPU检测上的数学局限性。

Abstract: Neurosymbolic systems rely on mathematical solvers to guarantee reasoning correctness, yet solvers are fundamentally blind to whether a formal translation maintains strict reference-equivalence to a designated formalization. We formalize this vulnerability as Verdict-Preserving-Unfaithfulness (VPU): a failure mode where an incorrect encoding executes successfully and matches the expected verdict. We theoretically prove that structural, verdict-only verification heuristics are mathematically bounded to chance-level detection on these deceptively valid traces. To resolve this, we introduce Generative Verification (GenV), which distills an offline Z3-equivalence oracle into a reference-free, continuous reference-equivalence score by repurposing the language model’s native vocabulary space. Mechanistic analysis via decision-projected logit lenses and sparse autoencoders shows this generative readout natively extracts precise spatial error coordinates without explicit localization training. Empirically, our oracle-mined verifier (GenV+HN) achieves 0.961 AUROC in reference-equivalence verification, generalizes zero-shot across unseen translators and divergent formal styles, and yields an 11.3-point downstream accuracy gain in agentic test-time compute allocation.

[56] RiVaT-Fuse: Reliability-Calibrated Variational Tensor Fusion for Multimodal Prediction under Modality Uncertainty cs.LG | cs.CVPDF

Yingfan Xu, Tieming Liu, Ye Liang, Taiping Liu

TL;DR: 本文提出了RiVaT-Fuse，一个用于图像-元数据预测的可靠性校准变分张量融合框架。它将多模态融合定义为样本级的潜在状态估计，通过变分目标平衡图像证据、元数据证据、跨模态交互和稳定性，从而在模态不确定性下生成共识潜在表示。

Details

Motivation: 现有表示级融合方法（如拼接、门控、注意力）通常直接聚合特征，而未在模态不确定性下明确定义融合表示的含义。本文旨在解决异构证据可靠性随样本和潜在因素变化的问题，为融合提供更严谨的数学定义。

Result: 在图像级图像-元数据预测基准测试中，RiVaT-Fuse在直接表示级基线方法中取得了最强的整体预测排名，同时提高了在扰动下的概率和标签稳定性。

Insight: 创新点在于将融合重新定义为样本级潜在状态估计的变分问题，并用矩阵值的信任几何替代标量模态置信度，将交互分解为加性、乘性和关系性组件。该方法耦合了潜在状态与条件鲁棒性及结构化多任务预测，提供了潜在求解的适定性和稳定性解释。

Abstract: Image-metadata prediction requires fusing heterogeneous evidence whose reliability can vary across samples and latent factors. Existing representation-level fusion methods typically choose an aggregation architecture, such as concatenation, gating, conditional modulation, or attention, without explicitly defining what the fused representation should mean under modality uncertainty. We propose RiVaT-Fuse, a reliability-calibrated variational tensor fusion framework that defines fusion as sample-wise latent-state estimation. Rather than producing a fused vector by direct aggregation, RiVaT-Fuse estimates a consensus latent state through a variational objective that balances image evidence, metadata evidence, structured cross-modal interaction, and stability. The resulting framework replaces scalar modality confidence with matrix-valued trust geometry, decomposes interaction into additive, multiplicative, and relational components, and couples the latent state with conditional robustness and structured multi-task prediction. We provide well-posedness and stability interpretations of the latent solve and instantiate the framework with efficient low-rank-plus-diagonal trust operators. On an image-level image-metadata prediction benchmark, RiVaT-Fuse achieves the strongest overall predictive rank among direct representation-level baselines while improving probability and label stability under perturbation.

[57] M3-Former: Multimodal Transformer with Mixture-of-Experts for Long-Term Vessel Trajectory Prediction cs.LG | cs.CVPDF

Wenzhe Jin, Haina Tang

TL;DR: 本文提出了M3-Former，一个用于长期船舶轨迹预测的多模态Transformer框架。该框架利用大型语言模型编码静态语义信息，并通过双粒度混合专家架构联合建模全局航线规划和局部运动变化，以解决行为多模态、语义利用不足和长期误差累积等挑战。

Details

Motivation: 旨在解决船舶轨迹预测中存在的三大挑战：行为多模态性、有限的语义信息利用以及长期预测中的误差累积问题。

Result: 在真实世界的丹麦AIS数据集上，M3-Former在1至4小时的预测范围内均优于现有SOTA基线。在4小时预测任务中，平均位移误差和最终位移误差分别降低了4.4%和5.1%。定性和消融分析进一步验证了其有效性。

Insight: 创新点在于：1) 构建了统一的多模态表示空间，将LLM编码的静态语义与动态轨迹特征对齐；2) 引入了序列级和令牌级的双粒度混合专家架构；3) 设计了转向加权交叉熵损失以缓解稀疏转向样本的长尾分布问题，为语义引导的层次化预测建立了新范式。

Abstract: To address the challenges of behavioral multimodality, limited semantic utilization, and long-term error accumulation in vessel trajectory prediction, this paper proposes M3-Former, a multimodal trajectory prediction framework enhanced by large language models (LLMs). The proposed framework incorporates vessel static attributes and navigational intent as semantic priors for long-term trajectory modeling. Specifically, a unified multimodal representation space is constructed, in which static semantic information is encoded by a pre-trained LLM and aligned with dynamic trajectory features through self-attention. To jointly capture global route planning and local motion variations, a dual-granularity Mixture-of-Experts (MoE) architecture is introduced, where sequence-level experts model global navigation trends and token-level experts refine fine-grained maneuvering behaviors. In addition, a Steering-Weighted Cross-Entropy loss is designed to alleviate the long-tail distribution of sparse turning samples and improve prediction accuracy in critical maneuvering scenarios. Experiments on a real-world Danish AIS dataset demonstrate that M\textsuperscript{3}-Former consistently outperforms state-of-the-art baselines across prediction horizons from 1 to 4 hours. In the 4-hour prediction task, the proposed method reduces Average Displacement Error (ADE) and Final Displacement Error (FDE) by 4.4% and 5.1%, respectively, compared with the strongest baseline. Qualitative and ablation analyses further verify that semantic fusion effectively reduces long-term trajectory drift, while the dual-granularity MoE improves robustness in complex waterways and route-branching scenarios. The proposed framework establishes a semantic-guided hierarchical prediction paradigm, in which high-level navigational intent and local motion dynamics are jointly modeled for robust long-term vessel trajectory forecasting.

eess.AS [Back]

[58] Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding eess.AS | cs.CLPDF

Michael Picheny

TL;DR: 本文提出了一种基于Whisper的多语言视频语音转录方法，旨在通过改进跨语言视频的自动转录质量，为跨文化理解工具提供更好的训练数据。该方法利用YouTube公开视频和Whisper工具，在七种语言（西班牙语、日语、韩语、普通话、土耳其语、俄语和希伯来语）上实现了平均30%的转录错误率，并通过少量微调数据将错误率降低至20%。

Details

Motivation: 在全球化背景下，跨文化理解日益重要，而基于LLM的自动化工具需要高质量的多语言视频转录数据来辅助非母语者适应跨文化环境。本文旨在为工具构建者提供无需深厚语音处理专业知识即可使用的简易语音转录流程。

Result: 在七种语言的YouTube视频上，使用Whisper工具进行基线转录的平均错误率为30%；经过少量数据微调后，平均错误率降至20%，显著提升了转录结果的可用性。

Insight: 创新点在于提供了一个易于使用的多语言视频语音转录框架，并公开了相关的语音和元数据，以促进社区进一步优化。从客观角度看，该方法通过微调显著提升了Whisper在跨语言视频转录上的性能，为跨文化理解工具的数据准备提供了实用解决方案。

Abstract: Cross-cultural understanding has become increasingly important in today’s highly connected, cross-national world. The success of LLM-based technologies is now driving the development of automated tools to aid understanding for nonnative people trying to succeed in cross-cultural environments. Building such automated tools is often done by leveraging in-thewild text, audio, and video data. This paper presents techniques for improving speech recognition-based transcript creation in multiple languages from videos to better train these automated tools. The focus is on processes and speech tools that can easily be used by cross-cultural tool builders without requiring deep speech processing expertise. Using publicly available videos from YouTube and Whisper-based tools, average transcription error rate across seven languages (Spanish, Japanese, Korean, Mandarin, Turkish, Russian, and Hebrew) of 30% are observed. With a modest amount of fine-tuning data, the average error rate can be reduced to 20% making such output much more usable for downstream processing. Speech and metadata associated with these videos that can be used by the community to further refine these experiments are released as well.

[59] RetroThinker: Enabling Retrospective Thinking in Speech LLMs eess.AS | cs.AI | cs.CLPDF

Yi-Jen Shih, Puyuan Peng, Abdelrahman Mohamed, David Harwath

TL;DR: 本文提出了RetroThinker，一种多阶段后训练框架，旨在增强语音大语言模型（SpeechLLMs）的推理能力。该框架通过自我验证和前瞻性修正思维链步骤，使模型能够在推理过程中动态修订其推理轨迹，从而在保持低延迟的同时提升复杂任务上的准确性。

Details

Motivation: 语音大语言模型虽然降低了延迟并保留了副语言细微差别，但在复杂推理任务上仍落后于纯文本LLMs，且实时语音交互对延迟有严格限制。现有方法如思维链和并发推理存在固有的准确性与延迟权衡问题，因此需要探索模型能否动态修订推理过程。

Result: 在GSM8K基准测试中，RetroThinker相比非回顾性基线显著改善了准确性与延迟的权衡，在可比延迟下实现了11%的绝对准确率提升。

Insight: 创新点在于引入回顾性思维机制，通过监督微调和基于长度的直接偏好优化，使模型能够在用户说话时进行早期推理中的自我验证和前瞻性修正，从而动态优化推理过程，这为流式语音LLMs的实时推理提供了新思路。

Abstract: Speech large language models (SpeechLLMs) offer reduced latency and retain paralinguistic nuances that are typically lost in cascaded automatic speech recognition (ASR) and text-based LM architectures. However, they continue to lag behind text-only LLMs on complex reasoning tasks, while real-time spoken interaction imposes strict latency constraints. Although prior works employ Chain-of-Thought (CoT) and concurrent reasoning to enhance reasoning capabilities without inducing prohibitive delays, an inherent accuracy-latency trade-off persists. In this paper, we investigate whether a streaming SpeechLLM can dynamically revise its reasoning traces on the fly. We introduce RetroThinker, a multi-stage post-training framework that equips the Moshi model to self-verify and forward-correct CoT steps during inference. RetroThinker combines supervised fine-tuning (SFT) on curated retrospective thinking data with length-based direct preference optimization (DPO) to optimize retrospective during early reasoning (i.e., reasoning concurrently while the user speaks). Evaluated on the GSM8K benchmark, RetroThinker significantly improves the accuracy-latency trade-off over non-retrospective baselines, achieving an 11% absolute accuracy gain at a comparable latency.

cs.AI [Back]

[60] Studying Without a Syllabus: Task-Agnostic Environment Preprocessing cs.AI | cs.CL | cs.LGPDF

Vinay Samuel, Varun Ursekar, Vijay S. Kalmath, Apaar Shanker, Veronica Chatrath

TL;DR: 本文研究了任务无关的环境预处理问题，探讨了大型语言模型（LLM）代理在未知下游任务分布的情况下，如何自主探索新环境并构建可重用资源（如索引、脚本或程序指南）。论文形式化了该问题，并通过实验比较了不同预处理方法在六个异构基准测试上的性能。

Details

Motivation: 现有自动化适应方法通常依赖任务示例、轨迹或评估反馈来决定构建什么资源，而现有的任务无关方法虽无需监督，但需预先为特定环境类型确定准备策略。本文旨在研究一个更开放的环境：代理能否在测试前且不了解下游任务分布的情况下，自主探索不熟悉的环境并选择如何准备。

Result: 在六个异构基准测试中，一个配备存档的元代理变体在五个基准上取得了最高的Avg@3奖励，而固定的语料库处理方法在最大的语料库基准上表现最佳。更大的研究预算并不总能可靠地提高下游奖励，但所构建的工件减少了达到给定分数所需的测试时采样。

Insight: 论文的创新点在于形式化了任务无关的环境预处理问题，并展示了可重用准备如何将计算从重复的测试时尝试转移到任务前的研究阶段。从客观角度看，该方法为LLM代理在未知任务下的自主环境适应提供了新的研究视角，强调了预任务探索与资源构建的潜力。

Abstract: Before an LLM agent tackles tasks in a new environment, it can inspect available corpora and tools and construct reusable resources such as indices, scripts, or procedural guidance. Most automated adaptation methods, however, rely on task examples, trajectories, or evaluation feedback to decide what to build. Existing task-agnostic approaches avoid this supervision but commit in advance to a preparation strategy for a particular type of environment. We study a more open-ended setting: can an agent study an unfamiliar environment without a syllabus, i.e. before test time and without knowledge of the downstream task distribution, and choose how to prepare it? We formalize task-agnostic environment preprocessing, in which a studying system explores an environment under a budget and produces artifacts for a frozen solver. We compare unaided and archive-equipped meta-agents with fixed synthetic-practice and corpus-processing methods across six heterogeneous benchmarks. A meta-agent variant achieves the highest Avg@3 reward on five benchmarks, while fixed corpus processing remains best on the largest corpus benchmark. Larger study budgets do not reliably improve downstream reward. Nevertheless, studied artifacts reduce the test-time sampling needed to reach a given score, demonstrating how reusable preparation can shift computation from repeated test-time attempts to a pre-task study phase.

[61] KuaiRP Series Role-playing Models Technical Report cs.AI | cs.CLPDF

Yipeng Wang, Ziwei Zhang, Jiahui Zhang, Qi Gan, Kai Sheng

TL;DR: 本文介绍了KuaiRP系列角色扮演模型的完整技术方案，旨在实现简化提示工程、高稳定输出质量、内置领域世界知识以及小参数规模高效部署四大核心目标。为克服深度领域知识注入导致的通用能力灾难性遗忘问题，提出了一个多阶段训练流程，包括基于用户行为模拟和反向画像过滤的SFT数据构建、基于规则复合奖励函数的强化学习，以及采用累积散度衰减的两阶段在线策略蒸馏新范式来恢复通用能力。

Details

Motivation: 解决为专用角色扮演模型注入深度领域知识时，普遍导致模型通用智能体能力严重遗忘的权衡问题。

Result: 实验结果表明，KuaiRP模型在目标领域内的角色扮演保真度上达到了当前最先进的专有模型水平，同时成功恢复了通用智能体能力，并保持了极低的部署成本。

Insight: 创新点在于提出了一个结合SFT、RL和新型自蒸馏（Two-stage OPD with CDD）的多阶段训练流程，通过让领域适应模型作为教师、原始基础模型作为学生，有效平衡了深度领域知识注入与通用能力保留。该方法为解决领域专业化与通用能力保留的经典矛盾提供了新思路。

Abstract: This paper introduces the complete technical solution for the KuaiRP series of role-playing models. We aim to achieve four core objectives for a dedicated role-playing model: simplified prompt engineering, highly stable output quality, built-in domain world knowledge, and high-efficiency deployment with a small parameter size. However, effectively injecting deep domain knowledge often leads to a severe catastrophic forgetting of the model’s general agent capabilities. To overcome this trade-off, we propose a multi-stage training pipeline. First, we design a standardized character template and construct an SFT data pipeline based on user behavior simulation and reverse profile filtering. Next, we utilize a rule-based composite reward function during the Reinforcement Learning (RL) phase to eliminate common degradation phenomena like length expansion and repetitive generation. Finally, to recover the general capabilities compromised during SFT and RL, we propose a novel self-distillation paradigm using Two-stage On-Policy Distillation (OPD) equipped with Cumulative-Divergence Decay (CDD). By using the domain-adapted model as the teacher and the original base model as the student, we effectively balance deep domain knowledge injection with the preservation of general agent capabilities. Experimental results demonstrate that the KuaiRP models not only match the current state-of-the-art proprietary models in role-playing fidelity within our target domains, but also successfully recover general agent capabilities, maintaining extremely low deployment costs.

[62] A Voice-Interactive Multi-Agent System for Smart Operating Rooms: Architecture Design and Key Technologies cs.AI | cs.CL | cs.HCPDF

Tianxiang Zhou

TL;DR: 本文介绍了SurgicalRoomAgent，一个基于大语言模型的智能手术室语音交互多智能体系统。该系统通过分层架构实现自然语言理解、设备控制、术中记录和手术报告生成，并研究了三种关键技术以降低延迟和优化上下文使用。

Details

Motivation: 旨在为智能手术室开发一个低延迟、高响应的语音交互系统，以支持自然语言控制、记录和报告生成，满足手术室实时操作的需求。

Result: 系统在16,384个令牌的上下文限制内有效运行，多设备并行控制响应时间满足手术室实时要求，关键技术将推理延迟从约500毫秒降低至数十毫秒，端到端延迟减少约30%。

Insight: 创新点包括KV Cache前缀预热以减少推理延迟、流式部分JSON解析以实现早期并行任务执行，以及基于用户角色、连接设备和手术阶段动态过滤系统提示的渐进式技能提示披露，以优化有限上下文窗口的信息密度。

Abstract: This paper presents SurgicalRoomAgent, a voice-interactive multi-agent system for smart operating rooms based on large language models (LLMs). The system achieves natural language understanding, device control, intraoperative recording, and surgical report generation through a layered architecture comprising a voice interaction pipeline (wake, ASR, turn detection, agent reasoning, TTS) and an agent core (skill registry, task planner, device manager). Three key technologies are investigated: (1) KV Cache prefix warming for low-latency inference, reducing recomputation overhead from approximately 500 ms to tens of milliseconds via byte-level Longest Common Prefix reuse; (2) streaming partial JSON parsing with early parallel task execution, reducing end-to-end latency by approximately 30%; and (3) progressive skill prompt disclosure, which dynamically filters system prompts based on user role, connected devices, and surgical phase to maximize information density within limited context windows. The system is implemented using the Qwen3-27B model with llama.cpp/sglang inference engines. Experimental analysis demonstrates effective operation within a 16,384-token context limit and multi-device parallel control response times meeting OR real-time requirements.

[63] AI-Powered Flare Combustion Efficiency Estimation cs.AI | cs.CVPDF

Afeefa Azam, Iyyakutti Iyappan Ganapathi, Fares Ossama Abdelhafez, Divya Velayudhan, Maregu Assefa Habtie

TL;DR: 该论文提出了一种基于AI的燃烧效率估计方法，通过结合轻量级视觉语言编码器和多层感知机，直接从低成本热成像视频中预测火炬燃烧效率，并集成到易于部署的图形用户界面中。

Details

Motivation: 传统气体分析仪和高光谱相机等设备昂贵、易损且需要频繁校准，不适用于偏远或预算有限的工业现场，因此需要一种低成本、可靠的替代方案来监测火炬燃烧效率以满足环保标准。

Result: 系统在六个月的运行中实现了99%的正常运行时间，每周维护时间少于15分钟，表明其具有高可靠性和低维护成本。

Insight: 创新点在于利用低成本热成像视频替代昂贵传感器，结合视觉语言模型进行端到端效率预测，并通过用户友好的界面实现实时监控和数据导出，为工业监测提供了实用且经济的解决方案。

Abstract: Achieving high combustion efficiency in flare stacks is crucial for adhering to regulatory standards and controlling the release of hydrocarbons into the environment. Traditional instruments like gas analyzers and hyperspectral cameras are expensive, fragile, and require frequent calibration, which makes them impractical for remote or budget constrained industrial sites. We propose an innovative solution that combines a lightweight vision-language encoder with a compact multi-layer perceptron to predict combustion efficiency directly from low-cost thermal video footage. The fully trained model is integrated into an easy-to-deploy graphical user interface. This interface overlays predicted combustion efficiency values on each video frame, displays real-time trends in combustion efficiency, shows the distribution of combustion efficiency across all frames in the video, and allows users to export CSV reports. Over a six-month period, the system achieved 99% uptime and required less than 15 minutes of maintenance per week.

[64] MindTopo: Can Foundation Models Reason in Topological Space? cs.AI | cs.CL | cs.CVPDF

Yunfei Ge, Anbang Liu, Qineng Wang, Johnalbert Garnica, Jianwen Lyu

TL;DR: 本文介绍了MindTopo基准测试，旨在评估基础模型在拓扑空间中的推理能力。该基准基于认知科学和形式拓扑学定义了五个拓扑属性（连续性、分离性、顺序性、包围性和结），包含11,030个实例，涵盖13种程序生成的任务类型，并分为推理和规划两个认知层次进行评估。

Details

Motivation: 当前基础模型的评估主要关注度量或视角依赖的空间关系，而忽略了拓扑关系这一空间理解的基础。本文旨在填补这一空白，系统评估模型对拓扑不变性的理解。

Result: 评估了14个多模态大语言模型（MLLM），所有模型在推理任务上的表现均优于规划任务，且最佳模型性能仍远低于观察到的人类水平。在Qwen3-VL-2B-Instruct模型上，监督微调和强化学习对推理能力的提升大于对规划能力的提升。

Insight: 提出了首个系统评估基础模型拓扑直觉的基准，将认知科学的拓扑属性与形式拓扑学结合，并区分了推理（识别关系）和规划（闭环智能体行动）两个认知层次。研究发现模型生成的观察能保留局部线索，但难以可靠地遵循环境动态或保持跨状态转换的拓扑不变性。

Abstract: Spatial reasoning depends not only on metric properties such as distance, angle, and shape, but also on topological relations that remain invariant under continuous deformation. Cognitive science identifies these relations as foundational to spatial understanding, yet foundation-model evaluations largely focus on metric or viewpoint-dependent relations. We introduce MindTopo, a benchmark of topological intuition across five properties grounded in cognitive science and formal topology: continuity, separation, order, enclosure, and knots. MindTopo evaluates each property at two cognitive levels. Reasoning asks a model to identify topological relations or infer how they change. Planning instantiates a foundation model as a closed-loop agent whose policy selects environment actions. MindTopo contains 11,030 instances across 13 procedurally generated task types with controllable difficulty. We benchmark 14 MLLMs and study agent configurations augmented with image and video generation, including 3 video generative models in planning settings. Every MLLM performs better on reasoning than on planning, and the best-performing model remains far below observed human performance. On Qwen3-VL-2B-Instruct, supervised fine-tuning and reinforcement learning improve reasoning more than planning. Generated observations retain local cues and reach plausible endpoints, but audited rollouts do not reliably follow environment dynamics or preserve topology across transitions. Our website is at https://mind-topo.github.io/

eess.IV [Back]

[65] Scale-Aware 3D Deep Learning for Robust Brain Metastasis Detection in Multimodal MRI eess.IV | cs.CV | cs.LGPDF

Sylvain Jaume, Hongming Wang, Simon K. Warfield

TL;DR: 本文提出了一种尺度感知的3D深度学习框架，用于在多模态MRI中鲁棒地检测脑转移瘤。该方法通过融合不同空间视野（FOV）的独立训练的3D U-Net（96^3和64^3）的整个体积概率图，以加权晚期融合的方式结合，旨在利用互补的空间上下文信息改善检测性能。

Details

Motivation: 脑转移瘤在MRI中检测具有挑战性，因为病灶在大小和外观上变化很大，且非常小的转移瘤在三维输入中仅占极小部分。研究动机是探究结合不同空间视野是否能改善多模态MRI中的病灶检测。

Result: 在97名患者的开发队列上，跨FOV融合相对于单个模型提高了病灶级别的精确率和F1分数，同时显著减少了假阳性。一个相同FOV的集成对照实验表明，这些增益并非仅由独立训练网络的平均所解释，支持了互补空间上下文的贡献。

Insight: 创新点在于提出了一种简单的、计算上实用的跨FOV概率融合策略，以改善3D脑转移瘤检测中的精确率-假阳性权衡。该方法允许单独研究空间上下文与图像分辨率和模态选择的影响，并通过加权晚期融合有效结合了不同尺度的信息。

Abstract: Detecting brain metastases in magnetic resonance imaging (MRI) remains challenging because lesions vary widely in size and appearance, with very small metastases occupying only a minute fraction of a three-dimensional input. We investigate whether combining different spatial fields of view (FOVs) improves lesion detection in multimodal MRI and present a scale-aware 3D deep-learning framework. The method uses independently trained $96^3$ and $64^3$ 3D U-Nets whose whole-volume probability maps are combined by weighted late fusion. This design allows us to study the effect of spatial context separately from image resolution and modality choice. On a 97-patient development cohort, cross-FOV fusion improved lesion-level precision and F1 while substantially reducing false positives relative to the individual models. A same-FOV ensemble control showed that these gains were not explained solely by averaging independently trained networks, supporting a contribution from complementary spatial context. An exploratory cross-FOV agreement filter reduced false positives but did not improve overall F1. These results support cross-FOV probability fusion as a simple and computationally practical strategy for improving the precision-false-positive trade-off in 3D brain-metastasis detection.

Table of Contents

cs.CL [Back]

[1] Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking cs.CLPDF

[2] Data-Efficient Language Modeling: From Frontier Advancement to Principle-Guided Model Improvement cs.CL | cs.AIPDF

[3] Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System cs.CLPDF

[4] SearchAtlas: Analyzing Agentic Search Strategies via Evidential Query Graphs cs.CLPDF

[5] Structurally Speaking: Motif-Oriented Graph Captioning through Bidirectional Graph-Text Translation cs.CL | cs.LGPDF

[6] Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction cs.CL | cs.AI | cs.LGPDF

[7] Distribution-aware Language Neuron Identification in Multilingual Large Language Models cs.CLPDF

[8] Rubric-Aligned Disentangled Evaluation of Human Simultaneous Interpreting cs.CLPDF

[9] OmniHallu: Unified Hallucination Detection for Cross-Modal Comprehension and Generation in Multimodal Large Language Models cs.CL | cs.CVPDF

[10] Can LLMs Normalize Databases? A Benchmark and Multi-Agent Framework for Schema Normalization cs.CLPDF

[11] The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods cs.CLPDF

[12] MultiHuSE: A Multimodal Dataset for Humour Styles and Emotions cs.CL | cs.CV | cs.MMPDF

[13] SEAR: Segment-Evidence-Aware Routing for Weak-to-Strong Multilingual Speech MCQ cs.CL | cs.SDPDF

[14] ReGround: Grounding Reviewer Comments in Multimodal Evidence cs.CL | cs.IRPDF

[15] Negative Self-Distillation: Learning to Reason by Avoiding Flaws cs.CL | cs.LGPDF

[16] The Eloquence submission for Task 2 of the Interspeech 2026 MLC-SLM challenge cs.CLPDF

[17] Augustinian BabyLM: What Ostensive Definition Can and Cannot Teach a Small Language Model cs.CLPDF

[18] Domain-Specific Hallucination Detection in Large Language Models cs.CL | cs.AI | cs.LGPDF

cs.CV [Back]

[19] MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery cs.CVPDF

[20] Rethinking Handwritten Character Recognition cs.CV | eess.IVPDF

[21] Meta-Learning for Data-Efficient Plant Growth Estimation via Vision Transformers and Fuzzy Clustering cs.CV | cs.LGPDF

[22] Evaluation of Vision-Language Models Across Diverse Coastal Environments cs.CV | cs.ROPDF

[23] BodyCam-VQA: Enhanced Body-Worn Camera Video Captioning via Multimodal Reasoning and Probe Question Generation cs.CV | cs.CLPDF

[24] HiPerViT: A Hierarchical Perceiver-Vision Transformer Architecture for Multi-Scale Texture Recognition cs.CVPDF

[25] CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation cs.CVPDF

[26] New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

[27] Toward Interpretable Multimodal Fusion: Heat Conduction Modeling for Hyperspectral and LiDAR Joint Classification cs.CV | cs.AIPDF

[28] TailProp: content-adaptive light- and heavy-tailed propagation for vision cs.CV | cs.LGPDF

[29] Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions cs.CV | cs.AI | cs.ETPDF

[30] Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval cs.CV | cs.AIPDF

[31] CEM-TUDASR: Computationally efficient multi-modality transformer based unsupervised domain adaptive super-resolution approach cs.CVPDF

[32] Tri-DehazeGS: Scene–Medium Decoupled Gaussian Splatting with Transmittance-Aware Optimization cs.CVPDF

[33] HALDETECT at ImageEval 2026 Shared Tasks: Answer-First Contrastive Grounding with QLoRA cs.CV | cs.AIPDF

[34] Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation cs.CVPDF

[35] From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models cs.CV | cs.AIPDF

[36] Your Model Already Knows Don’t Teach It, Learn to Ask It: Soft Prompting for Few-Shot Adaptation of Vision-Language Models cs.CV | cs.AI | cs.LG | eess.IV | stat.MLPDF

[37] Multi-Modal Controlled Coherent Motion Generation cs.CVPDF

[38] Vision Transformer-Based Multi-Level Feature Fusion for Multi-Label Sewer Defect Classification cs.CVPDF

[39] BruNet: A Cross-Domain Transfer Framework for Bruise Segmentation cs.CVPDF

[40] DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging cs.CVPDF

[41] Recursive Code World Models: Building Complex Worlds through Recursive Scene Programs cs.CVPDF

[42] Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation cs.CVPDF

[43] World in World: Explore the World with World Models cs.CVPDF

[44] OmniKVQuant: KV Cache Quantization for Omni-LLMs cs.CVPDF

[45] MMGait: Benchmarking and Unifying Gait Recognition across Heterogeneous Modalities cs.CVPDF

[46] Multimodal Taxonomic Conditioning for Generative Plankton Imagery cs.CV | cs.LGPDF

[47] Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation cs.CV | cs.LGPDF

[48] MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird’s-Eye-View Images cs.CV | cs.ROPDF

[49] Language-Augmented Semantic Priors for B-Spline Surface Fitting cs.CV | cs.AIPDF

[50] SenseNova-U1.5: Towards Native Unified Visual Intelligence cs.CVPDF

[51] Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding cs.CV | cs.HCPDF

cs.SD [Back]

[52] Xiaomi-CocktailASR-1 Technical Report cs.SD | cs.CL | eess.ASPDF

cs.RO [Back]

[53] HuRo: Robotizing Human Videos for Scalable VLA Pretraining cs.RO | cs.CV | cs.LGPDF

[54] IMLE-VLA: Fast Single-Step Action Generation for Vision-Language-Action Policies cs.RO | cs.CVPDF

cs.LG [Back]

[55] Beyond Solver Verdicts: Generative Reward Models for Autoformalization cs.LG | cs.CLPDF

[56] RiVaT-Fuse: Reliability-Calibrated Variational Tensor Fusion for Multimodal Prediction under Modality Uncertainty cs.LG | cs.CVPDF

[57] M3-Former: Multimodal Transformer with Mixture-of-Experts for Long-Term Vessel Trajectory Prediction cs.LG | cs.CVPDF

eess.AS [Back]

[58] Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understanding eess.AS | cs.CLPDF

[59] RetroThinker: Enabling Retrospective Thinking in Speech LLMs eess.AS | cs.AI | cs.CLPDF

cs.AI [Back]

[60] Studying Without a Syllabus: Task-Agnostic Environment Preprocessing cs.AI | cs.CL | cs.LGPDF

[61] KuaiRP Series Role-playing Models Technical Report cs.AI | cs.CLPDF

[62] A Voice-Interactive Multi-Agent System for Smart Operating Rooms: Architecture Design and Key Technologies cs.AI | cs.CL | cs.HCPDF

[63] AI-Powered Flare Combustion Efficiency Estimation cs.AI | cs.CVPDF

[64] MindTopo: Can Foundation Models Reason in Topological Space? cs.AI | cs.CL | cs.CVPDF

eess.IV [Back]

[65] Scale-Aware 3D Deep Learning for Robust Brain Metastasis Detection in Multimodal MRI eess.IV | cs.CV | cs.LGPDF