cs.CL [Total: 36]
cs.CV [Total: 67]
eess.IV [Total: 1]
cs.SE [Total: 1]
cs.RO [Total: 2]
cs.CE [Total: 1]
cs.SI [Total: 1]
cs.AI [Total: 5]
cs.LG [Total: 4]

cs.CL [Back]

[1] R$^{2}$Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG cs.CL | cs.IRPDF

Yucan Guo, Miao Su, Saiping Guan, Long Bai, Zhongni Hou

TL;DR: 本文提出了R$^{2}$Adapter，一个轻量级的插件式路由与重写适配器，用于动态分配查询给基于文本的普通RAG和基于图结构的RAG。它通过路由机制仅将真正受益于图推理的查询分配给图RAG，以减少不必要的图检索开销，并对不确定的图路由查询进行重写以更好地暴露其多跳推理需求，从而在保持答案准确性的同时显著提升混合RAG系统的效率。

Details

Motivation: 现有混合文本-图RAG方法通常依赖启发式或基于LLM的路由，导致不必要的开销和对底层LLM的强依赖。用户查询的复杂性差异很大，固定的RAG策略并非最优。

Result: 在三个多跳问答基准测试上的广泛实验表明，R$^{2}$Adapter将基于图的RAG使用量减少了高达59%，同时保持了可比的答案准确性。

Insight: 论文的创新点在于提出了一个模型无关的轻量级适配器，它通过动态路由和查询重写机制，实现了对查询复杂性的自适应处理，从而在混合RAG系统中平衡了效率与精度，无需额外监督即可提升检索质量。

Abstract: Retrieval-Augmented Generation (RAG) has become a prevailing paradigm for enhancing Large Language Models (LLMs) with non-parametric knowledge. Vanilla RAG efficiently handles simple queries but struggles with relational or multi-hop reasoning. Graph-based RAG alleviates this issue but incurs higher inference complexity and latency. In practice, user queries can differ significantly in their complexity, rendering a fixed RAG strategy suboptimal. However, existing hybrid text-graph RAG methods typically rely on heuristic and LLM-based routing, resulting in unnecessary overhead and strong dependence on the underlying LLM. To address these challenges, we propose R$^{2}$Adapter, a lightweight plug-in Routing and Rewriting Adapter designed to allocate queries between vanilla and graph-based RAG dynamically. By routing only the queries that genuinely benefit from graph-based reasoning, R$^{2}$Adapter reduces unnecessary graph retrieval overhead. Additionally, uncertain graph-routed queries are rewritten to better expose their multi-hop reasoning requirements, improving retrieval quality without additional supervision. Extensive experiments on three multi-hop QA benchmarks demonstrate that R$^{2}$Adapter reduces graph-based RAG usage by up to 59% while maintaining comparable answer accuracy. This adapter is model-agnostic and can be seamlessly integrated into diverse vanilla and graph-based RAG pipelines, providing an efficient and adaptive solution for hybrid RAG systems.

[2] Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition cs.CL | cs.SDPDF

Fengrun Zhang, Li Fu, Wangjin Zhou, Lu Fan, Youzheng Wu

TL;DR: 本文提出了一种名为Dual-Form ASR（DF-ASR）的框架，旨在解决自动语音识别（ASR）中口语形式转录和书面形式转录（通过逆文本规范化，ITN）的生成问题。该框架通过引入口语和书面语的双重监督，结合LLM驱动的生成-判断工作流和ITN-MWER序列级目标，实现了语义感知的ITN，同时保留了在转录形式间的提示级选择能力。

Details

Motivation: 当前ASR系统通常采用级联模块，先产生口语形式转录，再由独立的ITN组件重写为书面形式，这使得书面形式ASR-ITN易受识别错误影响，且规范化过程与声学-上下文建模脱节，特别是在处理语义依赖的数字表达时。

Result: 在SpeechIO的中文手动标注子集上，DF-ASR持续优于开源ASR-ITN系统，与强大的闭源参考系统保持竞争力，并在口语和书面语输出之间保持了可靠的提示级控制。

Insight: 创新点包括：通过LLM驱动的生成-判断工作流构建双重监督数据，引入ITN-MWER序列级目标以增强对规范化敏感跨度的错误惩罚，以及提出决策感知的REQUIRE-ITN/FORBID-ITN协议来分别评估必需规范化和禁止跨度的保留。

Abstract: Modern automatic speech recognition (ASR) scenarios require both spoken-form transcripts for faithful transcription and readable written-form transcripts with inverse text normalization (ITN). However, these forms are typically produced by cascaded modules, where a spoken-form ASR output is rewritten by a separate ITN component, making written-form ASR-ITN vulnerable to recognition errors and decoupling normalization from acoustic-contextual modeling, especially for semantically dependent numeric expressions. In this paper, we propose Dual-Form ASR (DF-ASR), a framework that extends spoken-form ASR capability to semantics-aware written-form ITN through paired spoken-form and written-form supervision while retaining prompt-level selection between transcript forms. The dual-form supervision is constructed via a large language model (LLM)-driven generate-and-judge workflow, and training is further enhanced by ITN-MWER, a sequence-level objective that assigns higher cost to errors on normalization-sensitive spans. We also introduce a decision-aware REQUIRE-ITN/\FORBID-ITN protocol to separately measure required normalization and forbidden-span preservation. On manually annotated Chinese subsets from SpeechIO, DF-ASR consistently outperforms open-source ASR-ITN systems, remains competitive with strong closed-source references, and preserves reliable prompt-level control between spoken-form and written-form outputs.

[3] RL-ADA: A World-Feedback Framework for Adversarially Robust Enterprise Dialogue Agents cs.CLPDF

Ram Narayanan, Harshit Rajgarhia, Abhishek Mukherji

TL;DR: 本文提出了RL-ADA框架，通过强化学习与对抗性对话代理的协同进化，解决企业任务型对话代理部署中标注数据稀缺和隐私敏感的问题。该框架利用基于交互结果的‘世界反馈’作为奖励信号，无需人工标注，使客户支持代理和对抗性客户代理在自动化裁判引导下相互对抗与进化。在银行客服概念验证中，该方法显著提升了任务完成率并消除了工具路由错误。

Details

Motivation: 企业客服对话代理的部署面临持续的标注瓶颈：鲁棒训练需要大规模标注的交互数据，但企业对话日志具有隐私敏感性且标注成本高昂，同时用户行为的变化速度快于标注流程的更新速度。

Result: 在银行客户支持的概念验证中，经过五个协同进化周期后，工具路由错误被消除，严格的端到端任务通过率（PASS rate）翻倍，所有改进仅依赖于自动化竞技场的奖励信号，未使用任何标注数据。

Insight: 核心创新在于用基于交互结果（世界反馈）的奖励信号完全替代人工标注，构建了一个非对称对抗的协同进化训练框架。一个值得注意的发现是‘上下文伪装’策略的涌现，即对抗性客户代理学会在密集的真实客户细节中隐藏意图，这对企业红队测试和鲁棒性评估具有直接启示。

Abstract: Deploying task-oriented dialogue agents in enterprise customer support faces a persistent annotation bottleneck: robust training requires labelled interaction data at scale, yet enterprise conversational logs are privacy-sensitive and expensive to annotate, while user behaviour evolves faster than labelling pipelines can keep pace. We present RL-ADA (Reinforcement Learning with Adversarial Dialogue Agents), a co-evolutionary training framework that eliminates this bottleneck by replacing human labels with \emph{world feedback}: consequence-based reward signals derived directly from measurable interaction outcomes. A Customer Support Agent (DA, 3B parameters) and an Adversarial Customer Agent (CA, 7B parameters) co-evolve in an adversarial arena guided by a fixed automated judge: the DA is rewarded for correctly handling multi-turn customer conversations to successful resolution, while the CA is rewarded for producing realistic, intent-concealing utterances that cause misroutes, creating asymmetric adversarial pressure through opposing but independently structured rewards. An isolation gym iteratively retrains the weaker agent on prior-failure transcripts, requiring no human annotation at any stage. In a banking customer support proof of concept, tool-routing errors are eliminated and the strict end-to-end PASS rate doubles over five co-evolutionary cycles, driven solely by automated arena reward with no labelled data. We additionally observe the emergence of \textbf{Contextual Camouflage}, an adversarial strategy in which the CA learns to embed intent within dense realistic customer detail purely from reward pressure, with direct implications for enterprise red-teaming and robustness evaluation.

[4] Judging LLM-as-a-Judge: Concerning Rubric Artifacts in LLM-based Automated Text Generation Evaluation cs.CL | cs.AIPDF

Anshul Bagaria, Sowmya S Sundaram, Gokul S Krishnan, Balaraman Ravindran

TL;DR: 该论文研究了基于LLM的自动文本生成评估方法（LLM-as-a-Judge）的可靠性问题。研究发现，仅基于评分标准文本（rubric）本身，无需查看待评估的回复，就能以非平凡的准确率预测评估结果，这表明评分标准本身编码了可预测的评估信号。此外，当对候选回复或评分标准进行反向扰动时，评估模型往往无法可靠地更新其判断。

Details

Motivation: 论文的动机是质疑当前广泛使用的基于LLM的自动评估流程的核心假设——即评估判断源于对候选回复相对于评分标准的推理。作者认为这一假设需要进一步审视，以探究此类评估方法的可靠性。

Result: 实验结果显示，仅基于评分标准文本训练的分类器在预测评估者输出上取得了非平凡的预测性能。此外，反事实扰动实验表明，当候选回复或评分标准被反转时，评估模型经常无法可靠地更新其决策。

Insight: 论文的创新点在于揭示了基于评分标准的LLM评估可能存在的‘评分标准伪影’问题，即评估结果可能部分独立于被评估的模型输出，而过度依赖于评分标准本身的表述。这为自动化评估方法学的研究敲响了警钟，强调了需要更严谨的方法来确保评估的可靠性。

Abstract: LLM-as-a-Judge pipelines are increasingly used to evaluate AI-generated text, based on the assumption that judgments arise from reasoning over candidate responses with respect to a rubric. We show that this assumption warrants further scrutiny. Classifiers trained only on rubric text, without access to any evaluated response, achieve nontrivial predictive performance on judge outputs. This suggests that rubric formulations encode recoverable evaluative signals, allowing scores to be partially anticipated independently of model outputs. Finally, counterfactual perturbations reveal that judges often fail to reliably update their decisions when either the candidate response or the rubric criterion is reversed. Our findings raise concerns about the reliability of rubric-based LLM evaluation and highlight the need for further methodological study of automated evaluation via LLMs.

[5] LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigation cs.CLPDF

Huiyuan Xie, Yuqin Huang, Zhicheng Hao, Yida Cai, Shaochun Wang

TL;DR: 本文提出了LexIssue基准，用于评估中文民事诉讼中的法律争议焦点识别任务。该基准包含430个真实案例和1,303个专家标注的争议焦点，并构建了一个涵盖27个案由和441个候选条目的法律知识库以支持检索增强推理。研究将法律争议焦点识别定义为法律争议焦点生成和分类两个互补任务，实验表明利用构建的知识库进行检索增强生成能有效提升模型性能。

Details

Motivation: 解决现实诉讼中识别诉讼双方争议焦点的关键需求，而当前法律AI研究对此领域探索相对不足。

Result: 在构建的LexIssue基准上，多种模型的实验结果表明，使用构建的法律争议焦点知识库进行检索增强生成能持续提升识别争议焦点及其对应法律属性的性能。

Insight: 提出了一个法律上具有依据的层次化模式，将法律争议焦点识别形式化为生成和分类两个互补任务，并构建了支持检索增强推理的以争议焦点为中心的法律知识库，为法律AI的细粒度任务提供了新的基准和方法框架。

Abstract: Identifying the issues disputed between litigating parties is a crucial component of real-world litigation. However, legal issues remain comparatively underexplored in legal AI research. In this work, we study the computational modelling of legal issue identification in litigation. We introduce a legally grounded hierarchical schema that represents legal issues through both free-form issue descriptions and structured legal categories, and formulate legal issue identification as two complementary tasks: legal issue generation and legal issue classification. Based on this formulation, we construct LexIssue, a benchmark containing 430 real-world Chinese civil litigation cases and 1,303 expert-annotated disputed legal issues. We further develop an issue-centric legal knowledge base spanning 27 causes of action and 441 candidate legal issue entries to support retrieval-augmented reasoning. Experimental results across a diverse set of models show that retrieval-augmented generation using the constructed legal issue knowledge base consistently improves performance in identifying disputed legal issues and their corresponding legal attributes.

[6] Jina-OCR-v1: Efficient Document Parsing with Speculative Decoding and Dense Verifiable Rewards cs.CL | cs.CVPDF

Alejandro Barón García, Feng Wang, Emilia Garcia Casademont, Han Xiao

TL;DR: Jina-OCR-v1是一个专为低预算GPU设计的端到端文档解析模型。它结合了DeepSeek-OCR的压缩视觉编码器和30亿参数的专家混合解码器，并引入了FastMTP推测解码技术以加速推理。通过结合指令对齐、鲁棒性微调和在密集可验证奖励下的GRPO训练，模型在OmniDocBench和olmOCR-Bench上取得了高分，并在NVIDIA L4等GPU上实现了高吞吐量。

Details

Motivation: 解决在低预算GPU上高效、准确地进行端到端文档解析的问题，旨在平衡模型性能与推理速度。

Result: 在OmniDocBench v1.6上得分为91.14，在olmOCR-Bench上得分为83.4，达到每秒2.57页的最高页面吞吐量。在NVIDIA L4 GPU上，FastMTP推测解码使解码速度比贪婪自回归解码快一倍。

Insight: 主要创新点包括：1) 采用FastMTP推测解码头，通过递归共享单个草稿块跨多个预测步骤来加速推理；2) 提出密集可验证奖励机制，使用确定性公式、表格和结构检查进行部分奖励，以提升训练效果；3) 模型设计针对低预算GPU优化，结合了压缩编码和稀疏激活的专家混合解码器以实现高效部署。

Abstract: We present Jina-OCR-v1, an end-to-end document parsing model built to serve on low-budget GPUs. It combines the compressed-vision encoder and the 3B mixture-of-experts decoder of DeepSeek-OCR, which activates about 570M parameters per token, with a FastMTP speculative decoding head that shares a single draft block recursively across K=3 prediction steps. Greedy verification makes decoding lossless. Post-training combines instruction alignment, robustness fine-tuning on difficult documents, and GRPO under dense verifiable rewards: deterministic formula, table, and structural checks that award partial credit. The training data mixes cleaned public corpora with targeted synthetic pages. At the default dynamic-resolution setting, Jina-OCR-v1 scores 91.14 on OmniDocBench v1.6 and 83.4 on olmOCR-Bench, and reaches the highest page throughput in our comparison at 2.57 pages per second. On a low-budget GPU such as the NVIDIA L4, FastMTP doubles decoding speed over greedy autoregressive decoding. The model is publicly available at https://huggingface.co/jinaai/jina-ocr-v1.

[7] MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrieval cs.CL | cs.LGPDF

Meriem Yacoubi, Pia Schmidt, Nenad Petrovic, Ahmed Frikha, Martin Kirchhoff

TL;DR: MemoryLACE（MemLACE）是一个轻量级记忆框架，旨在为长期LLM智能体显式建模文本证据的生命周期（包括合并、取代和矛盾关系），以改善跨交互的信息保存与矛盾区分。它通过重构关系感知的证据单元，为下游推理提供当前、历史、支持和冲突的证据，在保持自然语言记忆原子性的同时，显著提升了长期记忆推理的性能和效率。

Details

Motivation: 解决现有文本记忆系统在长期交互中难以显式区分重复证据、历史状态、更新和未解决矛盾的问题，以及结构化方法（如全局图、分层抽象或反思）带来的过高复杂性。

Result: 在BEAM和StructMemEval基准测试中，使用开源和专有LLM骨干网络，MemLACE在相同骨干网络的比较中取得了最高的综合性能，并且相对于最强的反思记忆基线Hindsight，在BEAM上将端到端运行时间减少了66.6%。消融研究表明生命周期扩展和时间感知是性能提升的主要贡献者。

Insight: 核心创新在于提出了一种轻量级方法，通过显式建模文本证据的局部生命周期（稀疏关系）来大幅提升长期记忆推理，避免了构建全面知识图谱或进行全局反思的复杂性。这证明了局部生命周期的显式建模对于高效、有效的记忆整合与检索是足够的。

Abstract: Long-term LLM agents must preserve information across interactions while distinguishing repeated evidence, historical states, updates, and unresolved contradictions. Existing textual memory systems retrieve semantically relevant memories efficiently but often leave these relationships implicit, whereas richer structured approaches model them through global graphs, hierarchical abstractions, or reflection at greater complexity. We introduce MemoryLACE (MemLACE), a lightweight memory framework that explicitly models the lifecycle of textual evidence through sparse merge, supersession, and contradiction relations while preserving atomic natural-language memories and their provenance. Rather than retrieving memories independently, MemLACE reconstructs relation-aware evidence units that expose current, historical, supporting, and conflicting evidence for downstream reasoning. Across BEAM and StructMemEval, using open-weight and proprietary LLM backbones, MemLACE achieves the highest overall performance in same-backbone comparisons while reducing end-to-end runtime on BEAM by 66.6% relative to Hindsight, the strongest reported reflective-memory baseline. Ablation studies identify lifecycle expansion and temporal awareness as the principal contributors to these gains. Together, the results demonstrate that explicitly modeling the local lifecycle of textual evidence is sufficient to substantially improve long-term memory reasoning without requiring comprehensive knowledge graphs or global reflection.

[8] Large Language Models in Resolving Contextual Knowledge Conflicts cs.CLPDF

Xinye Yang, Zhenyang Liu, Ruisi Li, Yuanyuan Lei

TL;DR: 本文研究大语言模型如何处理上下文知识内部的冲突，而非传统关注的模型参数知识与外部上下文之间的冲突。作者构建了一个包含六类冲突类型（事实性、推断性、时序性、粒度性、视角性和模糊性）的综合数据集ContextConflict，涵盖推理和摘要任务。实验发现现有模型在解决此类冲突时仍存在不足，并揭示了模型对早期证据的偏好是主要障碍。基于此，作者提出了一种无需训练和标注的激活引导方法，有效提升了冲突解决性能。

Details

Motivation: 现有研究多关注大语言模型内部参数知识与外部提供上下文之间的冲突，而本文旨在探究模型如何处理上下文知识自身内部产生的各种冲突，以更全面地评估和提升模型在复杂真实场景下的知识整合与推理能力。

Result: 在包含5,781个样本的ContextConflict数据集上对九个LLM进行测试，结果表明当前模型在解决上下文知识冲突方面仍有欠缺。作者提出的无训练、无标签的激活引导方法，在推理任务上持续提升了准确率，并在摘要任务上生成了更高质量、更平衡的摘要。

Insight: 创新点在于系统性地定义了六种上下文知识冲突类型并构建了相应数据集，填补了研究空白。从机制可解释性角度揭示了LLM处理冲突时的潜在冲突意识、表征几何结构以及对早期证据的固有偏好。提出的激活引导方法简单有效，通过调整内部表征来促进证据的全面整合，为改进模型在冲突场景下的决策提供了新思路。

Abstract: Most prior works focused on conflicts between an LLM’s internal parametric knowledge and externally provided context. In contrast, we investigate how LLMs handle conflicts that arise within contextual knowledge itself. We introduce a taxonomy of six types of contextual conflicts (factual, inferential, temporal, granularity, perspective, and ambiguity) and contribute a comprehensive dataset ContextConflict for this setting. The dataset contains 5,781 samples, covers both reasoning and summarization tasks, and includes both explicit contradictions and implicit conflicts that require multi-step reasoning. Experiments on nine LLMs show that current models still fall short in resolving contextual knowledge conflicts. We further provide mechanistic interpretability insights into how LLMs process such conflicts, revealing their latent awareness of conflicts and the representational geometry underlying conflict processing. In addition, our analysis uncovers a consistent model bias towards earlier evidence, and this positional preference serves as a key obstacle to effective conflict resolution. Motivated by these findings, we further propose a simple training-free, label-free steering method that steers activations to encourage a more comprehensive incorporation of evidences for better conflict resolution. On our dataset, the method consistently improves accuracy on reasoning tasks and generates higher-quality, more balanced summaries for summarization tasks.

[9] SWIM: Student Writing Simulation via Proficiency-Conditioned Generation cs.CL | cs.LGPDF

Heejin Do, Jakub Kontak, Mrinmaya Sachan

TL;DR: 本文提出SWIM任务，将学生写作模拟定义为基于熟练度条件的文章生成，探索语言模型能否真实模拟学生写作。研究发现提示方法对熟练度控制有限，监督微调显著改善对齐效果，而结合熟练度对齐奖励的强化学习在所有写作维度和提示上取得进一步增益。

Details

Motivation: 尽管基于LLM的学生模拟日益受到关注，但语言模型能否在扩展写作中再现内容、组织、词汇和语言使用等多维度的熟练度差异仍未充分探索。

Result: 实验表明提示方法（包括基于评分标准的策略）对熟练度控制有限，监督微调显著改善对齐，而强化学习结合熟练度对齐奖励在所有写作特征和文章提示上取得进一步增益。

Insight: 论文创新点在于将学生写作模拟形式化为熟练度条件生成任务，并提出使用熟练度对齐奖励的强化学习方法；客观来看，研究揭示了显式监督（微调与强化学习）相比单纯提示能更有效地控制写作熟练度特征，但真实低熟练度写作的模拟仍具挑战性。

Abstract: Writing proficiency manifests in how students develop content, organize ideas, choose words, and use language. Despite growing interest in LLM-based student simulation, whether LLMs can reproduce such multidimensional variation in extended writing remains largely unexplored. In this work, we explore if language models can realistically simulate student writing, and introduce SWIM, a task that formulates Student Writing sIMulation as proficiency-conditioned essay generation. We evaluate prompting, supervised fine-tuning (SFT), and reinforcement learning (RL) methods for writing simulation using automated essay scoring as a measure of profile alignment. Extensive experiments reveal that prompting provides limited proficiency control, even for strong proprietary LLMs with rubric-grounded strategies. In particular, while models can adjust content-oriented traits, they struggle to reproduce the lexical, grammatical, and organizational variation in different proficiency levels. SFT substantially improves alignment, while RL with the proposed proficiency-alignment reward yields further gains across all writing traits and essay prompts. Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.

[10] What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation cs.CL | cs.LGPDF

Daisuke Kikuta

TL;DR: 本文研究了大型语言模型在对话式生成过程中进行修订传播的能力，即当用户指定局部修改时，模型需要识别相关依赖并将修订传播到受影响的所有部分。论文为此引入了一个新的基准测试，并评估了九种修订方法，探索了具有成本效益的测试时计算策略。

Details

Motivation: 解决LLMs在对话式迭代生成与修订过程中，当用户仅指定局部更改时，模型难以自动识别相关依赖并将修订正确传播到整个生成物所有受影响部分的问题。

Result: 在提出的新基准上评估了多种方法，基线准确率为68.3%至93%。最经济有效的方法是使用基于LLM或中位数选择从三个并行样本中选取，可将准确率提升2.2%至9.7%。

Insight: 创新点在于首次系统性地研究了对话式生成场景下的修订传播问题，并提出了一个专门的基准。从工程角度看，其探索的并行采样与选择策略为在有限测试时计算成本下提升模型修订能力提供了实用方案。

Abstract: Large Language Models (LLMs) often help users generate artifacts through iterative cycles of generation and revision in conversation. A challenge here is that, when users specify only a local change during revision, LLMs must instead identify the relevant dependencies and propagate the revision to all affected parts of the artifact. This paper studies this ability of LLMs on conversationally generated artifacts, where the artifact context and its dependencies may be embedded in the conversation history. Toward practical use, we also explore cost-effective test-time compute for this new setting. Specifically, we introduce a new benchmark for this setting, and evaluate nine revision methods, including sequential reflection and parallel sampling variants, using gpt-oss-20b/120b, gpt-5.4-mini, and qwen3.5-9b/27b/122b on the benchmark. The results show that baselines achieve accuracies of 68.3–93%, and the most cost-effective method is selecting from three parallel samples using either LLM-based or medoid selection, which improves accuracy by 2.2–9.7%. Our code and dataset are available at https://github.com/ntt-dkiku/llm-revision-propagation.

[11] Contextual Tamil Spelling and Grammar Correction Using Progressively Fine-Tuned Sequence-to-Sequence Transformers cs.CLPDF

Karthikeyan A, Jaya Nirmala S, Sangeetha Sivanesan, Indhu R, Pranav Kumar

TL;DR: 本文提出了一种基于渐进式微调序列到序列Transformer的泰米尔语上下文拼写和语法纠错方法。针对泰米尔语作为黏着语、资源稀缺且具有复杂语言现象的特点，研究通过构建大规模合成语料库，对mT5-small和mBART-50模型进行四阶段渐进式微调，依次解决表面错误、上下文语法、单点连音和跨词多点连音等不同层次的错误。

Details

Motivation: 泰米尔语作为黏着语，具有丰富的动词形态、复杂的连音规则和庞大的字符集，现有基于规则、统计模型或混合流水线的方法难以可靠处理需要句子级理解的上下文错误（如主谓一致、时态一致和跨词连音）。

Result: 在独立验证的1000句平衡诊断集上，最佳模型mBART-50 v5达到了69.3%的top-1完全匹配准确率，其中连音纠错准确率为87.5%，主谓一致纠错准确率为43.5%。渐进式微调策略带来了显著提升：引入上下文对后主谓一致准确率从1.0%升至52.5%，引入多点连音对后连音准确率从0%升至87.5%。

Insight: 创新点在于将泰米尔语纠错建模为端到端的序列到序列任务，并设计了针对不同错误类型的渐进式微调策略，有效提升了模型对复杂语言现象的纠错能力。研究还量化了连音召回率与身份准确率之间的权衡关系，并验证了未经任务特定监督的泰米尔语指令模型在专业句子级纠错任务上表现有限。

Abstract: Tamil spell and grammar correction is challenging because Tamil is an agglutinative low-resource language with rich verbal morphology, complex sandhi (phonetic transformation) rules at word boundaries, and a script of 247 distinct letters. Prior work targets word-level surface errors with rule-based methods, statistical n-gram models, Minimum Edit Distance, or hybrid pipelines with a transformer re-ranker; such methods cannot reliably handle contextual errors - subject-verb agreement, tense consistency, or cross-word sandhi - which require sentence-level understanding. We propose an end-to-end sequence-to-sequence formulation and fine-tune mT5-small and mBART-50 on a synthetic corpus of up to 657,720 noisy-clean Tamil sentence pairs spanning ten error categories. Both backbones follow the same four-stage progressive schedule, each stage targeting one weakness: surface noise (v2), contextual grammar (v3), single-site sandhi (v4), and multi-site cross-word sandhi (v5). On a 1,000-sentence balanced diagnostic set verified disjoint from all training data, our best model, mBART-50 v5, reaches 69.3% top-1 exact-match accuracy, with 87.5% on sandhi and 43.5% on subject-verb agreement. The schedule is what produces these gains: subject-verb accuracy rises from 1.0% to 52.5% once contextual pairs are introduced, and sandhi from 0% to 87.5% once multi-site sandhi pairs are. We additionally quantify a precision-recall trade-off this literature has not reported: sandhi recall is paid for monotonically in identity accuracy. Finally, Tamil-LLaMA-7B-Instruct reaches 19.0% zero-shot and 24.7% with three demonstrations against a 20.0% copy baseline, showing that a Tamil-adapted instruction model does not transfer to specialised sentence-level correction without task-specific supervision.

[12] Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue cs.CLPDF

Yihang Li, Chenhui Chu

TL;DR: 本文提出了一种解耦数据方法，用于改进基于有限状态机（FSM）的全双工对话系统。该方法通过从真实人-人（HH）语音对话中学习轮转控制，同时通过可配置的人-代理（HA）文本对话塑造语义行为，从而将轮转与语义解耦。具体实现包括基于规则的事件引导数据转换方法，将HH对话序列化为FSM磁带，以及源感知校准（SAC）损失函数来联合校准状态转移令牌的长尾分布并引导不同数据源。

Details

Motivation: 现有神经有限状态机（NFSM）框架依赖合成文本数据，这限制了轮转的自然性，因为大语言模型（LLM）无法真实模拟真实人类对话的细粒度声学时间动态。本文旨在解决NFSM在轮转自然性上的根本限制。

Result: 实验表明，该方法显著提高了轮转熟练度，同时恢复了基础LLM的语义能力。

Insight: 创新点在于将轮转学习与语义生成解耦，分别利用真实语音对话和可配置文本对话作为监督源；提出了无需LLM生成标注的、基于规则的事件引导数据转换方法，实现可扩展的监督；设计了SAC损失函数，有效处理状态转移令牌的长尾分布并引导多源数据学习各自优势能力。

Abstract: The Neural Finite State Machine (NFSM) framework offers a pragmatic path to full-duplex dialogue by serializing turn-taking control and response generation onto a single causal tape under the standard next-token prediction objective, thereby preserving semantic prowess at a low fine-tuning cost. However, its reliance on synthetic text data fundamentally limits turn-taking naturalness, as Large Language Models (LLMs) cannot faithfully simulate the fine-grained acoustic temporal dynamics of real human dialogues. In this work, we propose a decoupled data approach that learns turn-taking from real Human-Human (HH) spoken dialogues while shaping semantic behavior through configurable Human-Agent (HA) text dialogues. To operationalize this approach, we introduce a rule-based event-guided data transformation method that serializes HH spoken dialogues into FSM tapes by classifying turn-taking events and applying deterministic mapping rules, enabling scalable supervision without LLM-generated annotations. We further propose a Source-Aware Calibrated (SAC) Loss that jointly calibrates the long-tailed distribution of state transition tokens and channels each data source toward the capability it best supervises. Experiments show that our approach substantially improves turn-taking proficiency while recovering the foundation LLM’s semantic capability. Our code and model are available at https://github.com/Liyht/def-fsm.

[13] TabScope: Question-Adaptive Scope Selection for Table Question Answering cs.CL | cs.AIPDF

Yuxiang Wang, Junhao Gan, Jianzhong Qi

TL;DR: 本文提出TabScope，一种针对表格问答的问题自适应范围选择框架。该框架根据问题类型动态选择局部化或全表推理模式，通过操作感知的表格分解构建问题特定的子表，以解决大语言模型在处理长表格时因无关内容导致的性能下降问题。

Details

Motivation: 大语言模型在表格问答中表现良好，但随着表格尺寸增大，其准确性会下降，且不同问题类型受影响程度不同：定位敏感问题易受无关内容干扰，而需要广泛证据的问题仍可能受益于全表推理。

Result: 在WikiTQ和SLQA基准测试上的实验表明，局部化推理对查找和局部推理问题特别有效，而自适应选择局部化与全表推理的模式实现了最佳整体性能。

Insight: 创新点在于提出了问题自适应的范围选择机制，强调长表格问答不仅需要决定如何定位，还需决定何时定位；同时引入了基于真实世界长表格的SLQA基准和用于评估证据选择的银参考子表。

Abstract: Large Language Models (LLMs) have shown strong performance on table question answering, yet their accuracy often degrades as table size increases. We find that this degradation is not uniform across question types. Localization-sensitive questions are particularly affected by irrelevant table content, while questions requiring broader evidence may still benefit from full-table reasoning. Based on this observation, we propose a question-adaptive framework that dynamically selects between localized and full-table reasoning. The framework constructs question-specific sub-tables through operation-aware table decomposition and uses the predicted question type to determine the appropriate reasoning mode. We further introduce silver reference sub-tables for evaluating evidence selection and construct SLQA, a benchmark based on real-world long tables. Experiments on WikiTQ and SLQA show that localization is particularly effective for lookup and local reasoning questions, while adaptive selection between localized and full-table reasoning achieves the best overall performance. These results highlight that long-table QA requires deciding not only how to localize, but also when to localize. Our code and datasets will be made available upon publication of the paper.

[14] Less Is Moral: A CHARMing Framework for Moral Foundations Detection in Endorsement Behaviour cs.CL | cs.CY | cs.SIPDF

Huixiang Fu, Marian-Andrei Rizoiu

TL;DR: 本文提出了CHARM框架，一个基于轻量级微调LLM的道德基础检测系统，通过整合道德基础、理由对齐和仇恨言论信号来提高跨领域泛化能力和预测可信度。

Details

Motivation: 现有道德基础检测系统存在跨领域泛化差、理由基础薄弱、依赖高成本提示型LLM的问题，需要更稳健且可解释的解决方案。

Result: 在MFTC、MFRC和News数据集上，CHARM将AUC提升高达15.3%，在所有跨领域数据集的AUC和F1分数上均超越监督基线，并在Twitter COVID-19话语分析中验证了道德价值对齐与在线认可行为的关联。

Insight: 创新点在于将心理学理论（MAC交叉注意力、理由对齐、仇恨言论调节）具体化为计算模块，实现了理论驱动的高效检测框架，为大规模道德框架分析提供了低成本工具。

Abstract: Moral language plays a central role in shaping online endorsement and the diffusion of information, yet existing moral foundation detection systems often suffer from poor cross-domain generalization, weak rationale grounding, and reliance on costly prompting-based large language models (LLMs). We introduce CHARM, a MA\textbf{C}- and \textbf{H}ate-speech-\textbf{A}ware \textbf{R}ationale-aligned \textbf{M}oral foundation detection framework built on a lightweight fine-tuned LLM, which integrates complementary moral grounding, rationale alignment, and polarity-aware hate speech signals to support more robust and faithful moral prediction. Unlike prior dictionary-, fine-tune-, or prompt-based detectors, which decouple computation from psychological theory, CHARM is built so that each component – MAC cross-attention, rationale alignment, and hate-speech modulation – operationalizes a distinct psychological construct. Using a 30% subsample of the MFTC, MFRC, and News training pools together with the richer supervision in MFTCXplain, CHARM improves AUC by up to 15.3% in-domain, surpasses the supervised baselines on every out-of-domain dataset in both AUC and F1, and offers a scalable, low-cost alternative to prompting-based LLM detectors. We further apply CHARM to large-scale COVID-19 discourse on Twitter and show that moral value alignment is strongly associated with online endorsement behavior. By making moral framing measurable at scale, CHARM offers a practical tool for studying the spread of morally charged misinformation.

[15] FPCO-Dialog: A Multi-Turn False-Premise Benchmark for Correction and Cooperation in Vision-Language Models cs.CLPDF

Jiayuan Ma, Yuqi Lu, Weiyang Guo, Chenrui Wang, Junyi Shu

TL;DR: 本文提出了FPCO-Dialog基准，用于评估视觉语言模型在多轮对话中面对持续存在的视觉相关错误前提时的纠正与合作行为。该基准包含1080张图像和10800个问题轮次，采用10轮对话协议，并引入了CorrTP@K指标来量化模型的纠正率。通过对20个商业和开源VLM的评估，揭示了模型在整体纠正倾向、逐轮动态以及不同错误前提类型下的系统性差异。

Details

Motivation: 现有评估很少关注当用户在描述视觉内容时持续存在错误假设时，视觉语言模型在多轮对话中的反应。该研究旨在填补这一空白，专门评估模型在重复错误前提下的纠正与合作能力。

Result: 在FPCO-Dialog基准上评估了20个模型，揭示了模型在整体纠正倾向（CorrTP@K指标）、模型特定的逐轮动态以及不同错误前提类型下表现出的显著且持续的跨模型差异。

Insight: 创新点在于构建了一个专门针对多轮对话中持续错误前提的评估基准（FPCO-Dialog）和相应的纠正率指标（CorrTP@K），为系统性地分析和比较VLM的鲁棒性与合作行为提供了新工具。从客观角度看，其分层设计（视觉复杂度、物体类别、错误前提类别）和模型无关的评估协议具有借鉴价值。

Abstract: Vision-language models (VLMs) are increasingly deployed in multi-turn settings where users may describe visual content with incorrect assumptions. Yet existing evaluations rarely isolate how models respond when the same visually grounded false premise persists across dialogue turns. We introduce FPCO-Dialog, a benchmark for evaluating correction and cooperation behavior in VLMs under repeated false premises. FPCO-Dialog contains 1,080 images and 10,800 question turns, stratified by visual complexity, object category, and false-premise class, and uses a 10-turn protocol in which a correct dialogue prefix is followed by repeated false-premise referring expressions. We evaluate 20 commercial and open-source VLMs with a model-agnostic protocol and CorrTP@K, a correction-rate metric over false-premise turns, scored by two independent detectors. FPCO-Dialog reveals substantial and persistent cross-model differences in aggregate correction tendency, model-specific turn-wise dynamics, and systematic variation across false-premise types under the benchmark’s substitution distribution. The dataset, evaluation protocol, model outputs, detector labels, and code are available.

[16] Lngram v2: Latent N-Gram Memory with Interpretable Discrete Representations cs.CLPDF

Yunao Zheng, Bin Wen, Xiaojie Wang

TL;DR: Lngram v2 提出了一种解耦路由数量、记忆维度和骨干网络宽度的潜在条件记忆机制，通过上下文感知分组查询注意力读取、零值汇和反事实替代梯度来提升记忆容量和训练稳定性，并在不同规模的视觉-语言模型上验证了其有效性和可扩展性。

Details

Motivation: 解决 Transformer 缺乏原生查找机制、需要重复密集计算识别局部静态模式的问题，以及 Lngram v1 中记忆容量与骨干宽度耦合导致的参数和激活成本高、可扩展性受限的缺陷。

Result: 在不同规模的视觉-语言模型实验中，Lngram v2 在保持或提升语言建模性能的同时，显著减少了总参数和激活记忆参数，并成功扩展到 300 亿参数模型，展现了其高效和可扩展性。

Insight: 通过解耦设计实现记忆容量的独立扩展，引入的离散地址不仅保留了连续隐藏状态的语义结构，还能单独进行语义恢复，为分析模型内部表示提供了结构化接口。

Abstract: Transformers lack a native lookup mechanism, requiring repeated dense computation to recognize and reuse local static patterns. Lngram v1 introduces tokenizer-independent conditional memory through discrete latent n-gram addressing, but its memory capacity is coupled with the backbone width, limiting scalability due to high parameter and activation costs. We propose Lngram v2, which decouples the number of routes, memory dimension, and backbone width, and introduces a context-aware grouped-query attention readout to scale memory capacity independently. A zero-value Sink and counterfactual surrogate gradients further improve readout selectivity and routing trainability while preserving hard discrete addressing. Experiments across vision–language models (VLMs) of different scales show consistent improvements, including successful scaling to a 30B-parameter model. Compared with Lngram v1, Lngram v2 substantially reduces both total and activated memory parameters while maintaining or improving language modeling performance. Further analysis shows that its discrete IDs preserve substantial semantic structure of continuous hidden states, enabling semantic recovery from IDs alone and stable ID–semantic associations across datasets. These results establish Lngram v2 as an efficient and scalable latent conditional memory mechanism whose discrete addresses also provide a structured interface for analyzing internal model representations.

[17] Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning cs.CLPDF

Heng Wang, Jielin Qiu, Wenting Zhao, Cheng Qian, Liangwei Yang

TL;DR: 论文提出了一种名为Random Attention的KV缓存淘汰方法，通过随机淘汰每个注意力头中的非提示词令牌，无需计算任何评分，在保持推理性能的同时显著提升了吞吐量。该方法挑战了现有基于评分选择重要令牌的压缩范式，揭示了提示词是缓存中的脆弱部分，而推理轨迹通过文本和注意力头两个层面的冗余实现了自我保护。

Details

Motivation: 解决大型语言模型在长链推理任务中KV缓存导致的内存瓶颈问题，现有基于评分选择重要令牌的压缩方法效率有限，作者旨在探索更简单高效的缓存淘汰策略。

Result: 在四个模型和六个推理任务上的实验表明，Random Attention与最强的现有淘汰器性能相当，同时在vLLM部署中实现了32-43%的吞吐量提升。

Insight: 创新点在于揭示了提示词是缓存的关键脆弱点，以及推理轨迹通过文本重复和跨注意力头冗余实现自我保护的机制，从而证明了随机淘汰的可行性，为高效推理提供了新思路。

Abstract: Large language models achieve superior performance on tasks that require extended reasoning, but long chains of thought make the KV cache a severe memory bottleneck. Existing KV cache compression methods share one paradigm: score each cached token by some estimate of how much it will matter later, and keep the top-scoring ones. We show that the selection signal contributes almost nothing. Random Attention keeps the prompt and evicts uniformly at random within each attention head, computing no score at all; across four models and six reasoning tasks it matches the strongest prior evictor while serving 32-43% higher throughput than it in vLLM deployment. Controlled experiments explain this by showing that 1) the prompt is the fragile part of the cache, and most of the gap between selectors is just whether their selection signal happened to keep it; 2) the reasoning trace protects itself against eviction with redundancy at two levels, in the text (the model restates what it still needs as it works) and across attention heads (each keeps its own copy of the trace), so once the prompt is safe, a random draw retains enough copies of what the model still needs, and no score is required to pick them. Our code is publicly available at https://github.com/SalesforceAIResearch/Random-Attention.

[18] When Users Don’t Ask: Benchmarking Context-Driven Memory Retrieval in Conversational Agents cs.CL | cs.AIPDF

Wen-Yu Chang, Yun-Nung Chen

TL;DR: 本文介绍了LOCOMO-CONV，一个用于评估对话代理中上下文驱动记忆检索的基准测试，该基准源自LoCoMo数据集，包含对话、隐式、反事实和组合四种查询风格。研究发现，对话框架暴露了传统QA基准忽略的显著检索差距，特别是对于隐式和组合查询，且强检索并不完全转化为响应质量。

Details

Motivation: 现有基准主要通过问答式探测评估记忆系统，而非在真实对话场景中进行评估，这无法充分反映长程对话代理中记忆系统的实际性能。

Result: 在五种代表性记忆系统上的评估表明，对话框架下的检索召回和端到端响应质量存在显著差距，尤其是在隐式和组合查询上；多面查询改写改善了原始轮次记忆的检索，但对抽象记忆无效。

Insight: 论文的创新点在于提出了一个更贴近真实对话场景的记忆评估基准，并揭示了隐式查询中存在‘静默接地’现象，即记忆改善了上下文接地性而未显式引用事实；同时指出了基于推理的记忆细化是一个有前景的方向，并发布了辅助性的supportive_memory标注。

Abstract: Large language models (LLMs) are increas- ingly deployed as long-horizon conversational agents, motivating growing interest in mem- ory systems. However, existing benchmarks primarily evaluate memory through QA-style probing rather than in-situ conversational usage. We introduce LOCOMO-CONV, a conversa- tional memory benchmark derived from Lo- CoMo with four query styles: dialog, implicit, counterfactual, and composed. Across five rep- resentative memory systems, we evaluate both retrieval recall and end-to-end response qual- ity. Our experiments show that conversational framing exposes substantial retrieval gaps over- looked by QA benchmarks, especially on im- plicit and composed queries, which multi-facet query rewriting narrows for raw-turn mem- ory but not abstractive memory. We further find that strong retrieval does not fully trans- late into response quality, and that implicit queries exhibit silent grounding, where mem- ory improves contextual grounding without ex- plicitly surfacing the gold fact. These results point to reasoning-based memory elaboration as a promising direction, and we release aux- iliary supportive_memory annotations captur- ing conversationally useful context beyond the original gold evidence.

[19] Lost in Reordering: Structural Sensitivity of Multilingual LLMs under Semantics-Preserving Perturbations cs.CLPDF

Karthika Nhayakkat, Rajat Verma, Maharaj Brahma, Vetcha Gnana Mahesh, Maunendra Sankar Desarkar

TL;DR: 本文研究了多语言大语言模型在语义保持的结构扰动下的鲁棒性，重点关注印地语和马拉雅拉姆语中的成分重排和主动-被动语态转换。作者构建了IndicReStruct基准数据集，发现多个SOTA模型在结构扰动下数学推理性能显著下降，并通过机制可解释性实验分析了失败原因。

Details

Motivation: 尽管多语言大语言模型展现出强大的推理能力，但其对语义保持的结构变化的鲁棒性尚未充分探索，尤其是在词序相对自由的语言中。

Result: 在GSM8K-Reordered和GSM8K-Voice两个数据集上，六个SOTA模型在结构扰动输入下均出现一致且显著的数学推理性能下降。

Insight: 创新点在于构建了针对词序自由语言的语义保持结构扰动基准，并通过残差流激活修补进行机制分析，发现实体-数量对齐的破坏是推理失败的主要原因，且中间Transformer层对推理恢复贡献最大。

Abstract: Large Language Models (LLMs) demonstrate strong multilingual reasoning performance, yet their robustness to semantics-preserving structural variation remains underexplored, particularly for relatively free word-order languages. We investigate the structural sensitivity of multilingual LLMs using two linguistically grounded perturbation settings in Hindi and Malayalam: constrained constituent reordering and active-passive voice transformation. We introduce a benchmark dataset IndicReStruct, with two variants, GSM8K-Reordered and GSM8K-Voice, constructed from GSM8K while preserving semantic meaning. Across six state-of-the-art LLMs and multiple prompting strategies, we observe consistent and significant degradation in mathematical reasoning performance under structurally perturbed inputs. To further understand these failures, we perform qualitative error analysis and mechanistic interpretability experiments using residual-stream activation patching. Our analyses show that reasoning failures frequently arise from disruptions in entity-quantity alignment and that intermediate transformer layers contribute most strongly toward reasoning restoration. Overall, our findings suggest that current multilingual LLMs remain highly sensitive to surface syntactic realization and lack robust compositional invariance under structurally different but semantically equivalent inputs.

[20] How Far Can Synthetic Data Take Thai OCR? cs.CL | cs.AI | cs.CVPDF

Kunat Pipatanakul

TL;DR: 本文研究了合成数据在泰语OCR任务中的迁移能力，通过解构合成数据的‘真实性’因素（如源域、页面上下文、字体、空间结构和字形变化），构建了无需真实泰语文档OCR标签的模型Wayu-Paxa-OCR-Zero。实验表明，字体多样性、二维结构和真实手写字形能有效提升迁移效果，而源域匹配则取决于训练粒度。

Details

Motivation: 解决合成数据在泰语OCR监督中如何有效迁移到真实文档的问题，以构建无需真实标签的泰语OCR模型。

Result: 在印刷和手写泰语文档上，模型在页面级训练时接近真实监督效果（中位字符错误率1.82% vs 1.31%），在裁剪级训练时域外重建更优（15.59% vs 5.52%）。Wayu-Paxa-OCR-Zero在五个评估集上均超越Typhoon OCR v1 7B，合成训练具有竞争力。

Insight: 创新点在于解构合成数据的‘真实性’因素并量化其影响，揭示了训练粒度对源域匹配的关键作用；实践上通过大规模合成页面（45,723页）微调预训练模型，实现了零真实标签的泰语OCR适配。

Abstract: We investigate what makes synthetic OCR supervision transfer to real Thai documents and use the resulting insights to build Wayu-Paxa-OCR-Zero, a Thai OCR model adapted without OCR labels from real Thai document pages. Synthetic data provide exact labels at scale, but “realism” conflates source domain, page context, typography, spatial structure, and glyph variation. We disentangle these factors with a controlled document-reconstruction pipeline and evaluate each variant under page- and crop-level training on printed and handwritten Thai documents. Non-text context has little consistent effect, whereas typeface diversity, two-dimensional structure, and real handwriting glyphs improve transfer; moreover, source-domain matching depends on training granularity, with in-domain reconstruction approaching real printed supervision under page-level training (1.82% versus 1.31% median character error rate) but underperforming out-of-domain reconstruction under crop-level training (15.59% versus 5.52%). Guided by these findings, we adapt the 0.9B-parameter PaddleOCR-VL-1.6 into Wayu-Paxa-OCR-Zero using 45,723 synthetic pages: relative to its base checkpoint, it reduces median character error rate from 6.64% to 1.24% on printed pages and from 74.87% to 20.55% on handwriting and outperforms Typhoon OCR v1 7B on all five evaluation sets, showing that synthetic-only training can be competitive.

[21] KhatianDoc: A Human-Verified Benchmark Diagnosing Multimodal LLM Failure on Bengali Legal Land Records cs.CLPDF

Tasmiad Hasan, Arafat Zaman Ratul, Sarker Sadman Saalim, S. M. Shah Nawaz Hossain, Khan Raiyan Ibne Reza

TL;DR: 本文介绍了KhatianDoc，一个针对孟加拉语法律土地记录的多模态LLM诊断基准，包含符号识别、十六进制转十进制、结构化字段提取和文档问答四个任务。该基准基于107份真实RS Khatian记录构建，包含1,634个QA对，并由土地法律从业者手工转录和验证。评估了六个多模态LLM（8B至72B+，开源和闭源）在零样本设置下的表现，发现多个模型在39.3%的QA类别中零正确，算术任务表现甚至低于常数均值基线。

Details

Motivation: 孟加拉国的土地所有权记录使用Ana-Ganda-Kora-Kranti-Til十六进制分数系统，其专用Unicode字形缺乏主流字体支持，且未被任何OCR流程或分词器覆盖。手写的RS Khatian记录是数百万地块的权威所有权文件，常涉及民事诉讼，但尚无基准测试机器能否阅读此类文档。

Result: 在固定零样本协议下评估六个多模态LLM，发现39.3%的分层QA类别所有模型均零正确；算术任务中所有输出数字的模型表现均差于常数均值基线，精确匹配和近似匹配分数重合，表明是去相关而非近似问题。基准提供了修正后的评分和元数据指标上限。

Insight: 创新点在于构建了首个针对孟加拉语法律土地记录的多任务、人工验证基准，揭示了当前多模态LLM在该领域的能力缺失而非性能差距。通过位置令牌匿名化保持多跳问题的指代区分，并公开代码和数据（含脱敏图像），为未来系统提供可靠真值。

Abstract: Land ownership in Bangladesh is recorded in Ana-Ganda-Kora-Kranti-Til, a base-16 positional fraction system with dedicated Unicode glyphs, no mainstream font, and no coverage in any OCR pipeline or tokenizer. The handwritten records that carry these fractions, RS Khatians, are the authoritative title record for millions of parcels and a frequent subject of civil litigation, yet no benchmark has asked whether a machine can read one. We introduce KhatianDoc, a four-task benchmark built from 107 real RS Khatian records from the Vumi (land) Office of Munshiganj, Bangladesh: symbol recognition, base-16-to-decimal conversion, structured field extraction, and legal document question answering over 1,634 QA pairs. Ground truth was transcribed by hand, verified by a land-law practitioner to full agreement, and anonymized through positional tokens that keep the referential distinctions multi-hop questions depend on. We evaluate six multimodal LLMs (8B to 72B+, open and closed) under a fixed zero-shot protocol. Five QA categories, 39.3% of our stratified set, return zero correct answers from every model; on the arithmetic task, every model that emits a number does worse than a constant-mean baseline, with exact- and near-match scores coinciding: decorrelation, not approximation. Auditing our own metrics surfaced two artifacts in opposite directions: we correct a refusal-scoring bug and report the fixed scores beside the originals, and flag an inflated metadata metric as an upper bound. KhatianDoc documents not a performance gap but the absence of a capability, with verified ground truth for future systems. Code and data, with a redacted image release, are publicly available.

[22] Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation cs.CL | cs.AIPDF

Xuanfa Jin, Zhijian Ma, Yongcheng Zeng, Xinyu Cui, Haifeng Zhang

TL;DR: 论文提出了R$^2$-MAD框架，通过为多智能体辩论中的智能体配备经验记忆库，并引入基于辩论状态的检索策略和智能体置信度加权机制，来缓解辩论过程中因多数智能体初始错误共识而导致的‘共享误解’问题，从而提升大语言模型的推理能力。

Details

Motivation: 多智能体辩论存在‘共享误解’的固有弱点，即当多数智能体初始达成错误答案时，辩论过程会放大而非纠正错误。现有方法主要处理同伴偏差，但未能解决智能体固有的、有偏的概念先验。

Result: 在多个基准测试上的实验表明，R$^2$-MAD相比现有的单智能体和多智能体辩论基线方法，取得了持续的改进。

Insight: 创新点在于引入经验记忆库来校准概念先验，并结合辩论状态动态检索历史证据；同时，利用检索到的经验估计每个智能体的可靠性，生成置信度权重来调节同伴影响，从而系统性地干预两种失败模式。

Abstract: Multi-agent debate (MAD) improves the reasoning capabilities of large language models by having multiple agents iteratively refine their responses through discussion. However, MAD suffers from a critical vulnerability known as shared misconception: when a majority of agents initially converge on an incorrect answer, the debate process tends to amplify rather than correct the error. Existing methods primarily address peer skew but leave the agents’ inherently biased concept priors unaddressed. To mitigate this systematic weakness, we propose R$^2$-MAD (Remember and Reweight for Multi-Agent Debate), a framework that equips agents with an experience memory accumulated from past debates. R$^2$-MAD intervenes on both failure modes through two complementary mechanisms: A debate-state-aware retrieval policy dynamically calibrates the concept prior by retrieving relevant historical evidence based on the current consensus level. Then these retrieved experiences provide a basis for estimating per-agent reliability, yielding confidence weights to modulate peer influence. Experiments on various benchmarks show that R$^2$-MAD achieves consistent improvements over existing single-agent and MAD baselines.

[23] Doesn’t Stop Reasoning: Analysis of Spurious CoT Termination cs.CL | cs.AIPDF

Seunghee Koh, Sungjae Choi, Minchan Kwon, Sunghyun Baek, Junmo Kim

TL;DR: 本文研究了在大型推理模型中使用早期退出策略时，通过注入‘思考结束’标记（EoT，即<|endofthink|>）来触发从推理到回答的转换，但发现这种注入的EoT并不总能确保干净的转换，反而可能导致‘虚假的CoT终止’，即类似推理的生成行为会延续到回答阶段。

Details

Motivation: 动机是探索训练无关的早期退出方法如何通过选择中间点来缩短CoT推理轨迹，但发现注入的EoT标记可能无法有效诱导模型从推理阶段过渡到回答阶段，从而引发虚假终止问题。

Result: 在四个大型推理模型、五个基准测试和两种早期退出方法上的实验表明，通过增加对注入EoT标记的关注（使用Exit-token Attention Biasing方法），可以减少虚假CoT终止并缩短回答阶段的长度。

Insight: 创新点在于揭示了通过外部匹配模型的显式思考块格式来控制大型推理模型的局限性，即仅插入EoT标记本身不足以保证预期的推理到回答的转换，需要增强模型对该标记的注意力以确保有效过渡。

Abstract: Chain-of-thought (CoT) reasoning improves large reasoning models (LRMs) on complex tasks but often produces long, redundant traces. Recent training-free early-exit methods shorten these traces by choosing an intermediate point to stop reasoning. We study one such strategy that injects an end-of-think token (EoT, ) at this point to trigger the reasoning-to-answering transition, and find that the injected EoT does not always induce a clean answering phase. Answering-phase generation can continue before the model regenerates another EoT, with the span preceding this regenerated EoT scaling with the reasoning tokens saved by early exit and exhibiting continued reasoning behavior. We call this spurious CoT termination, where reasoning-like generation continues into the answering phase. We hypothesize that insufficient attention to the injected EoT contributes to spurious CoT termination and probe this hypothesis with Exit-token Attention Biasing (EAB). Across four LRMs, five benchmarks, and two early-exit methods, increasing attention to the injected EoT reduces spurious CoT termination and answering-phase length. These results reveal a limitation of controlling LRMs by externally matching their explicit think-block format. Inserting the EoT token conforms to this format but does not by itself guarantee the intended reasoning-to-answering transition. Our code is available at https://github.com/Seunghee-Koh/Spurious-CoT-Termination.

[24] Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks’ financial statements cs.CL | cs.AI | cs.CE | cs.IRPDF

Arianna Miola, Bruno Spaccavento, Lorenzo Silotto, Marco Bianchetti, Luca Cagliero

TL;DR: 本文介绍了FinRAG-QA，一个针对银行财务报表问答的新型基准数据集，包含999个由从业者精心设计的问题，基于24家欧美银行在2019-2023年间的209份报告。该数据集专注于跨机构、超长文档的检索任务。作者评估了一个多阶段RAG（检索增强生成）流程，通过上下文块增强和优化的嵌入模型显著提升了检索性能，同时使用推理优化的生成器大幅提高了答案准确率。

Details

Motivation: 银行财务报表因其复杂性、长度、技术语言以及跨司法管辖区和机构的内容异质性，给自动化问答系统带来了巨大挑战。现有金融QA基准主要关注美国申报文件和单一机构分析，缺乏针对跨机构、超长文档的评估资源。

Result: 在FinRAG-QA基准上，上下文块增强结合检索优化的嵌入模型将NDCG@10从0.322提升至0.710；在检索到真实答案的前提下，推理优化的生成器将答案准确率从44.6%提升至79.0%（提升34.4个百分点），但生成延迟增加了约20倍。实验还表明，当第一阶段排序已经很强时，交叉编码器重排序会损害检索性能，且单个排名最高的文本块在生成时优于更大的上下文。

Insight: 论文的创新点在于构建了首个专注于银行财务报表跨机构、超长文档检索的基准数据集FinRAG-QA。从方法角度看，研究系统地分解并量化了RAG流程中各个组件（如上下文块增强、专用嵌入模型、推理优化生成器）的贡献，并揭示了在强检索基础上，重排序可能带来负面效果以及小上下文块在生成阶段的优势，这对优化实际RAG系统设计具有重要指导意义。

Abstract: The comparative analysis of banks’ financial statements poses significant challenges for automated question answering systems due to their complexity, substantial length, technical language, and inhomogeneity of both textual and numerical content across different jurisdictions and institutions. We introduce FinRAG-QA, a novel benchmark dataset for financial question answering, which comprises 999 practitioner-curated questions on 10 standardised indicators, grounded in 209 annual and Pillar 3 reports from 24 major European and U.S. banks spanning 2019-2023. Unlike prior financial QA benchmarks, which centre on U.S. filings and single-institution analysis, FinRAG-QA targets cross-institutional retrieval over documents averaging 198k words, longer than any existing financial QA resource. On this benchmark we evaluate a multi-stage RAG pipeline and isolate the contribution of each component. Contextual chunk enrichment combined with a retrieval-optimised embedding model raises NDCG@10 from 0.322 to 0.710; conditional on the ground truth being retrieved, a reasoning-optimised generator raises answer accuracy from 44.6% to 79.0% (+34.4 percentage points), at roughly 20x the generation latency. We further show that cross-encoder reranking degrades retrieval when the first-stage ranking is already strong, and that a single top-ranked chunk outperforms larger contexts at generation time. Experiments were run in late 2024-early 2025 with the models available at that time.

[25] A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural Entities cs.CLPDF

Anh Danh, Rick Nouwen, Massimo Poesio

TL;DR: 本文通过机制可解释性和注意力模式分析，研究了大语言模型（LLMs）如何表示和检索单数与复数实体以进行复数指代消解。研究发现了一组特定的注意力头，分别负责在输入中表示指代信息、识别构成复数指代的实体，并将信息传递给负责选择先行词和预测代词的组件。此外，研究还发现LLMs在复数代词偏好上与人类一致，即当实体在本体上相似且通过连词’and’连接时，更可能被指代为复数实体。

Details

Motivation: 研究动机是探索LLMs在上下文推理中处理复数指代消解任务的内在机制，特别是模型如何表示和检索单数与复数实体。

Result: 通过因果干预技术，识别出负责复数指代消解关键功能的特定注意力头；并发现LLMs在复数代词使用偏好上与人类行为一致，即本体相似且由’and’连接的实体更易触发复数指代。

Insight: 创新点在于结合机制可解释性与注意力分析，揭示了LLMs中处理复数指代的专用’电路’（circuit）及其与人类认知的相似性，为理解模型内部推理过程提供了新视角。

Abstract: Coreference resolution is an important task in contextual reasoning. In this paper, we investigate the mechanism for representing and retrieving singular and plural entities for plural reference. We use a combination of mechanistic interpretability and attention pattern analysis to study the process in which LLMs predict a pronoun to refer back to previously mentioned entities. Using a range of causal intervention techniques, we find a set of attention heads that are responsible for (1) representing coreference information in the input, (2) identifying entities that form a plural reference, (3) transferring the information to the component that is responsible for selecting the antecedents and predicting the pronoun. We also find that LLMs align with humans in preference for plural pronoun. Specifically, entities in a plural construction are more likely to be referred to as a plural entity if they are ontologically similar and are linked by the conjunction “and”.

[26] Opening mind by opening architecture: analysis strategies cs.CLPDF

Francesco Vitucci, Giuseppe Silvi, Daniele Giuseppe Annese, Francesco Scagliola, Anthony Di Furia

TL;DR: 本文探讨了电声作曲中数字信号处理领域因商业工具普及导致的封闭架构音频处理器模型主导问题，指出这种模型虽能描述输出数据的感知特性，却将内部处理过程封装为不可知的’黑箱’，导致技术实现与美学后果的脱节。论文以曼弗雷德·施罗德的历史混响器为案例，展示了如何通过重建科学方法和研究态度，开发分析评估工具与实践实施方案，以开启封闭架构并促进对信号处理技术’故事性’的认知。

Details

Motivation: 针对数字音频处理领域因商业工具泛滥导致的封闭架构模型主导现象，论文旨在解决技术实现过程被’黑箱化’的问题，强调信号处理技术承载着实现历史与美学影响的多层叙事，需要恢复对内部系统互动的科学认知。

Result: 论文未提及具体定量实验结果或基准测试，但通过曼弗雷德·施罗德历史混响器的案例研究，定性展示了分析工具构建与实施过程，为技术路径的’有意识研究’提供了方法论框架。

Insight: 创新点在于将信号处理器视为具有’技术实现故事’的叙事载体，主张通过文学视角和科学方法’开启架构’，以分析工具重建对内部过程的理解；客观而言，其跨学科方法（结合信号处理、科学哲学与美学分析）为破解技术黑箱提供了新颖的研究范式。

Abstract: In numerical signal processing for electroacoustic composition, the progressive loss of specific development and research environments caused by the increasing use of digital market tools has favoured the dominance of the closed-architecture audio processor model. This model, while powerful, envisions the possibility of describing output data about its perceived characteristics, but at the cost of ignoring its internal process and interacting systems, which become complex, powerful environments but closed in an inscrutable black box, a loss we must consider. Any digital signal processing technique tells a story. Just as the words of a language incorporate social, historical and technical polysemic layers, a signal processor has its own story of implementation, a gradual technological achievement with its inevitable aesthetic consequences. Through the looking-glass of literature, one can access those environments with renewed awareness by reestablishing a scientific method and an attitude to research. In this specific case, starting from the case study of Manfred Schroeder’s historical reverbs, we illustrate the process of building analytical evaluation tools, as well as practical implementation, at the basis of a conscious study path.

[27] Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks cs.CL | cs.AIPDF

Oline Ranum, Edward Fish, Simon Hadfield, Richard Bowden

TL;DR: 本文指出BLEU-4作为手语翻译（SLT）的标准评估指标存在不足，因为它可能无法反映真实的手语理解能力。作者提出了一种受语言学习评估启发的新评估协议，使用开放权重大语言模型（LLM）进行问答来测量关键内容保留，该协议与人类评估更一致且对释义更鲁棒。

Details

Motivation: 动机在于BLEU-4等口语指标可能不适用于评估手语翻译，因为手语的多模态、低资源特性使得模型可能利用虚假相关性或口语先验，而非学习更强的手语表示，从而无法准确衡量模型的手语理解能力。

Result: 在Phoenix-2014T和CSL-Daily数据集上对六个SLT模型的评估表明，BLEU-4的提升并不单独代表更好的手语理解。新提出的QA协议与人类排名更一致，且比BLEU-4对释义的鲁棒性高6到7倍；应用该协议发现，在Phoenix-2014T上，五个无词汇注释系统的性能差异很小，而有词汇注释监督的系统高出9.3分，这一差距是BLEU-4无法揭示的。

Insight: 创新点在于挑战了手语翻译领域沿用BLEU-4作为标准指标的惯例，并提出了一种基于LLM QA的内容保留评估方法，更注重手语的内容传递能力，减少了训练-测试重叠的影响，为SLT评估提供了更可靠的替代方案。

Abstract: BLEU-4 is the standard metric for evaluating sign language translation (SLT), but spoken-language metrics may not adequately reflect sign language proficiency. The multimodal, low-resource context of SLT allows models to exploit spurious correlations and spoken-language priors, rather than learning stronger sign representations. In this paper, we evaluate the relationship between spatio-temporal understanding and BLEU-4 across six SLT models on Phoenix-2014T and CSL-Daily, showing that gains in BLEU-4 are not on their own evidence of better sign language understanding. This work introduces an alternative inspired by language-learning assessment, using an open-weight-LLM QA protocol that measures salient content preservation. It aligns more closely with human rankings and is six to seven times more paraphrase-invariant than BLEU-4. Applied to SLT, this protocol targets content transfer, is more robust to train-test overlap, and gives a different picture of the field: the five gloss-free systems are largely within noise of one another on Phoenix-2014T, while the gloss-supervised system stands 9.3 points higher, a gap invisible to BLEU-4.

[28] Typological Feature Prediction with Large Language Models: An In-Context Learning Approach cs.CLPDF

Qianwen Wang, York Hay Ng, Aditya Khan, En-Shiun Annie Lee

TL;DR: 本文研究了利用大语言模型通过上下文学习方法预测语言类型学特征。研究发现，零样本提示效果不佳，但当提供系统发育和地理邻近证据时，LLMs显著超越所有基线模型，且不损害低资源语言的表现。此外，LLMs提供的理由大多与证据一致，推动了可解释的类型学特征预测。

Details

Motivation: 现有预测语言类型学特征的方法缺乏对预测结果的可解释性论证，且在不同资源水平和特征类型上的性能尚未充分探索。鉴于LLMs在元语言推理和提供理由方面的能力，本文旨在探索LLMs通过上下文学习进行类型学特征预测的性能。

Result: 在URIEL+和Glottolog的语言数据上，当提供系统发育和地理邻近证据时，LLMs显著优于所有基线模型，且不损害低资源语言的表现。

Insight: 创新点在于利用LLMs的元语言推理能力，通过提供系统发育和地理邻近证据的上下文学习，实现了高性能且可解释的类型学特征预测，为低资源语言提供了公平的解决方案。

Abstract: Typological features are widely used in multilingual NLP, and the prediction of such features holds downstream utility. However, existing methods to predict missing values lack interpretable justifications for predictions, while their performance across resource levels and feature types remains underexplored. Given LLMs’ abilities in meta-linguistic reasoning and in providing rationales, we investigate LLMs’ performance in typological feature prediction via an in-context learning approach with linguistic data from URIEL+ and Glottolog. We find that zero-shot prompting is insufficient, but when given phylogenetic and geographic neighbour evidence, LLMs substantially outperform all baselines without disadvantaging low-resource languages. We further find that most LLM rationales are consistent with the provided evidence, offering a step toward explainable typological feature prediction.

[29] Beyond Shallow Alignment: How Post-Training Methods Determine Refusal Circuits And Steering Robustness cs.CLPDF

Hoang Cuong Nguyen, Mark Dras, Usman Naseem

TL;DR: 本文研究了不同后训练方法（监督微调、推理增强微调和偏好优化）如何影响语言模型内部拒绝有害请求的计算机制。通过对比三种不同架构的模型，发现训练方法不仅改变了拒绝行为的数据表现，更重塑了其内部计算回路，且没有一种方法能同时实现安全对齐所需的全部理想属性。

Details

Motivation: 旨在探究用于训练语言模型拒绝有害请求的不同后训练方法，如何具体塑造模型内部的拒绝计算机制，以评估当前安全对齐方法的可靠性与局限性。

Result: 在Llama-3.1-8B、Gemma-2-9B和Qwen3-8B三个模型上的实验表明，推理增强训练在所有模型中均产生了一种独特的拒绝计算模式；模型架构独立影响内部结构和拒绝行为的可操控性；且现有方法均无法同时实现非脆弱组件分布、不损失通用能力以及可通过小规模编辑纠正安全行为这三个理想属性。

Insight: 创新点在于揭示了训练方法（而不仅仅是数据）对模型内部拒绝回路的决定性影响，并系统性地评估了不同后训练方法在安全对齐关键属性上的权衡，为理解对齐机制提供了新的内部视角，并警示当前方法尚未构成可靠的安全防御。

Abstract: How do the methods used to train language models to refuse harmful requests shape how that refusal actually works inside the model? We compare three post-training methods - supervised fine-tuning, reasoning-augmented fine-tuning (training on reasoning chains that justify a safety decision), and preference optimization (ORPO) - across three architecturally distinct models (Llama-3.1-8B, Gemma-2-9B, Qwen3-8B). We find that training method, not just data, reshapes how refusal is computed internally: reasoning-augmented training consistently produces a distinct kind of refusal computation, visible across all three models, while architecture independently shapes internal structure and how reliably refusal can be steered. Most importantly, no method we study achieves all three properties we would want from safe alignment at once: refusal that isn’t concentrated in a few fragile components, safety gains that don’t cost general capability, and safety behavior correctable through small, targeted edits. We caution against treating current post-training methods as a solved, reliable defense, especially for security-critical use. Code and models are available in https://github.com/hoangcuongnguyen2001/Beyond-Shallow-Alignment.

[30] RuleMem: Active Rule Memory for Long-Term Conversational Agents cs.CL | cs.IRPDF

Xingyuan Zeng, Zuohan Wu, Quanming Yao, Yue Wang, Wei Liu

TL;DR: 本文提出RuleMem，一种基于规则的记忆框架，用于长期对话中的问答代理。该框架从历史对话中归纳出可重用的逻辑规则，主动指导证据检索和推理，以解决现有记忆机制被动存储信息导致的语义鸿沟和不可靠推理问题。

Details

Motivation: 现有长期对话问答代理的记忆机制主要将历史信息视为被动存储的事实，导致语义鸿沟和推理不可靠。本文旨在通过主动归纳和利用逻辑规则来克服这一限制。

Result: 在LoCoMo和LongMemEval_s*两个长期对话基准上进行了评估。在LoCoMo上与14个基线模型的严格比较中，RuleMem取得了最高准确率，超出基线平均分27.47分（相对提升54.3%），达到了SOTA水平。

Insight: 核心创新点是提出了一个基于规则（自然语言Horn子句）的主动记忆框架，并引入了规则困惑度一致性（RPC）验证机制。这为证据检索和答案生成提供了显式的逻辑结构，能够检索语义上较远的证据，提升了长期对话中的推理能力。

Abstract: Question answering agents in long-term conversations must reason over massive, temporally dispersed dialogue histories. However, existing memory mechanisms primarily treat past information as \textit{passively} stored facts, leading to semantic gaps and unreliable reasoning. To address this limitation, we propose RuleMem, a rule-based memory framework that induces reusable logical rules from historical interactions to \textit{actively} guide both evidence retrieval and reasoning. Specifically, RuleMem constructs natural-language Horn clauses from conversations and validates them via a Rule Perplexity Consistency (RPC) mechanism. These induced rules enable the retrieval of semantically distant evidence while providing an explicit logical structure for answer generation. We conducted a comprehensive evaluation of RuleMem on two long-term conversational benchmarks, LoCoMo and LongMemEval_s*. In a rigorous comparison against 14 baselines on LoCoMo, RuleMem achieved the highest accuracy, exceeding the baseline average by 27.47 points (a 54.3% relative improvement).

[31] Fixed Suffix Dependency Ratio: Quantifying the Dual-Track Mechanism of Gender Assignment in Latvian Loanwords cs.CLPDF

Yelingyun Zhang, Atis Kapenieks, Marina Platonova

TL;DR: 本研究提出固定后缀依赖比率（FSDR）来量化拉脱维亚语外来词中不同性别对固定派生后缀的依赖程度，以区分形态锚定和自由选择分配。通过分析1832个拉脱维亚语名词词目类型，发现外来词系统中存在显著的FSDR不对称性：阴性外来词更依赖固定派生后缀，而阳性外来词更集中于自由选择区域。该模式具有外来词特异性，且在当代使用中更为明显。

Details

Motivation: 现有研究观察到英语外来词在不同接受语言中倾向于聚集在阳性性别，但其起源难以确定，因为固定形态规则和默认分配经常被一起分析。本研究旨在量化不同性别对固定派生后缀的依赖程度，并区分分布中的形态锚定和自由选择。

Result: 分析1832个拉脱维亚语名词词目类型的结果显示，外来词系统中存在显著的FSDR不对称性：阴性外来词显著更依赖固定派生后缀，而阳性外来词更集中于自由选择区域。该模式具有外来词特异性，且在当代使用中更为明显。

Insight: FSDR提供了一个量化框架来测试默认性别，并展示了在语言接触下阳性默认如何被激活和强化。该方法可以区分形态锚定和自由选择，为性别分配的双轨机制提供了量化工具。

Abstract: Existing research has repeatedly observed the tendency for English loanwords to cluster in the masculine gender across different recipient languages, yet the origin of this pattern remains difficult to determine, as fixed morphological rules and default assignments are frequently analysed together. This study proposes the Fixed Suffix Dependency Ratio (FSDR) to quantify the degree of reliance on fixed derivational suffixes across different genders, and to distinguish between morphological anchoring and free-choice in distribution. By examining 1,832 Latvian noun lemma types, the results reveal a significant FSDR asymmetry within the loanword system: feminine loanwords rely significantly more on fixed derivational suffixes, while masculine loanwords are more concentrated in the free-choice zone. This pattern exhibits loanword specificity and has become more pronounced in contemporary usage. FSDR therefore provides a quantitative framework for testing default gender and shows how masculine default can be activated and reinforced under language contact.

[32] Two-Stage Reinforcement Learning for Sound and Adversarial Test Generation in Code LLMs cs.CL | cs.LGPDF

Jiacheng Xu, Wentao Zhang, Zhiyi Lyu, Fuxiang Zhang, Chaojie Wang

TL;DR: 本文提出了一种名为TCS的两阶段强化学习框架，用于为代码大语言模型自动生成高质量测试用例。该框架通过两个阶段训练测试生成器：第一阶段生成与参考解决方案一致的测试用例，第二阶段专注于当前失败模式并生成反例测试。实验表明，TCS在TACO和LiveCodeBench基准上提升了代码生成的pass@1指标和基于生成测试的推理时答案选择性能。

Details

Motivation: 当前代码生成任务中，高质量的测试用例（既正确又具有判别性）往往稀缺，而强化学习依赖测试用例提供可执行反馈。因此，研究如何自动生成高质量的测试用例成为一个关键问题。

Result: 在TACO和LiveCodeBench基准测试中，TCS框架提高了代码生成的pass@1指标，并改善了基于生成测试的推理时答案选择性能。此外，学习到的测试生成器也能有效用于选择其他大语言模型的输出。

Insight: 核心创新在于将测试用例生成形式化为一个对抗性强化学习问题，并设计了两阶段训练框架：先学习生成正确测试，再专注于生成能暴露当前模型失败模式的反例测试。这种分阶段、对抗性的方法能更有效地生成高质量测试，进而提升代码生成模型的性能。

Abstract: Reinforcement learning (RL) has substantially advanced code generation with large language models (LLMs) through executable feedback. The feedback for coding problems mainly comes from specific test cases, where high-quality test cases are often scarce since they should be both sound and discriminative. We thus turn to study the auto-generation of test cases using the learned model. We find this is naturally an adversarial RL problem: the model is expected to generate effective test cases as counterexamples, depending on the solver’s current failure modes. We propose Test Cases Scaling (TCS), a two-stage RL framework for effective test generation. Both stages train a test generator from a rolling policy-aligned buffer: Stage 1 generates tests consistent with the reference solution, and Stage 2 restricts the buffer to current failure modes and learns counterexample tests. Across TACO and LiveCodeBench, TCS improves both pass@1 and inference-time answer selection according to generated tests. We find the learned test generator also enables effective selection among other LLM outputs.

[33] Translation as a Decision Space: A Multi-Agent Perspective on Low-Resource Dialect Generation cs.CL | cs.AIPDF

Hasan Alkhder, Mohammad Abboush, Igor Tchappi, Ahmet Zengin, Amro Najjar

TL;DR: 本文提出将神经机器翻译重新定义为由多个自主翻译代理探索的结构化决策空间，以解决低资源方言生成中单一输出掩盖多种有效翻译可能性的问题。通过三种代理（零-shot直接翻译、轻量级方言稳定化翻译、通过英语的枢纽翻译）在土耳其语-叙利亚阿拉伯语翻译任务上的实证研究，量化了代理间的行为差异，揭示了多语言模型内在的决策灵活性，并提供了一个可解释性框架。

Details

Motivation: 传统神经机器翻译系统为每个输入仅生成单一输出，掩盖了多语言解码中隐含的多种有效决策轨迹，这在低资源方言场景下尤为突出，因为多种在语言学上有效的实现可能在词汇真实性、语域和结构稳定性上存在差异。

Result: 在5000个对话句子的评估集上，轻量级稳定化处理使方言标记使用频率从0.2266提升至0.4988，几乎翻倍，并显著降低了结构不稳定性；枢纽翻译引入了规范化压力和可测量的压缩效应；零-shot翻译则表现出最高的决策方差。

Insight: 核心创新在于将翻译视为结构化决策空间，并将不同的翻译路径建模为在共享多语言主干上操作的代理，将代理间的分歧视为可解释的行为信号而非错误，为低资源方言生成提供了基于行为量化的原则性可解释性框架。

Abstract: Neural machine translation (NMT) systems typically produce a single output per input, obscuring the alternative decision trajectories implicitly available within multilingual decoding. This opacity becomes particularly problematic in low-resource dialect settings, where multiple linguistically valid realizations may differ in lexical authenticity, register, and structural stability. We propose reframing translation as a structured decision space explored by autonomous translation agents. Instead of analyzing a single output, we model distinct translation pathways as agents operating over a shared multilingual backbone. Inter-agent divergence is treated not as error but as an interpretable behavioral signal. We conduct an empirical study on Turkish–Syrian Arabic translation using three agents: (1) zero-shot direct translation, (2) dialect-stabilized translation via lightweight fine-tuning, and (3) pivot translation through English. Evaluation is performed on 5,000 dialogue sentences, while stabilization is trained on 5,000 additional Turkish–Syrian sentence pairs drawn from television dialogue and MADAR-Turk resources. Rather than optimizing for conventional performance metrics, we quantify structured behavioral displacement using dialect marker frequency, lexical proximity to standardized Arabic, and structural variance. Lightweight stabilization nearly doubles dialect marker usage, increasing it from 0.2266 to 0.4988, while significantly reducing structural instability. Pivot mediation introduces normalization pressure and measurable compression effects, whereas zero-shot translation exhibits the highest decision variance. We argue that translation divergence across agents reveals latent decision flexibility within multilingual models and we provide a principled interpretability framework for low-resource dialect generation.

[34] Last Translation Benchmark cs.CLPDF

Vilém Zouhar, Niyati Bafna, Mukund Choudhary, Maike Züfle, Sara Rajaee

TL;DR: 本文介绍了Last Translation Benchmark（LTB），这是一个旨在突破当前最先进机器翻译模型极限的基准测试集，包含人工撰写和同行评审的文本、图像、音频和视频示例。同时，论文提出了一种新的评估方法，每个示例都附带手工制作的验证规则，用于描述具体的失败案例，从而实现可靠且可操作的评估。LTB是一个持续更新的动态数据集，当前版本为LTBv1。

Details

Motivation: 动机在于现有机器翻译基准测试趋于饱和，自动评估指标不可靠且易受奖励攻击，而人工评估又缺乏可重复性、客观性和可扩展性，这阻碍了客观追踪领域进展和识别改进路径。

Result: 论文介绍了LTBv1基准测试集，其中包含截至2026年9月1日前被接受的贡献示例，这些示例旨在突破领先的机器翻译模型。

Insight: 创新点在于构建了一个动态的、多模态的、旨在揭示模型失败案例的基准测试集，并配套提出了一种基于手工验证规则的可操作评估方法，这为可靠评估模型极限和指导改进提供了新途径。

Abstract: For scientific progress, we need benchmarks that test the limits of state-of-the-art models, and evaluation methods that inform us about failure cases. As models get stronger, standard benchmarks for machine translation are approaching saturation. Further, automatic translation metrics are unreliable, vulnerable to reward-hacking, and provide unactionable assessments. Even gold human evaluation is not problem-free, because it often lacks reproducibility, objectivity, and scalability. Overall, this prevents us from tracking objective progress in the field and identifying pathways for improvement. We introduce the Last Translation Benchmark, a collection of human-authored and peer-reviewed examples (texts, images, audio, videos) that break leading machine translation models. We also present a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example, therefore allowing reliable and actionable future evaluation. The Last Translation Benchmark is a live dataset that accepts ongoing contributions. The latest version is LTBv1, containing accepted contributions prior to September 1st 2026, with future releases planned as new data is continuously collected.

[35] Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR cs.CL | cs.AI | cs.LGPDF

Boyan Li, Bingsen Chen, Chenghao Yang, Ping Nie, Chen Zhao

TL;DR: 本文研究了推理大语言模型后训练中两种主流方法——可验证奖励强化学习（RLVR）和在线策略蒸馏（OPD）的交互作用。研究发现，简单的两阶段方案（先进行OPD训练，再进行RLVR训练）在逻辑和数学推理基准测试中一致优于纯OPD、纯RLVR以及所有联合优化基线。

Details

Motivation: 动机在于探究如何更有效地结合OPD提供的密集token级监督信号与RLVR提供的稀疏奖励信号，以提升推理大语言模型的性能。先前工作将两种信号在单步内融合，但效果可能不佳。

Result: 在逻辑和数学推理基准测试上，两阶段方案‘OPD-then-RL’的表现超越了所有纯方法和联合基线。研究通过pass@k行为、学习动态和参数更新分析提供了系统性解释。

Insight: 核心创新点在于揭示了两种信号分阶段处理的优势：OPD扩展了学生对教师支持解决方案的覆盖范围，而RL则在此范围内进行锐化；联合优化会导致信号干扰。实践上，OPD验证分数是切换到RL的关键信号，且OPD是比监督微调（SFT）更好的RL冷启动方法。

Abstract: Reinforcement learning with verifiable rewards (RLVR) and on-policy distillation (OPD) have emerged as two dominant methods for post-training reasoning LLMs. Prior work uses OPD’s dense token-level supervision to complement the sparse RL reward, fusing the two signals within a single step: either as a \emph{weighted-additive combination} or a \emph{teacher-modulated rescaling} of the RL advantage. In this paper, we show that a simple two-stage scheme, OPD-then-RL, consistently outperforms pure OPD, pure RLVR, and all such joint baselines across logic and math reasoning benchmarks. Beyond the empirical results, we further provide a systematic understanding of this through pass@$k$ behavior, learning dynamics, and parameter updates, yielding a consistent explanation: OPD expands the student’s coverage of teacher-supported solutions and RL sharpens within that support, while jointly optimizing the two signals causes them to interfere.To provide a practical recipe, we find that the OPD validation score is the key signal for when to switch to RL, and that OPD is a better cold start for RL than SFT. Together, our results establish OPD-then-RL as a simple yet strong way to combine the two methods, turning two entangled signals into complementary stages.

[36] Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning cs.CL | cs.LGPDF

Kevin Du, Alexander Hoyle, Laura Ruis, Acyr Locatelli

TL;DR: 这篇论文探讨了链式思维推理中步骤文本的‘可读性’与‘可解释性’的区别。研究发现，虽然推理步骤的文本看起来提供了模型如何得出答案的窗口，但LLM评估者或微调的批评模型难以仅从文本中准确识别出对最终答案有重要功能贡献的步骤，这表明将可读性等同于可解释性存在风险。

Details

Motivation: 当前许多工作将链式思维模型的推理轨迹视为可解释的窗口，用于诊断错误、评估忠实性或提供过程监督。论文旨在检验这种做法的前提，即推理步骤的文本是否真的编码了关于其功能重要性的信息。

Result: 通过将步骤重要性操作化为‘优势’（通过蒙特卡洛模拟估计其对获得正确最终答案的期望奖励变化），研究发现，能力足够的LLM评估者在识别高优势步骤上能超过基线，但远未达到噪声上限。微调的步骤级批评模型对错误回答有显著改进，但对正确回答仍远未达到上限。

Insight: 核心创新点在于将步骤重要性量化为‘优势’并以此作为评估基准。主要见解是：推理轨迹的文本仅部分编码了步骤的功能重要性，因此不能简单地将可读性等同于可解释性，这对过程奖励建模等应用提出了警示。

Abstract: Reasoning traces from chain-of-thought models appear to offer a legible window into how a model arrives at its answer. A growing body of work treats them as such, using LLM judges to diagnose errors, evaluate faithfulness, and provide step-level supervision via process reward models and generative critics. These practices rely on the text of a reasoning step carrying information about its functional role. But does the text actually encode information about which reasoning steps matter? We operationalize the importance of a reasoning step as its advantage: the change in expected reward, e.g., producing the correct final answer, from including that step, estimated via Monte Carlo rollouts. Basing ground truth on these estimates, we evaluate whether LLM judges can identify high-advantage steps and find that sufficiently capable LLMs can outperform a prevalence baseline but fall well short of a noise ceiling. Fine-tuning a model as a step-level critic yields strong improvement for incorrect responses but remains distant from ceiling for correct responses, suggesting that step importance is only partially recoverable from the text of the reasoning trace. Our findings contribute to a growing body of chain-of-thought faithfulness work that cautions against treating the legibility of reasoning traces as interpretability, especially with implications for process reward modeling.

cs.CV [Back]

[37] Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers cs.CV | cs.CRPDF

Ahmed Abdelnaby, Mohamed Elmahallawy

TL;DR: 本文提出了一种名为TRIM的黑盒防御方法，用于在推理时检测和净化深度神经网络中的后门触发器。该方法无需模型内部信息、训练数据或干净样本，通过识别导致异常模型行为的图像区域并进行选择性净化，有效应对多种后门攻击类型。

Details

Motivation: 现有后门防御方法通常依赖模型内部信息、训练数据或干净验证样本，难以在仅能黑盒访问训练模型的实际部署场景中应用。本文旨在解决这一局限性，开发一种面向部署的黑盒防御方案。

Result: 在多种数据集和多种后门攻击类型（如混合、稀疏、变尺寸和多触发器）上的广泛实验表明，TRIM始终优于现有的黑盒防御方法，能将攻击成功率（ASR）降低至最低1.16%，同时保持高达87.87%的干净准确率。

Insight: 核心创新在于通过基于区域的深度特征分割、基于修复和扩散重建的自适应触发器发现（无需对触发器类型、形状或位置做假设）以及选择性区域净化来隔离和清理被污染区域。此外，通过缓存已识别触发器的特征嵌入，实现了高效的识别并避免了冗余操作。

Abstract: Deep neural networks (DNNs) are increasingly deployed in real-world vision systems, yet their predictions can be covertly manipulated by backdoor attacks, in which malicious triggers cause targeted misclassification while preserving high clean accuracy. Existing defenses often rely on model internals, training data, or clean validation samples, making them difficult to deploy when only black-box access to a trained model is available. We propose TRIM (Trigger Removal by Identifying Manipulated Regions), a deployment-oriented black-box defense that detects and selectively removes backdoor triggers at inference time without requiring model internals, training data, or clean samples. The key insight behind TRIM is to identify image regions that are responsible for anomalous model behavior and purify only those regions while preserving benign content. TRIM innovates via three key components: (i) region-based segmentation with deep feature representations, (ii) adaptive trigger discovery through inpainting and diffusion-based reconstruction to isolate regions responsible for misclassification—without assumptions about trigger type, shape, or location, and (iii) selective region purification that cleans poisoned regions while retaining benign content. To support practical deployment, TRIM further caches feature embeddings of previously identified triggers, enabling efficient recognition and avoiding redundant detection and purification. Extensive experiments across diverse datasets and backdoor types, including blended, sparse, varying-size, and multiple triggers, show that TRIM consistently outperforms existing black-box defenses, reducing attack success rates (ASR) to as low as 1.16% while preserving clean accuracy of up to 87.87%. These results demonstrate that effective backdoor mitigation is possible at inference time even when the defender has no access to any auxiliary data.

[38] Position: Unlabeled IS NOT Equal to No Human Supervision in Visual Learning cs.CV | cs.LGPDF

Dong Lao

TL;DR: 这篇立场论文认为，视觉学习中无标签并不等同于无人监督，并呼吁研究社区更明确地识别监督来源。作者指出，许多计算机视觉方法基于从大规模无标签数据学习的表示，但不同的数据整理方案和训练目标嵌入了显著不同的人类先验，导致“无监督”这一统称不再能捕捉这些区别。这种模糊性使得在不同假设下进行的无监督学习研究难以比较，并可能导致方法多样性的减少。

Details

Motivation: 论文的动机是澄清“无监督学习”术语的模糊性，因为当前许多方法虽被归为无监督，但实际上依赖数据选择和训练目标中隐含的人类先验，这影响了研究的公平比较和学术交流。

Result: 论文未提及具体定量结果或基准测试，而是基于对领域趋势的观察，指出自2021年以来，旗舰计算机视觉会议中以“无监督”为标题的论文数量急剧下降，尽管该领域仍在持续增长。

Insight: 论文的创新点在于倡导社区层面的概念清晰化，鼓励作者披露数据选择和学习目标中的先验，并标准化披露实践，以改善学术交流、确保公平比较并保护无监督学习的方法多样性。

Abstract: This position paper argues that the absence of labels does not imply the absence of human supervision in visual learning, and urges the research community to identify sources of supervision more explicitly. Many recent methods in computer vision build upon representations learned from large-scale unlabeled data, and are therefore grouped under the same umbrella term unsupervised.'' However, different data curation schemes and training objectives embed substantially different human priors on which models rely, and we argue that one unsupervised’’ umbrella term is no longer capturing these distinctions. This ambiguity makes it harder to compare unsupervised learning research conducted under different assumptions, coinciding with a sharp decline in papers titled with ``unsupervised’’ in flagship computer vision conferences since 2021, despite continued growth of the field. While we fully embrace pre-training as a strong foundation for modern computer vision, we advocate for a community-level effort toward greater conceptual clarity: authors are encouraged to disclose priors in data selection and learning objectives, and to specify which components of a learning pipeline depend on which assumptions. Standardized disclosure practices can improve academic communication, ensure fairer comparisons, and preserve methodological diversity in unsupervised learning.

[39] Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling cs.CVPDF

Young Seok Jeon, Beatrice Brown-Mulry, Rohan Satya Isaac, Anjana Dissanayaka, Theo Dapamede

TL;DR: 本文提出TopKSigLIP，一种针对乳腺X光摄影（钼靶）的视觉-语言模型，旨在解决标准CLIP架构在乳腺影像零样本任务中性能不佳的问题。模型通过TopK-Patch模块自适应采样高分辨率图像中可能包含病灶的稀疏区域，并采用Sup-sigmoid损失函数来处理报告文本的同质性问题。

Details

Motivation: 标准CLIP模型在乳腺影像的零样本任务（如癌症检测、发现类型和BI-RADS预测）中表现有限，主要原因是忽视了乳腺影像数据的高分辨率特性以及放射学报告文本的高度同质性（以阴性/良性发现为主）。

Result: 在内部和外部基准测试中，TopKSigLIP在密度评估、BI-RADS分类、发现亚型分类和癌症预测等零样本评估任务上，超越了现有的开源乳腺影像和通用医学VLM。在线性探测评估中，尽管使用了更小的视觉编码器和训练批次，其性能仍具有竞争力。TopK-Patch模块在病灶定位上也优于事后Grad-CAM方法。

Insight: 核心创新点在于针对特定领域（乳腺影像）数据特性定制VLM架构与目标函数：1) TopK-Patch模块通过可微分子集采样，在训练中自适应选择高分辨率图像的关键区域，避免了分辨率与批次大小的权衡，并提供了内置的病灶定位能力；2) 引入Sup-sigmoid损失（基于SigLIP的扩展），利用结构化数据生成的软标签替代对比损失，有效处理了文本语义相似但被错误排斥的问题。这是一种将领域先验知识（高分辨率病灶区域稀疏、报告同质化）深度融入模型设计的范例。

Abstract: There is growing interest in adopting CLIP-style vision–language model (VLM) pretraining for mammography. However, models that directly employ the standard CLIP architecture and training objective exhibit limited zero-shot performance in clinically important tasks such as cancer, finding-type, and BI-RADS predictions. We argue that this underwhelming performance is due to neglecting two characteristics of mammography data: (1) its high-res nature, and (2) homogeneity of radiology reports, largely driven by a predominance of negative/benign findings on examinations. We propose TopKSigLIP, a VLM designed to address these two limitations through a novel architecture and learning objectives. Instead of downscaling high-res mammography images to satisfy GPU memory constraints, TopKSigLIP introduces TopK-Patch module that learns to sample a sparse set of high-res patches likely to contain lesions, sidestepping the resolution–batch size tradeoff of VLM training. The sampled patch locations additionally serve as a built-in localization tool. To address report homogeneity, we replace the contrastive loss, which falsely repels semantically similar pairs, with a Sup-sigmoid loss. Sup-sigmoid loss extends the sigmoid loss from SigLIP with soft labels derived from structured data. TopKSigLIP outperforms existing open-source mammography and general medical VLMs on both internal and external benchmarks on density assessment, BI-RADS classification, finding subtyping, and cancer prediction under zero-shot evaluation. TopKSigLIP remains competitive under linear probing despite using a significantly smaller vision encoder and smaller training batches than baselines. The TopK-Patch module additionally achieves superior lesion localization over post-hoc Grad-CAM. Code and weights are made public:https://github.com/Youngseok0001/TopKSigLIP.

Wenzhuo Xu, Yuchen Zhu, Chongjian Ge, Xuan Shen, Jing Shi

TL;DR: VeriPhy是一个可审计的物理验证系统，用于评估和优化世界模型的物理可靠性。它通过文本规划器将提示编译为类型化物理义务和静态验证的执行计划，在执行过程中调用冻结的低级专家（如分割、跟踪、计数、物理测量等）生成携带来源的证据记录，最终映射为支持、矛盾或未知的三值状态，并提供完全可追溯的判决。

Details

Motivation: 解决生成视频中视觉流畅性不代表物理可靠性的问题，现有标量质量评分无法定位违反的物理义务或失败时刻，需要可审计的物理验证系统来评估世界模型。

Result: 在包含304个人工标注缺陷记录的149个核心视频剪辑上，VeriPhy解释了228个记录，优于给定相同剪辑和声明的已发布问题分解评估器的164个；虽然召回率接近整体提示骨干模型的222个，但其优势在于每个决策保留证据记录和来源，支持可审计性。

Insight: 创新点在于将物理验证系统化为类型化义务和静态验证计划，通过模块化专家生成可追溯证据，实现可审计的三值判决，这为生成模型的物理可靠性评估提供了结构化、可解释的接口，并可能反馈到生成过程中。

Abstract: Visual fluency in generated video does not imply physical reliability, and a scalar quality score alone is incapable of indicating the obligation a clip violates or the moment it fails. We present VeriPhy, an auditable physical-verification system in which a text-only planner compiles the prompt into typed physical obligations and a statically validated execution plan before any frame is observed. During execution, observations gate and scope only declared calls to frozen low-level experts (e.g., segmentation and tracking, counting, eleven typed physical measurements over the resulting tracks, depth, OCR, and audio-event detection). Each action returns a provenance-carrying evidence record whose payload, when usable, is either a typed measurement or an explicitly tagged learned state. Typed resolvers and fixed composition map usable records to a three-valued state (supported, contradicted, or unknown, surfaced as plausible, implausible, or abstain) with full provenance, so that every verdict is traceable to the evidence that produced it. We anchor evaluation in a 1,500-clip corpus of human-annotated flaw records that localize real generation failures in prompt reference, space, and time. On a 149-clip core carrying 304 such records, VeriPhy accounts for 228, against 164 for a published question-decomposition evaluator given the same clips and the same claims. Recall alone does not separate it from prompting the same backbone monolithically, which reaches 222; what separates them is that each decision retains its evidence record and provenance, making the traces auditable one verdict at a time and usable as the interface through which a critic verdict could be written back into generation.

[41] Who Speaks for the Pruned? Visual Token Pruning as Coverage Optimization cs.CV | cs.CL | cs.LGPDF

Qingchan Zhu, Weihang You, Hanqi Jiang, Changdi Yang, Tianming Liu

TL;DR: 本文提出CoverPruner，一种无需训练的视觉令牌剪枝方法，通过将剪枝问题建模为表征覆盖最大化（RCM），旨在优化剪枝后剩余令牌对原始令牌集的代表性覆盖，从而在多种视觉语言模型架构和压缩率下实现最佳平均准确率。

Details

Motivation: 现有视觉令牌剪枝方法主要关注保留哪些令牌，这种保留令牌的视角可能导致保留冗余的高分令牌，同时丢弃的证据缺乏相近的代表性。本文旨在解决这一互补的需求侧问题：在移除一个令牌后，哪个存活的原始令牌能代表它服务于目标视觉语言模型？

Result: 在多种视觉语言模型架构和压缩率下，CoverPruner在对比的所有方法中取得了最佳的平均准确率，通常在激进压缩下获得最大的性能提升。

Insight: 创新点在于将剪枝问题重新定义为表征覆盖最大化（RCM），并使用投影器空间覆盖和轻量级首层注意力探针来实例化RCM，这是一种无需训练、从需求侧优化令牌代表性的新视角。

Abstract: Visual token pruning reduces the inference cost of vision-language models (VLMs), but most methods only ask which tokens to keep. This retained-token view can keep redundant high-scoring tokens while leaving discarded evidence without a close representative. We propose CoverPruner, a training-free pruner that asks the complementary demand-side question: after a token is removed, which surviving original token represents it for the target VLM? CoverPruner formulates pruning as Representational Coverage Maximization (RCM), covering the full projected visual-token set with query-weighted demand. It instantiates RCM with projector-space coverage and a lightweight first-layer attention probe. Across multiple VLM architectures and compression rates, CoverPruner achieves the best average accuracy among all compared methods, with the largest gains usually appearing under aggressive compression.

[42] RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning cs.CV | cs.ROPDF

Howard Qian, Yiting Chen, Yunfei Xie, Kejia Ren, Podshara Chanrungmaneekul

TL;DR: RoboTok是一个互联网规模的数据引擎，用于从网络视频中检索与人类操作相关的演示，以训练灵巧的机器人策略。它通过从3D手部轨迹中学习潜在运动空间，实现跨相机视角、场景外观和演员遮挡的操作行为比较，从而高效检索和索引网络视频。

Details

Motivation: 解决机器人学习中演示数据收集昂贵且难以覆盖现实世界任务长尾分布的问题，通过利用网络视频作为可扩展的监督源。

Result: 在检索基准和下游机器人策略性能评估中，RoboTok比现有方法检索到更相关的操作演示，并提高了下游任务的成功率。

Insight: 创新点在于使用基于3D手部轨迹的潜在运动空间表示，实现跨场景的操作行为检索，使网络视频成为机器人学习的可扩展和持续增长的监督来源。

Abstract: Robot learning increasingly depends on broad and diverse demonstrations, yet collecting robot data remains expensive and poorly suited to covering the long tail of real-world tasks. To address this bottleneck, we introduce RoboTok, an internet-scale data engine that, given a query human manipulation video, retrieves manipulation-relevant human demonstrations from web videos for training dexterous robot policies. Specifically, we learn a latent motion space from 3D hand trajectories expressed in estimated actor-centered reference frames. This representation enables manipulation behaviors to be compared across variations in camera viewpoint, scene appearance, and actor occlusions, while remaining compact enough for efficient search and continual indexing over internet-scale video collections. We evaluate RoboTok against existing robot-data retrieval approaches on retrieval benchmarks and downstream robot policy performance. Our results show that RoboTok retrieves more relevant manipulation demonstrations and improves downstream task success, establishing hand-pose trajectory-aware retrieval as a way to make web video a scalable and continuously growing source of supervision for robot learning.

[43] Learning to Zoom Efficiently with a Contrastive Curriculum cs.CV | cs.CLPDF

Falko Helm, Iryna Gurevych

TL;DR: 本文提出了一种无需额外标注或监督微调（SFT）预热阶段的方法，通过设计一种基于对比课程的内在奖励，来高效地教导多模态大语言模型（MLLMs）使用缩放工具。该方法在多个基准测试中表现具有竞争力，甚至能作为SFT的直接替代方案并超越基线。此外，论文还引入了一个可扩展的合成数据集Muffin&Chihuahua（M&C）来直接评估模型的缩放能力，并发现召回率是与最终任务性能最相关的指标。

Details

Motivation: 现代视觉代理中，缩放工具是处理高分辨率图像任务的重要基础组件。现有方法通常需要大量有监督的微调预热阶段来教导模型缩放，这过程成本高昂且低效。本文旨在探索一种无需额外标注或预热SFT的、更高效的学习方法。

Result: 在V*、HRBench和MME-RealWorld基准测试上的实验表明，所提方法具有竞争力且更高效。当直接替代SFT时，甚至超越了所有基线模型。利用新提出的M&C数据集进行评估，发现召回率是衡量缩放区域选择与最终任务性能相关性的最强指标。

Insight: 主要创新点在于设计了一种基于InfoNCE风格的内在奖励，该奖励利用由易到难的负样本工具调用序列作为对比训练信号，形成一种课程学习策略。这避免了传统方法对大量标注数据和监督微调预热的依赖。从客观角度看，这种将工具使用学习转化为基于课程的内在奖励优化问题，为教导MLLMs使用复杂工具提供了一种新颖且高效的范式。

Abstract: Using a zoom-in tool is an important foundational part of modern visual agents, because it allows to efficiently handle tasks involving high-resolution images. Most previous methods need an extensive warm-start supervised fine-tuning phase for teaching models zoom-in. We show that this is not necessary by proposing a new intrinsic reward for learning tool use in MLLMs without the need for additional labels or warm-start SFT. Our InfoNCE-style reward uses a curriculum of increasingly hard negative tool calls as a contrastive training signal. Empirical experiments on $V^*$, HRBench and MME-RealWorld show that our approach is competitive while being more efficient. When used as a drop-in replacement for SFT, we even outperform all baselines. To directly measure the zoom-in ability of models, we further introduce the scalable synthetic Muffin&Chihuahua (M&C) dataset. Each image consists of a grid with every cell either showing a muffin or chihuahua. Leveraging the M&C dataset’s unique region of interest labels, we find that recall is the metric that most strongly correlates the zoom-in region with final task performance. Our model and code for reproduction is publicly available under https://github.com/UKPLab/emnlp2026-zoom-in

[44] ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers cs.CVPDF

Ali Hojjat, Janek Haberer, Olaf Landsiedel

TL;DR: 本文提出了ProgResViT，一种输入自适应的视觉Transformer模型，通过多轮渐进式推理来优化计算效率。模型首先使用低分辨率和窄子网络处理图像，若预测置信度不足则逐步提高输入分辨率和网络宽度进行细化。所有轮次共享一个主干网络，并引入了Progress-Conditioned Soft Gating（PSG）机制来根据当前轮次、块和输入分辨率调节令牌融合和层输出。

Details

Motivation: 解决传统ViT模型在处理所有图像时均使用固定输入分辨率和模型宽度导致的冗余计算问题，旨在实现更高效的自适应推理。

Result: 在图像分类任务中，基于DeiT的ProgResViT在准确率-计算量权衡上优于自适应宽度、深度和动态令牌的基线方法；结合知识蒸馏后达到84.9%的top-1准确率，略高于DeiT-III-S在可比设置下的报告结果。该设计在自监督DINO表示和下游语义分割任务中也表现出良好的准确率-计算量权衡。

Insight: 创新点在于多轮渐进式推理框架与PSG机制的结合，实现了计算资源的动态分配；从客观角度看，这种共享主干网络的渐进式设计为自适应视觉模型提供了可扩展且高效的架构思路。

Abstract: Vision Transformers (ViTs) typically process every image using a fixed input resolution and model width, even though many images can be classified with substantially less computation. We introduce ProgResViT, an input-adaptive ViT that performs inference progressively across multiple rounds. The first round processes a low-resolution image with a narrow subnetwork. Inference terminates when the prediction is sufficiently confident; otherwise, the model reuses the representations produced in the current round and proceeds with a higher-resolution input and a wider subnetwork to refine its prediction. As all rounds share a single backbone, we propose Progress-Conditioned Soft Gating (PSG), which conditions token fusion and layer outputs on the current round, block, and input resolution. On image classification, applying ProgResViT to DeiT yields better accuracy-compute trade-offs than adaptive-width, adaptive-depth, and dynamic-token baselines. With knowledge distillation, a DeiT-based ProgResViT achieves 84.9% top-1 accuracy, slightly exceeding the reported DeiT-III-S accuracy under a comparable evaluation setting. We show that the same design also provides favorable accuracy-compute trade-offs for self-supervised DINO representations and downstream semantic segmentation. Code is available at https://github.com/ds-kiel/ProgResViT.

[45] Counting Animals in Camera-Traps Image Sequences without Count Labels: Winning Solution to the iWildCam 2021 Challenge cs.CVPDF

Fagner Cunha, Juan G. Colonna, Eulanda M. dos Santos

TL;DR: 本文介绍了赢得iWildCam 2021挑战赛的解决方案MaxBoxCount，该方法旨在从相机陷阱图像序列中自动估计动物个体数量，而无需依赖计数标签进行训练。该方法结合了强大的物种分类流程和基于MegaDetector检测的简单启发式计数策略。

Details

Motivation: 相机陷阱广泛用于野生动物监测，但现有计算机视觉方法多集中于物种识别，而许多生态应用需要估计图像序列中独特个体的数量。由于相机陷阱图像序列存在时间不连续性，传统多目标跟踪方法不可靠，且手动收集计数标注成本高昂。

Result: 该方法在iWildCam 2021挑战赛的基准测试中获胜，该基准模拟了真实标注约束下（训练时无计数标签）的序列级动物计数任务。

Insight: 创新点在于提出了一种无需计数标注的计数启发式方法MaxBoxCount，通过结合物种分类和检测框分析来估计独特个体数，为数据稀缺场景下的动物计数提供了实用解决方案。

Abstract: Camera traps have become an essential tool for wildlife monitoring, motivating the development of computer vision methods for the automated extraction of information from these data. While most prior work has focused on species identification, many ecological applications also require estimating the number of unique individuals appearing across short image sequences. This task is particularly challenging because camera traps typically acquire bursts of images at approximately one frame per second, creating large temporal discontinuities that may make conventional multi-object tracking methods unreliable, and because manually collecting individual count annotations is prohibitively expensive. In this work, we describe the winning solution to the iWildCam 2021 Challenge, which introduced a benchmark for counting animals at the sequence level under realistic annotation constraints where count annotations are unavailable for training. Our approach, MaxBoxCount, combines a strong species classification pipeline with a simple yet effective counting heuristic based on MegaDetector detections to estimate the number of unique individuals without requiring count annotations. Code is available at https://github.com/alcunha/iwildcam2021ufam.

[46] MedQA-MM: Shortcuts Behind Medical Visual Reasoning cs.CV | cs.CLPDF

Benlu Wang, Yifan Zhang, Jiaqing Yu, Chin Siang Ong, Juncheng Huang

TL;DR: 该论文揭示了医学多模态多项选择题（MCQs）基准评估中存在的‘推理膨胀’问题，即模型可能通过文本线索、图像中的非视觉信息或人工标注等‘捷径’而非真正的医学图像推理来获得正确答案。作者通过提示和图像侧审计、模态消融等实验，在六个数据集上量化了这些捷径的影响，并构建了一个包含1000个项目的、缓解了捷径的MedQA-MM子集，以强调需要路径级别的证据来验证模型的图像推理能力。

Details

Motivation: 解决当前医学多模态MCQ基准评估的局限性，即仅凭最终答案的正确率无法区分模型是真正理解了医学图像，还是利用了数据集本身存在的、与图像内容无关的文本或上下文线索（捷径）来回答问题。

Result: 在包含13种配置的开放模型面板上，完整输入的准确率为62.63%，而仅使用文本和仅使用选项的准确率分别为53.96%和29.71%。移除特定类型的捷径线索（如长度差异、绝对/显眼词汇、空间/介词线索）分别导致准确率下降6.58、3.50和4.77个百分点。在构建的MedQA-MM子集上，仅文本和仅选项的准确率大幅降至5.21%和12.33%。

Insight: 论文的核心创新在于提出了‘推理膨胀’的概念，并系统性地设计实验（如模态消融、匹配修复）来分离和量化基准数据集中存在的各种捷径线索。这强调了在评估多模态医学AI模型时，不能仅依赖最终答案的准确率，而必须提供路径级别的证据来证明模型确实进行了图像推理。构建的MedQA-MM子集为未来更鲁棒的评估提供了基准。

Abstract: A benchmark score credits final answers, but not the route by which an item can be answered. In medical multimodal multiple-choice questions (MCQs), this distinction matters because a correct answer can be supported by the intended image finding or by benchmark-preserved cues in the wording of answers, non-visual clinical text, visible image text, artificial annotations, or device/context artifacts. We call the resulting score-level overinterpretation reasoning inflation. Here, a route is an observable input path that can support answer selection, not a claim about the model’s hidden cognition. Across six medical multimodal MCQ datasets, we separate candidate cues from behavioral evidence through prompt- and image-side audits, modality ablations, and matched repairs that preserve the medical target and answer key. In a 13-configuration open-model panel, full-input accuracy is 62.63%, while text-only and options-only settings achieve 53.96% and 29.71%, respectively. Removing length-gap, absolute/conspicuous, and spatial/prepositional cues lowers accuracy by 6.58, 3.50, and 4.77 percentage points. We also construct MedQA-MM, a 1,000-item shortcut-mitigated subset, where text-only and options-only accuracy fall to 5.21% and 12.33%. This does not imply that models never use images; it shows that medical image-reasoning claims require route-level evidence.

[47] Exploring the Potential of Contrastive Language-Image Pre-training for Multi-Source Remote Sensing Data cs.CV | cs.AIPDF

Xiangyang Miao, Kelu Yao, Yekai Huang, Xiaogang Xu, Junxiao Xue

TL;DR: 本文提出OmniRSCLIP，一个支持多源遥感传感器（如RGB、SAR、MSI、HSI）输入的端到端对比学习框架，以解决现有遥感CLIP方法难以利用异构传感器数据的问题。核心创新是引入光谱-空间基分解（SSBD）和光谱上下文感知掩码对比学习方案，并构建了首个覆盖多模态的大规模遥感图文数据集OmniRS5M。实验表明，该框架在保持RGB域性能的同时，能有效将CLIP扩展到异构遥感模态。

Details

Motivation: 现有遥感对比学习方法大多基于面向RGB的CLIP架构，难以有效利用SAR、多光谱和高光谱等异构传感器数据，限制了遥感视觉-语言理解的发展。

Result: 在检索、零样本分类和语义定位任务上的实验表明，OmniRSCLIP在保持RGB域强大性能的同时，成功将CLIP扩展到了异构遥感模态，实现了多源数据的统一语义空间对齐。

Insight: 创新点在于提出了光谱-空间基分解（SSBD）方法，将任意通道适配问题转化为基重组问题，避免了将异构传感器强行映射到固定通道输入空间；同时，构建了首个大规模多模态遥感图文数据集OmniRS5M，为领域研究提供了重要资源。

Abstract: Contrastive language-image learning (CLIP) has become a key paradigm for remote sensing vision-language understanding. However, existing remote sensing contrastive learning methods are mostly built on RGB-oriented CLIP architectures, making it difficult to exploit heterogeneous sensors such as SAR, multi-spectral imaging (MSI), and hyperspectral imaging (HSI). To address this limitation, we propose OmniRSCLIP, an end-to-end contrastive learning framework that supports multi-source sensor inputs for remote sensing vision-language modeling. The key idea is to extend CLIP beyond its fixed RGB input interface without breaking the pretrained visual knowledge. To this end, OmniRSCLIP introduces Spectral-Spatial Basis Decomposition (SSBD), which formulates arbitrary-channel adaptation as a basis recomposition problem: pretrained CLIP patch embeddings provide transferable spatial bases, while wavelength-conditioned coefficients span sensor-specific embedding kernels within a constrained visual prior space. This design avoids forcing heterogeneous sensors into a fixed-channel input space, while aligning them in a unified image-text semantic space. We further introduce a spectral-context-aware mask-based contrastive learning scheme to suppress modality-specific redundant features and enhance fine-grained image-text alignment. Finally, to support multi-modal training, we construct OmniRS5M, the first large-scale remote sensing image-text corpus covering RGB, SAR, MSI, and HSI. Experiments on retrieval, zero-shot classification, and semantic localization show that OmniRSCLIP preserves strong RGB-domain performance while effectively extending CLIP to heterogeneous remote sensing modalities.

[48] Neural-Collapse-guided Task-Free Continual Anomaly Detection cs.CVPDF

Xiaotong Kong, Chaoyang Song, Ziai Zhou, Jinxia Zhang, Kanjian Zhang

TL;DR: 本文提出NC-TFAD，一种受神经坍缩理论启发的几何驱动框架，用于解决工业视觉检测中无任务边界的持续异常检测问题。该方法通过将流式特征对齐到单纯形等角紧框架原型空间来稳定非平稳数据流下的表示几何，并引入合成异常样本、正则化技术和对比损失来抑制表示漂移并增强正常-异常可分性，最终通过融合正常块原型引导的定位分支与弱自注意力先验来生成异常热图。

Details

Motivation: 现实工业制造环境中的数据分布会发生不可预测的偏移，使得依赖任务边界的持续学习假设不切实际，因此需要将工业异常检测建模为无任务边界的持续学习问题。

Result: 在MVTec AD和VisA数据集上的大量实验表明，在无任务持续学习协议下，NC-TFAD在图像级检测和像素级定位任务上，始终优于从通用视觉任务改编的代表性无任务持续学习方法以及统一的异常检测基线方法。

Insight: 核心创新在于利用神经坍缩理论指导的几何建模来稳定非平稳流下的表示，通过构建ETF原型空间、生成合成异常作为辅助锚点，并结合FNCC损失等机制，为无任务持续异常检测提供了一个有效且鲁棒的解决方案。几何驱动的建模思路具有借鉴意义。

Abstract: Recent years have witnessed growing interest in continual anomaly detection for industrial visual inspection. However, real-world manufacturing environments exhibit unpredictable shifts in data distributions, rendering task-dependent continual learning assumptions impractical. To address this limitation, we formulate industrial anomaly detection as a task-free continual learning problem and propose NC-TFAD, a neural-collapse-inspired, geometry-driven framework for learning from non-stationary data streams without task boundaries. NC-TFAD freezes a pretrained backbone and aligns streaming features to a simplex Equiangular Tight Frame (ETF) prototype space to stabilize representation geometry under non-stationary streams. To satisfy the NC-inspired geometric construction in the absence of real anomalies, we generate synthetic anomaly samples as auxiliary anchors during training. Building on this geometry, we further introduce inter- and intra-class regularization together with a Focal Neural Collapse Contrastive (FNCC) loss to suppress representation drift and improve normal-anomaly separability. Finally, a normal-patch-prototype-guided localization branch constructs calibrated patch-wise deviation maps from normal training samples and fuses them with a weak self-attention prior, producing anomaly heatmaps without pixel-level annotations. Extensive experiments on MVTec AD and VisA show that NC-TFAD consistently outperforms representative task-free continual learning methods adapted from general vision, as well as unified anomaly detection baselines, in both image-level detection and pixel-level localization under the task-free continual learning protocol. These results highlight that geometry-driven modeling offers an effective and robust solution for task-free continual anomaly detection in real-world industrial applications.

[49] Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage cs.CV | cs.MMPDF

Jagadish Kashinath Kamble, Jayanta Mukhopadhyay, Debaditya Roy, Partha Pratim Das

TL;DR: MudraGen是一个条件扩散框架，用于生成印度古典舞蹈中复杂的双手交互手势（Samyukta Hasta Mudras）的逼真RGB图像。该模型通过引入几何感知监督（包括关键点损失、关节偏移损失和形状一致性损失）来确保手势的精确协调、解剖学有效性和文化细微差别，从而克服了现有文本条件图像生成模型在低资源数据集和缺乏精确文本描述方面的局限性。

Details

Motivation: 印度古典舞蹈手势数据集资源匮乏，且许多手势的经典梵文定义缺乏精确的文本描述，这限制了传统文本条件图像生成模型的有效性。因此，需要一种能够生成具有精确协调性、解剖学有效性和文化细微差别的复杂双手交互手势的方法，以促进舞蹈文化遗产的保存和传播。

Result: 实验结果表明，MudraGen在视觉真实性、解剖学正确性和精细手部姿态结构的保持方面超越了现有的最先进生成方法，能够忠实地再现复杂的Samyukta Hasta手势。

Insight: 论文的创新点在于为条件扩散模型引入了多层次的几何感知监督（关键点对齐、双手空间连贯性和解剖学正则化），以在低资源、缺乏精确文本描述的场景下，生成解剖学合理、协调一致且具有文化根基的复杂双手交互手势。这为文化遗产的数字化保存和教育应用提供了新的技术思路。

Abstract: Automatic generation of hand gestures is essential for the transmission of Indian classical dance and critical for its preservation. Indian classical dance gesture datasets are inherently low-resource, and the canonical Sanskrit definitions of many mudras lack precise textual descriptions, limiting the effectiveness of conventional text-conditioned image generation models. We present \textbf{MudraGen}, a conditional diffusion framework that synthesizes realistic RGB images of \textit{Samyukta Hasta Mudras} – interactive two-hand gestures from Bharatanatyam (an Indian classical dance form). Unlike prior work on simple hand signs or single-hand gestures, MudraGen introduces geometry-aware supervision to capture the precise coordination, anatomical validity, and cultural nuance of interacting hands. We formulate three geometry-aware objectives: Keypoint Loss for 3D joint alignment, Joint Offset Loss for inter-hand spatial coherence, and Shape Consistency, which serves as an anatomical regularizer by encouraging consistent hand morphology while allowing independent hand poses. Together, these objectives guide the diffusion model toward anatomically plausible and well-coordinated hand configurations, enabling the synthesis of photorealistic and pose-accurate gesture images. Experimental results show that MudraGen surpasses existing state-of-the-art generative approaches in visual realism, anatomical correctness, and preservation of fine hand-pose structure, enabling faithful reproduction of complex Samyukta Hasta mudras. Beyond quantitative gains, its ability to generate culturally grounded and structurally consistent gestures highlights practical applications in cultural preservation and dance education.

[50] When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals cs.CVPDF

Wonbin Son, Gyumun Choi, Junil Seo, Seungmin Rho, Mi Young Lee

TL;DR: 本文提出了一种无需图像输入的视觉语言模型（VLM）对象令牌编辑评估协议，用于探究冻结VLMs何时会对对象级别的令牌编辑做出响应。该方法将图像抽象为对象令牌集，在模型输入前进行编辑，并通过一个无需标注答案的协议来评估编辑效果。研究发现，响应能力依赖于明确的编辑教学、令牌的清洁度和场景密度，且该令牌路径能保留大部分原始VQA性能。

Details

Motivation: 解决传统VLM场景假设查询（通常通过文本注入或生成模型重绘）的局限性，探索在表示层（即模型输入前）对对象令牌进行编辑的有效性，并回答冻结VLMs何时能对此类编辑做出响应这一开放性问题。

Result: 在iSAID和VRSBench两个遥感数据集及三个冻结LM骨干上的实验表明，使用检测器+分割器生成的令牌与真实（oracle）令牌性能相当，且在VRSBench上表现更优；图像无关的令牌路径保留了匹配的补丁令牌基线92-96%的自由文本VQA性能。

Insight: 创新点在于提出了一个无需答案标注的评估协议，能逻辑推断编辑效果并进行自审计；关键发现是VLMs对令牌编辑的响应需要明确的编辑教学来激活，且受令牌清洁度和场景密度调控，同时证明了‘阅读’（即从令牌中提取信息）是一个可分离的能力维度。

Abstract: Answering what-if queries about a scene with a VLM usually means injecting the assumption as text or repainting the scene with a generative model. We instead move the edit to the representation level, before the model input. The image is abstracted into a set of object-level tokens, and the original image never enters the VLM. This design rests on an open question: when do frozen VLMs actually respond to such token edits? We introduce an answer-key-free protocol: no post-edit answer is annotated. It scores edits whose answers are logically determined, and audits itself by reversing each scoreable choice. The protocol reveals three structures. The response is not free: explicit edit teaching, not ordinary VQA training, produces it in dense scenes and multiplies it in sparse ones, on all three operations. Once on, it is governed by token cleanliness and density, with deployable detector+segmenter tokens competitive with the oracle and outperforming it on VRSBench. And reading is a separable axis: the image-free token route preserves 92-96% of a matched patch-token baseline’s free-text VQA, and the answers measurably depend on the tokens. The response, cleanliness, and reading structures are sign-preserved across two remote-sensing datasets (iSAID, VRSBench) and three frozen LM backbones. We release the probe generator, records, judge logs, and code.

[51] Preserving Knowledge across Space and Time for Continual Video Deepfake Detection cs.CVPDF

Taehoon Kim, Jongwook Choi, Heejae Jo, Byungmin Park, Jongwon Choi

TL;DR: 本文提出了一种持续视频深度伪造检测框架MSFD，通过将视频特征在频域分解为空间、时间和时空模态，并独立保留每种模态的知识，以应对不断出现的新型视频伪造模式。

Details

Motivation: 现有基于图像的深度伪造检测方法无法捕捉视频特有的时空线索，而视频伪造在空间和时间轴上均留下独特痕迹，需要在连续模型更新中分别保留各模态知识。

Result: 在多种持续视频深度伪造场景的广泛实验中，MSFD框架在适应性和性能保持方面均优于现有最先进方法。

Insight: 创新点在于将视频特征在频域进行模态分解以实现独立知识保留，并引入跨模态去相关损失使时空表示与单模态线索保持正交，从而更有效地处理视频特有的时空伪造证据。

Abstract: The continuous emergence of high-quality video deepfakes requires detectors that continually adapt to new forgery patterns, yet existing approaches, which are designed for deepfake images, fail to capture video-specific cues. Unlike deepfake images that contain only spatial artifacts, deepfake videos leave distinct evidence along both spatial and temporal axes, necessitating the separate preservation of each modality during sequential model updates. To overcome this limitation, we introduce a continual deepfake video detection framework, Modality-Specific Frequency Distillation (MSFD), that explicitly decomposes video features into spatial, temporal, and spatiotemporal modalities in the frequency domain. This decomposition enables independent preservation of each modality, as different deepfake video types exhibit varying reliance on spatial and temporal cues across tasks. Furthermore, MSFD adopts a cross-modality decorrelation loss that encourages spatiotemporal representations to remain orthogonal to single-modality cues. Extensive experiments show that our framework achieves stronger adaptation and preserves performance more effectively than state-of-the-art methods across diverse continual deepfake video scenarios.

[52] When Depth Hurts: Reliability-Aware Geometry Distillation for Depth-Free RGB-D Salient Object Detection cs.CVPDF

Xuehao Wang, Jiaxin Hua, Runmei Li, Zhenyu Wu, Chenglizhao Chen

TL;DR: 本文提出了一种可靠性感知的几何蒸馏框架（RAGD），用于RGB-D显著目标检测（SOD）。该方法在训练和推理阶段均不使用数据集提供的深度图，而是利用一个冻结的Depth Anything V2模型作为教师，将几何信息蒸馏到一个紧凑的边缘感知几何分支中，最终得到一个仅需RGB输入的推理网络。

Details

Motivation: RGB-D SOD中传感器深度图的质量并不总是可靠的，其缺失区域、模糊边界和结构伪影会通过多模态融合传播，导致RGB-D检测器性能甚至可能比纯RGB检测器更差。现有方法虽能调节观测深度，但仍依赖同一可能缺陷的模态。

Result: 在36个指标-数据集对比中，该方法在26项上取得了最佳或并列最佳结果，例如在ReDWeb-S数据集上相对MAE降低了13.4%。当在DUTS-TR上重新训练后，其在PASCAL-S上的F-measure比先前最强方法提升了4.2%，表明蒸馏的几何信息具有跨传感器和数据集领域的泛化能力。

Insight: 核心创新在于提出了一种不依赖真实深度图的可靠性感知几何蒸馏框架，通过教师模型（Depth Anything V2）在训练时传递几何先验，并利用像素级可靠性估计器选择性地注入与当前RGB表示兼容的几何信息，最终实现了一个高性能的纯RGB推理模型，避免了低质量深度图的负面影响。

Abstract: Depth can resolve appearance ambiguity in RGB-D salient object detection (SOD), yet sensor depth is not uniformly reliable. Missing regions, blurred boundaries, and structural artifacts can propagate through multimodal fusion and make an RGB-D detector less accurate than its RGB-only counterpart. Existing quality-aware approaches regulate observed depth but remain dependent on the same potentially defective modality. We propose \method, a reliability-aware geometry distillation framework developed for RGB-D SOD benchmarks without using dataset-provided depth during training or inference. A frozen Depth Anything V2 model serves only as a training-time teacher, transferring dense relative geometry, hierarchical spatial attention, and boundary structure to a compact edge-aware geometry branch. Pooled bidirectional interaction aligns geometry with appearance, and a pixel-wise reliability estimator selectively injects geometry that is compatible with the current RGB representation. The teacher is removed after training, leaving an RGB-only inference network. Trained on 2,985 RGB-mask pairs, \method{} achieves the best or tied-best result in 26 of 36 metric-dataset comparisons against ten recent RGB-D SOD methods, including a 13.4% relative MAE reduction on ReDWeb-S. When retrained on DUTS-TR, it also improves the strongest prior $F$-measure by 4.2% on PASCAL-S, showing that the distilled geometry transfers beyond a particular sensor or dataset domain. Code will be released upon publication.

[53] Preprocessing Failure and Adversarial Detection in Depthwise-Separable Edge Vision Systems cs.CV | cs.CRPDF

Jannatul Masruk Mukta, Rifa Sanjida, Adrita Rahman Tory, Md. Saifur Rahman, Khondokar Fida Hasan

TL;DR: 本文评估了六种基于预处理的防御方法在残差网络和深度可分离卷积网络（边缘视觉系统主流架构）上对抗对抗性扰动的效果，发现深度可分离架构的恢复能力普遍较差，而残差架构仅能部分恢复。这一失败结果揭示了预处理防御在两类架构间存在性能差异，并进一步指出这种差异可用于对抗性样本检测，而无需重新训练或修改架构。

Details

Motivation: 当前基于预处理的防御方法评估主要基于残差或Inception类架构，而边缘部署中广泛使用的深度可分离卷积网络（如MobileNet、EfficientNet）的安全性评估存在空白，本文旨在填补这一文献缺口。

Result: 在所有测试的扰动水平和防御方法下，两种深度可分离架构（MobileNetV2、EfficientNetB0）的恢复能力持续较差，而残差架构（ResNet50）仅表现出部分恢复；结果表明这是架构性而非参数性原因，但评估仅限于三种架构和一种攻击家族。

Insight: 创新点在于揭示了预处理防御在深度可分离架构上的系统性失败，并利用这种失败导致的输出差异（干净样本预测被干扰而对抗样本预测基本不变）开发了一种无需重新训练或架构修改的对抗性检测机会；同时指出标准图像质量指标是防御效果评估的不可靠代理，为实践者提供了对抗性弹性边缘视觉部署的决策框架。

Abstract: Preprocessing-based defenses are the standard first-line response to adversarial attacks on edge vision systems, requiring no retraining, no architectural changes, and widely recommended as model-agnostic mitigations. Yet the foundational evaluations of these defenses were conducted on residual or Inception-class architectures, not on the depthwise-separable CNNs that dominate edge deployments. This untested assumption leaves a gap in the security evaluation literature. This paper closes that gap by evaluating six preprocessing defenses against adversarial perturbations across both architecture families. Across all perturbation levels and defenses tested, the two depthwise-separable architectures show consistently poor recovery while the residual architecture shows partial recovery; ablation results are consistent with an architectural rather than parametric explanation, though only three architectures and one attack family are evaluated. Crucially, this failure is not merely a negative result. The same output divergence that disqualifies preprocessing as a recovery mechanism reveals a detection opportunity: preprocessing consistently disrupts clean predictions while leaving adversarial predictions largely unchanged, an asymmetry that is directly measurable without retraining or architectural modification. We further show that standard image quality metrics are unreliable proxies for defense effectiveness, a methodological gap in current evaluation practice. A practitioner decision framework is provided for adversarially resilient edge vision deployment.

[54] Neural Video Compression Based on Deformable Temporal Alignment and Difference-aware Fusion cs.CV | cs.AIPDF

Chuyue Shan, Songlin Sun, Wang Chenwei, Shen Zihan

TL;DR: 本文提出了一种结合可变形时间对齐和差异感知空间选择性融合的神经视频压缩方法，旨在提升条件编码框架中时间上下文的质量。通过上下文感知时间对齐模块生成互补的时间上下文，并利用差异感知空间选择性融合模块自适应选择可靠信息并抑制错位，从而改善复杂运动、遮挡和高频纹理区域的压缩性能。

Details

Motivation: 现有基于条件编码的神经视频压缩方法主要从传播的参考特征构建时间上下文，但在复杂运动、遮挡和高频纹理区域容易受到运动估计和局部对齐误差的影响，导致时间信息不准确。

Result: 实验表明，该方法在率失真性能上相比DCVC-DC模型取得了一定的提升。

Insight: 创新点在于引入可变形对齐机制增强时间上下文的鲁棒性，并结合差异感知的空间选择性融合来动态整合可靠信息，这为处理视频压缩中的动态场景和错位问题提供了新思路。

Abstract: In conditional coding-based neural video compression, the quality of temporal context directly affects compression per- formance. Existing methods mostly construct context from prop- agated reference features, but they are vulnerable to motion esti- mation and local alignment errors in regions with complex mo- tion, occlusion, and high-frequency textures, resulting in inaccu- rate temporal information. To address this issue, this paper pro- poses a method combining deformable temporal alignment and difference-aware spatial selective fusion. A Context-aware Tem- poral Alignment Module is used to generate complementary tem- poral context, while a Difference-aware Spatial Selective Fusion module adaptively selects reliable temporal information and sup- presses misalignment. Experiments show that the proposed method achieves certain rate-distortion performance improve- ment over DCVC-DC.

[55] SafeRI: Recognition and Intervention for Token-Level Safety Intervention in Large Vision Language Models cs.CVPDF

Caoyuan Ma, Tian Gu, Wenpu Liu, Weichu Xie, Shuai Dong

TL;DR: 本文提出SafeRI框架，用于大型视觉语言模型（VLM）的令牌级安全干预。该方法通过轻量级识别器实时判断生成状态是否安全，并动态门控LoRA模块的激活，仅在检测到不安全时进行干预，从而避免对安全生成的干扰，保持模型原有的多模态能力。

Details

Motivation: 现有VLM安全对齐方法通常全局修改模型行为，导致对安全和不安全生成均进行干预，这可能不必要地扰动模型的原始推理路径并降低其通用多模态能力。作者认为安全对齐应是一种按需干预，而非对每条解码轨迹的永久修改。

Result: 在多个安全和通用基准测试上的实验证明了该方法在后对齐设置下的有效性，能够在保持模型通用能力的同时提升安全性。

Insight: 创新点在于提出了流式识别与门控LoRA框架，实现了令牌级的按需安全干预；其核心是将安全对齐从全局、持续的修改转变为动态、条件触发的干预，这有助于在提升安全性的同时最小化对模型原有能力的负面影响。

Abstract: Existing safety alignment methods for vision-language models usually modify the model behavior globally: once the safety parameters are trained or loaded, they participate in both unsafe and already-safe generations. This always-on intervention can unnecessarily perturb the model’s original reasoning path and degrade general multimodal capabilities. We argue that safety alignment should be an on-demand intervention rather than a permanent modification to every decoding trajectory. To this end, we propose a streaming recognition and gated LoRA framework for intrinsic VLM safety. During autoregressive generation, a lightweight recognizer estimates whether the current pre-token generation state is safe or unsafe. Its output updates the LoRA gate for the following decoding step; otherwise, generation follows the frozen-backbone policy. The LoRA module is trained from unsafe prefixes, transition statements, and safe continuations, so that it learns to redirect unsafe generations back to safe responses after activation. Experiments across multiple safety and general-purpose benchmarks demonstrate the effectiveness of our method in post-alignment settings.

[56] Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation cs.CV | cs.GRPDF

Haoyu Wang, Songchun Zhang, Haoran Li, Haoyang Huang, Zeyue Xue

TL;DR: 本文提出了一种基于Unreal Engine的大规模合成数据生产流水线，用于生成动作条件化、多视角的视频数据，以解决世界模型预训练所需的高质量、动作对齐数据的获取难题。该流水线采用两阶段架构，分离实时物理模拟与高质量离线渲染，并围绕核心流程构建了包含分布式任务调度、自动化筛选与监控的完整生产系统。

Details

Motivation: 动机在于动作条件化视频模型需要大规模视觉数据与精确时间对齐的控制信号配对，而这种监督信息难以从普通真实世界视频中获取，因为导致每个视觉变化的动作通常是未知的。

Result: 该系统已在包含25台服务器（每台配备8块NVIDIA RTX 5090 GPU）的生产集群上运行，从2,384个资产包中筛选出429个关卡和40个人形角色池，已产出2,691小时的1080p视频和6,076小时的720p视频，构成了EchoWM项目中的Unreal Engine合成数据生产组件。

Insight: 创新点在于设计了两阶段（实时物理记录与离线高质量渲染）的合成数据生成流水线，并构建了包含缓存感知任务分区、节点本地槽调度、自动化场景筛选与健康监控的分布式生产系统，为世界模型数据策划提供了可扩展的工程解决方案，同时指出了使用感知质量代理进行数据策展的局限性。

Abstract: Action-conditioned video models require large-scale visual data paired with control signals that are temporally aligned with the resulting scene transitions. Such supervision is difficult to obtain from ordinary real-world video because the actions that caused each visual change are typically unknown. We present a large-scale synthetic data production pipeline built on Unreal Engine for generating action-conditioned, multi-view video. To accommodate the different execution requirements of real-time physics and high-quality offline rendering, the pipeline executes trajectory generation and final rendering in two stages: Stage I runs real physics in PIE and records per-frame character states, control inputs, and camera states into an intermediate trajectory representation; Stage II replays those trajectories in a new engine process and renders them offline with Movie Render Queue (MRQ). Around this core, we develop a distributed production system with cache-aware task partitioning, node-local slot scheduling, automated scene screening, aesthetic and luminance filtering, partial-output recovery, asynchronous upload, and continuous cluster health monitoring. The production cluster contains 25 servers with eight NVIDIA RTX 5090 GPUs per server. From 2,384 asset packs, 429 levels were retained for production together with a pool of 40 humanoid characters. The pipeline has produced 2,691 hours of 1080p video and 6,076 hours of 720p video. We describe the system architecture, the implementation decisions that emerged from production failures, and the limitations of using perceptual quality proxies for world-model data curation. The pipeline described in this report constitutes the Unreal Engine synthetic-data production component used in EchoWM.

[57] FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow cs.CVPDF

Byeongjun Park, Byung-Hoon Kim, Hyungjin Chung

TL;DR: FlashRender是一个少步生成式渲染框架，能够在几秒钟内根据目标相机轨迹重新渲染源视频。它通过表示变换与对齐（RETA）解决现有多步生成模型中采样步长依赖的相机控制不一致性问题，从而降低去噪轨迹曲率，并结合MeanFlow目标和策略内流图蒸馏进行微调，最终在极低采样成本下实现高质量、几何一致的视频渲染和优异的相机可控性。

Details

Motivation: 现有基于扩散模型的多步生成式渲染方法存在采样步长依赖的相机控制不一致性，这是离散化误差的显著表现，导致去噪轨迹曲率高，难以进行有效的步数蒸馏，限制了实时渲染的效率和质量。

Result: 在大量实验中，该方法在视频质量和几何一致性上匹配了多步基线模型，同时将采样成本降低了25倍，并且在分布外目标相机轨迹下仍能实现卓越的相机可控性。

Insight: 核心创新在于提出了RETA模块，通过将源视频的隐表示与冻结的视觉几何模型提取的目标视频特征对齐，直接在源视频流中编码几何变换，实现了采样步长一致的相机控制；结合MeanFlow目标在低曲率轨迹上微调，以及策略内流图蒸馏纠正自展开误差，三者协同作用，有效解决了少步生成渲染中的离散化误差和可控性问题。

Abstract: We present FlashRender, a few-step generative rendering framework that retakes a source video along a target camera trajectory in seconds. We identify sampling-step-dependent camera control as a prominent manifestation of discretization error in existing multi-step generative rendering models and show that resolving this inconsistency substantially lowers denoising trajectory curvature, facilitating subsequent step distillation. To this end, we introduce Representation Transformation and Alignment (RETA), which aligns hidden source-video representations with target-video features from a frozen visual geometry model. This directly encodes the geometric transformation within the source-video stream, enabling sampling-step-consistent camera control. We then fine-tune the model with the MeanFlow objective on the lower-curvature denoising trajectory induced by RETA, allowing the model to more effectively address discretization error. Finally, we apply on-policy flow map distillation to correct self-rollout errors under fixed few-step sampling. Extensive experiments show that RETA, MeanFlow, and on-policy flow map distillation play complementary roles in few-step generative rendering. Together, they enable our approach to match multi-step baselines in video quality and geometric consistency at 25x lower sampling cost while achieving superior camera controllability, even under out-of-distribution target camera trajectories.

[58] Occlusion-Robust Multimodal Emotion Recognition in VR via Fusion of Facial Images and EMG cs.CV | cs.HCPDF

Birgit Nierula, Karam Tomotaki-Dawoud, Mert Akguel, Mustafa Tevfik Lafci, David Przewozny

TL;DR: 本文针对虚拟现实（VR）中头戴式显示器（HMD）遮挡上半脸导致传统基于图像的面部表情分析不完整的问题，提出了一种融合下半脸视频和被遮挡上半脸面部肌电图（EMG）的多模态情绪识别方法。该方法通过提出的后期融合架构，在受试者无关测试中实现了51%的宏F1分数，优于仅使用图像或仅使用EMG的基线模型。

Details

Motivation: 解决VR中因HMD遮挡上半脸而导致传统图像分析方法失效，无法进行实时情感评估的挑战。

Result: 在提出的同步多模态数据集上进行受试者无关测试，所提的后期融合架构（卷积视觉嵌入与RBF核EMG表示融合）实现了51%的宏F1分数，优于仅图像（41%）和仅EMG（43%）的基线，证明了其有效性。

Insight: 创新点在于利用被遮挡区域（上半脸）的EMG信号作为视觉信息的补充，通过多模态融合克服了VR环境中的视觉遮挡问题，为自然VR环境中的情感识别奠定了基础。

Abstract: Head-mounted displays (HMDs) fundamentally limit emotion recognition in virtual reality (VR): by occluding the upper face, they render conventional image-based facial expression analysis incomplete, particularly for applications requiring real-time affective assessment. We address this challenge by fusing lower-face video with facial electromyography (EMG) from the occluded upper face to classify seven emotional categories (six basic emotions plus neutral). We introduce a synchronized multimodal dataset from 20 participants, pairing lower-face video with seven-channel upper-face EMG elicited by validated emotion stimuli. Under subject-independent test, our proposed late-fusion architecture merging convolutional visual embeddings with RBF-kernel EMG representations achieves 51% macro-F1, outperforming both image-only (41%) and EMG-only (43%) baselines. These results demonstrate that upper-face EMG provides robust complementary information under HMD-induced visual occlusion and establish a foundation for multimodal emotion recognition in naturalistic VR environments. This approach facilitates affect-adaptive applications, including communication training and therapeutic interventions. The dataset will be shared upon request under an ethical-use agreement.

[59] Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving cs.CVPDF

Zhaoxin Fan, Tianbao Zhang, Wenjun Wu, Xiaofeng Wang, Yeying Jin

TL;DR: 本文提出了Drive-HWM，一个用于自动驾驶的分层慢-快世界模型框架。该框架通过在不同时间尺度上组织未来表示预测和动作生成，旨在同时实现长时程的场景预测和基于即时观测的响应式决策。

Details

Motivation: 现有自动驾驶世界模型方法要么将未来预测与动作生成分离，要么在相同时间尺度上联合预测，难以兼顾长时程预测和响应式、基于观测的决策。本文旨在解决这一矛盾。

Result: 在NAVSIM v1和v2基准测试上的大量实验表明，Drive-HWM具有强大的驾驶性能。全面的消融研究进一步验证了其分层慢-快设计、动态感知的未来表示以及联合下一帧和动作预测的有效性。

Insight: 核心创新在于分层慢-快世界建模范式，其中慢模型预测多步未来表示以捕获长时程场景演化，并引入了通过光流预测学习的动态感知潜在变量；快模型则利用轻量级多模态主干和自回归专家，在慢模型未来表示的引导下，联合预测下一帧和即时动作，实现了决策的持续更新。

Abstract: World models offer a promising paradigm for autonomous driving by predicting how traffic scenes may evolve and using such predictions to support action generation. However, existing approaches either separate future prediction from action generation or jointly predict them at the same temporal scale, making it difficult to simultaneously achieve long-horizon anticipation and responsive, observation-grounded decision making. We present Drive-HWM, a hierarchical slow–fast world modeling framework that organizes future representation prediction and action generation at complementary temporal scales. The slow world model predicts multi-step future representations to capture extended scene evolution. To explicitly model the abundant motion dynamics in driving environments, we introduce Dynamic-Aware Latents learned through optical-flow prediction. Guided by these future representations, the fast model uses a lightweight multimodal backbone and an autoregressive expert to jointly predict the next frame and the immediate action from the latest observation. Next-frame prediction encourages the fast model to capture imminent scene evolution, while one-step action generation allows decisions to be continuously updated as new observations arrive. Extensive experiments on NAVSIM v1 and v2 demonstrate the strong driving performance of Drive-HWM. Comprehensive ablation studies further validate the effectiveness of the hierarchical slow–fast design, dynamics-aware future representations, and joint next-frame and action prediction.

[60] SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving cs.CV | cs.ROPDF

Jinyang Wang, Shiwei Li, Junjian Wang, Zhiqiang Deng, Jianbin Gao

TL;DR: 本文提出SV-WAM，一种高效的环视世界-动作模型，用于端到端自动驾驶。该方法通过共享生成模型，利用未来视频预测作为动作学习的密集监督，但在推理时丢弃视频分支，从而在保持六摄像头环视输入的同时实现高效推理。模型还引入了可微分的可行驶区域合规正则化器以提升规划安全性。

Details

Motivation: 现有驾驶世界模型为追求推理效率，通常仅使用单前视摄像头输入，这限制了在变道、汇入和转弯等关键场景的空间覆盖。本文旨在设计一个既能保留完整环视观测，又能保持高效推理的模型。

Result: 在闭环NAVSIMv2基准测试和开环nuScenes基准测试上的大量实验表明，SV-WAM实现了最先进的规划性能，同时具有低推理延迟和竞争力的零样本迁移能力。

Insight: 核心创新在于提出了一个以动作为中心的因果掩码，在联合动作-视频去噪过程中阻止动作令牌关注未来视频令牌，从而允许在部署时仅保留动作规划分支。此外，可行驶区域合规正则化器通过惩罚车辆边界接近或跨越可行驶区域边界，提升了规划的安全性和边界意识。

Abstract: World models (WMs) have demonstrated strong potential for end-to-end autonomous driving by learning predictive representations of future scene dynamics. However, generating future videos during inference introduces substantial computational overhead, leading many recent driving WMs to adopt a single front camera as input for efficient deployment. This design restricts spatial coverage in safety-critical maneuvers such as lane changes, merges, and turns. To address this limitation, we propose SV-WAM, a surround-view world-action model (WAM) that preserves full six-camera observations while maintaining efficient inference. SV-WAM leverages future-video prediction as dense training supervision for action learning within a shared generative model, rather than as an inference-time output. At the core of this design is an action-centered causal mask that prevents action tokens from attending to future-video tokens during joint action-video denoising. Consequently, the video branch can be discarded at deployment, enabling efficient action-only planning. Furthermore, we introduce a differentiable drivable-area compliance regularizer that penalizes vehicle-footprint corners approaching or crossing drivable boundaries, improving planning safety and boundary awareness. Extensive experiments on the closed-loop NAVSIMv2 benchmark and the open-loop nuScenes benchmark demonstrate that SV-WAM achieves state-of-the-art planning performance with low inference latency and competitive zero-shot transfer capability.

[61] EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders cs.CV | cs.AIPDF

Xinghao Wang, Dong Li, Wei Yu, Yingwei Pan, Tao Gong

TL;DR: 本文提出EraseSAE框架，利用稀疏自编码器对基于DiT的文本到视频扩散模型进行精细化的概念擦除。该方法通过分解-归因-擦除的流程，将密集的时空激活分解为可解释的稀疏特征，并通过对比归因机制定位特定概念的特征核，在推理时使用基于时间步的时空掩码进行精准擦除，在保证生成质量的同时有效移除目标概念。

Details

Motivation: 现有的文本到视频扩散模型依赖于粗筛选的训练数据，引发了安全和版权问题。现有概念擦除方法粒度较粗，与概念表示的细粒度、分布式特性不匹配，导致擦除不彻底或生成质量下降。本文旨在通过干预单语义特征层面，实现精细化的概念擦除。

Result: 在多种扩散模型和概念擦除任务上的大量实验表明，EraseSAE能够以最小的质量损失实现精确且鲁棒的概念移除，性能显著优于现有最先进方法。

Insight: 创新点在于提出了一个基于稀疏自编码器的分解-归因-擦除流程，特别是引入了分区卷积稀疏自编码器来分解并保持时空一致性的稀疏特征，以及使用对比归因和时间步解析的时空掩码进行精准干预，实现了对模型内部概念表示的精细外科手术式编辑。

Abstract: Recent advances in text-to-video (T2V) diffusion models have demonstrated remarkable generative capabilities, yet their reliance on loosely curated training data raises pressing safety and copyright concerns. Concept erasure offers a principled remedy by removing unwanted semantics from pretrained models while preserving remaining concepts. However, existing approaches typically operate at a coarse granularity misaligned with the fine-grained, distributed nature of concept representations, leading to incomplete removal or degraded generation quality. We argue that surgical erasure fundamentally requires intervention at the level of monosemantic features, where each unit encodes a single interpretable concept. To this end, we propose EraseSAE, a novel framework that leverages sparse autoencoders to achieve surgical concept erasure in DiT-based T2V diffusion models via a principled decompose-attribute-erase pipeline. We first introduce the Partitioned Convolutional Sparse Autoencoder, which decomposes dense spatiotemporal activations into disentangled, interpretable sparse features while preserving spatiotemporal coherence. A contrastive attribution mechanism then contrasts activations from paired prompts to isolate concept-specific feature kernels. At inference, timestep-resolved spatiotemporal masks derived from the identified kernels confine erasure to regions where the target concept is active, leaving unrelated content intact. Extensive experiments across diverse diffusion models and concept erasure tasks demonstrate that EraseSAE achieves precise and robust concept removal with minimal quality degradation, substantially outperforming state-of-the-art methods. The code is available at https://github.com/HiDream-ai/EraseSAE.

[62] Stabilizing Camera-Controlled Novel View Synthesis at Inference Time cs.CVPDF

Prajwal Singh, Arjun Badola, Seema Kumari, Hajime Nagahara, Shanmuganathan Raman

TL;DR: 本文提出了一种无需训练、基于推理时相机运动控制的单图像新视角合成方法CamTrol++。该方法通过将大范围相机运动分解为小的自回归步骤来限制几何畸变和误差累积，并结合几何约束空间注意力、低频外观锚定以及免配准的扭曲流水线作为辅助改进。

Details

Motivation: 现有基于预训练视频扩散模型的免训练、相机控制单图像新视角合成方法在大相机运动和长生成序列下往往不稳定，且现有方法通常结合多种推理时组件，难以确定哪些设计选择对稳定性最关键。

Result: 在RealEstate10K和MegaScene数据集上，CamTrol++在时间与几何一致性、下游3D重建质量和生成效率方面优于免训练基线方法，在56帧生成和深度信息严重损坏的情况下仍保持有效。

Insight: 核心创新在于揭示了推理时相机运动控制是稳定性的主要来源，即通过小步长自回归分解相机运动来限制几何畸变；同时，几何约束空间注意力和低频外观锚定作为有效的辅助改进手段，整个方法无需重新训练或修改扩散模型主干。

Abstract: Training-free, camera-controlled novel view synthesis from a single image using pre-trained video diffusion models often becomes unstable under large camera motion and long generation horizons. Existing approaches commonly combine several inference-time components, making it unclear which design choices are most important for stability. We show that the main source of stability is simple. Decomposing camera motion into small autoregressive steps limits per-step geometric distortion and reduces error accumulation. A controlled camera-step study shows that performance remains stable for small motions and degrades more strongly as the per-step motion approaches $18$-$20^\circ$. We further evaluate geometry-constrained spatial attention and low-frequency appearance anchoring as supporting refinements, together with an efficient registration-free warping pipeline. Across RealEstate10K and MegaScene, CamTrol++ improves temporal and geometric consistency, downstream 3D reconstruction quality, and generation efficiency over training-free baselines. The method remains effective for 56-frame generation and under substantial controlled depth corruption. These results show that careful control of camera motion at inference time can substantially improve the stability of camera-controlled novel view synthesis without retraining or modifying the diffusion backbone.

[63] Tree-Structured Vector Quantization For Efficient And Progressive Image Compression cs.CVPDF

Xinkun Wang, Tianyi Xu, Qingyu Luo, Mingming Ma, Changzhe Jiao

TL;DR: 本文提出了一种名为Tree-VQ的渐进式树结构向量量化框架，用于学习型图像压缩。该方法将离散码字组织为层次化二叉树，通过根到叶的路径表示每个潜在令牌，使得每个路径前缀都对应有效的量化表示，从而实现从低质量到高质量的渐进解码，无需为不同目标比特率重新编码。

Details

Motivation: 现有基于向量量化的图像压缩方法虽能实现可变码率，但通常无法生成渐进式比特流（即前缀本身可解码并能通过追加比特逐步细化），这限制了其在流式传输等场景中的应用。

Result: 实验表明，Tree-VQ在性能与效率之间取得了优越的权衡，在感知压缩结果上达到最佳，同时比竞争方法参数更少、延迟更低。

Insight: 创新点在于将向量量化与树形结构结合，通过前缀兼容的树熵模型、码率感知的细化调度和层次化前缀监督，实现了真正的渐进式压缩，提升了压缩的灵活性和解码效率。

Abstract: Vector-quantization based image compression has achieved strong rate–distortion performance, yet most of them still produce a separate compressed representation for each target bitrate. Such variable-rate behavior allows one model to operate at multiple rates, but it does not necessarily provide a progressive bitstream whose prefixes are themselves decodable and can be refined by appending additional bits. We propose \textbf{Tree-VQ}, a progressive tree-structured vector quantization framework for learned image compression. Tree-VQ organizes discrete codewords as a hierarchical binary tree and represents each latent token by a routed root-to-leaf path. Crucially, every prefix of this path corresponds to a valid quantized representation, so shallow internal nodes serve as coarse reconstruction codes and deeper nodes provide successive refinements. This allows a compressed image to be decoded from an early prefix and progressively improved as more branch symbols are received, rather than being re-encoded for different target rates. To make this structure practical for compression, we introduce a prefix-compatible tree entropy model that codes progressive continuation decisions and routed branch refinements using only causally available decoded contexts. We further use rate-aware refinement scheduling to decide which spatial blocks should receive additional tree bits under a given prefix budget, and hierarchical prefix supervision to ensure that internal nodes are directly decodable at low rates. Experiments show that Tree-VQ achieves a superior performance–efficiency trade-off, delivering the best perceptual compression results with much fewer parameters and lower latency than competing methods.

[64] PL-SCEA: Reconfiguring Pretrained Attention for Few-Shot Industrial Anomaly Detection cs.CVPDF

Xiaoyu Yang, Qixing Wu, Huixian Zhao, Changlong Jin

TL;DR: 本文提出PL-SCEA方法，通过重新配置预训练视觉基础模型的注意力机制，以增强少样本工业异常检测中的异常定位能力。该方法在保留语义上下文的同时，构建基于上下文化值特征的token自适应自相关，并通过正相关过滤和幂律重加权突出显著关系，无需引入可训练的注意力投影。最终结合轻量级变分自编码器进行重建建模，在MVTec AD和VisA数据集上实现了竞争力的图像级检测和像素级定位性能。

Details

Motivation: 预训练视觉基础模型的注意力计算通常继承自以语义聚合为中心的预训练目标，这可能与异常检测所需的局部纹理和结构偏差暴露不匹配，因此研究如何将冻结VFM的注意力计算重新配置为任务相关的异常检测组件。

Result: 在MVTec AD和VisA数据集上的少样本设置中，完整框架实现了竞争力的图像级检测和一致的强像素级定位；消融实验表明PL-SCEA在测试设置下无论与VAE还是记忆库结合都能提升定位性能。

Insight: 创新点在于提出无需额外可训练参数的注意力重配置机制（PL-SCEA），通过正相关过滤和幂律重加权增强局部关系偏差表示；客观分析认为该方法展示了任务对齐的注意力重配置可以提升冻结预训练表示的异常定位能力，为利用预训练模型进行特定下游任务提供了新思路。

Abstract: Vision Foundation Models (VFMs) provide transferable patch representations for few-shot industrial anomaly detection, but their attention computation is typically inherited from pretraining objectives centered on semantic aggregation. This creates a potential mismatch: token relations that support semantic recognition may not adequately expose the localized texture and structural deviations required for anomaly localization. We therefore investigate the hypothesis that the attention computation of a frozen VFM can be reconfigured as a task-relevant component of anomaly detection. We instantiate this idea with Power-Law Self-Correlation Enhanced Attention (PL-SCEA), which retains the semantic context of pretrained query-key attention while constructing token-adaptive self-correlations over contextualized value features. Positive-correlation filtering and power-law reweighting then emphasize relations that are salient relative to each token’s relational background, without introducing additional trainable attention projections. The resulting features are modeled by a lightweight variational autoencoder that provides a fixed-size reconstruction-based representation of category-specific normality. The two stages serve complementary roles: attention reconfiguration shapes how local relational deviations are represented, while reconstruction-based modeling converts deviations from learned normality into anomaly scores. Across MVTec AD and VisA, the complete framework achieves competitive image-level detection and consistently strong pixel-level localization across the evaluated few-shot settings. Ablations further show that PL-SCEA improves localization with either the VAE or a memory bank under the tested setting. These results support the view that task-aligned attention reconfiguration can improve the anomaly-localization capability of frozen pretrained representations.

[65] Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations cs.CVPDF

Onat Şahin, Mohammad Altillawi, George Eskandar, Carlos Carbone, Ziyuan Liu

TL;DR: 本文提出了一种名为3D形态扰动（3D Morphological Perturbations）的无优化正则化方法，旨在解决NeRF和3D高斯溅射（3DGS）等3D场景表示在稀疏视图设置下产生严重伪影的问题。该方法将每个高斯视为基本构建块，通过尺度、旋转和剪枝在其形态参数空间施加扰动，从而在保持空间一致性的同时，无需进行昂贵的逐场景3DGS优化循环即可构建训练数据集。

Details

Motivation: 现有生成式3D伪影修复方法依赖于在不同视图配置下进行成本高昂的逐场景重建以获取成对的损坏和干净渲染数据，而2D图像增强方法虽然可作为即时正则化器，却缺乏能保持跨视图空间一致性的3D表示等效方法。本文旨在为3D表示提供一种能保持空间一致性的、无需优化的正则化方法。

Result: 在轻量级视频扩散沙箱的诊断消融实验中，该方法使模型学习到比稀疏视图基线更强的几何先验。通过ControlNet扩展到140亿参数视频模型后，该方法在保持视觉保真度的同时，将平均深度误差比最先进的图像到图像3D伪影精炼方法降低了12.5%，并在4个操作任务中的3个上，将下游机器人策略成功率提升了高达8.0%。

Insight: 创新点在于将3D高斯视为类似2D像素的基本构建块，并对其形态参数（尺度、旋转、剪枝）进行扰动，从而创造了一种专门针对3D表示、能保持空间一致性的无优化数据增强/正则化方法。这绕过了对成对数据的需求和逐场景优化的开销，有效提升了模型学习的几何先验和下游任务性能。

Abstract: 3D scene representations like NeRF and 3D Gaussian Splatting (3DGS) suffer severe artifacts in sparse-view settings. Recent generative 3D artifact fixers attempt to address this, but rely on paired corrupted and clean renders requiring costly, per-scene reconstructions across varying view configurations. While 2D image augmentations act as instant regularizers, no explicit equivalents exist for 3D representations to preserve spatial consistency across views, an essential property for 3D-aware training. We propose 3D Morphological Perturbations as an optimization-free regularizer that preserves spatial consistency. Leveraging explicit 3DGS, we treat each Gaussian as a fundamental building block - analogous to a 2D pixel - and apply perturbations across its morphological parameter space via scale, rotation, and pruning. Our method eliminates per-scene 3DGS optimization loops from dataset curation while enabling models to learn stronger geometric priors than sparse-view baselines in diagnostic ablations conducted on a lightweight video diffusion sandbox. Scaled to a 14B-parameter video model via ControlNet, our approach maintains visual fidelity while reducing mean depth error by 12.5% over state-of-the-art image-to-image 3D artifact refiners, ultimately boosting downstream robotics policy success rates by up to 8.0% across 3 of 4 manipulation tasks.

[66] Cross-Dataset Transfer and Reliability of Explainable Artificial Intelligence for RhythmFormer Remote Photoplethysmography cs.CV | cs.AI | eess.IVPDF

Louis Chen, Torbjörn E. M. Nordling

TL;DR: 本研究量化评估了用于远程光电容积描记法（rPPG）心率估计的RhythmFormer模型的可解释性方法，重点关注其跨数据集（NCKU-rPPG和UBFC-rPPG）的迁移性和可靠性。研究发现，Beyond Intuition方法在皮肤覆盖率和显著性引导忠实系数（SaCo）上表现最佳，但这些可解释性指标与模型性能指标（如心率误差）并非简单的代理关系，而是提供互补信息。

Details

Motivation: 远程光电容积描记法（rPPG）从面部视频估计心血管脉搏，但其可解释性通常依赖于定性热图检查，缺乏关于模型从何处读取信号的定量证据。本研究旨在量化这些解释，并探究这些解释是否能在不同数据集间迁移以及是否能追踪模型性能。

Result: 在NCKU-rPPG和UBFC-rPPG数据集上评估了多种可解释性方法。Beyond Intuition在两个数据集上均排名最高（例如，在静态光照3级下，中位覆盖率为0.789，SaCo为0.837；在UBFC-rPPG上分别为0.826和0.917）。然而，在单个参与者的单个条件下，可解释性指标与心率误差、波形相关性或信噪比均无显著关联。

Insight: 创新点在于首次对rPPG模型的可解释性进行了跨数据集的量化评估与可靠性分析。核心洞察是：可解释性指标（如皮肤覆盖率和SaCo）与模型性能指标是互补的而非替代的；归因于皮肤区域并不能保证估计准确；归因方法揭示的是模型关注的位置，而非其热图排序的忠实度。这为评估和理解rPPG模型的可解释性提供了新的定量框架和重要警示。

Abstract: Background. Remote photoplethysmography estimates the cardiovascular pulse from facial video, and its explanations have rested on inspecting heatmaps rather than on quantitative evidence about where a model reads it. We quantified the explanations and asked whether such explanations transfer between datasets and track model performance. Method. We trained eight condition-specific RhythmFormer models on NCKU-rPPG, recorded under three illumination levels, speaking, rotation, and cycling, estimated one heart rate per 5.12-second clip, and set them beside a UBFC-rPPG reproduction. Raw attention, rollout, attention flow, and Beyond Intuition were assessed by skin coverage and the Salience-guided Faithfulness Coefficient (SaCo). Results. Beyond Intuition ranked highest on both datasets, at median coverage 0.789 and SaCo 0.837 on Static level 3 against 0.826 and 0.917 on UBFC-rPPG; lower ranks differed. Within one participant of one condition, neither measure was related to a clip’s heart-rate error, waveform correlation, or signal-to-noise ratio on either dataset: 186 of the 252 coefficients fell below $|ρ|=0.10$ and 28 reached $p<0.05$ against the 13 expected by chance. Across the eight scenarios only Beyond Intuition’s coverage followed the three performance measures, at $ρ=-0.43$, $+0.57$, and $+0.43$, while the attention-only methods’ SaCo ran opposite to each. It failed at 40 lux alone, its median coverage falling to 0.180 and its median SaCo to $-0.178$, whereas motion degraded the estimates far more without such a drop. Conclusions. Skin coverage and SaCo carry information complementary to the performance measures rather than a proxy for them: attributing to the skin does not guarantee an accurate estimate. What an attribution reveals about a condition is where the model looks rather than how faithfully its map is ordered.

[67] Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation cs.CVPDF

Yingmao Miao, Pengfei Zhang, Chaoran Xu, Meng Yu, Jing Tang

TL;DR: 该论文针对视频生成模型在跨片段世界状态推理上的不足，提出了一个名为Statebench的基准测试，用于评估模型在给定历史视频和新提示下生成符合逻辑延续的能力。同时，论文提出了Stateagent方法，通过显式维护和更新实体状态表示来提升视频延续的连贯性和可控性。

Details

Motivation: 当前视频生成器通过组合短片段生成长视频，但其依赖的历史记忆（如帧、特征）主要保留可见证据，未能可靠地转化为对视频世界状态的推理。这导致模型难以生成与历史动作和新提示都逻辑一致的视频延续。

Result: 在提出的Statebench基准上，所提方法Stateagent将综合状态得分（SCS-All）从45.2提升至69.3，显著改善了可控视频延续的效果，并在一分钟尺度的故事生成任务中也展现出益处。

Insight: 创新点在于明确指出了视频生成中世界状态推理的缺失问题，并构建了专门的基准和解决方案。Stateagent通过显式建模和更新实体状态，并将其作为未来帧的约束，为生成更具逻辑连贯性的长视频提供了一种可借鉴的架构思路。

Abstract: Video generators build long videos by composing shorter parts, either by generating segments one after another or by autoregressively extending chunks. Each new part usually depends on memories of historical observations, such as recent frames, selected key frames, memory banks, or cached features. These memories preserve visible evidence from the past, but current generators do not reliably turn such evidence into a world-state interface: what holds in the video world after previous actions and how it should change under the next prompt. A past frame remains valid history, but it may not describe the state needed by the next segment; some states must instead be inferred from occluded or implicit changes rather than copied from a directly observed frame. This creates a simple but overlooked question for video continuation: given a previous video, its prompt, and a new prompt, can a model generate a continuation that reflects the state determined by both the historical video and the new prompt? To answer this question, we introduce Statebench, a benchmark that targets this gap by testing continuations over three state categories: past-visible states, occluded-process states, and complex-transition states. We further propose Stateagent, which explicitly maintains an entity-state representation, updates it under the new prompt, grounds the predicted post-action state as a future end frame, and renders the next video. Experiments show that our method improves controlled video continuation by raising the all-case state score (SCS-All) from 45.2 to 69.3, and also benefits story generation at the one-minute scale. Code is avaliable at https://github.com/AMAP-ML/StateAgent.

[68] CoFiE: Coarse-to-Fine Evidence Selection for Efficient Streaming Video Understanding cs.CVPDF

Jing Jiang, Yiran Ling, Ruonan Li, Dimitrios Stamoulis, Jie Liu

TL;DR: 本文提出了CoFiE框架，用于流式视频理解中的高效证据选择。该框架将证据选择解耦为两个阶段：在视觉编码器之前进行与查询无关的粗粒度过滤，以及在LLM预填充阶段进行与查询相关的细粒度精炼。这种方法在编码前就去除了大量冗余，从而显著降低了端到端延迟。

Details

Motivation: 现有方法主要通过视觉编码后的令牌剪枝和记忆库方案来提高效率，但昂贵的帧编码成本已经产生，仅靠下游令牌剪枝无法实质性减少端到端延迟。因此，需要一种在视觉编码前就减少冗余的方法。

Result: 实验表明，CoFiE在多个视频理解基准测试（如StreamingBench和OvO-Bench）上实现了新的最先进的准确率-效率权衡，准确率分别达到78.86%和68.72%，比先前方法提高了高达3.15%。即使过滤掉高达80%的证据帧，CoFiE仍优于强大的开源多模态模型，并将端到端推理延迟提高了高达2.54倍。

Insight: 主要创新点在于将证据选择解耦为粗粒度（基于视觉新颖性、查询无关）和细粒度（查询相关）两个阶段，在编码前就进行过滤以降低计算成本，同时保留语义信息可用后的精炼能力，从而在保持准确性的同时大幅提升效率。

Abstract: Streaming video understanding requires Vision Language Models (VLLMs) to process growing video streams and answer user questions under tight latency constraints. Existing methods improve efficiency through token pruning and memory-bank schemes, but mainly reduce visual tokens after visual encoding. Consequently, downstream token pruning alone cannot substantially reduce end-to-end latency because the expensive frame encoding cost has already been incurred. We propose CoFiE, a Coarse-to-Fine Evidence Selection framework that decouples evidence selection into a coarse, query-agnostic filtering stage before the vision encoder and a fine, query-specific refinement stage during LLM prefill. CoFiE introduces Novelty-Guided Frame Filtering to retain visually distinctive candidate frames and Query-Specific Evidence Refinement to select the frames most relevant to the user query. This design removes substantial redundancy before frame encoding while preserving query-specific refinement once semantic information becomes available. Experiments show that CoFiE establishes a new state-of-the-art accuracy-efficiency trade-off across multiple video understanding benchmarks, reaching 78.86% accuracy on StreamingBench and 68.72% on OvO-Bench, with improvements of up to 3.15% over prior methods. Even with up to 80% evidence-frame filtering, CoFiE outperforms strong open-source multimodal models while improving end-to-end inference latency by up to 2.54 times.

[69] DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data cs.CV | cs.ROPDF

Patrick Zimmer, Michael Halstead, Chris McCool

TL;DR: 本文提出了DropClick，一种用于农业机器人视觉数据分割的半自动化单点击标注工具。该系统通过用户对物体的单次点击生成伪标签，无需对场景中每个物体进行点击，从而大幅减少人工标注工作量。论文在SB20（植物分割）和BUP20（果实分割）两个农业机器人数据集上验证了其有效性，并展示了其作为伪标签方法在半监督训练中的潜力。

Details

Motivation: 解决农业机器人视觉数据分割任务中标注成本高昂、过程繁琐的问题，旨在简化标注流程并降低对密集人工点击的依赖。

Result: 在仅使用5张图像训练后，DropClick在SB20和BUP20数据集上分别达到70.0和72.6的mIoU，性能与现有单点击方法相当或更优；当50%的点击缺失时，mIoU仍保持在68.9和71.3。作为伪标签训练Mask2Former模型时，减少点击输入（节省46.3%和31.9%的点击量）仍能达到与全点击相近的性能（如SB20上AP50为70.1 vs 70.7）。

Insight: 创新点在于半自动化的单点击分割机制，允许用户省略部分物体的点击而不显著影响性能，实现了标注效率与质量的平衡；其小样本训练和伪标签生成策略为数据标注自动化提供了可扩展的解决方案。

Abstract: Labelling vision datasets, especially for segmentation tasks, is a laborious and costly process that stymies novel developments in agricultural robotics. In this paper, we present DropClick, a click-guided segmentation tool that simplifies the annotation process. Our system utilises single-click inputs on objects to generate pseudo-labels, which can replace manual annotations. DropClick stands out as it is a semi-automated approach and does not require a click for every object in the scene. It can therefore further reduce the required amount of user input drastically. We evaluate our method on two challenging agricultural robotic datasets, SB20 and BUP20 for plant and fruit segmentation, respectively. DropClick is first trained on a small subset of just 5 images from the original training data. This DropClick model can then be deployed as a one-click segmentation system and achieves comparable or higher performance than other one-click methods achieving an mIoU of 70.0 and 72.6 points, for SB20 and BUP20 respectively. DropClick then excels at maintaining high performance when clicks are not given (e.g. dropped); when 50% of the clicks are missing it still maintains an mIoU of 68.9 and 71.3 points, for SB20 and BUP20 respectively. We validate DropClick as a pseudo-labelling approach by taking its outputs to train a Mask2Former instance-based segmentation model in a semi-supervised manner. In this process, partially removing user input from DropClick yields similar high performance when compared to providing all clicks, at 70.1 vs 70.7 points AP50 for SB20 and no difference for BUP20 at 77.0 for both models; at the same time saving 46.3% of total input for SB20 and 31.9% for BUP20.

[70] MetaStructAtlas: A Grounded 3D Vision-Language Dataset and Benchmark for Functional and Structural Reasoning in Whole-Body PET/CT cs.CVPDF

Chenguang Zheng, Le Xue, Yichi Zhang, Wenbo Zhang, Zehui Ling

TL;DR: 本文介绍了MetaStructAtlas，一个用于全身PET/CT综合解释的大规模、多模态3D视觉-语言数据集，包含配对的PET/CT体积、器官级分割掩码和放射学报告。同时，作者提出了MetaStructVQA基准，一个标准化的3D视觉问答任务，用于评估模型在解剖、形态和代谢特征上的多模态推理能力。

Details

Motivation: 当前3D医学视觉-语言模型主要局限于区域CT成像，缺乏对全身PET/CT（结合代谢功能和解剖结构）的综合分析能力，这阻碍了临床诊断的进展。

Result: 作者在提出的MetaStructVQA基准上评估了最先进的3D医学视觉-语言模型，为核医学中的多模态表示学习和综合全身推理建立了坚实基础。

Insight: 创新点在于构建了首个大规模、具有grounding注释的全身PET/CT视觉-语言数据集和基准，明确将诊断查询与跨模态（PET和CT）的视觉证据联系起来，促进了功能与结构联合推理的研究。

Abstract: The joint interpretation of metabolic function and anatomical structure is essential for clinical diagnosis in whole-body PET/CT. Although recent advances in 3D medical vision-language models have demonstrated remarkable progress, current efforts are limited to regional CT imaging, leaving a critical void in comprehensive whole-body PET/CT analysis. In this work, we introduce MetaStructAtlas, a large-scale dataset for grounded whole-body PET/CT interpretation that synthesizes multimodal imaging with integrated anatomical, metabolic, and semantic annotations. MetaStructAtlas provides 490 co-registered 3D PET and CT volumes with 50,470 organ-level segmentation masks and grounded radiology reports. To facilitate interactive reasoning, we further developed MetaStructVQA, a standardized 3D grounded visual question-answering benchmark containing 100,565 QA pairs. This framework explicitly links diagnostic queries to visual evidence across modalities, encompassing anatomical, morphological, and metabolic characteristics. Finally, we evaluate state-of-the-art 3D medical VLMs on MetaStructVQA, establishing a robust foundation for multimodal representation learning and integrated whole-body reasoning in nuclear medicine.

[71] SignSeek: Learning Transferable Representations for Sign Dictionary Retrieval cs.CVPDF

Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden

TL;DR: SignSeek是一种用于手语词典检索的表示学习方法，通过对比学习和显著性引导的发音器官掩码来学习可迁移的手语表示。该方法在多个手语数据集上实现了最先进的跨语料库检索性能，并能零样本泛化到未见过的英国手语，同时可迁移到孤立手语识别和字幕对齐任务。

Details

Motivation: 现有手语表示学习方法主要用于闭集识别，其生成的嵌入无法泛化到检索任务所需的开放集、独立于手语者的场景，SignSeek旨在解决这一泛化问题。

Result: 在ASL-Citizen、WLASL和NMFs-CSL数据集上的跨语料库检索任务中，SignSeek无需下游微调即达到新的最先进性能；在完全未见的英国手语上实现零样本泛化，甚至超过在BSL上显式训练的方法。

Insight: 创新点在于引入显著性引导的发音器官掩码，通过掩码对比对齐损失和掩码预测损失，从单一关键发音器官和时空上下文学习鲁棒表示，实现了对手语者差异的强泛化能力。

Abstract: Sign language dictionaries are essential resources for sign language learners, yet automatically retrieving a sign from a dictionary, given only a query video, remains a challenging problem due to the natural variability between signers. Existing sign representation learning methods are built for closed-set recognition, producing embeddings that do not generalise to the open-set, signer-independent setting that retrieval demands. \textbf{SignSeek} closes this gap by contrastively learning sign representations with saliency-guided articulator masking. A contrastive objective aligns same-gloss signs across signers, while our Articulator Saliency-Guided Masking (ASGM) pinpoints the single most critical articulator per sign. This drives two complementary objectives, a masked contrastive alignment (MAC) loss that sees the sign through a single articulator and a masked prediction (MAP) loss that reconstructs it in latent space from the surrounding spatio-temporal context. Pretrained on 266K samples ($\sim$5,700 glosses) across multiple sign languages, \textbf{SignSeek} sets a new state-of-the-art performance in cross-corpus retrieval on ASL-Citizen, WLASL, and NMFs-CSL without any downstream fine-tuning. Strikingly, it achieves zero-shot generalisation to an entirely unseen British Sign Language (BSL), surpassing methods explicitly trained on BSL, and transfers seamlessly to isolated sign recognition and subtitle alignment, outperforming prior skeleton-based methods.

[72] Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning cs.CVPDF

Yijun Yang, Shenghe Zheng, Wenbo Li, Jianhui Liu, Haoze Sun

TL;DR: 本文提出了FactoSR框架，旨在解决视觉语言模型在空间推理上的‘扁平化’问题。该方法将复杂的4D世界一致性问题分解为平面对应、深度一致性和时间可逆性三个正交的几何子目标，并通过因子化强化学习进行优化。

Details

Motivation: 尽管视觉语言模型在多模态任务上表现出色，但其在物理世界推理上本质是‘扁平’的，这源于模型训练的2D投影与真实空间推理所需的潜在3D几何和时序连续性之间存在维度不匹配。

Result: 在多视角和视频基准测试上的广泛评估表明，该方法在3D和4D推理上取得了显著提升，在VSI-Bench上提升了5.9%，在All-Angles-Bench上提升了4.5%。

Insight: 核心创新点在于将单体的、病态的投影恢复问题，分解为一系列可验证的、正交的几何约束子目标，并通过统一的策略学习机制进行优化。这为将VLMs进化为具有稳健世界感知能力的推理器提供了一条关键路径。

Abstract: Despite the remarkable prowess of Vision-Language Models (VLMs) in general multimodal tasks, they remain fundamentally flat'' when reasoning about the physical world. We argue that this spatial bottleneck stems from a profound dimensional mismatch: while VLMs are trained to interpret 2D projections, true spatial reasoning demands the recovery of latent 3D geometry and temporal continuity. To conquer this high-dimensional complexity, we advocate a shift from monolithic learning to a divide and conquer’’ paradigm. We present FactoSR, a factorized reinforcement learning framework that explicitly interpret the dimensions collapsed by visual projection. At its core, FactoSR decomposes the monolithic problem of world-consistent reasoning into three orthogonal, geometric sub-objectives: planar correspondence ($XY$), depth consistency ($Z$), and temporal reversibility ($T$). By optimizing these verifiable constraints within a unified policy learning mechanism, we effectively transform an ill-posed projection recovery problem into a series of tangible reasoning steps. Extensive evaluations on multi-view and video benchmarks demonstrate that this elegant decomposition yields substantial gains in 3D and 4D reasoning, achieving a 5.9% boost on VSI-Bench and 4.5% on All-Angles-Bench. Our findings suggest that reinforcing explicit, factorized 4D consistency is a critical step toward evolving VLMs into robust, world-aware reasoners.

[73] ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation cs.CV | cs.AIPDF

Javier del Pino, Salvador Rodríguez, Alejandro Garabito, Javier Álvarez, Chema Garabito

TL;DR: ENEAS是一种统一的、可文本提示的实例跟踪和语义发现方法，旨在解决现有文本提示分割模型（如SAM 3）在时序幻觉、空间碎片化和语义误分类方面的缺陷。它通过扩展几何鲁棒的SeC架构并引入语义验证层，实现了对独特实例的精确跟踪与高质量分割，以及开放概念下所有命名实例的发现。

Details

Motivation: 现有文本提示分割模型存在时序幻觉（目标离开视野时无法报告缺失）、空间碎片化（极端特写时分割局部纹理而非完整对象）和语义误分类（将视觉相似但本体不同的实体误判为目标）等问题，ENEAS旨在解决这些局限性。

Result: 论文未在摘要中提供具体的定量基准测试结果或SOTA比较，但宣称ENEAS能实现高质量的视频、大型库以及时空无序数据集的语义跟踪与分割，并能有效区分真实实例与其视觉相似物。

Insight: 创新点在于将文本提示适配器集成到几何鲁棒的SeC架构中以增强跟踪鲁棒性，并设计了一个结合高速视觉嵌入匹配与条件VLM精化的语义验证层，仅在模糊候选上触发语义推理，从而在保持低延迟的同时过滤仅视觉模型无法区分的本体错误。

Abstract: We present ENEAS, a unified, text-promptable method for instance tracking and semantic discovery. Text-promptable segmentation models, including the latest foundation models such as SAM 3, still suffer from temporal hallucinations, spatial fragmentation, and semantic misclassification: they fail to report target absence when an object leaves the field of view, segment local textures instead of the complete object during extreme close-ups, and prioritize visual features over ontological reality, so that visually similar artifacts such as statues, paintings, or reflections are segmented as target entities. ENEAS works two ways from a single method: precise tracking and high-quality segmentation of a unique instance, and open-concept discovery of every instance a text query names, resolved by a semantic verification layer. For tracking, we extend the geometrically robust SeC architecture, previously limited to point interactions, with a text-prompting adapter and leverage its temporal memory, so that the target is held through disappearance without drifting to distractors and kept whole even when it fills the entire view. For discovery, the verification layer combines high-speed visual embedding matching with conditional VLM refinement, invoking semantic reasoning only for ambiguous candidates, which filters out the ontological errors that visual-only models cannot distinguish while keeping latency low. Designed with 3D reconstruction in mind, where a single misclassified distractor corrupts the asset, ENEAS unlocks high-quality semantic tracking and segmentation of video, of broad libraries, and of collections of temporally or spatially unordered data, together with the discrimination to tell true instances from their doppelgangers: things that look alike but are not the same. The code and models are available at https://github.com/speridlabs/eneas

[74] KnowVis: Knowledge-Centric Visual Summarization for Video Lectures cs.CV | cs.CLPDF

Yi Xu, Yifan Hou, Xiaoyu Zhang

TL;DR: KnowVis是一个将线性视频讲座转化为基于教学原理的视觉叙事框架，通过提取概念图、构建结构化知识单元并合成视觉摘要，旨在降低学习者的认知负荷并提升学习效果。

Details

Motivation: 现有视频摘要方法主要生成文本密集的线性摘要，未能解决视频线性传递信息与人类学习需构建互连认知网络之间的教学不匹配问题，尤其对缺乏先验知识的新手学习者造成认知过载。

Result: 在包含125个教育视频的数据集上，自动评估和人工研究表明，KnowVis相比SOTA基线能生成更准确清晰的视觉摘要，显著降低认知负荷并提高学习效果和知识保留率。

Insight: 创新点在于以知识为中心，通过提取阈值概念和构建视觉叙事来弥合教学鸿沟，提供了一种结构化、视觉化的摘要方法，可借鉴于教育技术中认知负荷优化的设计。

Abstract: Video lectures are valuable educational resources, but their dense and lengthy formats often overwhelm novice learners. This difficulty stems from a fundamental pedagogical mismatch: while videos deliver transient information linearly, human learning requires constructing interconnected cognitive networks, a task that induces severe cognitive overload for novice learners lacking prior domain knowledge. Existing video summarization methods fail to resolve this mismatch, as they primarily produce text-heavy, linear condensations that still demand high cognitive effort. To bridge this gap, we propose KnowVis, a framework that transforms linear video lectures into pedagogically grounded visual narratives. KnowVis first extracts a detailed concept map from multimodal video content to identify important and challenging threshold concepts, then constructs structured knowledge units, and finally synthesizes engaging visual summaries. Alongside the framework, we introduce a curated dataset of 125 educational videos across 10 academic disciplines, paired with 1,079 generated visual summaries. Extensive automated evaluations and a human study demonstrate that, compared to state-of-the-art baselines, KnowVis generates more accurate and clear visuals that successfully reduce cognitive load and significantly improve student learning effectiveness and knowledge retention.

[75] A Reverse Sign Language Dictionary: Open-Vocabulary Sign Recognition from Continuous Signing via Video Captioning and Description Retrieval cs.CV | cs.CLPDF

Santiago Poveda-Gutiérrez, Hideki Nakayama, Mayumi Bono

TL;DR: 本文提出了一种基于视频描述和描述检索的反向手语词典方法，用于从连续手语中实现开放词汇的手语识别。该方法通过使用开放权重的视觉语言模型将手语片段生成自由形式的程序性描述，然后利用多语言句子编码器从目标描述词汇中检索最接近的条目，从而无需依赖封闭的词目标注，支持开放词汇识别。

Details

Motivation: 传统孤立手语识别（ISLR）被建模为基于词目标签的封闭集分类，无法泛化到训练中未见的手语，且每次部署都依赖于词目标注词典。本文旨在解决这一问题，实现无需词目监督的开放词汇手语识别。

Result: 在日本手语对话语料库的1,300个手语片段上，经过微调后，可见类别的检索性能显著提升（top-10检索率从4.5%提升至49%），在三个测试集中的两个上与标准监督封闭集分类器（I3D）统计上无差异。未见类别的检索性能也显著改善（top-10检索率从11.5%提升至21.0%），而封闭集分类器无法处理此类情况。

Insight: 创新点在于首次提出基于描述、无需词目监督的开放词汇手语检索方法，通过视频描述生成和描述检索构建反向手语词典，支持从连续手语中识别未见手语，为手语识别提供了更灵活和可扩展的框架。

Abstract: Isolated Sign Language Recognition (ISLR) is conventionally cast as closed-set classification over gloss labels, which cannot generalize to signs unseen in training and ties every deployment to a gloss-annotated lexicon. We instead recognize signs extracted from continuous signing by (1) captioning a sign-level clip into a free-form procedural description of the articulation with an open-weight vision-language model, and (2) retrieving the closest entry from a vocabulary of target descriptions with a multilingual sentence encoder: a reverse sign language dictionary that needs no gloss supervision and admits an open vocabulary. On 1,300 sign-level segments from a Japanese Sign Language (JSL) dialogue corpus annotated with procedural descriptions (against a 2% top-10 chance floor over the 503-entry target vocabulary), fine-tuning the captioner substantially improves seen-class retrieval: language and vision tower fine-tuning raises top-10 retrieval on seen classes from 4.5% (untrained) to 49%, becoming statistically indistinguishable from a standard supervised closed-set classifier (I3D) on two of the three test sets where a closed-set classifier can be evaluated at all. More importantly, unseen-class retrieval also improves significantly over the untrained pipeline (11.5% -> 21.0% top-10, p=0.0094), a regime in which the closed-set classifier cannot participate. A matcher-side empirical upper-bound analysis shows the sentence encoder already recovers close to 100% of paraphrased gold descriptions, locating a gap in captioning quality that we aim to address in future work. To our knowledge this is the first description-based, open-vocabulary sign lookup from continuous signing without gloss supervision, and the first for JSL.

[76] LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes cs.CV | cs.AIPDF

Chuyan Chen, Haoxing Chen, Kun Chen, Zhenglin Cheng, Long Cui

TL;DR: 本文提出了LLaDA-Image，一个统一的开源图像生成框架。它由一个从头训练的6B参数扩散Transformer（DiT）和一个基于LLaDA2.0-Mini构建的冻结视觉-语言理解模块组成。该框架通过大规模图像预训练和中期训练构建视觉生成先验，并使用高效的优化器，最终模型能生成高度逼真的图像并精确遵循细粒度编辑指令。

Details

Motivation: 旨在构建一个完全开源的强大图像生成器，其动机是减少对大规模成对图文数据的初始依赖，通过图像优先的训练策略来建立强大的视觉生成先验。

Result: 在Qwen-Image-Bench基准测试中，LLaDA-Image在英文和中文赛道上分别取得了53.53和53.38的综合分数，在两个赛道上均创造了开源模型的新SOTA。

Insight: 创新点在于其训练策略：先通过大规模纯图像数据进行预训练和中期训练来构建生成先验，而非从一开始就依赖图文对数据。此外，其统一的框架设计（DiT + 冻结VLM）以及使用参数免费的RMSNorm和Muon优化器以实现高效可扩展的优化，也是值得借鉴的技术路径。

Abstract: We introduce LLaDA-Image, a unified framework that pairs a 6B Diffusion Transformer (DiT) trained from scratch with a frozen vision-language understanding module built on the LLaDA2.0-Mini diffusion language model backbone. Instead of relying heavily on paired image-text data from the beginning, we first build a strong visual generative prior through image-only pre-training and mid-training. The generation pipeline comprises 220M samples, 98 of which are real images. For efficient and scalable optimization, we use parameter-free RMSNorm throughout the DiT together with the Muon optimizer. The resulting unified model produces highly photorealistic images while accurately following fine-grained editing instructions. We further distill LLaDA-Image into LLaDA-Image-Turbo, enabling fast inference in 2-4 sampling steps. On Qwen-Image-Bench, LLaDA-Image achieves overall scores of 53.53 and 53.38 on the English and Chinese tracks, respectively, setting a new state-of-the-art among open-source models on both tracks. To support further research on capable and efficient generative models, we release our model weights, training code, and detailed recipes.

Minwei Zhao, Weiming Zhang, Jiawang Du, Qiming Liu, Weiming Zhuang

TL;DR: 该论文提出了GBA-GCs基准数据集和MCGC多模态框架，用于识别中国粤港澳大湾区的封闭式与开放式社区。研究首先构建了一个包含37,444个住宅小区、融合卫星影像、中文元数据和结构化属性的城市级多模态基准，并在此基础上开发了基于DINOv3-SAT的视觉中心多模态分类器，通过模态感知交叉注意力和自适应门控缓解模态不平衡问题。最后，利用验证后的模型进行城市尺度制图，揭示了封闭社区的空间聚集、私有化绿地及行人连通性降低等公平性影响。

Details

Motivation: 现有对中国封闭小区（fengbi xiaoqu）的研究多为定性或小规模分析，缺乏可复现的城市尺度研究，限制了对其空间开放性与社会公平影响的系统性理解。

Result: MCGC框架在GBA-GCs基准上持续优于强大的单模态和多模态基线模型，实现了封闭/开放社区识别的先进性能。

Insight: 创新点在于构建了首个针对中国城市的大规模、多模态封闭社区识别基准，并提出了融合视觉、文本和结构化数据的自适应多模态融合框架；从客观角度看，其将计算机视觉技术应用于城市形态与社会公平的交叉研究，为量化分析城市空间的社会壁垒提供了可扩展的方法论。

Abstract: Communities are fundamental spatial units that shape urban form and social life. Whether a residential compound is spatially open or enclosed affects mobility, access to public services, and equity, yet studies of Chinese fengbi xiaoqu remain largely qualitative or small-scale, limiting reproducible city-scale analysis. We address this gap by introducing GBA-GCs, a metropolitan-scale multimodal benchmark for locally grounded gated/open community recognition in China’s Greater Bay Area, covering 37,444 residential compounds with aligned boundary polygons, high-resolution satellite imagery, Chinese metadata, and structured attributes, together with expert-verified labels, inter-annotator reliability, and official evaluation splits. Built on this benchmark, we present Multimodal Classifier for Gated Community (MCGC), a vision-centric multimodal framework based on DINOv3-SAT that fuses imagery, text, and structured cues via modality-aware cross-attention and adaptive gating to mitigate modality imbalance. MCGC consistently outperforms strong unimodal and multimodal baselines. Finally, we apply the validated model to metropolitan-scale mapping and report equity-oriented findings including spatial clustering of GCs, privatized green space, and reduced pedestrian connectivity. The benchmark, code, and release documentation are available at https://github.com/MinweiZhao/GBA-GCs.

[78] VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligence cs.CV | cs.CLPDF

JoyIndustrial VisCAD Team, Linxin Cai, Qiuhe Hong, Zhichao Huang, Guanlin Li

TL;DR: 本文提出了VisCAD，一个用于工业产品AI辅助计算机辅助设计（CAD）的基础模型套件。该套件包含核心模型VisCAD-M1，用于零件级设计生成，以及一个利用前沿模型进行复杂装配生成的领域特定工具。VisCAD旨在实现广泛的泛化能力和强大的CAD领域能力。

Details

Motivation: 现有专门的CAD模型通常训练数据输入域狭窄（如渲染图或文本），泛化能力差；而通用前沿模型虽然覆盖更广的输入，但在CAD领域表现不一致。因此，需要开发一个既能广泛泛化又具备强大CAD能力的模型。

Result: 在PubCADBench和RealCADBench基准测试中，VisCAD-M1在零件级得分达到0.5540，超过了最强前沿模型的0.5496。通过将其作为测试时验证器，得分可进一步提升至0.5797，相对于之前的最先进水平有约5%的相对提升。在装配生成方面，其领域特定工具在定量和定性评估中也优于通用工具。

Insight: 核心创新在于通过中期训练和后训练策略构建了一个专门用于CAD零件级生成的大规模基础模型（VisCAD-M1，27B参数），并提出了一个重用该模型作为测试时验证器以进一步提升性能的方法。此外，将领域特定工具与前沿模型结合用于复杂装配生成，也是一个有效的系统设计思路。

Abstract: AI-assisted computer-aided design (CAD) for industrial products involves two challenging phases. Part-level generation maps diverse forms of user intent, including renders, text descriptions, 2D drawings, and real photographs, to executable programs in a CAD domain-specific language. Assembly-level generation must additionally handle interacting parts, plan mating relations, estimate poses, and place all parts correctly. Existing specialized CAD models are commonly trained on narrow input domains, such as renders or texts, and often generalize poorly, while general-purpose frontier models cover broader inputs but perform inconsistently across CAD domains. We present VisCAD, a foundation model suite designed to provide both broad generalization and strong CAD capability for realistic industrial products. At its core is VisCAD-M1, a 27B model trained through mid-training and post-training for part-level design generation. On PubCADBench and RealCADBench, VisCAD-M1 achieves the highest average part-level score among the evaluated models, reaching 0.5540 compared with 0.5496 for the strongest frontier model. Reusing VisCAD-M1 as a test-time verifier can further raise the score to 0.5797, an approximately 5 percent relative improvement over the previous state of the art. VisCAD also includes a domain-specific harness that leverages frontier models for complex assembly generation and demonstrates advantages over general-purpose harnesses in both quantitative and qualitative evaluations.

[79] VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues cs.CVPDF

Ernesto Lozano, Alberto Jaenal, Javier Civera

TL;DR: VI3是一个模型无关的框架，旨在利用惯性测量单元（IMU）读数，将预训练的3D基础模型（3DFM）的输出与真实度量尺度对齐。该方法通过IMU预积分获得度量运动参考，从而恢复3DFM预测的绝对尺度，无需真实值监督，并在合成和真实航空数据集上验证了其有效性。

Details

Motivation: 3D基础模型在从多视图预测相机姿态和密集深度方面表现出色，但由于单目图像无法观测度量尺度，其绝对尺度预测通常不准确。而大多数设备中的IMU能够观测到带尺度的运动，自然可以弥补单目相机的这一不足。

Result: 在合成和真实航空数据集上的实验表明，VI3能够在没有真实值监督的情况下恢复度量尺度，同时保持几何一致性。在运动信息充分时，它起到精细优化的作用；在运动信息较少时，它则作为一个强先验。

Insight: 论文的创新点在于提出了一个模型无关的框架，通过融合IMU的度量运动信息来锚定和校正3D基础模型的尺度预测，解决了单目3D重建中的尺度模糊问题。从客观角度看，这种跨模态（视觉与惯性）的弱监督尺度恢复方法具有通用性和实用性。

Abstract: 3D foundation models (3DFMs) excel at predicting camera poses and dense depth from multiple views of a scene, showcasing strong zero-shot generalization. However, as metric scale is not observable from monocular images, their absolute scale predictions are typically inaccurate. Inertial measurement units (IMUs), present in most devices, naturally complement monocular cameras by observing scaled motion. We introduce VI3, a model-agnostic framework that metrically anchors a pretrained 3DFM using only IMU readings. VI3 initializes and preintegrates the IMU to obtain a metric motion reference, which is then used to recover the scale of the 3DFM outputs. Our method includes adaptable anchoring strategies tailored to diverse 3DFM architectures. Experiments on synthetic and real aerial datasets demonstrate that VI3 recovers metric scale without ground-truth supervision while preserving geometric consistency, acting as a fine refinement under well-conditioned motion and as a strong prior when motion is less informative.

[80] GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs cs.CV | cs.AI | cs.ROPDF

Junqing Du, Fernando Ropero, Erkin Turkoz, Yanfeng Zhang, Lu Liu

TL;DR: 本文提出了GraFT，一个无需训练、基于3D场景图（3DSG）的框架，旨在增强多模态大语言模型（MLLMs）的3D空间推理能力。该框架通过3DSG提供确定性几何计算、以鸟瞰图（BEV）呈现的全局布局以及任务相关的自我中心视角帧，从而解决MLLMs在精确几何测量、视角转换和细粒度外观理解上的不足。

Details

Motivation: 当前多模态大语言模型在3D空间推理（如精确几何测量、自我中心与全局视角转换、细粒度外观理解）上表现不可靠。现有方法通常依赖于大规模标注数据集进行微调或附加专用3D几何编码器，导致解决方案成本高昂且与特定模型主干耦合。

Result: 在ScanQA基准上，GraFT在所有指标上均优于同主干基线，CIDEr分数提升了27%。在VSI-Bench基准上，GraFT将冻结的MLLMs性能提升高达65%，超越了所有专有和通用开源基线以及多个著名的微调空间模型，达到了SOTA水平。

Insight: 论文的创新点在于提出了一种无需训练、解耦的框架，通过轻量级3D场景图（3DSG）为MLLMs注入3D结构信息，从而提供符号化几何工具、全局布局渲染和视觉属性定位能力。从客观角度看，该方法避免了昂贵的监督微调和模型主干依赖，为增强MLLMs的空间推理提供了一种灵活且高效的途径。

Abstract: 3D spatial reasoning underpins understanding and acting in the physical world, yet it remains unreliable in current multimodal large language models (MLLMs). These models falter at precise geometric measurement, at transforming between egocentric and allocentric viewpoints, and at grounding fine-grained appearance. The most common remedies fine-tune the model on large-scale curated spatial-reasoning datasets or attach dedicated encoders for 3D geometry, which typically couples the solution to costly supervision and a specific backbone. We instead introduce GraFT, a training-free framework that supplies the missing 3D structure through a compact, easily maintained 3D scene graph (3DSG). From this 3DSG, GraFT provides three spatial reasoning capabilities: (1) deterministic geometry through symbolic tools, (2) allocentric layout through a bird’s-eye-view (BEV) rendering, and (3) visual-attribute grounding through task-relevant egocentric frames. On ScanQA, GraFT improves every metric over the same-backbone baseline, raising CIDEr by 27%. On VSI-Bench, GraFT improves frozen MLLMs by up to 65%, surpassing every proprietary and general-purpose open-source baseline, and several prominent fine-tuned spatial models.

[81] OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping cs.CVPDF

Zelong Lv, Sicheng Xu, Jianfeng Xiang, Ruicheng Wang, Yue Dong

TL;DR: OctWorld是一个基于扩散模型的视频生成框架，通过引入名为OctMap的持久性3D记忆系统，能够从单张图像出发，沿着用户指定的相机轨迹，生成可探索、世界一致且高保真的长距离视觉场景。其核心创新是采用基于动态稀疏八叉树的可扩展空间自适应3D表示，渐进融合生成的视觉观测和深度图，以解决长距离生成中因视角变化和区域重访导致的空间一致性难题。

Details

Motivation: 解决长距离视频生成（具有长相机路径和宽视角覆盖）中，当相机重新访问已生成区域时，保持空间一致性的挑战。现有方法在维持场景几何与外观细节的一致性方面存在不足。

Result: 实验表明，OctWorld在现有基准测试和具有挑战性的长距离生成设置中，均优于先前方法，能够生成长距离且空间一致的视频。OctMap在保持细节和低内存开销方面，也明显优于基于点的缓存和固定分辨率的TSDF体积方法。

Insight: 创新点在于提出了一个基于动态稀疏八叉树的可扩展、空间自适应的3D记忆（OctMap），它通过TSDF融合渐进构建全局场景表示，能根据图像证据自适应调整空间分辨率，从而在多样场景尺度下保持几何与外观细节，同时维持较低的内存开销。这为生成具有持久3D一致性的内容提供了新的架构思路。

Abstract: We present OctWorld, a video diffusion framework with persistent 3D memory for generating explorable, world-consistent, and high-fidelity visual scenes. Given a single image, OctWorld performs stable autoregressive world generation along user-specified camera trajectories. We focus on long-range generation, characterized by extended camera paths and wide viewpoint coverage, where preserving spatial consistency is particularly challenging when previously generated regions are revisited. To address this problem, we introduce OctMap, an extensible and spatially adaptive 3D memory that progressively fuses generated visual observations and their corresponding depth maps into a global representation. OctMap employs TSDF fusion within a dynamic sparse octree whose spatial resolution adapts to image evidence. This design preserves geometric and appearance details across diverse scene scales while maintaining low memory overhead. Experiments demonstrate that OctWorld generates long-range, spatially consistent videos and outperforms prior methods on both existing benchmarks and challenging long-range generation settings. OctMap also provides clear advantages over point-based caches and fixed-resolution TSDF volumes. Project page: https://maxtirerror.github.io/octworldpage/

[82] Sparse auto-regressive modeling for scene generation from multi-view images cs.CV | cs.LGPDF

Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel, Wonjune Cho, Bardienus Pieter Duisterhof

TL;DR: 本文提出了SPAR3S，一种稀疏体素对齐的3D潜在生成模型，用于从稀疏多视角图像进行条件化场景补全。该方法的核心是在一个结构化的、紧凑的、仅表示被占据体素的3D潜在空间中，通过掩码自回归Transformer联合建模体素占用和潜在令牌值，从而高效、空间一致地生成未观测区域。

Details

Motivation: 解决从稀疏、无约束视角生成完整3D场景的根本挑战，现有前馈重建方法局限于输入图像可见内容，而密集体素表示的3D生成模型则受限于高计算成本和大规模3D监督数据的稀缺。

Result: 在合成室内场景上，该方法在生成新视角图像的质量上超越了先前工作；在RealEstate10k真实世界数据集上的验证也证明了其泛化能力。

Insight: 创新点在于将3D场景生成问题公式化在一个稀疏的体素对齐3D潜在空间中，仅需多视角图像的光度监督，无需真实3D数据；并采用掩码自回归Transformer联合预测缺失的潜在令牌及其空间支持，实现了高效且空间一致的生成。

Abstract: Generating complete 3D scenes from sparse, unconstrained views is a fundamental challenge in 3D vision which requires reasoning beyond observed content while remaining computationally tractable. Existing feed-forward reconstruction methods are inherently limited to content visible in the input images, while 3D generative modeling is hindered by the high computational cost of dense volumetric representations and the scarcity of large-scale 3D supervision. We introduce SPAR3S, a sparse voxel-aligned 3D latent generative model for conditional scene completion without requiring ground-truth 3D data for supervision. Our key insight is to formulate 3D scene generation in a structured, compact, voxel-aligned 3D latent space where only occupied voxels are represented. We learn this sparse latent space directly from multi-view images using photometric supervision via differentiable 3D Gaussian Splatting. Given a partial set of observed voxels encoded from sparse input views, scene completion reduces to predicting the missing latent tokens and their spatial support within the voxel grid. To this end, we train a masked autoregressive transformer that jointly models voxel occupancy and latent token values, enabling efficient and spatially consistent generation of unseen regions. We demonstrate the effectiveness of our method on synthetic indoor scenes, achieving higher novel-view quality than prior work. We further validate its generalization on RealEstate10k, highlighting its applicability to real-world data.

[83] Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs cs.CV | cs.CLPDF

Prakhar Khatri

TL;DR: 本文系统研究了长视频多模态大语言模型中的视觉令牌分配策略，包括帧选择、空间压缩和资源再投资三个关键决策。研究发现，帧选择对性能影响最大，简单的正交匹配追踪算法与专用选择器效果相当；空间压缩成本极低；而将压缩节省的令牌再投资于更多帧能进一步提升性能。

Details

Motivation: 长视频语言模型无法处理所有帧，现有研究通常将帧选择视为预处理细节，且不同选择器在多个变量上同时变化，难以公平比较。本文旨在通过控制变量实验，系统评估帧选择、压缩和再投资各自对性能的影响。

Result: 在LongVideoBench等三个长视频基准测试上，使用查询相关的8个选定帧比均匀采样的16帧性能高6.9分。正交匹配追踪算法与所有专用选择器效果相当或仅差1分以内。将空间预算减半最多损失0.44分，而将节省的令牌用于增加压缩帧数可再提升2-3分。

Insight: 帧选择是性能提升的最大杠杆，而非复杂的专用算法；空间压缩近乎零成本，但其价值需通过再投资（增加帧数）才能体现。研究强调了在统一实验框架内进行公平比较的重要性，并揭示了现有基准实现中的不一致性问题。

Abstract: Long-video language models cannot look at every frame: an hour sampled once per second is 3,600 images, and a system keeps only a small fixed slice of that pool. Which frames survive that slice is usually treated as a preprocessing detail; we test whether it should be. Published selectors make the comparison hard because they change the frame scorer, the prompt boundary, the resolution policy, and the answering model all at once. We hold each fixed and vary one decision at a time: selection, spatial compression, and reinvestment of the savings, across six training-free selection rules, three long-video benchmarks, and two answering models. Selection is the largest single lever: on LongVideoBench’s hour-long bin, eight query-selected frames beat sixteen uniformly spaced ones by 6.9 points, and Orthogonal Matching Pursuit, an unmodified decades-old sparse-approximation algorithm, matches or comes within a point of every purpose-built selector we compare it against, across all three benchmarks. Compression is close to free: halving each frame’s spatial budget at fixed timestamps costs at most 0.44 points. Reinvestment is where that budget turns back into accuracy: spending the freed tokens on twice as many compressed frames, at a measured cost no higher than the original eight, returns a further two to three points; compression only pays off once its savings are spent this way. Along the way, an implementation bug in our own AKS baseline and a 0.07 to 3.74 point gap between two harnesses running the same published rules at the same budget show why these comparisons need to happen inside one controlled harness rather than across papers.

[84] IchthyoNoma: Nomenclature and Context Sensitivity of Zero-Shot Biological Vision–Language Models for Bangladeshi Freshwater Fish Recognition cs.CV | cs.CLPDF

Nazim-E-Alam, Tarek Rahman, Md Kishor Morol

TL;DR: 本文评估了CLIP、BioCLIP、BioCLIP2及Jina CLIP v2等零样本视觉语言模型在孟加拉国淡水鱼识别任务上的表现，发现模型准确率高度依赖于生物领域专业化、多语言对齐、命名法（学名/俗名）、提示词构建及上下文背景。

Details

Motivation: 动机是审计零样本视觉语言模型作为免训练物种识别器的实际能力，探究其报告准确率是否真实反映视觉物种知识，还是受到其他非视觉因素（如命名法、语言、提示词）的显著影响。

Result: 在BFF-15数据集上，BioCLIP2使用英文俗名达到72.36%准确率，在SylFishBD数据集上使用学名达到68.91%，而通用CLIP模型分别仅为25.15%和14.40%。使用孟加拉语提示时，BioCLIP2准确率接近随机水平（约14%），Jina模型部分恢复至21.89%和16.36%。

Insight: 创新点在于系统揭示了零样本生物VLM性能是生物领域专业化、多语言对齐、命名法、提示词构建和上下文背景等多种因素共同作用的结果，而非单纯的视觉识别能力；研究强调了在生物多样性监测等应用中，需谨慎选择模型、命名体系和提示语言。

Abstract: Zero-shot vision-language models (VLMs) are increasingly used as training-free species recognizers, but reported accuracy can reflect more than visual species knowledge. We audit CLIP, BioCLIP, BioCLIP2, and a multilingual Jina CLIP v2 control on seven freshwater-fish categories from two Bangladeshi sources (10,321 images). BioCLIP2 reaches 72.36% on BFF-15 with English common names and 68.91% on SylFishBD with scientific names, versus 25.15% and 14.40% for generic CLIP. BioCLIP2 Bengali prompts are near chance in balanced accuracy (14.22-14.29%); Jina partially recovers Bengali discrimination to 21.89% and 16.36%, but bare Bengali names return to 14.29% on both sources. Paired SylFishBD interventions show no significant weak-blur effect, modest losses from stronger blur/gray masking, a larger white-mask artifact, and strong species dependence. Zero-shot biological VLM scores therefore jointly reflect biological specialization, multilingual alignment, nomenclature, prompt formulation, and context.

[85] WorldReward: Reward Modeling for Camera-Conditioned World Models cs.CVPDF

Yibin Wang, Zehan Wang, Junshu Tang, Zhimin Li, Yujie Zhou

TL;DR: 本文提出了WorldReward，一个基于视觉语言模型（VLM）的成对偏好奖励模型，用于评估相机条件世界模型生成的交互视频。该方法通过将视频分解为动作对齐的片段、组织结构化视觉证据并进行投票聚合，统一了动作一致性和视觉质量的评估。

Details

Motivation: 现有奖励模型分别评估相机条件世界模型视频的动作执行（几何奖励）和视觉质量（图像奖励），缺乏一个统一的框架来同时衡量动作与视觉结果的关联。作者认为VLM提供了一个共享的推理空间来关联动作与其视觉结果，但直接评估长视频会因上下文过长而丢失局部动作证据。

Result: 在作者构建的人类标注基准WorldReward-Bench上，WorldReward在动作一致性、外观质量和运动质量三个维度上与人类偏好的一致性均达到最高，分别超过GPT-5.5模型3.42、1.45和3.56个百分点。当用于HY-WorldPlay 1.5模型的强化学习后训练时，它在短期到长期的视野上都持续改善了动作执行和视觉质量。

Insight: 主要创新点在于提出了一种基于VLM的、通过分解-结构化-投票机制来统一评估动作一致性与视觉质量的奖励建模方法。其核心洞察是将长视频评估分解为动作对齐的片段，以避免长上下文中的信息稀释，并通过结构化视觉证据和投票聚合来提高评估的鲁棒性和准确性。构建大规模推理增强偏好数据集的方法也具有借鉴意义。

Abstract: Camera-conditioned world models generate interactive videos in which commanded actions should induce the expected scene changes while appearance, geometry, and temporal dynamics remain coherent. Existing rewards assess these requirements separately: geometry-based rewards estimate trajectory execution but cannot judge the visual quality of the executed motion, whereas image-based rewards measure frame quality without capturing action execution or temporal dynamics. We posit that a vision-language model (VLM) offers a shared reasoning space for relating actions to their visual outcomes. However, judging a complete long video against its full action sequence creates a lengthy, noisy context in which short-lived local action evidence can be missed or diluted. We present WorldReward, a VLM-based pairwise preference reward model that unifies action-consistency and visual-quality evaluation for camera-conditioned world models. WorldReward decomposes paired videos into action-aligned chunks, organizes each chunk into structured visual evidence, and aggregates chunk-level decisions by voting into separate video-level action and visual-quality preferences. To train it, we construct a large-scale reasoning-augmented preference dataset using structured judgments generated by a frontier VLM and refined through tool-based agent auditing and targeted human review. We further introduce WorldReward-Bench, a human-annotated benchmark measuring reward-model agreement with human preferences across action consistency, appearance quality, and motion quality. WorldReward achieves the highest agreement on all three dimensions, exceeding GPT-5.5 by 3.42, 1.45, and 3.56 percentage points, respectively. When used for RL post-training of HY-WorldPlay 1.5, it consistently improves both action execution and visual quality across short- to long-term horizons.

Emanuele Cardinale, Marco Proietti, Alessandro Cacciatore, Maria Francesca Spadea, Lucia Migliorelli

TL;DR: 本文针对2D婴儿姿态估计中噪声标注问题，提出了基于训练动态记忆的可靠关键点选择方法REMIND，该方法通过聚类分析关键点训练动态来识别噪声标签，无需假设噪声分布先验，从而实现在临床新生儿数据集上的无噪声模型训练。

Details

Motivation: 监督深度学习依赖大规模高质量标注数据，但噪声标注会严重损害模型性能；姿态估计领域的标签噪声鲁棒性研究相对不足，而在新生儿临床监测中，婴儿图像标注因关键点自遮挡、护理人员干扰等视觉挑战而极易出错，因此需要解决该场景下的噪声标注问题。

Result: 在专有的NeoPose数据集（包含46个早产儿的临床视频）上，REMIND在多种噪声场景下能正确识别噪声标注，使用三种不同姿态估计架构时曲线下面积最高达93%，首次在早产儿姿态估计中显式处理标签噪声。

Insight: 创新点在于提出了一种无需噪声分布先验的聚类式关键点选择策略，利用关键点级训练动态来识别噪声标签；从客观角度看，该方法将训练动态记忆机制引入姿态估计的噪声鲁棒性学习，为数据质量无法保证的婴儿监测算法设计提供了新思路。

Abstract: Noisy annotations pose a significant challenge for supervised deep learning, as neural networks rely on large-scale, high-quality labeled data whose corruption can severely impair model performance. Although robustness to label noise has been extensively studied for classification tasks, it remains relatively underexplored in Pose Estimation (PE). This limitation becomes critical in clinical contexts, including neonatology, where PE of preterm infants is used to support the assessment of spontaneous motility, a key indicator of neurodevelopmental trajectories. In such settings, infants’ images labeling is further hindered by visual challenges (e.g., keypoint self-occlusions, caregiver interference), making the annotation process inherently susceptible to errors. To tackle noisy annotations in PE, we introduce REliable keypoint selection via Memory of traINing Dynamics (REMIND), a clustering-based keypoint-selection strategy that exploits keypoint-wise training dynamics to identify noisy labels without assuming any prior knowledge of the noise distribution, thus enabling noise-free model training. When evaluated on the proprietary NeoPose dataset, comprising 46 videos of 46 preterm infants recorded in real clinical settings, REMIND correctly identifies noisy annotations across multiple corruption scenarios, achieving up to 93% Area Under the Curve (AUC) with three different PE architectures used in the relevant literature. To our knowledge, this is the first study to explicitly address label noise in preterm infants’ PE, paving the way for the design of trustworthy learning-based algorithms for infants’monitoring support when data quality cannot be guaranteed.

[87] Stable and Scalable Bundle Adjustment of Holistic 3D Structures cs.CVPDF

Shaohui Liu, Rémi Pautrat, Daniel Barath, Richard Hartley, Viktor Larsson

TL;DR: 本文提出了一种统一的框架，将光束法平差（Bundle Adjustment, BA）扩展至联合优化几何特征和高阶关系（如共面性、平行性等）。该框架通过将高阶关系组建模为类似相机的实体，并利用二维重投影误差表达组约束和跨特征关联，从而在保持经典点云BA稀疏结构的同时，避免了直接三维正则化带来的数值稳定性问题。

Details

Motivation: 传统BA主要优化相机参数和稀疏3D点，而引入更丰富的几何结构（如平行性、共面性或线框）通常会显著增加计算成本并降低数值稳定性。本文旨在解决如何稳定且可扩展地将BA扩展到联合优化几何特征和高阶关系。

Result: 在真实世界和合成数据集上的实验表明，该方法的运行时间性能与经典的仅点云BA相当，同时能生成显著更丰富的3D结构并提高几何精度。

Insight: 创新点在于提出了一种分类法，将可扩展的几何特征（如点、线）与编码高阶关系的组区分开来，并将组建模为类似相机的实体；通过二维重投影误差来表述组约束和跨特征关系，从而在Schur消元下保持了经典BA的稀疏性，避免了直接3D正则化对条件数和稳定性的负面影响。

Abstract: Bundle Adjustment (BA) is a cornerstone of 3D computer vision and has benefited from decades of advances in sparse optimization and numerical methods. It was originally developed for jointly optimizing camera intrinsics, poses and sparse 3D points. While extensions incorporate lines and other primitives, integrating richer geometric structures such as parallelism, coplanarity, or wireframes often introduces significantly increased computational cost and reduced numerical stability. In this paper, we propose a unified framework that extends bundle adjustment to jointly optimize geometric features and higher-order relations. We first introduce a taxonomy that distinguishes scalable geometric features with direct 2D measurements (e.g., points and lines), from groups encoding higher-order relations (e.g., coplanarity, parallelism, etc.), where we show that groups can be modeled as camera-like entities within the bundle adjustment framework. Building on this formulation, we propose that both group constraints and cross-feature relations (i.e., point-line associations) can be expressed through 2D reprojection measurements. By formulating group-induced and cross-feature reprojection errors, we preserve the sparsity structure of classical point-based BA under Schur elimination, while avoiding direct 3D regularization that degrades the conditioning and stability. Experiments on both real-world and synthetic datasets demonstrate runtime performance comparable to classical point-only bundle adjustment, while producing significantly richer 3D structures and improved geometric accuracy.

[88] Catalogue Photography as a Cold Start: Toward Deployable Carbide Burr Recognition cs.CV | cs.AI | cs.ROPDF

Abilash Philip Madavath, Chandra Yuvesh Aubeeluck, Augustin Raju, Nicolas Pyschny, Felix Hackelöer

TL;DR: 本文研究了在工业铣削工具（碳化钨旋转铣刀）质量检测中，如何利用制造商产品目录图片作为冷启动监督来源，以应对缺乏标注现场图像的问题。论文评估了目录监督在领域偏移下的有效性，并提出了减少领域敏感性的简单改进方法。

Details

Motivation: 解决铣削工具生产批次质量检测自动化中，因缺乏标注现场图像而面临的冷启动问题，探索仅使用制造商产品目录图片作为监督来源的可行性。

Result: 在目录图片上，度量学习实现了近乎完美的无监督聚类发现（调整兰德指数0.94-0.97），但仅有不到一半的性能增益能迁移到现场照片。最大的迁移增益来自简单的领域敏感性降低策略：将图像转换为灰度（+0.22）并结合匈牙利分配利用已知订单表进行约束检索（+0.11）。

Insight: 创新点在于将产品目录摄影视为有用的冷启动而非可直接部署的训练域，并提供了从目录到现场迁移的实证基线和评估协议。客观分析表明，最大的性能提升并非来自模型规模或表示复杂性，而是来自减少领域差异的简单预处理和任务约束，这对工业视觉系统的实际部署具有借鉴意义。

Abstract: Verifying that manufactured batches of milling tools or carbide rotary burrs conform to production order sheets remains a largely manual and error-prone quality assurance task. Automating this process with computer vision faces a critical cold-start constraint since no labelled imagery is available, leaving manufacturer catalogue photography as the sole source of supervision. We investigate how far catalogue supervision can support an industrial recognition pipeline under domain shift, explicitly measuring the gap between catalogue separability and performance on held-out field photographs. Our findings reveal three key insights. First, off-the-shelf frozen feature extractors do not reliably separate the two task attributes, head shape and tooth profile, motivating targeted representation learning. Second, metric learning produces near-perfect unsupervised cluster discovery on catalogue images (adjusted Rand index 0.94–0.97), but less than half of this gain transfers to field photographs. Third, the largest transfer gains do not come from model scale or representation complexity, but from simple changes that reduce domain sensitivity: converting images to grayscale (+0.22) and constraining retrieval using the known order sheet via Hungarian assignment (+0.11). We therefore treat catalogue photography as a useful cold start rather than a deployment-ready training domain, and provide empirical baselines and an evaluation protocol for catalogue-to-field transfer in precision tool manufacturing.

[89] Editable Visual Design cs.CV | cs.CLPDF

Junyan Ye, Wei Liu, Dongzhi Jiang, Zichen Wen, HaoDong Li

TL;DR: 本文提出了一种名为’可编辑视觉设计’的新范式，通过一个编码代理驱动，结合视觉语言模型作为创意大脑进行需求理解与审美判断，并利用图像生成模型按需合成独立视觉资产。该代理遵循’先想象，后行动’的闭环工作流，生成独立资产、编写原生HTML/CSS，并基于视觉渲染反馈迭代优化设计，最终产出具有解耦图层和真实文本的可编辑设计产物。

Details

Motivation: 现有基于扩散的模型生成的图像是扁平化的位图，文本易出错且无法分层编辑；而基于代码的视觉生成虽能提供精确布局控制和解耦图层，但缺乏全局审美直觉且难以编码复杂视觉资产。本文旨在同时实现精细美学与生产级可编辑性。

Result: 在宣传海报、信息图表等场景的验证表明，该范式成功实现了精细美学与生产级可编辑性。

Insight: 创新点在于将VLM作为创意大脑与图像生成模型作为视觉世界模拟器相结合，采用’先想象，后行动’的闭环工作流，并通过’代理设计回放’机制复现人类设计师的创作推理轨迹，最终生成可直接在图形界面中进行直观拖拽和布局调整的可编辑设计文件。

Abstract: While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand visual world simulator’’ to synthesize standalone visual assets. Operating under an ``imagine first, then act’’ closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.

[90] DSAQuant: Denoising-Stage-Aligned Quantization-Aware Training for Video Generation cs.CVPDF

Shuaiting Li, Zelin Gao, Haibin Shen, Yujun Shen, Haotong Qin

TL;DR: 本文提出了一种针对视频扩散模型（VDMs）的量化感知训练方法DSAQuant，通过将量化过程与去噪阶段对齐来解决现有方法在细节和纹理保真度上的退化问题。该方法在训练阶段采用去噪阶段导向的监督策略，在推理阶段使用去噪阶段门控引导，有效提升了低比特量化下的视频生成质量。

Details

Motivation: 视频扩散模型在文本到视频生成方面取得了显著进展，但其高内存和计算成本阻碍了实际部署。现有的量化感知训练方法在应用于VDMs时，虽然能保持提示语义、全局布局和粗略运动，但严重损害了视觉细节、纹理保真度和清晰度。

Result: 在Wan和CogVideoX模型家族上，对W4A4和W3A3量化设置进行了广泛实验。结果表明，DSAQuant始终优于最先进的QAT基线，在激进的W3A3量化下，VBench平均得分最高提升了6.60，同时保持了强大的文本-视频对齐能力。

Insight: 核心创新在于认识到有效VDM量化不仅需要减少量化误差，还需要使量化训练和推理与视频扩散的阶段特性对齐。具体地，提出了去噪阶段导向的监督和去噪阶段门控引导，前者在训练中根据去噪阶段调整监督策略，后者在推理中禁用后期去噪步骤的CFG以防止量化误差被放大为高频伪影。

Abstract: Video diffusion models (VDMs) have achieved impressive progress in text-to-video generation, but their high memory and computational costs hinder practical deployment. Quantization-aware training (QAT) is an effective solution for compressing and accelerating advanced generative models without runtime overhead at inference. However, existing QAT methods suffer from a distinctive challenge in VDMs: while they often preserve prompt semantics, global layout, and coarse motion, the quantized model severely degrades visual details, texture fidelity, and sharpness. In this paper, we trace this degradation to the timestep-agnostic design of conventional quantization pipelines, which overlooks the stage-wise functionality of video denoising. In VDMs, early denoising steps mainly establish global structure and motion, whereas middle and late steps refine local appearance and high-frequency details. Based on this insight, we propose DSAQuant, a Denoising-Stage-Aligned Quantization-aware training framework for VDMs. During training, Denoising-Stage Oriented Supervision preserves teacher distillation in early steps for stable structure planning, while shifting later steps toward target-driven optimization to enhance detail reconstruction. During inference, Denoising-Stage Gated Guidance disables CFG in the final denoising steps to prevent it from amplifying quantization-induced errors into high-frequency artifacts. Extensive experiments on the Wan and CogVideoX families under W4A4 and W3A3 settings show that DSAQuant consistently outperforms the SOTA QAT baseline, improving the VBench average score by up to 6.60 under aggressive W3A3 quantization while preserving strong text-video alignment. These results demonstrate that effective VDM quantization requires not only reducing quantization error, but also aligning quantization training and inference with the stage-wise nature of video diffusion.

[91] Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving cs.CV | cs.ROPDF

Ruoyu Yao, Yusen Xie, Qingzhao Liu, Pei Liu, Zewei Yang

TL;DR: 本文提出LaPla框架，一种统一的视觉-语言-动作（VLA）模型，通过潜在对齐规划来解决自动驾驶中离散语义推理与连续物理约束动作之间的鸿沟。它利用基于残差VQ-VAE的动作分词器将轨迹编码到结构化潜在空间，并通过并发动作查询将多模态上下文直接映射到该连续潜在空间，再由冻结解码器生成物理可行的动作，避免了量化误差和耗时的自回归生成。

Details

Motivation: 解决视觉语言模型的离散推理能力与自动驾驶所需的连续、受物理约束的动作执行之间的模态差距这一核心挑战。

Result: 在nuScenes基准测试中，LaPla取得了有竞争力的开环性能，与最先进的VLA方法相比，长时域L2误差降低了15.52%。在NVIDIA AlpaSim模拟器上的闭环评估进一步证实了其优越性，成功率提高了33.34个百分点，且推理延迟显著降低。

Insight: 核心创新在于将VQ-VAE的潜在表示重新用作物理先验，以弥合高维语义与原始动作空间的模态差距，并通过并发查询的单次前向传递实现连续潜在空间的对齐与映射，从而在保证物理合理性的同时避免了量化误差和自回归生成的延迟。

Abstract: Bridging the gap between the discrete reasoning of Vision-Language Models and the continuous, physics-constrained nature of autonomous driving remains a significant challenge. In this work, we introduce LaPla, a unified Vision-Language-Action (VLA) framework featuring latent-aligned planning to seamlessly ground semantic understanding in precise motion execution. We first design an action tokenizer based on a residual vector-quantized variational autoencoder (VQ-VAE), capturing vehicle kinematics and encoding trajectory features into a structured latent space. Rather than discrete codebook lookups that inevitably introduce quantization errors, LaPla repurposes this representation as a physical prior to bridge the modality gap between high-dimensional semantics and the raw action space. Specifically, given multimodal inputs integrating multi-view images, historical actions, and textual instructions, LaPla incorporates concurrent action queries to causally attend to the multimodal context in a single forward pass, projecting hidden states directly into the pretrained VQ-VAE latent space. The frozen decoder then translates these continuous latents into actions, effectively eliminating quantization errors and ensuring physically plausible trajectories while bypassing time-consuming autoregressive generation. Extensive experiments on the nuScenes benchmark demonstrate that LaPla achieves competitive open-loop performance, reducing long-horizon L2 error by 15.52% compared to state-of-the-art VLA methods. Closed-loop evaluations on the NVIDIA AlpaSim simulator further confirm its superior capability in ensuring smooth driving progress, improving the success rate by 33.34 percentage points with significantly reduced inference latency.

[92] The Shape of Time: Video-Token Contrast for Temporal Understanding in VideoLMs cs.CVPDF

Yumeng Shi, Quanyu Long, Yin Wu, Wenya Wang

TL;DR: 本文提出VT-Contrast，一种用于视频语言模型（VideoLMs）的表示级时序对比目标，旨在解决现有模型因主要监督作用于生成文本而非视频令牌表示，导致模型可能通过物体、场景等捷径学习时序答案，而无需内部视频表示捕获事件动态的问题。该方法通过对比保持顺序的视图与按Kendall tau距离分级的同视频重排序反事实，监督选定的深层最后一帧视频令牌，无需改变模型架构，即可提升模型在时序理解基准上的整体性能。

Details

Motivation: 现有VideoLMs接收有序视频流，但其主要监督作用于生成的文本，而非视频令牌表示，这导致模型可能从物体、场景和语言先验等捷径学习时序答案，而无需内部视频表示真正捕获事件进展。

Result: VT-Contrast方法在多个时序理解基准测试上提升了整体性能，且无需架构改动，兼容多种VideoLM训练任务。

Insight: 创新点在于提出了一种表示级的时序反事实对比目标，通过监督预期在语言生成前整合时序信息的深层最后一帧视频令牌，并利用Kendall tau距离分级的重排序反事实进行对比，迫使模型在视频表示层面学习事件动态，而非依赖捷径。

Abstract: Seeing frames in order does not mean representing time. Modern VideoLMs receive ordered video streams, yet their main supervision acts on generated text rather than video-token representations where event dynamics should first emerge. This mismatch allows models to learn temporal answers from shortcuts such as objects, scenes, and language priors, without requiring internal video representations to capture event progression. To address this, we propose VT-Contrast, a representation-level temporal counterfactual objective for VideoLMs. Its design asks where temporal supervision should act and what temporal differences it should expose. VT-Contrast supervises selected late-layer last-frame video tokens, where temporal information is expected to be integrated before language generation, and contrasts order-preserving views with same-video reordered counterfactuals graded by Kendall tau distance. It requires no architectural changes, is compatible with diverse VideoLM training tasks, and improves overall performance across temporal understanding benchmarks. Our code is available at https://github.com/ANDgate99/VT-Contrast.

[93] Efficient Semantic Understanding from Digital Foveation cs.CVPDF

Caterina Caccavella, Vittorio Fra, Andreas Ziegler, Giulia D’Angelo, Yulia Sandamirskaya

TL;DR: 本文提出了一种受生物视觉启发的数字中央凹感知方法，用于高效语义理解。该方法通过结合显著性驱动的注视点选择、高分辨率中央凹观测、低分辨率上下文信息、语义积累和自适应计算，构建了一个轻量级主动视觉流程。实验表明，该方法能以极低的计算成本实现接近密集预测基线的语义理解性能。

Details

Motivation: 密集语义分割在整个图像上均匀分配计算资源，而不考虑场景复杂性或任务相关性，这导致了计算效率低下。本文的动机是探索是否可以通过模拟生物视觉的中央凹感知机制，以更高效、选择性的方式实现语义理解。

Result: 在ADE20K-Object数据集上，单次中央凹观测达到了基线Top-1准确率的95.9%和Top-3准确率的96.9%，而计算成本仅为基线的4.7%。在场景层面，通过语义积累恢复了基线物体召回率的90.6%，同时使用了58.6%的计算量。

Insight: 核心创新点在于将生物视觉的中央凹机制（选择性高分辨率处理）引入计算视觉，提出了一种非均匀、任务驱动的感知范式。这挑战了传统密集预测的均匀计算模式，并引入了基于物体级别的评估协议，为高效视觉系统设计提供了新思路。

Abstract: Dense semantic segmentation allocates computational resources uniformly across the entire image, regardless of scene complexity or task relevance. Inspired by biological vision, we investigate whether semantic understanding can be achieved more efficiently through digital foveated perception. We introduce a lightweight active-vision pipeline that combines saliency-driven fixation selection, high-resolution foveal observations, low-resolution contextual information, semantic accumulation, and adaptive computation. Beyond conventional dense prediction metrics, we use object-level evaluation to measure semantic understanding under sparse observations. On ADE20K-Object, a single foveated observation achieves 95.9% of the baseline Top-1 accuracy and 96.9% of the baseline Top-3 accuracy while requiring only 4.7% of the computational cost. At the scene level, semantic accumulation recovers 90.6% of the baseline object recall while using 58.6% of the computation. These results suggest that substantial semantic understanding can emerge from sparse observations when computation is allocated selectively, highlighting active vision as an efficient alternative to uniform dense processing and motivating evaluation protocols beyond conventional pixel-wise segmentation metrics.

[94] CORE: Improving Compositional Reasoning in MLLM Embedding via Reranker Distillation cs.CV | cs.AI | cs.CL | cs.IRPDF

Tingyu Song, Mingxin Li, Yanzhao Zhang, Dingkun Long, Chu Liu

TL;DR: 本文提出了CORE方法，旨在通过重排序器蒸馏来提升多模态大语言模型（MLLM）嵌入模型的组合推理能力。该方法通过合成涵盖五个组合匹配级别的候选列表，并引入Rank-KL目标函数，训练嵌入模型以复现重排序器的细粒度排序结果。

Details

Motivation: 现有的MLLM嵌入模型在组合检索任务上存在局限，难以区分包含相同概念但属性-对象绑定关系不同的场景。然而，同样的模型主干作为交叉注意力重排序器时却能解决此类区分，这促使作者将重排序器的组合判断能力蒸馏到嵌入模型中。

Result: 在三个组合推理基准测试（COLA, SUGARCREPE++, NEGBENCH）上，CORE-RERANKER-8B模型取得了82.7%的总平均分，比Jina-Reranker高出10.7个百分点；CORE-EMBED-8B模型在所有评估的嵌入模型中取得了最佳总平均分（0.666）。改进效果也迁移到了MCMR基准上，且未牺牲在COCO和Flickr30K上的检索性能。

Insight: 核心创新点在于提出了一种通过重排序器蒸馏来增强嵌入模型组合推理能力的框架，并引入了多级监督的合成候选列表和Rank-KL目标函数。客观来看，该方法有效地将重排序器的细粒度判别能力注入到轻量级的嵌入模型中，并通过系统性的比较验证了列表式Rank-KL损失函数在利用多级监督方面优于对比学习和成对CoSENT方法。

Abstract: MLLM-based embedding models remain limited in compositional retrieval, often failing to distinguish scenes containing the same concepts but different attribute-object bindings. Yet the same backbone can resolve such distinctions when used as a cross-attentive reranker, motivating us to distill its compositional judgments into the embedding model. We propose CORE, which synthesizes candidate lists spanning five compositional matching levels and introduces a Rank-KL objective that trains the embedding model to reproduce the reranker’s fine-grained ranking. We further introduce a graded evaluation protocol and compare contrastive learning, pairwise CoSENT, and listwise Rank-KL under the same data and tuning budget. Our comparison shows that both CoSENT and Rank-KL use the multi-level supervision more effectively than contrastive learning, with Rank-KL achieving the strongest overall performance. Across three compositional reasoning benchmarks (COLA, SUGARCREPE++, NEGBENCH), CORE-RERANKER-8B achieves an 82.7% total average, outperforming Jina-Reranker by 10.7 points, while CORE-EMBED-8B achieves the best total average (0.666) among all evaluated embedding models. The improvements transfer to the MCMR benchmark without sacrificing retrieval performance on COCO and Flickr30K.

[95] BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Data cs.CVPDF

Wei Zhang, Xin Li, Peishu Shi, Jialin Gao, Xuekang Peng

TL;DR: 本文提出BooM-VVT，一个基于关键帧驱动范式的无掩码视频虚拟试穿框架。它通过多阶段训练策略利用图像级伪数据进行无掩码定位学习，并引入服装敏感关键帧采样和帧共享3D-RoPE来提升服装一致性与细节传递，同时构建了大规模多视角数据集OmniView。实验表明该方法在时间一致性和服装保真度上优于现有方法。

Details

Motivation: 现有视频虚拟试穿方法依赖掩码定位试穿区域，对大幅运动和严重遮挡敏感；且构建视频级伪数据成本高昂，关键帧采样粗糙以及多视角试穿数据稀缺，限制了服装一致性和处理多样化试穿任务的能力。

Result: 大量实验证明，BooM-VVT在时间一致性和服装保真度方面优于现有方法，达到了更优的性能。

Insight: 创新点包括：利用图像级伪数据通过多阶段训练实现无掩码定位，降低了数据成本；提出服装敏感关键帧采样以更好地捕捉服装外观；引入帧共享3D-RoPE建立时空对应关系以精确传递服装细节；构建大规模多视角数据集OmniView支持复杂场景。这些方法共同提升了视频试穿的鲁棒性和质量。

Abstract: Video virtual try-on (VVT) aims to generate realistic videos of a person wearing a target garment. Recent methods leverage a keyframe-driven video generation paradigm to improve in-the-wild performance, yet they still rely on masks to localize try-on regions, making them vulnerable to large motions and severe occlusions. Although mask-free image-based try-on methods have shown promising results by leveraging large-scale pseudo data, extending this paradigm to videos remains difficult, as constructing video-level pseudo data is prohibitively expensive. Furthermore, coarse keyframe sampling and the scarcity of multi-view try-on data limit existing keyframe-driven methods in maintaining garment consistency and handling diverse try-on tasks. To address these challenges, we propose BooM-VVT, a mask-free VVT framework built upon the keyframe-driven paradigm. To achieve mask-free VVT, we introduce a multi-stage training strategy that leverages image-level pseudo data for mask-free localization learning, substantially reducing the need for costly video-level pseudo data. To improve garment consistency, we propose Garment-Sensitive Keyframe Sampling, which selects keyframes based on garment-relevant body regions to better capture garment appearance. We further introduce Frame-Shared 3D-RoPE to establish spatiotemporal correspondences between keyframes and target video frames for accurate garment-detail transfer. Finally, we construct OmniView, a large-scale multi-view try-on dataset to support reliable try-on video generation under complex camera viewpoints and diverse try-on tasks. Extensive experiments demonstrate that BooM-VVT achieves superior temporal consistency and garment fidelity over existing methods. Project page: https://boomvvt.github.io/boomvvt.

[96] Zero-Shot Novel Depth Synthesis Using 3D Foundation Models Scene Representations cs.CVPDF

Denis M. Akola, David F. Fouhey

TL;DR: 本文提出了一种名为Z3D的方法，该方法利用3D基础模型（如VGGT）学习到的内部场景表示，通过潜在扩散过程，从新的视角合成未见过的深度图，实现了零样本的新颖深度合成。

Details

Motivation: 动机在于探索3D基础模型内部表示所蕴含的通用3D场景知识，并利用这些知识从新视角推断场景的3D结构，解决从单一或有限视图进行3D重建的挑战。

Result: 实验表明，Z3D能够在多个数据集上为新的视角预测出逼真的深度图，证明了其方法的有效性。

Insight: 创新点在于首次展示了可以从3D基础模型的内部表示中解码出隐藏表面，并提出了一个基于潜在扩散的零样本框架来合成新视角深度，这为利用预训练大模型的隐式3D知识进行下游任务提供了新思路。

Abstract: 3D Foundation Models (3DFMs) such as VGGT have recently pushed the boundaries of 3D vision by predicting rich unified representations with feed-foward transformers. The scene representations learned by these models enable strong performance on multiple 3D vision tasks. In this paper, we investigate using their internal representations to infer 3D in the scene from new views. Our hypothesis is that in order to solve the task of 3D reconstruction, these models need to learn a representation that includes a large amount of general knowledge about 3D scenes. After showing that it is possible to decode hidden surfaces from internal 3DFM representations, we propose a method, Z3D, that estimates pointmaps in unseen views by doing latent diffusion on 3DFM representation. We show that Z3D can predict realistic depth maps for new views across multiple datasets.

[97] Seeing Before Synthesizing: VLM-Guided Transition Event Discovery for Weakly-Supervised Dense Video Captioning cs.CV | cs.AIPDF

Ye-Chan Kim, Seunghee Choi, SeungJu Cha, Si-Woo Kim, Hwiseon Kim

TL;DR: 本文提出了一种名为Seeing Before Synthesizing（SBS）的框架，用于解决弱监督密集视频描述任务中辅助过渡描述缺乏视觉依据和分配僵化的问题。该方法利用视觉语言模型（VLM）生成帧级叙事，检测语义变化以发现过渡事件，并自适应地优化过渡事件的时间边界，从而提供视觉接地的语言指导。

Details

Motivation: 现有方法通过大语言模型（LLM）合成辅助过渡描述以增强视觉-语言对齐，但这些描述缺乏视觉依据，且以固定的位置和时长被僵化地分配到每个事件间隙中。本文旨在解决这些问题。

Result: 在ActivityNet Captions和YouCook2数据集上的实验表明，该方法在描述生成和事件定位方面均达到了最先进的（SOTA）性能。

Insight: 核心创新在于先利用VLM“观察”视频内容（生成帧级叙事、检测语义变化点），再“合成”过渡描述，实现了自适应、视觉接地的过渡事件发现与时间边界优化，而非僵化地分配LLM生成的文本。

Abstract: Weakly-Supervised Dense Video Captioning aims to localize and describe multiple events in untrimmed videos given only an ordered set of event-level captions per video. Recent work synthesizes auxiliary transition captions via LLM to provide additional vision-language alignment, but these captions lack visual grounding and are rigidly assigned to every inter-event gap at a fixed location and duration. To address these, we propose Seeing Before Synthesizing (SBS), a framework that adaptively provides visually grounded linguistic guidance only where warranted. Leveraging a VLM, we generate frame-level narratives for the inter-event gaps and detect transitions from the semantic variation across them. For identified transitions, we then refine inter-event temporal masks by blending the temporal midpoint with the semantic change point and selecting the width that maximizes vision-language alignment. Experiments on ActivityNet Captions and YouCook2 demonstrate state-of-the-art performance in both captioning and localization.

[98] Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding cs.CVPDF

Hongyu Qu, Guangming Yao, Ling Xing, Xiaobin Hu, Rongxing Ding

TL;DR: 本文提出了一种名为LatentStream的渐进式潜在工作记忆框架，用于流式视频理解。该框架将传统的存储-检索范式转变为检索-内化范式，通过分层组织视觉历史、迭代检索与内化证据，并利用置信度引导的优化，构建紧凑且持续演化的潜在记忆来指导推理。

Details

Motivation: 现有流式视频理解方法通常将历史观测压缩到外部记忆库中并检索相关证据作为视觉上下文，但这种方式无法将历史证据内化为紧凑、演化的潜在记忆以持续指导流式推理。本文旨在解决这一局限性。

Result: 在现有的在线和离线视频基准测试上，LatentStream取得了新的最先进（SOTA）结果。

Insight: 主要创新点在于提出了从“存储-检索”到“检索-内化”的范式转变，通过分层流式记忆组织、分层潜在记忆演化以及渐进置信度引导的潜在记忆优化，实现了历史证据向紧凑、固定长度潜在记忆的内化与持续演化。

Abstract: Streaming video understanding requires multimodal large language models (MLLMs) to process continuous visual inputs and respond to user queries under strict causality and bounded memory. Existing approaches typically compress historical observations into an external memory bank and retrieve query-relevant evidence as additional visual context. Though effective, this store-and-retrieve paradigm keeps historical evidence as external visual context, preventing it from being internalized into a compact, evolving latent memory that can continuously guide streaming reasoning. To bridge this gap, we introduce LatentStream, a progressive latent working memory framework that shifts streaming memory from store-and-retrieve to retrieve-and-internalize. Specifically, LatentStream comprises three coordinated components. First, Query-agnostic Hierarchical Streaming Memory organizes visual history into short-, mid-, and long-term levels under a fixed memory budget through Jenks-guided adaptive consolidation. Once a query arrives, Hierarchical Latent Memory Evolution equips groups of latent memory tokens with progressively expanding memory receptive fields, enabling them to iteratively retrieve historical evidence from their corresponding scopes and internalize it into a compact, fixed-length latent memory. Finally, Progressive Confidence-guided Latent Memory Optimization constructs a hierarchical progression reward from group-wise predictive entropy and jointly refines the latent memory tokens and retrieved evidence, encouraging increasingly confident streaming reasoning. Extensive experiments demonstrate that LatentStream achieves new state-of-the-art results on existing online and offline video benchmarks.

[99] One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing cs.CV | cs.AIPDF

Adheesh Sunil Juvekar, Onkar Kishor Susladkar, Kiet A. Nguyen, Muntasir Wahed, Nabeel Bashir

TL;DR: 本文提出了EditVid，一个无需训练的统一视频编辑框架，能够处理多种编辑范式，包括指令引导和参考引导的编辑。该框架通过稀疏因果记忆、基于对应的后注意力令牌注入和软潜在混合等技术，实现了局部连贯性、长程身份保持和编辑局部性。

Details

Motivation: 解决在单一统一框架内实现高质量指令引导和主体引导视频编辑的挑战，克服现有方法在多样编辑任务上的局限性。

Result: 在FiVE基准测试中，EditVid取得了78.16的FiVE-Acc分数，显著优于最强无需训练基线（58.95），并在IVEBench上获得有竞争力的结果；用户研究显示，EditVid相比7种竞争方法获得了51.8%的整体偏好。

Insight: 创新点在于将稀疏因果记忆、基于对应的后注意力令牌注入和软潜在混合技术结合到一个无需训练的框架中，实现了对多种编辑任务（如风格迁移、属性修改、物体插入等）的统一支持，并显著提升了编辑质量和身份保持能力。

Abstract: Video editing spans diverse editing paradigms, yet achieving high-quality instruction-guided and subject-guided editing within a single unified framework remains challenging. We introduce EditVid, a training-free framework combining sparse causal memory for local coherence, correspondence-based post-attention token injection for long-range identity preservation, and soft latent blending for edit locality. The same framework supports instruction-guided and reference-guided edits, including style transfer, attribute modification, object insertion, part-level editing, and subject replacement. On FiVE, EditVid achieves 78.16 FiVE-Acc, compared with 58.95 for the strongest evaluated training-free baseline, while obtaining competitive results on IVEBench. A user study further shows a 51.8% overall preference for EditVid over 7 competing methods.

[100] Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States cs.CVPDF

Kang Liao, Yihang Luo, Xiao-Ming Wu, Linyi Jin, Size Wu

TL;DR: 论文提出了Puffin-World，一个统一的多模态架构，能够整合物理理解、空间模拟和3D世界生成与重建，无需依赖外部离线模块。该框架联合建模了物理（重力场和纬度）、几何（深度）和外观（图像）三种原生世界状态，并引入了统一的Omni-Camera表示。通过将绝对相机属性锚定在现实世界中，Puffin-World实现了物理一致且视觉稳定的世界生成，并进一步在单个生成过程中耦合外观和几何，联合合成未来视图并重建其底层几何。

Details

Motivation: 为了解决在复杂场景中可靠构建和交互3D世界的问题，同时避免依赖外部离线模块，论文旨在开发一个统一的多模态模型，整合物理、几何和外观理解，以支持多样化的任务和灵活的运动。

Result: 为了扩展Puffin-World到复杂场景，作者构建了Puffin-16M数据集，包含1500万个视觉-语言-相机三元组和100万个具有各种挑战性运动的轨迹。论文已发布代码、模型和数据集以促进该领域研究，但摘要中未明确提及具体的基准测试或定量比较结果（如SOTA水平）。

Insight: 论文的创新点在于提出了一个统一的多模态架构，联合建模物理、几何和外观三种原生世界状态，并引入了统一的Omni-Camera表示和跨未来帧传播物理动态的策略。从客观角度看，其将外观和几何耦合在单个生成过程中的方法，以及构建的大规模多模态数据集Puffin-16M，对于推动3D世界理解和生成任务具有借鉴意义。

Abstract: We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and reconstruction without relying on external offline modules. To reliably construct and interact with 3D worlds, our framework jointly models three native world states: physics (gravity field and latitude), geometry (depth), and appearance (image), together with a unified Omni-Camera representation that supports diverse tasks and flexible motions. Beyond modeling these states, we introduce a strategy for propagating physical dynamics across future frames. By grounding absolute camera properties in the real world, Puffin-World enables physically consistent and visually stable world generation. We further couple appearance and geometry within a single generative process, jointly synthesizing each future view and reconstructing its underlying geometry. This unified paradigm enables interleaved closed-loop applications requiring synergy across multiple tasks, including mimic and self-calibrated world exploration. To scale Puffin-World to complex scenarios, we construct Puffin-16M, comprising 15 million vision-language-camera triplets and 1 million trajectories featuring various and challenging motions. To foster further research in this area, we released the code, models, and datasets.

[101] Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction cs.CVPDF

Chin-Yang Lin, Yang-Che Sun, Cheng Sun, Fu-En Yang, Min-Hung Chen

TL;DR: 本文提出Scal3R方法，用于解决在线3D重建模型在长视频上因姿态回归误差累积导致的几何崩溃问题。该方法将在线重建重新定义为多参考相对姿态查询，通过轻量级可学习令牌和冻结的主干网络，结合在线姿态图优化与闭环检测来抑制长距离漂移。

Details

Motivation: 现有在线3D重建模型在长视频上表现不佳，原因是基于固定首帧锚点的姿态回归会导致训练分布外的外推，小漂移累积放大为严重的几何崩溃。作者观察到在此过程中每帧深度保持稳定，表明局部几何完好而全局姿态头失效，这启发了对两者解耦的研究。

Result: 在KITTI数据集上，相比在线基线方法，Scal3R将平均绝对轨迹误差（ATE）降低了60%以上。此外，在Virtual KITTI、Sintel、TUM-Dynamic、ScanNet和7-Scenes等多个数据集上均达到了最先进的性能水平。

Insight: 创新点在于将在线重建重新表述为多参考相对姿态查询，并引入仅占参数约1%的轻量级可学习令牌，通过非对称注意力注入到完全冻结的主干网络中。该方法结合了在线姿态图优化与闭环检测，有效抑制了长距离漂移，且训练收敛快（单GPU 8小时）。

Abstract: Online 3D reconstruction models perform poorly on long videos. This happens because regressing poses relative to a fixed first-frame anchor forces extrapolation far beyond the training distribution. Small drifts accumulate and amplify into significant geometric collapse. However, we observe that per-frame depth remains stable throughout this failure. The backbone’s local geometry remains intact; only the global pose head breaks down. Motivated by this decoupling, we introduce Scal3R. This approach reformulates online reconstruction as multi-reference relative pose querying. We use lightweight learnable tokens, which make up about ~1% of the parameters, and inject them into a completely frozen backbone via asymmetric attention. This setup queries poses relative to multiple past keyframes. An online pose-graph optimization system with loop closure suppresses long-range drift. Scal3R reaches convergence in 8 hours on a single GPU. It reduces the average ATE by over 60% on KITTI compared to the online baseline. It also achieves state-of-the-art performance across Virtual KITTI, Sintel, TUM-Dynamic, ScanNet, and 7-Scenes. Project page: https://linjohnss.github.io/scal3r/

[102] Principia: Relational Physics Tests for Video Models cs.CVPDF

Varun Varma Thozhiyoor, Shivam Tripathi, Venkatesh Babu Radhakrishnan, Anand Bhattad

TL;DR: 该论文提出了一个名为Principia的基准测试，用于评估视频模型在牛顿物理规律方面的推理能力。该方法通过分析同一场景中成对物体运动之间的相对一致性来评估物理合理性，而不依赖于绝对运动测量。论文还引入了一种与校准无关的一致性评分，直接在图像空间中量化物理违规情况。

Details

Motivation: 评估视频模型中的物理推理能力具有挑战性，因为绝对运动测量依赖于帧率、物体尺度和相机校准等模糊或不可用的因素。因此，需要一种不依赖于校准的方法来评估物理合理性。

Result: 在六个最先进的视频生成器生成的数千个视频上测试，所有模型在Principia基准上的得分均未超过0.42，而在VBench基准上得分约为0.8。视觉语言模型在检测相对物理违规方面的最佳准确率仅为67%，大多数模型接近随机水平。

Insight: 论文的创新点在于提出了基于相对一致性的物理评估方法，避免了绝对测量的依赖，并引入了校准无关的评分机制。这为评估生成视频的物理合理性提供了更可靠和通用的基准。

Abstract: Evaluating physical reasoning in video models is difficult because absolute motion measurements depend on frame rate, object scale, and camera calibration, all of which are often ambiguous or unavailable in generated video. We propose a different approach. When two objects in the same scene obey the same physical law, their motions must satisfy predictable relationships, and these relationships hold independent of calibration. We introduce Principia, a benchmark that evaluates Newtonian physics through relational consistency between paired objects. Principia spans eight phenomena - gravity, restitution, friction, rotational inertia, projectile motion, momentum, pendulum, and mass-spring oscillation - across translational, rotational, collisional, and oscillatory dynamics, using real-world scenes recorded under controlled protocols. We also introduce a calibration-independent consistency score that quantifies physical violation directly in image space. Across thousands of generations from six state-of-the-art video generators, no model exceeds 0.42 on Principia despite all scoring around 0.8 on VBench. Vision-language models are evaluated on their ability to detect relational physics violations, with the best model achieving only 67% accuracy and most performing near chance level.

[103] Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision cs.CVPDF

Shravan Venkatraman, Wenshuai Zhao, Mohammad Hassan Vali, Arno Solin

TL;DR: 本文提出了S$^3$T（时间自监督自蒸馏）框架，这是首个完全自包含的连续视频状态跟踪方法。该方法利用时间采样密度作为特权信息，通过密集视图作为教师模型，指导稀疏视图的学生模型学习匹配其下一令牌分布，从而实现无标签、无额外教师或奖励信号的训练。在LLaVA-OneVision-2-8B上，S$^3$T显著提升了VSTAT准确率，并将从无标签合成视频学到的能力迁移到真实视频，在VSTAT-YouTube和MVBench Action Count上均取得改进。

Details

Motivation: 解决连续视频状态跟踪任务中依赖监督信号或外部奖励的问题，旨在开发一个完全自监督的框架，无需人工标注或额外模型即可学习视觉状态变化。

Result: 在LLaVA-OneVision-2-8B模型上，S$^3$T将VSTAT准确率提升+1.74（单模型）、+2.38（集成）和+2.70（结合视觉编码器适配）；在无标签合成视频上学习的能力迁移到真实视频，VSTAT-YouTube状态跟踪问题提升+7.95，MVBench Action Count提升+4.50，优于先前自演化方法。

Insight: 创新点在于将时间采样密度作为特权信息，通过自蒸馏机制让模型自我生成训练目标，实现完全无监督学习；客观分析认为，该方法避免了额外推理成本，并展示了从合成数据到真实场景的有效知识迁移能力。

Abstract: We introduce S$^3$T (Self-Supervised Self-Distillation over Time), which, to the best of our knowledge, is the first fully self-contained framework for continuous video state tracking. Our method treats temporal sampling density as privileged information, based on the hypothesis that a denser view of the same clip recovers the running state more accurately. This view serves as the teacher, while a sparse-view student with the same weights learns to match its next-token distribution. The model generates its own target, so training requires no labels, separate teacher, or reward signal, and adds no inference cost. On LLaVA-OneVision-2-8B, S$^3$T improves VSTAT accuracy by $+1.74$ as a single model, $+2.38$ with souping, and $+2.70$ with additional vision-encoder adaptation, while prior self-evolving methods leave state tracking largely unchanged. The capability learned from unlabeled synthetic clips transfers to real videos, improving performance by $+7.95$ on VSTAT-YouTube state-tracking questions and $+4.50$ on MVBench Action Count.

eess.IV [Back]

[104] Learning from Scarce Labels: Multi-View Echocardiography for Ejection Fraction Prediction eess.IV | cs.CV | cs.LGPDF

Zhiyuan Gao, Dominic Yurk, Yaser S. Abu-Mostafa

TL;DR: 本文提出了首个公开的基于胸骨旁长轴（PLAX）超声心动图预测左心室射血分数（EF）的资源。为了解决PLAX-EF数据稀缺的问题，作者创新性地利用临床记录与超声视频的时间相关性，结合视图分类器微调和代理标注，构建了一个包含超过25,000个PLAX视频的标注数据集。基于此，他们训练了首个可复现的PLAX EF预测模型，并展示了其临床可行性，以及通过多视图（PLAX与心尖四腔A4C）融合可进一步提升性能。

Details

Motivation: 解决从PLAX超声心动图视角预测EF时缺乏公开标注数据集的问题，为在无法获取临床标准A4C视图的情况下提供一种可行的替代方案。

Result: 训练的PLAX EF模型取得了6.86%的平均绝对误差（MAE），与临床标准A4C方法的性能（6%-7% MAE）相当，超越了现有方法。通过简单的未加权后期融合将PLAX与A4C预测结合，可将MAE进一步降低至6.37%，优于单视图基线。

Insight: 创新点在于提出了一种利用临床记录与视频时间相关性、结合视图分类和代理标注的数据生成策略，以克服特定医学影像视图标注稀缺的挑战。该方法证明了从非标准视图进行EF估计的临床可行性，并展示了多视图集成在提升模型性能方面的价值。

Abstract: We present, to the best of our knowledge, the first publicly available resource for predicting left ventricular ejection fraction (EF) from parasternal long-axis (PLAX) echocardiography. Because no PLAX-EF datasets previously existed, our work focuses on an innovative data generation strategy to overcome this scarcity. By leveraging a time-based correlation between clinical notes and echocardiographic videos, combined with fine-tuning view classifiers and proxy labeling, we created a labeled dataset of over 25,000 PLAX videos. This enables us to train the first reproducible PLAX EF model, achieving a mean absolute error (MAE) of 6.86%. Given that apical four-chamber (A4C) methods, the clinical standard, report MAE values of 6%-7%, our results demonstrate that EF estimation from PLAX views is both feasible and clinically relevant. This surpasses the performance of existing methods and provides a clinically relevant solution for situations where apical views may not be feasible. Going further, we demonstrate that combining PLAX and A4C predictions via simple unweighted late fusion improves both single-view baselines to a 6.37% MAE, underscoring the value of multi-view integration. To promote continued research, we release the dataset labels, trained models, and runnable demos on GitHub, Hugging Face, and Google Colab: https://github.com/Jeffrey4899/PLAX_EF_Labels_202509

cs.SE [Back]

[105] When Models Edit Too Much: On the Fidelity of Minimal Code Edits cs.SE | cs.AI | cs.CLPDF

Tongyao Zhu, Wei Hern Lim, Min-Yen Kan

TL;DR: 这篇论文研究了大型语言模型在代码编辑任务中的过度编辑问题，即模型倾向于进行超出修复错误所需的修改。作者构建了一个基于BigCodeBench的评估框架，通过注入可控的AST级损坏来创建已知最小补丁的修复任务。研究发现，即使像GPT-5.5这样的强大模型也存在普遍的过度编辑现象，导致不必要的代码修改和认知复杂度增加。通过添加保留指令可以显著减少这种行为，但改进并非简单地来自更大的推理预算或模型规模。此外，论文探讨了通过监督微调和强化学习来直接学习最小编辑的方法，发现强化学习在跨域编辑保真度和性能保持方面表现最佳。

Details

Motivation: 论文的动机是解决LLMs在代码编辑任务中过度编辑的问题，即模型不仅修复错误，还进行不必要的代码重写，这影响了修复的简洁性、可审查性和对原始实现的忠实度。

Result: 在400个BigCodeBench问题构建的评估框架上，研究发现即使GPT-5.5等前沿模型也存在普遍过度编辑，高Pass@1与不必要的编辑共存。添加保留指令后，平均超额Levenshtein距离从0.195降至0.131，添加的认知复杂度降低26.6%，Pass@1提高2.3个百分点。强化学习在跨域编辑保真度和性能保持方面达到最佳权衡。

Insight: 论文的创新点在于将编辑保真度确立为代码修复质量的一个独立维度，并提出了可量化的评估框架。客观分析认为，通过指令工程（如保留指令）和强化学习优化，可以有效提升模型的最小编辑能力，这对于实际代码修复工具的开发具有重要借鉴意义。

Abstract: Large language models (LLMs) are increasingly used to edit existing code, but correctness alone is not enough: useful repairs should also be minimal, reviewable, and faithful to the original implementation. We study over-editing, the tendency of a model to rewrite code beyond what is required to fix a bug. We construct an evaluation framework from 400 BigCodeBench problems by injecting controlled AST-level corruptions into reference solutions, giving each repair task a known minimal patch. Across frontier LLMs, over-editing is widespread even among strong models like GPT-5.5: high Pass@1 can coexist with unnecessarily large edits and added cognitive complexity. A preservation instruction substantially reduces this behavior, lowering average excess Levenshtein distance from 0.195 to 0.131, reducing added cognitive complexity by 26.6%, and increasing Pass@1 by 2.3 points. However, these gains do not simply follow from a larger reasoning budget or larger models. We next ask whether minimal editing can be learned directly during post-training. We observe that supervised fine-tuning overfits to seen corruption patterns, whereas reinforcement learning gives the best out-of-domain edit-fidelity and performance-retention trade-off. These results position edit fidelity as a distinct axis of code-repair quality and show that it can be measured and learned.

cs.RO [Back]

[106] Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies cs.RO | cs.CV | cs.LGPDF

Yue Yang, Diego Romeres, Chiori Hori, Gedas Bertasius, Daniel Szafir

TL;DR: 本文针对视觉-语言-动作（VLA）策略在有限、同质数据训练下产生的模态纠缠问题，提出了证据门控正则化（EGR）方法。EGR是一种模态无关的训练目标，通过逐帧、逐传感器计算任务相关性信号，门控两个状态条件一致性目标，以增强策略在传感器被遮挡或存在干扰时的鲁棒性。

Details

Motivation: VLA策略融合多模态感知输入，但在有限且同质的机器人演示数据上训练时，容易学习到虚假的传感器间相关性（即模态纠缠），而非任务相关信号。这导致在现实世界的遮挡和干扰下，策略对无关传感器损坏产生不必要的敏感，或在仅有一个信息性传感器可用时性能不足。

Result: 在基于BEHAVIOR-1K构建的基准测试中，EGR在完整模态下将成功率（SR）从12.5%提升至16.4%（+31%），在无关传感器损坏下从9.4%提升至16.5%（+75%），在单传感器回退下从2.8%提升至6.1%（+120%）。在两个真实机器人平台（双Kinova臂RGB相机和单臂MELFA ASSISTA结合视觉与GelSight触觉传感器）上，面对物理物体干扰，EGR分别将成功率从30%提升至85%（+183%）和从55%提升至70%（+27%）。

Insight: 论文的核心创新点是提出了证据门控正则化（EGR），这是一种无需推理开销的训练方法，通过动态评估每个传感器在每帧中的任务相关性，并据此门控施加不变性（对低证据传感器）和单传感器充分性（对高证据传感器）约束，从而解耦模态纠缠，提升策略的鲁棒性。这为解决多模态融合中的虚假关联问题提供了一个新颖的、可泛化的训练框架。

Abstract: Vision-Language-Action (VLA) policies fuse multimodal sensory inputs, but training on limited and homogeneous robot demonstrations encourages spurious inter-sensor correlations rather than task-relevant signal, a failure we term modality entanglement. Under real-world occlusions and distractors, this manifests as nuisance sensitivity to corruption of uninformative sensors and single-modality insufficiency when only one informative sensor remains intact. We propose Evidence-Gated Regularization (EGR), a modality-agnostic training objective that introduces zero inference-time overhead. EGR derives a per-frame and per-sensor task-relevance signal to gate two state-conditional consistency objectives: invariance on low-evidence sensors, and single-sensor sufficiency on high-evidence ones. We introduce a benchmark based on BEHAVIOR-1K, comprising a fast inference-only diagnostic suite and 47 rollout-based skills targeting modality entanglement. We validate EGR on this benchmark and on two real-robot setups with fundamentally different embodiments: a bi-manual setup with two Kinova arms and three RGB cameras, and a single-arm MELFA ASSISTA setup combining vision and GelSight tactile sensors. EGR improves simulation success rates (SR) from 12.5% to 16.4% under full modalities (+31%), from 9.4% to 16.5% under uninformative-sensor corruption (+75%), and from 2.8% to 6.1% under single-sensor fallback (+120%). Under physical-object distractors, EGR boosts SR from 30% to 85% on the bi-manual setup (+183%) and from 55% to 70% on the tactile setup (+27%).

[107] Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis cs.RO | cs.AI | cs.CVPDF

Sixu Yan, Shikang Wang, Binhua Huang, Xuanlai Tang, Guohua Fan

TL;DR: 本文提出了AdaRoboVLG，一个任务自适应的视觉-语言-抓取（VLG）框架，支持在不同机器人手之间进行可泛化的抓取合成。该方法将物理抓取合成与任务相关理解解耦，通过可组合的基础模型先验和可泛化的基础策略，实现了无需重新训练策略即可适应不同抓取任务的上下文自适应抓取。

Details

Motivation: 现有VLG方法通常将基础模型与端到端抓取策略紧密耦合，限制了其可扩展性和对不同任务的适应性。本文旨在解决这一问题，通过解耦物理抓取合成与任务相关理解，提供一个更可扩展的机器人抓取范式。

Result: 在广泛的仿真和真实世界实验中，基础策略表现出高效的学习能力和强大的跨手泛化能力；框架能有效整合空间、认知和时间先验，在不影响抓取合成性能（与SOTA方法相当）的情况下，解决了三个代表性抓取挑战；这些先验可以联合工作，在杂乱和动态环境中实现功能性抓取。

Insight: 核心创新在于将可泛化的物理抓取策略与提供可组合先验的专用基础模型模块解耦。这允许未来基础模型的进步能直接转化为改进的抓取能力，而无需重新设计或重新训练底层的抓取策略，为机器人抓取提供了一个可扩展的范式。

Abstract: This paper proposes AdaRoboVLG, a task-adaptive Vision-Language-Grasp (VLG) framework that supports generalizable grasp synthesis across different robotic hands. Unlike existing VLG methods that tightly couple foundation models with end-to-end grasp policies, AdaRoboVLG learns an efficient generalizable base policy that generates and evaluates physically feasible grasp candidates through explicit kinematic mapping and force-closure-based stability estimation, while offloading task-dependent understanding to specialized foundation-model modules. These modules provide composable priors that are integrated into the grasp synthesis process, enabling contextually adaptive grasp synthesis without retraining the underlying grasp policy. Through extensive simulation and real-world experiments, we demonstrate that (i) the base policy exhibits efficient learning and strong cross-hand generalization, (ii) the framework effectively incorporates spatial, cognitive, and temporal priors to address three representative grasping challenges without compromising grasp synthesis performance compared to state-of-the-art methods, and (iii) these priors can operate jointly to enable functional grasping in cluttered and dynamic environments. These results indicate that decoupling physical grasp synthesis from task-dependent understanding provides a scalable paradigm for robotic grasping, allowing future advances in foundation models to be directly translated into improved grasp capabilities without redesigning or retraining the underlying grasp policy. Supplementary videos are available at https://adarobovlg.github.io/

cs.CE [Back]

[108] What Do CAE Simulation Agents Really Need Beyond a Generic Harness? cs.CE | cs.CL | physics.comp-phPDF

Jiasheng Shi, Tianhan Zhang

TL;DR: 本文探讨了计算机辅助工程（CAE）仿真智能体在通用框架之外的实际需求。研究发现，一个配备执行反馈修复功能的单智能体通用框架，在信息访问和修复预算固定的条件下，其性能（FoamBench 96.4%）匹配甚至超过了专门的多智能体系统（88.2%）。

Details

Motivation: 动机是探究在通用框架（已提供多轮推理、工具使用和执行反馈）的基础上，CAE仿真智能体是否还需要额外的、特定于仿真的复杂机制（如多智能体分解、领域检索、脚本化反思）。

Result: 在FoamBench基准测试上，单智能体通用框架达到96.4%的成功率，优于专门的多智能体系统（88.2%）。消融实验显示，执行反馈修复将成功率从71.8%提升至96.4%，而脚本化反思没有带来增益。

Insight: 主要创新点在于揭示了对于现代基础模型，通用框架提供的核心能力（尤其是执行反馈修复）已足够，而领域知识（以求解器教程形式提供）是唯一能带来显著额外提升的输入。这挑战了为特定领域（如CAE）构建复杂专用智能体系统的必要性。

Abstract: Computer-aided engineering (CAE) simulation is among the largest and most demanding areas of engineering, where setting up a solver such as OpenFOAM, FEniCS, or COMSOL takes real expertise. Large language model (LLM) agents promise to turn a natural-language request into a working simulation, and recent CAE agents add simulation-specific machinery: multi-agent decomposition, domain retrieval, and scripted reflection. That machinery suited weak base models; modern harnesses already supply multi-turn reasoning, tool use, and execution feedback. We ask what a CAE simulation agent still needs beyond a generic harness. With information access and repair budget held fixed, a single-agent harness matches or beats multi-agent specialized systems (FoamBench 96.4% vs.\ 88.2%). Ablations trace this to capabilities the harness already provides: execution-feedback repair lifts FoamBench from 71.8% with no repair round to 96.4%, while scripted reflection adds nothing. The one input that still helps is domain knowledge supplied as solver tutorials, our largest measured gain (80.9% to 96.4%).

cs.SI [Back]

[109] When Vision Meets Graphs: A Survey on Graph Reasoning and Learning cs.SI | cs.CV | cs.LGPDF

Xinjian Zhao, Wei Pang, Zhixuan Yu, Xiangru Jian, Xiaozhuang Song

TL;DR: 这篇论文综述了视觉与图结构交叉的新兴领域，探讨了如何将图的视觉表示作为推理和学习的一类输入。文章将现有工作分为三个方向：视觉用于图推理、视觉用于图学习以及科学图领域，旨在系统梳理该领域现状并展望未来发展方向。

Details

Motivation: 尽管图神经网络（GNNs）在理论上有坚实基础，但科学家通常通过视觉（如分子图、网络可视化）来理解图结构。当前大多数图学习流程仍将图视为纯符号结构，忽略了其视觉形式，作者认为在强大的视觉和视觉语言模型时代，这一差距值得重新关注。

Result: 作为一篇综述性论文，未提供具体实验定量结果，但系统梳理了现有方法的能力与局限，并指出了该领域未来可能的发展路径。

Insight: 论文的核心创新点在于首次系统性地提出了“视觉遇见图”这一交叉领域，并构建了清晰的研究框架。其关键见解是，将图的视觉表示作为一等公民输入，可以超越传统消息传递GNN的已知局限，并可能催生能够像科学家一样感知和推理图的基石模型。

Abstract: Graphs are a fundamental data structure underlying many problems in the natural and social sciences. Over the past decade, Graph Neural Networks (GNNs) have dominated graph machine learning, supported by solid theoretical foundations. Yet scientists often understand graph structure through vision: chemists read molecular diagrams and social scientists inspect network visualizations. Despite decades of work on graph visualization, most graph learning pipelines still treat graphs purely as symbolic structures, rarely leveraging the visual form of graphs. We argue that this gap deserves renewed attention in the era of powerful vision and vision-language models. This survey provides a first systematic overview of the emerging area we term vision meets graphs, which treats visual depictions of graphs as first-class inputs for reasoning and learning. We organize existing work into three threads. Vision for Graph Reasoning studies how models can use visual depictions of graphs to understand structure and carry out multi-step reasoning. Vision for Graph Learning explores how visual features can complement or augment graph encoders beyond known limitations of message passing. Scientific Graphs examines domains where standardized depiction conventions support both reasoning and learning. Our goal is to clarify what current methods can and cannot do, and to outline a path toward foundation models that perceive and reason about graphs as scientists do.

cs.AI [Back]

[110] More Criticism Does Not Make a Better Review: EquiReview-R cs.AI | cs.CLPDF

Zexing Zhang, Jichao Li, Tianyang Lei, Yude Fu, Yang Kewei

TL;DR: 本文提出EquiReview-R，一种将AI辅助审稿重新定义为基于证据的结构化问题集细化的方法，旨在解决现有审稿系统在遗漏重要缺陷和过度批评方面的失败。通过构建证据链接轨迹语料库ReviewTrace，论文展示了在进一步搜索前进行修订的必要性，并在未见论文集上验证了该方法在减少主要遗漏和过度批评方面的有效性。

Details

Motivation: 当前AI审稿系统能产生大量具体批评，但更多批评并不等同于更好的审稿。审稿可能遗漏关键弱点或包含证据不足的指控，这两种失败需要相反的修正，而现有生成导向系统和聚合指标模糊了这种区别。

Result: 在先前未见论文的冻结队列上，EquiReview-R满足了对主要遗漏的预设非劣效性标准，将主要过度批评从15.5%降至8.1%，并在52.4%的论文上停止审稿时达到9.9%的单侧遗漏上界。计算匹配对照、受控对和消融实验表明，性能提升来自修订机制而非额外推理或更短输出。

Insight: 创新点在于将审稿重构为证据引导的结构化问题集细化过程，明确区分遗漏和过度批评两种风险，并引入修订优先于搜索的流程。客观来看，该方法通过证据链接和局部证据解析，为可解释、可追溯的AI辅助审稿提供了新框架，并公开了ReviewTrace语料库以支持审稿修订、分歧和溯源研究。

Abstract: AI reviewers can now produce many specific criticisms, but more criticism is not necessarily a better review. A review may miss a consequential weakness or retain an allegation that available evidence does not support. These failures require opposite corrections, yet generation-oriented systems and aggregate measures obscure the distinction. We therefore recast AI-assisted review as evidence-guided refinement of a structured concern set, with omission and overcritique treated as separate risks. Building on this formulation, we introduce EquiReview-R, which resolves existing concerns against localized evidence, searches for missing issues from independent and review-conditioned perspectives, and returns stop, continue, or defer. To expose the failure mode that motivates this design, we construct an evidence-linked trajectory corpus. Its retrospective analysis shows why revision must precede further search: nearly all concerns in a high-recall review lack a definitive evidential disposition, while an earlier refinement mechanism cannot revise them. On a frozen cohort of previously unseen papers, EquiReview-R satisfies the prespecified non-inferiority criterion for major omission, reduces major overcritique from 15.5% to 8.1%, and attains a one-sided omission upper bound of 9.9% while stopping on 52.4% of papers. Computation-matched controls, controlled pairs, and ablations show that the gain comes from revision rather than extra inference or shorter output. We release the corpus as ReviewTrace, an evidence-linked resource for studying review revision, disagreement, and provenance.

[111] FiMI Banking: A Sovereign Model for Indian Retail Banking cs.AI | cs.CLPDF

NPCI AI Research Team, Aman Kumar, Asit Desai, Chandra Bhushan, Harsh Sharma

TL;DR: 论文提出了FiMI Banking，一个针对印度零售银行的受控对话系统测试平台。该平台基于银行文档、结构化真值、合成客户背景和银行工具构建。研究评估了两种后训练方法：用于响应级行为的偏好优化，以及用于多轮工具使用任务的可验证奖励强化学习。

Details

Motivation: 通用语言模型在需要基于特定信息、正确使用工具或谨慎处理银行敏感场景时表现不佳，无法可靠满足银行业对安全、合规对话系统的需求。

Result: 偏好优化将超出范围请求的拒绝率从52%提升至80%。强化学习将边缘案例性能从0.509提升至0.718，顺序敏感任务性能从0.590提升至0.679，同时减少了29%的生成token。

Insight: 研究创新在于构建了一个针对特定领域（印度零售银行）的受控评估环境，并证明了偏好优化和基于可验证奖励的强化学习在提升对话系统安全性、工具使用效率和边缘案例处理能力方面具有互补作用。

Abstract: Banks need conversational systems that can answer product questions, assist customers with account-related requests, and operate safely within strict operational and regulatory constraints. General-purpose language models do not reliably meet these requirements. They fall short when a task requires grounded information, correct tool use, or cautious handling of bank-specific sensitive situations. We introduce FiMI Banking, a controlled Indian retail-banking setting. We build it from vetted banking documents, structured ground truth, synthetic customer backgrounds, and banking tools. We evaluate two post-training approaches: preference optimization for response-level behavior, and reinforcement learning with verifiable rewards for multi-turn tool-use tasks. Preference optimization improves safe behavior substantially: out-of-scope refusal rises from 52% to 80%. Reinforcement learning improves edge-case performance from 0.509 to 0.718 and order-sensitive task performance from 0.590 to 0.679, while using 29% fewer generated tokens. These results show that preference optimization and verifiable-reward reinforcement learning address complementary requirements for reliable banking agents.

[112] Instruction Duplication as an Inference-Time Control Primitive cs.AI | cs.CLPDF

Victor Lavrenko

TL;DR: 本文提出了一种称为指令复制的推理时控制方法，通过在输入中重复过程性指令（无需重新训练或修改解码过程）来提高语言模型在遵循指令任务上的确定性。该方法在多个指令调优模型和医疗选择题数据集上进行了评估，结果显示重复指令能显著提升模型通过所有八项可观测测试的比例，并减少失败案例。

Details

Motivation: 为了解决语言模型在过程性指令跟随任务中的可控性问题，尤其是在下游系统需要检查或修复生成轨迹的场景下，需要一种简单且无需重新训练的推理时控制方法。

Result: 在七个指令调优模型和300道医疗选择题的评估中，将指令复制一次（即使用两份指令）使通过全部八项测试（All-8诊断）的比例从90.22%提升至93.17%，消除了30.2%的剩余失败案例。在答案工程（AE）任务中，结合指令复制将SSNHL端点的性能从84.2%提升至97.1%。

Insight: 创新点在于提出了一种极简的黑盒推理时控制原语——指令复制，它仅通过重复输入指令即可提升模型对过程性指令的遵循确定性，且无需模型重训练或修改解码策略。其实际价值取决于下游系统如何利用暴露的生成轨迹，是一种低复杂度、对放置位置敏感的控制方法。

Abstract: Procedural instruction following is a basic requirement for controllable language-model systems, especially when generated trajectories are inspected or repaired downstream. We introduce instruction duplication, a minimal black-box inference-time control that repeats only the procedural instruction, without retraining or decoding changes. Across seven instruction-tuned models, 300 medical multiple-choice questions, eight placement conditions, and 16,800 scheduled generations, moving from one to two copies raises the deterministic All-8 diagnostic–responses passing all eight observable tests–from 90.22% to 93.17% (+2.95 percentage points), eliminating 30.2% of the failures remaining after one copy. Pre-provisional TF-IDF recall rises from 73.44% to 74.81% (+1.38 points; Holm-adjusted p < .001), while final-answer accuracy remains exactly 60.21%. Premature commitment increases from 1.52% to 2.30% (p_Holm = .00536). A blinded challenge audit yields 10/30 directional confirmations, 20/30 perceptual ties, and no reversals; its prespecified 28/30 confirmation criterion is not met. Yet this distinction can matter operationally when a downstream system acts on the generated trajectory. In Answer Engineering (AE), where explicit trajectory state determines local repair, the published reason-first no-editing SSNHL endpoint was 25.1%; system-only AE was later reproduced at 84.2%, and the same trailing duplicate raised it to 97.1%. For conductive diagnostic branch preservation, the corresponding values are 58.9% published without editing, 78.6% with reproduced AE, and 73.8% with AE plus duplication–a within-AE decrease, but still 14.9 points above the no-editing baseline. Instruction duplication is therefore a low-complexity, placement-sensitive control whose practical value can emerge through the downstream system that consumes the exposed trajectory.

[113] SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generation cs.AI | cs.CVPDF

Marco Cipriano, Leonardo Zini, Alexandra Schild, Valentin Teutschbein, Afsana Mimi

TL;DR: 本文提出了SVG-Score，一个与人类判断对齐的文本到SVG生成评估框架。作者首先指出当前基于CLIP等为自然图像设计的评估指标在SVG生成任务上存在不足，然后构建了一个用于衡量语义对齐的人类标注数据集，并在此基础上开发了两种互补的评估器：一种是与人类偏好对齐的、适用于矢量图形的CLIP评分器，另一种是通过监督微调和奖励塑形强化学习训练的VLM评判器。最后，作者使用这两种评估器对主流的开源、商业和基于优化的SVG生成器进行了基准测试。

Details

Motivation: 当前文本到SVG生成领域缺乏针对矢量图形领域的评估协议，现有方法（如CLIPScore）并非为SVG设计，且与人类判断的对齐度有限，这阻碍了该领域的进展。

Result: 作者在独立的描述集上对主要的开源、商业和基于优化的SVG生成器进行了基准测试，使用了新提出的两种评估器。

Insight: 创新点在于构建了首个用于SVG语义对齐的人类标注数据集，并基于此开发了两种互补的、与人类判断对齐的评估方法（适应矢量图形的CLIP评分器和经过精细训练的VLM评判器），为文本到SVG生成提供了更可靠、可解释的评估标准。

Abstract: Scalable Vector Graphics (SVG) generation is attracting increasing attention as generative models improve in expressiveness and controllability. Progress, however, is held back by the lack of domain-specific evaluation protocols: current practice relies on metrics designed for natural images, most notably CLIPScore, which was never trained on vector graphics and aligns only partially with human judgment. We introduce \textbf{\ours}, a human-aligned evaluation framework for text-to-SVG generation. Through controlled caption and image perturbations, we first show that CLIP-based scores barely react to the errors SVG generators actually make, such as wrong colors, counts, and spatial relations, and that off-the-shelf Vision-Language Model (VLM) judges, while more sensitive, respond unevenly across error types and SVG styles. We then introduce a human-annotated dataset for \textit{Semantic Alignment}, measuring how faithfully a generated SVG reflects its caption. Building on it, we develop two complementary evaluators: CLIP scorers adapted to vector graphics and then aligned to human preferences, for fast large-scale evaluation, and a VLM judge trained with supervised fine-tuning and reward-shaped reinforcement learning, for more expressive and interpretable assessment. Using both, we benchmark major open-source, commercial, and optimization-based SVG generators on an independent caption set.

[114] Rethinking On-Policy Distillation of Large Language Models II: One Training Example cs.AI | cs.CLPDF

Zixuan Fu, Bingxiang He, Yuxin Zuo, Haohuan Huang, Jinqian Zhang

TL;DR: 本文研究了大型语言模型（LLM）在策略蒸馏（OPD）中训练数据的作用，通过极端数据最小化实验（仅使用单个查询进行训练）发现，单查询OPD在数百步训练后能持续提升，并恢复大部分全数据OPD的收益。研究通过分析训练中访问的状态覆盖率和学生与教师对齐的速率，揭示了OPD是数据过载但算法饥饿的，即rollouts能快速提供广泛监督，而学生吸收监督的速度却逐渐减慢。

Details

Motivation: 现有工作主要关注OPD的算法行为，而训练数据的作用尚不明确。本文旨在通过极端数据最小化（单查询训练）来探究数据在OPD中的角色，以理解其成功机制。

Result: 在多个任务领域和模型家族中，单查询OPD能恢复大部分全数据OPD的增益；单个查询的状态覆盖率已达71.5%，16个语义不同的查询可达到98.9%的覆盖率，匹配全数据训练效果；多教师OPD中，每个领域16个语义多样查询也能匹配全数据MOPD。

Insight: 创新点在于揭示了OPD的数据效率本质：rollouts能快速覆盖广泛的状态（提供密集监督），但模型吸收监督的速度缓慢，表明未来工作应关注OPD的步进效率而非单纯增加数据；状态覆盖率可作为评估查询集有效性的指标，且任务内容与诱导的状态覆盖率可以分离（如内容轻量模板也能接近真实查询基线）。

Abstract: On-policy distillation (OPD) combines student-generated rollouts with dense token-level supervision from a teacher. Existing work has mainly studied its algorithmic behavior, leaving the role of training data unclear. We examine this role at the data-minimal limit by training on a single query. One-shot OPD keeps improving for hundreds of steps and recovers most of full-data OPD’s gain across task domains and model families. We explain this result through the states visited during training and the rate at which the student aligns with the teacher. We measure \emph{state coverage}, the fraction of the states full-data OPD visits that a query set’s rollouts reach. A single query already reaches (71.5%), most of it within the first 100 steps. Adding semantically distinct queries raises coverage and validation accuracy together, until 16 queries reach (98.9%) and match full-data training. Yet alignment slows at a similar pace whether OPD trains on one query or the whole dataset, and even a fixed set of states takes hundreds of steps to absorb. OPD is therefore data-overfed but algorithm-starved. Its rollouts quickly expose broad supervision, while the student absorbs that supervision increasingly slowly. The state-coverage result extends to multi-teacher OPD, where 16 semantically diverse queries per domain match full-data MOPD. As a further stress test, content-light templates and off-domain WildChat queries also approach the real-query baseline. Task content and induced state coverage can therefore come apart. We hope these findings direct future work toward the step efficiency of OPD, and prompt a re-examination of the data and the mechanisms behind its recent successes in frontier post-training.

cs.LG [Back]

[115] Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

Zhiwei Zhang, Zechen Sun, Fei Zhao, Kang Peng, Bin Liang

TL;DR: 本文提出了教师门控在线策略蒸馏（TGOPD）方法，以解决传统在线策略蒸馏（OPD）中教师模型可能提供错误监督信号的问题。该方法在提示级别验证教师的可靠性，仅当验证通过时才使用教师的密集监督，否则转向基于验证器的GRPO训练。在数学、代码和指令遵循任务上，TGOPD在4B和35B参数规模的学生模型中均优于传统OPD，并显著提高了异步训练中教师节点的GPU利用率。

Details

Motivation: 传统在线策略蒸馏（OPD）对所有提示统一应用教师模型的密集监督，但未验证教师对每个提示的可靠性。由于反向KL散度的模式寻求特性，一个自信但错误的教师会产生强烈但误导性的更新，因此需要在提示级别验证教师可靠性后再决定是否采纳其监督。

Result: 在数学、代码和指令遵循三个领域的六个单域设置中，TGOPD均优于传统OPD。在多域训练下，两个模型规模（4B和35B）在七个基准测试上的平均性能也更高。此外，TGOPD将异步OPD中教师节点的GPU利用率从9.8%提升至78.9%。

Insight: 核心创新在于提出了提示级别的教师可靠性验证机制，通过少量验证器评分的教师探针来估计可靠性，并据此动态路由训练信号（使用OPD或GRPO）。这不仅提升了性能，还通过复用闲置的教师计算能力进行可靠性估计，显著优化了计算资源利用率。

Abstract: On-policy distillation (OPD) accelerates post-training by providing dense token-level supervision from a frozen teacher on the student’s own rollouts. Vanilla OPD applies this supervision uniformly across prompts, without checking whether the teacher is reliable for each prompt. Because reverse KL is mode-seeking, a confidently wrong teacher can induce a strong yet misleading update. Distributional proxies, such as entropy or teacher-student likelihood agreement, measure uncertainty or agreement but do not directly verify outcome correctness. We introduce Teacher-Gated On-Policy Distillation (TGOPD), built on the principle that teacher reliability should be verified at the prompt level before dense supervision is admitted. TGOPD estimates reliability from a small set of verifier-scored teacher probes and routes each prompt exclusively to dense OPD when the reliability check passes or to verifier-grounded GRPO otherwise. Across 4B and 35B students in mathematics, code, and instruction following, TGOPD outperforms Vanilla OPD in all six single-domain settings and achieves higher seven-benchmark averages at both scales under multi-domain training. By using otherwise-idle teacher capacity for reliability estimation, TGOPD also reduces teacher-side compute waste in asynchronous OPD, increasing teacher-node GPU utilization from 9.8% to 78.9% in the measured 4B single-domain run.

[116] Routing Is Not Enough: Diagnosing Intra-Adapter Subspace Contention in MoE+LoRA Fine-Tuning cs.LG | cs.CLPDF

Mehreen Hossain Chowdhury, Nowshin Mahjabin, Ahmed Shafin Ruhan, Md Azam Hossain, Abu Raihan Mostofa Kamal

TL;DR: 本文研究了MoE+LoRA多领域微调中，即使专家路由近乎分离，跨领域数据仍会导致负迁移的问题。作者通过引入路由重叠和梯度相似性诊断工具，发现干扰源于不同领域的正交梯度在同一低秩适配器子空间内竞争。为解决此问题，提出了SpawnLoRA方法，在检测到适配器级竞争时动态添加门控子适配器，并在多个模型和混合设置中验证了其有效性。

Details

Motivation: 动机在于验证MoE+LoRA微调中令牌级路由能分离领域特定更新的假设，并探究当路由分离时仍出现负迁移的根本原因。

Result: 在Phi-tiny-MoE-instruct和OLMoE-1B-7B模型上的实验表明，SpawnLoRA相比标准LoRA和秩自适应LoRA，能有效减少负迁移，证明了专家内部结构分离的益处。

Insight: 创新点在于揭示了路由分离不足以保证更新兼容性，提出了基于Jaccard路由重叠和适配器-梯度余弦相似性的诊断方法，以及动态添加门控子适配器的SpawnLoRA解决方案，为MoE+LoRA架构的优化提供了新思路。

Abstract: Multi-domain fine-tuning often combines MoE routing with LoRA, assuming that token-level routing separates domain-specific updates. We test this assumption in MoE+LoRA using Python code paired with biomedical text and mathematical reasoning. Although these domains show near-disjoint expert routing, adding biomedical data substantially increases code perplexity, indicating that routing separation alone may not prevent negative transfer. To localize the failure, we introduce Jaccard routing overlap and adapter-gradient cosine similarity, which measure expert sharing and update compatibility, respectively. These diagnostics indicate that interference arises mostly from nearly orthogonal domain gradients competing within the same low-rank adapter subspace. We address this issue with SpawnLoRA, which dynamically adds gated sub-adapters inside MoE experts when adapter-level contention is detected, while keeping the router fixed. We evaluate SpawnLoRA on Phi-tiny-MoE-instruct and OLMoE-1B-7B across multiple mixture settings and find that it effectively reduces negative transfer compared with standard and rank-adaptive LoRA. These results demonstrate that structural separation inside experts provides benefits beyond routing or rank expansion alone.

[117] It’s the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories cs.LG | cs.AI | cs.CLPDF

Yigit Utku Bulut

TL;DR: 这篇论文通过引入两种反事实控制方法，挑战了关于大语言模型推理轨迹的常见解读。首先，通过重启控制的截断探测，区分了解决方案是否受限于计算预算，发现大多数情况下前缀的优势源于计算压缩而非能力提升。其次，通过难度控制的测试，发现早期内部信号中的结果信息主要源于问题难度基线，而非轨迹本身的信息。

Details

Motivation: 论文旨在澄清对LLM推理轨迹的误解，特别是关于‘突破性时刻’和早期可预测结果的解读，这些解读缺乏对具体主张层面的反事实控制。

Result: 在178个问题-模型组合中，仅1个被确认为前缀受限；重启剂量反应区分了计算匮乏与能力受限的模型。在难度控制的测试中，早期窗口内部信号未检测到超出问题难度基线的结果信息，公开语料库的分析显示，仅基于难度的代理指标在192K个DeepSeek-R1生成上AUROC达到0.873，而问题内部的评估结果与随机猜测无异。

Insight: 论文的创新点在于引入了重启控制和难度控制这两种反事实分析方法，强调了在评估LLM推理轨迹时，必须考虑计算预算和问题难度的混淆因素，并指出高聚合探测性能本身不能证明尝试内部存在信息，需要问题基线或问题内部评估。

Abstract: Reasoning traces of large language models are widely read as containing “breakthrough” moments and early-legible fates. Both readings rest on measurements missing a counterfactual control at the level of the claim; we supply both controls. First, a restart-controlled truncation probe separates when a solution fits the continuation budget from when a prefix carries value that fresh computation cannot buy, comparing per-anchor continuation solve rates against from-scratch restart curves at matched total generated-token budget. Applied to 178 problem-model cells (89 MATH problems x two small open models, an outcome-blind but difficulty-targeted cohort), exactly 1 of 178 cells survives as prefix-limited; restart dose-response separates a compute-starved model from a capability-limited one; and wherever the matched budget lies inside the restart grid, continuing the model’s own prefix beats restarting (9 of 9) – predominantly compute compression rather than expanded reachability. Second, a pre-registered, difficulty-controlled test finds no detectable outcome information in early-window internal signals beyond a problem-difficulty baseline, and two generation-free analyses of public corpora show why this control is needed: a trace-blind difficulty proxy reaches AUROC 0.873 on 192K DeepSeek-R1 generations – inside the published probe range – and a closely matched reconstruction of the closest published early-window positive recovers a comparable pooled result (0.849) while within problem it is statistically indistinguishable from chance at all ten anchors (0.496 at t=4); a post-hoc within-targeted probe finds only a small average residual, concentrated in three low-failure problems. High pooled probe AUROCs cannot by themselves establish within-attempt information; a question-only baseline or within-problem evaluation is required.

[118] Headroom-Drift Replay: A Primitive for Principled Replay Control in GRPO cs.LG | cs.AI | cs.CLPDF

Hyun Bin Park, Du-Seong Chang

TL;DR: 本文提出了一种名为Headroom-Drift Replay的、用于GRPO（推测为一种强化学习优化方法）的组级回放控制原语，旨在通过有原则的回放选择来减少基于RL的推理模型后训练中重复生成新轨迹的负担。该方法将回放决策分解为评估剩余学习价值的Headroom和评估与当前策略兼容性的Drift两个部分，无需改变原始策略流或增加额外生成/训练机制。

Details

Motivation: 在基于强化学习的推理模型后训练中，特别是在智能体场景下，重复生成新的环境交互轨迹成为主要瓶颈和计算成本来源。现有回放方法通常与探索、经验重组或混合策略优化等复杂流程耦合，难以单独评估回放选择本身的效果。本文旨在探究仅通过有原则的回放选择能达到何种效果。

Result: 在数学推理、多模态推理和智能体搜索基准测试中，该方法在Avg Mean@32指标上优于朴素回放方法，并匹配或超越了更复杂的回放方法。在环境交互成本占主导的智能体搜索任务中，该方法能以显著更低的实际运行时间获得可比较的结果质量。

Insight: 核心创新在于将回放控制解耦为一个独立的、可分析的“原语”，通过Headroom（剩余价值排序）和Drift（策略兼容性门控）两个简单决策机制实现高效经验复用，避免了复杂训练管道的干扰，为理解和优化回放机制提供了一个清晰、轻量级的框架。

Abstract: RL-based post-training for reasoning models is increasingly bottlenecked by repeated fresh rollout generation, particularly in agentic settings where environment interaction dominates wall-clock cost. Replay can reduce this burden by reusing past trajectories, but existing methods typically embed it within larger training pipelines involving exploration, experience restructuring, or mixed-policy optimization. This makes replay’s own contribution difficult to isolate. We ask a focused question: how far can principled replay selection alone go? We introduce Headroom-Drift Replay, a group-level replay control primitive for GRPO that separates reuse into two decisions. Headroom ranks stored groups by remaining learning value, while Drift gates them by compatibility with the current policy. The fresh on-policy stream remains unchanged, and the method adds no auxiliary generation or training machinery. Across mathematical reasoning, multimodal reasoning, and Agentic Search benchmarks, this single intervention outperforms naive replay and matches or exceeds broader replay methods on Avg Mean@32. In Agentic Search, where environment interaction dominates cost, it delivers comparable quality at materially lower wall-clock time.

Table of Contents

cs.CL [Back]

[1] R$^{2}$Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG cs.CL | cs.IRPDF

[2] Dual-Form ASR: Semantics-Aware Inverse Text Normalization for Chinese Speech Recognition cs.CL | cs.SDPDF

[3] RL-ADA: A World-Feedback Framework for Adversarially Robust Enterprise Dialogue Agents cs.CLPDF

[4] Judging LLM-as-a-Judge: Concerning Rubric Artifacts in LLM-based Automated Text Generation Evaluation cs.CL | cs.AIPDF

[5] LexIssue: Benchmarking Legal Issue Identification in Chinese Civil Litigation cs.CLPDF

[6] Jina-OCR-v1: Efficient Document Parsing with Speculative Decoding and Dense Verifiable Rewards cs.CL | cs.CVPDF

[7] MemoryLACE: Memory Lifecycle-Aware Consolidation and Evidence Retrieval cs.CL | cs.LGPDF

[8] Large Language Models in Resolving Contextual Knowledge Conflicts cs.CLPDF

[9] SWIM: Student Writing Simulation via Proficiency-Conditioned Generation cs.CL | cs.LGPDF

[10] What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation cs.CL | cs.LGPDF

[11] Contextual Tamil Spelling and Grammar Correction Using Progressively Fine-Tuned Sequence-to-Sequence Transformers cs.CLPDF

[12] Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue cs.CLPDF

[13] TabScope: Question-Adaptive Scope Selection for Table Question Answering cs.CL | cs.AIPDF

[14] Less Is Moral: A CHARMing Framework for Moral Foundations Detection in Endorsement Behaviour cs.CL | cs.CY | cs.SIPDF

[15] FPCO-Dialog: A Multi-Turn False-Premise Benchmark for Correction and Cooperation in Vision-Language Models cs.CLPDF

[16] Lngram v2: Latent N-Gram Memory with Interpretable Discrete Representations cs.CLPDF

[17] Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning cs.CLPDF

[18] When Users Don’t Ask: Benchmarking Context-Driven Memory Retrieval in Conversational Agents cs.CL | cs.AIPDF

[19] Lost in Reordering: Structural Sensitivity of Multilingual LLMs under Semantics-Preserving Perturbations cs.CLPDF

[20] How Far Can Synthetic Data Take Thai OCR? cs.CL | cs.AI | cs.CVPDF

[21] KhatianDoc: A Human-Verified Benchmark Diagnosing Multimodal LLM Failure on Bengali Legal Land Records cs.CLPDF

[22] Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation cs.CL | cs.AIPDF

[23] Doesn’t Stop Reasoning: Analysis of Spurious CoT Termination cs.CL | cs.AIPDF

[24] Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks’ financial statements cs.CL | cs.AI | cs.CE | cs.IRPDF

[25] A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural Entities cs.CLPDF

[26] Opening mind by opening architecture: analysis strategies cs.CLPDF

[27] Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks cs.CL | cs.AIPDF

[28] Typological Feature Prediction with Large Language Models: An In-Context Learning Approach cs.CLPDF

[29] Beyond Shallow Alignment: How Post-Training Methods Determine Refusal Circuits And Steering Robustness cs.CLPDF

[30] RuleMem: Active Rule Memory for Long-Term Conversational Agents cs.CL | cs.IRPDF

[31] Fixed Suffix Dependency Ratio: Quantifying the Dual-Track Mechanism of Gender Assignment in Latvian Loanwords cs.CLPDF

[32] Two-Stage Reinforcement Learning for Sound and Adversarial Test Generation in Code LLMs cs.CL | cs.LGPDF

[33] Translation as a Decision Space: A Multi-Agent Perspective on Low-Resource Dialect Generation cs.CL | cs.AIPDF

[34] Last Translation Benchmark cs.CLPDF

[35] Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR cs.CL | cs.AI | cs.LGPDF

[36] Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning cs.CL | cs.LGPDF

cs.CV [Back]

[37] Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers cs.CV | cs.CRPDF

[38] Position: Unlabeled IS NOT Equal to No Human Supervision in Visual Learning cs.CV | cs.LGPDF

[39] Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling cs.CVPDF

[40] VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement cs.CVPDF

[41] Who Speaks for the Pruned? Visual Token Pruning as Coverage Optimization cs.CV | cs.CL | cs.LGPDF

[42] RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning cs.CV | cs.ROPDF

[43] Learning to Zoom Efficiently with a Contrastive Curriculum cs.CV | cs.CLPDF

[44] ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers cs.CVPDF

[45] Counting Animals in Camera-Traps Image Sequences without Count Labels: Winning Solution to the iWildCam 2021 Challenge cs.CVPDF

[46] MedQA-MM: Shortcuts Behind Medical Visual Reasoning cs.CV | cs.CLPDF

[47] Exploring the Potential of Contrastive Language-Image Pre-training for Multi-Source Remote Sensing Data cs.CV | cs.AIPDF

[48] Neural-Collapse-guided Task-Free Continual Anomaly Detection cs.CVPDF

[49] Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage cs.CV | cs.MMPDF

[50] When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals cs.CVPDF

[51] Preserving Knowledge across Space and Time for Continual Video Deepfake Detection cs.CVPDF

[52] When Depth Hurts: Reliability-Aware Geometry Distillation for Depth-Free RGB-D Salient Object Detection cs.CVPDF

[53] Preprocessing Failure and Adversarial Detection in Depthwise-Separable Edge Vision Systems cs.CV | cs.CRPDF

[54] Neural Video Compression Based on Deformable Temporal Alignment and Difference-aware Fusion cs.CV | cs.AIPDF

[55] SafeRI: Recognition and Intervention for Token-Level Safety Intervention in Large Vision Language Models cs.CVPDF

[56] Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation cs.CV | cs.GRPDF

[57] FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow cs.CVPDF

[58] Occlusion-Robust Multimodal Emotion Recognition in VR via Fusion of Facial Images and EMG cs.CV | cs.HCPDF

[59] Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving cs.CVPDF

[60] SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving cs.CV | cs.ROPDF

[61] EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders cs.CV | cs.AIPDF

[62] Stabilizing Camera-Controlled Novel View Synthesis at Inference Time cs.CVPDF

[63] Tree-Structured Vector Quantization For Efficient And Progressive Image Compression cs.CVPDF

[64] PL-SCEA: Reconfiguring Pretrained Attention for Few-Shot Industrial Anomaly Detection cs.CVPDF

[65] Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations cs.CVPDF

[66] Cross-Dataset Transfer and Reliability of Explainable Artificial Intelligence for RhythmFormer Remote Photoplethysmography cs.CV | cs.AI | eess.IVPDF

[67] Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation cs.CVPDF

[68] CoFiE: Coarse-to-Fine Evidence Selection for Efficient Streaming Video Understanding cs.CVPDF

[69] DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data cs.CV | cs.ROPDF

[70] MetaStructAtlas: A Grounded 3D Vision-Language Dataset and Benchmark for Functional and Structural Reasoning in Whole-Body PET/CT cs.CVPDF

[71] SignSeek: Learning Transferable Representations for Sign Dictionary Retrieval cs.CVPDF

[72] Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning cs.CVPDF

[73] ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation cs.CV | cs.AIPDF

[74] KnowVis: Knowledge-Centric Visual Summarization for Video Lectures cs.CV | cs.CLPDF

[75] A Reverse Sign Language Dictionary: Open-Vocabulary Sign Recognition from Continuous Signing via Video Captioning and Description Retrieval cs.CV | cs.CLPDF

[76] LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes cs.CV | cs.AIPDF

[77] Urban Boundaries, Social Barriers: A Benchmark and Vision-Centric Framework for Mapping Gated Communities and Equity Implications cs.CVPDF