cs.CL [Total: 33]
cs.CV [Total: 89]
cs.AI [Total: 16]
cs.CR [Total: 2]
cs.GR [Total: 1]
cs.HC [Total: 2]
cs.IR [Total: 1]
cs.LG [Total: 17]
cs.RO [Total: 7]
cs.SE [Total: 1]
eess.AS [Total: 1]
q-bio.QM [Total: 1]

cs.CL [Back]

[1] MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis cs.CL | cs.CVPDF

Rajdeep Pandhare, Rohit Kundaikar, Yakub Kojar, Shreyansh Tiwari

TL;DR: MeddeX结合QLoRA微调LLaMA-3、检索增强生成和Gemini视觉层，分析文本PDF、扫描PDF及放射图像，并通过报告级检索和纵向比较生成带证据摘要。

Details

Motivation: 医疗报告日益复杂，人工审阅耗时、易错且难以扩展；系统需处理文本原生PDF、扫描图像PDF和影像，并为问答提供报告上下文依据。

Result: MeddeX以8B LLaMA-3经QLoRA微调，结合RAG和多模态Gemini视觉层。混合提取流程包含针对损坏及UTF-16编码文档的垃圾文本检测；系统还提供报告范围检索、自动纵向报告比较，以及按需回填旧文档的自修复流程。相较LLaMA3-Med42-8B基座，评测ROUGE-1提高9.2%、ROUGE-2提高10.0%、ROUGE-L提高11.8%、BLEU提高71.4%、BERTScore提高0.8%。系统由FastAPI、Supabase向量库和Next.js前端组成。

Insight: 报告级检索和纵向比较可把摘要与特定文档证据及时间变化关联；多格式提取则覆盖文本与扫描输入。摘要中的自动文本指标提升不能等同于临床正确性或决策支持有效性，未报告医生评审、错误率或前瞻临床验证。

Abstract: Modern healthcare generates increasingly complex medical reports that challenge clinical professionals in terms of time and interpretive burden. Manual review processes are slow, error-prone, and difficult to scale. This paper presents MeddeX, a Medical Report Analyzer that combines a QLoRA fine-tuned LLaMA-3 (8B) model with Retrieval-Augmented Gen eration (RAG) and a multimodal Gemini Vision layer to deliver accurate, concise, and evidence-backed summaries of medical documents. The system handles text-native PDFs, scanned image based PDFs, and direct radiological images through an intelligent hybrid extraction pipeline that includes a novel garbage-text detection mechanism for corrupted and UTF-16-encoded doc uments. Beyond single-report Q&A, MeddeX introduces report scoped retrieval for precise contextual grounding, an automated longitudinal report comparison engine, and a self-healing backfill pipeline that lazily processes legacy documents on demand. A FastAPI backend, Supabase vector store, and Next.js fron tend complete the end-to-end architecture. Evaluation against the base LLaMA3-Med42-8B model demonstrates consistent improvements across ROUGE-1 (+9.2%), ROUGE-2 (+10.0%), ROUGE-L (+11.8%), BLEU (+71.4%), and BERTScore (+0.8%), validating the benefit of domain-specific fine-tuning. MeddeX represents a practical and robust step toward AI-assisted clinical decision support.

[2] AbridgeKV: Compressing Long Reasoning into the KV Cache of Learned Pause Tokens cs.CL | cs.LGPDF

Jack Cai, Lijie Yang, Vasilis Kontonis, Dimitris Papailiopoulos, Shivam Garg

TL;DR: AbridgeKV将已生成的长推理文本压缩到少量可学习暂停token的KV缓存中，在保留准确率和输出长度的同时显著降低缓存占用并加速推理。

Details

Motivation: 长链式推理的KV缓存会随生成token线性增长，造成推理的内存瓶颈；直接淘汰缓存条目会让未在这种缓存状态上训练过的模型生成更长文本，无法有效解决问题。

Result: AbridgeKV在每个生成文本块后插入若干带训练嵌入、但不产生输出的暂停token，让其KV表示压缩该块，再释放原始缓存。方法将暂停token置于被替换文本块的内部位置，按层中缓存条目的测量价值分配预算，并使用较大的压缩块。在AIME、HMMT、AMC、BRUMO、CMIMC和SMT共446道竞赛题、32K token生成设置中，保留四分之一生成缓存时，准确率与输出长度匹配同数据训练的全KV模型；同预算下优于最强已发表淘汰方法，且比最接近的同数据重训压缩器高10个百分点。vLLM部署时每序列缓存缩小3.5倍，饱和H100完成一道题的速度为全KV的3.2倍。

Insight: 结果表明，训练模型主动压缩自身历史可能比推理时直接删缓存更有效，尤其适合长推理的显存和吞吐优化。摘要报告的是竞赛数学任务和特定服务设置，不能直接推断其他任务、模型或硬件上的收益。

Abstract: Long chain-of-thought decoding is memory-bound: the KV cache of the generated tokens grows linearly with the test-time compute being spent. Evicting cache entries does not fix this, because a model never trained on a cache with entries removed generates longer, often up to the length limit. We instead train the model to compress its own output. AbridgeKV compresses each completed block of generated text into the KV entries of a few learned pause tokens. These are extra input tokens with trained embeddings that produce no output. Once the pause tokens have encoded the block, AbridgeKV frees the block’s original cache; subsequent tokens attend to the pause tokens’ KV entries in its place. Three novel choices make this work: the pause tokens’ KV entries take positions inside the block they replace, the cache budget is allocated across layers according to the measured value of each layer’s entries, and compression operates on relatively large blocks. On 446 competition problems from AIME, HMMT, AMC, BRUMO, CMIMC and SMT with 32K-token generations, keeping a quarter of the generated cache matches an identically trained full-KV model in accuracy and output length; the strongest published evictor at a matched budget writes far longer, and the closest trained compressor, retrained on the same data, loses 10 points. Served in vLLM, the cache is 3.5x smaller per sequence and a saturated H100 finishes a problem 3.2x faster than with full KV.

[3] CoTS: Competitive Token Selection for Latent Reasoning in Large Language Models cs.CL | cs.AIPDF

Jie Yu, Yuxi Sun, Zhaoxu Li, Chunxiao Liu, Xudong Jiang

TL;DR: CoTS根据推理步骤中最可能与次可能令牌之间的概率竞争程度，连续调节离散令牌承诺与软表示探索，无需训练、手调阈值或额外前向。

Details

Motivation: 潜在推理能以连续软嵌入保留多种推理路径，但不同步骤对潜在介入的需求不同：确定时适合离散提交，模糊时应保留备选。既有方法通常采用全局软激活或按不确定度阈值硬切换，形成二元决策。

Result: 竞争令牌选择（CoTS）以两个最高概率候选之间的竞争为信号，在每个推理步骤连续分配潜在介入强度：若一个候选明显占优，则表示靠近采样离散令牌以维持推理轨迹稳定；竞争增强时，逐渐增加软表示的贡献以保留可信替代项。该方法无需人工调整切换阈值或混合系数，也不增加前向计算。六个推理基准实验显示，CoTS持续优于标准思维链和先进免训练潜在推理方法。

Insight: 逐步适应的不确定度介入能在稳定提交与备选探索之间折中，避免全局开关策略。摘要未给模型、基准名称及具体准确率增幅，也没有报告软表示生成和显存开销。

Abstract: Recent latent reasoning methods move beyond discrete Chain-of-Thought (CoT) by replacing sampled tokens with continuous soft embeddings or hidden states, enabling richer intermediate representations and preserving alternative reasoning paths. However, the need for latent reasoning varies across decoding steps: confident predictions favor discrete commitment, whereas ambiguous steps benefit from preserving multiple plausible alternatives. Existing approaches typically handle this variation through either global soft activation or hard switching based on uncertainty thresholds, treating latent intervention as an all-or-nothing decision rather than continuously adapting its strength. To address this limitation, we propose Competitive Token Selection (CoTS), a training-free framework that reframes latent intervention from binary mode selection into continuous allocation at the token level. CoTS uses the probability competition between the two most likely candidates to dynamically balance discrete commitment and soft exploration at each reasoning step. The second candidate represents the strongest alternative to the model’s preferred continuation, so the separation between the two directly reflects the stability of the current discrete choice. When one candidate clearly dominates, CoTS keeps the representation close to the sampled discrete token to preserve a stable reasoning trajectory; as the competition strengthens, it increases the contribution of the soft representation to retain plausible alternatives. This competition-based allocation requires neither manually tuned switching thresholds nor mixing coefficients, and introduces no additional forward passes. Experiments across six reasoning benchmarks demonstrate that CoTS consistently outperforms standard CoT and state-of-the-art training-free latent reasoning methods. Our code is available at https://github.com/OkinoYu/CoTSReasoning.

[4] PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models cs.CLPDF

Giovana Kerche Bonás, Thales Sales Almeida, Marcelo da Silva Reis, Rodrigo Nogueira, Marcos Meideiros Raimundo

TL;DR: PRISM评估工具调用语言模型中的激活干预能否跨精度、语言和模型规模迁移，并利用NF4量化模型的行为标签及多语数据发现和缓解不安全工具调用。

Details

Motivation: 模型可能一边用文本拒绝，一边仍发出不安全工具调用，形成隐蔽安全漏洞；研究考察激活干预在不同精度、语言和模型规模之间的迁移性。

Result: PRISM发现，利用低资源设置，尤其是NF4量化标签和跨语言迁移，可揭示并改善模型对齐。即使场景数很少，NF4副本生成的行为标签也能稳定估计干预方向；用五种语言NF4监督得到的方向可迁移到未见阿拉伯语，在Llama-3.1-8B上无需目标语言调优便使不安全违规率降低21.95个百分点。通过配对良性激活映射，干预还可迁移至更大模型，最高覆盖70B参数规模。

Insight: 量化副本及多语言辅助监督可作为低成本信号，帮助估计安全干预并跨语言、规模复用；评价应关注实际工具调用行为，而非仅文本拒绝。摘要没有给各精度模型、违规类型和误拒率细项，21.95个百分点对应阿拉伯语、Llama-3.1-8B的报告设置。

Abstract: Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation interventions across precision, languages, and scales. Our findings demonstrate that leveraging lower-resource settings (specifically quantized NF4 labels and cross-lingual transfer) offers a robust pathway to expose and improve model alignment. Notably, using behavioral labels from an NF4 copy enables stable intervention estimation even with very few scenarios. Furthermore, these alignment improvements transfer effectively across languages: five-language NF4-supervised directions successfully transfer to held-out Arabic, reducing unsafe violations in Llama-3.1-8B by 21.95 percentage points without target-language tuning. By mapping paired benign activations, we also successfully transfer these safety interventions to much larger models (up to 70B parameters). Ultimately, PRISM highlights how auxiliary supervision from compressed models and multilingual data can uncover and mitigate hazardous tool-calling behaviors across different model families. We release all experimental code and supporting artifacts at https://github.com/GiKerche/prism, alongside an interactive explorer of recorded model responses and experimental results at https://gikerche.github.io/prism/.

[5] Prune the Summary, Not the History: Source-Judged Compaction for Long-Horizon Agents cs.CLPDF

Guanghui Min, Chen Chen

TL;DR: SJC对智能体压缩摘要逐条检查是否可追溯到环境输出或先前摘要，并删除无来源条目，旨在防止压缩器自行推理被误当作环境事实。

Details

Motivation: 长时程智能体把超窗交互历史压成自然语言摘要，但摘要常混合环境确立的事实与压缩器写入的推理，后续智能体无法区分二者；作者对一种常用结构化压缩器的分析发现，83%的失败运行可追溯到执行了摘要中的特定条目，且多数缺少环境输出支持。

Result: Source-Judged Compaction（SJC）是免训练后处理，为每条摘要内容判断是否有环境输出或上一版摘要作为来源，并删除无依据条目；不修改智能体或压缩器，每次压缩仅增加一次低成本判断请求。判定器Jev是非生成式决策模型，输出校准概率而非解释文本。在AppWorld和OfficeBench、两种智能体模型上的实验中，SJC较原压缩器将跨运行可靠性提高2.1%至8.9%，且不增加智能体令牌用量。

Insight: 压缩摘要需保留来源可追溯性，避免模型自行推理被后续当成已核验事实；逐条来源检查可以作为低干预的安全层。83%是对一种压缩器失败运行的归因分析，不代表所有失败类型；摘要未给可靠性指标定义和判断器误删率。

Abstract: Long-horizon LLM agents rely on context compaction: when the interaction history outgrows the context window, a compressor replaces it with a natural-language summary. We show that these summaries contain more than a record of what happened. Compaction prompts ask for decisions and next steps, so each summary mixes facts established by the environment with reasoning written by the compressor, and the agent cannot tell the two apart afterwards. In an analysis of a widely used structured compressor, 83% of failed runs trace back to an action that carries out a specific summary entry, most of which no environment output supports. We propose Source-Judged Compaction (SJC), a training-free post-processing step that scores each summary entry for whether it has a source in the environment outputs or the previous summary, and removes the entries that do not. It changes neither the agent nor the compressor and adds one inexpensive judge request per compaction. The judge is Jev, a non-generative decision model that answers the source question with a calibrated probability instead of text. On AppWorld and OfficeBench with two agent models, SJC improves cross-run reliability over the underlying compressor by 2.1%-8.9% without increasing the agent’s token usage.

[6] CoTranslator: Reverse to Forward Chain-of-Thought Translator for Reasoning Distillation cs.CL | cs.AI | cs.LGPDF

Zinan Tang, Zhuoshi Pan, Kairui Chen, Ze Yan, Shaomian Zheng

TL;DR: CoTranslator学习把条件于已知答案生成的反向思维链，翻译成接近经拒绝采样验证的正向推理分布，以降低数学推理蒸馏中的教师调用成本并改善学生表现。

Details

Motivation: 从问题正向生成思维链并拒绝错误答案可获得经验证数据，但难题可能需要大量教师调用；条件于已知答案的反向生成成本较低，却可能事后合理化，而且学生推理时没有答案可用，存在训练—推理不匹配。

Result: CoTranslator用少量配对的反向和经拒绝采样的正向回答训练分布翻译器，再大规模生成并验证学生训练数据。六个学生模型、六个数学基准评测中，平均准确率相较语义抑制方法最高提高5.82个百分点。对两种4B学生，该方法保留拒绝采样平均准确率的95.0%，但估算计算量只需其35.9%。无需重训练，翻译器可迁移到新的数学数据集、不同教师及STEM问题；4B和8B学生的平均STEM准确率分别提高4.88和4.31个百分点。

Insight: 少量成对数据可将低成本、答案条件化的反向推理转换为更贴近学生无答案推理分布的训练样本，兼顾成本与覆盖。35.9%是估算计算成本，摘要未给拒绝采样量、翻译错误率或各基准单项结果。

Abstract: Reasoning distillation requires chain-of-thought (CoT) data with correct answers, but obtaining such data efficiently remains challenging. Forward CoT generation (FCG) followed by rejection sampling (RS) produces verified, question-only responses, yet may require many teacher calls for difficult problems. Reverse CoT generation (RCG) is cheaper because it conditions on the known answer, but access to this answer can lead to post-hoc rationalization and a mismatch with the student’s answer-free inference setting. We propose CoTranslator, which learns to translate reverse CoT responses toward the distribution of verified forward responses. Trained on a small set of paired reverse and rejection-sampled forward responses, it supports large-scale generation and verification of student training data. Across six student models evaluated on six mathematics benchmarks, CoTranslator improves average accuracy over semantic suppression by up to $5.82$ percentage points. For two 4B students, it retains $95.0%$ of rejection sampling’s average accuracy while using $35.9%$ of its estimated compute. Without retraining, the same translator transfers to a new mathematics dataset, a different teacher, and STEM problems, improving average STEM accuracy by $4.88$ and $4.31$ percentage points for 4B and 8B students, respectively. These results show that CoTranslator offers an efficient and transferable approach to reasoning distillation.

[7] Can LLMs Anticipate Their Cruxes? cs.CL | cs.LGPDF

David Reber, James Reber, Ari Holtzman, Victor Veitch

TL;DR: 该研究把模型决策的crux定义为不同推理轨迹意见分歧、且改变答案可能改变结论的子问题，并比较先验猜测、单次推理抽取和多次轨迹对比三种识别成本。

Details

Motivation: 决策辅助需要理解模型为何推荐某个行动，但冗长解释不便使用；关键争点（crux）应揭示哪些不确定子问题若改变答案会影响结论，而不能只从单条推理文本中任意提取。

Result: 作者比较三种计算成本递增的方法：预先让模型判断决策可能的crux；生成一次回答后从推理中抽取实际出现的crux；生成多条回答并比较推理来识别分歧因素。最后一种方法使用低成本重排器，估计计算量比裁判模型低86倍。跨领域和模型实验发现，先验猜测与事后识别的重要因素关系较小；单条轨迹有帮助但仍不足以覆盖完整crux集合。因此，对高风险决策及理解模型决策空间而言，多轨迹比较不可避免。

Insight: crux是模型多次推理分布上的属性，而不是单一回答的解释；多次轨迹对比更能捕捉会改变结论的分歧因素。摘要没有列出领域、识别质量数值和总成本，86倍是相较裁判模型的估算计算差异。

Abstract: To use language models to help us make decisions we would like to understand the rationale behind the language model’s outputs. In principle, the language model provides its rationale as part of its text output. However, the sheer volume of text makes this hard to use in practice. In this paper, we are interested in extracting the cruxes that lead a model to recommend one action over another. We take a crux to be a sub-question that a model’s rollouts disagree on, where changing its value may have altered the conclusion. A crux is therefore a property of the distribution of a model’s rollouts, not of any one rollout. We consider three strategies of increasing computational cost. First, we just ask a model to identify, a priori, what the cruxes of a decision will be. Second, we have the model actually go through the process of generating a response and then extract the cruxes that arose in its reasoning. Finally, we generate many responses and extract the cruxes by comparing the reasoning across the rollouts. We make this last procedure computationally tractable with cheap calls to a reranker, an estimated 86 times less compute than a judge. We then conduct an extensive empirical evaluation to assess whether the computationally inexpensive options are sufficient. They are not. Across domains and models, we find that a model’s a priori assessment of the cruxes has little relation to the factors that are actually identified as important a posteriori. Using a single rollout helps, but is still inadequate for identifying the full set of cruxes. Accordingly, for high-stakes decisions (and to understand the space of language model decision making) the many rollout procedure is unavoidable.

[8] ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews cs.CL | cs.AI | cs.IRPDF

Zhaoqian Xue, Shaoze Zhou, Xuexin Li, Junting Mu, Haozheng Liu

TL;DR: ReviewPilot以对话方式配置PRISMA系统综述筛选条件与抽取模式，逐项记录筛选理由和抽取来源，并在流行病学专家综述上超过单提示模型及AgentSLR。

Details

Motivation: 大语言模型深度研究工具能检索和总结文献，但通常不记录哪些研究被排除，也不说明抽取数值来自文中何处，降低系统综述流程的可审计性。

Result: ReviewPilot是对话式多智能体系统，自动执行从文献筛选到信息抽取的PRISMA流程；研究者可通过对话定制筛选标准和字段模式，项目记忆保存设置及其修改。系统为每个筛选决定记录理由，为每个抽取值记录来源。在流行病学专家综述上，跨三种语言模型评测时，它超过单提示LLM和AgentSLR，筛选macro-F1最高0.776、抽取F1最高0.788。生物医学和人机交互案例研究显示其与人工标注者较一致，提示可迁移到流行病学之外。

Insight: 系统综述自动化需要保留逐条排除理由和抽取证据来源，才能支持核查与修订；对话配置和项目记忆便于复用审查规则。摘要未提供纳入研究数量、人工一致性数值及外领域系统性评测规模。

Abstract: Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at https://github.com/ZhaoqianXue/ReviewPilot.

[9] Multimodal AI Detection for Math-Heavy Scientific Text cs.CLPDF

Yixuan Huang, Danish Pruthi, Bhuwan Dhingra

TL;DR: 该研究发现仅使用PDF提取文本的AI写作检测器在数学内容增多时准确率下降，而利用保留版式信息的LaTeX或页面截图训练，可显著改善证明文本检测。

Details

Motivation: 数学密集型科学文本包含丰富的视觉格式信息，但仅分析PDF抽取文本的检测器无法利用这些布局线索，可能在证明和公式内容较多时失效。

Result: 作者从2022年前的arXiv LaTeX源文件中选取人工撰写的证明和散文，并在同一论文语境下使用15个现代大语言模型重新生成，形成LaTeX源、PDF渲染图像和抽取文本三种配对表示。最先进检测器Pangram 4在数学内容增多时准确率显著下降，文本输入尤其明显。针对该领域微调Qwen-3.5-27B检测器可恢复差距，LaTeX输入明显优于文本。考虑到实际很少能获得LaTeX，作者另训练截图检测器SnapJudge：在0.1%假阳性率下，对前沿模型生成证明和散文的检测率分别为92%和93%，显著超过Pangram 4和文本检测器。

Insight: 检测数学文本来源时保留排版结构或直接使用页面图像，能补足纯文本丢失的视觉信号；极低假阳性率下的检测率也更适合实际审查。结果基于特定合成数据构造与15个生成模型，摘要未给跨领域误报分布及真实混合作者文本的表现。

Abstract: As large language models become increasingly capable of generating, and assisting with, scientific writing, there is a need for greater transparency and disclosure around the use of AI in research. Consequently, a veritable subfield of research and a number of commercial services aim to flag AI-generated content automatically. However, existing detectors which rely only on text extracted from PDFs fail to benefit from the rich visual information contained in the formatting of math-heavy scientific content. To study this, we select human-written proof and prose passages from pre-2022 arXiv LaTeX sources and re-generate them using 15 modern LLMs within the context of the same paper. This leaves us with coupled human and AI outputs in three different representations: the LaTeX source, a rendered image of the PDF, and the text extracted from the PDF. We find that the accuracy of the state-of-the-art Pangram 4 drops significantly as the mathematical content in a passage increases, especially when evaluated on text as opposed to LaTeX. However, this is not an inherent limitation of detecting AI-generated math: finetuning Qwen-3.5-27B based detectors on this domain recovers the gap, with LaTeX inputs performing significantly better than text since they preserve more formatting information. Since LaTeX sources are rarely available in practice, we also train SnapJudge: an image-based detector operating on screenshots of both prose and proofs from papers. At 0.1% false positive rate, SnapJudge achieves a detection rate of 92% on proofs and 93% on prose generated by frontier models, substantially outperforming both Pangram 4 and our text-based detector. We release our data, models and code at https://nlplab.cs.duke.edu/snapjudge.

[10] A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models cs.CL | cs.AI | cs.MAPDF

Alessandro Rozza, Davide Mambelli, Steven Motta, Juri Taresch

TL;DR: 该研究将无标签语言模型集成视为由可靠性未知的证人组成的陪审团，用EM根据模型间答案同异估计专家权重，而无需人工标签拟合权重。

Details

Motivation: 集成系统的核心不只是看多数模型支持哪个答案，还需判断各专家是否可靠；现有方法多使用固定信誉或从标注数据学习权重，本文考察能否从无标签模型回答配置本身估计可靠性。

Result: 模型化假设是每题有潜在真实答案，各专家以未知可靠率作答；作者仅根据无标签回答配置用期望最大化估计可靠度，并证明最终决策规则等价于对专家答案分布作log-odds加权线性评分。在1,560题基准上，使用9个最多3B参数专家的陪审团，表现与同一融合规则使用标签拟合权重相当，监督未带来统计显著优势；无标签陪审团还超过匹配自一致性的最佳单模型和最强无标签基线。

Insight: 若不同专家的同异结构足以估计可靠性，集成可以减少对标注权重的依赖；投票规则本身不变，关键变化是信任度的学习方式。结果限于1,560题和9个模型组成，摘要未给具体分数、问题类别或EM估计的不确定性。

Abstract: An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not what the majority said but who is credible. Most ensemble methods assign each expert a fixed reputation, often learned from labels. We ask whether it can instead be inferred from the pattern of agreement and disagreement among the experts. We model the experts as a jury: each question has a latent true answer, each expert reports it with unknown reliability, and those reliabilities are estimated by Expectation Maximisation (EM) from unlabelled answer configurations alone. We show that its decision rule reduces to a log-odds weighted linear score over the experts’ answer distributions. What changes is not how the jury votes, but how it learns whom to trust. On a 1560-question benchmark, the jury, with nine experts of up to 3B parameters, performs comparably to the same fusion rule with label-fitted weights, showing no statistically significant advantage from supervision. Instead, it outperforms the best single model with matched self-consistency and the strongest label-free alternative on the full benchmark.

[11] From Observation to Intervention: Distilling Self-Generated In-Context Demonstrations via Executable Causal Intervention cs.CLPDF

Minming Ye, Min Liu, Haoang Chi, Ciheng Wu, Naiyang Guan

TL;DR: ECI2D把自生成示范中的自然语言理由抽象为可执行程序，并在逻辑相似样本上实施因果干预，仅保留表现具有迁移不变性的示范。

Details

Motivation: 自生成上下文学习可让模型自行合成少样本示范，但既有筛选常只看是否得到正确答案；忠实因果理由和事后编造理由可能产生相同输出，单凭观察结果无法区分。

Result: 作者提出可执行因果干预示范蒸馏（ECI2D），将语言理由转为程序，并用do算子在逻辑相似样本上实施干预；若示范蕴含的理由跨样本保持有效则保留。数学、逻辑和常识推理基准实验显示，ECI2D以更少示范持续超过基于观察筛选的上下文学习；测试分布发生变化时，收益超过7个百分点。

Insight: 示范筛选应检验理由能否支持相似问题上的因果迁移，而不是仅检查单个答案是否正确。摘要未列各基准名称和数据规模，也未给出相似样本构造与可执行程序的覆盖范围。

Abstract: Self-generated In-Context Learning (ICL) enables LLMs to synthesize their own few-shot demonstrations, often outperforming manual prompts. However, existing methods filter demonstrations by observation, assuming a rationale is high-quality if it leads to the correct output. We show such filtering suffers from \textit{observational equivalence}, whereby both faithful causal rationales and spurious post-hoc rationales can yield same outputs and are statistically indistinguishable from observation alone. Inspired by independent causal mechanisms, we argue that faithful rationales imply \textit{transfer invariance}, in which causal rationales should remain effective across logically similar samples. We instantiate this criterion as \textbf{E}xecutable \textbf{C}ausal \textbf{I}ntervention for \textbf{D}emonstrations \textbf{D}istillation (ECI2D), which abstracts language rationales into executable programs and applies the causal interventions ($do$-operator) on logically similar samples, retaining only those demonstrations that imply transfer invariance. Experiments on math, logical and commonsense reasoning benchmarks demonstrate that ECI2D consistently outperforms observation-based ICL while retaining far fewer demonstrations, with gains exceeding 7 points as the test distribution shifts.

[12] What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination cs.CL | cs.LGPDF

Esther Xin

TL;DR: 该审计比较16个开放RLVR数学语料的八种去污染策略，指出较宽松语义相似度阈值会误删大量样本；经裁判仲裁的策略在其候选范围内具有更好的精确率—召回率权衡。

Details

Motivation: RLVR数学语料常按与基准题重叠进行清洗，但清洗规则的可靠性和数据损失成本研究不足，仅报告重叠数量不能说明清洗是否误删无关训练样本。

Result: 作者审计16个开放语料、共1,673,514条语料内训练样本，对照六个基准中的1,949道题，评估基于精确、词汇和语义匹配的八种策略，并盲审594组训练—基准配对。校准集和留出集在基准题及训练样例族上互不重叠；另对80个训练样本的83个候选匹配进行误删审查。在余弦阈值0.80下，抽样移除的59项中52项（88%）被证实为误删，但这不是总体误删率。预注册0.80—0.98语义阈值均未在校准集达到90%保守精确率目标。现有裁判仲裁策略在留出语料上的已裁定精确率98.1%、候选框架召回率98.2%；六个抽样移除中无已确认误删，但另有一例未决。作者明确指出这不证明风险为零，且该召回率不衡量候选框架之外的污染。

Insight: 数据去污染需同时审计精确率、召回率和误删成本，并明确候选匹配范围；宽松语义阈值可能造成大量误删。裁判策略的高指标仅适用于评估的候选框架和校准/留出条件，不能推断未知污染或零误删。

Abstract: Reinforcement learning with verifiable rewards (RLVR) math corpora are routinely screened for benchmark overlap, but the reliability and data-loss costs of cleaning policies remain underexamined. We audit sixteen open RLVR math corpora comprising 1,673,514 corpus-specific training items against six benchmarks containing 1,949 questions. We evaluate eight policies based on exact, lexical, and semantic matching using 594 independently and blindly dual-reviewed training-benchmark pairs. Calibration and held-out sets have disjoint benchmark questions and training-example families. A separate review of all 83 candidate matches for 80 sampled training items measures item-level false removal. At cosine threshold 0.80, 52 of 59 sampled removals (88%) were confirmed false removals; this is not a demonstrated population rate. No semantic threshold in our preregistered grid (0.80-0.98) meets the 90% conservative-precision target on calibration. The existing judge-adjudicated policy achieves 98.1% resolved precision and 98.2% candidate-frame recall on held-out corpora. It has zero confirmed false removals among six sampled removals, with one unresolved case; this does not establish zero risk. Within the evaluated candidate frame, this policy offers a more favorable precision-recall balance than the semantic-threshold alternatives tested. Recall does not measure contamination outside the candidate frame. We release reviewed labels, per-policy decisions, and coverage accounting to support evaluation of cleaning reliability and cost rather than overlap counts alone.

[13] System1-Arena: Which Decisions Can Be Left to System 1? cs.CL | cs.AI | cs.LGPDF

Tianyu Chen, Xinyang Liu, Ruyi An, Zhendong Wang, Mingyuan Zhou

TL;DR: System1-Arena统一评测单次前向概率决策模型与生成式推理模型，覆盖92,000题、105项任务及138个闭环环境，用于分析哪些决策可交给System 1处理。

Details

Motivation: 现实应用中的模型常要在离散选项中快速决策；System 1可一次前向输出选项概率，而System 2生成推理过程。需要厘清哪些静态或交互决策能由轻量概率模型处理、哪些需要生成式推理。

Result: 基准包含来自268个公开来源的92,000题和105项任务，分为文本分类与知识、应用决策、评估与控制、智能体与行动四组；另含138个闭环环境，覆盖网页购物、SWE-bench代码控制、机器人、游戏和驾驶，实时设置中环境会在模型决策时继续演变。作者评测30个模型：7个闭源LLM、13个在答案令牌处读取的开源LLM和10个System-1模型。最大的System-1模型在非智能体任务上可匹配或超过快速闭源LLM，概率校准更好且延迟约为四分之一；推理LLM最准确，但成本约为快速LLM的70倍。闭环任务中大型开源LLM成功最多（最高32.9%），小型System-1模型很少成功。

Insight: 概率式一次前向模型在静态决策上可能实现更低延迟和更好校准，但复杂闭环行为仍更依赖大型生成式模型。基准结果取决于任务类型，不能用非智能体分类表现推断闭环控制能力；摘要未列各闭环环境详细成绩和成本定义。

Abstract: Large language models (LLMs) often make discrete decisions, such as flagging phishing or escalating to a human. System-1 models, such as Jev and the OpenAI Decisions API, return probabilities over options in a single forward pass, while System-2 approaches generate reasoning steps. Which decisions can System-1 models handle, and which require generative reasoning? We introduce System1-Arena, a benchmark that gives all models the same decision requests and scores their probabilities. It contains 92k questions across 105 tasks from 268 public sources, in four groups: text classification and knowledge, applied decisions, evaluation and control, and agent and action. It also includes 138 closed-loop environments, from web shopping and SWE-bench coding control to robotics, games, and driving; in real-time mode, the world evolves while a model decides. We evaluate 30 models: 7 closed LLMs, 13 open LLMs read at the answer token, and 10 System-1 models. The largest System-1 models match or exceed fast closed LLMs in non-agentic accuracy, with better-calibrated probabilities at one-quarter of the latency. A reasoning LLM is the most accurate, at about 70x the cost of a fast LLM. In closed loops, large open LLMs succeed most often (up to 32.9%); small System-1 models rarely succeed.

[14] FGSS-BO: Feedback-Guided Hypothesis Management for LLM-Based Bayesian Optimization cs.CLPDF

Hao Chen, Ziyang Ling, Ronald X. Xu, Mingzhai Sun

TL;DR: FGSS-BO为大语言模型引导贝叶斯优化引入有结构的假设状态，记录假设、可执行参数干预和跨轮证据更新，并由确定性管理器校验身份与测试记录。

Details

Motivation: LLM引导贝叶斯优化使用历史观测指导搜索，但提出和修订搜索方向的依据通常隐含在文本中，难以审查或追踪假设如何随证据变化。

Result: 反馈引导搜索状态（FGSS）把语言指导与观察证据、可执行参数干预和比较支持度更新连接起来；LLM反思器提出和修订假设，确定性整理器校验并维护假设身份及测试记录，演化状态随后引导候选构造和搜索优先级。集成到LLAMBO时保留其代理模型和默认期望改进策略，并使用有界测试策略。在两个回顾式协议/媒体任务、最近邻响应oracle设置下，FGSS-BO的最终最优值样本均值和搜索AUC高于匹配LLAMBO及受测非LLM基线。文字反思与仅EI控制显示组件效应不一；六个直接训练超参数优化任务上的迁移依任务而异，在糖尿病SVM上最明显。精确网格和反应控制另行考察其它条件。

Insight: 显式记录假设及其执行和证据修订，使黑箱式反思搜索更可审查；实验收益只在所测部分设置明显，组件消融存在混合结果。摘要未列最终目标值和AUC提升、任务规模及候选调用成本，不能概括为所有优化任务均受益。

Abstract: Large language model (LLM)-guided Bayesian optimization (BO) uses past observations to guide search, but proposed directions and their revision can remain implicit. We propose Feedback-Guided Search State (FGSS), a structured hypothesis-management interface connecting language-based guidance to observed evidence, executable parameter interventions, and comparative support updates. An LLM reflector proposes and revises hypotheses; a deterministic curator validates them and maintains identities and test records. The evolving state guides candidate construction and priorities. Instantiated on LLAMBO, FGSS-BO retains its surrogate and default expected improvement selection, with a bounded testing policy. On two retrospective protocol/media tasks with nearest-neighbor response oracles, it attains higher sample mean final best and search AUC than the matched LLAMBO baseline and evaluated non-LLM baselines. Prose-reflection and EI-only controls show mixed component effects. Six direct-training hyperparameter-optimization tasks show task-dependent transfer, strongest on diabetes SVM; exact-grid and reaction controls examine other settings. FGSS exposes hypotheses, their execution, and cross-round revisions for inspection while supporting search gains in selected settings.

[15] LLM-Based Weak Annotation for Cybersecurity Tweet Classification: A Teacher-Student Framework cs.CLPDF

Ferry Afit Kurniawan, Kazushi Okamoto, Koki Karube, Kei Harada, Atsushi Shibata

TL;DR: 该研究以教师—学生弱监督流程，用大语言模型为未标注网络安全推文生成弱标签，再训练领域预训练模型，减少依赖大规模专家人工标注。

Details

Motivation: 社交媒体上的漏洞与攻击信息可能早于正式报告出现，是网络威胁情报的重要来源；讨论量增长使专家难以逐条阅读和标注，阻碍监督式领域模型开发。

Result: 作者提出教师—学生框架，由选定大语言模型为未标注网络安全推文生成弱标签，再以这些标签训练网络安全领域预训练语言模型。仅用模型生成标签训练的学生，在所有评估架构上F1均超过0.92，与全人工监督模型的差距不超过3个百分点。

Insight: 当专家标注资源有限时，LLM弱标注可作为构建网络安全分类数据的实用替代途径，但仍有小幅差距。摘要未说明推文类别体系、数据规模、人工标签质量控制和F1具体架构结果，不能判断不同威胁类别的表现是否均衡。

Abstract: Cyber threat intelligence (CTI) relies on the timely identification of emerging threats, enabling organizations and security analysts to support situational awareness and decision-making. Social media platforms such as X (formerly Twitter) have become valuable CTI sources because vulnerabilities and attack activities are often discussed there before appearing in formal reports. However, the rapid growth of cybersecurity discussions on social media has created more content than domain experts can realistically review and annotate, making labeled data a major bottleneck for developing supervised learning approaches. While large language models (LLMs) have shown promise as weak annotators in other domains, their effectiveness for cybersecurity tweet classification and downstream training of domain-specific pre-trained language models (PLMs) remains underexplored. To address this challenge, we propose a Teacher-Student weak supervision framework in which a selected LLM serves as a Teacher to generate weak labels for unlabeled cybersecurity tweets, enabling the training of cybersecurity-specific PLMs without large-scale manual annotation. Experimental results show that PLMs trained solely on LLM-generated labels consistently achieve F1 scores above 0.92, remaining within 3 percentage points of fully human-supervised models across all evaluated architectures. These findings suggest that LLM-based weak annotation offers a practical alternative for constructing cybersecurity-specific training data when expert annotation resources are limited.

[16] Making every stage of medical device document assessment with large language models deterministic cs.CL | cs.IRPDF

Ryosuke Suzuki

TL;DR: 该研究重复调用14种商业部署的模型发现，即便采用其接受的确定性采样设置，至少一项医疗器械文件评估仍出现不一致；作者另构建端到端确定性流水线并逐阶段验证字节级复现。

Details

Motivation: 医疗器械法规符合性评估需专家逐项判断文件证据并记录结果以供复核；若LLM预审或文档处理管线重复运行给出不同结论，将削弱审计和变更控制。

Result: 作者向14种商业部署（7个模型、3家提供方、6种调用路由）在其各自接受的确定性采样设置下重复发送相同请求；每种部署至少有一项评估不同，其中12种标签发生变化。降低推理程度未能减少变化，仅对最小模型使用检索段落提示才消除变化；同一开权重模型是否可复现也取决于服务方式。作者构建逐阶段确定性管线，涵盖文本抽取/OCR、分块、嵌入、索引、检索和推理；在血糖仪及输液泵文件上，跨重复运行、中断、编辑、相同GPU型号机器及不同日期均输出逐字节一致结果。若OCR、嵌入或近似检索本身未设为不变量，这些阶段会变化；GPU型号及推理引擎调度设置也会改变输出，因而应记录在配置中。

Insight: 端到端可复现需保证每个处理和推理阶段的不变性，仅设置采样参数并不足够；硬件及调度配置也属于审计记录。结果覆盖14个商业部署及特定医疗器械文件，摘要未说明确定性管线的实现开销或法规专家对输出正确性的验证。

Abstract: To show that a medical device complies with regulation, experts judge whether documents and records meet each requirement and record the judgment for others to verify. For each assessment item that experts define, large language models could prepare a preliminary assessment: a label such as Satisfied or Not satisfied, a reason and quoted evidence. We sent fourteen commercial deployments of such models (seven models from three providers, through six routes) the same request repeatedly, with the deterministic sampling settings each accepted; every deployment returned differing assessments for at least one request, and in twelve the label changed. Reducing reasoning where the interface allows it did not reduce the variation, and prompts of retrieved passages removed it only for the smallest models. The same open-weight model was reproducible or not depending only on how it was served. A pipeline we built to be deterministic at every stage – text extraction and optical character recognition (OCR), chunking, embedding, indexing, retrieval and inference – returned byte-identical output at each stage across reruns, interruptions, edits, machines of one graphics processing unit (GPU) model and days, for blood glucose meter and infusion pump documents. OCR, embedding and approximate retrieval varied when their own serving was not made invariant, and outputs changed with the GPU model and with the inference engine’s scheduling settings, which therefore belong in the recorded configuration. End-to-end determinism is achievable and gives a testable basis for audit and change control.

[17] Emotion Is Not External Knowledge: Internal Attention Signals for Affective State Reasoning cs.CLPDF

Wenqiu Tang, Zhen Wan, Yihui Wang, Takahiro Komamizu, Ichiro Ide

TL;DR: SIAB从模型自身行为中定位稀疏情绪注意力头，并在回答位置增强这些头已经关注的内容令牌，以改进跨话题对话中的情绪状态推理。

Details

Motivation: 多轮对话需要维护话题转换后仍相关的隐含状态，如根据稀疏上下文线索推断情绪。既有注意力干预依赖带标签的领域内注意力头及外部指定目标片段，跨情绪证据分布迁移受限。

Result: 自目标内部注意力增强（SIAB）先在合成最小对上通过因果定位（具体为激活置换）识别稀疏情绪头，再于答案位置增强这些头原本关注的内容令牌；头部和目标令牌均由模型自身行为确定，同一头集合可复用于不同任务。在三个大语言模型、多种提示设置以及ECC和GoEmotions评测中，SIAB较匹配提示基线最高提升ECC宏F1 10.3分、GoEmotions宏F1 5.5分。与PASTA式外部监督结合时，准确率最高提高13.84个百分点、宏F1提高12.51分。机制分析将收益关联到稀疏且富含情绪信息的注意力头，并显示层位置会影响组合增益。

Insight: 模型内部注意力可为跨话题情绪证据路由提供无需外部标注头/片段的信号；与外部监督组合时收益更高，但效果受层位置影响。摘要未列三个模型、ECC具体指标定义及各设置的稳定性结果。

Abstract: Large Language Models (LLMs) increasingly operate in multi-turn interactions that require maintaining latent conversational states, not only explicit facts. We study affective state as an implicit state inferred from sparse contextual cues that remain relevant after topic shifts, and ask whether LLMs expose internal attention signals for routing such evidence at inference time. Prior attention interventions rely on labeled in-domain head profiles and externally specified target spans, limiting transfer across affective-evidence distributions. We propose Self-targeted Internal Attention Boosting (SIAB), which localizes sparse affective heads via causal localization (in detail activation patching) on synthetic minimal pairs and boosts, at the answer position, the content tokens these heads already attend to; both edited heads and target tokens are derived from the model’s own behavior, enabling the same head set to be reused across tasks.We evaluate on ECC and GoEmotions across three LLMs and multiple prompting settings. Across settings, SIAB improves prompt-matched baselines by up to +10.3 macro-F1 on ECC and +5.5 on GoEmotions. Combined with PASTA-style external supervision, it achieves up to +13.84 accuracy points and +12.51 macro-F1 points, while mechanistic analyses trace the gains to sparse, emotion-enriched heads and show that layer proximity affects additivity.

[18] RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design cs.CLPDF

Jingguo Liu, Yuanqing Liu, Chong Zhang, Yue Yang

TL;DR: RenoLayout将住宅翻新与家具布置统一表述为设计点引导的条件生成，输出可执行Geometry-as-Code程序，并构建设计点体系及真实前后翻新基准。

Details

Motivation: 既有户型生成方法多假设输入是空房边界，而实际翻新要保留不可改动的建筑结构；翻新和家具布局又常被分开处理，忽略空间依赖关系及建筑服务等硬约束。

Result: RenoLayout把翻新前住宅状态和设计点集合转成可执行几何代码。作者构建Design Map，包含123个覆盖结构改造与家具布局的细粒度设计点；Difference-Grounded Design-Point Annotation根据前后设计配对自动生成设计点，并以视觉语言模型进行一致性验证。模型使用CPT、SFT、RL三阶段训练，逐步加强空间推理、指令遵循和约束满足。另建立RenoLayout Benchmark，含200个真实前后翻新案例及完整家具布局，涵盖关键结构和建筑服务约束。

Insight: 把设计要求显式表示为设计点并输出可执行几何程序，有望统一处理结构保留、空间改造和家具布置。摘要未报告基准指标、基线比较或数据划分；“首个统一住宅设计基准”是作者据其所知的表述。

Abstract: Residential design aims to transform existing homes into functional living spaces while satisfying diverse design preferences and physical constraints. However, existing floorplan generation methods typically assume empty building boundaries as input, whereas renovation requires reasoning over existing floorplans. Furthermore, floorplan renovation and furniture layout are commonly addressed as separate tasks, overlooking their inherent spatial dependency. Consequently, practical residential design must preserve immutable structural components while transforming editable spatial elements. It must also optimize furniture placement under design objectives and physical constraints. To address these challenges, we formulate residential design as a design-point-guided conditional generation task and propose RenoLayout, a framework that translates a pre-design residential state together with a design-point set into an executable Geometry-as-Code program. To enable controllable supervision, we construct a Design Map comprising 123 fine-grained design points covering structural renovation and furniture layout. We further introduce Difference-Grounded Design-Point Annotation to derive design-point sets automatically from before–after design pairs with VLM-based consistency verification. RenoLayout is trained using a three-stage CPT–SFT–RL pipeline, progressively improving spatial reasoning, instruction following, and constraint compliance. We also introduce the RenoLayout Benchmark, a set of 200 real-world before–after renovation cases with complete furniture layouts. To the best of our knowledge, it is the first benchmark for unified residential design. These cases include design-critical structural and building-service constraints.

[19] Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction cs.CLPDF

SeungHyun Yi, Seungjun Yi, Sriram Sattiraju, Haeun Park, Joakim Nguyen

TL;DR: 该研究比较六种提示演化方法在社交媒体压力与情绪预测中的效果，并归纳出五类与开发集提升相关的指令策略，同时记录多标签情绪任务早期变差后部分恢复等评测现象。

Details

Motivation: 早期压力检测有助于及时评估心理健康风险，但只看准确率可能掩盖误报；提示修订在不同模型和任务上收益不一致，策略组合与指令变化之间的关系尚不明确。

Result: 作者跨两种模型规模比较六种方法。GEPA及合并两条提示指令的GEPA+merge在多个设置中超过初始提示；归纳出五类与开发表现提升相关策略：关注情绪证据、区分当前与过去困扰、提供间接线索示例、要求情绪背景、指导标签选择。另报告四项观察：二元压力预测较早改善，多标签情绪预测先下降后部分恢复；错误或相互冲突的指令会影响表现；小型比较样本上的收益未必在完整开发集保留；选中提示的开发集与报告测试排名可能变化。

Insight: 提示演化效果依赖模型、任务和评估样本规模，且指令之间可能冲突；应关注误报及完整开发/留出测试表现，而不只看单一准确率。摘要未提供数据集规模、具体指标及提示策略的统计显著性，所列策略是与开发收益相关而非因果证明。

Abstract: Early stress detection and risk prediction are crucial for timely mental health assessment and support. While large language models have recently shown promise for social media stress prediction, relying on accuracy can obscure false positives. Also, prompt revisions yield inconsistent gains across models and tasks, with unclear links to strategy combinations and instruction changes. By comparing six methods on social media stress and emotion data across two model sizes, we found that GEPA and its extension combining instructions from two prompts (GEPA+merge) improved prediction over initial prompts in several settings. We also identified five prompting strategies associated with development gains. These strategies included directing attention to emotional evidence, distinguishing current from past distress, illustrating indirect cues, requiring emotional context, and guiding label selection. Moreover, we documented four observations across tasks and evaluation settings. In a separate set of searches, binary stress prediction improved early, whereas multilabel emotion prediction initially declined and partly recovered. The other three concerned incorrect or conflicting instructions, gains on small comparison samples that did not hold on full development data, and changes in selected prompts’ development and reported test rankings. These findings identify effective prompt evolution methods, strategy combinations associated with gains, and task and evaluation limits, providing guidance for applying prompt evolution methods to social media stress detection.

[20] Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning cs.CL | cs.LGPDF

Guimin Hu, Qiwei Peng

TL;DR: FaShift按潜在因子的分布变化、干预效应和跨环境稳定性，区分无预测价值、稳定有用及有用但不稳定的信息，再分别抑制、保留或衰减其贡献。

Details

Motivation: 多模态分布偏移方法常通过压制环境依赖变化来追求不变性，却对所有偏移信息统一处理；实际中有些变化无助于预测、有些稳定有用、另一些仅在特定环境有预测价值。

Result: FaShift先分解多模态表示，再按分布变化、干预效应和跨环境稳定性诊断各因子，区分非预测因子、稳定预测因子及有用但不稳定因子，并据此选择抑制、保留或衰减贡献。在MOSI、MOSEI和CH-SIMS上，模型在三个数据集的域内准确率和F1均取得最佳。相较报告域外结果的最强竞争者，MOSI域外准确率/F1提高1.5/3.6分，MOSEI提高1.7/2.7分；在CH-SIMS上取得报告中的最佳域外准确率和F1。

Insight: 鲁棒学习不应把所有环境相关变化一概删除，而应根据其预测价值和稳定性区别处理。域外对比受可报告结果的竞争基线限制，摘要未给跨环境数目、具体分数及因子诊断误差。

Abstract: Distribution shifts pose a fundamental challenge to robust multimodal learning. Existing methods typically promote invariance by suppressing environment-dependent variations, implicitly applying a uniform treatment to shifted information. However, shifted information can have different predictive consequences: some contributes little to prediction, some remains reliably informative, and some exhibits environment-dependent predictive effects. This raises a fundamental question: which shifted information should be suppressed, preserved, or attenuated? To address this question, we propose FaShift, a factor-wise shift framework that diagnoses latent representation factors according to their distributional changes, intervention effects, and cross-environment stability. By factorizing multimodal representations and evaluating these complementary properties, FaShift distinguishes non-predictive factors, stably predictive factors, and predictively useful but unstable factors. It then selectively suppresses, preserves, or attenuates their contributions, rather than enforcing uniform invariance. Experiments on MOSI, MOSEI, and CH-SIMS show that FaShift achieves the best ID accuracy and F1 across all three datasets. Compared with the strongest competitors reporting OOD results, it improves OOD accuracy/F1 by 1.5/3.6 points on MOSI and 1.7/2.7 points on MOSEI, while achieving the best reported OOD accuracy and F1 on CH-SIMS.

[21] OPRD: On-Policy Reminder Distillation for Long-Horizon Coding Agents cs.CLPDF

Yuechen Luo, Zhiyi Lai, Miao Ziqi, Zihang Xu, Jingxuan Xu

TL;DR: OPRD通过多范围提醒监督和基于结果的路由，分别对成功学生轨迹自我模仿、对失败轨迹进行教师条件逆KL监督，并在推理阶段移除提醒。

Details

Motivation: 可靠的仓库级代码智能体需在长交互中保留约束并响应工具反馈，但诊断显示模型常不利用上下文已有的相关信息；最终通过/失败标签提供的过程监督又较稀疏。

Result: OPRD在无提醒学生rollout上进行基于结果的路由：成功轨迹提供自回归自我模仿目标，失败轨迹则由教师在相同学生前缀上重新评估，并进行提醒条件的逆KL监督。全局提醒将最终测试诊断转为轨迹级指导；回合局部提醒只作用于相关环境观察后的下一步。师生模型共享Coding SFT和指令遵循SFT两阶段初始化，推理时学生不使用提醒。在SWE-bench Verified、Pro和Multilingual上，相较开源Qwen3.5-4B基座，基准平均任务解决率提高11.3个百分点；同一诊断协议下汇总错误事件由446降至222，减少50.2%。

Insight: 将错误诊断转成不同时间范围的提醒监督，能教会模型使用已有证据而不要求部署时额外提示；成功和失败轨迹用不同目标处理。摘要未给各SWE基准单项提升、训练成本和错误事件分类细节。

Abstract: Reliable repository-level coding requires agents not only to generate correct code but also to preserve constraints and respond to tool feedback across long interactions. However, our diagnostic analysis shows that agents often fail to act on relevant information already available in context, while final Pass/Fail outcomes provide only sparse process supervision. We introduce On-Policy Reminder Distillation (OPRD), which combines Multi-Scope Reminder supervision with outcome-based routing on reminder-free student rollouts. Successful rollouts provide autoregressive self-imitation targets, whereas failed rollouts receive Reminder-conditioned reverse-KL supervision from a teacher that re-evaluates the same student-generated prefixes. A Global Reminder converts final-test diagnostics into trajectory-level guidance, while Turn-local Reminders apply only to the next decision following the relevant environment observation. The teacher and student share a two-stage initialization from Coding SFT and Instruction-Following (IF) SFT. At inference, the student operates without Reminders. On SWE-bench Verified, SWE-bench Pro, and SWE-bench Multilingual, OPRD improves the benchmark-averaged task resolution rate by 11.3 points over the open-source Qwen3.5-4B base model. Under the same diagnostic protocol, it reduces the aggregate error-event count from 446 to 222, a 50.2% reduction.

[22] Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence cs.CLPDF

Yiran Zhang, Hanbo Huang, Jielan Li, Zhen Zhao, Shiyu Liang

TL;DR: PACE把多模态推理令牌级信用分配与教师对图像证据的依赖相结合，通过四种教师视角下的成对令牌对比及自适应轨迹置信度改进RLVR训练。

Details

Motivation: RLVR的组相对优化通常把一个序列级优势广播给全部令牌，但错误往往集中在少数关键步骤；自蒸馏改进虽使用教师—学生概率差，仍无法分辨教师依据图像还是语言捷径，且可能在教师不可靠时照常应用。

Result: PACE包含成对令牌对比和自适应轨迹置信度。前者用“正确/错误答案提示”与“保留/移除图像”组合的四种教师视角为响应打分，并逐令牌比较两类答案提示，以抵消二者共享偏移、揭示令牌支持是否依赖图像。后者依据教师在正确提示和图像条件下对每条响应的预测能力评估轨迹可信度，在批内归一化后决定该响应内令牌对比重分信用的幅度。PACE在三个骨干上的平均准确率最高；使用Qwen3-VL-8B-Instruct时，在所有评估的多模态推理基准排名第一。消融显示，单视角信号替代成对对比会退化，自适应轨迹置信度进一步带来提升。

Insight: 令牌级优势需区分图像证据和语言先验来源，还应按教师对整条轨迹的可信度控制信用迁移强度。摘要未列具体基准与分数，也未报告四视角教师调用的训练成本。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves multimodal reasoning, but group-relative policy optimization broadcasts a single sequence-level advantage to every token of a response, although errors usually localize to a few decisive steps. Recent self-distilled variants refine credit with a teacher–student likelihood gap. However, this signal cannot tell whether it relies on the image or on a language shortcut, and is applied uniformly even when the teacher is uninformative. To address this, we propose Pairwise token contrast and Adaptive trajectory ConfidencE (PACE). Pairwise token contrast scores each response under four teacher views, crossing a correct or incorrect answer hint with the image present or removed, and compares the two hints for every token, which cancels shifts shared by both hints and reveals whether the token’s support relies on the image. Adaptive trajectory confidence measures how well the teacher predicts each response given the correct hint and the image, normalizes this score within the batch, and uses it to set how far the token contrast redistributes credit within that response. PACE achieves the best average accuracy on three backbones and ranks first on all evaluated multimodal reasoning benchmarks with Qwen3-VL-8B-Instruct. Experiments show that both components matter: replacing pairwise token contrast with a single-view signal underperforms our method, while adaptive trajectory confidence adds further improvement.

[23] SceneWeave: Audience-Guided Scene Exploration for Dramatic Adaptation cs.CLPDF

Aolin Li, Xiao Xu, Haihua Xie

TL;DR: SceneWeave通过撰写聚焦场景的多种对照草稿来指导整部戏剧化改编，而不只根据抽象计划扩写剧本；并训练专用写作模型与人类偏好模型辅助草稿比较。

Details

Motivation: 将散文改编为剧本需把叙述和内心体验转为场景，传达人物关系与心理矛盾；规划虽能指定预期效果，却不能决定其如何通过对白和行动实现。

Result: SceneWeave围绕核心场景生成相互对照的处理版本，比较它们形成的互动，再据此修改人物塑造、前置铺垫、后续发展和场景顺序，最后生成完整剧本。系统重点以实际场景写作反馈适配决策，并将后果传播到全篇。作者还训练任务专属写作模型和人类偏好模型；前者利用改编示例和人类偏好学习，后者结合人工与合成监督。盲读者比较偏好SceneWeave而非基线流程和仅基于描述的对照；内容评估显示其减少叙事冗余且心理刻画较强。

Insight: 具体撰写场景并比较其戏剧效果，可为改编规划提供比抽象描述更直接的反馈，并帮助在全剧范围调整因果铺垫。摘要未说明原文/剧本数量、盲评人数及偏好统计，也未提供叙事冗余的量化指标。

Abstract: Adapting prose into a script requires transforming narration and inner experience into scenes that convey relationships and psychological contradictions. Planning specifies intended effects but leaves their realization in dialogue and action unresolved. Drawing on screenwriters’ accounts of revising scenes and their connections to the surrounding work, we present SceneWeave, which uses alternative scene drafts to revise the adaptation as a whole. It writes contrasting treatments of a focal scene, compares the interactions they create, and revises characterization, preceding preparation, subsequent development, and scene order before generating the complete script. The central contribution is to use actual scene writing to inform adaptation decisions and propagate their consequences across the work. We also develop a task-specific writing model and a human-preference model for comparing script drafts. The writing model learns from adaptation examples and human preferences; the preference model combines human and synthetic supervision. Blind reader comparisons favor SceneWeave over a baseline workflow and description-based controls, while content assessment indicates reduced narrative redundancy and strong psychological treatment.

[24] Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning cs.CLPDF

Shiwen Qin, Cameron Barker, Henry Gouk, Elliot J. Crowley, Shay B. Cohen

TL;DR: LURCH把长上下文推理难度拆为证据范围、证据分散度和推理深度，并提供6,550条带支持证据及推理图的多领域问答实例。

Details

Motivation: 上下文窗口长度常被当作长上下文任务难度指标，但同等长度的材料可能只需阅读一段局部内容，也可能需要整合分散证据并完成多步依赖推理。

Result: 作者用三个属性定量描述难度：找到答案所需信息量的证据范围、信息在上下文中的分布广度，以及从证据到答案所需的依赖推理步数。LURCH包含6,550个多领域问答实例，并提供支持证据与推理图以测量这些属性。专有及开放权重模型评估显示，在固定上下文长度下，三项属性均与模型表现强负相关；上下文变长时，证据分散样本的性能急剧下降，而局部证据样本相对稳定。三类难度因素会复合：三者均中等偏高的问题比仅一项极高的问题更难。

Insight: 长上下文推理难度不仅由token长度决定，还取决于需查找多少证据、证据相隔多远及推理链有多深；基准应报告这些任务结构。摘要未给各模型的具体表现和属性测量一致性。

Abstract: Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty. However, context length alone cannot explain why models fail on long-context tasks that require reasoning over complex information. Contexts of equal length can pose very different challenges: a task may be solvable from a single local passage, or it may require integrating evidence distributed across the full context. We quantitatively characterise this difficulty through three properties: evidence scope, how much necessary information must be found; evidence dispersion, how widely that information is scattered within the context; and reasoning depth, how many dependent steps are needed to derive an answer from it. We construct LURCH, a multi-domain question-answering benchmark of 6,550 instances with supporting evidence and reasoning graphs, enabling all three properties to be quantified. Evaluations of proprietary and open-weight models show that: (1) at fixed context length, all our three properties are strongly negatively correlated with model performance; (2) as context length increases, performance degrades sharply on samples with dispersed evidence, whereas it remains relatively stable on samples with localised evidence; and (3) difficulty compounds across properties, as questions with moderately high values on all three are harder than those with an extreme value on just one. These findings establish evidence scope, dispersion and reasoning depth as measures of long-context reasoning difficulty that complement context length.

[25] Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling cs.CLPDF

Tong Zhu, Zhe Xu, Zefeng He, Yunkai Chai, Xuyang Hu

TL;DR: Intern-Decision提供0.8B、2B和4B多模态结构化决策模型，用一次因果前向从文本及可选图像输出JSON字段选择及候选概率。

Details

Motivation: 交互智能体常需在有限动作、标签或序数选项中反复决策；为每次选择生成自由文本会增加延迟，也使模型与环境接口更复杂。

Result: Intern-Decision在完整助手JSON骨架中为每个字段设置一个决策占位符，使用自回归掩码语言建模目标；真实符号仅用于监督，推理时由骨干原生语言模型头在一次因果前向中评估所有字段。4B模型在七个评估套件上的不加权平均准确率为90.02%，Jev v1.13.0为88.74%。RTX 4090上固定289令牌、三字段请求的4B平均延迟44.16毫秒，较小模型约33—34毫秒。另一个96例同分布试点中，温度缩放将多类别Brier分数从0.628降至0.550、ECE从0.213降至0.089。对111道公开Jevbench-Hard题的置信度移交实验，把42题转给Atria-Dawn-Preview后准确率从82/111（73.87%）升至97/111（87.39%）。

Insight: 结构化决策输出和候选概率可降低自由文本生成负担，并支持按置信度将困难问题移交更强模型；低延迟优势与模型规模有关。校准结果来自96例已知分布试点，移交结果来自111道特定题，不能视为广泛分布外校准保证。

Abstract: Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We present Intern-Decision, a family of 0.8B, 2B, and 4B multimodal decision models that return structured choices and candidate probabilities from text and optional images. Our autoregressive masked language modeling objective places one decision placeholder per field in a complete assistant JSON skeleton. Ground-truth symbols appear only in supervision, while all fields are evaluated in a single causal forward pass using the backbone’s native language-model head. The 4B model achieves a 90.02% unweighted average accuracy across seven evaluation suites, compared with 88.74% for Jev v1.13.0. For a fixed 289-token request with three fields on one RTX 4090, mean latency is 44.16 ms for the 4B model and approximately 33–34 ms for the smaller models. On a separate 96-case known-distribution pilot, temperature scaling reduces expected multiclass Brier from 0.628 to 0.550 and expected calibration error from 0.213 to 0.089. A confidence-based handoff study on 111 public Jevbench-Hard items improves accuracy from 82/111 (73.87%) to 97/111 (87.39%) by routing 42 items to Atria-Dawn-Preview. We also describe qualitative game, visual interface, and browser demonstrations. These results support compact decision models as a practical component of larger agent systems.

[26] EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering cs.CL | cs.AIPDF

Wei Xia, Yehui Tang, Zhi-Hong Deng

TL;DR: EMO交替优化问题特定上下文与上下文诱导的logit修正，用无答案的外部裁判反馈更新系统提示，并以置信度约束的方向控制下一令牌分布。

Details

Motivation: 测试时上下文优化可用文本反馈适配冻结模型，但普通条件生成无法单独控制上下文更新导致的分布变化强度。

Result: 免训练EMO仿照期望最大化交替执行：E步用无黄金答案访问的外部裁判提供文本梯度，修订问题特定系统上下文；M步在共享前缀下比较新旧上下文的下一令牌分布，构造置信度约束logit修正。被引导回答的反馈再驱动下一轮上下文更新。理论上，作者用共享目标KL和加性logit表示连接参数与上下文优化，并在上下文确实改善、引导忠实时证明足够小修正强度下单轮目标KL下降。八种模型、六个基准的贪心解码评估中，40个聚合设置里39个超过零样本基线，平均提高9.10个百分点；同一裁判下较TextGrad平均再提高1.53分，MMLU-Pro各模型均有提升。匹配目标模型生成预算时，对best-of-N的优势在Llama上最强；多数比较中候选更少但oracle覆盖更高。

Insight: 上下文编辑与令牌分布干预被作为两个相互反馈的控制环节，理论保证依赖上下文改善和引导忠实等假设。候选覆盖—选择差距提示测试时计算还需联合分配给生成与验证；覆盖更高并不意味着最终所选答案必然更好。摘要未列八模型名称和39种设置的逐项分数。

Abstract: Test-time context optimization adapts frozen language models through textual feedback, but ordinary conditional generation provides no separate control over how strongly to reinforce the distributional changes induced by a context update. We introduce EMO, a training-free framework inspired by expectation–maximization that alternates question-specific context estimation (E-step) and distribution refinement (M-step). The E-step revises a system context using textual gradients from an external judge without access to gold answers. The M-step contrasts next-token distributions under the revised and preceding contexts at a shared prefix to construct a confidence-constrained logit correction. Feedback on the steered response drives the next context update, coupling adaptation across rounds with intervention within each generation. Theoretically, we connect parameter and context optimization through a shared target-KL objective and additive logit representations, and derive the steering vector from context-induced logit displacements. Under context-improvement and faithful-steering assumptions, we prove a one-round decrease in target KL divergence for sufficiently small steering strength. Under greedy decoding across eight models and six benchmarks, EMO improves the zero-shot baseline in 39 of 40 aggregated settings, averaging $+9.10$ percentage points. With the same judge, it adds $+1.53$ points on average over context-only optimization (TextGrad), with consistent MMLU-Pro gains across models. At matched target-model generation budgets, accuracy advantages over best-of-$N$ are strongest on Llama, while oracle coverage is higher in most comparisons despite fewer candidates. The coverage–selection gap motivates allocating test-time computation jointly to candidate generation and verification.

Chengfei Wu, Zhaoqing Wu, Dan Goldwasser

TL;DR: CLUE通过监督证据推理加GRPO，训练模型从对话自身发现社会关系、预期和历史互动线索，并用Grounded Information Utilization奖励鼓励证据支撑的新推断。

Details

Motivation: 社会判断需要将话语与说话人关系、预期及早前交流联系起来；相关背景往往已在对话中，但模型需要学会主动发现并利用这些线索，而不是依赖外部补充上下文。

Result: CLUE采用两阶段训练：先监督模型进行证据推理，再用Grounded Information Utilization奖励引导GRPO；奖励鼓励新增、由证据支持的社会推断，同时考虑推理成本。作者用少量对话样例评估跨任务、语言和体裁泛化，推理时模型独立分析给定互动。相较基础Qwen，CLUE域内平均加权F1相对提升17.3%，域外提升9.3%，五项域外评测中四项F1更高；两个领域的平均推理令牌均减少80%以上。人工评估发现其解释更常引用具体对话内容，引用证据与人工选取上下文的一致性更高。

Insight: 模型可训练为从原始互动中检索社会线索，减少对人工提供外部上下文的依赖，并通过奖励同时约束证据依据和推理成本。摘要未给任务/语言清单、绝对F1及人工评估规模；相对提升不能直接换算为百分点。

Abstract: Understanding a conversation requires connecting what is said to the speakers’ relationships, expectations, and earlier exchanges. Prior work shows that supplying relevant context can improve models’ social judgments, but much of this information may already be present in the conversation. This motivates training models to discover the cues that matter and use them to support an interpretation. We propose CLUE, a two-stage training pipeline that combines supervised evidence reasoning with GRPO guided by Grounded Information Utilization ($\mathrm{IU}_{\mathrm{G}}$). This reward credits new, evidence-supported social inferences while accounting for reasoning effort. We train on a small set of conversational examples to assess effectiveness and generalization across tasks, languages, and genres. At inference time, the trained model reasons over the supplied interaction in a self-contained manner. Compared with base Qwen, CLUE achieves relative gains of 17.3% in-domain and 9.3% out-of-domain in average weighted F1, with higher F1 on four of five out-of-domain evaluations. These gains are accompanied by over 80% fewer reasoning tokens on average in both domains. Human evaluation further finds that CLUE more often grounds its explanations in specific conversational content, with closer alignment between its quoted evidence and human-selected context.

[28] Mosaic: Multi-Session Agentic Reinforcement Learning cs.CL | cs.AI | cs.LGPDF

Yilong Xu, Minrui Xu, Xinyu Zhou, Xiang Long, Haochen Tan

TL;DR: Mosaic提出多会话智能体强化学习，让轨迹可跨任意数量会话，并在轨迹级与会话级分配贡献优势，改善上下文压缩和子智能体分叉场景的会话使用效率。

Details

Motivation: 多数智能体RL假定轨迹始终在一个累积上下文中运行，但上下文压缩和子智能体分叉会产生跨多个会话的推理轨迹；将轨迹级优势广播给所有会话无法区分各会话贡献，也不能指导会话预算分配。

Result: Mosaic是无critic的分层多会话优化方法：轨迹层把会话使用信号纳入优势估计，会话层依据估计的边际贡献塑造各会话优势。在Qwen3.5-4B及BrowseComp上，分别在上下文压缩和子智能体分叉场景中超过将轨迹优势广播到所有会话的基线，且平均使用会话数更少。分析显示会话效用和分配均有改善。

Insight: 跨会话轨迹需要把不同会话对最终结果的边际贡献区别对待，而不能共享同一轨迹奖励。摘要只报告BrowseComp和Qwen3.5-4B设置，未给准确率增幅、会话数具体变化或更大模型结果。

Abstract: Most existing agentic reinforcement learning methods assume single-session trajectories, where interaction proceeds within one continuously accumulated context. However, agentic techniques such as context compaction and subagent forking may produce trajectories spanning multiple sessions, creating a mismatch between the single-session training assumption and inference-time execution. Therefore, we introduce Multi-Session Agentic Reinforcement Learning, a more general setting that supports an arbitrary number of sessions within a trajectory. Under this setting, a widely adopted method is to broadcast trajectory-level advantages to all sessions, but this does not distinguish contributions from various sessions or guide session allocation within trajectories. To address this issue, we propose Mosaic, a multi-session agentic RL method with critic-free hierarchical optimization. At the trajectory level, it incorporates session-usage signals into advantage estimation. At the session level, it shapes each session’s advantage according to the estimated marginal contribution. Experiments on BrowseComp with Qwen3.5-4B show that Mosaic outperforms broadcasting in both context compaction and subagent forking scenarios while using fewer sessions on average. Further analyses show that our method achieves improvements in session utility and allocation, which we suggested is a promising target for future advances in multi-session agentic RL.

[29] Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing cs.CLPDF

Tianxiang Fei, Jiazheng Kang, Mao Zheng, Xingyan He, Xiang Yu

TL;DR: Hy-Memory-30B-A3B是跨Mem0、MemOS和Hy-Memory训练的长期记忆写入器，通过记忆在线蒸馏学习协议、再用下游可答性强化学习优化写入策略。

Details

Motivation: 外部记忆能让模型跨越上下文窗口，但效果依赖写入路径：模型需决定保留什么、如何精确表达以及怎样用新证据更新状态。既有系统通常依赖框架专属提示的一般大模型，带来推理成本，且专用写入器难跨协议迁移。

Result: Hy-Memory-30B-A3B统一学习三个记忆框架。Memory On-Policy Distillation在学生生成状态上教授框架专属写入协议；Memory RL再以分块探针密集评估下游可答性、跨块归因奖励、过度存储控制及块级GRPO进行优化。训练中跨窗口传递策略写入的记忆库，以贴近部署。在固定的基准20%子样本上，该模型在四个评估harness中均排名第一，包括留出EverMemOS；宏平均55.49%，Claude Opus 5为54.62%。

Insight: 记忆写入器需根据学生自身状态学习不同框架协议，并以未来可答性而非单纯写入格式优化；跨窗口传递记忆可缓解训练—部署差异。结果基于固定20%子样本，摘要未给各harness分项表现及基准抽样不确定性。

Abstract: External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state. Existing frameworks typically place a general-purpose large language model behind framework-specific prompts. This raises serving cost, and a writer specialized for one protocol does not transfer directly to another; a unified model that can operate across established memory frameworks remains largely unexplored. We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory. Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO. Carrying policy-written banks across windows keeps training aligned with deployment. On fixed 20% benchmark subsamples, Hy-Memory-30B-A3B ranks first on all four evaluated harnesses, including held-out EverMemOS, with a 55.49% macro average versus 54.62% for Claude Opus 5.

[30] Beyond Downstream QA: Rethinking How We Evaluate Agent Memory cs.CL | cs.AI | cs.LGPDF

Sebastian-Antonio Toma, Jean de Kernier, Mike Ply, Oliviu Matei

TL;DR: FEB-30将智能体记忆评估从最终问答表现扩展到逐次文档摄取后的记忆库状态检查，显示问答准确率与记忆操作正确性可能显著脱节。

Details

Motivation: 现有记忆基准以问答准确率代理记忆质量，却把记忆是否正确与检索和生成能力混在一起；正确回答可能掩盖损坏记忆，错误回答也可能把正确记忆的检索失败误判为记忆错误。

Result: FEB-30包含30条事实演变轨迹、6类诊断类别和3个难度等级，通过从已知事实轨迹逆向生成文档，建立无需人工标注的确定真值。每条轨迹规定事实在多作者文档、邮件和对话中的更新方式，可直接检查每次摄取后的记忆库。对代表性记忆系统评测发现，内在记忆检查与外在问答平均相差16个百分点，44%的轨迹超过有意义差异阈值。系统对创建、更新、强化、替代等记忆操作的正确分类率仅20%，而问答评估完全无法发现；失效模式还随类别和难度系统变化。

Insight: 应将记忆库状态演变与下游检索/回答分开评估，避免把错误归因混为一谈；逐次摄取检查能暴露问答正确率掩盖的记忆操作缺陷。基准仅30条合成事实轨迹，外推到真实开放式记忆仍需验证。

Abstract: Agent memory benchmarks evaluate whether an agent’s responses reflect correct knowledge, measuring downstream question-answering accuracy as a proxy for memory quality. We show this evaluation paradigm is incomplete: it conflates memory correctness with retrieval and generation quality, producing both false positives where correct responses mask broken memory and false negatives where incorrect responses blame correct memory for retrieval failures. We introduce FEB-30, a benchmark of 30 fact-evolution trajectories spanning 6 diagnostic categories and 3 difficulty levels, constructed via paradigm inversion: documents are generated from known fact trajectories, yielding deterministic ground truth without human annotation. Each trajectory defines how a fact should evolve across multi-author artifacts (documents, emails, conversations), enabling direct inspection of the memory store after each ingestion step. Applying FEB-30 to a representative memory system, we demonstrate that intrinsic and extrinsic evaluation diverge by an average of 16 percentage points, with 44% of trajectories exceeding meaningful divergence thresholds. Diagnostic decomposition reveals that the system correctly classifies memory operations (create, update, reinforce, supersede) only 20% of the time, a failure entirely invisible to extrinsic evaluation, and that failure modes differ systematically by category and difficulty. We release the benchmark, document generation pipeline, and scoring framework to support reproducible evaluation of agent memory systems.

[31] AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions cs.CL | cs.AIPDF

Alexey A. Bokov, Ivan I. Panin, Nikolay B. Nechaev, Mikhail Yu. Valkov, Valeria Yu. Chernina

TL;DR: AI Consilium以300个已明确诊断的临床病例评测LLM单模型意见和多学科协商报告，分别考察事实依据、连贯性、可操作性和安全性。

Details

Motivation: LLM可为复杂病例生成鉴别诊断，但有用的第二意见还需事实可靠、临床连贯、可行动且安全；需要同时评估结构化报告格式及多学科综合讨论的贡献。

Result: 基准使用300个NEJM–MedQA已明确诊断病例，其中110例用于医生参考评分和裁判校准，190例留作测试。八种单模型流水线在自由形式和结构化临床推理条件下生成独立角色意见及交互式会诊报告；经医生校准的LLM裁判评估3,040份最终报告及对应结构化主要角色输出。模型身份对质量差异的影响大于回答格式；八种模型流水线中有七种的结构化最终报告整体均分更高，管理维度优势最明显（2.740对2.436）。相较会诊前结构化主要角色意见，结构化综合报告在五项共同标准的汇总评分均提高，问题优先级、事实依据和推理连贯性提升最大。GPT-5.6-Sol在所有评估组件领先，且达成共识所需审议轮次最少。

Insight: 统一病例评估可分解模型能力、结构格式、多学科综合和审议轮次的作用；结构化综合报告在多数流水线中得分更高。该基准仍是已解决病例上的模拟评估，不能替代临床验证；摘要未给医生评分者数量、一致性及模型具体安全分项。

Abstract: Large language models (LLMs) can generate differential diagnoses for complex cases, but a useful second opinion must also be factually grounded, clinically coherent, actionable, and safe. We developed a multidimensional benchmark using 300 diagnostically resolved NEJM–MedQA cases: 110 for physician reference ratings and Judge calibration and 190 for held-out evaluation. Eight single-model pipelines generated independent role-specific opinions and interactive-consilium reports under free-form and structured clinical-reasoning conditions. A physician-calibrated LLM Judge evaluated 3,040 final reports and the corresponding structured primary-role outputs. Model identity separated report quality more strongly than response format. Structured final reports had higher overall mean scores in seven of eight model pipelines, with their clearest advantage in management (2.740 vs. 2.436). Compared with the structured pre-consilium primary-role opinion, the complete structured synthesis had higher pooled scores across all five shared criteria, with the largest increases in problem prioritization, factual grounding, and reasoning coherence. GPT-5.6-Sol led every evaluated component and reached consensus in the fewest review rounds. These findings show that the benchmark can distinguish model capability, the contribution of multidisciplinary synthesis, criterion-specific effects of response structure, deliberation dynamics, and inference requirements within one common-case evaluation.

[32] Training Reasoning Models to Generate Diverse Scientific Ideas cs.CLPDF

Manya Wadhwa, Pranav Narayanan Venkit, Hiroaki Hayashi, Yu Li, Tuhin Chakrabarty

TL;DR: 该研究以集合级强化学习训练模型从既有论文生成多条彼此不同且有文献依据的科研构想，并按每条构想质量及其与先前构想的距离共同评分。

Details

Motivation: LLM科研构想生成研究常优化单条构想质量，却忽略一次研究方案可提供的构想多样性；实际需求是生成一组高质量、彼此清楚不同且扎根于源文献的想法。

Result: 单次生成时，模型撰写K张有结构的构想卡片，集合级奖励联合评分，并按每条构想与此前构想的距离加权其质量，鼓励后续想法避开已有方向。研究报告，训练后的8B模型在无污染基准上creative utility（结合质量和多样性）高于Claude Opus 4.8和GPT-6 Astra。四名专家参与的试点人评认为其集合与Claude Opus 4.8同样有前景，独特构想略多。编码智能体对想法执行概念验证实验时，模型success@k与Claude Opus 4.8相当，表明增加多样性未牺牲可执行性。

Insight: 科研构想的集合质量需同时考虑单条质量、构想间差异及来源文献支撑，而非仅选取单个最佳回答。人评只有四位专家，摘要未报告creative utility数值和概念验证任务规模。

Abstract: One of the first steps of a research pipeline is generating ideas. Large Language Models (LLMs) are increasingly used to automate this step, but most of this work optimizes the quality of individual ideas, while overlooking diversity. In our work, we study document-grounded ideation, focusing on increasing the diversity of LLM generated ideas and ensuring they are high quality. Given prior papers, a model must propose a set of ideas that are each high-quality and clearly distinct from one another, while also being grounded in the input documents. To optimize for this, we propose training with a set-level reinforcement learning objective. In our setup, in a single generation, the model writes K structured idea cards grounded in the source papers, and the set is scored jointly, where each idea’s quality is weighted by its distance from the ideas written before it. This teaches the model to steer each new idea away from its predecessors. We show that our trained 8B model achieves higher creative utility (a measure combining quality and diversity) than Claude Opus 4.8 and GPT-6 Astra on our contamination-free benchmark. In a pilot human study with four experts, our sets are judged as promising as Claude Opus 4.8’s and contain marginally more unique ideas. When a coding agent runs proof-of-concept experiments on the ideas, our model’s success@k is comparable to Claude Opus 4.8’s, so we see that the added diversity does not cost any executability.

[33] OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling cs.CLPDF

Bowei Liu, Xinchen Zhang, Xuhuan Li, Tianlin Zhang, Kaian Jiang

TL;DR: OmniVerifier-C1把复杂提示或环境规则自动拆成细粒度子项并给出分项分数，以结构化、连续批评信号替代单一真假判断，应用于生成视觉验证及规则世界模型。

Details

Motivation: 复杂多模态场景中的二元视觉验证器只输出True/False，反馈信息有限；由生成式模型构建世界模拟和规则推理时，需要可解释的逐项检查信号。

Result: 该验证器自动将复杂提示或环境规则分解为细粒度要素并逐项打分。解耦RL联合优化子问题级二元判断与全局对齐评分，用精确局部反馈形成细粒度核验能力。作者在传统文生图场景中报告逐项评分验证器显著超过二元验证器，并称结构化输出提升了多模态批评任务的域外泛化。扩展到显式规则治理的生成世界建模时，理论分析表明在有真值图像时成对验证比逐项点式验证更准确；Maze、Sudoku等结构化世界模型任务实验也支持该方案。

Insight: 复杂规则的整体一致性需要将可检查子项分解，同时保留局部与全局分数；有真值图像时成对比较可能提供更可靠批评。摘要认为世界建模智能体依赖准确的成对分级视觉验证器，但没有给出各任务的定量指标和域外增益数值。

Abstract: Generative visual verifiers play a crucial role in advancing multimodal intelligence. To enhance the robustness of visual verifiers in complex multimodal scenarios involving compositional requirements, we move beyond conventional binary verifiers that produce only True/False discrete judgments and introduce a verifier that automatically decomposes complex prompts or environmental rules into fine-grained components and assigns pointwise scores to provide a continuous and more informative critique signal. Our experiments further demonstrate that these structured and interpretable outputs improve the verifier’s generalization to out-of-domain multimodal critic tasks. To train this verifier, we introduce a Decoupled RL training strategy that jointly optimizes sub-question-level binary judgment and global alignment scoring, using precise local feedback to develop fine-grained verification capabilities that provide a foundation for reliable continuous scoring at the global level. Under a general reinforcement learning framework, we first empirically demonstrate that the proposed pointwise graded verifier significantly outperforms binary verifiers in traditional text-to-image scenarios. We then extend our investigation to rule-governed generative world modeling where generative models are leveraged for world simulation and world reasoning under explicit rules. From a theoretical standpoint, we further show that a pairwise verification paradigm yields more accurate critiques than the pointwise formulation when ground-truth images are available, with empirical results on diverse structured world-modeling tasks such as Maze and Sudoku further validating the effectiveness of our approach. Overall, our findings suggest a key insight: the transition from generative models to structured world-modeling agents critically hinges on the availability of accurate pairwise graded visual verifiers.

cs.CV [Back]

[34] BD-HazardVLM: Probing Vision-Language Models for Latent Defensive-Driving Hazards in Bangladesh Road Scenes cs.CV | cs.LG | cs.ROPDF

Abdullah Al Maruf, Md. Sajedul Islam, Tanmoy Mridha, Irfan Hossain Bhuiyan

TL;DR: BD-HazardVLM用500张孟加拉道路场景图像评测视觉语言模型的防御性驾驶风险推理，发现粗略识别危险并不代表能准确判断风险细节和防御行动。

Details

Motivation: 现有驾驶场景理解研究对全球南方道路中弱结构、复杂交通条件下的防御性推理了解不足；仅检测是否有危险，也不足以衡量风险类别、出现时机、严重程度和应对方式等安全能力。

Result: 作者整理500张孟加拉道路图像，其中375张来自RSUD20K、125张来自TFP-BD，并标注危险存在、类别、风险时机、严重程度、防御行动、可见证据，以及幻觉和西方道路偏差陷阱。对Qwen2.5-VL-7B、InternVL3-8B和MiniCPM-V-4.6进行统一零样本评测。危险二分类准确率为88.0%–89.2%，与89.0%的多数类基线近似；类别准确率低于40%，风险时机准确率仅1.6%–12.4%，防御行动完全匹配率低于2%。InternVL3-8B严重程度准确率最高，为61.2%，但对58个高严重度案例的召回率为零；Qwen出现类别模式坍缩，所有模型对潜在危险预判和陷阱识别都较弱。

Insight: 该基准揭示了危险有无识别与细粒度防御推理之间的明显差距，可用于推动地域多样化的驾驶安全评测。结论针对这三种模型及该数据集的零样本设置；摘要未报告各模型的详细错误分布或真实道路部署表现。

Abstract: Vision-language models are increasingly used for driving-scene understanding, yet their defensive reasoning under weakly structured Global South traffic remains unclear. We introduce BD-HazardVLM, a diagnostic benchmark of 500 Bangladesh road-scene images, comprising 375 from RSUD20K and 125 from TFP-BD, annotated for hazard presence, primary hazard category, risk timing, severity, defensive actions, visible evidence, and hallucination- and Western-road-bias traps. We evaluate Qwen2.5-VL-7B, InternVL3-8B, and MiniCPM-V-4.6 using a shared zero-shot task definition and structured output schema. Binary hazard-presence accuracy ranges from 88.0 percent to 89.2 percent, essentially matching the 89.0 percent majority-class baseline. Fine-grained reasoning is substantially weaker: category accuracy remains below 40 percent, risk-timing accuracy ranges from 1.6 percent to 12.4 percent, and exact defensive-action matching remains below 2 percent. Although InternVL3-8B achieves the highest severity accuracy at 61.2 percent, it has zero recall on the 58 high-severity cases. Qwen exhibits severe category mode collapse, while all models show weak latent-hazard anticipation and near-zero self-reported trap recognition. For the evaluated models, these findings show that coarse hazard recognition does not imply reliable fine-grained defensive-driving reasoning and motivate geographically diverse safety evaluation.

[35] Orbia: Do Generated Videos Form a Consistent 3D World? cs.CVPDF

Dongyue Lu, Guian Fang, Hur Lim, Yonggang Wu, Yanrong Wang

TL;DR: Orbia提出交互式视频世界模型的三维一致性基准，通过探索后重访场景，系统检查输入保真、生成内容持久性和三维自洽性。

Details

Motivation: 视频生成模型画面逼真并不意味着其呈现同一个稳定的三维世界；已有评测多只覆盖局部几何属性，或依赖视觉语言模型判断记忆与一致性，缺乏全面、可控的三维一致性评估。

Result: Orbia包含720个室内外实例，结合公开数据、自采场景和模拟数据，并提供六种探索与重访协议；评测覆盖27个文本、动作和相机条件模型。输入保真通过配准RGB-D参考和标注锚点测量外观、几何及空间稳定性；生成内容持久性比较未出现在初始输入中的区域在首次生成和重访时是否保持；三维自洽性则检查跨视角深度与特征对应、局部尺度一致和留出高斯渲染。基准还包含分钟级探索与重访，以考察长期一致性。

Insight: 该工作重点是建立系统诊断工具和统一评测协议，为开发更持久的视频世界模型提供依据。摘要没有给出各模型在各指标上的具体成绩，因此不能据此判断模型排名或现有方法的总体水平。

Abstract: Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing benchmarks assess selected geometric properties or use vision-language models to judge memory and consistency, leaving systematic 3D evaluation underexplored. We introduce Orbia, the first benchmark dedicated to a systematic and comprehensive evaluation of 3D consistency in interactive world models. Through controlled exploration and revisit, we organize the evaluation into three dimensions: input preservation, generated-content persistence, and 3D self-consistency. For input preservation, registered RGB-D references and annotated anchors support appearance, geometry, and spatial stability measurements. For generated-content persistence, we compare revisits to regions absent from the input image with their first generated observations to test whether models preserve what they create. For 3D self-consistency, cross-view depth and feature correspondence, regional scale agreement, and held-out Gaussian rendering test whether generated views describe the same 3D scene. Minute-long exploration and revisits further test long-term consistency. Our construction and annotation pipeline brings together public datasets, self-captured scenes, and simulation, yielding 720 instances across indoor and outdoor environments and six exploration-and-revisit protocols. Evaluation spans 27 text-, action-, and camera-conditioned models through native-interface adapters. Our Orbia benchmark provides a systematic basis for diagnosing 3D inconsistency and developing more persistent video world models.

[36] WorldCast: Exploring Intelligent Visual Generation in World State Prediction cs.CV | cs.AIPDF

Wenhao Yan, Haodong Li, Xiaotong Li, Yaxin Luo, Zhengrong Yue

TL;DR: WorldCast评测模型根据多模态观察预测连续未来世界状态的能力，发现前沿生成模型已有初步进展，但复杂推理和开源模型仍有显著差距。

Details

Motivation: 多模态生成系统开始能结合上下文生成描绘世界变化的视觉结果，但需要同时理解观察、动作和物理变化并连续预测未来状态的高层任务研究相对不足。

Result: 作者提出四级能力层次，并构建WorldCast：覆盖八类任务的320个人工设计案例，评测12个代表性模型。GPT-Image-2.5 System得分72.8，显示其在真实世界任务上的初步视觉状态预测能力；Nano Banana Pro得分42.8，最佳开源模型为20.1。模型在复杂上下文、相互交织的参考信息和高推理要求任务上仍存在不足；实验也显示强生成模型能够利用其底层语言模型能力。

Insight: 多步世界状态预测把理解、规划和视觉生成结合起来，适合衡量模型能否连贯模拟世界变化，而不只是生成单张视觉结果。摘要未说明分数刻度、各类别详细结果及评测模型的具体配置，因此数字应限于论文给出的基准对比。

Abstract: Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar capabilities: they can integrate multimodal context and synthesize visual outputs that depict changes in the world. To characterize this emerging trajectory, we organize model capabilities into a four-level hierarchy and discover that higher-level tasks remain relatively underexplored despite model progress. To bridge this gap, we explore model performance on multi-step world state prediction, a high-level task that requires models to forecast successive future world states from multimodal observations and diverse references. Such a task requires models to possess entangled understanding and generation capabilities, as well as extensive world knowledge to translate human action sequences, physical transformations, and abstract visual reasoning into coherent visual outputs. We introduce WorldCast, a benchmark comprising 320 manually designed cases across eight categories, and evaluate 12 representative models. The conducted experiments yield three key insights: (a) advances in frontier models are rapidly pushing the boundaries of intelligent world modeling, with the GPT-Image-2.5 System scoring 72.8 and demonstrating early-stage visual state prediction capabilities on real-world tasks; (b) WorldCast reveals substantial gaps between models: even Nano Banana Pro reaches only 42.8 and the best open-source model scores 20.1, with deficits in handling complex context, entangled references, and reasoning-heavy tasks; (c) strong generative models effectively draw on the capabilities of their underlying language models. These findings highlight the need for multimodal generative models that are capable of dynamic planning and reasoning while also being deeply unified to faithfully simulate real-world states.

[37] ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models cs.CV | cs.AIPDF

Feize Wu, Zhiyuan Yan, Yuhuan Hong, Yuwei Niu, Zongjian Li

TL;DR: ReasonUni在图像编辑式重建训练中加入显式推理，并用TreeGRPO联合优化理解和生成，使统一多模态模型在两类任务的多个基准上均有提升。

Details

Motivation: 统一多模态模型中的图像理解与文本生成图像可通过重建训练相互促进，但已有重建方法主要提供感知层监督，对图像结构、编辑意图和状态变换的推理监督有限。

Result: 给定原图与编辑指令，ReasonUni先推理需要编辑的内容和方式并描述目标状态，再依据该理解结果生成目标图像。TreeGRPO为每条推理路径采样多个候选图像，以视觉奖励聚合更新推理和生成模块，从而在统一目标下联合优化。作者报告在多个基准上的理解和生成均取得稳定提升。

Insight: 该方法将“先理解并规划编辑、再生成”的过程纳入联合训练，目标是让重建监督覆盖超越像素感知的推理能力。摘要未给出具体基准名称、量化增益、模型规模和消融结果，因此目前只能确认其总体实验趋势。

Abstract: Image-to-text (I2T) understanding and text-to-image (T2I) generation are dual tasks in unified multimodal models (UMMs). Reconstructive post-training couples these tasks, but existing reconstruction-based methods remain perception-centric and provide limited supervision for reasoning about structure, intent, and transformation. We propose ReasonUni, a reasoning-augmented reconstructive post-training framework that extends this coupling beyond perception. Given an original image and an editing instruction, the UMM first reasons about what and how to edit and describes the target state, then generates the corresponding target image conditioned on this understanding output. To jointly optimize both modules, we introduce TreeGRPO, a tree-structured reinforcement learning method that samples multiple reasoning paths and candidate images per path, then aggregates visual rewards to update both modules under a unified objective. Experiments across multiple benchmarks demonstrate consistent gains in both understanding and generation, showing that reasoning-augmented reconstruction yields genuine mutual gains for UMMs.

[38] Blame Errant Words, Not the Canvas: Defect-Aware Spatial Credit Assignment for Visual Text Generation cs.CVPDF

Sujie Hu, Huaisong Zhang, Pujing Yang, Qian Wang, Xiaomin Li

TL;DR: TextDART逐区域评估图中文字的语义正确性和字形质量，SCANNER再把区域奖励映射到对应潜在令牌，以细粒度空间信用分配改善视觉文本生成。

Details

Motivation: 视觉文本生成仍有错词和畸形字形；识别器式奖励可能漏掉可见字形缺陷，而整图标量反馈又掩盖不同文字区域质量不均的问题。

Result: 作者提出“归责于错误文字，而不是整张画布”的原则。TextDART定位每个文本区域，分别评价语义正确性和字形质量，生成区域级细粒度奖励；SCANNER将各采样图像中同一文字目标的奖励归一化，再把区域优势映射到相应潜在令牌，形成空间差异化策略反馈。在既有基准及新建PolyText-Bench上的实验中，该方法在文字准确性和字形保真度方面达到报告的最先进表现。

Insight: 空间局部奖励可以把训练信号集中到真正出错的文字区域，避免整图反馈抹平局部质量差异；语义和字形也应分开评价。摘要未给出基准规模、具体指标和对照提升幅度，SOTA结论范围以所评基准为限。

Abstract: Recent reinforcement learning approaches have improved visual text generation, yet generated images still suffer from incorrect wording and malformed glyphs. We identify two coupled limitations: recognition-based rewards often overlook visible glyph defects, while whole-image scalar feedback obscures the uneven quality of individual text regions. These limitations motivate our central principle: $\textit{Blame errant words, not the canvas}$, to effectively preserve local quality distinctions. First, we introduce $\mathbf{TextDART}$, a defect-aware region-targeted reward model that localizes individual text regions and independently evaluates their semantic correctness and glyph quality, providing fine-grained, region-precise feedback. Building on TextDART, we propose $\mathbf{SCANNER}$, which turns these regional judgments into spatially differentiated policy feedback. It normalizes rewards for each text target across sampled images and casts the resulting regional advantages onto the corresponding latent tokens. Extensive experiments on existing benchmarks and our newly established $\textbf{PolyText-Bench}$ demonstrate that our approach achieves state-of-the-art performance in text accuracy and glyph fidelity. Project page: https://sujiehu.github.io/textdart-scanner

[39] RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay cs.CVPDF

Mengfei Li, Yi Zhang, Xingtong Ge, Lunjie Zhu, Fangyu Lin

TL;DR: RIGen为生成式游戏加入持久状态与可配置规则、上下文交互推理及动作条件音视频生成，使玩家动作后果和世界自身规则共同塑造后续内容。

Details

Motivation: 生成式游戏不只需即时响应玩家动作，还要让动作产生持久影响，并让世界按自身状态和规则影响玩家处境及后续选择。受限历史、部分可见游戏状态和上下文决策使仅靠音视频预测难以长期维持互动。

Result: RIGen结合持久状态及可配置规则、上下文交互推理和动作条件音视频生成，使交互后果与角色行为共同决定生成内容，并保持游戏状态与可见结果一致。作者构建Xonotic游戏数据集来训练学习动力学和交互的音视频生成器，并通过后训练开发交互式生成第一人称射击原型RIGArena。实验表明，其战斗结果更可靠，且玩家与生成世界之间实现互惠互动。

Insight: 生成式游戏需要状态、规则和玩家动作共同约束内容，而不只是条件化生成下一段视频；持久状态使互动后果得以跨时刻延续。摘要未提供具体基准、战斗胜率或人评数据，验证主要是Xonotic数据及原型实验。

Abstract: Generative gameplay requires more than immediate responses to player actions.Actions should have persistent consequences, while the generated world should act according to its own state and rules, shaping the player’s situation and subsequent choices. Video generation captures local dynamics, but limited history, partially observed game state, and the need for contextual behavior decisions make such interactions difficult to sustain through audiovisual prediction alone. We introduce \rig (Reciprocally Interactive Generation), a framework for reciprocal interaction in generative gameplay. \rig combines persistent state and configurable rules, contextual interaction reasoning, and action-conditioned audiovisual generation. Together, these components make interaction consequences and actor behavior jointly determine generated content while maintaining consistency between game state and visible outcomes. We construct a Xonotic gameplay dataset to train an audiovisual generator for learning dynamics and interactions. Further post-training enables \rigarena, an interactive generative first-person shooter (FPS) prototype. Experiments demonstrate more reliable combat outcomes and reciprocal interaction between the player and the generated world. Project page: https://murphylmf.github.io/RIGen/.

[40] Probing Negation Understanding in Vision-Language Models With Object Attention cs.CV | cs.AI | cs.CLPDF

Beth Pearson, Michael Wray, Martha Lewis

TL;DR: 该研究比较视觉语言模型处理肯定句与否定句时的物体注意力，并与人类注视对照；总体发现模型注意模式不类人，否定问题存在性能差异且PaliGemma2的注意转移可能只是伴随现象。

Details

Motivation: 否定理解是语言能力的重要部分，视觉语言模型需要正确处理否定；研究关注模型是否会把注意力转向肯定描述的相反对象，以及注意模式与人类视觉注视有何差别。

Result: 作者在合成和真实数据、二元及多元选择设置中，比较模型物体级注意力与人类眼动注视，并评估肯定和否定陈述。总体上，模型解决否定时未表现出类人的注意模式，提示其可能依赖注意力以外的机制。逐层分析发现PaliGemma2-3B在否定条件下会把物体注意力转向替代对象，但逐头消融显示这更可能是副产物，而不是实际否定处理机制。LLaVA-1.5-7B还对画面左侧物体有空间偏置。下游任务评测中，所有模型的肯定题和否定题表现均存在差距。

Insight: 注意力可视化中看似合理的目标转移未必构成模型真正执行否定推理的机制，需结合干预和下游表现分析；模型与人类的注意差异也不等于因果解释。摘要未给出具体任务分数、注视匹配统计或否定准确率差距。

Abstract: Negation is a fundamental aspect of language understanding and it is important vision-language models (VLMs) are able to process it effectively. We investigate how VLMs process negation by analysing attention patterns of different models. We draw comparisons between human gaze and attention in models when processing affirmative vs negated statements. We compare object level model attention to human eye-fixations in both binary and multary settings, evaluating with both synthetic and realistic datasets. We find models generally do not follow human-like attention patterns when resolving negation, suggesting they rely on mechanisms outside of attention. While layerwise analysis shows that PaliGemma2-3B shifts object attention to the alternative under negation, our headwise ablations suggest this is a byproduct rather than a negation processing mechanism. Additionally, we find that LLaVA-1.5-7B displays a spatial bias towards left-side objects. Our evaluation of models on downstream tasks shows that all models have a discrepancy between affirmative and negated questions highlighting the need to better understand the underlying processing of negation to close this performance gap. Code available at https://github.com/otmive/negation_attention

[41] Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation cs.CVPDF

Qian Yu, Zongyang Qiu, Juncheng Yan, Hongliang Li, Qi Qin

TL;DR: Intern Lumina U2以多个互补码本离散表示每个视觉位置，在单一扩散语言模型骨干中统一文本、图像、视频和3D输入，并以稳定性感知采样提升图像生成效率。

Details

Motivation: 单码本离散视觉令牌与文本建模兼容但表征容量有限；连续或混合方法虽保留更丰富视觉信息，却使图文处于异质空间、训练目标不一致，可能引发优化冲突。

Result: 作者称Intern Lumina U2是首个在完全离散空间表示多码本视觉令牌的扩散语言模型。每个视觉位置由互补码本组成的代码组表示；输入时拼接各代码嵌入，输出时轻量多码本自回归头在每个位置依次预测代码，而扩散骨干并行处理全部位置。基于AToken统一4D表示，单一骨干支持图像、视频和3D输入，并在视觉理解、图像生成及编辑的统一模型中取得领先表现。作者还在昇腾和NVIDIA平台构建全栈系统验证跨平台有效性；置信度平台期引导解掩码与漂移触发缓存刷新结合的稳定性感知采样，使图像生成加速4.45倍。

Insight: 多码本离散表示试图同时保留高视觉容量和与文本共享离散优化空间的兼容性；跨平台系统和缓存刷新策略进一步关注实际推理部署。摘要未提供各任务具体得分、模型规模、硬件配置和4.45倍加速的基线及质量影响。

Abstract: Unified multimodal generation covers discrete, continuous, and hybrid paradigms. Discrete approaches with single-codebook visual tokenizers align naturally with text modeling but have limited representational capacity. Continuous and hybrid approaches retain richer visual representations, but they model text and images in heterogeneous spaces with different training objectives, potentially introducing optimization conflicts between modalities with misaligned representation spaces. These choices expose a central question: how to efficiently model high-capacity visual representations alongside textual content in a shared optimization space within a single backbone. We present Intern Lumina U2, to our knowledge the first diffusion language model to represent multi-codebook visual tokens in a fully discrete space. Each visual position is represented by a group of codes from complementary codebooks, increasing its representational capacity while preserving compatibility with discrete text modeling. At the input, the embeddings are concatenated at each position; at the output, a lightweight multi-codebook autoregressive head predicts the codes within each position sequentially, while the diffusion backbone processes all positions in parallel. Built on the unified 4D representation of AToken, Intern Lumina U2 supports image, video, and 3D inputs within a single backbone and achieves leading performance among unified models in visual understanding, image generation, and image editing. We further build a full-stack training, inference, and evaluation system on both Ascend and NVIDIA platforms to verify the cross-platform effectiveness of our model. We also improve the inference efficiency through a stability-aware sampling strategy, which combines confidence-plateau-guided unmasking approach with drift-triggered cache refreshing mechanisms, accelerating image generation by 4.45x.

[42] Pixels to Tokens: Token Space Efficient Active Learning for Low-Budget Semantic Segmentation cs.CV | cs.LGPDF

Utku Cicek, Mahip Singh, Ziyao Shang, Kimathi Kaai, C Thomas

TL;DR: TEAL在冻结ViT原生令牌网格上进行多样性采样，再于解码网格用不确定性细化选择像素标注点，面向极低标注预算的语义分割主动学习。

Details

Motivation: 现有视觉Transformer主动学习常按patch或区域选样，像素级监督仍需大量标注；当每图仅能标注极少像素时，还需同时挑选信息量最大的像素并从稀疏信号训练可靠解码器。

Result: TEAL直接在冻结ViT令牌网格进行多样性选择，避免将令牌嵌入插值到稠密像素空间引入伪影；先对多层令牌描述符进行两级MaxHerding选择代表性候选，再在更细解码网格用边际不确定度进行精炼。在CamVid、Cityscapes、ADE20K和Pascal Context上，极低标签预算下持续超过先前基线：每张图只标1个像素时，较最强基线最高提升24.36 mIoU；每图10个像素时最高达到全监督表现的97%。为区分增益来源，作者还在所有基线统一使用DINOv3骨干时确认提升仍存在。

Insight: 利用ViT令牌几何做样本选择，再结合解码器网格的不确定性，能避免简单上采样令牌后选择像素的失真，并在极少像素标注下保持性能。最高提升及97%表现是不同数据集/设置的上限，不代表每个基准均达到。

Abstract: While foundation models and vision transformers (ViTs) have redefined visual representations, current active learning (AL) strategies for these backbones largely operate at the patch or region level, where annotation requirements remain high due to extensive pixel labeling. Extending ViT-based AL to the pixel-level, low-budget regime is uniquely challenging: with as little as one pixel query per image, a method must simultaneously identify the most informative locations and train a reliable decoder head from an extremely sparse signal. We introduce TEAL (Token-space Efficient Active Learning), the first pixel-level AL framework built around ViT representations. TEAL uses a frozen ViT backbone and performs diversity-based selection directly on its native token lattice, avoiding the artifacts introduced by interpolating token embeddings to dense pixel resolutions. Our framework applies a two-level MaxHerding strategy over multi-layer token descriptors to select representative candidates, followed by margin-based uncertainty refinement on a finer decoder grid. Across CamVid, Cityscapes, ADE20K, and Pascal Context, TEAL consistently outperforms previous baselines under extreme label scarcity, improving over the strongest baseline by up to +24.36 mIoU with a single labeled pixel (px) per image, and reaching up to 97% of fully supervised performance with just 10 px. To rigorously establish the source of the gains, we further show that the improvements persist when all baselines are equipped with the same DINOv3 backbone, demonstrating that coupling token-space selection with uncertainty refinement on the decoder grid makes ViT token geometry an effective foundation for extremely low-budget active segmentation.

[43] VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents cs.CV | cs.CLPDF

Zhivar Sourati, Marianne Menglin Liu, Rongguang Wang, Zheng Wang, Yazhe Hu

TL;DR: VELD-QA提供1.5万条人工撰写的长文档问答及逐题视觉证据标注，分开评估证据检索和解释，并揭示仅获得正确页仍留下显著视觉理解与推理缺口。

Details

Motivation: 现有长文档问答基准较少同时具备大规模人工问题及细致视觉证据标注，难以定位模型究竟在证据查找还是图表、表格解释上失败。

Result: VELD-QA包含15,000组人工编写问答，来自5,859份真实PDF、共372,445页，平衡覆盖图表、表格和复杂版面。人工标注支持页面和证据元素，并描述所引视觉内容，使检索和解释可分别评估。作者测试九种视觉语言模型的四种证据设置及七种检索增强/智能体系统。检索方法显著低于提供真实支持页的oracle设置，整份文档输入也未消除差距；即便oracle正确给页，最高准确率只有81.7%，表明视觉解释和推理仍是瓶颈。加入该数据集的视觉元素标注后，性能差距缩小17%至24%。

Insight: 长文档视觉问答需要分别测量证据定位和证据理解；检索到正确页面仍不足以保证答对，显式元素标注还能作为模型输入帮助缩小差距。摘要未给各系统、任务和证据设置的完整分数，oracle 81.7%是最高报告值。

Abstract: Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis of evidence localization and interpretation failures. We present VELD-QA, a large-scale benchmark for Visual Evidence grounding and question answering in Long Documents. It contains 15,000 fully human-authored question-answer pairs across 5,859 real-world PDFs totaling 372,445 pages, balancing chart, table, and complex-layout tasks. Human annotations identify supporting pages and evidence elements and describe cited visual content, enabling separate retrieval and interpretation evaluation. We evaluate nine vision-language models under four evidence settings and seven retrieval-augmented and agentic systems. Our analysis identifies bottlenecks in evidence localization and interpretation. Retrieval-based methods substantially underperform the oracle setting with ground-truth supporting pages; full-document access does not close the gap. Localization alone is insufficient: oracle accuracy peaks at 81.7%, highlighting persistent visual interpretation and reasoning challenges. Enriching inputs with our visual-element annotations narrows the performance gap by 17-24%, demonstrating value beyond evaluation and motivating data enrichment for multimodal document QA. Our code is available at https://github.com/oracle-samples/veld-qa.

[44] DeSpatial: The devil of Agentic Spatial Reasoning Lies in 3D Itself cs.CVPDF

Yifei Liu, Xiaolong Zhou, Ziyang Gong, Yifan Zhou, Yuanyuan Gao

TL;DR: DeSpatial将空间智能体拆分为3D感知和推理：先融合分割、深度及多视角实例，构造度量化、重力对齐的统一场景，再由智能体选择推理或计算工具。

Details

Motivation: 空间智能体已有重建和分割工具，但不一致预测与对象身份碎片化会使结果难以形成可靠三维场景信息。oracle实验显示，仅把感知替换为真实3D框、保持推理工具不变，五项VSI-Bench任务即可接近满分，说明感知是关键瓶颈。

Result: DeSpatial提供共享3D感知工具，将独立感知结果整合为统一的度量化、重力对齐场景。联合分割—深度协同细化用于合并同一物体的掩码并消除单帧分割和深度不一致导致的投影伪影；跨视角实例融合合并体素重叠实例，但禁止合并同一帧中的不同实例，还根据三维结构和源掩码外观融合因观测不足造成的空间分离碎片。获得完整统一场景后，智能体再选择推理或计算工具。方法在VSI-Bench、MindCube-Tiny和ViewSpatial上取得领先结果，并报告VSI-SUPER长视频结果。

Insight: oracle结果将该任务中可恢复的主要瓶颈定位到精确3D感知；因此先统一对象、尺度与重力坐标再做推理，比单纯强化推理工具更关键。摘要未给各基准具体分数及oracle准确率，且跨视角融合的边界依赖同帧不合并等设计约束。

Abstract: Spatial agents have access to reconstruction and segmentation tools, yet inconsistent predictions and fragmented object identities can prevent their outputs from becoming reliable 3D scene information. A simple oracle experiment exposes this perception bottleneck: replacing tool-predicted perception with ground-truth 3D bounding boxes raises an agent to nearly full score across five object-centric VSI-Bench tasks, while retaining the same reasoning tools. Motivated by this finding, we believe the devil of spatial reasoning lies in 3D itself, and introduce DeSpatial(Devil of Spatial), which explicitly decomposes spatial understanding into perception and reasoning. DeSpatial has a shared 3D perception tool to reconcile independent perception outputs into a unified, metric, gravity-aligned 3D scene. This perception tool has two core components: a) a joint segmentation–depth co-refinement module that consolidates masks of the same object and removes projection artifacts caused by inconsistent segmentation and depth within a single frame; b) a cross-view instance fusion module that consolidate voxel-overlapping instances but not allowed to merge same-frame instances. This fusion module additionally fuses spatially disjoint fragments caused by insufficient multi-view observations, by checking their 3D structure and source mask appearance. After receiving the complete and unified 3D scene information, the agent chooses reasoning or computational tools to solve the spatial problem. DeSpatial achieves leading performance on VSI-Bench, MindCube-Tiny, and ViewSpatial, with additional long-video results on VSI-SUPER, revealing the bottleneck of spatial understanding lies in a precise 3D perception itself.

[45] Mind the Tail: Data Selection Through Sparse Concepts cs.CVPDF

Ziheng Zhang, Neha Hulkund, Colin Lee, Zheda Mai, Hui Shen

TL;DR: 该研究用稀疏自编码器提取图像概念支持度，逐步降低已充分覆盖概念的样本权重，并用局部支持筛选可靠补充长尾概念的样本，以改善数据效率和分布外鲁棒性。

Details

Motivation: 数据选择会重新分配物体、属性、颜色、纹理和背景等视觉概念的训练支持；丢弃稀有长尾概念会损害测试鲁棒性，而过度选择类别边界样本又可能带来不稳定监督。

Result: 作者跨细粒度分类、伪相关和一般图像分类及多模态预训练研究数据选择。方法用稀疏自编码器提取单图概念激活，选择样本时累计其对数据集概念支持分布的贡献，再通过边际收益递减降低已充分表示概念的权重、转向分布尾部；随后结合局部支持，选择能可靠增强欠代表概念的样本。结果显示该方法在所有评测基准上持续优于强基线，并分析发现其增强的概念与模型行为变化相关，包括改善分布外及伪相关上下文鲁棒性。

Insight: 数据集级概念覆盖比单样本重要性更能刻画尾部概念是否得到支持；局部可靠性筛选也有助于避免过度选择不稳定边界样本。摘要未给数据集名称、具体指标、选择预算及概念解释可靠性量化。

Abstract: Data selection reallocates training support across visual concepts, including objects, attributes, color, texture, and backgrounds. Different allocation strategies may produce varied downstream model behavior, especially for tail concepts supported by only a few samples. Discarding them can hurt test-time robustness, while overemphasizing samples lying on category boundaries may introduce unstable training signals. This work explicitly investigates this relationship across fine-grained, spurious-correlation, and general image classification, as well as multimodal pretraining. Specifically, we use sparse autoencoders (SAEs) to extract concept activations from individual images. During selection, we accumulate the dataset-level concept support for each added sample. Applying diminishing returns to this distribution down-weights well-represented concepts and shifts the focus to the distribution tail. We then incorporate local support to find samples that reliably strengthen under-supported concepts. Empirical results show consistent improvements over strong data selection baselines across all benchmarks. We also reveal the connection between concepts our method enhances and the induced behavioral changes, including improved robustness against out-of-distribution and spurious contexts. This work establishes concept support, beyond individual sample importance, as a useful principle for data-efficient and robust learning.

[46] Audio-Visual Dog Identification and Tracking in Real-World Videos cs.CV | cs.LGPDF

Aryahvishwa Babu, Kingsley Jin, Lillian Wang, Tuan M. Dang, Theron S. Wang

TL;DR: 该框架将视觉个体识别、多目标跟踪与犬吠声纹结合，为狗的叫声事件关联具体个体并维护持续档案，新增46段真实视频及213个手工标注犬吠事件基准。

Details

Motivation: 在真实视频中根据犬吠识别具体狗仍少有研究；多狗可能同时吠叫、被遮挡或进出画面，视觉外观和叫声虽都含身份信息，却多被分开研究。

Result: 多模态犬只指纹框架结合视觉身份识别、多目标跟踪与犬类声纹，将叫声事件与具体狗匹配并维护持久档案；系统同步叫声和跟踪对象，根据外观与声音特征更新档案，以应对遮挡、重叠叫声及离屏吠叫。作者构建含46段真实视频和213个人工标注犬吠事件的基准。可见事件中，活跃可见犬只定位正确率在IoU≥0.30时为61.83%；可见与离屏吠叫检测F1为91.33%。

Insight: 跨模态身份档案可将离散叫声事件与持续跟踪的个体关联，覆盖可见、遮挡和离屏情况。基准规模有限，定位IoU阈值为0.30且准确率为61.83%，表明精确个体定位仍有明显改进空间；摘要未报告重叠吠叫分项结果。

Abstract: Identifying individual dogs from barks in real-world videos remains challenging and largely unexplored. Solving this problem would enable long-term behavioral analysis, veterinary monitoring, and animal welfare monitoring by attributing vocalizations and behaviors to the correct individual. Real-world videos are challenging because multiple dogs may bark simultaneously, become occluded, or move in and out of view. Prior studies show that canine vocalizations and visual appearance contain discriminative identity information, but these modalities have largely been studied independently. We present a multimodal dog-fingerprinting framework combining visual identification, multiple-object tracking, and canine vocal fingerprinting to associate bark events with individual dogs while maintaining persistent profiles. The framework synchronizes bark events with tracked dogs and updates profiles using visual appearance and vocal characteristics, enabling identification despite occlusion, overlapping vocalizations, and off-screen barking. We also introduce a benchmark of 46 real-world videos containing 213 manually annotated bark events. Our framework correctly localizes the active visible dog in 61.83% of visible events at IoU $\geq 0.30$ and achieves a 91.33% F1 score for visible versus off-screen barking detection.

[47] RoPE-Flow: Monocular Vision-based Robot Pose Estimation via 2D Graph-Conditioned 3D Flow Matching cs.CV | cs.ROPDF

Liangjing Shao, Wanhao Liu, Zhiwei Fang, Rulin Zhou, Quanlu Zhang

TL;DR: RoPE-Flow以端到端流匹配估计单目图像中的相机—机器人位姿，用关键点多尺度表征和图结构条件建模关节关系，并通过骨长及射线深度损失强化拓扑与尺度稳定性。

Details

Motivation: 从单张二维图像恢复机器人三维结构仍具挑战；既有方法要么依赖耗时的迭代渲染，要么采用复杂2D—3D配准，容易受投影歧义、远端关节误差累积及各关节学习难度不均影响。

Result: RoPE-Flow从预测的二维热图中提取关键点中心多尺度图像块特征，同时获得位置和上下文表征；图引导条件生成器学习关键点邻接图，根据关节相关性为流匹配构造条件。骨长损失和射线深度损失分别约束拓扑一致性与尺度稳定性，并用关节级加权缓解关节预测难度差异。作者报告该方法在不同类型机器人及多相机设置下超过先进位姿估计方法，并建立跨场景基准验证零样本跨场景机器人位姿估计表现。

Insight: 用关键点关系图指导分布式位姿生成，可在单目条件下整合局部视觉线索及机器人骨架约束。摘要未列数据集、具体指标、跨场景划分或对照数值，性能提升目前只能定性概述。

Abstract: Camera-to-robot pose estimation from a monocular image is significant for vision-based robot navigation and control. However, recovering 3D structural features from 2D observations remains a challenging task. Existing camera-to-robot pose estimation methods either rely on time-consuming iterative rendering or involve sophisticated 2D-3D registration which suffers from projection ambiguity, accumulated errors for distal joints and imbalanced learning for different joints. In this work, we propose RoPE-Flow, an end-to-end flow matching-based framework for camera-to-robot pose estimation. From the predicted 2D heatmaps, we propose a Keypoint-centered Feature Extractor to obtain positional features along with contextual representations from keypoints-centered multi-scale patches. Moreover, we introduce Graph-guided Condition Generator, which embeds a learnable adjacency map to generate condition for flow matching based on correlation among keypoints. Besides, we introduce Bone Length Loss and Ray-Depth Loss for topological consistency and scale stability, with joint-wise weighting to mitigate varied prediction difficulty across joints. The proposed method outperforms state-of-the-art methods for pose estimation across different types of robots with mutiple cameras. Besides, we establish a novel cross-scene benchmark to demonstrate the outstanding performance of RoPE-Flow on zero-shot cross-scene robot pose estimation. Meanwhile, animated visualizations are shown on the website: ropeflow.netlify.app

[48] Can World and Action Modeling Benefit Each Other under Unified Causal Training? cs.CVPDF

Yue Su, Bokai Lin, Xinkai Wang, Chubin Zhang, Xiangnan Wu

TL;DR: OneWM在共享因果视频—动作架构中同时将动作作为世界预测条件和策略学习目标，通过LIBERO、RoboCasa365及真实策略实验研究世界建模与动作建模的双向收益。

Details

Motivation: 世界模型与动作建模关系紧密，但在统一因果训练中二者能否相互促进尚不明确；需要分别检验指定动作条件的前向动力学学习是否改进策略，以及动作生成学习是否改善世界预测。

Result: OneWM把动作同时用于条件化世界状态预测和策略训练目标，并在LIBERO、LIBERO-Plus、RoboCasa365等具身测试平台评估策略学习和世界建模，另有真实世界策略实验。结果显示，学习指定动作导致的视觉后果可以改善策略表现及跨场景泛化；反过来，动作学习也能在相同架构下提高多视角世界预测保真度。作者据此认为两方向均获得正向收益。

Insight: 共享因果架构让预测动作后果与生成动作彼此提供训练信号，实验支持两种能力可以互促。摘要未给模型规模、定量提升、真实机器人任务或训练细节，无法进一步判断不同任务上的收益幅度。

Abstract: World and action modeling are closely related, yet their reciprocal benefits under unified causal training remain unclear. We introduce OneWM, a simple framework for unified causal training that treats actions as both conditions for world prediction and targets for policy learning within a shared video-action architecture. Using this framework, we investigate whether learning forward dynamics conditioned on specified actions improves action learning, and whether learning to generate actions in turn improves action-conditioned world modeling. We use LIBERO, LIBERO-Plus, and RoboCasa365 as embodied testbeds to evaluate both policy learning and world modeling, complemented by real-world policy experiments. Learning the visual consequences of specified actions improves policy performance and generalization across changing scenes. In turn, action learning improves multi-view world-prediction fidelity under the same architecture. Together, these results answer both questions positively, supporting reciprocal benefits between world modeling and action generation under unified causal training.

[49] Sparse Attention for Video Generation Acceleration via Growing Sparsity and Reduced Search cs.CVPDF

Yun Dai, Yuyun Chen, Jiarui Wen, Huiping Zhuang, Cen Chen

TL;DR: GSRS根据去噪过程中注意力逐渐集中的特性逐步提高稀疏率，并复用早期候选块缩小后续搜索范围，在HunyuanVideo和Wan 2.1上实现1.55至2.21倍加速且生成质量接近全注意力。

Details

Motivation: 视频扩散Transformer的自注意力计算随令牌数平方增长。稀疏注意力能跳过部分计算，但既有方法在整个去噪过程固定稀疏率，且难以准确判断哪些计算可安全跳过。

Result: 作者通过注意力熵和平均注意距离分析去噪动态，发现注意力随去噪逐步集中，早期选中的块在后续仍承载大量注意力权重。GSRS据此前期保留更多计算、后期逐步减少，并将后续搜索限制在早期候选集合内。方法使用Top-p自适应控制稀疏率，并在FlashAttention计算中精确评估注意力权重，额外开销可忽略。HunyuanVideo和Wan 2.1实验显示，加速比为1.55至2.21倍，生成质量与全注意力相当。

Insight: 稀疏分布随去噪阶段变化，动态增加稀疏度并复用搜索结果比全程固定比例更贴合计算需求。加速范围限于所测两个模型及其设置；摘要未给分辨率、时长、硬件和各指标差值。

Abstract: Diffusion Transformers (DiTs) dominate video generation but suffer from high inference cost due to the quadratic complexity of self-attention. Sparse attention mitigates this by skipping unnecessary computation in the attention matrix, but existing methods apply a fixed sparsity ratio throughout denoising and struggle to accurately determine which computations to skip. To address these limitations, we analyze attention dynamics through attention entropy and mean attention distance, and find that attention becomes increasingly concentrated across denoising steps. We further observe that blocks selected early continue to capture a large fraction of the total attention weight at later steps. These findings suggest two acceleration opportunities: the sparsity ratio should grow as denoising progresses, and earlier search results can be reused to reduce the search space. Based on these findings, we propose Growing Sparsity and Reduced Search (GSRS), a training-free framework that retains more computation early and progressively reduces it later, while restricting subsequent searches to an early candidate set to reduce search overhead. GSRS adopts Top-p selection for adaptive sparsity control, supported by a precise evaluation scheme that computes exact attention weights within the FlashAttention computation at negligible overhead. Experiments on HunyuanVideo and Wan 2.1 validate that GSRS achieves 1.55$\times$–2.21$\times$ speedup while maintaining generation quality comparable to full attention.

[50] VisualTrust: Video Reasoning under On-Screen Claim Framing cs.CVPDF

Huachao Zhu, Junjielong Xu, Sicheng Li, Liang Yang, Mingtao Chen

TL;DR: VisualTrust以同一视频的无文字、准确文字和误导文字三个反事实版本，评估模型是否让屏幕声明覆盖视觉证据，并提出DEAR把证据仲裁与答案阅读分开。

Details

Motivation: 屏幕文字有时描述视频内容，有时则试图框定其含义；现有基准通常同样对待两者，测到的可能是文字读取能力，而非模型是否应相信文字并在其与画面冲突时优先视觉证据。

Result: VisualTrust含5,063个案例和14类声明—事实组合；每个问题配同一视频的无声明、准确声明及仅改变一个有依据事实的误导声明版本，误导声明所支持的选项作为陷阱答案。七种开放权重和四种专有模型的平均准确率从无声明时90.1%降至误导声明时51.9%；初始答对的回答中，42.8%翻转为陷阱答案，仅0.6%变为其它错误。作者另提出免训练DEAR：独立检查冲突证据，选择器权衡各证据且无固定模态优先级，并对阅读器隐藏未选证据；阅读器在新上下文中根据最终视频作答。500段视频、三种专有模型上，误导声明条件准确率由47.2%—64.0%升至81.8%—85.2%，陷阱答案选择率由34.4%—50.8%降至11.6%—15.0%，无声明准确率得以保持。

Insight: 模型即使无声明时表现很好，也可能严重服从误导字幕；显式区分证据仲裁和读取有助于缓解这种偏置。DEAR的干预结果来自500段视频和三种专有模型，摘要未给各模型单项及仲裁器误判分析。

Abstract: On-screen text can describe what a video shows, or it can frame what the video is supposed to mean. Current benchmarks treat both alike, testing whether a model can read the text rather than whether it should trust it. We study claim deference, multimodal large language models’ tendency to let an on-screen claim override conflicting visual evidence. We introduce VisualTrust, a counterfactual benchmark with 5,063 cases across 14 claim-fact classes. Each case pairs a question with three versions of the same video: one with no claim, one with an accurate claim, and one with a misleading claim that alters a single grounded fact. The option the misleading claim supports is the trap answer. Across seven open-weight and four proprietary models, mean accuracy falls from 90.1% without a claim to 51.9% with a misleading claim. Among initially correct responses, 42.8% flip to the trap answer and only 0.6% become other errors. Strong no-claim accuracy does not ensure resistance. We also introduce DEAR (Decoupled Evidence Arbitration and Reading), a training-free agent for video question answering that separates evidence arbitration from reading. An independent check reports conflicting evidence, a selector weighs it without a fixed modality priority and blinds what it withholds, and the reader answers from the resulting video in a fresh context. On 500 videos across three proprietary models, DEAR raises accuracy under misleading claims from 47.2–64.0% to 81.8–85.2% and reduces trap-answer selection from 34.4–50.8% to 11.6–15.0%, while preserving no-claim accuracy.

[51] ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling cs.CVPDF

Yuang Liu, Zhi Zuo, Zhengkai Zhao, Lirui Zhang, Pan Gao

TL;DR: ControlFlow3D在冻结3D编码器定义的结构化潜空间中做条件流匹配，通过多视图图像与3D令牌共享原型逐步蒸馏视觉知识，用于无需测试时多视图图像的点云上采样。

Details

Motivation: 稀疏点云观测欠约束，使高质量上采样困难；多视图图像可以缓解几何歧义，但现有多模态方法未能充分利用视觉线索，且测试时依赖图像会限制部署。

Result: ControlFlow3D在训练阶段把多视图图像令牌和3D潜变量令牌通过无监督软K-means聚为共享原型，再用速度控制引导潜空间流轨迹，并以一致性损失逐步把图像知识迁入基础网络。点云潜空间由冻结3D编码器定义，Mamba几何解码器以线性复杂度将潜在特征映射为稠密坐标；测试时无需多视图图像。作者另构建包含3.5万物体的ShapeNetPU多模态基准，规模为先前数据集的31倍。多个基准实验支持方法有效性及较强泛化。

Insight: 训练期用多视图视觉知识引导潜空间生成、测试期只需点云，可兼顾几何消歧能力和部署简洁性；线性复杂度解码器也针对输出点数扩展。摘要没有具体上采样指标、对照结果或多视图数目，泛化结论只作定性报告。

Abstract: Point cloud upsampling is essential for 3D applications but remains challenging due to sparse, under-constrained observations. Multi-view images can resolve geometric ambiguity, but existing multi-modal methods do not fully exploit visual cues. We propose ControlFlow3D, a framework that distills knowledge from pretrained foundation models into a lightweight generation network during training, enabling strong performance without multi-view images available at test time. Specifically, our method performs conditional flow matching in a structured latent space defined by a frozen 3D encoder. Multi-view image tokens and 3D latent tokens are jointly clustered into shared prototypes via unsupervised soft KMeans; the resulting prototypes guide the flow trajectory through velocity control and are aligned by a consistency loss that progressively transfers image knowledge into the base network. A Mamba-based geometry decoder then maps latent features to dense coordinates with linear complexity. We also construct ShapeNetPU, a 35K-object multi-modal benchmark that is 31 times larger than prior datasets. Extensive experiments across multiple benchmarks demonstrate the effectiveness of our method and its strong generalization capability.

[52] Do VLAs Really Follow Instructions? Diagnosing How-Level Instruction Following in Vision-Language-Action Models cs.CV | cs.ROPDF

Sangwu Park, Wonjoong Kim, Yeonjun In, Chanyoung Park

TL;DR: 该研究发现当前视觉—语言—动作模型对“如何执行”类指令缺乏响应，并提出在训练片段级丰富动作方式指令；同时构建SIMPLER-IN评估要求明确写在指令中的执行条件。

Details

Motivation: VLA研究以往主要测试指定任务内容的What级指令，而较少考察规定执行方式的How级指令；作者诊断发现，现有模型对这类指令反应不足，甚至可能降低任务成功率。

Result: 作者假设每个训练片段只配一条指令限制了How级遵循，并通过片段级丰富指令训练，发现动作可对How指令作出响应，但任务成功率没有稳定提升。为超越普通基准衡量此能力，作者提出SIMPLER-IN，要求模型满足仅由指令给出的执行条件。评测显示，获得的响应性不会迁移到更苛刻或分布外的How级指令。

Insight: 能改变动作响应不等于在复杂或未见执行要求下真正遵循指令；How级泛化仍是开放问题。摘要未报告模型、任务数量及成功率具体数值，且丰富指令带来的动作响应改善并未稳定提高总体完成率。

Abstract: Vision-language-action (VLA) models are expected to follow instructions like their language backbones, yet prior work has focused on What-level instructions that specify the task rather than How-level instructions that specify how to carry it out. Through our diagnoses, we find that How-level instructions do not help current VLAs and lower task success. We hypothesize that pairing each training episode with a single instruction limits How-level instruction following, and show that training with segment-level enriched instructions makes actions respond to such instructions without consistently raising task success. To measure How-level instruction following beyond standard benchmarks, we introduce SIMPLER-IN, where success requires conditions given only in the instruction. It shows that the gained responsiveness does not extend to demanding or out-of-distribution How-level instructions. How-level instruction following thus remains an open challenge.

[53] FocusOPD: Structure-Guided On-Policy Distillation for Diffusion Models cs.CVPDF

Xinrui Lin, Shumin Wang, Suqi Song, Fan Li, Yanyong Zhang

TL;DR: FocusOPD在扩散模型在线策略蒸馏目标上增加深层Transformer块和早期去噪步骤的令牌级方向特征对齐，以改善多教师能力迁移。

Details

Motivation: 多教师在线策略蒸馏可让整流流模型整合多种能力，但输出匹配不保证内部表征对齐，且尚不清楚在哪些网络层和去噪阶段增加特征监督最有效。

Result: 对教师—学生特征差异的分析显示，失配集中在早期去噪的深层Transformer块，并且OPD后仍存在，说明蒸馏不充分。FocusOPD在基础OPD目标上加入仅作用于深层和早期去噪步骤的令牌级方向特征对齐。在两种整流流骨干及多种OPD目标上，该方法改善组合生成、文本渲染和偏好评价的能力迁移。主基准上，较DiffusionOPD，GenEval由0.953升至0.967，PickScore由23.797升至23.944，LAION-Aesthetic由6.052升至6.199。消融显示，只在深层和早期阶段监督比覆盖全网络和完整轨迹更有效且高效。

Insight: 特征对齐应针对失配集中的网络深层及早期去噪阶段，而非对所有层和时间步均匀施加；选择性监督可以同时提升效果和训练效率。摘要未提供两种骨干名称、统计显著性和计算成本数值。

Abstract: Multi-teacher on-policy distillation enables rectified-flow models with diffusion-transformer architectures to combine task-specific capabilities within a single student. However, matching model outputs does not guarantee that their internal representations are aligned, and it remains unclear where and when additional feature supervision is most useful. We analyze the teacher-student feature mismatch across Transformer blocks and denoising timesteps, and find that the mismatch is concentrated in deeper Transformer blocks during early denoising and persists after OPD distillation, indicating ineffective distillation. Motivated by this observation, we introduce FocusOPD, which augments the base OPD objective with token-wise directional feature alignment restricted to deep layers and early denoising steps. Across two rectified-flow backbones and multiple OPD objectives, FocusOPD improves capability transfer in compositional generation, text rendering, and preference-based evaluation. On the primary benchmark, it improves over DiffusionOPD from 0.953 to 0.967 on GenEval, from 23.797 to 23.944 on PickScore, and from 6.052 to 6.199 on LAION-Aesthetic. Ablations show that selective deep and early supervision is more effective and efficient than alignment over the full network and trajectory.

[54] TRACER: A Multimodal Harness for Patient Care in Hospitals cs.CV | cs.AIPDF

Zane Durante, Paul Tang, Keshigeyan Chandrasegaran, Amit Kaushal, Shrinidhi Kowshika Lakshmikanth

TL;DR: TRACER把医院视频转为分钟级动作记录并与临床记录汇总为小时报告，允许智能体按需查询视频和病历；研究还在大规模监控队列中观察到谵妄阳性患者目的性活动较少。

Details

Motivation: 连续视频和临床记录互补，有助于了解患者住院期间行为变化；挑战在于跨整段住院周期表示行为，同时保留访问细粒度视频和临床证据的能力。

Result: 免训练多模态harness TRACER从视频生成分钟级动作记录，并结合临床记录形成小时级报告；LLM智能体可用工具查询该层级、查看相关视频并检索病历。作者构建两个基准：397段带15类原子动作标注的一分钟片段，以及来自两名ICU患者、共264小时视频和临床记录的144道临床专家知情选择题。动作检测准确率最高84.8%；问答准确率61.0%，使用同一骨干的最强基线为49.3%。在280名患者、约60,000摄像机小时数据中，住院期间谵妄评估阳性者的目的性活动显著少于阴性者（p<0.0001）。系统未使用受保护健康数据训练。

Insight: 分层时间摘要结合原始视频与临床记录检索，可支持跨住院过程的行为分析；分钟到小时的结构保留了整体概览和证据回溯。谵妄关联是观察性结果，不能据此推断因果或诊断效能；摘要未报告真实临床部署和患者隐私治理细节。

Abstract: Continuous video and clinical records provide complementary information for understanding how patient behavior evolves over a hospital stay. A central challenge is how to represent behavior across the entire stay while preserving access to fine-grained visual and clinical evidence. We introduce TRACER, a training-free multimodal harness that constructs minute-level action records from video and combines them with clinical records into hourly reports. The harness equips an LLM agent with tools to query this hierarchy, inspect relevant video, and retrieve clinical records. To evaluate TRACER, we construct two benchmarks. The first contains 397 annotated one-minute clips spanning 15 atomic actions; the second poses 144 clinician-informed multiple-choice questions, grounded in 264 hours of video and clinical records from two ICU patients. TRACER achieves up to 84.8% accuracy for action detection and 61.0% QA accuracy versus 49.3% for the strongest baseline using the same backbone. Across 280 patients spanning approximately 60,000 camera-hours, TRACER identifies significantly less purposeful activity in patients with a positive delirium assessment during their stay than in those without (p < 0.0001). Our results show that combining continuous video with clinical records can support understanding of patient behavior over time and across patient cohorts without training on protected health data.

[55] GeoPano: Towards Geometrically Accurate 3D Reconstruction from a Single Panorama cs.CVPDF

Jing OU, Zidong Cao, Liaoyuan Fan, Zhuoxiao Li, Shuai Zhang

TL;DR: GeoPano针对单幅全景图重建完整场景点云，利用显式球面几何的Pano-Attention协调透视视图间信息，并在透视局部细节与球面全局结构上联合监督。

Details

Motivation: 从单张全景图恢复完整360度几何有利于机器人和AR/VR，但经纬度投影图像存在球面畸变；将其切成无畸变透视视图虽可缓解单视图畸变，却常造成视图之间几何不一致。

Result: GeoPano是前馈式单全景重建框架，提出精简注意力聚合器及Pano-Attention，利用全景固有球面几何引导跨视图交互并抑制几何不一致。混合监督同时在透视空间强化细粒度局部结构，在球面空间约束整体结构。实验显示，GeoPano在重建准确性、几何一致性和视觉保真度上显著超过此前先进方法。

Insight: 全景分解带来的局部无畸变视图需由共享球面几何进行协调；同时监督局部细节和全局结构有助于避免跨视图不一致。摘要未给出数据集、指标和提升数值，性能结论目前为定性。

Abstract: Panoramic 3D reconstruction enables the holistic recovery of complete 360 $^\circ$ scene geometry, offering significant benefits for robotics and AR/VR applications. However, directly estimating geometry from ERP images is inherently challenged by spherical distortions. To reduce spherical projection distortions, a common strategy is to decompose panoramas into distortion-free perspective views, but independently processing these views often introduces cross-view geometric inconsistencies. To address these challenges, we introduce GeoPano, a feed-forward framework for single-view panoramic 3D reconstruction that recovers a geometrically accurate and consistent point cloud from a single panorama. Our approach is driven by two key innovations: First, we propose a panoramic-aware attention aggregator, featuring a streamlined attention architecture equipped with a novel Pano-Attention mechanism, which explicitly exploits the intrinsic spherical geometry of the panorama to guide cross-view interactions, thereby suppressing geometric inconsistencies. Furthermore, we formulate a hybrid supervision strategy to jointly enforce fine-grained local details in perspective space and global structural coherence in spherical space. Experiments demonstrate that our method significantly outperforms previous SOTA approaches in reconstruction accuracy, geometric consistency, and visual fidelity.

[56] Dusting the Phantom: Gaussian Allocation for Fading Dynamic Content cs.CVPDF

Minhyeok Roh, Minseo Lee, Jun Young Jeong, Byeonghyeon Lee, Lucas Yunkyu Lee

TL;DR: 该方法提出Seed Injection和Temporal Biased Relocation两种时空高斯分配策略，在固定高斯预算下将新基元放到欠重建动态区域，并引导迁移基元落在有用的时空位置。

Details

Motivation: 动态高斯表示支持高质量实时体积视频，但小型快速运动物体可能消失，高动态区域的细纹理也会丢失；仅延长训练或增加高斯数量仍可能无效，瓶颈可能在基元的分配时机和位置。

Result: Seed Injection结合时间外观变化与重建误差识别欠重建动态区域，并利用多视图观测在几何合理的三维位置初始化新高斯，不依赖已有高斯位置。Temporal Biased Relocation则利用随时间变化的优化信号引导已迁移高斯的时空放置。两项策略均保持固定高斯预算，不修改底层表示。多个动态场景数据集实验显示，该方法改善重建质量，尤其能恢复高动态区域中的小型快速运动物体及细粒度外观。

Insight: 动态重建的局部失真未必能靠更大表示容量解决，按欠重建时空区域重新分配有限高斯预算可能更有效。摘要未列数据集、重建指标和提升幅度，也未给在线实时性能变化。

Abstract: Dynamic Gaussian representations have made high-quality, real-time volumetric video increasingly practical, yet challenging motion can still break their reconstruction: small fast-moving objects may disappear, and fine textures in highly dynamic regions are often lost. In particular, simply training longer or using more Gaussians may still fail to recover small, fast-moving objects. We argue that the key bottleneck is not representational capacity itself, but where and when Gaussian primitives are allocated. Existing allocation strategies rely on current Gaussian locations and often overlook the spatiotemporal destinations of relocated Gaussians. To address these limitations, we introduce two complementary strategies. First, Seed Injection identifies under-reconstructed dynamic regions using temporal appearance changes and reconstruction errors, and initializes new Gaussians at geometrically plausible 3D locations through multi-view observations, independent of existing Gaussian locations. Second, Temporal Biased Relocation uses time-resolved optimization signals to guide the spatiotemporal placement of relocated Gaussians. Both strategies maintain a fixed Gaussian budget without modifying the underlying representation. Experiments across multiple dynamic-scene datasets demonstrate improved reconstruction quality, particularly in highly dynamic regions, recovering small, rapidly moving objects and fine-grained appearance details.

[57] VLA-$Δ$: Learning Physical State Transition for Vision-Language-Action Models cs.CVPDF

Qi Lu, Jiarun Li, Ce Zhang, Miao Pan, Yi Pan

TL;DR: VLA-Δ以当前到未来状态间的物理变化作为显式训练目标，补足VLA仅学习观测—示范动作映射的监督缺口，推理时仍直接由当前观测生成动作。

Details

Motivation: 多数VLA把观察直接映射到示范动作，没有显式监督中间物理状态变化，容易过拟合观测—动作对应关系；已有方法虽加入语言、视觉或潜空间中的中间推理/未来预测，却未直接监督物理状态转移。

Result: VLA-Δ构建大规模预训练数据及物理状态转移标注，覆盖任务相关语义和视觉运动变化，为连续动作生成提供更直接监督。推理时模型只依据当前观测生成动作，不增加额外推理开销。在LIBERO和RoboTwin上，性能与先进方法相当；真实机器人实验中超过π0.5。

Insight: 明确学习物理状态变化可为动作预测提供比单纯示范动作更直接的环境动力学监督，同时保持推理路径简洁。摘要未给数据集规模、各基准分数或真实机器人任务与提升幅度，结论需限于所报告评测。

Abstract: Vision-language-action (VLA) models transfer semantic knowledge acquired through vision-language pretraining to robot control, achieving strong performance across various benchmarks. However, most VLAs directly map observations to demonstrated actions without explicit supervision of intermediate physical state changes, making them prone to overfitting observation-action correspondences. Some methods introduce intermediate reasoning or future-state prediction in language, visual, or latent spaces to guide action generation, but do not explicitly supervise the physical state transition itself. We therefore propose VLA-$Δ$, a general framework that uses physical changes between current and future states as explicit learning targets. To support this objective, we construct a large-scale pretraining dataset and derive physical state-transition annotations covering task-relevant semantics and visual motion changes, providing more direct supervision for continuous action generation. During inference, the model generates actions directly from current observations without additional inference overhead. VLA-$Δ$ achieves performance competitive with the state of the art on LIBERO and RoboTwin, and outperforms $π_{0.5}$ in real-robot experiments. Our code is available at https://github.com/ZJU-OmniAI/VLA-Delta

[58] Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG cs.CV | cs.AIPDF

Eunchan Jo, Seounghyun Jang, Sangwoo Mo

TL;DR: LoC把视觉文档RAG的生成器侧证据利用作为独立瓶颈，通过提高整页视觉分辨率并为问题相关区域补充OCR，在不需标注或额外训练下改善多项文档问答基准。

Details

Motivation: 多模态文档RAG通常聚焦检索，但即使检索到正确页面，生成器也可能没有充分利用其中的视觉证据；输入分辨率、图像细节和证据显著性都可能限制回答。

Result: 在SciEGQA oracle页上，五种既有方法经通用图像处理器平均每题只给生成器0.7K至2.7K视觉令牌；将仅页面预算从1K提至32K，准确率提高15.22个百分点。在固定16K预算下，加入真实标注裁剪区域比只输入页面高3.75个百分点。提高视觉令牌预算或视觉保真度均可改善准确率；同预算下整页缩放优于重复与平铺。抑制周边内容、突出区域有助于效果，页面图像加该区域OCR优于任一单独输入。Loud and Clear（LoC）以高分辨率页面及问题相关区域OCR实现两项设计，无需真实区域标注或额外训练。在SciEGQA、ViDoRe-v3和MMLongBench-Doc上，它超过八种既有方法；同检索器和生成器下，较最强ColQwen3分别提升8.88、3.09和4.22个百分点，也优于相同视觉令牌预算的仅页面版本。

Insight: 检索正确页面只是第一步，生成器还需要足够视觉细节并让相关区域显著；整页高分辨率和局部OCR具有互补作用。oracle真实裁剪上限不能直接转为无标注输入效果，LoC结果来自指定生成器/检索器组合及三项基准。

Abstract: Multimodal document retrieval-augmented generation (RAG) has focused largely on retrieval, yet its answers depend on how well a vision-language model reads the retrieved pages. We find that evidence in retrieved pages remains underused even when the correct pages are retrieved. On SciEGQA oracle pages, five prior methods give the generator 0.7K to 2.7K visual tokens per query on average under a common image processor, yet raising the page-only budget from 1K to 32K improves accuracy by 15.22 points. At a fixed 16K budget, adding ground-truth crops improves accuracy by 3.75 points over page-only input. We study what the generator needs from retrieved pages through two requirements: Loud, making full use of visual token capacity, and Clear, refining the page so that its evidence becomes prominent. For Loud, increasing either the visual token budget or visual fidelity, the image resolution those tokens preserve, improves accuracy with the other held fixed, and full-page scaling outperforms repetition and tiling at matched budgets. For Clear, suppressing surrounding content improves accuracy without enlarging selected regions, and adding OCR of these regions to page images outperforms either input alone. We implement both as Loud and Clear (LoC), which combines higher-resolution pages with OCR from query-relevant regions without ground-truth annotations or additional training. LoC outperforms eight prior methods on SciEGQA, ViDoRe-v3, and MMLongBench-Doc, improving over the strongest, ColQwen3, by 8.88, 3.09, and 4.22 points with the same retriever and generator. It also outperforms its page-only variant under the same visual token budget. These results locate a bottleneck beyond retrieval: how the retrieved pages are given to the generator.

[59] ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer cs.CV | cs.CL | cs.MMPDF

Hao Shi, Jiafeng Wang, Yuzhuo Fu, Tao Zhang, Jian Bai

TL;DR: ZoomCap把细粒度图像描述视为可恢复视觉信息传递，用草稿描述路由检索、OCR阅读、覆盖缺口补全和自适应局部放大，再以图像真值与重建可实现性双盲锚点评价事实主张。

Details

Motivation: 详细图像描述的质量常与长度混为一谈；长文本仍可能漏掉小物体、文字和空间关系，或把不确定观察写成确定事实，难以形成可靠可复用的视觉监督。

Result: ZoomCap依据草稿描述检索条件知识、读取OCR敏感文本、补足覆盖空缺，并仅对最复杂的合格区域进行自适应深度裁剪；空间关系从落地几何推导，并融合不重复证据。FactCycle对描述拆出的原子主张分别以源图像（真实性）和重建（可实现性）盲评，将编造与生成器遗漏逐条区分，并辅以人评和多裁判比较。相较Qwen3.5-397B-A17B描述，ZoomCap的教师模型小十倍以上仍取得81.9%人类平局调整偏好分；FactCycle每图计数52.4条传递主张，ScaleCap为31.5。ZoomCap-450K在持续预训练11基准平均分上较最强竞争语料高1.31至2.38分；Ling-Tiny-VL-v3在60B令牌训练后，生产文档/OCR监控套件提升1.4分、感知提升1.5分。医疗预训练中，264万张ZoomCap描述图像使五项VQA基准平均提高3.04分，同图Gemini-3.1-Pro描述提高1.76分。

Insight: 描述监督不仅要追求文字丰富，还需验证每项主张是否有图像依据及生成器能否实现；按难度分配放大预算可提升证据覆盖。不同训练迁移结果来自多个模型/数据设置，81.9%为人类偏好分，不能直接解释为准确率。

Abstract: Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass outputs still miss small objects, text, and spatial relations or promote uncertain observations into confident claims. We formulate fine-grained captioning as recoverable visual information transfer, in which a teacher acquires missing evidence under a finite observation budget and converts it into reusable supervision. ZoomCap uses a draft caption to route conditional knowledge retrieval, OCR-sensitive reading, coverage-gap recovery, and adaptive visual zooming, allocating deeper crops only to the most complex eligible region, deriving spatial relations from grounded geometry, and fusing non-duplicate evidence. We also introduce FactCycle, which scores caption-derived atomic claims on two blind anchors–source image (truthfulness) and reconstruction (realizability)–separating fabrication from generator loss claim by claim; human and multi-judge comparisons complement this fact-level view. Against Qwen3.5-397B-A17B captions, ZoomCap achieves an 81.9% human tie-adjusted preference score with a teacher over 10x smaller, and FactCycle counts 52.4 transferred claims per image vs. 31.5 for ScaleCap. The evidence also transfers: in continual pre-training, ZoomCap-450K improves the 11-benchmark average by 1.31-2.38 points over the strongest competing corpus and Ling-Tiny-VL-v3 gains 1.4 points on a production document/OCR monitor suite (1.5 on perception) at 60B tokens; in medical pre-training, 2.64M ZoomCap-captioned images improve five VQA benchmarks by 3.04 points (vs. 1.76 for same-image Gemini-3.1-Pro captions).

[60] CoViG: Coarsened Vision GNN for Image Classification cs.CVPDF

Martial Guidez, Stefan Duffner, Christophe Garcia

TL;DR: CoViG在视觉图网络中间Grapher模块加入MinCUT池化，以图粗化减少节点数量和推理计算，在ImageNet上保持接近原ViG的准确率，同时将FLOPs降至约51%。

Details

Motivation: 视觉图网络把图像表示为节点并在k近邻图上做图卷积，在图像分类上表现突出，但计算成本仍较高。

Result: CoViG将图粗化与视觉图网络结合，在中间ViG块的Grapher组件中增加MinCUT池化步骤，简化图结构并减少特定模块节点数，从而降低推理成本。作者在ImageNet及多种ViG架构上评估，准确率与原始ViG相当，而计算量约为其51%。

Insight: 适度粗化中间视觉图可减少图卷积成本，同时保留分类所需结构信息。摘要没有给各架构的准确率和吞吐数据、池化位置消融或显存指标；“相当”未附具体误差范围。

Abstract: Although Graph Neural Networks are widely used in various domains, they remained mostly unexplored in computer vision. Convolutional Neural Networks and Vision Transformers were leading the field, until the quite recent introduction of Vision Graphs (ViG) that treat images as a set of nodes and apply graph convolution on their k-NN graphs. ViGs show impressive accuracy on image classification but their computational cost remains relatively high. Inspired by optimization methods for GNNs, we present CoViG, a novel approach combining graph coarsening and ViGs. Our method introduces an additional MinCUT pooling step within the Grapher component of intermediate ViG blocks. By simplifying the intermediate graphs and thus decreasing the number of nodes of specific blocks, our approach considerably reduces the computational cost of ViG during inference. We evaluated our approach on ImageNet with several ViG architectures, and we obtained accuracies equivalent to the original ViG models with only about 51% of FLOPs.

[61] AdaLoop: Thinking with the Vision Encoder cs.CVPDF

Xinran Nicole Han, Yiyang Lu, Katelyn Gan, Todd Zickler

TL;DR: AdaLoop冻结预训练视觉权重，但根据问题多次迭代复用视觉编码器变换，使视觉计算随问题需求调整；在六项VisRO任务及三个VLM家族中超过同数据与更新预算的微调基线。

Details

Motivation: 多数视觉语言模型把视觉编码器当成一次性静态特征提取器，图像编码不依赖问题，后续推理全部交给语言模型；但不同问题可能需要不同视觉操作和处理深度。

Result: AdaLoop提出问题条件化视觉递归，在保持预训练视觉权重冻结的情况下，根据问题调整视觉计算，并跨多轮复用编码器变换。作者同时构建VisRO程序化数据集及生成流程，用于训练和评测视觉中心推理。在六项VisRO任务上，AdaLoop超过标准微调和问题条件单次处理基线；比较控制了训练数据量和优化器更新次数。收益在三个视觉语言模型家族的域内及域外样本上均出现。

Insight: 冻结视觉编码器并不意味着只能执行一次前向；按任务迭代调用其变换可让视觉特征处理深度适配问题。摘要未列VisRO具体任务、分数提升、推理额外计算和数据集生成规模。

Abstract: Most vision-language models (VLMs) treat the vision encoder as a static feature extractor: it encodes an image once, independently of the question, and leaves subsequent reasoning to the language model. Yet different questions may require different visual operations and processing depths. We present AdaLoop, a framework for question-conditioned visual recurrence in VLMs. AdaLoop adapts visual computation to the question and reuses the encoder’s transformations across multiple iterations, with the pretrained vision weights frozen. We also introduce VisRO, a procedural dataset and generation pipeline for training and evaluating vision-centric reasoning. On six VisRO tasks, AdaLoop outperforms standard fine-tuning and question-conditioned single-pass baselines with matched training data and optimizer updates. These gains hold across three VLM families on both in-distribution and out-of-distribution examples. Our findings suggest that pretrained vision encoders can contribute to reasoning through task-directed, iterative visual computation.

[62] CLAD: Keypoint Matching Using Global Line Correspondences cs.CV | cs.ROPDF

Masaki Satoh

TL;DR: CLAD以关键点到全局匹配线段的距离构造上下文描述符，并用HOME检测强弱线结构，在重复纹理或弱纹理场景中补充SIFT、ORB等局部特征匹配。

Details

Motivation: SIFT、ORB等关键点描述子依赖局部图像块，在重复图案或弱纹理场景中，不同位置的局部块可能相似，导致匹配不可靠。

Result: 上下文线辅助描述子CLAD为每个关键点构造一个向量，其各维表示该点到已匹配线段的接近程度，从而利用关键点与场景全局线结构的空间关系。系统通过HOME（霍夫空间一维极值匹配）检测明显和较弱线性结构，并建立足量线—关键点关联。TUM RGB-D SLAM数据集和户外视频序列评测显示，CLAD提供几何一致的匹配，可补充传统局部描述子；在局部块无法区分的重复场景中，利用全局结构提高匹配可靠性。作者称方法计算轻量且易实现。

Insight: 关键点匹配可利用场景级线几何，而不只依赖局部纹理；线结构在重复或弱纹理区域提供互补约束。摘要未给匹配准确率、速度或相对SIFT/ORB的量化增益，尚不能评估极端线段缺失场景表现。

Abstract: Traditional keypoint descriptors, such as SIFT (Scale-Invariant Feature Transform) and ORB (Oriented FAST and Rotated BRIEF), are computed from local image patches. They may be unreliable in scenes with repetitive patterns or weak textures, where patches at different locations can look similar. We propose the Contextual Line-Assisted Descriptor (CLAD), a keypoint matching method that addresses this problem by using global geometric context from line correspondences. CLAD represents each keypoint with a vector whose elements indicate its proximity to matched lines. It can therefore use the keypoint’s spatial relationships to the lines in the scene. We use HOME (Hough-space One-dimensional Matching of Extrema) to detect both clear and weak linear structures and to establish enough line-to-keypoint associations to represent this context. Evaluations on the TUM RGB-D SLAM dataset and outdoor video sequences show that CLAD provides geometrically consistent matches that complement those obtained with traditional local descriptors. In repetitive scenes, where local descriptors may not distinguish similar patches, CLAD uses global structure to improve matching reliability. The method is computationally lightweight and practical to implement.

[63] Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs cs.CVPDF

Zeyuan Yang, Zhuohao Chen, Jiaben Chen, Yao Zhang, Maohao Shen

TL;DR: PARA通过比较更准确视觉信息与更强推理器分别能挽回多少错误，量化VLM在模型—基准组合上的感知和推理剩余空间；GRAD则用组内最佳轨迹蒸馏视觉注意力来直接增强感知。

Details

Motivation: 强化学习显著提升语言推理，但在视觉任务上的收益不稳定；同一基准对不同模型可能分别受感知或推理瓶颈限制，统一把失败归因于推理会导致优化方向不当。

Result: 感知与推理归因PARA在4个视觉语言模型、17个多模态基准上，分别衡量提供更准确视觉信息或更强推理器可恢复的错误量。分析显示，RL收益随感知剩余空间增加而变小，随推理可解释的可恢复错误比例增加而变大，说明当前RL更能利用推理空间。作者进一步发现，现有RL的奖励级和令牌级信号只间接影响视觉注意力；据此提出组相对注意力蒸馏GRAD，用每组最佳rollout直接引导较弱rollout的视觉注意力。GRAD在两种模型规模、七个基准上持续提升表现，并可与已有RL方法互补。

Insight: 视觉任务优化前应区分感知和推理瓶颈；若感知限制大，单纯强化推理可能收益较小。PARA的归因来自人为替换信息/推理器的比较，GRAD结果限于报告的模型与基准，摘要未给具体分数及oracle构造细节。

Abstract: Reinforcement learning has brought strong gains to language model reasoning, but its improvements on visual tasks remain less consistent. One difficulty is that visual task failures can arise from different sources: the same benchmark may be limited by perception for one model and by reasoning for another. We introduce Perception and Reasoning Attribution (PARA), which measures the remaining perceptual and reasoning headroom of each model–benchmark pair by comparing how many current errors are recovered with more accurate visual information versus a stronger reasoner. Across 4 vision-language models and 17 multimodal benchmarks, PARA broadly agrees with the expected characteristics of existing benchmarks while revealing substantial model-specific variation. More importantly, it shows that RL gains become smaller as perceptual headroom increases, but larger when reasoning explains more of the recoverable errors, suggesting that current RL exploits reasoning headroom more effectively than perceptual headroom. Motivated by this gap, we analyze how existing RL objectives affect visual perception and find that reward- and token-level signals influence visual attention only indirectly. We therefore propose GRAD, a group-relative attention distillation objective that uses the best rollout in each group to directly guide the visual attention of weaker rollouts. GRAD consistently improves performance across two model scales and seven benchmarks, and further complements existing RL methods.

[64] Where, How, and When: Query-Guided Grounding for Video Understanding cs.CV | cs.AIPDF

Yogesh Kumar

TL;DR: 该论文围绕视频理解的“在哪里、如何、何时”提出对象级、关系级及片段级查询引导定位方法，涵盖未见对象定位、少样本视频关系定位及视频片段检索。

Details

Motivation: 视频理解需在多个粒度回答关键对象位置、对象关系及事件发生时刻；单一最终标签或局部定位难以覆盖对象、关系和时间三类查询引导的grounding任务。

Result: 对象级方面，QDETRv扩展Detection Transformer，用查询—上下文融合、时间记忆和合成对象轨迹无监督预训练，对视频中的未见对象进行一次性定位；TOViT面向少样本视频目标检测，基于语言对齐开放集视觉编码器，并跨帧传播高置信对象特征。关系级方面，提出少样本视频指代关系任务，给定(subject, predicate, object)和共享谓词的支持视频，通过元学习关系网络、查询条件平移嵌入、全局/局部语义聚合及信念传播优化T部随机场以定位实体。片段级方面，MATR使用双阶段动态时间规整进行融合前后对齐、可学习查询预测边界，并以时间增强自监督预训练；扩展到文本—视频片段检索时，表现与先进方法相当或更优。

Insight: 查询引导grounding可统一看作空间对象、对象关系和事件时间三个层次的问题；不同层次需各自设计支持记忆、关系推断或时间对齐机制。摘要未报告各方法基准名称、具体指标及彼此统一比较结果，该文为多项工作的综合性论文/学位论文式摘要。

Abstract: Understanding video content requires reasoning at multiple levels of granularity, from identifying objects to interpreting their interactions and localizing when specific actions occur. This thesis studies three query-guided grounding tasks that answer where key objects are (object-level grounding), how they interact (relationship-level grounding), and when specific moments occur (moment-level grounding). For object-level grounding, we present QDETRv, a query-guided extension of the Detection Transformer for one-shot localization of unseen objects in videos, which combines query-context fusion, a memory module for temporal consistency, and unsupervised pretraining on synthetic object trajectories. We further propose the Temporal Object-Aware Vision Transformer (TOViT) for few-shot video object detection, which builds on a language-aligned open-set vision encoder and propagates high-confidence object features across frames. For relationship-level grounding, we introduce few-shot referring relationships in videos: given a (subject, predicate, object) query and a few support videos sharing the predicate, the entities are localized by optimizing a T-partite random field using a meta-learned relation network with query-conditioned translational embeddings, Global Semantic Aggregation, Local Localization Aggregation, and belief-propagation-based message passing. For moment-level grounding, we propose the Moment Alignment Transformer (MATR) for video-to-video moment retrieval, which uses dual-stage Dynamic Time Warping for pre- and post-fusion alignment, learnable queries for boundary prediction, and self-supervised pretraining with temporal augmentations; MATR also extends to text-to-video moment retrieval with performance comparable to, or better than, the state of the art. These contributions advance query-guided video understanding across spatial, relational, and temporal grounding.

[65] PET Quantification-Preserving Registration for Longitudinal Whole-Body PSMA PET/CT cs.CVPDF

Fryderyk Kögl, Anna Reithmeir, Daniel M. Lang, Emily Chan, Rickmer Braren

TL;DR: 该方法改造LapIRN进行纵向全身PSMA PET/CT形变配准，结合仿射预配准、多模态配准、测试时个体优化、PET生物标志物保持损失及骨结构刚性正则化。

Details

Motivation: 纵向PSMA PET/CT配准需在不同时间检查间对齐解剖结构，同时保持代谢肿瘤体积和总病灶糖酵解等PET定量指标，避免形变损害临床测量。

Result: 作者将微分同胚粗到细LapIRN用于Learn2Reg 2026 PSMAReg挑战，方案包括仿射预配准、多模态形变配准和测试时实例优化。新增针对代谢肿瘤体积（MTV）与总病灶糖酵解（TLG）的生物标志物保持损失，含Jacobian约束，并对骨骼结构施加逐结构刚性正则。所提交配置在作者评测协议下达到DSC 81.0%、HD95 6.17毫米，MTV和TLG误差均为3.3%。

Insight: 配准质量不仅需评价解剖重叠和边界距离，也应检查变形对PET定量标志物的影响；骨结构刚性约束针对特定解剖先验。指标来自挑战评测协议，摘要未提供对照基线、测试样本量或临床阅片验证。

Abstract: We adapt the diffeomorphic coarse-to-fine LapIRN architecture for longitudinal whole-body PSMA PET/CT registration in the Learn2Reg 2026 PSMAReg challenge. The method combines affine pre-registration, multi-modal deformable registration, and test-time instance optimization. We further introduce PET biomarker preservation losses for metabolic tumor volume (MTV) and total lesion glycolysis (TLG), including Jacobian-based constraints, and a per-structure rigidity regularization for skeletal structures. The submitted configuration achieved 81.0% DSC and 6.17 mm HD95, with MTV and TLG errors of 3.3% and 3.3%, respectively, on our evaluation protocol. Code is available at https://github.com/koegl/psmareg.

[66] Can Visual Generation Expand What Unified Multimodal Models Know? cs.CV | cs.AIPDF

Wenkai Li, Wenyi Hong, Zhuoyi Yang, Jie Tang

TL;DR: KTP在受控设置中检验图像生成训练能否把视觉监督中的新知识迁移到文本问答，发现迁移直接但不均衡，并通过文本和图文交错对齐改善可访问性。

Details

Motivation: 统一多模态模型通过图像生成监督接触到文本未充分记录的视觉信息，尚不清楚这种训练能否扩展预训练模型的知识，并使知识可通过纯文本问答调用。

Result: 知识迁移探测KTP跨七类知识和三种统一多模态模型，以图像生成训练注入新知识，再用纯文本问答测试其可访问性。实验观察到视觉监督向语言的直接但不均衡迁移。作者进一步提出文本对齐和图文交错对齐，让生成与回答共享知识或交错响应；对选定实体的引导无需问答监督即可改善其它实体的知识访问，交错对齐还能进一步增益。分析显示，能正确在图像中再现的知识往往更容易通过文本访问，但两种访问方式之间仍有明显差距。

Insight: 图像生成监督可成为文本监督之外的知识来源，但生成时掌握知识不代表文本问答中都能调用；跨实体指导和交错对齐改善了部分可访问性。摘要未给准确率、七类知识具体内容及各模型差异。

Abstract: Unified multimodal models (UMMs) receive image-generation supervision that exposes them to visual information not fully documented in text. Can learning to generate images expand what pretrained models know? We introduce Knowledge Transfer Probing (KTP), a controlled protocol that supplies new knowledge through image-generation training and tests its accessibility through text-only question answering. Across seven knowledge categories and three UMMs, we observe direct but uneven transfer from visual supervision to language. Motivated by these observations, we successively introduce Textual Alignment and Interleaved Image–Text Alignment, which connect generation and answering through shared knowledge and interleaved responses, respectively. Guidance on selected entities can improve knowledge access on other entities without QA supervision, with additional gains from interleaved alignment. Further analysis shows that knowledge correctly reproduced in images is often more accessible through text, although substantial gaps remain between the two forms of access. These findings support visual generation as a source of knowledge beyond textual supervision, and motivate joint investigation of training data design and model architecture to make this knowledge more broadly accessible.

[67] Cross-Prompt Inference Mitigates Rare-Class Suppression in Imbalanced VLM Finetuning cs.CVPDF

Emanuel Ben Baruch, Sivan Biham, Alon Shoshan, Yochai Zvik, Avi Ben-Cohen

TL;DR: 该研究发现类别不平衡微调时，推理阶段换用不同但描述性的提示可恢复稀有类别召回，且其效果来自训练—测试提示交互而非单纯提示质量。

Details

Motivation: 视觉语言模型在类别不平衡数据上微调后，稀有类召回可能低于自身零样本表现；通常推理时沿用微调提示，作者发现这种匹配反而可能比换用另一条描述性提示更差。

Result: 作者在六个数据集及多种视觉语言模型上评估跨提示推理，发现使用不同的描述性推理提示可持续恢复稀有类召回，但对常见类召回存在不同权衡。换成非描述性提示并不会产生相同效果，说明现象不是单纯更换提示带来的。效果在类别不平衡和视觉混淆造成明显稀有类抑制时最强；原本没有此类抑制时则弱或不出现。调优贡献（TuCo）分析显示，跨提示推理减少对微调引入计算的依赖、转向预训练成分；人为降低微调贡献也会显著减小跨提示优势。

Insight: 不平衡微调抑制的稀有类知识可能仍保留在预训练表征中，替换描述提示可改变模型对预训练与微调成分的依赖；稀有类收益需与常见类召回权衡。摘要未报告各数据集的具体增益和类别频率。

Abstract: When a vision-language model is finetuned on class-imbalanced data, rare-class recall can fall well below the model’s own zero-shot performance. In this regime, we uncover a surprising matched-prompt penalty whereby the standard choice of reusing the descriptive finetuning prompt at inference can yield lower rare-class recall than using a different descriptive prompt. We call this inference-time strategy cross-prompt inference. We evaluate diverse VLMs across six datasets and find that cross-prompt inference consistently recovers rare-class recall, with varying trade-offs in frequent-class recall. The effect reflects a train-eval prompt interaction rather than prompt quality alone, and does not arise with non-descriptive prompt changes. It is strongest when imbalance and visual confusability produce substantial rare-class suppression, and is weak or absent when such suppression does not occur. Using Tuning Contribution (TuCo), which decomposes a model’s computation into pretrained and finetuning parts, we find that cross-prompt inference reduces reliance on finetuning-induced computation and shifts the model toward its pretrained component. Reducing that finetuning contribution also substantially reduces the cross-prompt advantage. These results show that rare-class knowledge suppressed by imbalanced finetuning can remain accessible under a different inference prompt.

[68] GRASE: Geometry-native Real-to-sim Agentic Scene Modeling from Video cs.CVPDF

Zhaorui Lin, Haohan Liu, Zhen Chen, Xiangru Huang

TL;DR: GRASE以采集视频作为持续参照，形成“渲染—比较—修订”闭环来构建真实到仿真的几何场景模型，逐步校正结构外壳、资产位置与几何误差。

Details

Motivation: 现有真实到仿真转换常采用松耦合的一次性流程，各阶段反馈有限，早期估计误差会逐步传播，最终场景可能与观测不一致。

Result: GRASE将多视角采集视频全程作为场景建模参照，若渲染证据与视频不符，就修订当前假设，而非固定接受中间结果。流程先根据深度及多视角线索拟合建筑外壳和开口；再由智能体在共享坐标系中放置生成资产并检查空间关系；最后迭代细化资产几何和位置以匹配观测视角。各阶段通过反馈闭环连接，定位结构差异并仅修正相关组件，同时维持跨视角一致。作者报告生成场景忠实于输入、视角间一致且可用于仿真，实验显著超过包括GPT-6 Astra直接转换在内的先进方法。

Insight: 持续使用原始多视角视频验证渲染并局部回滚，可减少流水线误差累积，避免早期几何错误被后续阶段固化。摘要未提供场景数量、量化指标、人工成本或仿真任务上的实际收益。

Abstract: Real-to-sim conversion aims to turn a captured video of a real environment into an editable 3D scene while preserving the geometry and layout of what was observed. Existing methods often follow a one-pass, loosely coupled paradigm: each stage receives only limited feedback from previous stages, allowing errors to propagate without reliable correction and leaving the final scene inconsistent. We present GRASE, an agentic framework that closes this loop by treating the captured multi-view video observations as a standing reference throughout scene modeling. Instead of committing to intermediate estimates, GRASE revises its current hypothesis whenever rendered evidence disagrees with the capture, overcoming the fixed intermediate assumptions of conventional pipelines. Specifically, GRASE first fits the architectural shell and its openings from depth and multi-view cues. An agent then places generated assets in a shared coordinate frame while checking their spatial relationships. Finally, each asset’s geometry and placement are refined iteratively to improve agreement across the observed views. By coupling these steps through feedback, GRASE localizes structural discrepancies and revises only the responsible components, while preserving cross-view consistency. The resulting 3D scenes are faithful to the input, consistent across views, and suitable for simulations. In our experiments, GRASE substantially outperforms other state-of-the-art methods, including a direct real-to-sim conversion using GPT6-Astra.

[69] FilterFusion: Prior-Guided Adaptive Filter Fusion for Efficient Video Denoising cs.CVPDF

Wenlong Yang, Weihang Yuan, Canran Jin, Jiahao Li, Henrik Turbell

TL;DR: FilterFusion用低分辨率控制器根据时间/空间方差线索，在原始分辨率自适应混合一组可解释滤波分支，以小模型和规则滤波器实现高效多帧视频降噪。

Details

Motivation: 真实通信视频需同时应对传感器噪声、压缩伪影和运动不一致，并满足严格延迟；纯深度模型精度高但计算大，传统滤波稳健高效却缺乏适应性。

Result: FilterFusion结合时间感知学习特征和可解释降噪滤波分支，预测低成本引导信号，在原分辨率自适应混合少量滤波响应；低分辨率控制器显式使用时间方差和空间方差。模型仅含109K参数。在真实传感器噪声CRVD上，达到34.72 dB PSNR、0.9330 SSIM，网络计算量仅0.18 GFLOPs。滤波器组由高斯模糊、中值及加权求和等简单规则操作构成，直接编译的C合成路径在单CPU线程、1080p下每帧17.9毫秒（55.9 FPS），高于实时要求，速度比每帧超过2秒的轻量CNN基线快122至252倍。

Insight: 低成本控制器负责按场景选择规则滤波响应，可在保留适应性的同时避免全分辨率深网络推理。报告的1080p速度基于单CPU线程及特定编译实现，CNN比较为122—252倍，摘要未给多种混合退化条件下的分项质量。

Abstract: Real-world video denoising for communication systems must handle mixed degradations such as sensor noise, compression artifacts, and motion-induced inconsistency while remaining deployable under tight latency budgets. Purely deep models often achieve high accuracy but come with significant computational cost, whereas classical filters are robust and efficient but insufficiently adaptive. We present FilterFusion, a prior-guided multi-frame denoising framework that combines temporally-aware learned features with an interpretable bank of denoising branches. The model predicts a low-cost guidance signal and uses it to adaptively mix a compact set of denoising responses at the original resolution. The lightweight design uses only 109K parameters and explicitly injects temporal variance and spatial variance cues into the low-resolution controller. On CRVD (real sensor noise), it reaches 34.72 dB PSNR and 0.9330 SSIM with only 0.18 GFLOPs (network-only). Because the filter-bank operations are simple and regular (Gaussian blur, median, weighted sum), a straightforward compiled C implementation of the synthesis path achieves 17.9ms per frame (55.9 FPS) on a single CPU thread at 1080p—exceeding real-time and 122–252 times faster than lightweight CNN baselines that require over 2 seconds per frame. The results demonstrate a strong quality-efficiency-speed trade-off and a practical route to real-time denoising through low-resolution control and explicit filter-based synthesis.

[70] MYOPIA: Understanding the Limits of Tree-Based Reasoning in Vision-Language Models cs.CVPDF

Islam Mesabah, Sary Elmansoury, Gerrit Großmann, Peter Neigel, Sebastian J. Vollmer

TL;DR: MYOPIA基准研究视觉语言模型按人工修订决策树逐问分类的准确率代价，发现树遍历在12种数据集—模型组合中均弱于零样本提示。

Details

Motivation: 决策树可通过根到叶问题序列提供可解释分类，但逐步贪心且不可回溯的过程可能损失准确率，其代价及失败来源尚不明确。

Result: MYOPIA包含针对GTSRB、MNIST、CIFAR-10和MSCOCO构建并经人工修订的四棵决策树，以及匹配提示、诊断协议和评测工具。在GPT-4o、Qwen-VL Max和LLaMA-3.2 11B Vision上，树遍历在全部12种数据集—模型组合中都低于零样本提示，配对bootstrap分析始终支持零样本方法。模型回忆树中类别属性的准确率通常高于将相同属性落地到图像的准确率，平均标签—图像差距分别为9.5、13.8和12.6个百分点。错误局部判断会不可逆地排除正确类别，答案提取也造成额外且依赖模型的损失。节点审计发现，分裂熵与较低节点准确率呈较弱但一致关联，深度、分支因子和节点内grounding差异则较不稳定。

Insight: 层次决策不仅可能因早期错误剪除正确类别，还受视觉属性grounding和答案抽取影响；树结构可解释性不保证分类准确。实验仅覆盖四棵特定树和三类模型，作者建议未来设计优先考虑可感知性及早错恢复。

Abstract: Decision trees can make vision-language model (VLM) classification interpretable by replacing a single prediction with a sequence of root-to-leaf questions. However, the accuracy cost of this greedy, non-backtracking procedure remains unclear. We introduce \textbf{MYOPIA}, a benchmark comprising four LLM-generated, human-refined decision trees for GTSRB, MNIST, CIFAR-10, and MSCOCO, together with matched prompts, diagnostic protocols, and an evaluation harness. Across GPT-4o, Qwen-VL Max, and LLaMA-3.2 11B Vision, tree traversal underperforms zero-shot prompting in all 12 dataset–model pairs; paired bootstrap analyses consistently favor zero-shot. Our diagnostics characterize interacting failure modes associated with this gap. Models often recall tree-encoded class attributes more accurately than they ground the same attributes in images: the mean label–image accuracy gaps are 9.5, 13.8, and 12.6 points for GPT-4o, Qwen-VL Max, and LLaMA, respectively. Incorrect local decisions then irreversibly exclude the correct class, while answer extraction introduces additional model-dependent loss. A node-level audit of the four trees finds that split entropy is weakly but consistently associated with lower node accuracy, whereas depth, branching factor, and within-node grounding differences are less stable. \textbf{MYOPIA} therefore provides a framework for diagnosing hierarchical visual classification and motivates testing tree designs that prioritize perceptual answerability and recovery from early errors. Code is available at https://github.com/islammesabah/VLM_Classification.

[71] Hear, Localize, and Reason: Spatially Aware Scene Understanding for Audio-Visual LLMs cs.CV | cs.SDPDF

Kim Sung-Bin, Lee Jung-Mok, Jinwoo Jung, Oh Hyun-Bin, Hyeonggon Ryu

TL;DR: HLR-AVSceneQA按“听到什么—声源在哪里—声源与视觉场景如何关联”评测音视频空间理解，HLR-LLM则在单声道语义音频通道外增加双耳空间音频分支。

Details

Motivation: 现有音视频大语言模型多把音频当作单声道语义内容，限制对声音来源方位及其与视觉场景关系的推理；已有空间音视频研究常只覆盖对应关系或方向距离等单项能力。

Result: 作者提出分层基准HLR-AVSceneQA，评估声音识别、在自我中心和客观坐标视角中的声源定位，以及利用定位结果推理声源与视觉场景的关系。HLR-LLM在强音视频基础模型上加入双耳空间音频分支，同时保留单声道语义音频路径，并以课程学习训练，最后阶段加入多步空间推理思维链监督。实验显示，现有音视频模型在空间落地和关系推理上仍有限；HLR-LLM显著改善空间音视频场景理解，同时不损害语义音视频感知。

Insight: 声音语义识别与声源空间定位是互补能力，需要在模型结构和评测中分别体现；双耳线索及多步推理监督可提升空间理解。摘要未给基准规模、准确率、模型细节及音频空间标注方式。

Abstract: Audio-visual large language models (AV-LLMs) have made strong progress in multimodal understanding, yet most treat audio as monaural semantic content, limiting their ability to reason about where sounds originate and how they relate to the visual scene. Recent spatial audio-visual studies address parts of this problem, but often focus on specific abilities, such as spatial correspondence or direction and distance reasoning. In this work, we introduce HLR-AVSceneQA, a comprehensive benchmark with a hear-localize-reason hierarchy that evaluates whether models can recognize what is heard, localize sound sources in egocentric and allocentric views, and use these localized sources to reason about how they relate to the visual scene. We further introduce HLR-LLM, which augments a strong audio-visual foundation model with a binaural spatial audio branch alongside its monaural semantic audio pathway. We train HLR-LLM with a curriculum that incorporates final-stage chain-of-thought supervision for multi-step spatial reasoning. Experiments show that existing AV-LLMs remain limited in spatial grounding and relational reasoning, while HLR-LLM substantially improves spatial audio-visual scene understanding without compromising semantic audio-visual perception.

[72] Spurious Attention Heads in Vision Transformers: Mechanistic Identification of Annotation-Driven Bias in Medical Chest X-Ray Analysis cs.CV | cs.CLPDF

Joshua Muhumuza, Cornelius Kalenzi

TL;DR: 机制可解释性分析在ViT-Base/16中定位到专门读取胸片角落标注的注意力头L8H10，并通过遮挡干预验证其因果作用及微调后仍会保留。

Details

Motivation: 医疗视觉Transformer可能利用与疾病无关的伪相关，但若不了解内部机制就难以定位和修复。研究考察模型是否读取胸片角落文字等标注捷径，而非肺部病理。

Result: 在200张COVID-19胸片中，ViT-Base/16的单个注意力头L8H10有62%的情况下关注角落标注而非肺部病灶。修补验证显示驱动因素是标注内容而非亮度或边缘密度；在受影响图像中移除标注使肺部注意力提高1.52倍（p<0.0001）。该现象还见于NIH ChestX-ray14（79%）、DeiT-Base（88%）和ViT-Large/16（80%），跨两个数据集、三种架构重复出现。全量微调未消除此行为，98.4%的伪相关图像仍然存在该现象，伪相关率还略升。单头消融（p=0.340）及三个载体头的多头消融（p=0.532）均无法从输出层面显现该回路。

Insight: 行为准确率评测可能完全看不到具有因果作用的标注读取回路，常规全量微调甚至可能强化捷径；机制审计和内容级干预可揭示隐藏偏差。百分比是作者定义的伪相关图像比例，摘要未给疾病分类性能及不同医院标注分布。

Abstract: Vision Transformers deployed in medical imaging exploit spurious correlations, yet the internal mechanisms remain unidentified and impossible to fix. We apply mechanistic interpretability to locate one such mechanism in ViT-Base 16: a single attention head (L8H10) that functions as a dedicated annotation-reader on chest X-rays, attending to corner text rather than lung pathology in 62% of 200 COVID-19 images. Causal validation via inpainting confirms annotation content rather than luminance or edge density drives the behaviour, increasing lung attention 1.52 times upon removal in affected images ($p{<}0.0001$). The finding replicates across NIH ChestX-ray14 (79%), DeiT-Base (88%), and ViT-Large 16 (80%), establishing spurious annotation-attending heads as a consistent property of ViT-family architectures across two datasets and three architectures. Full fine-tuning does not suppress the behaviour and may entrench it: 98.4% of spurious images remain spurious and the spurious rate rises marginally, as the shortcut is reinforced rather than removed. Critically, single-head ablation produces $p{=}0.340$ and multi-head ablation of all three identified carriers produces $p{=}0.532$, meaning a causally verified annotation-reading circuit is completely invisible to output-level evaluation. Mechanistic auditing finds what behavioural testing cannot.

[73] SCMerge: Spatial-Consistency-Aware Token Pair Merging for Efficient Semantic Segmentation cs.CVPDF

Junfeng Ren, Yi Gong, Yuan Zeng

TL;DR: SCMerge是免训练视觉Transformer令牌合并方法，在配对时同时考虑特征相似性和空间一致性，合并后再映射回原始patch网格用于语义分割。

Details

Motivation: 视觉Transformer的二次注意力复杂度限制语义分割应用；合并相似令牌可缩短序列，但若只依特征相似性而忽略空间一致性，可能引入分割错误。

Result: SCMerge在编码器内部合并成对令牌，配对时共同利用特征相似度与空间一致性，解码后将合并序列重建回原始patch网格。方法无需训练，可插入已有视觉Transformer语义分割流程。在ADE20K、Pascal Context和Cityscapes上的实验显示，与基线相比，SCMerge在分割准确率和效率之间取得更好的权衡。

Insight: 空间相邻或结构一致性应与语义特征共同决定令牌合并，以免将视觉相似但位置关系不同的区域混并。摘要未给令牌缩减比例、延迟/FLOPs及分割分数，效果仅定性报告。

Abstract: Vision Transformer architectures have showcased impressive performance on semantic segmentation, yet their quadratic attention complexity hinders practical applications. Recent works have focused on merging tokens to reduce sequence length and thus improve transformer efficiency. However, existing token merging methods primarily rely on feature similarity to identify similar tokens, overlooking spatial consistency, which may introduce segmentation errors in semantic segmentation. In this work, we propose SCMerge, a training-free token merging method that jointly considers feature similarity and spatial consistency in pairing similar tokens. The pairwise tokens are then merged within the encoder, and the resulting token sequences are reconstructed onto the original patch grid after decoding. The proposed method is flexible and can be plugged into existing vision Transformer-based semantic segmentation pipelines. Extensive experiments on the benchmark datasets ADE20K, Pascal Context, and Cityscapes show that SCMerge consistently achieves a better trade-off between segmentation accuracy and efficiency than baseline methods.

[74] FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models cs.CVPDF

Jiaming Zhang, Zherui Li, Siqi Guo, Junhao Dong, Kun Wang

TL;DR: PaRMA/FusionAudit按两类视觉干预路径分别审计原生多模态模型：像素扰动与渲染文字插入，并提出MANTIS和Nat-Evid攻击揭示单一攻击排名可能漏掉的风险。

Details

Motivation: 视觉语言模型从冻结编码器流水线转向原生多模态架构后，图像通道既承载视觉内容，也承载可能与用户提示竞争的渲染文字；只用单一像素攻击及单一总分无法覆盖不同攻击面和架构差异。

Result: PaRMA以证据为基础定义路径条件风险，分析像素扰动和渲染文本插入两类图像干预，并使用路径专属诊断暴露架构盲点。研究发现原生模型存在“看见但不受骗”现象：模型强烈关注印刷覆盖文字，却在视觉上拒绝其内容；深度融合模型中编码器级攻击与答案级攻击还存在目标错配。基于此提出边际感知像素扰动MANTIS和宿主一致语义插入Nat-Evid。对18种开放权重VLM及新颖性分类评测显示，传统PGD单一攻击排名在原生模型上不稳定；新攻击显著提高估计的残余风险。

Insight: 模型注意到攻击文字与最终遵循它是不同现象，需按架构路径和攻击目的分别测量；依赖单一PGD分数会误排模型鲁棒性。摘要未列具体风险值、攻击成功率和新颖性分类细节，评估框架侧重可证伪诊断而非单一总榜。

Abstract: As vision-language models (VLMs) transition from frozen-encoder pipelines to native multimodal architectures, the visual channel increasingly serves as both a perceptual input and a carrier of rendered text that competes with user prompts. Current single-attack, pixel-centric evaluations fail to capture this complexity: they collapse distinct visual attack surfaces into a single scalar and ignore how architectural shifts alter vulnerability. We introduce PaRMA, an evidence-based auditing framework that defines pathway-conditioned risk over two primary image-level interventions: pixel perturbation and rendered-text insertion. Instead of arbitrary attack enumeration, PaRMA uses pathway-specific diagnostics to expose architecture-specific blind spots. Notably, we uncover a see-but-not-deceived signature where native VLMs attend heavily to typographic overlays but visually reject them, and we identify an objective mismatch between encoder-level and answer-level attacks in deep-fusion models. To exploit these findings, we instantiate FusionAudit, introducing two diagnostic-motivated attacks: MANTIS (margin-aware pixel perturbation) and Nat-Evid (host-congruent semantic insertion). Evaluating 18 open-weight VLMs across a novel nativeness taxonomy, we demonstrate that legacy single-attack rankings (e.g., PGD) are unstable for native models. Our diagnostic-driven attacks substantially raise the estimated residual risk, showing that PaRMA provides a falsifiable, evidence-driven auditing methodology for uncovering vulnerabilities missed by standard benchmarks.

[75] Edit4D: Editable 4D Scene Generation with Textual Control cs.CVPDF

Chanwoo Kim, Tackgeun You, Hwasup Lim

TL;DR: Edit4D将背景和动态角色分别生成并重建为3D高斯背景与4D网格角色，再通过文本引导分割、接触感知优化和全局细化组合，支持文字控制下可编辑的4D场景。

Details

Motivation: 整体视频式动态场景生成将背景与角色耦合，导致对象级编辑和灵活相机控制困难；可编辑4D生成还需同时保持空间几何与时间动态。

Result: Edit4D先将用户指令拆成背景、动态角色及场景—角色组合的阶段化提示；用文本到图像和相机条件生成先验构造多视图场景图像，重建背景3D高斯泼溅。随后生成角色图像，以图像条件视频先验赋予运动，重建4D网格并绑定高斯基元得到角色表示。最后以文本引导分割和接触感知优化组合背景与角色，并进行全局场景细化以改善协调性和渲染一致性。作者报告该流程支持可控相机运动、灵活对象编辑及可编辑4D场景构建。

Insight: 分离静态环境和动态主体的表征可提高对象级修改能力，再以接触和全局协调约束组合结果。摘要未给数据集、编辑/几何指标或与基线的量化比较，方法质量及可控性只作定性陈述。

Abstract: We introduce Edit4D, an editable text-to-4D scene generation framework that constructs 4D scenes from separate background and dynamic character representations. Recent advances in generative models have enabled text-driven dynamic scene synthesis, but editable 4D scene generation remains challenging due to the need to preserve spatial geometry and temporal dynamics. Existing approaches typically generate holistic scene videos, where the background and dynamic characters are coupled, making object-level editing and flexible camera control difficult. Edit4D addresses these limitations through a stage-specific generation pipeline. Given a user instruction, Edit4D first decomposes it into stage-specific prompts for background, dynamic character, and scene-character composition. Using these prompts, we synthesize multi-view scene images with text-to-image and camera-conditioned generative priors and reconstruct a background 3D Gaussian splatting representation. We then generate a character image, animate it with an image-conditioned video prior, reconstruct a 4D mesh, and bind Gaussian primitives to obtain a character representation. Finally, both components are composed through text-guided segmentation and contact-aware optimization. A global scene refinement is then performed to improve harmonization and rendering consistency. By integrating stage-specific components, Edit4D enables controllable camera motion, flexible object-level editing, and the practical construction of editable 4D scenes. Project page: https://chanwo0kim.github.io/Edit4D/

[76] Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration cs.CVPDF

Connor Daly, Salvatore Russo, Jinendra Ekanayake, Daniel S. Elson, Ferdinando Rodriguez y Baena

TL;DR: 该研究提出通过常规术中C臂透视与双模态可见标记阵列，生成每节椎骨6自由度位姿并映射至RGB-D坐标系，为无标记术中跟踪提供独立的深部结构真值。

Details

Motivation: RGB-D无标记脊柱跟踪可替代侵入性骨固定标记，但现有临床数据集缺少独立的骨下/深部真值，无法可靠验证这些方法。

Result: 流程利用常规椎体水平确认时已采集的C臂透视图像，通过多视角2D—3D CT到透视配准恢复各椎骨位姿，并借助同时可由两种成像模态检测的多模态标记阵列与RGB-D相机坐标配准。该流程不需额外辐射、器械或改变标准手术工作流。与光学跟踪羊椎骨的离体验证中，端到端误差为2.06±0.29毫米和3.35±0.93度，作者认为可作为误差显著更大方法的独立真值。随后在三段手术序列、11节椎骨、1,500帧临床数据上评估两种无标记配准策略，作者称这是临床场景中首次用独立深部参考进行此类评测。

Insight: 利用既有术中透视建立深部几何参考，有望在不改变手术流程的情况下填补无标记跟踪验证缺口。离体精度结果不等同于临床条件下真值误差；临床应用验证仅涉及三段序列和两种方法。

Abstract: Markerless intraoperative tracking of spinal anatomy via RGB-D sensors is a promising alternative to invasive bone-anchored fiducials, yet no existing clinical dataset provides independent subsurface ground truth for validating these methods. We address this gap with a clinically viable pipeline that derives per-vertebra 6-DoF pose from routine intraoperative C-arm fluoroscopy, co-registered to the RGB-D camera frame through a multimodal fiducial array detectable in both imaging modalities. Critically, the pipeline requires no additional radiation, instrumentation, or deviation from standard surgical workflows, relying solely on the fluoroscopic images already acquired during routine level checks. A calibrated transform chain links the vertebral pose recovered via multi-view 2D-3D CT-to-fluoroscopy registration to the RGB-D coordinate frame, enabling direct comparison of any markerless registration estimate against a subsurface reference. Ex vivo validation against optically tracked ovine vertebrae confirms end-to-end accuracy of 2.06 +- 0.29 mm and 3.35 +- 0.93 degrees, sufficient to serve as independent ground truth for methods with substantially larger errors. We demonstrate the pipeline’s utility by evaluating two markerless registration strategies on clinical data spanning 11 vertebrae across 1,500 frames from three surgical sequences: the first such evaluation against an independent subsurface reference in a clinical setting. The proposed framework provides reusable infrastructure for benchmarking emerging markerless tracking methods on real surgical data.

[77] Beyond Source Prompts: Towards Visually Grounded AI-Generated Video Quality Assessment cs.CVPDF

Kehao Zhou, Yixuan Li, Yuxuan Jiang, Fan Zhang

TL;DR: VGCap用基于生成视频多帧证据校正的全局描述及与提示无关的局部片段描述，作为文本参考评估AI生成视频的空间质量、时间质量和文本—视频一致性。

Details

Motivation: AI生成视频常存在多种失真，质量评估需要考察语义；但源提示可能与实际生成内容不符，用提示作唯一文本参考会造成评估错位。

Result: VGCap构造两种视觉落地描述：基于多帧证据对源提示做最小修改得到全局描述，以及独立描述局部时间片段的提示无关片段描述。二者共同为空间质量、时间质量和文本—视频匹配提供互补文本证据。在LGVQ和FETV数据集上，VGCap在三个维度均超过代表性基线。描述来源和时间组件消融支持视觉落地描述的有效性，并显示片段级特征尤其有利于时间质量预测。

Insight: 生成视频内容应作为质量评估的事实依据，原始提示需与多帧实际画面校准；片段描述有助于捕捉时间维度失真。摘要未列具体指标、数据集规模和基线名称，当前结果基于两个指定数据集。

Abstract: Recent advances in generative artificial intelligence have accelerated video generation technologies. However, AI-generated videos (AIGVs) remain susceptible to various distortions, highlighting the need for dedicated video quality assessment methods. Content semantics play an important role in AIGV quality assessment, with source prompts typically used as textual references. However, these prompts may not accurately reflect the generated video content, resulting in a discrepancy between the intended textual description and the generated result. To address this limitation, this paper proposes VGCap, an AIGV quality assessment framework guided by visually grounded captions that align better with generated content. Specifically, we introduce two forms of captions: a global caption obtained by minimally revising the source prompt based on multi-frame visual evidence, and prompt-independent segment captions that describe localized temporal content. Together, these captions provide complementary textual evidence for assessing spatial quality, temporal quality, and text-video alignment. Experimental results on the LGVQ and FETV datasets show that VGCap outperforms representative baselines across all three dimensions. Further ablation studies on caption sources and temporal components confirm the effectiveness of visually grounded captions for each quality dimension, while highlighting the benefits of segment-level features for temporal quality prediction. The source of VGCap will be available at https://github.com/lolo123-123/VGCap.

[78] Beyond Generation: Using Multimodal LLMs as Detectors of LLM-Generated Deepfake Facial Images cs.CV | cs.ETPDF

Olivia Salamon, Virginia N. L. Franqueira, Shujun Li

TL;DR: 该研究评估六种多模态大模型对真实及生成深伪人脸图像的识别，发现模型可借助图像结构/物理不一致检测合成内容，但表现随模型代际变化，SynthID水印可能改变可见伪影线索。

Details

Motivation: 图像生成模型日益逼真，传统取证技术难以跟上；研究考察多模态模型究竟通过识别物理结构不一致，还是依赖数字水印等痕迹判断人脸图像是否合成。

Result: 作者用400张图像评估GPT-4o、GPT-5、GPT-5.2、Gemini 2.5、Gemini 3和Seed 1.6，其中50张为真实照片，350张由七种生成器产生。评测包含单图分类、成对比较及针对Gemini的自检测实验。GPT-5.2在特定生成器组合的成对实验中最高准确率为97.9%，整体平均成对准确率为82.5%；分析认为模型识别了图像中的结构或物理不一致。自检测实验显示，含不可见SynthID水印的组比干净对照组检测准确率低10%；作者提出水印嵌入可能减少模型可依赖的部分可见伪影。

Insight: 模型可能利用结构或物理伪影而非仅依赖水印进行深伪识别，但结果因模型代际而异；水印嵌入与检测下降相关，不足以单独证明水印因果性地遮蔽特定伪影。数据集仅400张，摘要未报告单图分类分数及真实世界跨域泛化。

Abstract: As image generation models become increasingly capable of producing highly realistic content, traditional forensic techniques are struggling to keep up. This paper investigates whether MLLMs can instead be used as a form of forensic analysis by identifying synthetic media. Specifically, the study aims to determine whether these models detect fake images by recognising physical inconsistencies, or whether they rely on digital artefacts such as embedded watermarks.Six MLLMs: GPT-4o, GPT-5, GPT-5.2, Gemini 2.5, Gemini 3, and Seed 1.6, are benchmarked using a dataset of 400 images. Fifty images are authentic photographs, while the remaining 350 are generated using seven leading image models: Gemini 3, Gemini 2.5, Flux.2 Pro, GPT-Image-1, GPT-Image-1.5, Seedream 4.0, and Seedream 4.5. The evaluation is structured in three stages: single-image classification, pairwise comparison, and a focused “self-detection” experiment on Gemini. Several MLLMs achieved a high detection accuracy, with GPT-5.2 reaching a peak of 97.9% in the pairwise experiment, against specific generators and an overall mean pairwise accuracy of 82.5% by identifying structural or physical inconsistencies within images. However, results from the self-detection experiment indicate that the presence of invisible SynthID watermarks leads to a 10% reduction in Gemini’s detection accuracy compared to the clean control group. One possible explanation is that SynthID embedding reduces some of the visible artefacts the models rely on for detection.These results imply that MLLMs can detect structural artefacts without relying on watermarks, but performance varies substantially across model generations. The findings from comparison C5 also suggest that SynthID embedding may suppress some of the structural artefacts used during detection.

[79] FuseAdapt: Parameter-Efficient Multimodal Fusion for Semantic Segmentation with Missing Modalities cs.CVPDF

Xin Zhang, Robby T. Tan

TL;DR: FuseAdapt在冻结视觉基础模型的适配空间中进行多模态语义分割：各模态保留私有Q/V低秩适配，只在FFN适配残差中跨模态路由，并以训练期预测模态建模应对缺失输入。

Details

Motivation: 多传感器互补能提升语义分割，但测试时模态退化或缺失会使专用融合网络和多分支交叉编码器变得不可靠，导致明显性能下降。

Result: FuseAdapt为每种模态分配轻量适配分支，冻结视觉基础模型骨干；模态私有Q/V低秩适配保持隔离，只有FFN低秩残差在骨干内跨模态路由。预测模态建模（PMM）训练时遮蔽一个目标模态，并以完整模态输入下教师生成的目标表征为监督，预测被遮蔽模态嵌入；PMM仅用于训练，不增加推理开销。在MCubeS、DELIVER和MUSES三个多模态分割基准上，方法在完整和缺失模态情况下均有提升，较此前最先进方法分别最高增加3.01和12.56 mIoU，且可训练参数预算较小。

Insight: 跨模态交互可限制在适配残差中，而训练时重建缺失模态表征帮助模型利用可见模态间冗余；最大收益出现在缺失输入情形。报告的是最高mIoU增益，摘要未提供各基准分项结果和缺失模式细节。

Abstract: Multi-modal semantic segmentation benefits from complementary sensors, but this benefit is fragile when some modalities are degraded or missing at test time. Many existing methods rely on dedicated fusion modules or multi-branch cross-modal encoders, and the fusion often becomes unreliable when modalities are absent, leading to substantial performance drops. We propose \textbf{FuseAdapt}, a parameter-efficient framework that performs fusion within the adaptation space of a frozen vision foundation model (VFM), exploring whether VFM priors can serve as an effective shared backbone for multi-modal segmentation. Instead of attaching a standalone fusion network, FuseAdapt assigns each modality a lightweight adaptation branch and performs \emph{adaptation-space fusion} by keeping Q/V low-rank adaptation private to each modality and routing only FFN low-rank residual activations across modalities inside the frozen backbone. The pretrained VFM remains fixed while modality-specific corrections and explicit cross-modal interaction are learned through the adaptation paths. To handle missing modalities, we further introduce \textbf{Predictive Modality Modeling (PMM)}, a direct representation-level objective for cross-modal redundancy. During training, PMM masks a target modality and predicts its embedding from the visible ones, supervised by a teacher target computed under full-modality input. PMM is used only during training and adds no inference-time overhead. Across three multi-modal segmentation benchmarks (MCubeS, DELIVER, MUSES), FuseAdapt consistently improves both modality-complete and modality-incomplete segmentation with a small trainable budget, yielding up to +3.01 mIoU under full modalities and +12.56 mIoU under missing modalities over prior state-of-the-art. Project page: https://devinxzhang.github.io/FuseAdapt-Page/.

[80] Learning to Think and Explore in 3D World cs.CVPDF

Yijiang Li, Bingyang Wang, Nuno Vasconcelos

TL;DR: ACT3D让视觉语言模型从单张第一视角图像出发，通过动作与环境交互自主探索3D场景，并只用最终回答正确性训练探索策略。

Details

Motivation: 常见3D视觉问答直接给模型多视角图像、视频或3D表示，而该研究希望保留VLM原生逐张处理图像的方式，把3D仅作为可交互环境，让模型自己决定导航和改变视角。

Result: 每次轨迹从初始第一人称视图和视觉问题开始，模型可以循环推理、移动、调整视角后再回答。先做轨迹监督微调，再用主要依据最终答案正确性的强化学习训练；训练不给访问哪些视角或采取何种探索动作的直接监督。六个3D基准上，ACT3D平均准确率53.2%，比基础Qwen提高22.0%，并超过专有Gemini 3.6 Flash；输入帧减少50%至70%时仍超过既有开源3D方法。对未见领域的平均提升为相对监督初始化5.9%。按问题是否需探索分组，初始视图可答题相对基础模型提升0.6%，需要大量探索的题提升16.3%；分析显示模型会寻找遮挡目标、避免无必要探索并获取空间比较所需的互补视点。

Insight: 仅用结果奖励也可学习问题条件化的主动视觉探索，特别是在需离开初始视野时收益更大；减少输入帧说明效率与覆盖可兼顾。摘要未给六个基准分项分数、探索动作成本或真实机器人验证。

Abstract: We study how vision-language models (VLMs) can learn to think and actively explore in 3D space. Instead of providing multi-view images, videos, or 3D representations to the model, we preserve the native visual encoding of VLMs, i.e., a single image, one at a time, just like humans, and treat the 3D representation only as an environment with which the model can interact through actions (e.g., move left) and observations (rendered images). Each rollout begins from an initial first-person view and a visual question. The model can then iteratively reason, navigate, and reorient its viewpoint before committing to a final answer. Following an initial trajectory-supervised finetuning, we apply reinforcement learning (RL) with rewards driven primarily by final-answer correctness. Crucially, RL provides no direct supervision over which viewpoints the model should visit or which exploration actions it should take. Instead, the model must learn an effective exploration policy solely from the extent to which its interactions improve performance. Across six 3D benchmarks, our model ACT3D achieves an average accuracy of 53.2% that improves its base Qwen model by 22.0% and surpasses proprietary Gemini 3.6 Flash. ACT3D also outperforms existing open-source 3D methods while using 50-70% fewer input frames, and generalizes to unseen domains with an average improvement of 5.9% over its supervised initialization. Further analysis reveals adaptive, question-conditioned exploration. Performance gains over the base model increase from 0.6% on questions answerable from the initial view to 16.3% on those requiring extensive exploration. ACT3D searches for occluded targets, avoids unnecessary exploration, and acquires complementary viewpoints for spatial comparisons. These findings demonstrate that outcome-based RL enables VLMs not only to reason over visual evidence, but also to learn when and how to acquire it.

[81] NICE Toolbox: Nonverbal Interpersonal Communication Exploration Toolbox cs.CVPDF

Aleksandr Evgrashin, Carolin Schmitt, Timo Lübbing, Ashutosh Jha, Buket Naz Zeren

TL;DR: NICE Toolbox是免费开源Python框架，将计算机视觉和语音处理方法整合为非语言人际交流信号测量工具，支持多摄像头、算法替换、2D/3D可视化和自定义数据评估。

Details

Motivation: 心理学研究关注姿势、手势、目光、面部表情和语音等非语言交流信号，但传统测量和标注通常依赖耗时的专业人工标注。

Result: NICE Toolbox把现有先进视觉与语音处理方法整合进单个软件包，自动测量上述交流信号。工具支持多摄像头系统、可替换检测算法、检测结果的二维和三维可视化、用户自有数据评估及第三方软件导出，目标是让人际沟通信号探索更可扩展、可复现且易于心理学研究者使用。

Insight: 统一工具箱可降低跨模态信号分析和人工标注门槛，同时保留算法替换与自定义验证能力。摘要未给识别准确率、支持的具体算法清单或对不同群体和场景的验证结果，不能把自动测量视为经临床/心理学验证的标注。

Abstract: Understanding human communication is a long-standing goal in psychological research. People express themselves through many verbal and nonverbal channels: posture, gesture, gaze, facial expression, and speech. Measurement and annotation of these signals has traditionally required time-consuming manual work by trained human labellers. The Nonverbal Interpersonal Communication Exploration (NICE) Toolbox is a free, open-source Python framework that automatically measures these signals by combining existing state-of-the-art computer vision and speech-processing methods into a single software package. It includes support for multi-camera systems, interchangeable detection algorithms, 2D and 3D visualization of detector outputs, evaluation on the user’s custom data, and export to third-party software. With the release of this tool, we aim to make data exploration of interpersonal communication signals scalable, reproducible, and accessible for psychological research.

[82] MedPAO-VL: Interpretable and Protocol-Compliant Agent for Structured Radiology Report Generation cs.CVPDF

Shrish Shrinath Vaidya, Gowthamaan Palani, Minmini Selvam, Gokulraja Srinivasaraja, Ganapathy Krishnamurthi

TL;DR: MedPAO-VL以计划—行动—观察循环生成结构化胸片报告，通过可解释视觉模块表达诊断不确定性，并按语义差异迭代修正报告。

Details

Motivation: 从医学影像生成临床准确、结构化放射学报告仍具挑战；端到端黑箱方法容易产生事实幻觉和缺乏视觉依据的发现，也可能不遵循专科报告格式。

Result: MedPAO-VL将单体生成改为面向目标的智能体流程：先用可解释视觉模块分析胸片并表征诊断不确定性，再观察生成报告与视觉发现之间的语义差异，迭代自我修正以提高对应程度。评测得到专家评定准确性3.5/5、结构分4.3/5。

Insight: 显式表达不确定性并对报告与影像发现做迭代核对，旨在提升可解释性、完整性和协议遵循。摘要未给数据集规模、对照模型、评分者一致性或临床前瞻验证，专家分数不代表可直接用于临床决策。

Abstract: Despite the remarkable generalization capabilities of Large Language Models, generating clinically accurate and structured radiology reports from medical images remains a significant challenge. Current end-to-end approaches function as black boxes, prone to factual hallucinations and generating ungrounded findings. This lack of reliability and failure to adhere to domain-specific structuring protocols, fundamentally limits their clinical utility. We present MedPAO-VL, a multimodal agent that shifts the paradigm from monolithic generation to explainable, iterative, protocol-compliant structured report generation. Unlike deterministic models, our plan-act-observe loop functions as a goal-oriented agent: it first perceives the Chest X-Ray through an explainable vision module designed to capture inherent diagnostic uncertainty, then iteratively refines the generated report by observing semantic discrepancies and self-correcting its generation for better alignment with visually detected clinical findings. Evaluation of our framework demonstrates that this agentic reasoning improves clinical correctness and completeness, achieving an expert-rated accuracy score of 3.5/5 and a structural score of 4.3/5. By prioritizing pathology specific explainability and iterative refinement over opaque end-to-end mapping, MedPAO-VL offers a transparent and clinically viable alternative for automated structured radiology report generation.

[83] Single-stage joint diffusion of sky images and clear-sky index for ultra-short-term irradiance forecasting: what the frame-to-irradiance stage discards cs.CV | cs.LG | eess.SYPDF

Kanawut Suwandee, Suwichaya Suwanwimolkul

TL;DR: 该研究将天空图像预测和晴空指数预测放进同一扩散过程联合去噪，并用未来天空图像的去噪预览直接预测辐照度，以避免级联中图像到辐照度回归阶段丢失信息。

Details

Motivation: 天空图像辐照度预测通常先预测未来视频帧，再用独立训练回归器把图像映射为辐照度；分阶段训练可能丢失直接预测辐照度所需信息。实际无辐射计站点也无法把测量辐照度作为输入。

Result: 单阶段模型联合去噪未来天空图像和晴空指数序列，辐照度头读取未来天空图像的去噪预览而非扩散噪声状态。预测器仅需天空图像和确定性协变量，不输入实测辐照度。2023年SIRTA数据上，合并RMSE为104.1 W/m²，相较智能持续性基线的连续排序概率评分（CRPS）技巧分为+0.34，超过12种基线配置中的任一；在2021—2022数据上重训仍保持该技巧。用模型自身生成图像单独训练的回归器RMSE为150.6 W/m²，而联合头为104.1，约46 W/m²误差由联合训练挽回、被级联丢弃。点预测误差并非最佳：同时读取实测辐照度的确定性网络RMSE为97.6；但CRPS技巧在所有天空状况三分位均领先该网络0.26至0.30。

Insight: 联合生成与预测可避免级联表示丢失概率预报所需信息，并在不提供实测辐照度输入时保持技巧；但点RMSE仍不及使用实测辐照度的确定性网络。约46 W/m²是摘要对两种预测头差值的解释，结果对应SIRTA和指定时期。

Abstract: Sky-image irradiance forecasting is dominated by a two-stage design: a video-prediction model forecasts future sky frames, and a separately trained regressor maps those frames to irradiance. We propose a single-stage alternative that co-denoises the future sky-image and clear-sky-index sequences in one diffusion process, with an irradiance head that reads a denoised preview of the future sky rather than the noised diffusion state. The forecaster needs no regression stage and runs from sky images and deterministic covariates alone, with no measured irradiance at its input — the situation at a site with a camera but no pyranometer. On 2023 SIRTA data the model reaches a pooled RMSE of $104.1$W,m$^{-2}$ and a skill score of $+0.34$ on the continuous ranked probability score (CRPS) against smart persistence, higher than any of twelve baseline configurations, and retains that skill when retrained on 2021–2022. On the model’s own generated frames, a separately trained regressor reaches $150.6$W,m$^{-2}$ against the joint head’s $104.1$: roughly $46$~~W,m$^{-2}$ that joint training recovers and a cascade discards. Point accuracy is competitive but not best: a deterministic network that also reads measured irradiance attains $97.6$~~W,m$^{-2}$. The model’s CRPS skill leads that network’s in every sky-condition tertile, by $0.26$ to $0.30$.

[84] Teaching DINOv3 About Partial 3D Geometry: A Self-Supervised Geometry-Aware Approach cs.CVPDF

Viktoria Ehm, Dongliang Cao, Riccardo Marin, Daniel Scholz, Weikang Wang

TL;DR: 该方法通过LoRA自监督微调DINO特征，使其适应部分3D形状匹配中的缺失观测，并将改进后的描述子接入已有匹配流水线。

Details

Motivation: 真实场景中物体形状常只被部分观测，部分形状匹配因此重要但研究不足；传统特征难处理边界或高度依赖绝对空间位置，DINO特征也并非天然适合部分观测。

Result: 作者提出基于LoRA自监督学习来细化DINO特征，生成对部分形状更稳健的特征描述子。实验显示，该特征在部分形状匹配上显著超过传统描述子和视觉基础模型特征；集成到现有匹配流水线后，在部分形状匹配和左右方向预测基准上达到报告的最先进结果。

Insight: 通用视觉表征需要针对部分可见性和形状边界进行适配，低秩自监督调整可改善其匹配用途。摘要未给数据集、指标、具体提升值或左右方向任务定义，SOTA结论范围由所评基准限定。

Abstract: Partial shape matching is a crucial yet underexplored problem in 3D vision, with significant relevance to real-world scenarios where shapes are often only partially observed. Existing feature descriptors face difficulties in this setting, as traditional representations either struggle with the boundaries of partial shapes or heavily depend on the shape’s spatial position. While existing approaches have employed DINO features for partial shape matching, these features are not inherently suited for handling partial observations. In this work, we propose a method to refine DINO features using LoRA-based self-supervised learning, enabling the generation of feature descriptors that are robust to partiality. Our features substantially improve performance on partial shape matching compared to traditional or vision foundation features. Additionally, when integrated into existing partial shape matching pipelines, we achieve state-of-the-art results on partial shape matching and left-right prediction benchmarks.

[85] Anvil: Scaling Embodied Spatial Intelligence through Knowledge Recirculation cs.CV | cs.AIPDF

Weilin Ruan, Bohan Zhou, Jinghao Li, Yangkai Wei, Wenqian Li

TL;DR: Anvil整合具身空间智能的数据生成、训练和基准，通过11种Ground–Relation–Act形式构建闭环数据飞轮，并用专家蒸馏训练9B模型统一多阶段空间知识。

Details

Motivation: 具身空间智能需定位实体、推理关系并将知识转化为行动相关表示，但联合训练中不同阶段监督分散且几何、语义输出形式不兼容，可能混淆各阶段所需知识。

Result: Anvil-Gen结合按形式生成、跨阶段一致性校验和失败驱动回收，形成数据飞轮；Anvil-Ben提供场景对齐监督及能区分阶段能力与误差传播的评估；Anvil-MOPD用专家教师蒸馏训练9B学生。语义优先的首错路由将教师监督对准学生最早的决定性失败，阶段归一化则控制不同长度原生输出的损失尺度。作者构建580万条有来源支撑记录，覆盖16万张图像；58万条空间记录留作留出评估，其余522万条训练。七个公开基准平均而言，Anvil-MOPD比Qwen3.5-9B和RynnBrain-8B高9.29和11.03个百分点，在VABench-Point达到80.67%。受控研究支持定向覆盖、选择性迁移和反馈修复作为互补组件。

Insight: 将定位、关系理解和动作表征置于场景对齐的多阶段监督中，并按最早错误定位蒸馏，可减少阶段间误差传播。摘要未给七个基准分项结果和数据生成质量审计，报告的是公开基准平均表现。

Abstract: Embodied spatial intelligence requires more than visual recognition: models must localize entities, reason about their relations, and express this knowledge in action-relevant forms. Yet joint training can conflate the knowledge needed at different stages because supervision is fragmented across incompatible geometric and semantic outputs. We introduce Anvil, a unified framework for data generation, training, and benchmarking for embodied spatial intelligence. (1) Anvil-Gen is a heterogeneous data flywheel that combines form-specific generation, cross-stage consistency verification, and failure-driven recollection across 11 Ground–Relation–Act forms. (2) Anvil-Ben provides scene-aligned supervision for learning diverse embodied spatial capabilities and scene-linked assessments that distinguish stage competence from error propagation. (3) Anvil-MOPD is a 9B student that consolidates heterogeneous spatial knowledge through distillation from specialist teachers. Semantic-first-fault routing targets teacher supervision to the student’s earliest decisive failure, while stage normalization controls the loss scale across native outputs of different lengths. We construct 5.8M source-grounded records spanning 160K images, reserving 580K spatial records for held-out evaluation and using the remaining 5.22M records for training. On average across seven public benchmarks, Anvil-MOPD outperforms Qwen3.5-9B and RynnBrain-8B by 9.29 and 11.03 percentage points, respectively, while reaching 80.67% on VABench-Point. Controlled studies support targeted coverage, selective transfer, and feedback-guided repair as complementary framework components.

[86] SurgStreamer: proactive, request-driven monitoring of surgical video streams with structured state and a reusable reasoning layer cs.CVPDF

Bowen Xiang, Jon S. Heiselman, Michael I. Miga

TL;DR: SurgStreamer将手术视频监测拆成程序特定感知和程序无关的事件推理，用结构化状态、事件记忆和形式条件响应请求触发提醒并回答已发生事件。

Details

Motivation: 手术团队可能需要系统监测指定事件（如胆囊三角解剖时夹闭器出现）并回答此前发生了什么；实现时需明确事件语义、警报因果逻辑，并避免每个手术流程都重新设计完整推理系统。

Result: SurgStreamer把1 FPS视频转成器械、动作和阶段结构状态，再由通用推理层基于该状态和事件记忆检查监测条件，可使用精确规则或通过指针而非名称引用实体的小控制器。监测核心用黄金条件评估。在预注册封闭测试集的12例腹腔镜胆囊切除术全程中，宏事件F1为0.598；对所有方法仅给相同75秒窗口时，得分0.677。OneStreamer-4B多种设置（包括在状态或适配视觉编码器视频上微调）最高为0.540，差异Holm校正p≤0.012。三个外部中心仅重训感知后，留出手术得分由0.239升至0.470。对新手术类型垂体手术，胆囊切除术训练的控制器在oracle状态上与域内控制器相当（0.947对0.938），但预测状态上未达到预注册非劣界限，除非重新校准警报阈值。

Insight: 将感知与可复用事件推理分离，可提升系统审计性和跨手术复用，但主要分布偏移瓶颈仍在感知端。结果显示oracle状态与预测状态差别明显；数据集仅12例封闭测试及外部中心评估，不能据此推断临床部署可靠性。

Abstract: Surgical teams could benefit from assistants that watch the video for requested events, such as “tell me when the clip applier appears during Calot triangle dissection”, and answer questions about what has already happened. We formalise this task as request-driven event detection with exact semantics and causal alert decisions, and present SurgStreamer. It separates procedure-specific perception, which maps the 1-FPS stream to a structured state over tools, actions and phases, from procedure-agnostic reasoning, which evaluates a formal monitoring condition over this state and an event memory, either with exact rules or with a small controller that addresses entities through pointers rather than names. We evaluate this monitoring core with gold conditions. On a pre-registered, sealed test set of 12 laparoscopic cholecystectomies, SurgStreamer reached a macro event-F1 of 0.598 over full procedures. On identical 75-s windows with only the window available to every method, it scored 0.677. The tested configurations of the streaming vision-language model OneStreamer-4B, including ones fine-tuned on SurgStreamer’s state or on video with an adapted vision encoder, scored at most 0.540 (Holm-adjusted p <= 0.012). At three external centres, re-training only perception raised performance on held-out procedures from 0.239 to 0.470. On a new procedure, pituitary surgery, controller weights trained on cholecystectomy matched an in-domain controller on oracle state (0.947 vs 0.938). On predicted state they missed the pre-registered non-inferiority margin (-0.024 [-0.040, -0.008]) unless the alert thresholds were re-calibrated. The results support separating perception from reasoning and point to perception under distribution shift as the main limitation.

[87] Seeing is Believing: Benchmarking and Mitigating the Interference of Language Priors on Visual Perception in MLLMs cs.CVPDF

Li Ma, Yan Zhuang, Jiawen Deng, Fuji Ren

TL;DR: ViSiP-Bench用稀有但真实场景、模型特定的语言先验诱导和三项连续指标评估视觉语言模型是否让先验覆盖图像证据，并提出MAPS以事实知识微调来降低过度依赖先验。

Details

Motivation: 多模态大模型的语言先验可能压过视觉证据；既有基准常假设各模型共享先验且只看准确率。作者发现跨模型先验一致率低于80%，且超过15%的题目不看图也能答对，会使准确率高估视觉抗先验能力。

Result: ViSiP-Bench基于六类先验的稀有真实情境，采用模型感知的动态先验诱导协议，并设计三项比准确率更细致、连续的抗先验指标。24个模型评估显示，先验遵从普遍存在，随模型规模增加并未消失；较大模型更倾向于强烈覆盖其先验或坚定遵从先验。作者进一步提出MAPS，先识别每个模型最强先验，再用事实依据充分的知识进行微调，以软化过度先验依赖并尽量不损害通用能力。

Insight: 抗先验评测应针对模型自身先验设计，并排除无需图像即可答对的项目；单一准确率可能掩盖模型是否真正参考图像。摘要未给MAPS的具体基准得分、通用能力保持指标或三项新指标定义。

Abstract: Language priors in MLLMs can override visual evidence, impairing visual perception. Existing benchmarks assume shared priors across models and rely solely on accuracy. However, cross-model prior agreement falls below 80%, and over 15% of items can be answered correctly without any image, causing accuracy to overestimate prior resistance. To address these limitations, we introduce ViSiP-Bench, a benchmark grounded in rare-but-real scenarios across six prior categories, with a model-aware dynamic prior induction protocol and three metrics that more precisely and continuously measure prior resistance than accuracy alone. Evaluating 24 models reveals that prior adherence is pervasive, does not improve with scale, and larger models tend to either strongly override their priors or firmly adhere to them. We therefore propose MAPS, which identifies each model’s strongest priors and fine-tunes on factually grounded knowledge to soften excessive prior reliance without disrupting general capabilities.

[88] Flow-CLIP: Image-Conditioned Residual Scoring for CompositionalImage-Text Matching cs.CVPDF

Minghong Wei, Enguang Zhu, Pu Cao, Lu Yang, Qing Song

TL;DR: Flow-CLIP在全局图文相似度上加入图像条件化的令牌—图像块局部证据变化，并以跨图像配对排序监督缓解构图匹配对语言先验的依赖。

Details

Motivation: 视觉语言预训练的句级对齐适合检索和零样本识别，但组合匹配要求区分物体、属性及其绑定关系；只比较整体句子与图像相似度可能忽略这些组合差异。

Result: Flow-CLIP由全局兼容校准GCC学习句级相似度，并以图像条件证据细化ICER将视觉图像块上下文注入词元查询，利用局部匹配证据变化修正全局分数。跨图像间隔排序CIMR则在匹配和不匹配图像上比较同一正负描述对，鼓励图像支持正确描述时扩大排序间隔。组合匹配和属性—物体绑定基准实验显示，Flow-CLIP通过局部证据细化提升绑定准确率，超过预训练CLIP及学习式全局对齐；跨图像排序监督可缓解对语言先验的依赖。

Insight: 组合语义需要局部图像证据来验证词语与物体/属性的绑定，整体句级相似度不足；跨图像比较还能约束模型不能只依靠描述自身的共现先验。摘要未给基准名称、具体增益和计算开销。

Abstract: Vision–language pre-training has enabled substantial progress in image–text retrieval and zero-shot recognition by learning transferable cross-modal representations. However, sentence-level alignment remains insufficient for compositional matching, where captions can describe the same objects and attributes while differing in how these elements are bound. To address this limitation, we propose Flow-CLIP, which refines global image-text alignment through image-conditioned changes in token–patch evidence. Global Compatibility Calibration (GCC) learns a sentence-level similarity metric, while Image-Conditioned Evidence Refinement (ICER) incorporates visual patch context into token queries and uses the resulting change in local matching evidence to adjust the global score. We further introduce Cross-Image Margin Ranking (CIMR), which compares the same positive–negative caption pair across matched and mismatched images, encouraging a larger ranking margin when the image supports the correct description. Experiments on compositional matching and attribute–object binding benchmarks show that Flow-CLIP improves binding accuracy over pretrained CLIP and learned global alignment through local evidence refinement, while cross-image ranking supervision mitigates reliance on language priors. Code will be released at link.

Raul Balmez

TL;DR: VesperMUSE用热成像和表面法线补充低照度RGB特征，在增强后通过可扩展、模态无关的自注意力融合全局与局部线索，面向多种光照下的语义分割。

Details

Motivation: 自动系统在低光照下的语义分割容易受噪声、伪影、色彩失真和结构细节丢失影响；系统需要融合热信息及几何边界等辅助模态恢复视觉线索。

Result: VesperMUSE首先提出物理先验引导的合成低光适配算法，并以热成像指导低光图像增强；之后将主RGB特征与辅助热表征、突出几何不连续及材料边界的表面法线表示动态融合。核心模块采用可扩展的模态无关自注意力，从任意数量辅助输入中提取全局上下文和细粒度局部特征，并将分层多模态表征投影到统一组件，按需关注跨模态线索，无需为不同传感器配置更改架构。作者报告实验能恢复缺失视觉线索，并称其在非结构化极端环境机器感知中具有最先进性能。

Insight: 低照度增强、热模态引导与几何边界线索可分阶段互补，并以模态无关融合便于适配不同传感器组合。摘要未给数据集、分割指标、传感器配置或基线数值，“SOTA”结论无法从摘要进一步量化。

Abstract: Semantic segmentation is critical for the reliable navigation and scene understanding of autonomous systems, yet its performance degrades severely in low-light environments due to noise, artifacts, colour distortion, and the loss of structural details. To address this challenge, this work introduces VesperMUSE, a unified multi-modal framework designed to achieve robust image semantic segmentation across diverse illumination conditions. The architecture addresses the light deficiency problem on multiple levels: proposing a novel physics-informed synthetic low-light adaptation algorithm, approaching Low-Light Image Enhancement (LLIE) through a thermal-guided paradigm, and finally aiming to recover the intrinsic scene details for semantic segmentation through a multi-modal fusion approach. Following enhancement, the framework dynamically integrates the primary RGB features with auxiliary thermal representations and surface normal maps highlighting geometric discontinuities and material boundaries. At the core of this integration is a highly scalable, modality-agnostic self-attention mechanism that extracts both global context and fine local features from an arbitrary number of auxiliary inputs. By combining and projecting these hierarchical multi-modal representations into a unified component, the attention module allows the network to selectively attend to relevant cross-modal cues without requiring any architectural modifications when different sensor configurations are used. Extensive evaluations demonstrate that VesperMUSE successfully recovers missing visual cues, providing a flexible, state-of-the-art (SOTA) solution for machine perception in extreme and unstructured real-world environments.

[90] Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning cs.CVPDF

Yuki Natsume, Sang-Ho Yun, Chai Kiat Yeo

TL;DR: SparK-SAR在S1GRD遥感影像上使用稀疏卷积掩码预训练与ConvNeXt，针对高分辨率数据和有限计算改进特征预训练效率。

Details

Motivation: 哨兵1号GRD标注数据稀缺，自监督预训练则多依赖计算和数据需求较大的ViT掩码建模；SAR成像特性也可能更适合利用卷积归纳偏置。

Result: SparK-SAR基于SparK与ConvNeXt设计。领域适配编码器ConvNeXt-RS将stem步幅从4降至2，在参数量不变时以16步幅输出14×14特征图、提供4倍空间令牌；轻量ConvNeXt-512重建解码器使用PixelShuffle，相较UNet-128每GPU预训练显存减少7.5%—8.5%，准确率相当。作者还刻画标准SparK UNet-768在S1GRD上FP16预训练不稳定，并发现逐层学习率衰减可改善下游微调。四个Copernicus-Bench任务上，27.8M参数微调编码器较无预训练基线分别在EuroSAT-S1、BigEarthNet-S1、DFC2020-S1和Flood-S1提高4.7、5.0、5.8和1.4个百分点；约少5倍参数时，在四项中三项超过139M参数且冻结的Copernicus-FM ViT。数据缩放分析显示分类在SSL4EO-S12 v1.1数据的10%—25%已趋于饱和，密集预测则在25%—50%仍显著改善；另含CKA和地理去重实验。

Insight: 不同下游任务的数据需求差异明显，分类可能更节省样本，密集预测仍从更多预训练数据受益；卷积骨干、轻量解码器和LLRD共同影响资源效率。摘要未报告地理去重的具体结果及各项计算时长，百分点提升均相对无预训练基线。

Abstract: Labeled Sentinel-1 Ground Range Detected (S1GRD) datasets remain scarce, limiting supervised deep learning for land-surface remote sensing, while self-supervised pretraining for this domain has been dominated by Vision Transformer (ViT)-based masked image modeling requiring substantial data and compute. We propose SparK-SAR, a sparse convolutional masked pretraining framework built on SparK and ConvNeXt, designed to exploit convolutional inductive biases for S1GRD imagery under constrained compute. SparK-SAR makes three core technical contributions: (i) ConvNeXt-RS, a domain-adapted encoder that halves the stem stride (4x to 2x) to produce 14x14 feature maps at stride 16x, providing 4x more spatial tokens at identical parameter count; (ii) a lightweight ConvNeXt-512 reconstruction decoder with PixelShuffle upsampling that reduces pretraining VRAM by 7.5-8.5% per GPU relative to a UNet-128 baseline while matching its accuracy; and (iii) an empirical characterization of FP16 mixed-precision pretraining instability in the standard SparK UNet-768 decoder on S1GRD data, complemented by a finding that finetuning with layer-wise learning rate decay (LLRD) improves downstream performance of pretrained encoders. On four Copernicus-Bench S1GRD tasks, our finetuned 27.8M-parameter ConvNeXt-RS encoder improves over a non-pretrained baseline by +4.7, +5.0, +5.8, and +1.4 pp on EuroSAT-S1, BigEarthNet-S1, DFC2020-S1, and Flood-S1 respectively, and outperforms the Copernicus-FM ViT (139M parameters, frozen) on three of four tasks at roughly 5x fewer parameters. A pretraining data-scaling study reveals task-dependent data efficiency: classification saturates with as little as 10-25% of the SSL4EO-S12 v1.1 corpus, while dense prediction continues to improve significantly up to 25-50%. The study also includes a CKA representation analysis and a geographic de-collision experiment.

[91] Visual Sanad: Auditing Vision-Language Models for False Acceptance of Qur’anic Citations cs.CVPDF

Niaz Mohaiman Abtahi, Reyana Shahid, Evan Maksud

TL;DR: Visual Sanad用2,400张受控渲染图像评估视觉语言模型是否因版式权威感而错误认可古兰经经文引用，并发现部分开源模型常默认判为有效。

Details

Motivation: 视觉语言模型开始处理宗教、教育和文化敏感图像，但对引用核验的可靠性研究不足；模型可能仅因引文及其出处以图像形式出现，就错误接受不准确归属。

Result: 基准包含100条英文古兰经经文，每条设四种事实状态，并在从纯文本到装饰及权威框架的六种视觉条件下渲染，共2,400张图像；全部引文—出处组合在渲染前经源文本核验和人工审查。24个完整模型—提示运行显示能力分化明显：由API提供的专有VLM从近乎完美核验到中等误接受不等，近期开放权重模型区分能力常较弱，并在多数图像上默认回答VALID。去偏提示可降低误接受，但常是把阈值偏向INVALID，而非形成更强的引用辨别能力。

Insight: 文化敏感引用的视觉呈现可能被模型误当作自证信息，拒绝率提高也不必然代表引用核验能力增强；需分别衡量误接受和真伪区分。评测为100条经文的英文渲染图，未覆盖其它语言及真实复杂版式。

Abstract: Vision-language models (VLMs) are increasingly used to interpret religious, educational, and culturally sensitive visual content, yet their reliability on citation verification remains underexplored. We introduce Visual Sanad, a controlled benchmark for testing whether VLMs falsely accept incorrect Qur’anic verse attributions when the same quote-reference pair is rendered under different visual framings. The benchmark contains 2,400 rendered images built from 100 English Qur’an verses, four factual states per verse, and six visual conditions ranging from plain text to decorative and authority-framed layouts. All quote-reference pairs were source-checked and human-audited before rendering. Across 24 full model-prompt runs, we observe a sharp capability split. Proprietary API-served VLMs range from near-perfect citation verification to moderate false acceptance, whereas recent open-weight VLMs often show weak discrimination and default to VALID on most images. De-biased prompting can reduce false acceptance, but often by shifting the decision threshold toward INVALID rather than by producing strong citation discrimination. Visual Sanad therefore exposes a culturally grounded multimodal factuality failure: fluent VLMs may treat displayed religious citations as self-authenticating unless they have strong citation-verification ability.

[92] When Models Misread Ink: Auditing VLMs for Arabic Calligraphy Recognition cs.CVPDF

Niaz Mohaiman Abtahi, Evan Maksud, Reyana Shahid

TL;DR: 该研究用1,195张图像的六分类基准测试12种视觉语言模型识别阿拉伯书法字体，发现模型普遍塌缩到默认标签，提示引导效果因模型而异。

Details

Motivation: 阿拉伯书法对穆斯林社群具有重要文化意义，但VLM评测较少覆盖精细书体传统；研究考察模型是否能区分不同书法类别，而非只依赖默认标签或提示暗示。

Result: 作者在清理后的1,195张图像六分类基准上，以数字标签、视觉线索和Diwani优先三种提示评测12个VLM。数字提示下，闭源/API模型最佳准确率60.9%，开放权重模型最佳47.2%。主要失败是默认标签塌缩：每种数字提示运行都由单一标签主导，占预测33%—63%，而多数类基线为18.8%；12种模型中8种默认选择Thuluth，GPT-4o将52.9%的图像判为Thuluth，尽管数据中其占比仅18.1%。视觉线索提示对部分模型可提升超过10个百分点，对另一些则有害；突出Diwani常只是转移默认标签，并未消除塌缩。

Insight: 总体准确率之外还需检查类别预测分布，以发现系统性默认标签偏置；提示可改善个别模型但不一定提升稳定区分能力。结论限于该六分类、1,195图像基准和三类提示，未评估开放集识别。

Abstract: Arabic calligraphy is a high-stakes cultural visual domain for Muslim communities, yet VLM evaluations rarely test its fine-grained script traditions. We audit 12 VLMs on a cleaned 1,195-image six-way benchmark using numeric, visual-cue, and Diwani-first prompts. In this closed-set setting, the best numeric-prompt accuracy is 60.9% for closed/API models and 47.2% for open-weight models. The main failure is default-label collapse: every numeric run is dominated by a single label taking 33-63% of predictions, against an 18.8% majority-class baseline. For 8 of 12 models the default is Thuluth; GPT-4o labels 52.9% of all images as Thuluth although it is only 18.1% of the set. Prompting helps unevenly: visual cues move accuracy by more than 10 points for some models but hurt others, and foregrounding Diwani often relocates the default rather than removing it. Arabic calligraphy recognition is therefore a compact, culturally grounded stress test for VLM robustness and for measuring which visual traditions become legible to automated systems.

[93] Memory as Weights: Internalizing Long-Term History for Streaming Videos cs.CV | cs.AI | cs.LGPDF

Zhuoming Liu, Jinhong Lin, Lin Zhang, Yiwu Zhong, Yin Li

TL;DR: MaLoW将流式视频历史通过循环超网络逐步压缩进固定大小LoRA权重，使历史以参数记忆携带、当前观测仍作为输入，避免历史上下文和新视频争夺有限窗口。

Details

Motivation: 流式视觉语言模型需要持续整合过去信息并响应当前观察和问题；常见记忆机制将历史压缩、检索或缓存后再放回输入上下文，导致历史记忆与当前观测竞争有限上下文容量。

Result: MaLoW利用循环超网络将新视频观测逐步巩固到固定大小LoRA权重中，历史通过参数更新保留，无需重看完整视频流。为训练构建MaLoW-Instruct，包含56,000段视频上的381,000组问答。在OVO-Bench、StreamingBench和StreamArena上结果较强；OVO-Bench backward划分上，较既有记忆方法跨视频骨干提升3.9%至11.8%，仅有适度延迟开销。方法还迁移至视觉—语言—动作模型，使Simpler WidowX动作成功率提高9.3%。

Insight: 把历史信息写入轻量可更新权重、把当前帧留作即时输入，可改变传统上下文外置记忆的资源竞争方式。摘要未给各基准完整分数、精度损失和记忆写入计算成本；WidowX结果仅报告成功率提升幅度。

Abstract: Streaming vision-language models (VLMs) must continuously integrate information from the past while remaining responsive to current observations and user queries. Existing memory mechanisms typically compress, retrieve, or cache historical observations and reintroduce them into the input context, forcing historical memory and current observations to compete for limited context. We propose MaLoW, a streaming memory framework that instead internalizes historical context into evolving lightweight parameter updates. MaLoW uses a recurrent HyperNetwork to incrementally consolidate incoming video observations into fixed-size LoRA weights, allowing historical information to be carried forward without revisiting the full video stream. In doing so, MaLoW represents history as weights, while keeping the current observation as input. To support training, we further construct MaLoW-Instruct, a large-scale streaming video dataset containing 381K question-answer pairs over 56K videos. We conduct extensive experiments to demonstrate that MaLoW achieves strong performance on OVO-Bench, StreamingBench, and StreamArena. On the backward split of OVO-Bench, MaLoW outperforms prior memory approaches by 3.9% to 11.8% across different video backbones while incurring only modest latency overhead. Beyond streaming video understanding, MaLoW also generalizes to vision-language-action models, improving the action success rate on Simpler WidowX by 9.3%.

[94] Retrofitting Recurrent Vision-Language Models from Pretrained Backbones cs.CVPDF

Madhav Iyengar, Andreas Geiger, Hilde Kühne

TL;DR: 该工作把深度递归改造应用于预训练VLM：裁剪语言骨干层并循环复用剩余层，通过三阶段恢复训练弥补剪枝退化。

Details

Motivation: 将层递归改造到预训练语言模型可减小参数规模，研究考察能否用类似方式缩减VLM语言骨干，同时恢复因剪枝造成的视觉语言性能损失。

Result: 方法裁剪VLM语言骨干层并循环运行保留层的子集，每轮以线性适配器融合当前块输出和此前令牌表征，再投影回块输入空间。恢复训练分三阶段：仅语言预训练恢复语言骨干，视觉语言投影器对齐，最后通过视觉指令微调完整适配；第一和第三阶段都把预训练非递归模型输出蒸馏给递归模型。以TinyLLaVA-1.4B为骨干，改造时不增加新视觉语言数据。使用相同恢复数据训练时，递归模型超过未剪枝基线，同时语言参数减少23.3%；也超过在相同数据上把递归语言模型转成VLM的方案。消融分析适配器及更大递归块等设计；推理类基准有所提升，基础视觉理解与基线相当。

Insight: 通过循环复用层和蒸馏恢复，可在较少语言参数下保留或提升若干任务能力，且不需新增图文训练数据。结果限于TinyLLaVA-1.4B及相同恢复数据设定，摘要未给各基准分数、推理延迟或递归次数。

Abstract: Recent work shows that depth recurrence can be retrofitted into pretrained language models. In this work, we adapt this paradigm for visual understanding, using depth recurrence to reduce the parameter footprint of a pretrained vision-language model (VLM). To this end, we prune layers from the language backbone of the VLM and loop over a subset of the remaining layers. At each step of the loop, a linear adapter merges the block’s output with the token representations from the preceding layers and projects the fused representation back into the block. As the pruning impacts the original model performance, we propose a three-stage recovery training: first, we leverage a language-only pretraining to recover the performance of the language backbone, followed by an alignment of the vision-language projector, and a full fine-tuning of the model via visual instruction tuning. In the first and the last stage, we distill the outputs of the pretrained non-recurrent model into the recurrent model, which further improves the recovery. We evaluate the proposed approach on the TinyLLaVA-1.4B backbone without introducing any new vision-language data during retrofitting. Our experiments demonstrate that the retrofitted recurrent model outperforms the unpruned baseline trained with the same recovery data while storing 23.3% fewer language parameters. We further show that the proposed retrofitting recurrence outperforms the setup of converting a recurrent LM into a VLM on the same data. Additionally, our ablations show how design choices, such as the adapter between recurrences and a larger recurrent block, lead to the improved performance of our approach. Finally, we find that our proposed model gains on reasoning-oriented benchmarks, whereas its performance on basic visual understanding benchmarks remains on par with the baseline.

[95] Beyond the Dominant Label: Recovering Coexisting Lesion Evidence with Multiple Instance Learning cs.CV | cs.LGPDF

Lubin Gan, Jing Zhang, Xinming Zhang, Chengpeng Xu, Siying Wu

TL;DR: DomSet-MIL把病理全切片弱监督建模为显性最高严重度标签下的多实例学习，避免将未报告的低严重度共存病灶误当不存在。

Details

Motivation: 全切片图像可能同时含有多类病灶，但弱监督常只提供最严重诊断。标准多实例学习把该主导标签视为完整独热描述，一旦有主导病灶，就会压制较低严重度的共存病灶证据。

Result: DomSet-MIL通过主导标签删失似然拟合已报告诊断，但不把未报告病灶判作阴性；严重度排序残差路由从高到低分配patch证据，保留次要发现的剩余支持，再用top-q池化连接局部路由分数与整袋预测。自然及受控实验显示，该方法在主导标签预测上达到先进表现，同时更有效地恢复潜在共存病灶证据。

Insight: 诊断标签仅报告最高严重度并不意味着其它病灶不存在；建模标注生成机制可在主诊断预测不退化的情况下保留次要发现。摘要未给数据集、指标及次要病灶恢复量化结果，临床意义仍需结合完整研究验证。

Abstract: Whole-slide images may contain coexisting lesions, yet weak supervision typically provides only the most severe diagnosis. We formulate this setting as dominant-label multiple instance learning, where the observed label is the maximum-severity element of a latent lesion set. Standard multiclass MIL treats it as a complete one-hot description and therefore suppresses lower-severity evidence whenever it co-occurs with a dominant lesion. We propose DomSet-MIL, a label-aware framework that aligns the annotation mechanism across bag and instance levels. Dominant-Label Censored Likelihood models the reported diagnosis without declaring unreported lesions absent. Severity-Ordered Residual Routing assigns patch evidence from high to low severity and preserves residual support for secondary findings, while top-$q$ pooling links local routing scores to bag prediction. Experiments across natural and controlled settings show that DomSet-MIL achieves state-of-the-art performance in dominant-label prediction while more effectively recovering latent coexisting-lesion evidence. These findings demonstrate that modeling the dominant-label mechanism can improve diagnostic prediction without sacrificing clinically meaningful secondary findings.

[96] SCCL-DT: Semantic-Conflict-Aware Contrastive Learning with Dual-Rule Teacher Distillation for Zero-Shot Chest X-Ray Diagnosis cs.CVPDF

Ting Liu, Haoran Lai, HaobinChen, Ming Liu, S Kevin Zhou

TL;DR: SCCL-DT通过动态EMA相似度阈值和硬掩码识别胸片对比学习中的语义冲突负例，再将包容式与共识式双教师蒸馏为单一可部署学生。

Details

Motivation: 常规视觉—语言对比预训练把批次内所有非对角图像—报告对当作负例，但放射学中不同患者可能具有相同发现，实例不同不代表语义不兼容，因而产生错误负例监督。

Result: 作者对训练轨迹的审计发现，在线掩码选中的配对中，依据报告推断的发现一致性更高；这只是代理分析，不能证明临床等价。SCCL使用EMA追踪模态特定相似度分布并产生自适应阈值，在softmax归一化前硬屏蔽被标记候选，避免固定阈值失准或软重加权仍留排斥梯度。包容式OR和共识式AND规则构造两种教师，其双向跨模态排序通过标准蒸馏整合为SCCL-DT。在五个公开胸片基准上，平均零样本AUC为0.850，比较中最强基线为0.837。

Insight: 医学图文对比学习中需区分实例不匹配和语义冲突，动态阈值硬屏蔽可避免把同发现样本作为负例。报告中发现一致性来自报告文本代理，不代表临床真实标签；摘要未给各数据集分数及双教师消融。

Abstract: Contrastive vision-language pre-training supports zero-shot chest X-ray diagnosis, but standard objectives treat every off-diagonal image-report pair in a batch as a negative. In radiology, recurring findings across patients mean that instance mismatch need not imply semantic incompatibility, creating false-negative supervision that we term a semantic conflict. A training-trace audit shows that pair-observations selected by the online mask used during training are enriched for report-derived finding agreement, although this proxy analysis does not establish clinical equivalence. Fixed thresholds can become miscalibrated as similarity distributions evolve, while soft reweighting leaves residual repulsive gradients. We therefore propose Semantic-Conflict-Aware Contrastive Learning (SCCL), which tracks modality-specific similarity distributions with exponential-moving-average (EMA) statistics, derives adaptive thresholds, and hard-masks flagged candidates before softmax normalization. Inclusive (OR) and consensus (AND) rules define two SCCL teachers, whose bidirectional cross-modal rankings are consolidated through standard distillation into a single deployable student, SCCL-DT. Across five public chest X-ray benchmarks, SCCL-DT achieves a mean zero-shot AUC of $0.850$, compared with $0.837$ for the strongest evaluated baseline in our comparison. Code will be made publicly available soon.

[97] LAMP: Layerwise Adaptive Mixing of Predictors for Training-Free Few-Shot Vision-Language Adaptation cs.CVPDF

Zhipeng Ye, Feng Jiang, Qiufeng Wang, Hao Li

TL;DR: LAMP在冻结编码器的多层全局和区域特征上分别拟合核预测器，再用带标签验证集按类别分数混合，以免额外投影和训练并利用多层互补表征进行少样本适配。

Details

Motivation: 少样本适配常仅使用编码器最终全局表征，遗漏中间层信息；不同层维度可能不同、任务相关性也不同，使直接拼接或学习映射不易处理。

Result: LAMP每个视图只需一次前向即可获得多层描述符。全局预测器和支持集校准的区域核预测器分别拟合同一标签残差，带标签验证集在类别分数空间选择两者混合权重，从而保留各层原生维度而无需学习投影。LAMP-F进一步适配文本锚定类别原型，利用缓存响应精确更新固定核残差预测。覆盖11个数据集及ViT、ResNet骨干时，LAMP在4、8、16-shot的已发表免训练ResNet-50方法中平均准确率最优，16-shot为78.73%。跨五种支持预算，较配对的仅全局特征基线，ViT-B/16及ResNet-50分别提高1.14和1.59个百分点；LAMP-F分别提高1.96和2.54点，16-shot分别达到83.57%和79.10%。受控实验将主要收益归于多层整合，并分析池化、校准、验证标签和计算开销。

Insight: 按层独立预测并在类别分数空间融合，可利用冻结表征的互补信息而避免维度统一的额外训练；少样本验证标签参与混合权重选择是该方法的一部分。摘要未给各数据集结果和验证集规模，最佳平均分针对所比较的免训练ResNet-50方法。

Abstract: Few-shot adaptation often relies on an encoder’s final global representation, leaving complementary information in intermediate layers underused. Combining these features is challenging because their dimensions can differ and their usefulness varies across tasks. We propose LAMP, Layerwise Adaptive Mixing of Predictors, a training-free framework that combines global and regional information from multiple encoder layers. A single forward pass per view supplies all descriptors. Global and support-calibrated regional kernel predictors independently fit the same label residuals. Labeled validation data select their mixture in class-score space, preserving native feature dimensions without learned projections. LAMP-F further adapts text-anchored class prototypes, using a cached response to update the fixed-kernel residual predictions exactly. Experiments cover eleven datasets and ViT and ResNet backbones. LAMP achieves state-of-the-art mean accuracy among the compared published training-free ResNet-50 methods at 4, 8, and 16 shots, reaching 78.73% at 16 shots. Averaged across five support budgets, LAMP improves over a paired global-feature-only baseline by 1.14 and 1.59 percentage points on ViT-B/16 and ResNet-50; LAMP-F raises these gains to 1.96 and 2.54 points. LAMP-F reaches 16-shot accuracies of 83.57% and 79.10%, respectively. Controlled experiments identify multi-layer integration as the main source of improvement and examine pooling, calibration, validation labels, and computational cost. These findings show that combining layer-specific predictions can exploit complementary features from frozen encoders to improve few-shot classification.

[98] EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment cs.CV | cs.CLPDF

Jiapeng Shi, Qiuxia Hou, Jiaqi Leng, Junke Wang, Yanhao Zhang

TL;DR: EVA-Cap将视频字幕拆解为原子级视听事件，并在SFT后以GRPO直接优化事件完整性、事件内归因和事件间同步。

Details

Motivation: 全模态语言模型可统一处理视听视频字幕，但既有方法常把字幕当作无结构文本生成，忽视视频事件结构，造成细粒度视听对齐不足。

Result: EVA-Cap用自建的事件中心质量控制数据集EVA-Data训练，将无结构文本监督转为事件级对齐。GRPO阶段针对三项目标优化：全局事件完整性、事件内归因及事件间同步。在ChronusAV上，事件中心评估平均提升9.0%；在WorldSense等一般视听字幕基准上也具竞争力，WorldSense提升3.3%。

Insight: 明确以事件为单元监督字幕，可同时约束是否覆盖事件、谁参与事件以及事件时间关系，而非仅提升文本流畅度。摘要未提供各基准完整分数、数据集规模和消融结果。

Abstract: Recent advances in Omni Language Models (OLMs) provide a unified solution for audiovisual video captioning. Nevertheless, existing approaches predominantly treat captioning as an unstructured text generation process, neglecting the inherent semantic structure of videos and leading to suboptimal fine-grained audiovisual alignment. To bridge this gap, we propose EVA-Cap, a novel framework that decomposes captions into atomic audiovisual events and transforms unstructured text supervision into event-centric alignment. We train EVA-Cap via Supervised Fine-Tuning (SFT) and Group Relative Policy Optimization (GRPO) on a self-curated dataset, EVA-Data, which is built with event-centric quality control. During the GRPO phase, the model is explicitly optimized against three event-centric alignment targets: global event completeness, intra-event attribution, and inter-event synchronization. Extensive experiments demonstrate that EVA-Cap significantly outperforms existing methods in event-centric evaluation (e.g., +9.0% average gain on ChronusAV), while achieving competitive performance on general audiovisual captioning benchmarks (e.g., +3.3% on WorldSense).

[99] OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use cs.CVPDF

Hanzhang Zhou, Long Li, Quyu Kong, Lei Wang, Panrong Tong

TL;DR: OpenGCUA提出开放通用电脑使用智能体全栈，让模型在视觉与程序接口间自主选择观察、行动和工作组织方式，并以代码执行和决策从harness转移至模型为核心设计。

Details

Motivation: 电脑使用正在从仅操作GUI扩展到结合视觉和程序接口完成任务，但前沿通用电脑使用系统多为闭源，限制对其设计的系统研究。

Result: 首个OpenGCUA版本将代码执行用于让中间结果决定后续操作，并提出将部分观察和任务状态决策从固定harness规则转交模型。OSWorld-v2上，完整配置在评测的八个模型中均提高任务分数，相较批量GUI-only流程，平均partial score提高19.6分、报告的每任务步骤平均减少53.0%。作者开放实现、提示、八个模型的评估轨迹，以及真实设备harness和跨设备SDK初版。真实设备harness上的四项macOS任务中，所选Qwen3.8-Max运行的报告推理令牌量是GPT-6 Astra的19.4倍，显示实际设备执行效率存在模型差异。

Insight: 通用电脑使用智能体的关键不只是GUI点击，还包括代码执行、观察选择和任务状态管理；开放轨迹及跨设备接口有助于复现与扩展。OSWorld的partial score和步骤数不是实际设备端到端时延，macOS效率比较仅四项任务。

Abstract: Computer use has reached a turning point: the focus is expanding from GUI-only interaction to systems that complete tasks on users’ computers through visual and programmatic interfaces. We define a generalist computer-use agent (GCUA) as a system in which the model chooses how to observe, act, and organize its work across visual and programmatic interfaces. Yet frontier implementations, such as GPT-6 Astra’s computer-use system, remain largely closed, limiting systematic study of their design. We introduce Open Generalist CUA (OpenGCUA), an ongoing project to develop and open the full stack for GCUAs with the community. This report presents the first release of OpenGCUA. Code execution is a key feature of our agent design: it lets intermediate results determine subsequent operations and enables models to apply their existing programming capabilities directly to computer interaction. We also propose harness-to-model decision transfer, moving selected observations and task-state decisions from fixed harness rules to the model. On OSWorld-v2, our full configuration improves task scores across all eight evaluated models, including GPT-6 Astra and Claude Opus 5, raising mean partial score by +19.6 points and reducing reported steps per task by an average of 53.0% relative to batched GUI-only execution. We release our implementation and prompts, evaluation trajectories from all eight models, and preliminary versions of a real-device harness and a cross-device SDK. The harness addresses real-device challenges not fully captured by benchmarks, while the SDK provides a common programming interface across computers, mobiles and browsers. Across four real macOS tasks under our real-device harness, selected Qwen3.8-Max runs use 19.4 times as many reported reasoning tokens as GPT-6 Astra, highlighting substantial differences between models in real-device execution efficiency.

[100] TRACE: Topology-Aware Reconnection via Prediction-Adaptive Connectivity Enforcement for Thin-Structure Segmentation cs.CV | cs.AIPDF

Junho Moon, Ikbeom Jang

TL;DR: TRACE为细长结构分割构造预测自适应拓扑损失：以目标骨架定义局部必需连接，并根据当前预测选择最容易实现的有效重连路径。

Details

Motivation: 细长结构对连通性错误高度敏感，少量局部错误也可切断原本连续路径；传统骨架损失固定监督中心线位置，没有考虑可恢复连通性的替代局部路径。

Result: TRACE根据目标骨架定义必需局部连接，对每条连接在当前预测中寻找最容易成立的有效重连路线，并联合监督该路线瓶颈及相应骨架点，使监督随预测变化。作者还提出拓扑感知骨架载体，保留前景和类别特定拓扑，以可靠定义连接。在六个二维及三维基准上，实验显示该目标改善连通性和拓扑，同时保持较强分割准确率，训练额外开销较低。

Insight: 自适应重连监督不把模型固定拉向单条中心线，而可利用当前预测中更容易恢复的路径来修复连通。摘要未给基准名称、拓扑/准确率指标及训练成本的具体数值。

Abstract: Thin, elongated structures are particularly sensitive to connectivity errors, as even a few local segmentation mistakes can disrupt otherwise continuous paths. Existing skeleton-based objectives typically supervise fixed centerline locations and do not account for alternative local routes that may restore connectivity. We propose TRACE, a topology-aware, prediction-adaptive objective that uses a target skeleton to define required local connections. For each connection, TRACE identifies the easiest valid reconnection under the current prediction and jointly supervises its bottleneck with the corresponding skeleton point. The supervision thus adapts to the evolving prediction rather than remaining fixed to the centerline. We further introduce a topology-aware skeleton carrier that preserves both foreground and class-specific topology, enabling reliable definition of these connections. Extensive experiments across six 2D and 3D benchmarks show that TRACE improves connectivity and topology while maintaining strong segmentation accuracy with low training overhead. Code will be released upon acceptance.

[101] FutureLift: Lifting Trajectory Proposals into Bidirectional Future Graphs for Motion Forecasting cs.CV | cs.LGPDF

Daniel Grimm, J. Marius Zöllner

TL;DR: FutureLift把多模态轨迹候选表示为双向时序异构图，使较晚未来信息可在单次前向中修正早期片段，并预测坐标残差和置信度。

Details

Motivation: 运动预测器的多模态候选仍有残差误差；既有细化器压缩完整候选或顺序更新片段，无法把整条未来轨迹作为显式关系上下文来修正。

Result: 与骨干无关的FutureLift把每个多模态候选转换为未来图，时空节点连接智能体历史、地图元素、其它候选模式，并在联合预测中连接其它智能体的未来轨迹。双向时间边允许后续证据在一次通过中修订较早片段，更新节点输出坐标残差和置信度修正；只需候选轨迹、分数及场景上下文即可接入不同预测骨干。在Argoverse2和Waymo Open Motion Dataset上，方法持续改善冻结候选并超过原生及专用细化器。在WOMD运动预测排行榜的标准输入方法中，minADE为0.5049米、minFDE为0.9942米，均居比较方法首位，无需LiDAR或集成，Soft mAP为0.4874。

Insight: 把未来候选本身作为带空间关系的图，可在双向上下文中协调各时间片，而不是只局部顺序修补。排行榜结论限于标准输入比较方法及指定指标，摘要未列所有基线和模型计算开销。

Abstract: Accurate motion prediction is critical for safe autonomous driving, yet even strong forecasters leave residual errors in their multimodal proposals. Existing refiners compress complete proposals or update their segments sequentially, preventing the full proposed future from serving as explicit relational context for correction. We introduce FutureLift, a backbone-agnostic refiner that represents each multimodal proposal as a heterogeneous future graph, with spatially grounded temporal nodes connected to agent histories, map elements, alternative modes, and, for joint prediction, other agents future trajectories. Bidirectional temporal edges allow later evidence to revise earlier segments in a single pass, and the updated nodes predict residual coordinate and confidence corrections. Requiring only proposals, scores, and scene context, FutureLift provides a common refinement interface for structurally different forecasting backbones. On Argoverse2 and the Waymo Open Motion Dataset, it consistently improves frozen proposals and outperforms native and specialized refiners across marginal and joint forecasting. On the WOMD motion-prediction leaderboard, FutureLift ranks first in minADE (0.5049m) and minFDE (0.9942m) among the compared standard-input methods, without LiDAR or ensembling, while achieving a competitive 0.4874 Soft mAP.

[102] Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language Models cs.CV | cs.AIPDF

Yuqi Xiong, Chunyi Peng, Zhipeng Xu, Qing Yang, Zhenghao Liu

TL;DR: SCOPED先独立训练视觉能力专家并用奖励反思抽取显式技能，再通过在线策略专家蒸馏把程序性知识迁入不接收技能文本的统一VLM学生。

Details

Motivation: 强化学习能让VLM习得专门视觉能力，但同时优化异质目标会产生梯度冲突；单独训练专家可缓解干扰，却可能把能力与奖励劫持偏差纠缠在一起。

Result: 技能解耦在线专家蒸馏SCOPED先训练能力专属专家，再通过奖励引导反思抽取显式技能。在在线策略蒸馏中，这些技能用于指导教师监督，但不提供给统一学生，使其内化程序性知识而无需推理时显式技能提示。八个多模态基准上，SCOPED持续优于骨干模型和多能力混合RL。分析显示联合能力优化存在干扰；技能增强促使专家轨迹更一致、更多关注任务相关视觉证据，并让统一学生更好保留专门能力。

Insight: 独立专家、技能文本中介和学生蒸馏可以分开处理能力获取与能力整合，降低异质目标直接联合优化的冲突。摘要未列八项基准、具体分数或专家训练成本，且“奖励劫持偏差”如何定量评估未说明。

Abstract: Reinforcement learning (RL) can elicit specialized visual capabilities in vision-language models (VLMs), yet jointly optimizing heterogeneous objectives often introduces cross-capability gradient conflicts. Training experts independently mitigates this interference, but direct reward optimization may entangle specialized knowledge with reward-hacking biases. This paper proposes Skill-Decoupled On-Policy Expert Distillation (SCOPED), which trains capability-specific experts and extracts explicit skills through reward-guided reflection. During on-policy distillation, these skills guide expert supervision while remaining unavailable to the unified student, encouraging it to internalize procedural knowledge without explicit skills at inference time. Across eight multimodal benchmarks, SCOPED consistently outperforms the backbone and mixed-capability RL, demonstrating the effectiveness of skill-decoupled on-policy expert distillation for integrating independently acquired capabilities. Further analyses reveal interference during joint capability optimization and suggest that skill augmentation promotes more consistent expert trajectories, greater attention to task-relevant visual evidence, and better preservation of specialized expertise in the unified student. All code and data are available at https://github.com/NEUIR/SCOPED.

[103] How Much Physics Can Vision Learn from Audio? Probing and Distilling Damping Structure cs.CV | cs.LG | cs.SDPDF

Zainab Afolabi, Vadim Selyutin, Zhao Gao, Babs Khalidson, Mohamed Ghoneim

TL;DR: 该研究比较冻结音频与视觉编码器对物体阻尼参数Q值的表征能力，并尝试把音频教师的动力学信息蒸馏到冻结CLIP视觉骨干中。

Details

Motivation: 阻尼等物理属性决定材料受冲击后的运动和声音响应；视觉模型难以直接从静态图像推断这类动力学，而冲击声音中的振荡衰减包含相关线索。

Result: 作者用Spearman秩相关ρ衡量嵌入能否按无量纲品质因数Q给冲击排序。音频嵌入ρ=0.73，在训练未见材料上仍保留大部分优势；冲击瞬间单帧CLIP视频特征仅ρ=0.28。随后将冻结音频教师通过训练投影头蒸馏到冻结CLIP骨干。由于总体相关容易被类别身份支配，作者另用投影头和探针均未见目标材料的leave-one-material-out协议。四帧视觉输入下蒸馏使该协议相关从0.234升至0.338，覆盖17种材料中的14种；摘要另报告相较匹配四帧基线高0.053。跨冲击过程的四帧输入本身无需音频即可取得该改进的一半，说明单帧缺失的信息部分来自可见动态。

Insight: 声音表征更直接编码阻尼属性，但跨材料留出评估显示视频时间动态和音频教师蒸馏都可补充视觉信息。摘要同时报告0.234至0.338的变化和相较匹配四帧基线+0.053，两者参照不同；具体材料数量有限，不能据此推断普适材料物理推理能力。

Abstract: Physical understanding is crucial for decision making, yet vision models struggle to infer properties such as damping that govern how materials behave. Audio encodes such properties directly, because an object’s acoustic response to impact reveals its damping through measurable decay. We probe frozen encoders for the quality factor $Q$, a dimensionless measure of how many oscillations an object completes before its ring dies away, and report how well each embedding orders impacts by $Q$ using the Spearman rank correlation $ρ$, for which $ρ=1$ is a perfect ordering and $ρ=0$ an unrelated one. Audio embeddings reach $ρ=0.73$ and retain most of that advantage on materials withheld from training, while a single video frame taken at the moment of impact, encoded by CLIP, supports only $ρ=0.28$. Having established where the signal lives, we ask how much of that gap vision can recover. We distill a frozen audio teacher into a frozen CLIP backbone through a trained projection head and find that this recovers a useful fraction of the audio advantage. Because pooled correlations on this task are dominated in practice by category identity, we also evaluate under a leave-one-material-out protocol in which the held-out material is withheld from the projection head as well as the probe. Distillation with a four-frame input improves the correlation there from 0.234 to 0.338 (+0.053 over the matched four-frame baseline, 14 of 17 materials), a gain that no category-level strategy can produce. Widening the visual input to four frames spanning the impact supplies half of that improvement at no acoustic cost, which indicates that part of what a single frame misses is visible dynamics.

[104] MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents cs.CVPDF

Huanyao Zhang, Jiepeng Zhou, Jiaye Lin, Ontai Tang, Jingtian Hao

TL;DR: MMSearch-OPD通过扩展现有简单多模态问题构造长链搜索任务，并在SFT后联合强化学习和在线策略蒸馏训练搜索智能体。

Details

Motivation: 多模态深度搜索正转向持续收集证据的长时程调查，但训练受限于具有挑战性的问题不足及过程反馈稀缺。

Result: 数据Refine流程对已有简单多模态问题的推理链进行有针对性的扩展，用参数化变换控制搜索深度和跨模态证据需求，同时复用原有图像—问题对。训练时，答案奖励和轻量行为惩罚引导RL；奖励差异再调节不完美学生轨迹上的令牌级教师引导，并通过指数衰减系数逐步降低对教师的依赖。实验显示，数据精炼带来收益，SFT后联合训练进一步提升长时程多模态深度搜索能力。

Insight: 从已有图像问题构造可控难度扩展数据可缓解长链训练样本不足，RL与蒸馏结合则同时提供结果和过程监督。摘要未提供模型规模、基准名称、具体分数及数据扩展成本，效果仅作定性报告。

Abstract: Multimodal deep search is moving from short queries to long-horizon investigations that continually acquire evidence. However, training such agents remains constrained by limited challenging training questions and insufficient process feedback. We introduce MMSearch-OPD, combining controllable data refinement with joint reinforcement learning (RL) and on-policy distillation (OPD). Our Refine pipeline performs targeted expansion of reasoning chains derived from existing simple multimodal questions. Parameterized transformations control search depth and cross-modal evidence requirements while reusing existing image–question pairs. For training, answer rewards and lightweight behavior penalties guide RL, while the reward gap modulates token-level teacher guidance on imperfect student trajectories. An exponentially decaying distillation coefficient reduces teacher dependence as training proceeds. Experiments show gains from data refinement and further improvements from joint training after SFT, indicating stronger long-horizon multimodal deep search capabilities.

[105] SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation cs.CVPDF

Yufei Jiao, Jinfa Huang, Zeyue Xue, Tianyu Xie, Yuexiao Ma

TL;DR: SCOPE让文生图提示改写模型同时输出增强提示和语义分区，并在每个语义跨度内聚合策略对数概率变化，形成与对象、数量、属性及关系结构一致的令牌信用分配。

Details

Motivation: 文生图提示优化的RL常用单一图像信号更新单个子词令牌，但对象、数量、属性和关系往往构成完整语义片段，逐令牌处理可能破坏其组合结构。

Result: SCOPE基于GRPO，让改写器联合生成优化提示和其语义分区；对每个跨度内策略对数概率变化池化，形成共享损失系数，但每个完整回答仍只有一个优势值。它无需额外跨度奖励或生成更多图像。在Qwen-Image、SD3和FLUX.1-dev上，相较普通GRPO，GeneVal平均相对提升9.48%，T2I-CompBench提升7.62%。消融显示语义边界和跨度内池化均对收益有贡献。

Insight: 按语义跨度聚合令牌反馈，可使策略更新与图像生成中的组合概念结构对齐，同时维持单一图像级奖励。摘要未给各生成器的分项提升、绝对指标和RL训练成本，报告值为平均相对增益。

Abstract: Reinforcement learning (RL) enables language models to improve text-to-image (T2I) generation by rewriting prompts for a frozen image generator. Existing methods typically apply a single signal derived from the image to individual subword tokens, although objects, counts, attributes, and relations form coherent semantic spans. We propose SCOPE, an objective based on Group Relative Policy Optimization (GRPO) that aligns update weighting with this structure. The rewriter jointly generates an enhanced prompt and its semantic partition. SCOPE pools shifts in policy log probabilities within each span to derive a shared coefficient for its token losses while retaining a single advantage for each completion. It requires neither separate span rewards nor additional image renders. Across Qwen-Image, SD3, and FLUX.1-dev, SCOPE achieves average relative gains over vanilla GRPO of 9.48% on GeneVal and 7.62% on T2I-CompBench. Ablation studies show that both semantic boundaries and pooling within spans contribute to these gains, supporting semantic structure as a practical inductive bias for prompt engineering with RL.

[106] Unsupervised Clustering of Public Transport Vehicles Using Deep Morphological Features and Color Histograms cs.CVPDF

Juan Irving Vasquez

TL;DR: 该方法无监督聚类墨西哥城道路视频中的公交图像，将冻结DINOv2形态特征与HSV颜色直方图融合，以区分路线和车辆类型。

Details

Motivation: 道路监控视频包含大量无标注公共交通数据，但不同线路公交外形结构相似，主要靠涂装颜色区分；无人工标签下将车辆聚为有意义类别较困难。

Result: 方法从冻结DINOv2视觉Transformer提取形态特征，将其与手工HSV颜色直方图加权早期融合，再用UMAP投影和K-means聚类。数据包含从墨西哥城一条干道约1,460小时视频中抽取的7,972张公交图像，目标是无监督识别RTP公共公交网络车辆。65%形态特征、35%颜色特征的融合产生14个簇，可区分不同线路和车型，并比仅形态特征提高目标簇精确率。

Insight: 颜色可补充自监督形态特征，帮助区分外形相似但涂装不同的路线；若颜色权重过大则可能主导表征。摘要未给目标簇精确率数值、聚类纯度或跨城市泛化测试。

Abstract: Surveillance cameras along urban roads produce large volumes of unlabeled video that could support the monitoring of public transport, but grouping the observed vehicles into meaningful categories without manual annotation remains challenging, since buses from different routes often share the same body structure and differ mainly in their color schemes. This study presents an unsupervised clustering methodology for public transport vehicles that combines morphological features extracted with a frozen DINOv2 Vision Transformer and handcrafted HSV color histograms through weighted early fusion, followed by UMAP projection and K-Means clustering. The method was evaluated on 7,972 bus images extracted from about 1,460 hours of video of an arterial road in Mexico City, with the goal of isolating the buses of the city’s public bus network (RTP) without supervision. With a fusion of 65% morphological and 35% color features, the pipeline produced 14 clusters that separate distinct routes and vehicle types, and it increased the precision of the target cluster with respect to morphological features alone. These results show that color complements self-supervised features for route-level clustering, provided that it does not dominate the representation.

[107] MJev-Spatial: System One Spatial Intelligence via Native Attention Matching cs.CVPDF

Luozheng Qin, Yuhan Zhu, Changhai Zhou, Qian Qiao, Jun Gao

TL;DR: MJev-Spatial将空间选择题、数值距离和二维定位统一为候选分类，直接用骨干预训练Q/K投影评分，无需生成答案令牌。

Details

Motivation: 智能体常需以交互频率做空间关系、距离或位置判断，但VLM自由文本生成会为有限输出空间付出自回归解码和答案解析开销。

Result: MJev-Spatial是System 1多模态决策模型，将各候选视为类别并使用骨干现成查询/键投影评分，不增参数；候选可以是题目选项、数值分箱或经由粗到细分类细化的图像区域。每个分类只需一次前向，不生成答案令牌。训练时用教师强制在一次前向联合监督所有粗到细阶段，并结合长度感知全局批处理和跨GPU负载均衡，使吞吐较原批处理提高30.8%。基于Qwen3.5-4B、用现有空间数据集转换的1,230万QA对训练后，八模型总体得分最高为65.64%，十二个基准中七项第一，且在所有十二项均超过未修改自回归基座；速度为最快自回归基线的2.5倍、基座的5.6倍。

Insight: 将空间输出设计为离散候选评分可绕过文本生成，对实时决策更省时；统一框架涵盖离散选项、数值与坐标任务。摘要未给各任务分项得分、候选分箱和跨GPU训练硬件细节。

Abstract: Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an object is, or where to place it. Vision-language models (VLMs) produce these answers by free-form text generation, paying for autoregressive decoding and answer parsing even though the output space is compact: one of a few options, a scalar, or a 2D point. In light of this, we introduce MJev-Spatial, a System 1 multimodal decision model that tackles all three types of spatial understanding tasks within a unified classification framework. Specifically, MJev-Spatial treats each candidate as a class and scores it using the backbone’s pretrained query and key projections, without adding parameters. The candidates are the given options for choice tasks, or value bins and image regions refined through coarse-to-fine classification for numerical and point prediction, respectively. At inference, each classification decision takes a single forward pass and generates no answer tokens. To train on heterogeneous spatial data efficiently, we supervise all coarse-to-fine stages jointly with teacher forcing in one forward pass, and combine this with length-aware global batching and cross-GPU load balancing, raising training throughput by 30.8% over the original batching strategy. Built on Qwen3.5-4B and trained on 12.3M question-answer pairs converted from existing spatial datasets, MJev-Spatial achieves the highest overall score (65.64%) among eight tested models, ranks first on seven of twelve benchmarks, and outperforms its unmodified autoregressive base model on all twelve, while running 2.5 times faster than the fastest autoregressive baseline and 5.6 times faster than the base model.

[108] Routing Policy Optimization for Online Diffusion Reinforcement Learning cs.CVPDF

Qiuhong Shen, Yiding Yang, Yuxin Zhang, Xinwei Huang, Minxuan Lin

TL;DR: RPO把扩散生成器内部的注意力路由作为随机探索动作，在少数去噪层采样注意块并以成对rollout奖励差更新策略，而推理时恢复原确定性稠密注意力。

Details

Motivation: 用于视觉生成对齐的策略梯度方法通常扰动反向去噪轨迹来引入随机性，需要高成本rollout优化；作者探问能否在生成器内部探索，同时保持原采样器。

Result: Routing Policy Optimization在选定去噪层中让每个查询块保留自身块，并按模型原生注意力质量采样其它键块，或选择稠密注意力。采样路由改变该转移速度，再用围绕稠密速度的高斯似然为策略梯度打分。受控双rollout估计器让两个轨迹共享提示、初始潜变量、路由层和稠密锚定层，仅注意路由采样不同，奖励差作为路由转移优势。因似然对稠密速度本身求导，移除稀疏路由后学习更新仍有效；推理时恢复稠密注意力及原确定性采样器。文生图和文生视频实验显示质量提升，训练效率较Flow-GRPO类方法近4倍。

Insight: 随机探索可放在注意力路由而不是反向轨迹中，训练后又能回到原始确定性稠密推理路径。摘要报告近4倍训练效率提升，但未给质量指标、算力测量口径和路由稀疏度。

Abstract: Reinforcement learning can align visual generators with reward signals beyond their pretraining objectives, but existing score-function methods typically introduce stochasticity by perturbing the reverse denoising trajectory, leading to costly rollout-based optimization. We instead ask whether stochastic exploration can be introduced inside the generator while preserving its original sampler. Routing Policy Optimization (RPO) answers this question by turning attention routing into a stochastic exploration action. At a few selected denoising levels, each query block keeps its own block and samples further key blocks in proportion to the generator’s native attention mass, or keeps dense attention. The sampled route perturbs the velocity of that transition, and a Gaussian likelihood around the dense velocity scores the perturbation with a score-function objective. RPO further uses a controlled two-rollout estimator: two rollouts share the same prompt, initial latent, routed denoising levels, and dense anchor layers, differing only in their sampled attention routes. Their reward difference provides an advantage signal for the routed transitions. Because the likelihood differentiates the dense velocity itself, the learned updates remain effective after routing is removed. At inference, RPO restores dense attention and retains the original deterministic sampler. Experiments on text-to-image and text-to-video generation show that RPO improves generation quality while achieving nearly 4x higher training efficiency than Flow-GRPO-style methods. Please see our project page at https://velox-world.com/rpo for visual results.

[109] Grounded Human-Attributed Description and Activity Recognition in Videos cs.CVPDF

Jay N. Paranjape, Jurijs Nazarovs, Rohan Sarkar, Yue Guo, Lipeng Ke

TL;DR: GHADAR定义按人定位后对视频中每个人描述特征及活动的任务，构建基于AVA-Actions的开放集数据集，并在训练中用定位约束视觉语言模型的交叉注意力掩码。

Details

Motivation: 既有视频数据多只支持群体活动识别、单人活动识别或封闭集分类，无法要求模型对复杂场景中的每个人分别生成有定位依据的特征和活动描述。

Result: GHADAR任务要求给出每个人在视频中的位置，并描述视频里所有人的特征和活动。作者基于AVA-Actions生成开放集人物及活动描述数据，并提出训练方法，在VLM训练期间约束交叉注意力掩码以利用定位信息。实验显示其超过先进VLM。作者还指出现有评测指标过度依赖人工注释和文本精确匹配，因此提出直接在视频与生成描述间比较概念的整体VLM评估方案。

Insight: 人物级定位可为开放式描述提供实体依据，训练中显式利用grounding也有助于每人属性和活动的归属；评估需关注视频概念匹配而不只是文本重合。摘要未给数据集规模、基线分数或VLM评估器的人类一致性。

Abstract: Understanding characteristics and activities of individuals in complex multi-person environments is crucial for real-world applications. However, existing datasets often simplify this problem to grounded group activity recognition, single-person activity recognition, or close-set activity recognition, thus limiting the generalizability of models trained on these datasets. In this work, we introduce the task of Grounded Human-Attributed Description and Activity Recognition (GHADAR), which involves describing the characteristics and activity descriptions of \textbf{every} person in a video, provided the location of the person in the video, which is more practical for real-world applications. To facilitate this, we introduce a new dataset derived from AVA-Actions by generating open-set captions for the person description and activity. In addition, we propose a novel method to effectively utilize the information contained in grounding during training by constraining the cross-attention masks during training in VLMs to improve performance for this task. Our experiments show that our method outperforms SOTA VLMs on this task. Finally, we demonstrate the limitations of existing evaluation metrics, which are overly reliant on human-annotations and exact text-text matching. As an added video-based evaluation, we propose a holistic VLM-based evaluation schema that compares concepts {\em directly} between the video and the generated predictions. Thus, in this work, we develop a complete framework for GHADAR, including a dataset, a novel method and an evaluation schema, thereby establishing a strong foundation for future research in this domain.

[110] Velox: Spatial Memory Makes World Models Efficient cs.CVPDF

Qiuhong Shen, Shizun Wang, Xinchao Wang

TL;DR: Velox利用流式几何的视锥深度片段对应关系，路由长视频生成中与当前区域相关的历史注意力块，避免KV缓存随rollout增长导致后续片段变慢。

Details

Motivation: 交互世界模型需生成响应迅速且视觉连贯的长视频；分块视频扩散模型通常保留不断增长的KV缓存，导致越往后生成越慢。

Result: 免训练注意力路由器Velox把历史块表示为含深度区间的相机视锥片段，并通过近期优先多重warp估计当前块深度。对历史覆盖良好的区域，视锥重叠软调制模型推导的块重要性；未覆盖区域则保持原模型路由、不加几何偏置。固定令牌块粒度与FlashAttention式分块执行匹配，减少随rollout长度增长的注意力计算。视锥构建与去噪在同一H200上异步运行。到第48块时，注意力加速4.36倍、去噪加速2.43倍；WBench导航全158例上，平均表现距离稠密LingBot-Fast-Cam不超过0.15个免API分数点。

Insight: 几何可用于选择历史记忆块，使模型重点读取与当前可见区域相关的缓存内容，并以异步处理降低路由开销。第48块加速是特定长rollout位置，摘要未给其它长度、质量分项及显存变化。

Abstract: Video world models turn actions and camera motion into long visual rollouts, making video a natural interface for interactive simulation. Such interaction requires responsive generation, yet coherent rollouts must retain visual memory of what has already been generated. Chunked video diffusion models usually keep this context in growing KV caches, so later chunks become progressively slower. To address this bottleneck, we introduce Velox, a training-free attention router for region-level context selection using frustum slab correspondences from streaming geometry. Velox represents historical blocks as camera frustum slabs with depth intervals and obtains current-block depth through recency-priority multiwarp. For well-covered regions, frustum slab overlap softly modulates each layer’s model-derived block importance. Uncovered regions retain the model-derived route without geometric bias. The fixed token-block granularity matches FlashAttention-style tiled execution and reduces the attention term that grows with rollout length. Frustum slab construction runs asynchronously with denoising on the same H200. At chunk 48, Velox accelerates attention by $4.36\times$ and denoising by $2.43\times$. On the full 158-case WBench navigation split, it remains within 0.15 API-free average points of dense LingBot-Fast-Cam. Please see our project page at https://velox-world.com/velox/ for more details.

[111] Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling cs.CVPDF

SeungJu Cha, Ye-Chan Kim, Kwanyoung Lee, Dong-Jin Kim

TL;DR: EOS-Story在文字和视觉两个空间分离人物身份与场景变化：将短语外观残差注入场景EOS嵌入，并按场景尺度适配身份特征，减少视觉叙事中的结构伪影。

Details

Motivation: 扩散模型可生成视觉故事图像序列，但既有方法偏重人物身份保持，难适应不同场景变化，导致语义错配和结构灵活性不足。

Result: 免训练EOS-Story先将叙事拆成身份和场景子提示，避免场景内容被身份信息稀释；为让场景也能获得外观线索，Cross-Contextual Bridging将短语级外观残差软注入场景EOS嵌入。视觉空间中，作者发现身份主体与场景主体尺度不匹配会反复转移少量身份令牌，形成结构伪影；Adaptive Identity Preservation通过场景尺度身份锚定及身份感知自注意力整合特征。作者扩展Consistory+基准，加入多样构图场景Consistory++。实验显示EOS-Story在两个基准上均达到有竞争力或更优表现。

Insight: 人物一致性应随场景尺度适配，而非机械复制身份令牌；文本子提示和视觉特征整合分别解决语义稀释与尺度错配。摘要未给具体指标、基线和训练/推理成本，且称方法免训练。

Abstract: Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where coherent image sequences are generated from narrative prompts. However, existing methods primarily focus on identity preservation and often fail to adapt to diverse scene variations, resulting in semantic misalignment and structural inflexibility. We propose EOS-Story, a training-free framework that harmonizes identity consistency with scene-specific adaptation across text and vision spaces. In the text space, we decouple the narrative into identity and scene sub-prompts to prevent information dilution, but this leaves the scene without access to appearance cues. To bridge this gap, we introduce Cross-Contextual Bridging, which softly injects a phrase-level appearance residual into the scene’s embedding. In the vision space, we find that scale mismatch between identity and scene subjects causes a few identity tokens to be repeatedly transferred, producing structural artifacts. We address this with Adaptive Identity Preservation, which anchors identity features at the scene-specific scale (Identity Anchoring) and integrates them via Identity-Aware Self-Attention. To evaluate performance under varied spatial compositions, we extend the Consistory+ benchmark with diverse framing scenarios (Consistory+_+). Extensive experiments show that EOS-Story achieves competitive or superior performance on both benchmarks.

[112] AVC-Reward: Event-Centric Audio-Video Consistency Evaluation cs.CV | cs.AIPDF

Yuruo Wu, Kaihang Pan, Kai Shen, Jiacheng Li, Shuyuan Tu

TL;DR: AVC-Reward以事件为单位拆解视听生成内容，分别检查整体叙事协调、事件时间同步和细粒度属性对齐，并将评价训练成可用于在线RL的奖励模型。

Details

Motivation: 联合音视频生成可呈现多事件、多层音频和不对称跨模态关系，但当前评估多沿用简单任务指标，整段打分且预设少量关系，难以评价复杂场景。

Result: 作者提出事件中心框架，分别分解音频与视觉事件、逐事件分析并跨模态交叉核验关系，最终聚合为粗到细的三级一致性指标，评估全局叙事协调、事件级时间同步和细粒度属性对齐。基于多类生成模型产生的正负样本构建AVC-Benchmark，并将框架实例化为可训练AVC-Reward。结果显示其自动评价与人类判断的一致性优于其它自动方法，能够给出定位失败原因的可解释依据；作为在线强化学习信号时，也提升联合音视频生成模型的一致性。

Insight: 复杂音视频评估需检查每个事件及事件之间的跨模态关系，整体平均分可能掩盖局部错位；可解释奖励还能用于优化生成器。摘要未报告基准规模、人类一致性数值及RL前后具体指标。

Abstract: As joint audio-video generation models become more capable, they can generate audio-visual scenes exhibiting three forms of complexity: multi-event composition, multi-layer audio mixture, and asymmetric cross-modal relations. However, current evaluations largely reuse metrics from earlier simple and unidirectional tasks. They typically evaluate an audio-video clip as a whole and rely on simple predefined relations, making them unsuitable for these increasingly complex scenes. We propose an event-centric evaluation framework that disentangles audio and visual events at the event level, analyzes each event independently, cross-validates relations across modalities, and aggregates the judgments into a coarse-to-fine, three-level consistency metric. The metric assesses global narrative harmony, event-level temporal synchronization, and fine-grained attribute alignment, providing a general formulation for audio-video consistency evaluation across diverse generation settings and cross-modal relations. We instantiate the metric as AVC-Reward, a trainable audio-video reward model. To evaluate the agreement between automatic judgments and human perception across generation paradigms and relation complexities, we construct AVC-Benchmark, which is primarily built from diverse positive and negative samples generated by various types of audio-video generation models. AVC-Reward achieves state-of-the-art alignment with human judgment among automatic methods, provides interpretable rationales that localize failures, and improves the audio-video consistency of a joint generation model when used as an online reinforcement-learning signal. Project page: https://tsuki0512.github.io/AVC-Reward.github.io/

[113] Dense4D: Pixel-Level 4D Human Correspondence cs.CVPDF

Rıza Alp Güler

TL;DR: Dense4D从多张单目RGB图像预测人体、衣物和头发的稠密表面点图及深度，以共同参考时刻的三维表面坐标建立跨姿态、形变和遮挡的对应关系。

Details

Motivation: 4D人体重建需在关节运动、身体变形及可见性变化中追踪同一表面点；既有方法通常依赖身体模板，难以统一处理身体、衣物和头发。

Result: Dense4D是专为人体稠密4D对应设计的前馈模型，不需要人体模板。模型联合处理经过人物中心裁剪、并已知原图到裁剪变换的多张图像，逐帧预测Human Point Map（HPM）及深度；HPM为人物像素赋予共同参考时刻下其观测表面的3D位置。即使参考帧看不到某点，也可从其它帧定位对应位置；跨裁剪匹配HPM坐标即可建立对应，不必预测相机姿态或大范围场景位移，之后用逐图深度将匹配提升为3D轨迹。真实人物实验中，作者报告其跟踪准确度明显高于基线，且更接近扫描表面；不同帧点可组成参考姿态下连贯人体几何。

Insight: 通过共同参考时刻的表面坐标对齐各帧，使对应关系不依赖相机姿态估计，并可利用其它帧恢复参考视图中被遮挡的点。摘要未提供数据集、跟踪/表面误差数值和与基线的定量差异。

Abstract: Reconstructing human motion in 4D requires identifying the same surface points through articulation, deformation and changes in visibility. We introduce Dense4D, to our knowledge the first feed-forward model dedicated to dense 4D correspondence across the body, clothing and hair from a set of monocular RGB images, without a body template. Trained specifically for human geometry, Dense4D jointly processes person-centred crops with known image-to-crop transforms to predict Human Point Maps (HPMs) and depth for each image. An HPM assigns each person pixel the 3D position of its observed surface point at a common reference time. These maps support amodal correspondence: points hidden in the reference image can be localised from observations in other frames. Matching HPM coordinates across crops establishes correspondence without predicting camera poses or large scene displacements; per-image depth then lifts the matches into 3D tracks. Experiments on real people demonstrate substantially higher tracking accuracy and closer agreement with scanned surfaces than the evaluated baselines. Points from different frames assemble into coherent human geometry in the reference pose, providing visible evidence of consistent dense correspondence through articulation and clothing deformation. Additional qualitative results, videos, and an interactive viewer are available at https://alpguler.com/dense4d.

[114] ACEdit: Stable Multi-Turn Image Editing via Asymmetric Conditioning cs.CV | cs.AI | cs.GRPDF

Sara Dorfman, Nir Goren, Gal Barak, Daniel Cohen-Or, Or Patashnik

TL;DR: ACEdit通过训练期让学生在自身上一轮编辑结果上继续工作，并让教师始终以原始干净图像和组合指令提供监督，缓解多轮图像编辑中的分布偏移。

Details

Motivation: 图像编辑模型单轮表现良好，但每轮会引入小的分布变化并逐步累积，使多轮推理输入偏离原始训练分布，质量和指令遵循随轮次退化。

Result: 方法采用Self-Forcing思路，训练编辑器处理自己之前生成的结果。困难在于自生成编辑轨迹会偏离真实轨迹，直接监督不可靠；作者因此引入教师编辑器蒸馏信号。非对称条件设计中，学生逐步编辑自己的输出，教师则始终锚定原始干净图像并接收复合编辑指令，提供相对稳定目标。实验显示，该训练方案显著降低长多轮序列中的质量退化，同时保持编辑质量和指令遵循。

Insight: 学生与教师不必使用相同的多轮输入分布：学生需适应自身输出，教师可保留原图作为稳定参照。摘要未说明编辑轮数、数据集、具体质量指标及教师调用/训练成本。

Abstract: Image editing models produce impressive results for individual edits, but their quality often deteriorates over multiple editing turns. Each editing turn introduces small distribution shifts that accumulate over successive edits, creating a gap between the input distributions encountered during the editor’s original training and multi-turn inference. We introduce a training scheme that makes multi-turn image editing stable under this accumulating distribution shift. A key is to force the editor to operate on its own outputs from previous editing turns during training, bringing the principle of Self-Forcing to image editing. The main challenge is that self-generated editing trajectories deviate from ground-truth trajectories, making direct supervision unreliable. We address this challenge through a distillation objective that leverages a teacher image editor to provide a reliable training signal when the model operates on its own previous outputs. We introduce an asymmetric conditioning scheme: while the student performs edits sequentially on its own outputs, the teacher remains anchored to the original clean image and receives a compound editing instruction. Experiments show substantially reduced degradation over long multi-turn sequences while maintaining editing quality and instruction adherence.

[115] 3DCodeVerse: Exploring 3D Worlds as Code cs.CV | cs.AIPDF

Yipeng Gao, Ziyao Zeng, Jinfa Huang, Yijiang Li, Haolin Xiong

TL;DR: 3DCodeVerse提供大规模可执行3D程序数据、带自动验证的多智能体编码harness和经验指南，支持智能体以代码形式生成可编辑、可检查的三维内容。

Details

Motivation: 让编码智能体创建3D内容需要高质量可执行程序、空间推理工具和自动验证流程，单靠自然语言描述或静态3D数据难以规模化探索。

Result: 3DCodeVerse-2M整理独立可执行3D代码，来源包括开源数据、专用表示转换及编码智能体生成；每个程序均附执行环境所需源文件和资产，以及可用的描述和验证记录。3DCodeVerse Harness是多智能体有向无环图流程，利用执行检查、空间测量和视觉反馈自动评价及修订程序，生成过程无需人工反馈。系统还进行3D编码实证研究并建立经微调开源模型基线。作者报告，在Claude Opus 5.5驱动两种方案的成对人评中，3DCodeVerse harness相较Claude Design（3D Object）获90%胜率。

Insight: 可执行程序、配套资产和运行验证记录能把3D生成转成可复现的代码任务；自动执行与几何/视觉反馈有助于迭代纠错。90%是由同一Claude Opus 5.5使用两套系统时的成对人评结果，摘要未给数据集筛选、评审人数及开源模型定量结果。

Abstract: We introduce 3DCodeVerse, a research ecosystem that enables coding agents to create editable and verifiable 3D content at scale. 3DCodeVerse comprises large-scale, high-quality datasets of executable 3D code, a coding harness for spatial reasoning and automated verification, and practical guidance for 3D coding. First, we construct 3DCodeVerse-2M, a large-scale curated dataset of standalone 3D executable code. We build this corpus by collecting open-source data, converting specialized representations, and generating new programs with coding agents. Each program is packaged with the source files and associated assets required for execution in its declared environment, along with available descriptions and verification records. Second, we develop the 3DCodeVerse Harness, a multi-agent directed acyclic graph framework for generating and refining 3D content. It uses execution checks, spatial measurements, and visual feedback to automatically evaluate and revise generated programs without human feedback during generation. Third, we conduct systematic empirical studies of 3D coding, establishing baselines with fine-tuned open models and deriving practical guidance through component-level analyses of our harness. Extensive experiments demonstrate that fine-tuning on our dataset significantly improves the 3D coding capabilities of open-source models. Notably, our 3DCodeVerse harness achieves a 90% win rate against Claude Design (3D Object) in pairwise human evaluations, when both are utilized by Claude Opus 5.5.

[116] Speculative Forcing for Efficient Autoregressive Video Generation cs.CVPDF

Hyunwook Choi, Seungryong Kim, Dongyoon Han, Sangdoo Yun

TL;DR: Speculative Forcing把中间去噪的干净估计视为视频生成草稿，预测哪些令牌可提前冻结并将其缓存继续作为上下文，以减少逐令牌不必要的完整去噪计算。

Details

Motivation: 少步自回归视频生成可流式输出，但常对每个令牌都运行到最终去噪步；作者发现不少令牌在初始步骤已接近最终输出，而另一些才需要继续细化。

Result: Speculative Forcing允许已接受令牌作为最终结果冻结、不再继续去噪，同时将其缓存的键值保留为其它令牌上下文。作者提出两种验证器：免训练方案根据干净内容相似度及跨步稳定性判断；学习式方案从冻结生成器中间特征估计令牌距离最终输出的剩余差距。短视频、长视频和世界生成实验中，方法在显著降低计算时保持全步采样质量。LongLive上以每令牌约1.7步去噪匹配四步生成器，速度超过1.5倍，达到41.7和37.8 FPS；Lingbot-World 2.0在持续变化的视角内容下以每令牌约2.5步保持质量，加速1.35倍、达到24.5 FPS。

Insight: 提前接受已稳定令牌并保留其KV作为上下文，可按令牌分配去噪计算，而非全体等量迭代。FPS及步数对应指定模型/设置；摘要未给验证器误接受率及不同内容区域的收益。

Abstract: Few-step autoregressive video generators enable streaming generation, yet they run every token through the final denoising step, regardless of how much refinement it needs. We find this uniform computation is often unnecessary: many tokens already closely match their eventual full-step outputs in the initial steps, while others require refinement until the end. We introduce Speculative Forcing, a framework that treats intermediate clean estimates as drafts and predicts when individual tokens can be safely accepted early. Once accepted, a token is frozen as its final output and undergoes no further denoising, while its cached keys and values remain available as context for the remaining tokens. We explore two alternative verifier designs: a training-free one based on similarity to clean content and stability across steps, and a learned one that reads the frozen generator’s intermediate features to estimate each token’s remaining gap to its full-step output. Across short-video, long-video, and world generation, Speculative Forcing preserves the quality of full-step sampling while substantially reducing computation. On LongLive, it matches the four-step generator with ~1.7 denoising steps per token, running over 1.5x faster at 41.7 and 37.8 fps. On Lingbot-World 2.0, where camera motion continually changes the visible content, it maintains quality with ~2.5 denoising steps per token and runs 1.35x faster at 24.5 fps.

[117] SUPRA-TEX: 3D Generation with Super-Aligned Texture cs.CV | cs.GRPDF

Chen Yang, Jiemin Fang, Fanpeng Meng, Zihao Huang, Jichen Pang

TL;DR: SUPRA-Tex把单图3D材质重建拆为可见材质估计、表面投影对齐及基于观测的3D补全，以固定可见证据锚点生成完整可重光照材质。

Details

Motivation: 单图3D生成需为给定网格赋予可重光照材质并忠实保留参考细节；多视图预测不一致会在融合时产生伪影，而隐式图像特征条件又难保留细节。

Result: 作者先训练多模态大模型图像编辑器，在参考视角预测去除光照影响的PBR材质图，再投影到可见表面，并通过预训练材质VAE编码成与生成目标同一潜空间的观测潜变量。交错流Transformer将这些潜变量作为只读固定锚点，在未观测区域更新与全表面更新间交替，以生成完整材质潜变量。方法旨在对可见区域实现贴合参考图的所见即所得保真，同时对不可见表面作连贯补全。仅用公开数据训练时，作者报告其在几何条件纹理生成和端到端资产生成上均达SOTA，并在野外图像上匹配或超过领先商业系统。

Insight: 把可见材质作为同空间只读锚点，可将生成模型容量集中于保留观测及补全不可见区域，避免多视图不一致融合。摘要没有数据集、指标和商业系统对比细节，SOTA及野外结果无法定量展开。

Abstract: Single image 3D generation aims to dress a given 3D mesh with relightable materials while faithfully preserving the visual details of a reference image. Existing methods either introduce artifacts when fusing inconsistent multi-view predictions or struggle to preserve fine details through implicit image-feature conditioning. To resolve these challenges, we introduce SUPRA-Tex, built on the principle of decoupling visible-material estimation, surface alignment, and observation-guided 3D completion. This division of labor allows the 3D generator, trained on limited 3D data, to focus its capacity on preserving visible evidence and completing unobserved surfaces. Specifically, we first train an MLLM-based image editing model to predict lighting-separated PBR maps in the reference view. We then project these maps onto the visible surface and encode them with the pretrained material VAE encoder into native observation latents that share the generation target’s latent space. An interleaved flow transformer holds these latents as fixed, read-only anchors while alternating unobserved-region and full-surface updates to generate complete material latents. This design achieves super-alignment with the reference, delivering What You See Is What You Get fidelity on visible regions and coherent completion on unobserved surfaces. Trained solely on public datasets, SUPRA-Tex achieves SOTA performance in both geometry-conditioned texturing and end-to-end asset generation, matching or even exceeding leading commercial systems on in-the-wild images. Project page: https://supra-3d.github.io/supratex/

[118] DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models cs.CVPDF

Han Su, Meng Tian, Tianyu Huang, Mingyu Gao, Lennox Wei

TL;DR: DK-VLM以双核注意力分别保留预训练语义位置编码并引入场景3D点与相机位姿几何，以点位移和视角变换调节注意力。

Details

Motivation: VLM仍难跨视角理解3D空间关系并随观察者移动更新判断；常见做法把3D重建特征融合进视觉令牌，但空间监督有限时难与预训练语义表征对齐。

Result: 双核注意力包含语义核和几何核：前者保留模型原生注意力与位置编码，后者使用估计的3D点和相机姿态，通过点位移与相对视角变换直接影响注意力，再由学习门控融合两路输出，使几何作为位置进入注意力，而非重建特征融合。作者另提出参考坐标系组合监督，以经核验的单步标注提供逐步转向和朝向目标，训练模型在连续判断间更新参照系。所比较方法中，DK-VLM-8B在六个空间基准平均分最高，在VSI-Bench得74.33、ReVSI-32得58.28；坐标系监督进一步改善多步空间推理，完整模型保持一般视频理解能力。

Insight: 将几何作为注意力位置条件可直接影响跨视角信息交互，显式监督参考系更新则针对多步空间推理。摘要未给六个基准逐项分数、通用视频理解指标及几何估计误差敏感性。

Abstract: Vision-language models still struggle to understand 3D spatial relations across views and update spatial judgments as the observer moves. A common approach fuses 3D reconstruction features into visual tokens, but aligning these features with pretrained semantic representations remains challenging under limited spatial supervision. We propose DK-VLM with Dual-Kernel Attention, which computes attention from both a visual token’s input position and its geometric position in the scene. A semantic kernel retains the pretrained model’s native attention and positional encoding, while a separate geometric kernel uses estimated 3D points and camera poses to directly modulate attention through point displacements and relative view transformations. Then, a learned gate fuses their outputs. Geometry thus enters attention as position rather than as fused reconstruction features. We further introduce Reference-Frame Composition (RC) supervision to train the model to update its reference frame across successive judgments. It provides stepwise turn and heading targets derived from verified single-step annotations. Among the compared methods, DK-VLM-8B achieves the highest average score across six spatial benchmarks and the highest overall scores on VSI-Bench (74.33) and ReVSI-32 (58.28). RC supervision further improves multi-step spatial reasoning, while the full model preserves general video understanding. Project page: https://sumuru789.github.io/DK-VLM-website/.

[119] Grounding Generative Verification in 3D Content cs.CVPDF

Shuanglin Li, Jiaying Lin, Shuquan Ye

TL;DR: 3DVerifierBench评估模型核验3D内容的判定、拒绝理由及对规范/候选受控改变的响应，并探索验证反馈如何支持候选选择和递归修订。

Details

Motivation: 3D生成及理解除视觉保真外，还需符合任务特定的三维证据要求；可靠系统需要基于多视角观察提供指出缺项及违规原因的验证反馈，并区分真实几何不一致与投影视角差异。

Result: 作者提出覆盖10项任务的3DVerifierBench，测试模型判定、拒绝解释和对规格/候选受控改变的反应。人评显示，人与最强受测模型GPT-6 Astra之间有21.6个百分点差距；解释感知分析暴露拒绝可靠性问题。细粒度事实分析发现数值和值目标绑定错误。作者构建多视角事实提取、受控3D编辑和原生标注流程，产出14,126条带矛盾解释及关联反事实训练样本。在16候选人标注池中，oracle选择将完整事实成功率从26.7%提高到90.0%；另一个八输入研究中，人类引导递归修订对每个输入均满足全部七项要求，而并行Oracle@8中仅三个输入满足。

Insight: 在3D内容生成中，准确核验不仅能拒绝不合规结果，还可指导候选筛选和逐步修订；多视角事实及反事实支持更细粒度诊断。oracle和人类引导结果属于有限候选/小样本上限，不能直接视为自动系统性能；摘要未给自动验证器绝对分数。

Abstract: Recent advances in multimodal large language models (MLLMs) and 3D generation have expanded 3D understanding and synthesis. However, beyond visual fidelity, task-specific correctness grounded in 3D evidence remains a major challenge. We argue that building reliable 3D systems requires not only stronger generation and reasoning, but also verification feedback that identifies unmet requirements and explains their violations, allowing systems to reflect on and refine their outputs. Such feedback must integrate multi-view observations and distinguish genuine inconsistencies from projection-dependent appearances. We make three contributions. First, we introduce 3DVerifierBench, a benchmark spanning 10 tasks that evaluates decisions, rejection explanations, and responses to controlled changes in specifications and candidates. A human study reveals a 21.6 percentage-point gap between humans and the strongest tested model, GPT-6 Astra, while explanation-aware analysis exposes weaknesses in rejection reliability. Second, we analyze verification across fine-grained factual categories, exposing errors in values and target binding. We develop a scalable pipeline combining multi-view fact extraction, controlled 3D editing, and native annotations to produce 14,126 training examples with contradiction explanations and linked counterfactuals. Third, we examine how verification could support 3D generation through candidate selection and recursive refinement. In human-labeled sixteen-candidate pools, oracle selection improves complete factual success from 26.7% to 90.0%. In a separate eight-input study, human-guided recursive refinement satisfies all seven requirements for every input, compared with three under parallel Oracle@8. Together, our benchmark, analysis, and data pipeline establish a foundation for models to reflect on 3D content through reliable verification feedback.

[120] Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation cs.CV | cs.ROPDF

Zirui Wu, Chen Guo, Tianjian Jiang, Zeren Jiang, Zeming Li

TL;DR: P³-WAM在统一视频扩散骨干上学习第一视角灵巧操作的感知、动作条件预测和目标导向规划三种模式，将结构化3D手部动作与视觉动态联合建模。

Details

Motivation: 第一视角灵巧操作要求同时理解3D手部运动、预测动作导致的视觉变化并规划实现目标的动作；分别训练单项能力可能无法共享视觉与动作知识。

Result: Perceive模式从视频重建关节手部动作和相机轨迹；Predict模式在指定动作条件下生成未来视觉；Plan模式根据初始图像、语言指令和可选目标图像，联合生成动作轨迹及预期视觉后果。模型在预训练视频扩散Transformer中整合紧凑结构化3D动作表示，采用共享基座权重、模态专属适配和双向视觉—动作注意力；随机化模态可见性，使视频或3D动作在三种模式中作为条件或预测目标。实验显示统一训练改善三项能力，包括经VLM评测的规划质量；在四个数据集上，3D手部重建和动作条件视频预测超过专用基线，目标导向操作视频的指令遵循和动作进程也优于视频生成基线。

Insight: 共同视频—动作表示与随机化模态可见性使感知、动力学预测和目标规划共享知识。摘要未给具体指标、硬件或真实机器人执行评估，目标导向视频质量不等同于物理控制成功率。

Abstract: We introduce P$^{3}$-WAM, a unified world action model for egocentric dexterous manipulation that learns 3D perception, action-conditioned prediction, and goal-directed planning through three complementary modes: Perceive, which reconstructs articulated hand motion and camera trajectories from video; Predict, which generates visual futures under prescribed actions; and Plan, which jointly generates action trajectories and their anticipated visual consequences conditioned on an initial image, a language instruction, and an optional visual goal. Our model integrates a compact, structured 3D action representation into a pretrained video diffusion transformer through a mixture-of-transformers architecture with shared base weights, modality-specific adaptation, and bidirectional visual-action attention. Randomized modality visibility lets video and 3D actions serve as either conditioning context or prediction targets across the three modes. Experiments show that unified training improves all three capabilities over single-mode training, including gains in planning quality under a vision-language model evaluation. Through unified training, our model outperforms specialized baselines on 3D hand reconstruction and action-conditioned video prediction across four datasets, while producing goal-directed manipulation videos with stronger instruction adherence and action progression than video-generation baselines. Project Page: https://p3-wam.pages.dev/

[121] SoftCache: Adaptive Step Size Caching for Diffusion Transformers cs.CVPDF

Shimon Malnick, Nadav Orenstein, Ohad Fried, Shai Avidan

TL;DR: SoftCache利用缓存陈旧度信号距阈值的余量控制自适应采样步长：余量大时跨越多个计划节点，接近刷新时缩小步长，而不是仅二元决定缓存或重算。

Details

Motivation: 免训练缓存能重用近期网络激活以加速扩散/流模型，但动态缓存通常把陈旧度信号只作为刷新阈值的开关，且每一步仍按固定预设步长推进。

Result: 作者观察到陈旧度信号包含更多信息：其距刷新阈值的余量可预测复用产生的误差。SoftCache据此将余量映射为缓存步长；余量大时跳过多个计划节点，接近刷新则逐渐恢复为原步长，允许采样轨迹偏离固定网格。方法无需训练，也不需按骨干调参。在FLUX图像生成及HunyuanVideo、Wan 2.1视频生成中，3.5至6.9倍加速范围内，其四项保真指标均领先所有比较基线。

Insight: 缓存复用程度可以连续调节，而不是只用固定阈值作“刷新/不刷新”判断；误差余量可进一步用于跳步采样。摘要未给每个模型、速度点的质量数值及步长控制实现细节，3.5—6.9倍是多设置范围。

Abstract: Diffusion and flow models generate a sample over iterative steps, each a full pass through a large network, and that pass dominates generation cost. Training-free caching accelerates them by reusing activations from recent evaluations instead of recomputing them. Dynamic caching methods decide when to refresh by accumulating a cheap probe of the network input into a staleness signal and spending a fresh evaluation once it crosses a threshold. They perform hard caching: the signal is a binary switch between refresh and reuse, and every step, fresh or cached, advances by the prescribed step size. We observe that the signal carries much more than this switch. How far it sits below the threshold, its headroom, predicts the error induced by reuse. We propose SoftCache, which performs soft caching: instead of a binary switch, the headroom sets how far each cached step goes. Where the headroom is large, the sampler jumps past several scheduled nodes, and as a refresh nears, its steps shrink back toward the original step. These adaptive jumps may land between the scheduled nodes, taking the sampler off its fixed grid. SoftCache requires no training and adds no per-backbone settings: on FLUX for images and on HunyuanVideo and Wan2.1 for video, at speedups from $3.5\times$ to $6.9\times$, it is ahead of every baseline on all four fidelity metrics.

[122] Gen4P: Video Generators are 4D Perceivers cs.CVPDF

Yitong Xia, Zeren Jiang, Chuanxia Zheng

TL;DR: Gen4P将预训练视频生成器改造成前馈4D感知器，单次编码干净视频潜变量后按需查询空间点和连续时间的几何/运动属性，无需迭代去噪。

Details

Motivation: 从单目视频恢复4D几何与运动是统一感知任务，但视频生成预训练的模型通常用于生成，且通过反复去噪实现推理，成本较高。

Result: Gen4P基于按需查询框架，单次编码干净视频潜变量，并用轻量交叉注意力解码器预测请求的4D属性。按需查询支持灵活空间采样，连续时间查询提供时间灵活性。作者将预训练视频深度LoRA作为冻结几何先验插件引入，无需增加可训练参数即可改善总体性能。在3D点跟踪、视频深度和相机姿态估计任务上，Gen4P达到报告的最先进或有竞争力表现；野外视频定性结果展示其追踪复杂运动并维持精细结构的能力。

Insight: 生成式视频预训练可通过直接查询复用为4D感知表征，避免在每项任务上迭代生成；冻结深度LoRA提供额外几何先验。摘要未给各任务指标、基线及单次编码时延，SOTA范围以所列任务为限。

Abstract: We introduce Gen4P, a unified framework for recovering 4D geometry and motion from monocular video. We show that a pretrained video generator can be repurposed into a feed-forward 4D perceiver without iterative denoising. Building on on-demand querying, Gen4P processes clean video latents in a single encoder pass and predicts the requested 4D attributes through a lightweight cross-attention decoder. The on-demand query formulation enables flexible spatial sampling, and our proposed continuous-time queries further provide temporal flexibility. To strengthen geometric knowledge, we propose a straightforward plug-in solution by incorporating a pretrained video-depth LoRA as a frozen geometry prior, improving overall performance without adding extra trainable parameters. Gen4P achieves state-of-the-art or competitive performance on tasks of 3D point tracking, video depth and camera pose estimation. Qualitative results on in-the-wild videos illustrate its capability of tracking complex motion while maintaining the delicate structure. Together, these results demonstrate the potential of video generative pretraining for unified 4D perception. See https://gen4p.github.io for more visual results.

cs.AI [Back]

[123] ARIA: Runtime Inspection and Amendment for Multi-Agent Systems cs.AI | cs.CLPDF

Bolin Shen, Yushun Dong

TL;DR: ARIA从跨多个智能体框架收集的成功和失败轨迹中构建经执行验证的修复示范，训练模型在多智能体任务仍运行时识别错误并介入修正。

Details

Motivation: 多智能体系统中的局部错误会被后续智能体继承并扩散；事后诊断或反复重跑虽能搜索修正方案，却没有学出执行中的干预策略。

Result: ARIA先收集四种多智能体框架、六个基准和八个宿主模型的24,000多条成功/失败轨迹，并构建3,953组经执行验证的修复配对，逐项说明出错原因、介入位置及如何继续执行。随后训练与具体MAS框架无关的紧凑模型进行运行时检查和修补，适用于暴露执行轨迹且支持替换后续执行的系统。作者报告训练后模型在事后和在线修复设置均表现较强，并能迁移到未见框架及宿主模型。

Insight: 把经执行验证的修复变成训练数据，可将修复搜索从每次运行时迁移到数据构造阶段，并尝试泛化到相似错误。摘要未给修复成功率、基线、数据分布和新框架迁移量化值，具体性能无法进一步核实。

Abstract: In LLM-based multi-agent systems (MAS), a local mistake can propagate as other agents build on it, turning a correctable error into a failed task. Diagnosing completed runs or repeatedly re-executing them to search for corrections does not provide a learned policy for intervening while execution is still in progress. We present Agent Runtime Inspection and Amendment (ARIA), a framework for learning when and how to repair ongoing multi-agent executions. Our key intuition is to turn execution-verified repairs into reusable supervision, moving repair search into data construction and training so that a learned model can intervene at runtime without repeatedly testing alternatives. First, we collect over 24{,}000 successful and failed trajectories across four multi-agent frameworks, six benchmarks, and eight host models. From these trajectories, we construct the ARIA dataset, to our knowledge the first large-scale dataset pairing failed multi-agent trajectories with execution-verified repairs. It contains 3{,}953 verified repair pairs, each specifying what went wrong, where to intervene, and how execution should continue. Then, we develop the ARIA framework for MAS-agnostic runtime inspection and amendment, designed to integrate with any MAS that exposes execution trajectories and supports continuation replacement. Using verified repairs as training examples, we teach a compact model to recognize when intervention is needed and how to correct an ongoing run. The aim is to learn repair strategies that apply to related failures in new configurations, rather than merely reproduce individual corrections. Finally, the trained ARIA model demonstrates strong repair performance in both post-hoc and runtime settings, with generalization to unseen frameworks and host models. Our code is available at https://github.com/LabRAI/ARIA.

[124] When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Following cs.AI | cs.CLPDF

Shaoang Li, Yanhang Shi, Jian Li

TL;DR: 该研究把推理轨迹的两个作用分开测量：它可能提高答案准确率，也可能在与新证据冲突时妨碍模型更新；不同答题配置对证据跟随能力影响显著。

Details

Motivation: 保留的推理轨迹既可作为有用线索，也可能在答案阶段压过新证据；仅删除轨迹或看最终准确率，无法判断答案究竟跟随轨迹还是当前证据。

Result: 作者交叉设置经核验的不同证据版本和模型先前生成的推理轨迹，在相同轨迹及证据下比较继续原思考与单独新答案调用。三个模型家族gpt-oss、Gemma4、Qwen3在HotpotQA和MuSiQue上，单独答案调用的证据跟随率比继续思考高29.9至60.6个百分点。移除推理轨迹在两种配置下都会以相近幅度降低准确率；但冲突时，继续思考多数重复过时结论，而单独调用更常采用当前证据。进一步分析发现，轨迹末行保留其大部分价值，黄金证据若在轨迹写出前提供最有帮助；干扰证据会削弱单独调用的纠错能力；重新推理在多数冲突中会采用当前证据，而单纯要求验证则不会。

Insight: 使用推理轨迹获益与在证据冲突时服从轨迹是不同属性，评测应同时报告二者及答案调用方式。删除轨迹会丢失有用信息，不代表它没有产生锚定效应；结果限于两个QA基准和指定模型。

Abstract: A reasoning trace retained at answer time plays two roles: it can raise accuracy, and it can compete with the current evidence when the two disagree. We disentangle these roles by crossing verified evidence versions with the traces generated from each and answering from the same traces and evidence under two configurations: continuation of the model’s own thinking and a separate answer call. Across three model families (gpt-oss, Gemma4, Qwen3) on HotpotQA and MuSiQue, the separate call raises evidence-following over continuation by 29.9 to 60.6 points. On the same pairs, removing the trace lowers accuracy by similar amounts under both configurations. Yet continuation repeats the stale conclusion in most conflicts, and the separate call follows the current evidence far more often. Benefiting from a trace and deferring to it are therefore distinct properties. Further analyses show that the final line of a trace carries most of its value, gold evidence helps most before the trace is written, distractors weaken correction under a separate call, and renewed reasoning, unlike a verification instruction, follows the current evidence in most conflicts. Because trace deletion alone cannot reveal which source an answer follows, evaluations should report both properties together with the answer configuration.

[125] Confidence-Calibrated Inference Expansion for Evaluator-Guided Test-Time Reasoning cs.AI | cs.CL | cs.LGPDF

Weida Liang, Kenji Kawaguchi

TL;DR: 该控制器把评估器引导推理中的每步选择建模为三动作、算力感知决策：接受当前答案、回退到保底答案或继续扩展推理。

Details

Motivation: 评估器引导推理在每个节点都要决定信任当前答案、使用回退方案还是继续花算力扩展；固定策略难以针对决策不确定度和继续推理成本自适应。

Result: 控制器按预测答案成功率给终止动作评分，以rollout续答成功代理评分扩展动作，并显式计入计算成本。局部动作间隙分析刻画评分误差何时会改变决策，期望遗憾界则考虑实际扩展路径上的误差。作者据此学习并校准动作专属置信度，对模糊决定加入局部不确定性惩罚。在留出的宽度扩展和修订任务上，相较校准选出的固定策略，观察到效用提升，同时归一化在线计算分别约降低30%和16%。四个Qwen3-8B随机种子中，计算均低于拟合Q基线，效用差异较小且方向混合。

Insight: 测试时推理更适合被看作不确定条件下的资源分配，而不是一律增强推理；计算节省明确，但效用收益并非所有种子都一致。摘要未给具体效用指标、任务规模和固定策略比较的成本定义。

Abstract: Evaluator-guided reasoning presents a local control problem at every step: trust the current answer, return a fallback, or spend more inference. We formulate this choice as a compute-aware three-action controller, scoring terminal actions by predicted answer success and expansion by a rollout-based continuation-success surrogate, with compute cost priced explicitly. A local action-gap analysis characterizes when score errors can change a decision, while an expected regret bound accounts for errors along the realized expansion path. Guided by this analysis, we learn and calibrate action-specific confidence estimates, with local uncertainty penalties for ambiguous decisions. On held-out width expansion and revision tasks, the controller improves observed utility over calibration-selected fixed policies while reducing normalized online compute by about 30% and 16%, respectively. Across four Qwen3-8B seeds, compute is lower than fitted Q in both settings, while utility differences are small and mixed. The results frame evaluator-guided reasoning as resource allocation under uncertainty, rather than a uniformly stronger reasoner.

[126] SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills cs.AI | cs.CLPDF

Enze Ma, Chunyu Miao, Yankai Chen, Jie Yang, Liancheng Fang

TL;DR: SkillNEO将智能体技能优化设为非精英式演化，分别选择实际使用的版本和继续编辑的版本，从相似版本在同一任务上的表现中提取应保留步骤与待修问题。

Details

Motivation: 技能改进常需多个相互依赖编辑，低奖励版本可能仍是有价值的中间状态；若必须每次编辑立即带来收益，就会过早丢弃尚未完成的修复路径。

Result: SkillNEO把“选择使用哪个技能”与“选择继续改进哪些技能”分开，比较相关版本在同任务上的表现，找出可保留步骤及残余失败，并可依据后续证据回访早期版本。86项、覆盖8领域的SkillsBench任务上，GPT-5.4 Mini平均奖励从49.1%升至66.4%，达到GPT-5.5和GPT-5.6 Luna原始技能的范围。41项修改技能任务上，复用改进使Luna提升10.5个百分点，GPT-5.5较其发布的原始技能参考高10.6点。相同任务实例用于最终评估。搜索记录显示，最终获选技能有时经由分数较低的中间版本；技能也能在更强模型上复用，即使Mini仍未解决部分要求。

Insight: 技能搜索应保留低分但可能含有局部有效改动的版本，不能只做即时奖励贪心选择；较弱模型的部分进展可转成更强模型可复用程序知识。最终评测使用相同任务实例，摘要未说明相对于搜索过程可能产生的数据/任务泄漏控制。

Abstract: Agent skills turn procedural knowledge into reusable artifacts, allowing LLM agents to accumulate and refine expertise through experience. Building on this, skill evolution iteratively improves skills using execution feedback. However, improvement may require several interdependent edits, so low-reward versions can still be worth developing. Requiring immediate reward gains can discard useful partial repairs before their benefits emerge. Non-elitist evolution allows new versions to receive further edits despite scoring below earlier ones. For agent skills, this calls for evidence of what to preserve and repair next. We introduce SkillNEO (Non-Elitist Evolutionary Optimization for Agent Skills), which separately selects a version to use and versions to keep improving. Comparing how related versions perform the same task reveals working steps to preserve and remaining failures to fix. It can also revisit and revise earlier versions using later evidence. Across 86 SkillsBench tasks in eight domains, including software engineering and office work, SkillNEO raises GPT-5.4 Mini’s average reward from 49.1% to 66.4%, within GPT-5.5 and GPT-5.6 Luna’s original-skill range. Mini executes tasks, proposes revisions, and edits skills; final evaluation uses the same task instances. Gains span all eight domains. The same skills improve stronger models without further editing. On the 41 tasks with modified skills, reuse improves Luna by 10.5 percentage points and places GPT-5.5 10.6 points above its published original-skill reference. Execution records show these skills can benefit stronger models even when Mini still fails some task requirements. Search histories also show lower-scoring versions leading to skills ultimately selected for use. Together, these findings show that skill evolution can turn a weaker model’s partial progress into reusable procedural knowledge for improving more capable agents.

[127] Athanor: An Agent-Native System for Autonomous Post-Training Research cs.AI | cs.CL | cs.LG | cs.MAPDF

Yufa Zhou, Yichen Wang, Jiakun Fan, Ziqi Shu, Zhichao Liu

TL;DR: Athanor构建在真实GPU上运行的智能体自主后训练研究系统，让前沿智能体自行选择数据、编写训练算法、调参并分析结果，同时以隔离环境、冻结评估和隐藏留出集约束实验。

Details

Motivation: 完整递归自我改进较难当下量化，作者转而研究较弱但可测的任务：前沿智能体能否用公开数据自主后训练小型原始基座模型，作为其研究能力测试。

Result: Athanor为智能体提供研究自主权、低摩擦工程工具和高效起步代码；智能体自行读取数据与评测、构建训练集、修改算法、调参并决定下一步。系统在沙箱中运行，不允许使用外部教师模型；平台提供冻结评测、托管作业、去污染数据、持久实验记录及智能体未知的留出套件。104小时实验中，四个Claude Opus 5.5智能体各使用一个8-GPU节点、未获人工研究建议，将Qwen3-4B-Base六任务开发套件分数从15.9提高到67.3，留出套件从9.2提高到48.2；官方Qwen3-4B-Instruct-2507对应为66.5和47.9。作者称这是智能体团队自主将原始基座后训练为跨域通用模型、平均表现匹配或超过官方指令模型的首个演示。实验记录显示方法主要重组已知技术和相互模型，包括公开推理数据SFT、一种智能体提出的rollout修改RL、跨智能体模型合并及自蒸馏。

Insight: 该结果展示的是受控104小时活动中智能体团队进行数据、代码及实验工程的自主能力，并非发现全新算法的证据；系统服务、去污染和隐藏评测对结论至关重要。比较的分数来自所述六任务开发与留出套件，摘要未给各任务表现和额外算力成本。

Abstract: Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can be measured today: frontier agents post-training a small raw base model with public data, as a test of their research potential. We build Athanor, an open agent-native system for autonomous post-training research (AutoPostTrain) on real GPUs. We give the agents full research autonomy, low-friction engineering tools, and efficient starter code. The agents carry out the research themselves: they read datasets and evaluation results, build their training data, write and modify training algorithms, tune hyperparameters, and analyze the results to decide what to try next. They work in a sandbox and cannot use external teacher models. Athanor’s services supply frozen evaluation, managed jobs, decontaminated data, a persistent research record, and a held-out suite the agents are unaware of. In a 104-hour campaign, a team of four Claude Opus 5.5 agents, each on an eight-GPU node and given no research advice, improves Qwen3-4B-Base from 15.9 to 67.3 on a six-task development suite and from 9.2 to 48.2 on a held-out suite, against 66.5 and 47.9 for the official Qwen3-4B-Instruct-2507. To our knowledge, this is the first demonstration that a team of frontier agents can autonomously post-train a raw base model into a cross-domain generalist model that matches or surpasses the official instruct version on average. The campaign’s full record shows that the agents reach this level by recombining known methods and each other’s models: SFT on public reasoning data, RL with a rollout change one agent introduced, weight merges across agents, and rounds of self-distillation. With execution handled, today’s agents already have the engineering and research ability to conquer this task. We hope Athanor provides a foundation for scaling autonomous AI research.

[128] MemComposer: Learning to Assemble Memories for LLM Agents via Reinforcement Learning cs.AI | cs.CLPDF

Yixuan Xie, Xueqiang Xu, Xinyi Fan, Xinxi Lyu, Tao Feng

TL;DR: MemComposer联合考察当前查询和已检索记忆，学习选择哪些经验、保留多少及如何排序，并用完整智能体交互的任务成功反馈优化记忆组合策略。

Details

Motivation: 外部记忆使LLM智能体能复用历史经验，但语义相似不代表有用；下游表现还取决于检索到的记忆如何筛选和组织。

Result: MemComposer是记忆编排器，依据当前问题与检索候选联合决定纳入哪些经验、选择数量和排序。作者提出基于GRPO的Experience Policy Optimization（ExPO），通过完整智能体交互评估组装后的记忆上下文，并用任务成功反馈优化策略。在三个τ²-bench领域和两个冻结执行器上，MemComposer均超过各执行器最强基线，平均记忆令牌使用分别减少16.9%和4.9%。策略还能迁移到未见领域、执行器和记忆库，并可直接利用更强模型生成的记忆而无需再训练。

Insight: 检索之后的选择、数量和顺序会影响记忆实际效用，适合依据下游任务结果联合学习。两个执行器的令牌节省幅度不同，摘要未提供任务成功率绝对值及不同记忆库规模的结果。

Abstract: Agent memory enables large language model (LLM) agents to reuse past experiences without updating their parameters. However, semantic similarity alone does not guarantee memory usefulness: downstream performance depends on how memories are selected and presented to the agent. We propose MemComposer, a memory composer that jointly examines the current query and retrieved candidates to decide which experiences to include, how many to select, and how to order them. We train the composer using Experience Policy Optimization (ExPO), a GRPO-based framework that evaluates assembled memory contexts through complete agent interactions and uses task-success feedback to optimize the assembly policy. Across three $τ^2$-bench domains with two frozen executors, MemComposer outperforms the strongest baseline for each executor while reducing average memory-token usage by 16.9% and 4.9%, respectively. The learned policy also transfers to unseen domains, executors, and memory banks, and benefits from memories generated by stronger models without further training. These results demonstrate the value of learning query-specific memory assembly using downstream task feedback.

[129] Entertain, then Cancel: How Thinking Makes Reasoning Models Read Some and Or Literally cs.AI | cs.CLPDF

Zhizhuo Kou, Jian Yang, Pengfei Hao, Junyu Luo, Jingshu Peng

TL;DR: 该研究发现延长推理会改变模型对“some”和“or”等日常表达的语用解释：多数受测推理模型在后续步骤中撤销“不是全部”和“非两者兼有”的含意。

Details

Motivation: 模型允许用户决定思考多长时间，但额外推理如何影响日常语言含意尚不清楚；例如“有些学生通过”通常暗示并非全部通过，逻辑字面含义与会话语用推断可能不同。

Result: 研究固定模型权重，只改变思考时长并记录解释；另一种工具在不同推理轨迹位置截断模型，再要求作答，以定位解释变化时点。大多数受测开放推理模型及GPT-5会把“some”和“or”读作逻辑字面含义，撤销“非全部”及“非两者兼有”等语用含意；与此同时，受上下文驱动的间接回答推断会改善。轨迹显示模型先产生丰富语用解读，随后在推理中将其撤销。探索性地从早期丰富解读直接作答，可恢复这些含意且未损害字面准确率。

Insight: 更长推理不一定单调提升语言理解；模型可能先生成符合语用的解释、后续又因逻辑推理将其覆盖。评估应同时测解释过程和最终答案，并区分语用含意与逻辑字面正确性；摘要未给任务规模及早停策略泛化结果。

Abstract: When a speaker says ``some students passed’’, listeners infer that not all of them did. Reasoning models now let users decide how long a model thinks before it answers, but we do not know what extra thinking does to such everyday inferences. We study this directly: we keep a model’s weights fixed, change only how much it thinks, and record which reading it chooses. A second tool cuts the model’s own reasoning at successive points and asks for an answer, showing where the reading changes. Thinking makes models read logical words as logic: it cancels the implicatures of \emph{some} (\emph{not all}) and \emph{or} (\emph{not both}) in most tested open reasoning models and in GPT-5, while context-driven inferences such as indirect answers improve. The trace shows why: models first entertain the enriched reading and cancel it later. Answering from that early reading, an exploratory inference-time remedy, recovers these implicatures without losing literal accuracy. Evaluations of reasoning models should measure how they interpret, not only how accurate they are.

[130] Bias Control and Injection for Multi-Agent Aggregation cs.AI | cs.CL | cs.MAPDF

Sungjae Lee, Soheil Abbasloo, Jabin Koo, Jungseul Ok

TL;DR: 该框架在多智能体答案聚合中先归一化不同答案的推理风格以控制多数压力等偏差，再通过把每个聚合者自己的初选答案置于少数派来诱发不稳定性并估计可靠性。

Details

Motivation: 多智能体推理中意见冲突时需决定信任哪位智能体，但多数压力和回答风格偏好等非语义偏差会掩盖推理质量。

Result: 分析显示偏差既可被控制以改善初始答案选择，也可通过注入来诱发决策不稳定，作为可靠性信号。无需验证集或事先知道模型强弱的测试时聚合框架通过两种机制实现：对每种不同答案提供一条风格归一化推理轨迹；再让每个聚合智能体最初选择的答案处于少数派，以注入多数压力。在三个数学推理基准、四种异质LLM组合中，作者报告其平均准确率和令牌效率均优于其它非oracle聚合方法；用于多智能体辩论和Mixture-of-Agents时，也提高最终答案准确率而不改动原有交互或合成流程。

Insight: 意见聚合需区分语义证据和社会/表达偏差，并可把模型对压力的稳定程度用于可靠性判断。摘要未给基准名称、准确率/令牌增益及偏差注入失败案例，结论为跨所测设置的平均结果。

Abstract: Multi-agent reasoning with large language models (LLMs) raises a central question for collective decision-making: when agents disagree, whose decision should be trusted? Resolving such disagreements is difficult because agents’ decisions are susceptible to non-semantic biases such as majority pressure and response-style preferences, which can obscure the quality of the underlying reasoning. Our analysis shows how bias can be both mitigated and exploited: bias control improves initial answer selection, while bias injection elicits decision instability that serves as a reliability signal. Building on these findings, we introduce a test-time aggregation framework that requires neither validation data nor prior knowledge of relative model strength. The framework implements bias control by presenting one style-normalized reasoning trace per distinct answer, and bias injection by placing each aggregating agent’s initially selected answer in the minority. Overall, our framework achieves higher average accuracy and better token efficiency than competing non-oracle aggregation methods across three mathematical reasoning benchmarks and four heterogeneous LLM combinations. It also improves final-answer accuracy when applied to multi-agent debate and Mixture-of-Agents, without modifying their interaction or synthesis processes.

[131] DocPilot: Interactive Agent Orchestration and Training for Long Visual Document Understanding cs.AI | cs.CL | cs.CVPDF

Zhuowen Liang, Xiaotian Lin, Yuyu Luo, Haixun Wang, Nan Tang

TL;DR: DocPilot通过页面导航、细粒度证据定位、局部视觉检查、代码数值推理和跨模态推理协同处理长视觉文档，并以课程式智能体训练将这些能力教给小语言模型。

Details

Motivation: 长文档问答需要跨页寻找稀疏证据、理解异构内容并综合推理；单次VLM处理可能遗漏证据，既有文档智能体的预设流程和粗粒度操作也限制适应性。

Result: DocPilot提供可表达编排，先导航到相关页面并定位局部证据，再整合视觉检查、基于代码的数值计算和跨模态推理。为迁移到小模型，作者设计课程式智能体训练，从单能力学习逐步过渡到自适应编排，使用以数据为依据的推理轨迹和可执行交互轨迹监督。在MMLongBench-Doc、DocBench、FinRAGBench-V及MADQA上，前沿VLM骨干下取得强增益；DocPilot-4B相较显著更大的模型表现有竞争力，摘要称其在多种长文档推理设置中具有有效性和泛化能力。

Insight: 长文档任务需要分层取证和多工具协作，不宜把全部内容压成一次性输入；课程化轨迹训练可把编排能力迁移到小模型。摘要未提供各基准具体分数、模型名单、训练数据规模和工具调用成本。

Abstract: Multimodal long-document question answering requires models to seek sparse evidence across pages and modalities, understand heterogeneous document content, and reason over the collected evidence. Even advanced vision-language models (VLMs) can overlook sparse evidence and struggle with cross-modal reasoning in a single pass. Existing document agents further introduce multi-step interaction, but some still rely on predefined workflows or coarse-grained actions, limiting the flexibility and granularity of document reasoning. We introduce DocPilot, an agentic document framework that supports expressive orchestration and makes complex document solving learnable by small language models (SLMs). DocPilot orchestrates evidence seeking through page-level navigation and fine-grained evidence localization, and integrates local visual inspection, code-based numerical reasoning, and cross-modal reasoning for multimodal understanding. To transfer these capabilities to small models, we propose curriculum-based agentic training that progresses from single-ability learning to adaptive orchestration through supervision from data-grounded reasoning traces and executable interaction trajectories. Across MMLongBench-Doc, DocBench, FinRAGBench-V, and MADQA, DocPilot achieves strong gains with frontier VLM backbones, while DocPilot-4B delivers competitive performance against substantially larger models, demonstrating strong effectiveness and generalization across diverse long-document reasoning settings. The code is available at https://github.com/HKUSTDial/DocPilot.

[132] Temporal Specification Guidance for Text-to-Video Generation cs.AI | cs.CVPDF

Avishree Khare, Hideki Okamoto, Bardh Hoxha, Georgios Fainekos, Rajeev Alur

TL;DR: TSG将文本到视频的事件顺序、时间和持续性要求写成时序逻辑规格，并在采样期间依据可微规格满足度梯度引导去噪。

Details

Motivation: 文本到视频模型常生成了提示提及的视觉概念，却未满足它们应按何顺序出现、何时发生及持续多久等时间关系。

Result: 免训练推理期框架Temporal Specification Guidance把时间规格转化为可执行目标，并依据视觉概念证据轨迹的可微定量语义评分，使用得分梯度构造规格引导的去噪方向。实现使用视频—文本注意力轨迹、度量时序逻辑的可微评分及梯度导出的注意力偏置，无需外部概念分类器，也不需对视频Transformer反向传播；注意力引导前向过程为分类器自由引导补充方向。在覆盖11类时间约束的220条提示基准上，该实现相较CFG在五种模型上的规格满足准确率提高9.5至20个百分点，额外内存开销很小。

Insight: 显式时序规格为视频生成提供可组合的控制接口，比只检查概念是否出现更能约束事件顺序与持续时间。提升范围对应五种模型及特定220提示基准，摘要未给各类约束分项表现。

Abstract: Text-to-video models often generate the visual concepts requested in natural language prompts but fail to satisfy their intended ordering, timing, and persistence requirements. We propose representing these requirements as specifications in a formal Temporal Logic, and introduce Temporal Specification Guidance (TSG), a training-free inference-time framework that turns temporal specifications into executable objectives for guiding video generation during sampling. TSG scores traces of visual concept evidence using differentiable quantitative semantics and uses the score’s gradients to construct a specification-guided denoising direction. We instantiate this framework with video-text attention traces, efficient differentiable scores for Metric Temporal Logic, and gradient-derived attention biases. This instantiation requires neither an external concept classifier nor backpropagation through the video transformer. Its attention-steered forward pass yields a denoising direction that augments classifier-free guidance (CFG). On a benchmark of 220 prompts spanning 11 categories of temporal constraints, including ordered object entry and state transitions, this instantiation improves specification satisfaction accuracy over CFG by 9.5-20 percentage points across five models, with minimal memory overhead. These results demonstrate the potential of temporal specifications and differentiable satisfaction objectives as a flexible interface for controlling video generation.

[133] Do Agents Need a New Kind of Paper? SPRA: Structured Paper Representation for Agents cs.AI | cs.CLPDF

Yutong Leng, Haojiong Chen, Fukai Shang, Xiaoyang Wang, Mindong Liu

TL;DR: SPRA把论文表示为持久研究对象及其类型化关系，支持研究对象查询、遍历和复用，并以Schema-RAG评估结构化表示对科学问答和跨论文推理的作用。

Details

Motivation: 科研智能体需连接分散在叙述文章中的问题、方法和发现；普通段落检索难以显式追踪研究对象、组件使用及论文之间的比较关系。

Result: SPRA面向实证AI论文，将内容组织为Problem、Contribution、Component、ExperimentSetup、Measure和Finding，并记录部分论文间引用关系中的依赖、组件应用及比较，附原文位置供核验。资源覆盖超过百万篇AI论文，包含1,995万研究单元和2,407万内部关系。通过证据在推理前固定的Schema-RAG评估，七个子领域中，基于来源的科学问答较段落检索提高0.381/5，平均比Full Compact低0.078/5；定向跨论文推理较段落检索的限定性提高0.184/5；Top-5综合质量效果混合。包含Top-5的RQ2配对任务中，相较段落检索输入输出令牌减少28.5%，相较Full Compact减少95.3%。构想生成Overall分数较Full Compact低0.067，但令牌减少93.7%。

Insight: 结构化论文对象与来源位置可提升可追溯的跨论文关系检索，并显著减少上下文令牌；不同任务质量变化不完全一致，Top-5综合效果混合且构想生成略降。摘要未给结构抽取准确率及各子领域分项分数，资源依赖SciVerse平台。

Abstract: Scientific agents must connect research problems, methods, and findings dispersed through narrative articles. We introduce SPRA (Structured Paper Representation for Agents), a paper-level representation of persistent research objects and typed relations. Its empirical-AI profile organizes Problems, Contributions, Components, ExperimentSetups, Measures, and Findings for querying, traversal, and reuse. Selected paper-level citation relations record dependencies, component use, and comparisons with prior work; source locations support verification. We instantiate SPRA across more than one million AI papers, with 19.95 million research units and 24.07 million internal relations. Evaluations access SPRA through Schema-RAG with task evidence fixed before inference. Across seven subfields, SPRA improves source-conditioned scientific QA by 0.381/5 over passage retrieval while remaining close to Full Compact (0.078/5 lower on average). In directed cross-paper reasoning, qualification improves by 0.184/5 over passage retrieval; Top-5 synthesis shows mixed quality effects. Across all paired RQ2 tasks, including Top-5, input+output tokens decrease by 28.5% relative to passage retrieval and 95.3% relative to Full Compact. In idea generation, a 0.067-point lower Overall score than Full Compact accompanies 93.7% fewer input+output tokens. Together, these results support SPRA as a usable representation of scientific content and a foundation for research workflows that connect, inspect, and reuse paper-level research objects. The SPRA resource is accessible through the SciVerse scholarly-data platform.

Robert Moseley, Md Kaykobad Reza, Ameya Patil, Edward Ayrapetian, Salman Asif

TL;DR: MSP通过代理文本描述作为语义桥梁，在缺少成对非文本跨模态数据时训练多模态模型，并在测试时组合训练未见过的真实模态。

Details

Motivation: 大型多模态模型依赖昂贵且难扩展的成对多模态数据，数据规模和模态组合覆盖逐渐成为进一步发展的瓶颈。

Result: MSP不再需要真实成对非文本监督（如音频—视觉配对），但仍依赖模态—文本配对数据、预训练对比编码器及模态分布桥接校准。它缓解而非完全消除跨模态数据需求。

Insight: 用文字代理桥接未见模态可扩展组合监督，但代理文本质量和桥接校准仍是必要条件。摘要未列基准名称及数值，不能量化与真实配对训练的差距。

Abstract: Large multimodal models have achieved remarkable progress by scaling model capacity and training on massive paired multimodal data. However, this paradigm introduces a fundamental bottleneck: aligned multimodal datasets are expensive to curate, difficult to scale across diverse modality combinations, and increasingly constrain further progress. We introduce Modality Self-Play (MSP), a training framework for multimodal foundation models based on proxy-mediated modality composition. Instead of relying on paired cross-modal data, MSP uses anchor-supporting proxy textual descriptions of unseen modalities as semantic bridges during training. Given an observed modality (e.g., image or audio), the model generates proxy descriptions for complementary unseen modalities, which are then encoded and aligned with the observed modality through learned bridges, enabling cross-modal interaction without real paired non-text supervision. Our central hypothesis is that proxy text, combined with contrastively trained pretrained encoders, provides sufficient semantic structure for multimodal composition to emerge. We show that MSP enables zero-shot modality composition: models trained only with a real anchor modality and accompanying proxy descriptions can integrate and reason over multiple modalities at inference time despite never observing real paired non-text data during training. Empirically, MSP achieves state-of-the-art or competitive performance on multiple multimodal benchmarks. Ablation studies further demonstrate that learned bridges improve alignment, while anchor-supporting proxy descriptions enable effective cross-modal composition. MSP removes the need for real paired non-text (e.g., audio-vision) supervision, while continuing to rely on modality-text pairs, pretrained contrastive encoders, and modality-distribution bridge calibration.

[135] Mallea: Building, Steering, and Memorizing Worlds with Coding Agent cs.AI | cs.CVPDF

Xuanyi Liu, Ruiqi Li, Siwei Ma

TL;DR: Mallea用编码智能体从文本构建显式状态与可执行规则世界，统一规划对象结构、行为、用户干预和对象外观记忆。

Details

Motivation: 代码世界模型用明确状态及可执行规则表示世界动力学，研究关注如何协调对象表示、行为修改和视觉记忆，使用户在状态变化时仍能获得连贯观察。

Result: Mallea从文本推断对象交互需求，并联合规划对象结构、属性和规则，优先选择满足需求的紧凑表示。世界按规划规则演化，可选用户动作控制演化；文本指令还能编辑属性或扩展能力，同时保留未受影响状态。对象纹理记忆仅针对白盒定义对象保留可复用外观，并随对象变化更新；程序推进世界状态，生成式渲染器结合当前结构和记忆外观生成观察。摘要介绍系统的构造、操控和记忆机制，但未提供量化评测结果。

Insight: 将规则执行与生成式外观记忆分开，可在保持可编辑状态的同时复用对象纹理，并让后续观察与最新世界状态一致。摘要未报告基准、用户研究或状态一致性量化结果，当前属于系统方法描述。

Abstract: Code world models represent world dynamics through explicit state and executable rules. We investigate how to coordinate object representations, behavioral revisions, and visual memory within this formulation. We present Mallea, a system for building, steering, and memorizing worlds from text. A coding agent infers object interaction requirements from the prompt and jointly plans object structure, properties, and rules, favoring compact representations that support those requirements. The world evolves under the planned rules; optional user actions steer it, while text requests can edit properties or extend capabilities with unaffected state preserved. Object texture memory retains reusable appearance only for whitebox-defined objects and adapts it as those objects change. The program advances world state, while a generative renderer combines current structure with remembered appearance. By organizing construction, intervention, and memory around the same objects, Mallea conditions subsequent observations on the latest state and compatible appearance. Project page: https://lxycopper.github.io/Mallea.

[136] DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents cs.AI | cs.CL | cs.LG | cs.ROPDF

Yufeng Peng, Yixin Zhang, Ziyi Liu, Zhikun Xu, Jiarong Yang

TL;DR: DeciCAD提供领域原生CAD智能体harness，以语义操作、决策导向观察、环境反馈和持久状态定义行动空间，再通过轨迹监督SFT和几何感知在线RL训练策略。

Details

Motivation: LLM智能体的闭环策略受harness定义的决策空间影响；CAD含持久状态、几何约束和长流程任务，通用代码harness可能不适合此专业领域。

Result: DeciCAD将交互抽象为语义CAD动作、决策导向观察、环境反馈及持久状态转移。学习流程从交互轨迹提取因果决策监督，依次采用SFT和几何落地在线RL。在四个CAD基准上，该方法达到最高F1和IoU，相较通用代码harness将模型输出令牌减少45%至88%。同监督条件下，SFT策略F1从0.6883升至0.7437并超过代码策略；后续在线RL将几何可用性从66.5%升至73.5%，F1进一步达到0.7880。

Insight: 专业harness不仅影响调用效率，也改变模型学到的决策策略；显式几何反馈和领域动作接口能减少长文本输出并改善设计结果。摘要未给四个基准名称、各指标定义及在线RL计算成本。

Abstract: Large Language Model agents operate through closed-loop action policies whose decision space is defined by an agent harness. We investigate how this operating space shapes agent behavior and policy learning in computer-aided design (CAD), a professional domain characterized by persistent state, geometric constraints, and long-horizon procedures. We instantiate this perspective in DeciCAD, a domain-native harness that exposes semantic CAD actions, decision-oriented observations, environment feedback, and persistent state transitions. Building on this harness, we develop a learning pipeline that extracts causal decision supervision from interaction trajectories and improves the policy through supervised fine-tuning (SFT) and geometry-grounded online reinforcement learning (RL). Across four CAD benchmarks, DeciCAD achieves the best F1 and intersection over union (IoU) while reducing model-output tokens by 45–88% relative to a general-purpose coding harness. Under matched supervision, its SFT policy improves F1 from 0.6883 to 0.7437 and outperforms the coding policy; subsequent online RL further raises geometry availability from 66.5% to 73.5% and F1 to 0.7880. These results demonstrate that the decision space induced by a harness materially affects both agent execution and policy learning in CAD.

[137] HTN-Orchestrate: A Hierarchical Task Network Framework for Multi-Agent Orchestration cs.AI | cs.CLPDF

Yanchen Deng, Jianguo Huang, Yao Long Teng, Yixuan Li, Handuo Zhang

TL;DR: HTN-Orchestrate采用两层层级任务网络，规划器维护子任务依赖并延迟分解，局部编排器再调度工作者执行叶节点任务。

Details

Motivation: 复杂多智能体任务需协调局部执行与全局规划；动态派发灵活但未显式建模层级和依赖，预定义流程虽有结构，却在执行前固定分解。

Result: HTN-Orchestrate把Planner与局部Orchestrator分开：Planner维护子任务层级/依赖，并在前置结果可用后再分解；局部编排器负责工作者执行叶子子任务。结果按AND语义逐级向上传播，累计发现若当前分解仍无法解决任务，则重建任务网络。在五个覆盖网络研究、科学推理和研究流程的基准上，使用相同基础模型时，方法超过ReAct、Agent Team和DeepSeek Harness；BrowseComp准确率为89.73%，SUPERChem为73.44%，分别较Agent Team高2.45和4.69个百分点。

Insight: 延迟分解允许计划依据新结果调整，同时显式保留任务依赖；AND聚合确保所有前置工作完成后才认为上层子目标完成。摘要未列五个基准中其余任务成绩、工作者规模及执行成本。

Abstract: Orchestrating multiple agents on a complex task requires reconciling local subtask execution with global task planning. Dynamic dispatch approaches provide execution flexibility but do not explicitly model subtask hierarchies or dependencies, while predefined workflows impose this structure but fix the decomposition before execution begins. Therefore, we introduce HTN-Orchestrate, a two-layer framework that separates these responsibilities through a hierarchical task network (HTN). The Planner maintains subtask hierarchies and dependencies, deferring decomposition until prerequisite results become available, while local Orchestrators schedule workers to execute each leaf subtask. Results propagate upward under \textbf{AND} semantics, and accumulated findings inform a rebuilt task network when the current decomposition cannot resolve the task. On five benchmarks spanning web research, scientific reasoning, and research workflows, HTN-Orchestrate outperforms ReAct, Agent Team, and DeepSeek Harness using the same base model, achieving 89.73% accuracy on BrowseComp and 73.44% on SUPERChem, exceeding Agent Team by 2.45 and 4.69 percentage points, respectively.

[138] MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering cs.AI | cs.CL | cs.LGPDF

Shangheng Du, Jinxin Shi, Shuaiyu Zhang, Yiming Wu, Junpeng Zhao

TL;DR: MLExpert以Kaggle-MLE Factory和层级智能体SFT/RL训练35B混合专家模型，使智能体自主进行机器学习实验设计、执行、分析和迭代。

Details

Motivation: 自主AI研发需处理长时程实验规划；每次实验结果都由多个先前决策共同影响，因此训练需要从长轨迹中筛选有效监督并利用中间结果。

Result: 作者构建可执行任务和交互harness，并提出层级智能体SFT，将通用工具使用与代码能力迁移至机器学习工程。Windowed Interaction RL将连续两次实验结果之间的多轮决策作为执行窗口，共享结果级奖励，并用异步采集及策略校正支持轨迹结束前更新。训练的35B混合专家模型MLExpert在MLE-Bench Lite上将基座平均奖牌率从37.9%升至72.7%，表现与更大前沿模型Kimi-K3及GLM-5.3相当。研究还报告在NatureBench Lite、智能体脚手架优化和算法优化上有所改善，显示能力可迁移到其它任务。

Insight: 将实验结果归因到相邻评估之间的决策窗口，可支持长流程工程任务的在线策略学习；基准奖牌率提高说明自动化实验能力增强。摘要未给GPU资源、任务分项结果和相较前沿模型的具体数值，跨任务迁移仅作定性报告。

Abstract: Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI). Workflow-driven machine learning engineering (MLE) systems provide a practical path toward this pursuit through complex orchestration that manages long-horizon experimentation, while recent MLE systems adopt model-directed interaction, allowing models to autonomously organize experiments and adapt optimization strategies based on execution feedback. However, feedback from each experiment reflects several preceding decisions, and a long MLE run contains many such costly experiments. Training must therefore select useful supervision from long interaction trajectories and learn from intermediate outcomes. We propose a post-training method for autonomous long-horizon MLE optimization and apply it to train MLExpert, a 35B Mixture-of-Experts agentic model. We design the Kaggle-MLE Factory to construct executable tasks and an interaction harness for model-directed experimentation. Hierarchical agentic SFT transfers general tool-use and coding capabilities to MLE through outcome-guided supervision. Windowed Interaction RL (WIRL) treats the multi-turn decisions between successive experiment results as an execution window and assigns it a shared outcome-based reward. Asynchronous collection and policy correction support policy updates before the trajectory ends. On MLE-Bench Lite, MLExpert improves the average medal rate of the base model from 37.9% to 72.7%, achieving performance comparable to larger frontier models such as Kimi-K3 and GLM-5.3. Further experiments show that MLExpert improves performance on NatureBench Lite, agent scaffold optimization, and algorithm optimization, suggesting that the learned optimization capability generalizes to other tasks.

cs.CR [Back]

[139] CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data cs.CR | cs.AI | cs.CLPDF

Aisvarya Adeseye, Adeyemi Adeseye, Mohammad Tahir, Jouni Isoaho

TL;DR: CARE-SD把上下文自适应、分层自我披露判断、解释一致性检查和跨批次协调整合为本地小模型分析架构，面向网络安全访谈的敏感文本。

Details

Motivation: 网络安全访谈能揭示技术评估未覆盖的安全经历、行为和隐私顾虑，但自我披露判断依赖上下文、类别可能重叠，自动解释也可能加入文本不支持的事实；本地小模型更保护隐私，却难靠简单提示完成可靠推理。

Result: CARE-SD由四个模块组成：上下文自适应处理、层级披露推理、解释一致性验证和跨批次协调。作者使用82份来自五个组织行业、经独立标注的网络安全访谈评测Llama 1B、Qwen 1.5B和Llama 3B，并与传统分类器、三种提示策略及8B—32B大模型比较；两名独立审核者评估标签、事实陈述和解释正确性。CARE-SD提升小模型准确率及证据可靠性：Llama 3B Macro-F1从0.80提高至0.88，缺乏支持的陈述减少60%；3B模型在类别Macro-F1上达到20B参考模型水平。

Insight: 本地小模型可通过层级推理和解释核验处理隐私敏感访谈，减少向外部服务传输数据及无依据陈述。评测仅82份访谈，摘要未给各行业分项结果和标签分布；与20B模型相当仅针对类别Macro-F1。

Abstract: Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical assessments. Consequently, identifying genuine self-disclosures is challenging because statements are context-dependent, categories overlap, and automated interpretations may introduce unsupported claims. Locally deployed Small Language Models (SLMs) protect sensitive participant data by keeping processing within controlled environments, but their limited reasoning capabilities make simple prompting insufficient for context-aware and factually reliable analysis. This study developed CARE-SD (Context-Adaptive Reasoning and Explanation for Self-Disclosure), a novel four-module architecture integrating context-adaptive processing, hierarchical disclosure reasoning, explanation-consistency verification, and cross-batch reconciliation. We evaluated three local SLMs, including Llama 1B, Qwen 1.5B, and Llama 3B, using 82 independently annotated cybersecurity interviews across five organizational sectors. Comparisons included conventional classifiers, three prompting strategies, larger 8B–32B models, and architectural ablations. Two independent reviewers assessed disclosure labels, factual claims, and explanation correctness. CARE-SD improved the accuracy and evidence reliability of SLMs, increasing Llama 3B Macro-F1 from 0.80 to 0.88 while reducing unsupported claims by 60%. Remarkably, the 3B model matched the 20B reference model in category Macro-F1, demonstrating the effectiveness of the architecture without requiring a larger model.

[140] Language Is a Security Surface for Agent Guards cs.CR | cs.AI | cs.CL | cs.LGPDF

Hasan Demirkiran, Jens Ernstberger

TL;DR: LinguaGuardBench通过只翻译用户指令、固定所有工具调用与轨迹标签，测量安全防护器对请求语言变化的敏感性。

Details

Motivation: 安全防护器在每次工具调用前根据用户请求和轨迹判断行为安全，但提示和训练评测通常只用英语，无法判断语言本身是否改变防护结论。

Result: 基准从TS-Bench AgentDojo-Traj的1,220个标注步骤构建，将用户指令翻译为德语、法语、土耳其语、斯瓦希里语和阿姆哈拉语，所有工具调用、观察和标签保持字节级不变；还用六种英语改写及空格placebo作控制，并对托管防护器重复运行三次估计噪声。19个防护器涵盖前沿API、4B开源模型和专用智能体防护器。多数小型开放模型及专用防护器在翻译后判定变化超过自身噪声，且语言越稀有影响越大：13B以下九个防护器中，经placebo校正的翻转率从法语+1.5个百分点升至阿姆哈拉语+4.4点。12B—30B开源防护器更易误拦良性步骤，假阳性最高增加5.0点；所有显著召回下降均出现在10B以下模型，最高下降7.4点。前沿防护器变化约不超过1点，最强Gemini 3.8 Flash对是否附请求文本给出完全相同判定。影响集中在少数指令；事后分析发现智能体推理重述英语请求的步骤更易受影响。

Insight: 请求语言是安全系统的攻击/失效面；仅翻译指令而固定轨迹可将差异归因于语言通道。模型规模与损害方向相关但不代表因果，且不少影响集中于少数实例；该基准是语言敏感性评测，不直接衡量所有真实多语部署风险。

Abstract: Step-level guards decide, before each tool call, whether an agent’s next action is safe given the user’s request and the trajectory so far. Users write those requests in many languages, while guard prompts and the benchmarks on which purpose-built guards are trained and evaluated are English. We ask whether a guard’s verdict depends on the language of the request. We build LinguaGuardBench from the 1,220 labelled steps of TS-Bench AgentDojo-Traj: we translate only the user instruction into German, French, Turkish, Swahili and Amharic, and keep every tool call, observation and label byte-identical, so any change in a verdict is attributable to language alone. Six English rewordings and a whitespace placebo serve as controls, and managed guards are run three times to measure their noise. Across 19 guards, from frontier APIs to 4B open models and four purpose-built agent guards, most open, small and purpose-built guards change verdicts under translation beyond their own noise floor, and the effect grows with the rarity of the language: among the nine guards below 13B parameters, the mean placebo-adjusted flip rate rises from +1.5 pp on French to +4.4 pp on Amharic. Purpose-built guards are the most sensitive. The direction of the damage tends to follow guard size: open guards of 12-30B parameters block more benign steps (up to +5.0 pp false positives), and every significant loss of recall is in a guard below 10B (up to -7.4 pp). Frontier guards shift by at most about one point; the strongest, Gemini 3.8 Flash, returns identical verdicts with and without the request. The damage is concentrated in a few instructions and, in a post-hoc analysis, falls on steps where the agent’s reasoning restates the English request, consistent with guards reacting to inconsistency between channels. English paraphrase moves every guard less than translation does. We release the benchmark and all 489k verdicts.

cs.GR [Back]

[141] ResStreamGS: Residual-Sensitive Dual-Stream Gaussian Splatting for Mobile Volumetric Video Streaming cs.GR | cs.CVPDF

Haoran Liu, Di Wu, Wang Luo, Hengyuan Na, Miao Hu

TL;DR: ResStreamGS按高斯基元时间稳定性拆分传输流：稳定高斯每个GOP只发一次，残差敏感基元继续使用逐帧硬件解码视频流。

Details

Motivation: 移动体积视频需在带宽和计算受限下流式传输高质量3D内容；现有3DGS视频编码把所有高斯都当作逐帧变化信号，不适合大场景中大量时间稳定区域，可能造成画质下降和无效传输。

Result: ResStreamGS用轻量探测适配识别残差敏感基元，并在每个GOP内复用稳定高斯；稳定部分每个GOP仅发送一次，只有残差敏感部分保留在逐帧硬件可解码视频流。复杂全场景体积视频实验中，后编码PSNR较受控V³式全高斯基线提高7.51至8.35 dB，摊销传输负载最多减少56.5%，在Qualcomm Snapdragon 778G上达到30.883 FPS。

Insight: 依据时间稳定性对高斯分类可减少重复发送静态场景部分，同时保留动态细节的逐帧更新。结果来自复杂全场景视频和指定移动平台；摘要未报告带宽、具体场景及视觉感知指标。

Abstract: Real-time mobile volumetric video enables immersive free-viewpoint experiences, but delivering high-quality 3D content under constrained bandwidth and computation remains challenging. Recent 3D Gaussian Splatting (3DGS) systems, such as V$^3$, enable efficient mobile streaming by encoding time-varying Gaussian attributes with commodity video codecs and hardware decoding. However, existing pipelines treat all Gaussians as frame-varying signals, which is poorly suited to full-scene content where large portions remain temporally stable. Our empirical study shows that frame-wise adaptation and video coding of all Gaussians cause quality degradation in complex full-scene content, particularly in temporally stable regions. To address this issue, we propose ResStreamGS, a residual-sensitive dual-stream framework that processes Gaussians according to their temporal behavior. ResStreamGS identifies residual-sensitive primitives through lightweight probe adaptation and reuses stable Gaussians within each Group of Pictures (GOP). Stable Gaussians are transmitted once per GOP, while only residual-sensitive Gaussians remain in the frame-wise hardware-decodable video stream. Experiments on complex full-scene volumetric videos show that ResStreamGS improves post-codec PSNR by 7.51–8.35~~dB over a controlled V$^3$-style all-Gaussians baseline, reduces amortized payload by up to 56.5%, and achieves 30.883~~FPS on a Qualcomm Snapdragon 778G platform.

cs.HC [Back]

[142] Love for Believable AI: Artificial Partiality and Relationship Persistence as an Engineerable Stance cs.HC | cs.CLPDF

Sebastian Cochinescu

TL;DR: 该工作将对话智能体的人工偏向操作化为两个可工程化部分：超过服务底线的互动盈余分配，以及根据关系历史积累的用户状态，并明确不主张用户会感知到爱。

Details

Motivation: 论文研究如何在不改变底层推理模型的情况下，在会话智能体中实现对熟悉用户的有限个性化关照，同时避免把机制研究误称为用户依恋、信任或机器内在体验；作者没有开展人类受试研究。

Result: 人工偏向拆为关怀（有限互动盈余在各用户间分配、同时保证每人最低服务）和特殊性（固定推理机制上根据关系历史估计用户状态）。二者作为持久化层叠加在一个开放权重基座模型上，并在隐藏状态预先定义的多轮关系情境中测试。以配对生成种子对已知用户和陌生人同题探测，评估四通道差异；作者注明陌生人提示未做长度匹配，且initiative通道是分配器输出而非生成行为。完整机制复现理论曲线的序数形状但非幅度，并且只有该条件满足校准测试上的协议联合特征。初始机制未通过探测质量等价性，因为关系信息降低主题相关性；受约束修订版在校准测试通过，但在未用于校准的第二测试集不通过，并在其中得分高于未修改基线。第二测试集特异性差值0.0198，低于0.02协议阈值；配对平均正确用户—错误用户估计准确率差为0.375，但并非每次运行都为正。

Insight: 该研究只说明可持久化的用户状态和资源分配机制在人工构造测试中满足部分操作性签名，不提供用户感受证据；作者明确说它只是后续感知研究的候选机制。校准集与第二测试集结果不同，协议记录也非独立时间戳预注册；伦理约束包括陌生用户服务底线、盈余上限、披露和降强度机制。

Abstract: We study a behavioral mechanism for artificial partiality in conversational agents. The paper reports no human-subjects data and makes no claim about attachment, trust, perceived mind, or machine interiority. Partiality has two components: caring, defined as allocation of a finite interaction surplus above a guaranteed per-user service floor, and particularity, defined as a per-user state estimate accumulated from relationship history on fixed inference machinery. We implement both as a persistence layer over one open-weight base model and evaluate them on constructed multi-session relationships with known hidden-state schedules. A four-channel divergence compares known-user and stranger conditions on identical probes with paired generation seeds; the stranger prompt is not length-matched, and one channel (initiative) is an allocator output rather than generated behavior. The full mechanism reproduces the ordinal shape, but not the magnitude, of an analytically specified curve and is the only arm satisfying the protocol-defined joint signature on the calibrated battery. The initial mechanism fails probe-quality equivalence because relationship content reduces topical relevance. A guarded revision satisfies equivalence on the calibrated battery but not on a second battery not used in calibration, where it scores higher than the unmodified baseline. On that second battery, the specificity margin is 0.0198, below the 0.02 protocol threshold. The paired mean right-user–wrong-user estimation-accuracy contrast is 0.375 but is not positive in every run. The mechanism is therefore a candidate for a later perception study, not evidence that users perceive love. The versioned protocol record is not independently time-stamped and is not described as a preregistration. Ethical constraints include a stranger-treatment floor, a bounded surplus, disclosure, and de-intensification.

[143] Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI cs.HC | cs.AI | cs.CVPDF

Agnese Chiatti, Matteo Matteucci, Viola Schiaffonati

TL;DR: 该研究用56名具备AI素养参与者的在线实验及392次视频问答交互，分析任务后信任评分如何关联未来拒绝、核验使用或完全委托AI的意向。

Details

Motivation: 多模态AI成为日常思考伙伴后，需要研究用户何时把控制权交给系统，以及意向委托如何受互动经验和任务特定信任影响。

Result: 参与者查看每个多模态AI回答后评估任务特定信任，并为类似未来任务选择拒绝AI、核验后使用或完全委托三种策略。个体内分析中，交互后信任强烈预测委托选择，OR=14.97，95%置信区间[7.14,31.37]；但信任和委托仍是不同概念，核验是最常见策略，且常与高信任并存。控制即时及个体层信任后，任务顺序仍与委托增加相关，OR=1.22，95%区间[1.02,1.45]，提示自报信任未捕捉的经验因素。作者据此倡导未来直接观察实际委托行为，而非仅询问意图。

Insight: 高信任不等同于完全放权，核验行为在高信任下也常见；反复互动可能改变委托倾向。研究样本是56名AI素养参与者且测量的是未来意向，不能直接外推普通用户或实际长期使用行为。

Abstract: As multimodal AI systems are becoming our everyday thought partners, the shift towards studying how users transfer control to these systems becomes especially urgent. In this paper, we report an overview of findings from an online study with n=56 AI-literate participants and 392 Video Question Answering trials. After inspecting each multimodal AI response, participants rated task-specific trust and selected one of three intended policies for an analogous future task: reject AI assistance, use it with verification, or delegate fully to the AI. Within participants, post-interaction trust strongly predicted the user’s delegation choices (OR=14.97, 95% CI [7.14,31.37]). Trust and delegation nevertheless remained distinct. Verification was the dominant policy and often co-occurred with high trust. Delegation also increased with task order after adjustment for momentary and participant-level trust (OR=1.22, 95% CI [1.02,1.45]), indicating an experience-related component that self-reported trust ratings alone could not capture. These findings motivate a shift from intended delegation to a non-intrusive observation of how delegation is enacted in collaborative human-AI tasks. We therefore conclude by proposing enacted delegation traces as a methodological framework for future studies of multimodal and agentic AI use.

cs.IR [Back]

[144] Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval cs.IR | cs.CLPDF

Yingtao Luo, Kangyi Zhao, Shiyi Du, Yubo Li

TL;DR: AURA直接按中间推理表征区分相关文档与困难干扰项的能力监督检索推理，并训练效用估计器根据查询自适应决定推理深度。

Details

Motivation: 带推理的文本嵌入可逐步细化检索约束，但额外推理也可能产生过度泛化或语义噪声、降低检索特异性；只按最终检索结果监督，无法充分指导中间约束如何演进。

Result: AURA根据推理状态区分相关文档与困难干扰项的效果，直接监督中间表征；随后在前缀条件嵌入上训练轻量效用估计器，以便推理时自适应控制深度。在推理密集的BRIGHT基准上，AURA-4B平均nDCG@10为34.7，每个查询平均2.8个推理步骤和96个生成令牌。匹配部署条件下，早停将延迟从完整轨迹推理的4.6秒降至0.76秒。MS MARCO结果进一步表明，该专门化未明显损害常规域内检索。

Insight: 推理步数应由中间状态对困难负例的区分效用决定，既避免无益抽象，也减少全轨迹生成延迟。摘要未给BRIGHT各子集表现和MS MARCO具体变化，4.6至0.76秒仅针对匹配设置。

Abstract: Reasoning-conditioned embeddings can improve retrieval by progressively refining semantic constraints. However, additional reasoning may introduce over-generalized or semantically noisy abstractions that weaken retrieval specificity. Existing methods largely supervise reasoning through final retrieval outcomes, providing limited guidance over the refinement process itself. We propose AURA, a framework that directly supervises intermediate reasoning states according to how well they separate relevant documents from hard distractors. AURA further trains a lightweight utility estimator over prefix-conditioned embeddings to adapt reasoning depth at inference time. On the reasoning-intensive BRIGHT benchmark, AURA-4B achieves 34.7 average nDCG@10 while using 2.8 reasoning steps and 96 generated tokens per query. Under matched deployment conditions, adaptive stopping reduces latency from 4.6 to 0.76 seconds relative to full-trajectory reasoning. Results on MS MARCO further suggest that this specialization need not substantially degrade conventional in-domain retrieval.

cs.LG [Back]

[145] Same Answer, New Box: How Much of RLVR’s Out-of-Domain Gain Is Answer Format? cs.LG | cs.CLPDF

Zongye Lyu

TL;DR: 该研究重新评分四组7B数学RLVR前后模型的已存输出，发现基于公开抽取器报告的域外多项选择增益有82%来自答案格式迁移，而非答案内容变好。

Details

Motivation: RLVR常被认为能带来奖励验证领域之外的能力提升，但评测通常依赖从输出文本中抽取答案；如果强化学习只学会把答案写到抽取器期待的位置，准确率增益可能被高估。

Result: 作者比较四组公开的7B SimpleRL基础—强化学习模型输出，分别使用原公开代码中的抽取器和一个可从boxed格式或正文中读取明确答案的自建抽取器评分。四组模型中，原抽取器报告的域外多项选择增益有82%在新抽取器下消失，说明提升来自答案格式而非答案本身；基础模型多数把答案写在正文，RL则将其移入抽取器优先寻找的方框。独立LLM读者估计格式增益占77%；若提示本身要求方框，自建抽取器估计为79%。另一种训练配方的32B模型对中，几乎没有报告增益来自格式，因为其基础模型在被要求时已会加方框，而RL模型在未被要求时很少加框。

Insight: 报告RLVR跨域收益时，应区分答案质量与评测抽取格式，且可对存储输出用第二抽取器复核，无需重跑强化学习。格式效应因模型和训练配方而异，82%只针对四组7B模型及原评测提取器。

Abstract: Reinforcement learning with verifiable rewards (RLVR) is credited with gains beyond the domain its rewards check, such as higher MMLU accuracy after training on mathematics. Such accuracies are usually read out of the model’s text by an answer extractor. A model that learns to write its answer where the extractor looks can therefore score higher without answering better. We measure how much of the gain reported by extractors copied from public code arises this way. We generate outputs from a base model and its RL model and score them twice: with those extractors, and with one extractor of our own that reads a stated answer whether it is in the answer box \boxed{} or in the text. On four released 7B SimpleRL base-RL pairs, 82% of the out-of-domain multiple-choice gain that these extractors report disappears under ours: it is a gain in answer format, not in answers. The base models already state most of their answers in text, and RL moves them into the box, where these extractors look first. Independent LLM readers, in place of our extractor, put the figure at 77%. With a prompt that itself asks for the box, our extractor puts it at 79%. On a 32B pair trained with another recipe, almost none of the reported gain is format gain: its base model boxes its answers when asked, and its RL model rarely does when not. A reported gain is partly a property of the extractor that read it, and re-scoring stored outputs with a second extractor shows how much, without re-running RL.

[146] Gibbs-Gap Policy Optimization for Off-Policy RL with Verifiable Rewards cs.LG | cs.CLPDF

Xuanchang Zhang, Tong Zhang

TL;DR: GGPO为使用过期或不同策略生成的离线RLVR回答提供无需行为策略重要性权重的更新目标，通过同题响应的KL调整奖励log-mean-exp对比优化策略。

Details

Motivation: 可验证奖励强化学习常使用另一个、可能已过期的行为策略生成的回答；用学习者/行为策略重要性权重修正分布差异，长回答时可能引入高方差。

Result: Gibbs-Gap Policy Optimization最小化同一提示下多条响应的KL调整奖励log-mean-exp对比，不使用学习者到行为策略的重要性权重。理论上，在在线策略条件下，其总体损失恰为KL正则化最优性差距；在满足覆盖条件时，学习者单次响应期望奖励至少达到行为策略best-of-K奖励，减去有限组损失、正则化及有限训练数据项。作者分析了精确Gibbs目标复合下的参考策略刷新，并在局部参考控制和令牌级行为失配下推导有限数据最终策略奖励界。刷新很重要：五基准按问题加权平均上，固定参考版本得32.96，默认刷新调度得46.58。数学推理实验中，在训练—推理失配及固定离线数据设置下，GGPO超过GRPO和AGRO，并在受控策略陈旧度增加时保持表现。

Insight: 策略刷新并非实现细节，而关系到离线数据失配下的稳定收益；GGPO避免长序列重要性权重，理论结论仍依赖覆盖和局部控制等假设。摘要未提供所有基准分数、不同刷新周期的成本及奖励尺度。

Abstract: Reinforcement learning with verifiable rewards often trains language models on responses generated by a different, possibly stale behavior policy. Correcting this mismatch with learner-to-behavior importance weights can introduce high variance for long responses. We introduce Gibbs-Gap Policy Optimization (GGPO), which minimizes a log-mean-exp contrast of KL-adjusted rewards among responses to the same prompt, without learner-to-behavior importance weights. We derive GGPO from KL-regularized policy optimization: on policy, its population loss is exactly the KL-regularized optimality gap, and under suitable coverage the learner’s single-response expected reward is at least the behavior policy’s best-of-$K$ reward, minus terms for the raw finite-group loss, regularization, and finite training data. We characterize reference refresh through exact Gibbs-target composition and a finite-data final-policy reward bound under local reference control and tokenwise behavior mismatch. This refresh is empirically important: in an ablation, fixed-reference GGPO scores $32.96$ on the five-benchmark problem-weighted average, versus $46.58$ with the default refresh schedule. Experiments on mathematical reasoning further show that GGPO outperforms GRPO and AGRO under training-inference mismatch and on fixed offline data, while maintaining its performance as controlled policy staleness grows.

[147] CogDrift-4D: Hierarchical Multimodal Modeling of Temporal Behavioral Decay for MCI Detection cs.LG | cs.CLPDF

Sankalp Vaish, Sumukh Veeramalla, Rishank Singh, Caroline Summerour, John A. Batsis

TL;DR: CogDrift-4D用纵向多模态行为数据建模会话内短时“衰退”和跨会话累计漂移，以识别轻度认知障碍相关行为变化。

Details

Motivation: 痴呆护理需要尽早发现轻度认知障碍，但细微认知衰退需要纵向、跨模态观察；单次对话可能难以区分瞬时状态与长期行为变化。

Result: 作者收集18个月内七次非脚本化多模态互动数据，并将连续多会话数据组织成批次×会话×时间×特征的稠密4D张量，同时保留局部动态和长期变化。CogDrift-4D采用分层建模：会话内通过局部最小二乘斜率量化面部动作单元和声学能量的急性衰退；会话间通过递归交叉注意力反馈编码器累积跨次行为漂移。局部质量门控过滤环境噪声和跟踪失败特征，再融合语义与原始物理动态。在结构化言语和语言互动评估中，分类准确率为0.733±0.13，F1为0.716±0.14，作者报告超过先进基线。

Insight: 纵向变化和会话内动态可提供互补信号，质量门控用于减少采集噪声影响。摘要未报告受试人数、独立测试设置、基线分数和置信区间；结果是筛查研究，不等于临床诊断验证。

Abstract: Early detection of mild cognitive impairment remains a critical bottleneck in dementia care, demanding scalable tools capable of capturing subtle behavioral decay. To capture the subtle temporal changes of cognitive decline, we introduce a behavioral dataset collected across seven unscripted multimodal interactions over an 18-month horizon. This dataset formalizes continuous, multi-session interactions into a dense 4D tensor (Batch * Session * Time * Feature) that explicitly preserves concurrent local dynamics alongside long-term changes. To effectively process these complex behavioral patterns, we propose CogDrift-4D: a novel, hierarchical 4D Transformer framework. To capture the complex trajectory of cognitive decline, CogDrift-4D implements a dual-level behavioral fatigue and drift modeling architecture. At the intra-session level, the model computes localized least-squares regression slopes to quantify the acute ``fading’’ of frame-level facial action units and acoustic energy. At the inter-session level, a recursive cross-attention feedback encoder acts as a cumulative fatigue accumulator, mapping the patient’s continuous behavioral drift across successive sessions. To mitigate environmental noise and track failures across sessions, a localized Quality Gate dynamically filters low-integrity features before final fusion, also an early fusion that integrates semantic insights with raw physical dynamics. Evaluated on structured verbal and linguistic interactions, our architecture successfully detects MCI with a classification accuracy of 0.733 +- 0.13 and an F1-score of 0.716 +- 0.14, outperforming advanced baselines. The framework provides a mathematically rigorous, scalable, and robust foundation for home-based, real-time dementia screening.

[148] Wrong Votes, Right Gradients: Why Majority-Vote Rewards Track Verifiable RL cs.LG | cs.AI | cs.CLPDF

Dylan P. Wilson, Chengsong Huang, Jiaxin Huang

TL;DR: 该理论分析认为多数投票自生成标签在RL中之所以能接近可验证奖励，关键取决于错误是否跨提示同方向相关，而非错误标签比例本身。

Details

Motivation: 用模型自身多数投票产生标签进行RL，常能取得接近可验证奖励训练的收益；从单提示看，多数票只给出众数答案，似乎不能额外提供正确性信息。

Result: 作者以批次级参数更新为分析单位，指出实际批量下单个提示的梯度对该提示输出变化贡献低于1%，因此错误标签影响取决于其梯度是否跨提示共享方向。研究将多数投票更新分解为相对黄金更新的收缩和误导；当错误在提示间不相干时，无论错标频率如何增加，误导项会随批次规模消失。五种模型的逐回答梯度分析显示，多数投票错误与随机奖励空假设同样不相干；多数投票更新与黄金更新的一致程度接近两次独立黄金更新之间的一致度，去噪余弦与黄金更新为误差范围内1。随机翻转最多30%的黄金标签仍保留更新方向，而按共享规则翻转相同比例会破坏方向；每题都偏向某类回答的奖励模型则明显较差。该等价性在所检检查点成立，但仅是局部结论：最终留出多数准确率上，黄金奖励训练仍领先。

Insight: 伪标签可用性取决于梯度误差方向是否一致，而不是只看标签错误率；批次平均可能抵消不相关噪声。局部更新方向等价不代表完整训练轨迹或最终性能完全等同，摘要明确指出黄金奖励最终仍占优。

Abstract: Reinforcement learning with self-generated labels, such as majority vote over a model’s own samples, often recovers most of the gain of training with verifiable rewards. This is puzzling from the usual prompt-level view, in which majority vote only returns a model’s modal answer and cannot add information about correctness. We argue that the relevant unit is the batch-level update. Because parameters are shared, a prompt’s own gradient accounts for less than 1% of the change in that prompt’s output at practical batch sizes, so a wrong label matters only to the extent that label errors share a direction across prompts. We decompose the majority-vote update into shrinkage and misdirection relative to the gold update, and show that misdirection vanishes with batch size whenever errors are incoherent across prompts, however often the labels are wrong. Measuring per-response gradients on five models, we find that majority-vote errors are as incoherent as a random-reward null, that the majority-vote update agrees with the gold update as closely as two independent gold updates agree with each other, and that its noise-corrected cosine with the gold update is 1 within error. Randomly flipping up to 30% of gold labels leaves the update direction intact, while the same fraction flipped by a shared rule destroys it, and rewards that favor a kind of response on every prompt, such as a learned reward model, fall measurably short. The equivalence holds at every checkpoint we examine but is local: gold-reward training still ends ahead on held-out majority accuracy. Error coherence, not error rate, determines when self-generated labels can stand in for verification.

[149] Task-Centric Multimodal Learning for Cognitive Impairment Detection cs.LG | cs.CLPDF

Sankalp Vaish, Rishank Singh, Sumukh Veeramalla, Caroline Summerour, John A. Batsis

TL;DR: 该研究提出在Alexa结构化语音互动中融合视频、音频和文本的非接触式轻度认知障碍筛查，并比较三种对话任务及单模态/多模态模型。

Details

Motivation: 临床外早期认知障碍检测困难；只分析文本或语音会忽略人类表达的多模态信息，包括语音模式、声学特征、面部表情和语言结构。

Result: 研究使用Amazon Alexa进行三种对话任务，旨在探查自发言语、理解和回忆，并比较各任务的信息量及音频、视频和文本单模态模型与融合模型。视频模型在命令朗读任务最好，准确率0.65、AUC 0.69；音频模型在问答任务最好，准确率0.67、AUC 0.73。多模态模型跨任务表现较稳定：命令朗读准确率0.76、AUC 0.75，问答准确率0.76、AUC 0.73。

Insight: 不同交互任务可能突出不同模态信号，而多模态融合在所测任务中表现稳定。摘要没有报告样本量、外部验证或置信区间，不能据此视为可用于临床筛查的诊断工具。

Abstract: Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rely on text or voice-based responses, capturing only a limited view of human cognition despite the inherently multimodal nature of human expression. This work proposes a contactless, multimodal screening framework that leverages video, audio, and text signals collected during structured voice-based interactions with Amazon Alexa. By incorporating these modalities, our approach captures a more holistic representation of human behavior encompassing speech patterns, vocal characteristics, facial expressions, and linguistic structure, which may enable more accurate detection of cognitive decline. Different participants completed three conversational tasks designed to probe spontaneous speech, comprehension, and recall. We pursued three objectives: (1) evaluate which of the three Alexa tasks provides the most informative cognitive signals, (2) compare the effectiveness of unimodal models, and (3) assess the benefits of multimodal fusion models. Task-level analysis shows that the video model achieves its best performance on Command-Reading, with an accuracy of 0.65 (AUC 0.69), while the audio model performs best on Question-Answering, reaching an accuracy of 0.67 (AUC 0.73). In contrast, the multimodal model demonstrates consistently stable performance across tasks, achieving an accuracy of 0.76 (AUC 0.75) on Command-Reading and 0.76 (AUC 0.73) on Question-Answering. These findings demonstrate that multimodal behavioral cues captured through naturalistic interactions can reliably distinguish MCI from healthy aging, highlighting the limitations of traditional diagnostic paradigms and supporting the shift toward multimodal, real-world cognitive assessment frameworks.

[150] Judging the Judges: Confidence and Disagreement in Rubrics as Rewards cs.LG | cs.AI | cs.CLPDF

Michael Tian-Yue Liu, Anne Harrington, Trevor Darrell, Yutong Bai

TL;DR: RaRE通过置信度加权和分歧剔除整合多个量规裁判：用裁判logprob构成soft-Likert奖励，并从GRPO更新中排除高分歧轨迹。

Details

Motivation: 量规奖励用LLM裁判评分，将强化学习扩展到不可验证领域；既有研究主要改进量规或增强单个裁判，对多个裁判在训练中的组合方式关注较少。

Result: 作者首先发现，在RaR-Medicine和RaR-Science上训练Qwen3-4B-Base时，仅更换五种前沿或开放权重裁判，所得分数就有明显差异。随后提出RaRE：soft-Likert根据裁判logprob让更有把握的裁判权重更高；分歧剔除掩码则将裁判意见高度不一致的rollout排除出GRPO更新。简单平均裁判分数未超过最佳单裁判，但RaRE在HealthBench和GPQA Diamond上均超过所有单裁判RaR变体；主题级分析显示集成保留了组成裁判的互补优势。

Insight: 多个裁判的简单平均不足以利用差异；应将置信度与意见不一致纳入训练更新，避免低可靠性奖励污染策略。摘要未提供具体成绩、分歧阈值及额外评估成本，结论限于两个奖励学习基准。

Abstract: Rubrics as Rewards (RaR) extends reinforcement learning to non-verifiable domains by using an LLM judge to score responses against a structured rubric. Prior work has focused on improving the rubric or strengthening the single judge, with comparatively little attention to how different single or multiple judges might be used during RaR training. We first show that judge identity alone produces a substantial spread in scores when training Qwen3-4B-Base on RaR-Medicine and RaR-Science across five frontier and open-weight judges. Building on this, we propose RaRE (Rubrics as Rewards with Ensembles), a novel judge ensemble strategy for RaR with two mechanisms: a soft-Likert reward that uses judge logprobs to weight more confident judges more heavily, and a drop-on-disagreement mask that excludes high-disagreement rollouts from the GRPO update. We find that this design is critical: while a naive average of judge scores fails to outperform the best single judge, RaRE outperforms every single-judge RaR variant on both HealthBench and GPQA Diamond, with per-theme analysis showing that it inherits the complementary strengths of its constituent judges. Our findings establish judge ensembling as a compelling axis for improving RaR.

[151] TimeCap: A Scalable Open-Source Pipeline for Captioning Wearable Health Time-Series Data cs.LG | cs.CLPDF

Max Rosenblattl, Milana Gurbanova, Karl Aurel Deck, Narayan Schuetz, Thomas Kaar

TL;DR: TimeCap是无需语言模型参与的确定性时间序列字幕管线，包含三个可复用提取器层级和跨通道合成，可仅靠通道定义扩展新数据模式。

Details

Motivation: 时间序列语言模型受限于缺乏有信号依据、可复现且能跨模态/模式扩展的文本配对数据；用LLM批量标注虽可扩展，但输出不能精确重现，妨碍数据集审计和再生成。

Result: 作者发布TimeCap，以信号为输入、完全不调用语言模型的确定性管线生成字幕，含三层可复用提取器和跨通道合成模块，新模式可通过编写通道定义扩展。应用于OpenMHC（MyHeart Counts可穿戴数据）后构建MHCap，覆盖19个Apple HealthKit通道、908,944人日，共7,005,763条字幕。作者用MHCap训练OpenTSLM并评估健康结果预测：加入字幕的OpenTSLM-Cap在8项任务的32个按用户二元评估中有29项超过仅标签基线。

Insight: 确定性信号到文本管线可让配对语料重新生成、审计和扩展，而非依赖不可复现的LLM生成标注；字幕监督在多数按用户评估中带来收益。摘要未说明各通道的错误率、健康预测指标及人口代表性，提升也并非32项全胜。

Abstract: Time-series data generated continuously across industrial, environmental, and especially health domains produce multimodal signals whose scale and heterogeneity make their processing and interpretation particularly challenging. Time-Series Language Models (TSLMs) promise scalable interpretation of these signals, yet remain bottlenecked by a fundamental lack of text-annotated time series pairs that are signal-grounded, reproducible, and extensible across modalities and schemas. Existing paired corpora are either closed or limited in scale and modality coverage. Annotation with large language models could scale them up, but its outputs cannot be regenerated exactly, which prevents others from re-deriving, extending, or auditing the resulting corpus. To address this, we release TimeCap, an open deterministic captioning pipeline with three reusable extractor tiers and a cross-channel synthesis layer that operates directly on the signal with no language model in the loop, extensible to new schemas by writing channel definitions alone. This positions TimeCap as a reproducible mechanism for future dataset generation rather than a one-off release. Applying TimeCap to OpenMHC, the MyHeart Counts wearable dataset, yields MHCap, the largest open caption layer for multimodal wearable time-series data. MHCap spans 19 Apple HealthKit channels and 7,005,763 captions over 908,944 person-days. To showcase the impact of the corpus, we train OpenTSLM, a time-series language model, on MHCap and benchmark on health-outcome prediction. Caption-augmented training (OpenTSLM-Cap) outperforms a label-only baseline on 29 of 32 per-user binary evaluations across 8 tasks.

[152] PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning cs.LG | cs.CLPDF

Max Rosenblattl, Nikhil Krishnaswamy, Leon Nissen, Manuel Milling, Nicolas Zumarraga

TL;DR: PocketTSLM在手机端运行OpenTSLM SoftPrompt模型，把时间序列窗口编码为嵌入而非文本令牌，减少上下文占用并避免推理期间传输敏感生理数据。

Details

Motivation: 手机和可穿戴设备产生大量生理时间序列，但许多移动系统把它们压成摘要或文本，破坏时序信息；云端模型则需上传敏感数据并带来延迟和成本，而文本化或统计汇总方案受小模型上下文/内存限制。

Result: PocketTSLM将时间序列窗口作为嵌入输入，完全在消费级手机运行OpenTSLM SoftPrompt。Swift移植与Apple MLX Python参考实现通过数值一致性协议验证，贪心解码令牌序列完全相同；回答与PyTorch参考也匹配，但解释文字可能不同。相同骨干下的上下文效率评测中，软提示路径较文本序列化约少用12倍时间序列令牌并降低提示预填充成本。应用包括Sleep-EDF的30秒脑电睡眠分期和ECG-QA的1,000点（10秒）12导联心电图；较长窗口下，文本基线超出手机上下文或内存预算。推理全程本地进行，不传输健康数据。

Insight: 将时间序列作为嵌入而非自然语言令牌，有利于在设备端保留序列结构并控制上下文占用。运行可复现性验证的是数值实现一致，不代表预测临床准确性；摘要未给手机型号、推理时延、功耗及疾病任务性能。

Abstract: Consumer phones and wearables increasingly collect physiological time-series data, yet most mobile systems treat these streams as summaries or text rather than as temporal evidence. This representation is poorly matched to personal health systems that need to retrieve, route, or summarize sensor evidence while preserving temporal structure. Cloud-hosted time-series language models avoid smartphone limits, but they repeatedly move sensitive physiology off the device and add latency and per-query compute cost. Mobile model alternatives that aggregate time-series data into statistical features or serialize raw samples as text either compress temporal structure or exhaust the context and memory budgets of small on-device models. We present PocketTSLM, a mobile-native deployment of OpenTSLM SoftPrompt, the soft-prompt variant of the OpenTSLM time-series language model. PocketTSLM runs fully on a consumer smartphone by injecting encoded time-series windows as embeddings instead of tokenizing time series as text. A numerical parity protocol verifies identical greedy-decoded token sequences between the Swift port and a Python reference using Apple’s MLX machine-learning framework. Answers also match the PyTorch reference, although rationale wording can differ. An on-device context-economics benchmark compares the soft-prompt path with a text-serialized baseline on the same backbone. In our benchmark format, soft-prompting uses approximately 12 times fewer time-series tokens and reduces prompt-prefill cost. PocketTSLM processes 30-second Sleep-EDF electroencephalography clips for sleep staging and a 1,000-sample (10 s) 12-lead electrocardiogram clip from ECG-QA. In comparison, text-serialized baselines exceed the phone’s context or memory budget at longer time-series windows. All inference runs entirely on the device, with no health data transmitted during inference.

[153] Ranking and Partitioning of Attention Heads for Sparse and Continual Reinforcement Learning Fine-tuning cs.LG | cs.CLPDF

Ruizhe Shi, Zaiwen Yang, Qiubo Wang, Banghua Zhu, Maryam Fazel

TL;DR: 该研究用梯度范数排序注意力头以选择少量可训练参数，并在持续学习时把注意力头分配到不同任务，以降低任务间干扰。

Details

Motivation: 语言模型的稀疏RL微调可节省更新参数，持续学习则需避免新任务损害旧能力；需要系统判断哪些注意力头值得训练，以及如何隔离跨任务更新。

Result: 稀疏学习部分按梯度范数排列注意力头，选出可有效训练的小子集；持续学习部分把注意力头分配到不同任务，以减少相互干扰并保留已学能力。理论分析将梯度范数与训练效果联系起来，并解释稀疏、分离的头部更新为何可能保持稳定。数学、指令遵循和代码任务实验中，训练较高排名注意力头持续优于训练低排名头，并经常达到稠密基线水平；按任务分区注意力头改善旧任务保留，同时支持适应新任务。

Insight: 注意力头间的梯度贡献存在差异，可据此分配稀疏更新；持续学习中进一步分区可控制任务间干扰。摘要未提供模型规模、任务列表、稀疏比例和具体成绩，结果仅定性概括。

Abstract: We study sparse and continual reinforcement learning fine-tuning of language models through attention-head ranking and partitioning. For sparse learning, we rank attention heads by gradient norm to identify a small subset of heads that can be trained effectively. For continual learning, we partition heads across tasks to reduce cross-task interference and preserve previously learned capabilities. Theoretically, we relate gradient norm to training effectiveness, and further characterize why sparse, separated head updates can remain stable. Empirically, across math, instruction-following, and coding tasks, tuning higher-ranked heads consistently outperforms tuning lower-ranked ones while often matching denser baselines, and head partitioning improves retention while preserving adaptation to new tasks.

[154] Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models cs.LG | cs.CVPDF

Frank F. Yang, Kefei Yan, Yiren Wang, Yiyang Wang

TL;DR: 该研究对比VLM视觉推理的监督微调和在线策略蒸馏，发现OPD只有在教师对学生自己生成的轨迹仍可靠时才有效，并可能转移教师的未完成回答习惯。

Details

Motivation: OPD在学生生成的轨迹上获得教师反馈，可能比教师示范更省数据，但教师在每个学生状态上的反馈如何影响能力和完成行为尚不明确。

Result: 作者在教师可靠程度不同的两个任务上，对OPD与筛选式SFT进行受控比较。在教师几乎总能完成的ChartQA上，教师完成率99%，仅用10%数据的OPD与全数据SFT准确率相差1.4个百分点。Geometry3K上教师有22%解答未完成，OPD比SFT低7.9个百分点，主要差距来自回答不完整。更显著的是，从SFT学生启动OPD会使完成率从76%降至62%，实质上抹去SFT学到的完成行为；只按完整性筛选教师示范即可恢复SFT的大部分优势。

Insight: 学生访问的状态上教师是否可靠、回答是否完整，是OPD数据效率能否转化为准确率的关键；在线监督也会继承教师的失败模式。结论基于ChartQA与Geometry3K两项任务，摘要未列模型及置信区间。

Abstract: Improving the reasoning capabilities of vision-language models (VLMs) often relies on post-training with supervision from stronger models. Two common strategies are supervised fine-tuning (SFT), which trains on teacher-generated demonstrations, and on-policy distillation (OPD), which provides teacher feedback on trajectories generated by the student itself. While OPD can be more data-efficient by supervising student-generated trajectories, it is unclear how the teacher’s supervision at each state affects the student’s learned behavior. To study this question, we conduct a controlled comparison of OPD and filtered SFT across data budgets and tasks where the teacher exhibits different levels of reliability, and analyze how these differences shape student accuracy and completion behavior. Across the two tasks, we find that OPD is effective only when the teacher remains reliable on student-generated trajectories. On ChartQA, where the teacher completes 99% of its solutions, OPD trained on only 10% of the data comes within 1.4 accuracy points of full-data SFT. In contrast, on Geometry3K, where the teacher fails to complete 22% of its solutions, OPD underperforms SFT by 7.9 points, with most of the gap explained by incomplete responses. More strikingly, starting OPD from an SFT student reduces its completion rate from 76% to 62%, effectively erasing the completion behavior learned through SFT. Filtering teacher demonstrations for completeness alone recovers much of SFT’s advantage. These results show that on-policy supervision can transfer not only teacher knowledge but also persistent failure modes on student-visited states. Code is available at https://github.com/ffy208/opd-inherits-teacher-vlm.

[155] Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation cs.LG | cs.CLPDF

Bingxi Hou, Guochao Jiang, Guofeng Quan, Weiqing Li, Wenfeng Feng

TL;DR: Waypoint-OPD利用同一强化学习教师运行中的中间检查点，比较早期与最终策略变化方向，并按方向一致性门控终点策略差异以选择性迁移。

Details

Motivation: 策略变化蒸馏用教师RL前后log概率差监督学生轨迹，但终点差异无法揭示教师训练期间局部偏好是否一致；同一个最终变化可能由方向相同的阶段变化或相互抵消的变化造成。

Result: Waypoint-OPD在学生访问的前缀处，使用同次RL运行的中间教师检查点比较早期和最终策略的相对动作偏好；若两阶段方向相反，则抑制端点策略差异的迁移。相比只用端点教师，该方法仅额外需要一次冻结教师打分。以RL训练Qwen3-4B教师，在数学与代码推理中将Qwen3-8B、14B和30B-A3B作为学生，六种领域—学生组合里，Waypoint-OPD均取得受比较蒸馏方法中的最高领域平均分。Qwen3-8B消融显示移除或打乱门控会降低数学推理表现。

Insight: 教师策略变化的时间路径信息可区分一致强化与部分抵消的偏好迁移；用少量门控信号抑制不一致方向可改善蒸馏。摘要未给各组合分数、计算开销及代码任务消融结果。

Abstract: Policy-shift distillation reuses the difference between a teacher’s log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories. However, this endpoint policy shift cannot reveal whether local action preferences evolved consistently during teacher training. The same endpoint shift can result from early and late shifts that reinforce or partially cancel each other. We investigate whether agreement between early and late teacher policy shifts can guide selective transfer. We introduce Waypoint-guided On-Policy Distillation (Waypoint-OPD), which uses an intermediate teacher checkpoint from the same RL run to compare early and late shifts in relative action preferences at student-visited prefixes. We gate the endpoint shift according to the directional agreement between the early and late shifts, suppressing it when they point in opposing directions. Compared with endpoint-only transfer, our method requires only one additional frozen-teacher scoring pass. Using RL-trained Qwen3-4B teachers, we evaluate our method with Qwen3-8B, Qwen3-14B, and Qwen3-30B-A3B as student models in mathematical and code reasoning. In all six domain–student settings, Waypoint-OPD achieves the highest domain-average score among the compared distillation methods. Ablations with the Qwen3-8B student show that removing or shuffling gates reduces mathematical reasoning performance. These results support the use of directional agreement between early and late teacher policy shifts to weight the endpoint shift during student training.

[156] Selection Is Not Learning: Choosing Model Futures cs.LG | cs.AI | cs.CLPDF

Haoyi Yang, Kshitij Mishra, Nils Lukas, Salem Lahlou

TL;DR: 该研究指出自演化语言模型存在任务可学习性筛选与更新是否真正有用之间的落差，并用HeirCommit验证更新、EvoHeir分离参数继承和经验继承。

Details

Motivation: 自演化循环每轮需决定下一轮继承哪个模型；现有方法常按任务看起来是否可学习来筛选，之后却自动继承每次更新，忽略成功任务上的多数更新也可能无助于提高正确答案概率。

Result: HeirCommit冻结更新后的模型，用新的评估问题决定继承更新还是保留当前模型。EvoHeir将参数继承与经验继承分开，利用当前及归档经验修复失败并保留成功，再作最终确认。作者分析筛选诱导的乐观偏差，并将遗憾分为筛选、吸收和确认误差。相同接受率下，HeirCommit相较随机继承将被接受更新中的有害比例降低68%—83%。四个骨干模型上，EvoHeir在数学及一般推理平均成绩最佳，数学平均分较最强基线Agent0提高5.3%；即使产生经验的模型未被继承，经验仍可保留供后续使用。

Insight: 任务看似可学习不等于训练更新有效，应对参数变化进行新样本确认，并让经验与模型权重解耦。摘要未给四个骨干、测试集规模和更新成本，且5.3%提升对应数学平均分。

Abstract: Self-evolving language models train on tasks they generate, so every round must decide which updated model the next round inherits. Current loops such as R-Zero, Agent0, and Skill Self-Play make this decision through the task, admitting tasks that look learnable and inheriting every resulting update. We identify a selection-to-update gap in these loops, where a task that looks learnable need not produce a useful update. Most updates on verified tasks fail to make correct answers more likely, yet these loops inherit them all. HeirCommit freezes the updated model and uses fresh evaluation questions to decide whether to inherit it or retain the current model. EvoHeir separates parameter inheritance from experience inheritance, using current and archived experience to repair failures and preserve successes before final confirmation. Our analysis characterizes selection-induced optimism and decomposes regret into selection, absorption, and confirmation errors. HeirCommit cuts the harmful share of accepted updates by 68-83% relative to random inheritance at the same acceptance rate. Across four backbones, EvoHeir achieves the best mathematics and general-reasoning averages, raising the math average by 5.3% relative to the strongest baseline, Agent0. The framework lets useful experience persist even when the model that produced it is not inherited.

[157] Momentum, Commentary Tone, and Earnings Surprise in LLM Financial Forecasts cs.LG | cs.AI | cs.CL | q-fin.GNPDF

Alina Khaybullina

TL;DR: 该研究用合成财报公告独立操控20日动量、非信息性评论语气和EPS超预期情况，测量多种LLM对这些输入因素的答案偏移。

Details

Motivation: 研究问题是哪些输入因素驱动模型财务预测；真实公告中的动量、评论语气和盈余意外常彼此相关，难以分辨模型对各因素的依赖。

Result: 研究为四个模型家族的六种指令/聊天检查点（基座规模0.49B至7.61B）各生成2,016条提示，控制设计含24个数值区块、六组评论配对、盈亏情形、年度EPS升降和两种盈余意外幅度，并用A/B答案位置及U/D覆盖384种主情景。Q8_0直接作答协议下，作者测量匹配条件答案前缀分数变化，而非校准后的市场概率。主EPS对比在检查点间从−0.19到86.80个百分点；六个模型中，签名语气效应绝对值有五个超过EPS效应，动量效应也有五个超过。自然语言数值诊断准确率为51.0%—95.8%；答案编码、措辞、上下文及模型转换控制对结果作了限定。

Insight: 这些结果测量模型对输入因素的可观测依赖和数值识别能力，不揭示内部推理机制，也不证明实际收益可预测；模型可能显著受非信息性语气或动量影响。摘要明确否认实现市场回报预测的结论。

Abstract: Which inputs drive a language model’s financial forecast? We construct synthetic earnings announcements that independently reverse 20-day momentum, non-informational commentary tone, and whether fixed actual EPS beats a manipulated consensus. Six instruction/chat checkpoint conversions from four families (0.49-7.61B base parameters) receive 2,016 prompts each under a direct-answer Q8_0 protocol. The design includes 24 numerical blocks, six commentary pairs, profits and losses, rising and falling annual EPS, and two surprise sizes. Both A/B answer assignments and U/D cover all 384 primary scenarios per conversion. We estimate matched changes in conditional answer-prefix scores, not calibrated market probabilities. Across these checkpoints, the primary EPS contrast ranges from -0.19 to 86.80 percentage points. The magnitude of the primary signed tone contrast exceeds that of EPS in 5 of six models, and momentum exceeds it in 5. Natural-word numerical diagnostic accuracy ranges from 51.0 to 95.8 percent. Answer-encoding, wording, context, and conversion controls qualify these results. The experiment measures observable input reliance and numerical recognition; it establishes neither an internal reasoning mechanism nor realized return predictability. Public benchmark prompts, recorded scores, and an interactive recorded-results explorer accompany the study.

[158] Effectiveness of Hidden-State Probes for Localizing Reasoning Failures cs.LG | cs.CLPDF

Shubham Subhnil, Yannis Belkhiter, Erik Miehling, Adam Dahlgren Lindström, Elizabeth M. Daly

TL;DR: 该研究检验隐藏状态探针能否区分推理失败类型并定位失败步骤，发现分类结果依赖探针训练设计，而定位能力未超过简单轨迹长度规则。

Details

Motivation: 最终答案检查只能发现推理链错误，却不能区分任务超出模型能力、重试可能成功或可恢复轨迹中某一步出错；常规隐藏状态探针用最终答案正确性训练，会混淆这些情况。

Result: 作者在4B和8B推理模型上训练探针，判断失败类型及错误步骤，并与不使用隐藏状态的最强基线比较。对错误8B轨迹，基于中点阈值校准正确性的置信探针漏掉81%的“单步错误导致轨迹不可恢复”案例及47%的“再试一次可能成功”案例。用相同状态、但不同训练设计的探针会颠倒这两类失败的排序，说明两类信息在状态中可被探测，但读出受训练目标影响。两种规模下，受测探针定位失败步骤都不比仅按轨迹长度的规则准确；4B上直接训练定位步骤的探针在相同轨迹的10次实验中均未超过该规则。

Insight: 隐藏状态包含可区分失败类型的信息，但最终正确性探针未必按需要提取；当前方法对具体失败步骤定位仍无实证优势。摘要未给模型/任务列表和错误类别样本分布，结论受探针训练方案影响。

Abstract: Verifying the final answer of a long reasoning trace may show that the trace is wrong but it does not distinguish three cases. The problem may lie beyond the model’s capability, another attempt would succeed, or one step in an otherwise recoverable trace made the trace fail. Standard hidden-state probes are trained on final-answer correctness, a label that conflates these cases. Monte Carlo rollouts distinguish the cases and locate the failing step at additional inference cost. We test the hidden states of 4B and 8B reasoning models for the failure type and the failing step and compare each probe with the strongest baseline that uses no hidden states. On incorrect 8B traces, the confidence probe, a calibrated correctness probe at a midpoint cutoff, misses 81% of cases in which a single step makes the trace unrecoverable and 47% of cases in which another attempt would succeed. A probe with a different training design over the same states reverses the ordering of these two kinds of failure, so either ordering can be read from those states. At both scales, no single tested probe locates the failing step more accurately than a rule based only on trace length, and at 4B a probe trained to predict that step fails to outperform this rule in any of 10 runs on identical traces. The confidence probe therefore indicates that an answer is wrong, but its failure-type ordering depends on its training design.

[159] OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents cs.LG | cs.AI | cs.CVPDF

Bowen Yang, Kaiming Jin, Zichen Ding, Zhenyu Wu, Zehao Li

TL;DR: OS-Helix端到端统一训练GUI操作与代码执行动作空间，通过可执行桌面状态合成、可验证任务生成及按动作步骤平衡的GSPO来学习视觉—程序混合交互。

Details

Motivation: 真实桌面自动化既需理解用户界面，也需处理文件、脚本和系统状态；仅通过提示把代码工具接到GUI智能体上会使性能退化，因此协调方式需在高质量混合数据上训练进模型。

Result: OS-Helix提出应用—文件组合来构建带真实文件资产的可执行Ubuntu状态，并通过解耦指令/评估器生成管线构造可验证最终状态的任务，无论通过GUI还是代码完成均可判定。策略先在筛选的混合数据上SFT，再于真实桌面在线RL；Step-balanced GSPO按动作步骤而非原始助手令牌聚合重要性权重，防止长代码动作主导不同动作优化。OSWorld-Verified上，27B和35B-A3B分别较匹配Qwen3.5混合基线相对提高35.0%和33.7%；27B-RL再提高42.9%，达到66.44%成功率。消融结果与学会GUI/代码协同、可扩展可验证监督及步骤均衡优化的贡献一致；并展示向WindowsAgentArena跨平台迁移。

Insight: GUI和代码工具的混合决策需通过训练学习，而不是简单外接工具；按动作步骤平衡RL更新可避免长代码输出支配优化。摘要未给基线绝对分数和Windows迁移数值，“相对提升”和最终成功率应分开理解。

Abstract: Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating files, scripts, and system state. However, native GUI/code coordination cannot be obtained by prompt-level tool composition. In our preliminary experiments, naively adding a code tool degrades a GUI agent, revealing that GUI/code routing must be internalized through training on high-quality hybrid data. We present OS-Helix, an end-to-end trained multimodal computer-using agent that unifies GUI actions and code execution in one action space. To construct the required supervision, we introduce application-artifact composition, pairing desktop applications with authentic file artifacts to instantiate executable Ubuntu states, and a decoupled instruction/evaluator generation pipeline that produces environment-grounded tasks whose final states can be verified regardless of the solution modality. We cold-start the policy with SFT on filtered hybrid data and further improve it through online RL in live desktop environments. For RL, we propose Step-balanced GSPO, which aggregates importance weight by action step rather than raw assistant tokens to prevent long code actions from dominating heterogeneous-action optimization. On OSWorld-Verified, OS-Helix-27B and OS-Helix-35B-A3B achieve relative improvements of 35.0% and 33.7% over their matched Qwen3.5 hybrid baselines, while OS-Helix-27B-RL further improves by 42.9% to reach 66.44% success. Ablations provide evidence consistent with contributions from learned GUI/code coordination, scalable verifiable supervision, and action step balanced optimization, while demonstrating cross-platform transfer on WindowsAgentArena. Our project homepage is at https://os-copilot.github.io/OS-Helix/.

[160] Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries cs.LG | cs.AI | cs.CLPDF

Anikait Singh, Teresa Zhang, Yoonho Lee, Roshen Sanjay Nair, Aviral Kumar

TL;DR: Librarian Agents训练构建器智能体在推理前把原始文档整理成适配未来问题的层级文件工作区，并以实际下游问答准确率作为强化学习目标。

Details

Motivation: 长文档检索通常在推理时被动响应查询，限制跨文档复杂推理；预先生成知识图谱又常受固定启发式约束。研究考察能否学习主动组织语料以支持多种未来查询。

Result: 构建器智能体将原始文档转成由合成文件和引用链接组成的层级文件系统，供后续回答智能体检索。工作区构建被表述为马尔可夫决策过程，构建器策略通过强化学习直接最大化后续问答准确率。在BrowseComp-Plus上，Librarian Agents较最强检索与预计算基线提高33个百分点，并可将一次性构建成本摊销到重复查询。它还零样本迁移到BRIGHT未见领域，平均准确率提高31个百分点。

Insight: 在查询到来前组织文件和链接，可把检索从即时搜索转为面向未来任务的主动整理；其价值依赖工作区可被多次复用。摘要未给构建开销、查询重复次数和基线绝对准确率，摊销优势会受使用次数影响。

Abstract: Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottlenecking agents with complex, cross-document reasoning at inference time, while precomputed structures like knowledge graphs often fall short because they rely on rigid heuristics. Instead, can we allow agents to perform anticipatory directed curation: learning to proactively reorganize unstructured corpora prior to inference to efficiently serve diverse future queries. We build on a key asymmetry in modern agentic harnesses (e.g., Claude Code): while LLM agents are adept at navigating existing filesystems to solve an immediate task, they are rarely trained to construct reusable workspaces for future use. To instantiate this capability, we introduce Librarian Agents, a framework in which a builder agent transforms raw documents into a hierarchical filesystem of synthetic files and reference links, which forms a workspace tailored for a downstream answering agent. We formulate workspace construction as a Markov decision process and optimize the builder policy via reinforcement learning to directly maximize downstream answering accuracy. Empirically, Librarian Agents outperforms the strongest retrieval and precomputation baselines by 33 percentage points on BrowseComp-Plus, amortizes upfront construction costs across repeated queries, and generalizes zero-shot to unseen domains on BRIGHT with a 31-point average accuracy improvement.

[161] Twice Upon a Time: Complementary Representations for Time-Series Reasoning cs.LG | cs.AI | cs.CLPDF

Hedi Zisling, Liran Nochumsohn, Ilan Naiman, Mihir Parmar, Omri Azencot

TL;DR: 该研究用两种互补时间序列表征联合推理：折线图保留绝对数值与原坐标系，归一化延迟嵌入则消除正幅度缩放和偏移、突出时间结构。

Details

Motivation: 时间序列语言模型需决定表示保留哪些信息、消除哪些变化；只用一种表征会把固定归纳偏置带到所有下游任务。

Result: 模型通过专用视觉编码器把折线图和归一化延迟嵌入两种视觉视图整合到同一语言模型，以视觉令牌及多层特征融合传递信息。推理期干预验证两种视图具有不同不变性特征；单视图消融显示其组合尤其有益于超越基础感知的预测和推理任务。基于Qwen3-VL-8B的双视图模型在TSRBench总体准确率53.2%，高于仅折线图的44.5%及受测最强专用TSLM的36.7%；TSExam准确率89.9%，多变量ChatTS数值准确率86.8%。

Insight: 时序表示需同时保留数值坐标和对偏移/幅度变化不敏感的动态结构，两种视图的互补性优于固定单一表示。摘要未给各任务方差及计算开销，指标为特定基准结果。

Abstract: Time Series Language Models (TSLMs) enable language-based understanding and reasoning over temporal data, yet a fundamental question remains: what information should their time-series representations preserve, and what variation should they factor out? Existing TSLMs typically expose the language model to a single representation, imposing a fixed inductive bias across downstream tasks. We instead introduce complementary representations as a design principle for time-series reasoning. Our model combines two visual views: line plots preserve absolute measurements and the observed coordinate frame, while normalized delay embeddings factor out positive amplitude rescaling and offsets while exposing temporal structure. Dedicated visual encoders integrate both views into a shared language model through visual tokens and multi-level feature fusion. Evaluation-time interventions verify that the two views exhibit distinct invariance profiles, while single-view ablations show that their combination is particularly beneficial beyond basic perception, with the large gains in prediction and reasoning. Built on Qwen3-VL-8B, our dual-view model improves overall TSRBench accuracy from 44.5% with line plots alone to 53.2%, substantially exceeding the strongest evaluated dedicated TSLM baseline at 36.7%. It further achieves 89.9% accuracy on TSExam and 86.8% numerical accuracy on multivariate ChatTS alignment. Together, these results demonstrate that complementary representations provide an effective design principle for general-purpose TSLMs, enabling models to exploit temporal structure without sacrificing access to the original measurement frame.

cs.RO [Back]

[162] Complementary Future Token Pruning for World Action Models cs.RO | cs.CVPDF

Baekseung Kim, Junhoo Lee, Sohyeon Hong, Suhyun Jeon, Minkyu Kim

TL;DR: CF-Prune是免训练世界动作模型未来帧令牌剪枝框架，基于语言指令和动作注意力挑选任务相关视觉令牌，并在精度敏感去噪阶段恢复密集计算。

Details

Motivation: 世界动作模型同时预测未来视觉状态和机器人动作，但处理密集未来帧令牌带来显著推理延迟；这些未来图像服务于动作生成，不必保留视频合成所需的全部细节。

Result: CF-Prune在初始去噪前向中联合利用指令注意力与动作注意力识别任务相关令牌，即使未来帧及动作表征仍高度含噪。基于熵的阶段识别机制会在精度敏感阶段保留密集计算，以缓解剪枝导致的性能下降。在RoboLab、RoboCasa及真实世界操作任务上，剪枝率35%时平均加速1.19至1.27倍且任务成功率提高；剪枝率50%时在两个仿真基准上平均加速1.29至1.33倍，整体成功率距基线不超过1.0个百分点。

Insight: 未来帧表征服务于动作决策，任务相关细节可优先保留而非追求完整视频保真；按去噪阶段调整计算能控制剪枝风险。35%剪枝时成功率提高、50%时与基线接近，结果区分仿真和真实操作，摘要未给各任务详细分数。

Abstract: World action models (WAMs) jointly predict future visual states and robot actions, but processing dense future-frame tokens incurs substantial inference latency. We propose CF-Prune, a training-free framework for pruning future-frame tokens in pretrained WAMs. Our key insight is that future visual predictions support action generation and therefore need not preserve every visual detail required for high-fidelity video synthesis. CF-Prune combines instruction and action attention to identify task-relevant tokens during the initial denoising forward pass, even when future-frame and action representations remain highly noisy. An entropy-based phase identification mechanism further retains dense computation during precision phases to mitigate pruning-induced performance degradation. Experiments on RoboLab, RoboCasa, and real-world manipulation tasks demonstrate consistent inference speedups. At a 35% pruning ratio, CF-Prune achieves average speedups of 1.19-1.27x while improving task success rates. At a 50% pruning ratio, it achieves 1.29-1.33x average speedups on both simulation benchmarks, with overall success rates within 1.0 percentage point of the baseline.

[163] EgoJEPA: Beyond Retargeting for Dexterous Manipulation from Egocentric Videos cs.RO | cs.CVPDF

Meng Cao, Can Zhao, Jinjie Wei, Haonan Zhao, Yulong Zhang

TL;DR: EgoJEPA从第一视角人类视频学习与具身无关的潜在动作，不依赖规则式人到机器人动作重映射，并通过轻量动作适配器迁移到不同机器人。

Details

Motivation: 第一视角人类视频是规模化机器人示范的替代来源，但传统方法需将人体手腕和手指姿态按手工几何规则转换为特定机器人的控制，跨具身校准费力且会传播手部跟踪误差。

Result: EgoJEPA分三阶段：先用基于JEPA视觉预测、以手部运动差为条件的人类动作预训练，学习效应感知潜在动作；再联合预测未来视觉动态和潜在动作，分离人类先验学习与机器人控制参数化；最后用轻量动作适配器适配不同机器人。在三种机器人具身、五个真实操作任务上，域外评测平均成功率74%，高于重映射基线65%；跨具身累计耗时从743.2小时降至392.7小时，减少47.2%。

Insight: 在潜在空间学习动作及其视觉后果，可避免为每个机器人重新手工设计人体姿态重定向规则。实验覆盖三种具身和五项任务，但摘要未列任务分项成功率、硬件及训练时间构成。

Abstract: Egocentric human videos offer a scalable alternative to costly robot demonstra- tions, yet transferring their manipulation priors to robot control remains chal- lenging. The commonly adopted retargeting-based approaches convert human wrist and finger poses into embodiment-specific action commands through hand- crafted geometric mappings. However, such mappings require meticulous recal- ibration across different embodiments and risk propagating hand-tracking errors into downstream robot control pipelines. To this end, we propose EgoJEPA, a three-stage framework that learns embodiment-agnostic representations from ego- centric human videos without rule-based human-to-robot retargeting: 1) Human- action pre-training learns effect-aware latent actions through JEPA-style visual prediction conditioned on hand-motion differences; 2) Latent-action-based world modeling jointly predicts future visual dynamics and latent actions, which decou- ples human prior pre-training from robot-specific control parameterizations; 3) Embodiment-specific tuning adapts the pretrained model to diverse robots through lightweight action adapters. Experiments on five real-world manipulation tasks across three robot embodiments demonstrate the effectiveness and efficiency of EgoJEPA. It achieves a 74% average success rate under the out-of-domain evalu- ation, compared with 65% for the retargeting baseline, while reducing cumulative cross-embodiment wall-clock cost by 47.2%, from 743.2 to 392.7 hours.

Ruibin Ju, Ruifeng Cai, Min Xu, Lin Wang

TL;DR: X-Fly通过恢复DAgger和Flow-GRPO训练全块航拍视觉语言导航策略，并显式学习到达目标区域后的停止决策，以降低逐航点重规划成本。

Details

Motivation: 完整执行预测动作块可摊销VLM调用，将每个执行航点推理时间从195毫秒降到42毫秒，但执行状态因此偏离专家示范，训练数据既未监督这些状态的恢复，也未监督模型在自身抵达时终止。

Result: 在OpenFly test-seen中，完整动作块行为克隆47.78%的失败来自未停止。X-Fly分阶段训练：Recovery DAgger为学习者访问的状态标注可接回未来专家轨迹的平滑动作块，并在首次进入目标区域时标STOP；Flow-GRPO随后根据同任务闭环结果联合优化动作块流控制器和伯努利停止策略，并加入结果验证的停止监督。每次决策使用八项控制时，test-seen成功率74.18%、test-unseen 51.73%；完整块BC分别为16.45%和18.43%，DreamFly为32.04%和29.46%。

Insight: 块式执行能减少昂贵模型查询，但需针对学习者状态分布补足恢复和终止监督。结果显示相较所列基线提升显著，摘要未给测试环境规模、成功率置信区间和平均飞行时间。

Abstract: Aerial vision-language navigation (VLN) agents built on large vision-language models are expensive to query. Executing a complete predicted action chunk before replanning amortizes this cost, reducing model inference from 195 to 42 ms per executed waypoint for our policy. It also moves the states at which the policy is queried away from expert demonstrations, which supervise neither recovery from these states nor termination at the learner’s own arrival. On OpenFly test-seen, no-stop failures account for 47.78% of full-chunk behavior cloning (BC) outcomes. We present X-Fly, a staged training framework for full-chunk aerial VLN. Recovery DAgger labels learner-visited decision states with smooth chunks that reconnect to future expert segments and with STOP at the first in-region state. Flow-GRPO then jointly refines the chunked flow controller and a Bernoulli STOP policy from same-task closed-loop outcomes, supplemented by outcome-verified stopping supervision. With eight controls per decision, X-Fly reaches 74.18% SR on test-seen and 51.73% on test-unseen, compared with 16.45% and 18.43% for full-chunk BC and 32.04% and 29.46% for DreamFly.

[165] CarryOn: A Dual-Loop Harness for Personalized and Reliable Robot Assistance cs.RO | cs.CVPDF

Zixuan Wang, Yuqi Liu, Yuxin Chen, Sengqiao Yang, Jinhui Ye

TL;DR: CarryOn在冻结VLA策略外增加规划和执行双循环，前者维护并随交互更新用户/场景上下文，后者屏蔽危险动作并在失败时复用和改进恢复技能。

Details

Motivation: 通用VLA虽能执行开放世界操作，但真实机器人协助还缺少用户偏好个性化和可靠执行：复杂任务分解需依赖持久偏好，部署则需可解释安全保障及对偶发物理失败的恢复。

Result: CarryOn的规划循环持续将用户级和场景级记忆与新观测对齐，并通过交互修订，以支持跨对话及场景变化的个性化任务选择与执行 grounding。执行循环监测策略rollout，预测危险接触并屏蔽相应动作；失败时调用可复用控制恢复技能，反思既往失败后继续完善。在真实机器人及仿真中，系统能为不同用户和场景安排符合偏好的子任务；将已安全微调VLA违规率从52.6%降至6.1%，复用改进后的技能时恢复成功率从13%升至80%。

Insight: 个性化状态记忆和运行时安全/恢复控制承担不同作用：用户偏好指导计划，执行环监控危险与失败。结果来自指定机器人和任务，摘要未给用户数、违规定义及恢复技能跨场景泛化细节。

Abstract: While generalist vision-language-action (VLA) models have enabled diverse open-world manipulation, real-world robotic assistance requires two critical capabilities they currently lack: personalization and reliable execution. First, executing an instruction like “make me a sandwich” requires grounding subtask decomposition in persistent user preferences rather than relying on a single generic solution. Second, reliable deployment demands explainable safety assurance that proactively prevents hazards and gracefully recovers from occasional physical failures. To address these gaps, we present CarryOn, a dual-loop harness designed to augment a frozen VLA policy. The planning loop maintains persistent user-level and scene-level context that is continually grounded against new observations and revised through interaction, enabling personalized task selection and execution grounding across conversations and changing scenes. The execution loop actively supervises policy rollouts, shielding actions from predicted hazardous contact. When execution fails, the system invokes reusable control-based recovery skills that restore task progress and are refined through reflection on earlier failures. On a real robot and in simulation, CarryOn dispatches preference-consistent subtasks across users and scenes, reduces the violation rate of an already safety-finetuned VLA from 52.6% to 6.1%, and increases recovery success from 13% to 80% when refined skills are reused.

Sibaek Lee, Kyeongsu Kang, Seongbo Ha, Yewon Jeon, Joonyeol Choi

TL;DR: 该免训练3D高斯语言图细化方法对目标区域按文本嵌入注入最小必要语义先验，保留非目标区域，并用中心化余弦读取消除语言嵌入公共分量导致的查询退化。

Details

Motivation: 将视觉语言特征蒸馏到3D高斯可形成任意文本查询的语言地图，但部署时用户指定的少数目标常定位不可靠；修复目标定位又需保留其它开放词汇查询能力。

Result: 方法在已蒸馏语言图上使用可文本提示的分割器识别目标区域，将区域视觉嵌入与目标文本嵌入做凸组合，系数控制先验注入强度，非目标区域保持不变。为避免过量注入覆盖外观线索和一般查询能力，作者对每个目标闭式求解仍能使其胜出的最小系数，无需调参。研究还发现文本嵌入共享公共分量，注入后标准余弦读取可能变得与查询无关，因此在读出阶段做中心化。三个基准上，开放词汇分割持续提升，在Replica上的基座mIoU约翻倍；语言目标定位也更可靠。方法还能作为插件迁移到现成场和对象级语言地图，并展示四足机器人导航到自然语言目标。

Insight: 目标感知注入需要控制在满足定位的最低强度，兼顾特定对象与开放词汇查询；读出中心化针对注入后的公共偏置。摘要未给三个基准名称和详细分数，实际机器人部分为演示。

Abstract: Distilling vision-language features into 3D Gaussian Splatting yields a language map that can be queried with arbitrary text. In deployment, however, a small set of user-specified targets must be reliably located, which current distilled maps often miss, while open-vocabulary queryability for other words must remain intact. We propose a training-free, target-aware refinement of an already-distilled language map. Guided by a text-promptable segmenter, the visual embedding inside each detected target region is blended with the target text embedding, a convex combination whose coefficient sets the amount of injected prior, while non-target regions are left untouched. Injecting too much overwrites appearance cues and general queryability, so we seek, for each target, the smallest coefficient that still lets it win, and we obtain every coefficient in closed form, leaving no hyperparameters to tune. We further identify a failure mode of injection in language-goal localization. Text embeddings share a common component, and injecting them makes the standard cosine read-out query-agnostic, which a centering step in the read-out removes. Across three benchmarks, the refinement consistently improves open-vocabulary segmentation, roughly doubling the base mIoU on Replica, and localizes language goals more reliably than the base map. It also transfers as a plug-in to off-the-shelf field-based and object-level language maps and supports a real-world demonstration in which a legged robot navigates to natural-language goals. Project page and code: https://lab-of-ai-and-robotics.github.io/target-aware-langmap/

[167] REKI: Registering Knowledge in VLAs cs.RO | cs.CV | cs.LGPDF

Juliette Marrie, Paul Pacaud, Adrien Ramanana Rahary, Shizhe Chen, Moritz Böhle

TL;DR: REKI是仅用公开数据预训练的2.4B视觉—语言—动作模型，由VLM和流匹配动作专家组成，并以少量寄存器令牌在专家缓存中保留近期VLM输出。

Details

Motivation: 机器人操作策略需利用近期历史保持连续执行，而额外记忆通常会增加推理成本；研究目标是在小规模VLA中以低成本记忆提升模拟和真实机器人的任务表现。

Result: REKI用精选的公开机器人、人类第一视角及视觉语言数据混合训练，模型由视觉语言骨干和流匹配动作专家构成。动作专家中的少量寄存器令牌汇总每帧VLM输出并保存在专家缓存中，作为近期记忆，作者称成本可忽略。LIBERO-Plus、RoboTwin Clean2Rand和RoboCasa365上，只有约两倍规模的模型超过REKI，形成模型规模—性能Pareto前沿。记忆提升仿真和真实机器人成功率，并使姿态间振荡约减少四倍。

Insight: 把VLM逐帧表征压入动作专家缓存中的寄存器，可在不显著增加成本时利用近期历史；振荡减少说明记忆也可能改善动作稳定性。摘要未给各基准分数、记忆消融的成功率差值和真实任务设置。

Abstract: We introduce REKI, a 2.4B vision-language-action model (VLA) pretrained exclusively on public data that sets a new Pareto frontier between performance and model size: on LIBERO-Plus, RoboTwin Clean2Rand and RoboCasa365, it is outperformed only by models about twice its size. REKI consists of a vision-language model (VLM) followed by a flow-matching action expert, and is pretrained on a curated mixture of public robot, egocentric human and vision-language data. Additionally, we endow it with a memory that gives the policy access to its recent past at negligible cost: a few register tokens in the action expert summarise the output of the VLM at each frame and persist in the expert’s cache. This memory improves success in simulation and on real robots, and makes oscillations between poses about four times rarer. REKI uses a simple model design and training paradigm, and is optimised to be efficient at training and inference. We release the full code across data curation, training, inference and evaluation, deployment, and all pretrained and finetuned model weights: https://github.com/kyutai-labs/reki.

[168] T2-z: Test-Time Optimization of Environment Latents for Robotic World Models cs.RO | cs.AI | cs.CVPDF

Chenyuan Zhou, Yining Hong, Huang Huang, Yunfan Jiang, Wenlong Huang

TL;DR: T2-Z为机器人世界模型加入无监督可学习环境潜变量，并在测试时冻结模型、仅根据少量新交互优化潜变量以适配未知摩擦、质量或环境规则。

Details

Motivation: 动作后果不仅取决于可见图像和动作，还受摩擦、质量及人为设定规则等未观测或未说明环境因素影响，固定世界模型难适应新配置。

Result: T2-Z在训练中交替优化：一阶段固定潜变量、跨环境学习通用动作条件动力学；另一阶段冻结世界模型，仅依据世界预测优化环境潜变量，使其无须环境因子标签而自行形成结构。测试时模型保持冻结，初始化新环境潜变量并用一条或多条交互轨迹进行适配。在7种仿真条件和4项真实机器人任务中，物体预测误差指标从15.20降至7.00，动作成功率从33.73%升至72.96%；消融显示仅一条测试交互轨迹也能有效估计潜变量。

Insight: 把环境差异压入独立潜变量，可将模型适应与共享动力学学习分开，并把测试时更新限制在小型条件变量。摘要未列具体环境因素、误差指标定义及各真实任务分项结果；测试时成功率提高依赖额外交互。

Abstract: Predicting how the world responds to an action requires more than what can be seen: robots must account for environmental factors that are neither directly observable nor explicitly specified, from physical properties such as friction and mass to human-defined environmental rules. We introduce T2-Z for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions. This compact latent captures underlying environmental variation without supervision of what environmental factors exist or what values they take. During training, T2-Z alternates between two stages: a world-model optimization stage that fixes the latents and learns general action-conditioned dynamics across environments; and an environment-latent optimization stage that freezes the world model and optimizes the conditioning latents, allowing latent structure to emerge purely through world prediction. At test time, the world model remains frozen and a newly initialized environment latent is optimized from one or more test-time interactions, adapting the model to previously unseen environmental configurations. Across 7 simulated settings and 4 real-world robotic tasks, T2-Z reduces object prediction error metric from 15.20 to 7.00 and raises action success from 33.73% to 72.96%. Its emergent latents capture structured representations of individual and compounded factors across diverse visual scenes. Ablations further show that T2-Z can efficiently infer environment latents from as little as a single test-time interaction trajectory.

cs.SE [Back]

[169] WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents cs.SE | cs.CLPDF

Weihao Li, Zihang Xu, Zhongqiu Wang, Songwei Yu, Wenqiang Zhu

TL;DR: WEAVE把经验证的PR历史转为依赖结构化、可执行的多PR任务，并提出Graph Credit度量依赖一致的部分进展，为长时程代码智能体提供更密集可验证奖励。

Details

Motivation: 真实软件工程通常由多个关联PR逐步完成特性、迁移或系统修复，而大多数可执行仓库基准仍以单个问题/PR为单位；现有多PR设置常用粗粒度汇总，无法体现变更依赖。

Result: WEAVE利用仓库校准的类型化变更位置，将相关PR组织成有界DAG并实例化为统一可执行任务。Graph Credit是确定性、基于测试的度量，用于衡量与依赖关系一致的部分进展，并支持密集可验证RL奖励。任务构造、智能体评估、监督微调和强化学习实验显示，WEAVE可生成连贯可执行任务，比平坦评分更忠实地衡量进展，并为代码智能体训练提供有效监督和奖励。

Insight: 多PR任务中部分变更的价值取决于依赖关系，按图结构评分比无结构累计完成度更合适。摘要未给基准规模、模型或性能提升数值，结论主要为框架与定性实验结果。

Abstract: Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requests (PRs), requiring coordinated modifications across a repository. Yet most executable repository-level benchmarks retain a single issue or PR as the task unit, while existing multi-PR settings rely on coarse aggregation and structure-agnostic evaluation. This mismatch obscures dependencies among changes and limits progress measurement and learning signals for long-horizon code agents. We introduce WEAVE, a framework that transforms verified PR histories into executable, dependency-structured tasks. WEAVE leverages repository-calibrated typed change loci to organize related PRs into bounded DAGs and instantiate each as a unified executable task. We further introduce Graph Credit, a deterministic, test-grounded metric that measures dependency-consistent partial progress and supports dense, verifiable rewards for reinforcement learning. Experiments on task construction, agent evaluation, supervised fine-tuning, and reinforcement learning show that WEAVE yields coherent executable tasks, enables more faithful progress measurement than flat scoring, and provides effective supervision and verifiable rewards for training code agents.

eess.AS [Back]

[170] Full-Duplex Interaction with Speech, Expressions and Gestures eess.AS | cs.AI | cs.CV | cs.SDPDF

Siyin Wang, Wenyi Yu, Terumi Chiba, Xianzhao Chen, Xiaohai Tian

TL;DR: ELLSA 2是全双工多模态对话模型，同时生成语音、手势和表情，并用分离的聆听/说话状态持续驱动非语言行为。

Details

Motivation: 面对面交流需在说话和聆听过程中协调语音、手势与表情；现有系统常把语音交互和共语手势生成分开处理，难以持续生成对话相关非语言表达。

Result: 自回归分块合成器融合预训练声学特征以及对话骨干和语音合成器中的聆听、说话隐藏状态，因此模型即使保持语言静默也可持续生成非语言行为。为将对话理解转为语义手势，作者提出上下文语义调用和模板引导，分别解决何时调用语义手势及如何实现。研究还建立对话感知共语手势数据与评估流程，探索以参考式多模态大模型作为自动裁判。实验显示ELLSA 2与开源全双工语音交互模型相比具竞争力，且在对话感知手势和表情指标上超过级联基线；语义模板引导进一步改善语义手势质量。系统级评估与人类判断相关性较高，作者将其视为初步评估指标。

Insight: 全双工模型需要在聆听与发声时都协调非语言生成；把“是否调用”与“如何实现”分开有助于语义手势控制。自动多模态裁判与人类相关只是初步证据，摘要未给具体指标、数据规模和相关系数。

Abstract: Human face-to-face conversation requires coordinating speech, gestures and expressions across both speaking and listening. We present ELLSA 2, an end-to-end full-duplex dialogue model that jointly optimizes speech interaction and streaming gesture-expression generation. An autoregressive, chunk-wise synthesizer combines pretrained acoustic features with distinct listening and speaking hidden states from the dialogue backbone and speech synthesizer, enabling continuous non-verbal generation even when the model is verbally silent. To translate dialogue understanding into vivid semantic gestures, we introduce contextual semantic calls and template guidance, separating whether to invoke an available semantic gesture from how to realize it. We also establish a curated data and evaluation pipeline for dialog-aware co-speech gesture generation and investigate reference-based multimodal large language models (MLLMs) as automatic judges. Experiments show that ELLSA 2 remains highly competitive with open-source full-duplex speech interaction models and outperforms cascaded baselines across dialog-aware gesture and expression metrics. Semantic template guidance further significantly improves semantic gesture quality. Strong system-level correlations with human judgments support these reference-based scores as useful preliminary metrics for full-duplex and semantic gesture assessment. Together, these results advance dialogue modeling from spoken responses toward coordinated multimodal interaction.

q-bio.QM [Back]

[171] Documenting Trofinetide Treatment Phenotypes in Rett Syndrome with a Dual-LLM Consensus Pipeline q-bio.QM | cs.CLPDF

Daniel Palacios, Guantong Qi, Mikael Guzman Karlsson, Shawntel K. David, Mohammed Sameeruddin

TL;DR: 该研究用双LLM共识管线从Rett综合征患者临床记录提取18类曲妥替尼治疗相关表型，并以专家标注和其他表型测试其提示泛化。

Details

Motivation: 曲妥替尼是Rett综合征首个获批治疗，但人工审阅病历耗时，缺乏可扩展真实世界疗效监测；自动抽取还需区分药物不良反应与疾病本身表现。

Result: 作者分析108名在Texas Children’s Hospital持续接受曲妥替尼治疗患者的26,763份病历记录，抽取4类不良反应、13类Rett临床特征和药物拒绝共18种表型。流程先关键词筛选，再由两个LLM独立分类并要求共识，汇总为患者—时间点矩阵。架构和提示在腹泻开发集选择，冻结后将表型定义替换应用于其余17种；提示比较评估183个专家标注单元。要求腹泻当前且严重的提示表现最佳，准确率84.2±0.0%、F1=0.674，比正则表达式高47个百分点（p<0.0001）。专家每类抽查6项调用，两正三负，整体对92/102项（90.2%）达成一致。13类临床特征是疾病表现而非药物不良反应；粗细运动、语言/沟通和刻板行为在每次访视中有92%—100%患者被记录为存在。

Insight: 上下文推理和双模型共识可扩展多域表型抽取，但报告的是每次访视是否记录存在，而不是变化方向或药物导致的改善/恶化；观察到的疾病症状不能归因于治疗不良反应。人工审核每表型仅抽查6项，尚不能替代临床审阅。

Abstract: Objective: Trofinetide, approved in 2023 as the first Rett syndrome treatment, lacks scalable real-world monitoring because chart review is labor-intensive. We developed a dual large language model (LLM) consensus pipeline to extract 18 treatment-response phenotypes, comprising 4 adverse effects, 13 Rett clinical features, and medication refusal, from clinical notes. Materials and Methods: We analyzed 26,763 notes from 108 patients with confirmed sustained trofinetide exposure at Texas Children’s Hospital. The pipeline filters notes by keyword, classifies each through two LLMs requiring consensus, and aggregates a patient-by-timepoint matrix. Architecture and prompt were selected on a diarrhea development set, then frozen and applied to the other 17 phenotypes with the phenotype definition substituted, as an out-of-sample test. The reported prompt comparison scores 183 expert-labeled cells. Results: A prompt requiring diarrhea to be active and severe performed best (84.2 $\pm$ 0.0% accuracy; F1 = 0.674), 47 percentage points above regular-expression matching ($p < 0.0001$). Expert reviewers judged six of the pipeline’s calls per phenotype, three positive and three negative, and agreed with 90.2% (92/102). The 13 Rett clinical features are manifestations of the disorder itself rather than adverse effects of trofinetide. Gross and fine motor impairment, language/communication, and stereotypy were documented present in 92-100% of patients at every visit. Discussion: In-context LLM extraction captured multi-domain treatment responses. The outcome is documented presence at each visit, not a direction-of-change judgment. Conclusion: Coupling in-context LLM reasoning with a consensus architecture offers a scalable alternative to keyword and regular-expression extraction for real-world evidence, adapting to new phenotypes and medications through configuration alone.

Table of Contents

cs.CL [Back]

[1] MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis cs.CL | cs.CVPDF

[2] AbridgeKV: Compressing Long Reasoning into the KV Cache of Learned Pause Tokens cs.CL | cs.LGPDF

[3] CoTS: Competitive Token Selection for Latent Reasoning in Large Language Models cs.CL | cs.AIPDF

[4] PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models cs.CLPDF

[5] Prune the Summary, Not the History: Source-Judged Compaction for Long-Horizon Agents cs.CLPDF

[6] CoTranslator: Reverse to Forward Chain-of-Thought Translator for Reasoning Distillation cs.CL | cs.AI | cs.LGPDF

[7] Can LLMs Anticipate Their Cruxes? cs.CL | cs.LGPDF

[8] ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews cs.CL | cs.AI | cs.IRPDF

[9] Multimodal AI Detection for Math-Heavy Scientific Text cs.CLPDF

[10] A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models cs.CL | cs.AI | cs.MAPDF

[11] From Observation to Intervention: Distilling Self-Generated In-Context Demonstrations via Executable Causal Intervention cs.CLPDF

[12] What Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination cs.CL | cs.LGPDF

[13] System1-Arena: Which Decisions Can Be Left to System 1? cs.CL | cs.AI | cs.LGPDF

[14] FGSS-BO: Feedback-Guided Hypothesis Management for LLM-Based Bayesian Optimization cs.CLPDF

[15] LLM-Based Weak Annotation for Cybersecurity Tweet Classification: A Teacher-Student Framework cs.CLPDF

[16] Making every stage of medical device document assessment with large language models deterministic cs.CL | cs.IRPDF

[17] Emotion Is Not External Knowledge: Internal Attention Signals for Affective State Reasoning cs.CLPDF

[18] RenoLayout: Unified Floorplan Renovation and Furniture Layout for Constraint-Aware Residential Design cs.CLPDF

[19] Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction cs.CLPDF

[20] Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning cs.CL | cs.LGPDF

[21] OPRD: On-Policy Reminder Distillation for Long-Horizon Coding Agents cs.CLPDF

[22] Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence cs.CLPDF

[23] SceneWeave: Audience-Guided Scene Exploration for Dramatic Adaptation cs.CLPDF

[24] Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning cs.CLPDF

[25] Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling cs.CLPDF

[26] EMO: A Closed-Loop Test-Time Computation Framework via Alternating Context Optimization and Logits Steering cs.CL | cs.AIPDF

[27] CLUE: Uncovering Social Context for Pragmatic Understanding cs.CLPDF

[28] Mosaic: Multi-Session Agentic Reinforcement Learning cs.CL | cs.AI | cs.LGPDF

[29] Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing cs.CLPDF

[30] Beyond Downstream QA: Rethinking How We Evaluate Agent Memory cs.CL | cs.AI | cs.LGPDF

[31] AI Consilium: a Benchmark of LLM Clinical Multidisciplinary Second Opinions cs.CL | cs.AIPDF

[32] Training Reasoning Models to Generate Diverse Scientific Ideas cs.CLPDF

[33] OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling cs.CLPDF

cs.CV [Back]

[34] BD-HazardVLM: Probing Vision-Language Models for Latent Defensive-Driving Hazards in Bangladesh Road Scenes cs.CV | cs.LG | cs.ROPDF

[35] Orbia: Do Generated Videos Form a Consistent 3D World? cs.CVPDF

[36] WorldCast: Exploring Intelligent Visual Generation in World State Prediction cs.CV | cs.AIPDF

[37] ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models cs.CV | cs.AIPDF

[38] Blame Errant Words, Not the Canvas: Defect-Aware Spatial Credit Assignment for Visual Text Generation cs.CVPDF

[39] RIGen: Beyond Action Following with Reciprocal Interaction in Generative Gameplay cs.CVPDF

[40] Probing Negation Understanding in Vision-Language Models With Object Attention cs.CV | cs.AI | cs.CLPDF

[41] Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation cs.CVPDF

[42] Pixels to Tokens: Token Space Efficient Active Learning for Low-Budget Semantic Segmentation cs.CV | cs.LGPDF

[43] VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents cs.CV | cs.CLPDF

[44] DeSpatial: The devil of Agentic Spatial Reasoning Lies in 3D Itself cs.CVPDF

[45] Mind the Tail: Data Selection Through Sparse Concepts cs.CVPDF

[46] Audio-Visual Dog Identification and Tracking in Real-World Videos cs.CV | cs.LGPDF

[47] RoPE-Flow: Monocular Vision-based Robot Pose Estimation via 2D Graph-Conditioned 3D Flow Matching cs.CV | cs.ROPDF

[48] Can World and Action Modeling Benefit Each Other under Unified Causal Training? cs.CVPDF

[49] Sparse Attention for Video Generation Acceleration via Growing Sparsity and Reduced Search cs.CVPDF

[50] VisualTrust: Video Reasoning under On-Screen Claim Framing cs.CVPDF

[51] ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling cs.CVPDF

[52] Do VLAs Really Follow Instructions? Diagnosing How-Level Instruction Following in Vision-Language-Action Models cs.CV | cs.ROPDF

[53] FocusOPD: Structure-Guided On-Policy Distillation for Diffusion Models cs.CVPDF

[54] TRACER: A Multimodal Harness for Patient Care in Hospitals cs.CV | cs.AIPDF

[55] GeoPano: Towards Geometrically Accurate 3D Reconstruction from a Single Panorama cs.CVPDF

[56] Dusting the Phantom: Gaussian Allocation for Fading Dynamic Content cs.CVPDF

[57] VLA-$Δ$: Learning Physical State Transition for Vision-Language-Action Models cs.CVPDF

[58] Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG cs.CV | cs.AIPDF

[59] ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer cs.CV | cs.CL | cs.MMPDF

[60] CoViG: Coarsened Vision GNN for Image Classification cs.CVPDF

[61] AdaLoop: Thinking with the Vision Encoder cs.CVPDF

[62] CLAD: Keypoint Matching Using Global Line Correspondences cs.CV | cs.ROPDF

[63] Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs cs.CVPDF

[64] Where, How, and When: Query-Guided Grounding for Video Understanding cs.CV | cs.AIPDF

[65] PET Quantification-Preserving Registration for Longitudinal Whole-Body PSMA PET/CT cs.CVPDF

[66] Can Visual Generation Expand What Unified Multimodal Models Know? cs.CV | cs.AIPDF

[67] Cross-Prompt Inference Mitigates Rare-Class Suppression in Imbalanced VLM Finetuning cs.CVPDF

[68] GRASE: Geometry-native Real-to-sim Agentic Scene Modeling from Video cs.CVPDF

[69] FilterFusion: Prior-Guided Adaptive Filter Fusion for Efficient Video Denoising cs.CVPDF

[70] MYOPIA: Understanding the Limits of Tree-Based Reasoning in Vision-Language Models cs.CVPDF

[71] Hear, Localize, and Reason: Spatially Aware Scene Understanding for Audio-Visual LLMs cs.CV | cs.SDPDF

[72] Spurious Attention Heads in Vision Transformers: Mechanistic Identification of Annotation-Driven Bias in Medical Chest X-Ray Analysis cs.CV | cs.CLPDF

[73] SCMerge: Spatial-Consistency-Aware Token Pair Merging for Efficient Semantic Segmentation cs.CVPDF

[74] FusionAudit: Pathway-Conditioned Robustness Auditing for Native Multimodal Models cs.CVPDF

[75] Edit4D: Editable 4D Scene Generation with Textual Control cs.CVPDF

[76] Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration cs.CVPDF

[77] Beyond Source Prompts: Towards Visually Grounded AI-Generated Video Quality Assessment cs.CVPDF