cs.CL [Total: 14]
cs.CV [Total: 61]
cs.RO [Total: 2]
eess.IV [Total: 2]
cs.LG [Total: 3]
cs.AI [Total: 2]
cs.DL [Total: 1]

cs.CL [Back]

[1] A Survey of Automated Presentation Coaching: Systems, Methods, and Open Challenges cs.CLPDF

Wen Liang, Li Siyan, Zackary Rackauckas, Julia Hirschberg

TL;DR: 本文对自动化演讲辅导系统进行了系统性综述，涵盖发音训练、韵律建模和语音合成等领域，提出了一个五维任务分类法来归类现有系统，并指出了该领域面临的关键开放挑战。

Details

Motivation: 动机在于填补自动化演讲辅导领域缺乏系统性综述的空白，通过整合计算机辅助发音训练、韵律建模和语音合成等交叉领域，为现有系统提供分类框架并识别研究缺口。

Result: 通过提出的五维任务分类法（涵盖音段发音、词汇重音、超音段韵律、节奏和内容忠实度），将现有系统映射到该框架中，揭示了覆盖范围的不足。

Insight: 创新点在于首次系统性地对自动化演讲辅导领域进行多维度分类和比较，并明确指出了标注数据稀缺、口音公平性反馈和实时诊断延迟等关键开放挑战，为未来研究提供了清晰方向。

Abstract: Automated coaching for oral presentations sits at the intersection of computer-assisted pronunciation training (CAPT), prosody modeling, and speech synthesis, yet no prior work has systematically surveyed and compared existing systems along these dimensions. This survey reviews and categorizes automated presentation coaching systems, spanning pronunciation tutors, fluency and prosody coaches, multimodal trainers, and conference Q&A practice tools. We introduce a five-dimensional task taxonomy - covering segmental pronunciation, lexical stress, suprasegmental prosody, pacing, and content faithfulness - and explicitly map surveyed systems onto it to reveal coverage gaps. We further review the core technical methods these systems employ: TTS-based exemplar generation and diagnostic methods for pronunciation, prosody, and fluency assessment. Key open challenges include the scarcity of annotated presentation corpora, achieving accent-fair feedback across diverse L1 backgrounds, and delivering low-latency diagnostics for real-time rehearsal.

[2] Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs cs.CL | cs.LGPDF

Fahd Seddik, Fatemeh Fard

TL;DR: 本文提出了一种用于评估大型语言模型中潜在思维表示的公理化框架，包含四个独立于下游基准分数的度量指标，旨在揭示基准准确率所掩盖的表征缺陷。该框架通过形式化四个功能公理（因果性、最小性、可分离性和稳定性）并定义相应的量化度量，直接对表征本身进行评估。作者在23个推理任务上对开源权重LLM进行了审计，发现没有候选模型能同时满足所有公理，且表征在区分任务类型方面可靠，但无法区分同一任务内的不同问题，同时表征编码的信息基本未超出输入嵌入已有的内容。

Details

Motivation: 现有评估方法将表征质量与模型能力混为一谈，导致无法将失败归因于表征本身而非处理它的模型，因此需要一种独立于下游准确率的评估框架来揭示潜在思维表征的根本缺陷。

Result: 在23个推理任务（如空间推理、事实问答）上对开源权重LLM的审计表明，没有模型能同时满足所有四个公理；表征能可靠区分任务类型但无法区分同一任务内的问题；且表征编码的信息极少超出输入嵌入已有内容。这些失败在稠密、推理蒸馏和强化学习训练的模型家族中一致存在。

Insight: 创新点在于提出了一个公理化的、独立于下游性能的评估框架，直接量化表征质量，从而能够揭示基准测试掩盖的结构性缺陷；客观来看，该框架为理解LLM内部表征的局限性提供了新的方法论视角，并指出当前LLM的潜在思维表征存在根本性结构差距，而非仅受模型规模或训练过程影响。

Abstract: We introduce an axiomatic evaluation framework for latent thought representations in LLMs, comprising metrics that are independent of downstream benchmark scores and reveal representational failures that benchmark accuracy masks. Existing evaluations conflate representation quality with model capacity. Therefore, failures cannot be attributed to the representation rather than to the model that processes it. We formalize four functional axioms (Causality, Minimality, Separability, and Stability) and define a quantitative measure for each, computed directly on the representation independently of downstream accuracy. We audit open-weight LLMs across 23 reasoning tasks (e.g., Spatial Reasoning, Factual QA). We find that no candidate satisfies all four axioms simultaneously, that the representations distinguish task type reliably but cannot distinguish between two questions within the same task, and that the representations encode little information beyond what is already present in the input embedding. The failure is consistent across dense, reasoning-distilled, and RL-trained model families, indicating that the gap is structural rather than a property of model size or training procedure.

[3] Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents cs.CL | cs.AI | cs.LGPDF

Vedant Patel

TL;DR: 本文研究了LLM智能体在长对话中处理事实更新时的记忆维护问题，发现即使前沿模型在完整上下文条件下准确率可达92%，但在有限自维护记忆下准确率显著下降至77%，且该差距随对话长度增加而扩大。作者构建了强化学习环境Supersede，并通过对小型开源模型进行微调，将事实更新准确率从9.0%提升至16.7%，证明了该问题可通过训练改善。

Details

Motivation: 解决LLM智能体在长周期、多轮次交互中难以跟踪动态变化事实（如地址变更、价格更新）的问题，即智能体无法有效丢弃过时信息并使用最新事实的缺陷。

Result: 在LongMemEval的知识更新子集上，即使使用gpt-5.4，有限记忆下的准确率较完整上下文下降15个百分点（92%→77%），且该差距具有统计显著性（p<0.005）；通过对Qwen2.5-3B进行GRPO微调，在真实对话上的事实更新准确率从9.0%提升至16.7%。

Insight: 首次构建了以事实时效性为奖励目标的强化学习训练环境，证明了记忆更新能力可通过针对性训练提升，而非仅依赖模型规模扩大；揭示了对话长度（而非压缩比）是影响记忆维护性能的关键因素。

Abstract: Large language model (LLM) agents operate over long, multi-session interactions in which facts change: a user moves, a price updates, a plan is revised. Acting correctly requires using the current value of a fact and discarding values that have been superseded. We isolate this ability on real conversational data and show that it is a distinct, unsolved failure. On the knowledge-update subset of LongMemEval, replacing an agent’s full context with a bounded, self-maintained memory drops accuracy from 92% to 77% even on a frontier model (gpt-5.4), a gap that is statistically significant (paired McNemar p<0.005) and persists across model scale while full-context accuracy saturates near 92%. The bottleneck is therefore memory maintenance, not comprehension, and is not closed by a stronger model. We then ask whether this is merely an undersized memory, and find it is not: as the conversation grows 24x, accuracy falls further (from 68% to 28%), and granting the agent proportionally more memory yields no detectable recovery (28% to 28%, n=25). The failure scales with the length of the conversation, not the compression ratio. We release Supersede, an open reinforcement-learning environment (on the verifiers / prime-rl stack) that turns this measurement into a training signal: agents are rewarded for answering from the current value and penalized for stale ones. Finally, we close the loop and show the gap is trainable: GRPO fine-tuning a small open model (Qwen2.5-3B) on this environment nearly doubles its held-out supersession accuracy on real, unseen conversations (9.0% to 16.7%, a single run), along a monotonic checkpoint curve indicating the learned policy, not the harness, carries the gain. To our knowledge this is the first trainable environment whose reward targets temporal fact-currency, and the first evidence the supersession gap can be trained down, not only measured.

[4] Masked Language Flow Models cs.CL | cs.LGPDF

Iskander Azangulov, Kianoosh Ashouritaklimi, Leo Zhang, Simon Vary, Patrick Rebeschini

TL;DR: 本文提出了一种名为Masked Language Flow Models (MLFMs)的新方法，它通过将掩码机制整合到流语言模型(FLMs)中，使用连续随机插值桥接部分掩码序列和干净序列，从而支持条件生成。该方法允许将预训练的掩码扩散模型(MDMs)通过轻量级适配转换为MLFMs，并提出了一种交替进行连续去噪和离散解掩码自信令牌的新型采样器，以更好地支持多步推理任务。

Details

Motivation: 动机是解决现有并行语言生成方法的局限性：掩码扩散模型(MDMs)在少步采样时因跨令牌位置因子化近似而性能下降，而流语言模型(FLMs)虽能实现单步生成，但在需要多步推理的复杂任务中被迫解码所有令牌，效率低下。

Result: 在GSM8K和MT-Bench基准测试上进行了评估，首次证明了基于流的语言模型可以扩展到解决下游推理和指令遵循任务，取得了积极的结果。

Insight: 创新点在于将掩码机制与连续流模型结合，通过连续随机插值实现条件生成，并设计了一种交替连续去噪与离散解掩码的采样策略，这为并行语言生成提供了更灵活高效的框架，同时支持从预训练MDMs的轻量级转换。

Abstract: Masked Diffusion Models (MDMs) promise fast, parallel language generation, but their reverse transition factorises across token positions – an approximation that breaks down in the few-step sampling regime where parallel generation ought to provide the greatest efficiency gains. Flow Language Models (FLMs) sidestep this limitation by learning a continuous flow that transports noise toward clean sequences represented in Euclidean space, inducing a flow map that can be distilled for single-step generation. However, this makes complex tasks requiring multi-step reasoning problematic for FLMs, as FLMs are forced to decode every token during generation. To address this, we introduce Masked Language Flow Models (MLFMs), which incorporate masking into FLMs using a continuous stochastic interpolant to bridge partially masked and clean sequences. This design enables conditional generation via continuous flows and allows pretrained MDMs to be converted into MLFMs through a simple, lightweight adaptation. Leveraging this flexibility, we propose a novel sampler that alternates continuous denoising with the discrete unmasking of confident tokens to better support multi-step reasoning. We evaluate our approach on GSM8K and MT-Bench and find, for the first time, that flow-based language models can be scaled to solve downstream reasoning and instruction-following tasks.

[5] Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety cs.CLPDF

Ting Ma, Xiufeng Huang, Benlei Cui, Xiaowen Xu, Shikai Qiu

TL;DR: 本文提出了Yuvion LLM，一个专为对抗性鲁棒内容安全和更广泛AI安全而设计的大语言模型。该模型将对抗鲁棒性和智能体能力作为核心目标，通过包含对抗感知数据构建、知识增强持续预训练、基于策略的多任务安全后训练（如风险感知监督微调和基于强化学习的策略优化）以及安全感知的智能体强化学习在内的完整流程进行构建。

Details

Motivation: 现有通用大语言模型的安全开发往往忽视了其对抗性本质，导致在涉及规划、工具使用和多步推理的真实安全场景中表现不足，实测的安全性能高估了实际部署的鲁棒性。

Result: 在作者提出的Yuvion LLM RiskEval (YLRE)评估套件（包含93个基准测试）中，Yuvion LLM在安全导向的基准测试上表现出明显优势，尤其在对抗条件下展现出极强的鲁棒性，同时保持了扎实的整体能力。Yuvion-8B在多项安全任务上超越了包括GPT-5.4和Qwen3-MAX等更大规模模型在内的大多数最先进基线。

Insight: 核心创新在于将AI安全明确视为一个对抗性问题，并构建了一个将对抗鲁棒性与智能体能力（如工具使用和多步推理）协同优化的端到端训练流程。此外，引入的综合性评估套件YLRE为衡量模型在真实、对抗性安全场景下的能力提供了更全面的基准。

Abstract: As large language models are increasingly deployed in real-world systems, safety failures can still lead to harmful outputs and dangerous misuse. We argue that the essence of safety is adversarial: many failures arise not from natural inputs alone, but from strategic attempts to evade model policies and safeguards. However, existing general-purpose model development largely overlook this adversarial nature, and often remain insufficient for realistic safety scenarios involving planning, tool use, and multi-step reasoning, causing measured safety performance to overestimate real deployment robustness. To address this gap, we present Yuvion LLM, a large language model built for adversarially robust content safety and broader AI safety. Yuvion LLM treats adversarial robustness and agentic capability as first-class objectives. Its pipeline combines adversarially aware data construction, knowledge-enhanced continued pretraining, and policy-grounded multi-task safety post-training, including risk-aware supervised fine-tuning and reinforcement learning-based policy optimization, together with safety-aware agentic reinforcement learning for tool use and multi-step reasoning in complex safety scenarios. We further introduce the Yuvion LLM RiskEval (YLRE), a collection of 93 benchmarks across four evaluation categories, covering diverse open and internal evaluations with a focus on safety, adversarial robustness, and real-world capability requirements. Across these evaluations, Yuvion LLM demonstrates clear advantages on safety-focused benchmarks and particularly strong robustness under adversarial conditions, while maintaining solid overall capability. Notably, Yuvion-8B outperforms most state-of-the-art baselines, including substantially larger models such as GPT-5.4 and Qwen3-MAX, on several safety tasks.

[6] When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search cs.CLPDF

Yiling Tao, Shihan Deng, Meiling Tao, Pengzhi Wei, Zhichao Hu

TL;DR: 本文介绍了DiscoBench，一个用于评估搜索代理在深度搜索中主动识别模糊性、提出澄清问题并通过用户交互恢复正确推理路径能力的基准测试。该基准包含11个真实领域中的211个样本和463个模糊实例，覆盖四种模糊类型，并设计了多轮交互的用户模拟器，从任务效用、模糊检测、交互策略和成本效率四个维度评估模型性能。实验表明，当前搜索代理在模糊检测和有效澄清方面存在能力差距，且重复搜索而非澄清往往比直接猜测表现更差。

Details

Motivation: 现有基准通常假设用户查询是完整和明确的，忽略了现实世界搜索请求经常模糊、不完整甚至事实错误的问题，这种模糊性在深度搜索的多步推理链中可能传播并导致代理走向错误搜索轨迹。

Result: 在代表性大语言模型上的实验显示，模糊检测和有效澄清是两种不同的能力，重复搜索而非请求澄清通常比直接猜测表现更差，突显了当前搜索代理在检索能力和交互式问题解决之间的关键差距。

Insight: 创新点在于提出了一个专注于澄清感知深度搜索的基准DiscoBench，通过模拟真实模糊场景和多轮交互，系统评估搜索代理的交互式问题解决能力，揭示了现有模型在模糊处理和主动澄清方面的不足，为改进搜索代理的交互设计提供了方向。

Abstract: Search agents powered by large language models (LLMs) are increasingly used to solve complex information-seeking tasks, requiring multi-step retrieval and reasoning to fulfill user goals. However, existing benchmarks often assume that user queries are complete and explicit, overlooking the fact that real-world search requests are frequently vague, underspecified, or even factually incorrect. In deep search scenarios, such ambiguity can propagate along multi-step reasoning chains and lead agents toward incorrect search trajectories. To address this gap, we introduce DiscoBench, a benchmark for clarification-aware deep search, designed to evaluate whether search agents can proactively identify ambiguity, ask effective clarification questions, and recover correct reasoning paths through user interaction. DiscoBench contains 211 samples and 463 ambiguity instances across 11 real-world domains, covering four ambiguity types. We further design a user simulator for multi-turn interaction and evaluate model performance from four perspectives: task utility, ambiguity detection, interaction strategy, and cost efficiency. Experiments on representative LLMs show that ambiguity detection and effective clarification are distinct capabilities, and that repeatedly searching instead of asking for clarification often performs worse than direct guessing, highlighting a critical gap between retrieval ability and interactive problem-solving in current search agents.

[7] Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment cs.CL | cs.AI | cs.CE | cs.LGPDF

Zhuo Zuo, Li Yue, Wenhao Zheng, Chenpeng Wang, Xianggen Liu

TL;DR: 本文提出了一种名为平滑最大平均差异（SMMD）的新损失函数，旨在解决大语言模型（LLMs）在需要数值精确输出的任务中表现不可靠的问题。该方法通过结合数值标记间的距离核函数和图平滑性，将预测的数值分布与目标对齐，并鼓励局部一致性。

Details

Motivation: 标准交叉熵损失将数值标记视为无结构的类别，忽略了其数值间的度量结构，这导致LLMs在需要数值精确性的任务上表现不佳。

Result: 在数学推理、算术计算、时钟时间识别和图表问答四个数值目标任务上，SMMD在多个开源LLM和VLM骨干网络上进行评测，其准确率持续优于交叉熵损失和近期提出的数值目标损失。

Insight: 核心创新点在于设计了结合距离核函数和图平滑性的SMMD损失，将经典的MMD方法适配到数值预测场景。客观分析表明，MMD与平滑性具有互补效应，且基于距离的核函数设计至关重要。

Abstract: Despite their strong general capabilities, large language models (LLMs) often remain unreliable when outputs must be numerically precise. A key reason is the training objective: standard cross-entropy treats numeric tokens as unstructured categories and ignores the metric structure of their values. We address this mismatch with Smooth Maximum Mean Discrepancy (SMMD), which builds on the classic MMD by incorporating value-distance kernels over numeric tokens and graph-based smoothness. With this kernel defined over a numeric sub-vocabulary, SMMD aligns the predicted numeric distribution to the target via kernel matching and smooths the prediction-target residual over the induced kernel graph to encourage local consistency. We evaluate SMMD on four numeric-target tasks: mathematical reasoning, arithmetic calculation, clock-time recognition, and chart question answering, across multiple open-weight LLM and VLM backbones. SMMD consistently improves accuracy over both cross-entropy and recent numeric-target losses; analyses show complementary effects between MMD and smoothness and underscore the importance of distance-based kernel design. Code is available at https://github.com/Zuozhuo/smmd-loss.

[8] Position Bias Correction is Insufficient for One-Pass Attention Sorting cs.CL | cs.AIPDF

Qiong Tang, Xiangkun Hu, Xiangyang Liu, Yiran Chen, Yunfan Shao

TL;DR: 本文研究了长上下文语言模型中的位置偏差问题，并评估了通过单次注意力排序来纠正该偏差的有效性。论文提出了去偏单次注意力排序方法，通过估计位置偏差曲线来校正原始注意力分数，但实验表明，仅进行位置偏差校正不足以达到迭代排序的性能。

Details

Motivation: 长上下文语言模型存在位置偏差，导致中间位置的信息未被充分利用。迭代的注意力排序方法成本高昂，因此作者假设位置偏差是主要瓶颈，并探索通过单次去偏排序来降低部署成本。

Result: 在LLaMA-2-7B-32K-Instruct模型上，去偏处理与未校准的单次排序结果相同（包含准确率为94.83%）；在YaRN-Llama-2-7b-64k模型上，去偏使准确率提高了8.67个百分点，但仍比迭代排序低14.84个百分点，仅缩小了37%的差距。

Insight: 论文的创新点在于提出了基于提示估计位置偏差曲线并进行校正的单次排序方法。客观分析表明，位置偏差校正本身并不充分，迭代重排序带来的额外收益超越了单纯的偏差校正，这为理解注意力机制和优化排序策略提供了新视角。

Abstract: Long-context language models suffer from position bias, where information in middle positions is underutilized. Attention Sorting addresses this by iteratively reordering documents based on attention patterns, but its multiple sort-and-generate cycles increase deployment cost. We hypothesize that position bias is the primary bottleneck and propose Debiased One-Pass Attention Sorting, which estimates a per-prompt position-bias curve from the low-attention majority of documents and uses it to correct raw attention scores (via subtraction or division) to enable single-pass sorting. Our experiments on two models refute this hypothesis in the tested setting: on LLaMA-2-7B-32K-Instruct, debiasing produces identical results to uncalibrated single-pass sorting (94.83% containment accuracy), while on YaRN-Llama-2-7b-64k, debiasing improves accuracy by 8.67 percentage points but remains 14.84pp behind iterative sorting, closing only 37% of the gap. These results suggest that position-bias correction is insufficient to match iterative sorting, and that repeated reordering provides additional benefits beyond bias correction.

[9] Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs cs.CL | cs.AI | cs.GT | cs.MAPDF

Avni Mittal

TL;DR: 本文提出了一种扩展版狼人游戏’Triadic Werewolf’，通过引入第三方阵营’小丑’角色来评估大语言模型的多跳心智理论能力。小丑的获胜条件是故意被投票出局，这要求模型必须同时推理三种对立的效用函数。实验表明，在GPT-4.1、DeepSeek-V3.1和Llama-3.3-70B上，小丑胜率高达60-70%，而狼人胜率从未超过20%，且GPT-4.1控制的狼人常在首日投票淘汰小丑，这是一种自我挫败的行为。

Details

Motivation: 传统的心智理论评估通常采用二元社交推理游戏，其中所有可观察线索都指向单一隐藏阵营，导致语言模型仅凭强大的语言先验即可取得高分，而无需真正模拟对手的动机。本文旨在通过引入具有反转效用的第三方阵营，迫使模型进行更复杂的多智能体推理。

Result: 在60场游戏实验中，小丑角色胜率达到60-70%，狼人胜率从未超过20%。GPT-4.1控制的狼人在60-70%的游戏中于首日投票淘汰小丑，这是一种非理性的自我挫败行为。自学习机制对DeepSeek和Llama模型有帮助，但对GPT-4.1有负面影响，且代价由村民阵营承担。只有DeepSeek学会了’看似可疑但非故意可疑’的微妙策略，并从游戏循环中获益最大。

Insight: 论文的核心创新点在于设计了’三元激励结构’的游戏框架，通过引入效用函数反转的第三方阵营，暴露了二元推理游戏无法揭示的多智能体推理层次。这为评估语言模型的深层心智理论能力提供了更严格的测试平台，并揭示了不同模型在复杂策略学习上的差异。

Abstract: Theory-of-mind evaluations of large language models typically use dyadic social-deduction games, where every observable cue points to a single hidden side, so a model with strong language priors can score well without ever simulating opponents’ incentives. We extend the Werewolf game with a Jester, a third faction whose utility on peer suspicion is inverted because it wins by being voted out, so optimal play requires reasoning across three opposing utility functions. Across 60 games on GPT-4.1, DeepSeek-V3.1, and Llama-3.3-70B with Jester self-learning on and off, the Jester wins 60-70% of games while Werewolves never exceed 20%, and GPT-4.1 wolves vote the Jester out on day 1 in 60-70% of games, a strictly self-defeating action. Self-learning helps DeepSeek and Llama but hurts GPT-4.1, with the cost landing on Villagers rather than Werewolves. Only DeepSeek learns the subtle strategy of looking suspicious without looking intentionally suspicious, and it gains the most from the loop. Triadic incentive structure exposes a layer of multi-agent reasoning that dyadic deduction games leave invisible.

[10] From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection cs.CL | cs.AIPDF

Yasaman Haghbin, Sina Rashidi, Ali Zolnour, Fatemeh Taherinezhad, Ali Fartoot

TL;DR: 该论文提出了一种多阶段可解释性框架，旨在将基于语音的认知障碍检测黑盒模型预测转化为具有临床依据的叙述。该框架整合了基于SHAP的token归因、理论驱动的语言学特征以及一个使用LLaMA-3.1-70B-Instruct的四阶段LLM推理流程，构建于SpeechCARE-Adaptive Gating Network多模态筛查模型之上。

Details

Motivation: 解决基于Transformer的语音认知障碍检测模型缺乏临床可解释性的问题，使黑盒预测能够转化为临床医生可理解的、有临床依据的叙述。

Result: 在NIA PREPARE基准测试上，基础模型F1分数为72.11%。对70份分层英语样本的医生评估显示，框架输出与患者层面的认知特征高度一致，系统可用性量表得分为82/100，表明其具有很高的临床工作流整合潜力。

Insight: 创新点在于将模型可解释性（SHAP）与理论驱动的语言学特征（词汇丰富度、句法复杂性、语义连贯性等）相结合，并通过一个结构化的LLM推理流程生成临床叙述，为将AI模型输出转化为临床洞察提供了系统化框架。

Abstract: Speech-based cognitive impairment detection offers a noninvasive, accessible alternative to costly biomarker assays, yet transformer-based models remain clinically uninterpretable. We propose a multi-stage explainability framework that translates black-box transformer predictions into clinically grounded narratives by integrating SHapley Additive exPlanations (SHAP)-based token attribution, theory-informed linguistic features, and a four-stage LLM reasoning pipeline using LLaMA-3.1-70B-Instruct. Built on the SpeechCARE-Adaptive Gating Network multimodal screening model (F1 = 72.11% on the NIA PREPARE benchmark), the framework maps model outputs to four cognitive-linguistic dimensions, including lexical richness, syntactic complexity, and semantic coherence. Physician evaluation on 70 stratified English samples demonstrated strong alignment with patient-level cognitive profiles, and a System Usability Scale score of 82/100 indicated high potential for clinical workflow integration.

[11] ToxiREX: A Dataset on Toxic REasoning in ConteXt cs.CLPDF

Stefan F. Schouten, Ilia Markov, Piek Vossen

TL;DR: 本文介绍了ToxiREX数据集，这是一个多语言、上下文相关的毒性推理数据集，包含Reddit评论线程，并基于先前提出的毒性推理模式对评论的隐含意义进行结构化标注。数据集涵盖六种语言，收集自特定重大事件相关的帖子，包含由商业LLM标注的12.5万条训练数据和由母语者标注的近3000条测试数据。作者提供了基于提示和微调语言模型的基线结果，并开发了分层评估策略，表明任务具有挑战性。

Details

Motivation: 现有毒性检测数据集通常缺乏上下文、多语言支持和结构化推理标注，难以捕捉隐性和上下文依赖的毒性。本文旨在构建一个同时整合多语言、对话上下文和隐性毒性的数据集，以支持更精细的毒性推理研究。

Result: 在ToxiREX测试集上，通过提示和微调语言模型获得的基线结果优于随机猜测，但仍有很大改进空间，表明任务具有挑战性。作者开发了基于分层模式的评估策略来量化模型性能。

Insight: 创新点在于首次将多语言、对话上下文和隐性毒性结合，并应用毒性推理模式进行结构化标注，使数据集能解释上下文依赖的毒性。可借鉴之处包括使用模式化标注处理隐式内容，以及通过事件驱动的数据收集增强现实相关性。

Abstract: We introduce a new, contextual, multilingual dataset called ToxiREX: Toxic REasoning in ConteXt. The dataset consists of threads of Reddit comments and structured characterizations of what the comments imply, following a systematic toxic reasoning schema developed in a previous paper. Using the schema allows us to capture and explain implicit and context-dependent toxicity, while supporting mappings to existing toxicity taxonomies. The dataset includes comments in six languages (English, Arabic, Turkish, Spanish, German, and Dutch), collected from posts connected to specific major events (e.g. the 2023 Turkey earthquakes; the Russian invasion of Ukraine). We describe the context-preserving preprocessing of the threads. We create a training set of 125 thousand comments which is annotated by a commercially available LLM, and a test set of just under three thousand comments that is annotated by native speakers. We show that apparent disagreements in the test set annotations often reflect defensible alternative interpretations rather than noise. Finally, we provide baseline results by prompting and fine-tuning language models. To produce these results, we develop evaluation strategies for our hierarchical, schema-based predictions. While models perform better than random, there remains a lot of room for improvement, showing the task to be challenging. ToxiREX is the first dataset to simultaneously incorporate multiple languages, conversational context, and implicit toxicity, while using the toxic reasoning schema for rich, structured annotations. Dataset available at: https://github.com/cltl/toxirex

[12] Dialogue to Detection: A Multimodal Hybrid NLP Pipeline for Insurance Fraud Detection cs.CL | cs.AI | eess.ASPDF

Muhammad Shakeel Akram, Amal Htait, Abdul Hamid Sadka, Emma Meisingseth, Karishma Jaitly

TL;DR: 本文提出了一种用于保险欺诈检测的多模态混合NLP框架，旨在解决首次损失通知阶段早期检测的挑战。该框架通过合成方法生成包含文本对话和双人音频的多模态数据集，并集成了自动语音识别、说话人日志、命名实体识别、基于正则表达式的特征提取、LLM-RAG检索和说话人嵌入等技术，最终通过基于规则的风险评分来识别叙事重复、结构不一致和跨案件语音重复等欺诈模式。

Details

Motivation: 保险欺诈造成重大经济损失并影响运营效率，而现有方法主要依赖私有、纯文本数据集，限制了整合语言、行为和说话人特征的多模态方法的进展，因此需要开发一个能在FNOL阶段进行早期检测的、可复现的多模态框架。

Result: 通过数据集验证和组件级评估，该框架显示出稳定性和迁移潜力，为超越纯文本欺诈检测提供了一个可复现的基线。

Insight: 创新点在于构建了一个合成多模态框架来模拟真实FNOL场景，并通过结合传统NLP技术（如NER、正则表达式）与先进技术（如LLM-RAG、说话人嵌入）来构建混合检测系统，在平衡敏感性和误报率的同时，实现了对多种欺诈模式的综合检测。

Abstract: Insurance fraud imposes substantial financial losses and operational inefficiencies, raising premiums and impacting trust among legitimate policyholders. Early detection at FNOL remains a persistent challenge. Existing approaches rely largely on private, text-only datasets, limiting progress on multimodal methods that integrate linguistic, behavioural, and speaker-based indicators. We introduce a synthetic multimodal framework that replicates FNOL conditions. It generates agent-customer dialogue transcripts and two-speaker audios, performs ASR and diarisation. Downstream modules combine NER, regex-based feature extraction, LLM-RAG retrieval, and speaker embeddings in a rule-based risk score to flag narrative reuse, structural inconsistencies, and cross-case voice repetition while balancing sensitivity and false positives. Dataset validation and component-level evaluations show stability and transfer potential, offering a reproducible baseline beyond text-only fraud detection.

[13] Cognitive Episodes in LLM Reasoning Traces Enable Interpretable Human Item Difficulty Prediction cs.CL | cs.AI | cs.CY | cs.LGPDF

Chenguang Wang, Ming Li, Xinyue Zeng, Zhuochun Li, Hong Jiao

TL;DR: 本文提出Epi2Diff框架，通过将大语言模型的推理轨迹映射为认知层面的片段序列，结合片段动态特征与语义项目表示，来预测人类在测试项目上的难度。在四个真实世界数据集上的实验表明，该方法优于多种基线模型，并能提供可解释的难度归因分析。

Details

Motivation: 现有预测测试项目难度的方法依赖昂贵的人工校准或项目级文本表示，难以揭示导致项目困难的认知过程。作者认为难度应被视为项目文本属性与解题负担共同作用的结果，需要从大语言模型的推理轨迹中提取结构化、可解释的过程证据。

Result: 在四个真实世界人类难度数据集上，Epi2Diff均优于微调的小语言模型、LLM上下文学习以及监督式LLM适配等强基线。在SAT衍生的分类基准上，相比监督式LLM微调基线，Epi2Diff取得了平均8.1%的相对性能提升。

Insight: 创新点在于将LLM推理轨迹结构化为认知片段序列，并从中提取反映推理规模、努力分配和状态转换的动态特征，从而为难度预测提供了可解释的过程表征。研究发现，更难的项目会引发更费力、迭代且以实施为中心的片段动态，而非仅仅是更长的回答。

Abstract: Predicting human item difficulty is central to educational assessment, where reliable estimates support fairness and effective test construction. Existing methods often depend on costly human calibration or item-level textual representations, providing limited evidence about the cognitive processes that make items difficult. We argue that difficulty should be viewed not only as a property of item text, but also as an observable consequence of the problem-solving burden an item induces. Large Reasoning Models (LRMs) offer scalable process evidence through reasoning traces, but such evidence must be structured to support interpretable modeling. To this end, we introduce Epi2Diff (Episode to Difficulty), a framework that maps LRM reasoning traces into cognitively grounded episode sequences. These episodes group trace segments into functional problem-solving states, enabling difficulty to be modeled through reasoning scale, effort allocation, and state transitions. Epi2Diff extracts compact episode-dynamic features and combines them with semantic item representations for human difficulty prediction. Experiments on four real-world human difficulty datasets show that Epi2Diff consistently outperforms strong baselines, including fine-tuned small language models, LLM in-context learning, and supervised LLM adaptation. On SAT-derived classification benchmarks, Epi2Diff achieves an 8.1% average relative gain over supervised LLM fine-tuning baselines. Further analyses show that harder items induce more effortful, iterative, and implementation-centered episode dynamics, rather than merely longer responses. These results demonstrate that cognitive episodes in LRM reasoning traces provide a predictive and interpretable process representation for human item difficulty, offering a new lens for educational measurement with reasoning models.

[14] Vision-Default, Prior-Override: Causal Mechanisms of Perception-Knowledge Conflict in Vision-Language Models cs.CLPDF

Niclas Lietzow, Danielle Bitterman, Carsten Eickhoff, William Rudman, Michal Golovanevsky

TL;DR: 该论文通过激活修补和组件消融研究，揭示了视觉语言模型在处理视觉证据与先验知识冲突时的因果机制。研究发现，视觉基础是默认机制，而先验知识基础依赖于网络后半部分的一小部分注意力头（2.5-4.8%），这些头构成了一个稀疏的因果回路。

Details

Motivation: 解决视觉语言模型在视觉证据与记忆的世界知识冲突时如何调和的问题，以理解多模态系统的可靠性，而先前工作仅从行为层面描述，缺乏组件级的因果解释。

Result: 在三个VLM家族中，消融关键注意力头可将先验知识提示下的预测从知识基础答案翻转为视觉基础答案（68-96%的案例），而对视觉基础预测的影响很小（0.8-7.5%），显示出不对称的因果结构。

Insight: 创新点在于通过多粒度激活修补和机制分析，识别出处理感知-知识冲突的稀疏因果回路，包括路由头和写入头，这一结构在不同模型家族和规模中保持一致，为理解VLM的内部工作机制提供了新的视角。

Abstract: Vision-language models must reconcile visual evidence with memorized world knowledge when the two conflict. How they resolve this conflict shapes the reliability of multimodal systems, yet prior work characterizes it behaviorally without a component-level causal account. We combine activation patching across three granularities (residual stream, attention heads, and MLP sublayers) with model-component ablation studies and mechanistic analysis. Across three VLM families, we find that visual grounding emerges by default, whereas prior grounding depends on a small set of causally necessary attention heads (2.5-4.8%) concentrated in the second half of the network. These heads enable answers from stored world knowledge (e.g., “red” for a strawberry) despite conflicting visual input. Ablating them flips predictions from knowledge-grounded to visually grounded answers in 68-96% of cases under prior-knowledge prompts, but changes only 0.8-7.5% of visually grounded predictions, establishing an asymmetric causal structure. The identified heads decompose into routing heads, which modulate information flow, and writing heads, which directly project answer tokens into the residual stream. This structure is consistent across model families and scales, revealing a sparse causal circuit underlying perception-knowledge conflict in VLMs.

cs.CV [Back]

[15] Not All Relations Rotate Alike: Transformation-Aware Decoupling for Viewpoint-Robust 3D Scene Graph Generation cs.CV | cs.AI | cs.GR | eess.IVPDF

Jingjun Sun, Chaowei Wang, Zhirui Liu, Jiaxu Tian, Ming Yang

TL;DR: 本文提出了一种名为Transformation-Aware Decoupling (TAD)的视角鲁棒3D场景图生成框架，旨在解决现有模型在观察视角（偏航旋转）变化时关系预测不遵循预期变换行为的问题。该框架根据谓词的变换行为（方向性谓词应随观察坐标系变化，而接触、支撑等谓词应保持稳定）将关系推理解耦为两个分支，并利用视角稳定的物体表示来支持推理。

Details

Motivation: 当前3D场景图生成模型在处理同一3D场景的不同观察视角（偏航旋转）时，其关系预测往往不符合预期的变换行为，这揭示了谓词层面的变换异质性：方向性谓词（如左、前）应随观察坐标系变换，而大多数接触、支撑和语义谓词（如站立在、附着于）应保持稳定。本文旨在减少这种不匹配，提升模型的视角鲁棒性。

Result: 在3DSSG数据集上的大量实验表明，TAD在不使用训练时旋转增强的情况下，在偏航视角变化下实现了最先进的鲁棒性，同时在标准基准测试中保持了有竞争力的性能。

Insight: 论文的核心创新点在于根据谓词的变换行为对关系推理进行解耦，并设计了变换特定的描述符和组感知的辅助监督，以鼓励两个分支捕获互补的关系线索。这为构建对观察视角变化鲁棒的3D场景理解模型提供了一种新颖的、具有可解释性的结构设计思路。

Abstract: 3D Scene Graph Generation (3DSGG) represents 3D scenes as structured object-relation-object graphs, providing a compact relational abstraction for spatial understanding. In embodied intelligence settings, the same 3D scene may be observed by agents from viewpoints that differ by yaw rotations. However, current 3DSGG models often fail to produce relation predictions that follow the expected transformation behavior under such viewpoint shifts. This behavior reveals an empirical mismatch related to predicate-level transformation heterogeneity: directional predicates such as left, front, right, and behind should transform with the observation frame, whereas most contact, support, and semantic predicates such as standing on and attached to should remain stable. To reduce this mismatch, we propose Transformation-Aware Decoupling (TAD), a viewpoint-robust 3DSGG framework that decouples relation reasoning according to predicate transformation behavior and is supported by viewpoint-stable object representations. TAD decomposes relation reasoning into two parts: one learns cues that should stay stable across viewpoints, while the other learns directional cues that should change with the observation frame. The two parts are merged for standard multi-label predicate prediction. Transformation-specific descriptors and group-aware auxiliary supervision encourage the two branches to capture complementary relation cues. Extensive experiments on 3DSSG show that TAD achieves state-of-the-art robustness under yaw viewpoint changes without training-time rotation augmentation, while maintaining competitive performance under the standard benchmark. The project page is available at https://tad-predicate.github.io/.

[16] ReWorld: Learning Better Representations for World Action Models cs.CVPDF

Tianze Xia, Lijun Zhou, Kaixin Xiong, Jingfeng Yao, Yu Zhu

TL;DR: 本文提出了ReWorld，这是首个专为自动驾驶世界动作模型设计的表示学习框架。该框架通过直接优化中间表示，在生成和规划模块中分别施加未来预测监督、跨模态对齐和基于安全临界边界的难负样本监督，从而学习更好的世界表示。

Details

Motivation: 现有世界动作模型主要关注架构设计，而如何高效学习用于规划的更好世界表示尚未充分探索。标准训练仅监督生成和规划模块的输出端，导致承载世界知识的中间表示只能作为拟合输出的副产品被间接塑造。

Result: 在nuScenes和NAVSIM数据集上的实验表明，ReWorld将微调后的视频生成FVD指标提升了23.9%（从81.3降至61.9），将闭环PDMS从89.1提升至90.4，且无需强化学习或后处理，并将从头开始训练的收敛速度加快了约2倍。

Insight: 核心创新在于将中间表示作为直接优化目标，从三个互补维度（生成模块的未来预测监督、规划模块的跨模态对齐与安全边界判别性塑造）系统性地塑造表示。论文还系统分析了现有视频生成世界模型中表示学习方法的局限性，为其有效性提供了理论解释。

Abstract: World Action Models (WAMs) model future environment evolution under action conditioning, offering a scalable paradigm for autonomous driving. However, existing approaches focus largely on model architecture design, and how a WAM can efficiently learn better world representations for planning remains underexplored. To address this gap, we propose ReWorld, the first representation learning framework specifically designed for autonomous-driving world action models. In WAMs, standard training supervises only the output ends of the generation and planning modules, leaving the intermediate representations that carry world knowledge to be shaped only indirectly, as byproducts of fitting these outputs. The core idea of ReWorld is to treat intermediate representations as direct targets of optimization, shaping them along three complementary dimensions. On the Video DiT responsible for generation, we impose future-predictive supervision on its intermediate representations. On the Action DiT responsible for planning, we first align its intermediate representations cross-modally with the video world representation, then further shape them to be discriminative around safety-critical boundaries via hard-negative supervision. In addition, we systematically analyze the effectiveness of existing representation learning methods in video generation world models, and discuss why their performance is limited on this task. Experiments on nuScenes and NAVSIM show that ReWorld improves fine-tuned video generation by 23.9% in FVD (81.3 to 61.9), raises closed-loop PDMS from 89.1 to 90.4 without any post-training such as RL or post-processing, and accelerates from-scratch convergence by approximately 2x.

[17] Aloe-Vision: Robust Vision-Language Models for Healthcare cs.CV | cs.CLPDF

Jaume Guasch-Martí, Enrique Lopez-Cuena, Martín Suárez-Fernández, Jordi Bayarri-Planas, Anna Arias-Duart

TL;DR: 本文提出了Aloe-Vision，一个专为医疗保健设计的鲁棒视觉语言模型家族。为了解决高质量医疗多模态数据稀缺、安全关键环境下的鲁棒性担忧以及评估基准狭窄且可能被污染的问题，作者构建了Aloe-Vision-Data数据集，并基于此训练了7B和72B两种规模的模型。同时，为了支持可靠评估，作者还引入了CareQA-Vision基准，并揭示了当前模型在对抗性和误导性输入下的脆弱性。

Details

Motivation: 医疗领域专用的大型视觉语言模型发展受限于高质量多模态数据稀缺、安全关键环境下的鲁棒性担忧，以及现有评估基准狭窄且可能被污染，无法进行可靠评估。

Result: 在综合基准测试中，基于高质量训练混合数据训练的Aloe-Vision模型在保持通用能力的同时，相比基线模型取得了显著提升，达到了与最先进替代方案相竞争的性能水平。

Insight: 创新点包括：1) 构建了Aloe-Vision-Data，一个整合了医疗和通用领域、多模态与纯文本来源的大规模、高质量过滤数据集；2) 开源了完整的模型权重、训练方案和数据；3) 引入了CareQA-Vision，一个基于西班牙医学和护理专业入学考试、污染可能性低的新型视觉问答基准，用于可靠评估；4) 揭示了当前LVLMs在临床环境中面对对抗性输入的可靠性挑战。

Abstract: Large Vision-Language Models (LVLMs) specialized in healthcare are emerging as a promising research direction due to their potential impact in clinical and biomedical applications. However, progress is constrained by the scarcity of high-quality medical multimodal data, concerns about robustness in safety-critical settings, and the narrow and potentially contaminated evaluation benchmarks that limit reliable assessment. To address these issues, the field requires state-of-the-art solutions to be fully open and reproducible systems in which all components can be inspected, evaluated, and improved. This work introduces Aloe-Vision-Data, a large-scale, quality-filtered mixture which integrates both medical and general domains across multimodal and text-only sources, designed for direct use in model fine-tuning. Building on this dataset, we train the Aloe-Vision family of medical LVLMs, openly released with full weights, training recipes and data, in two scales (7B and 72B). Through comprehensive benchmarking, we demonstrate that high quality training mixtures produce balanced LVLMs which yield significant gains over the baseline models without compromising general capabilities, achieving competitive performance with respect to state-of-the-art alternatives. To support reliable evaluation, we introduce CareQA-Vision, a carefully curated vision benchmark derived from MIR and EIR exams, the residency entrance exams for medical and nursing specialists in Spain, offering novel vision questions with low likelihood of contamination. Finally, we show that current LVLMs remain vulnerable to adversarial and misleading inputs, underscoring reliability challenges in clinical contexts.

[18] Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos cs.CVPDF

Mohammadmahdi Honarmand, Parnian Azizian, Aaron Kline, Kae Nurge, Zerin Nasrin Tumpa

TL;DR: 该研究通过低秩适应（LoRA）方法，在400个临床医生评分的家庭视频上微调了Gemini 2.5 Pro多模态大语言模型，用于从短视频中提取自闭症谱系障碍（ASD）的行为特征。在99名儿童的留出测试集上，模型提取的特征与临床医生评分者间的一致性显著提升，并展现出零样本诊断能力，其诊断性能达到或超过了临床医生水平。

Details

Motivation: 自闭症谱系障碍（ASD）诊断年龄中位数超过四岁，存在诊断延迟问题。研究旨在利用易于获取的家庭视频数据，通过人工智能管道提供量化诊断，以帮助实现早期诊断和及时干预。

Result: 在留出测试集上，模型提取的30个行为特征中，有27个特征与临床医生评分的一致性（加权Cohen’s kappa）提升了40%（p<0.001）。作为涌现的零样本能力，直接进行ASD诊断的F1分数提升了53%（p<0.001），达到或超过了临床医生的诊断结果。使用微调后LLM提取的行为特征构建的分类器管道，在所有测试路径上都与临床医生评分的输入结果相当，达到了77%的准确率（95% CI: 68-85%）和86%的AUC（95% CI: 78-92%）。

Insight: 创新点在于将多模态大语言模型（Gemini 2.5 Pro）通过LoRA微调，转化为一个可扩展的、用于自闭症评估的行为特征提取器。研究证明了微调后的多模态LLM不仅能高精度地提取临床相关的行为特征，还能涌现出强大的零样本诊断能力，为基于家庭视频的自动化、可扩展的ASD筛查和诊断提供了新范式。

Abstract: Autism spectrum disorder (ASD) affects 1 in 31 US children, yet median age at diagnosis exceeds four years. Artificial intelligence pipelines that provide quantified diagnosis using easy to access observational data (e.g., home videos) could help with earlier diagnosis, and timely delivery of early treatments. We fine-tuned Gemini 2.5 Pro on 400 clinician-rated home videos with low-rank adaptation, training only on 30 behavioral features previously validated to produce reliable predictions when passed to various ML models. On 99 held-out children (49 ASD, 50 neurotypical), inter-rater reliability with clinicians (per-feature weighted Cohen’s kappa) improved by 40% (p<0.001), with 27 of 28 evaluable features improving. As an emergent zero-shot capability, direct ASD diagnosis F1 improved by 53% (p<0.001), matching or exceeding clinician outcomes. Classifier-assisted pipelines using fine-tuned LLM-derived behavioral features matched clinician-scored inputs across all tested pathways and achieved 77% accuracy (95% CI: 68-85%) and an AUC of 86% (95% CI: 78-92%). Fine-tuned multimodal LLMs can serve as scalable behavioral feature extractors for use in autism assessment and diagnosis.

[19] DMV-Bench: Diagnosing Long-Horizon Multimodal Agents’ Visual Memory with Incidental Cue Injection cs.CV | cs.AI | cs.CLPDF

Yujin Tang, Chenming Shang, Ruize Xu, Nikhil Singh

TL;DR: 本文介绍了DMV-Bench，这是首个用于评估多模态智能体视觉记忆的交互式基准测试。该基准基于一个包含1000种产品变体的受控家居装饰电子商务目录构建，通过文本泄漏合约确保任务的判别信号仅存在于像素中。在连续的自主购物会话链中，每个访问过的产品图像都包含一个独特的、预渲染的偶然线索，智能体随后需要回忆特定线索产品并导航至其URL。受双重编码理论启发，作者提出了DualMem记忆架构，该架构并行维护视觉和言语代码。在DMV-Bench上，DualMem在Gemini 2.5 Flash和Qwen2.5-VL-7B模型上，于所有测试链长度{5, 10, 15, 50}中均优于基线方法和三种近期多模态智能体记忆系统，其优势在控制了记忆库大小和编码位置偏差后依然存在。

Details

Motivation: 现有关于智能体记忆的研究主要集中在文本方面，缺乏在交互环境中评估智能体何时真正需要记住所见内容而非可记录内容的基准。本文旨在填补这一空白，诊断多模态智能体在长视野任务中的视觉记忆能力。

Result: 在DMV-Bench基准上，提出的DualMem架构在Gemini 2.5 Flash和Qwen2.5-VL-7B模型上，于所有测试链长度{5, 10, 15, 50}中均超越了基于描述的基线方法和三种近期多模态智能体记忆系统，达到了当前最佳性能（SOTA）。其领先优势在控制了记忆库大小和编码位置偏差后依然稳健。

Insight: 主要创新点包括：1）提出了首个专注于诊断多模态智能体视觉记忆的交互式基准DMV-Bench，通过‘文本泄漏合约’确保任务信号仅存在于视觉模态；2）受双重编码理论启发，提出了DualMem记忆架构，采用非对称的双重编码机制，其中视觉通道端到端地承载线索，而言语通道则扮演较小的查询接地角色，这为构建更鲁棒的视觉记忆系统提供了新思路。

Abstract: Research on agent memory has matured rapidly, but almost entirely on the text side: few existing benchmarks ask, in an interactive environment, when an agent genuinely needs to remember what it saw rather than what it could write down. We introduce DMV-Bench (Code: https://github.com/yyyujintang/DMV-Bench), the first interactive benchmark for multimodal-agent visual memory. DMV-Bench is built on a controlled home-furnishing e-commerce catalogue of 1,000 product variants in which a text-leakage contract keeps the discriminative signal of each task in the pixels alone. Across a chain of autonomous shopping sessions, every visited product image carries a unique, pre-rendered incidental cue, and the agent is later asked to recall a particular cued product and navigate to its URL. Inspired by dual-coding theory, we propose DualMem, a memory architecture that maintains a visual and a verbal code in parallel. On DMV-Bench, DualMem outperforms a caption baseline and three recent multimodal agent-memory systems at every chain length J in {5, 10, 15, 50} on both Gemini 2.5 Flash and Qwen2.5-VL-7B, with the lead surviving controls for memory-bank size and encoding-position bias, and an asymmetric dual-coding regime in which vision carries the cue end-to-end while the verbal channel plays a smaller query-grounding role.

[20] TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images cs.CVPDF

Jay Barot, Dan Lin

TL;DR: 本文提出了TruEye模型，用于细粒度检测和定位图像中AI生成或篡改的人类主体和场景。该模型通过掩码条件双流Transformer分离人类和场景token，并保持空间对应关系，实现了对合成内容的五类组合分类，包括将真实人类合成到真实场景中的最具挑战性情况。

Details

Motivation: 现有检测器存在对训练生成器过拟合、将检测视为不透明的二分类或依赖成本高昂的大型语言模型（LLM）解释输出等问题，无法有效应对日益增多的AI生成图像，尤其是用于欺诈和社交工程攻击的图像。

Result: 在6个数据集和新构建的FineSyn数据集上的实验表明，TruEye在准确性、推理速度和泛化到未见过的AI生成或篡改图像方面均超越了现有最先进的检测器，且运行速度比基于LLM的竞争对手快100倍以上。

Insight: 创新点包括首次提出对合成内容的五类组合分类，采用掩码条件双流Transformer架构实现人类与场景的语义分离与空间对应，以及通过token级监督和全局组合分类实现无需LLM的鲁棒可解释预测，显著提升了检测效率和泛化能力。

Abstract: AI generated images are proliferating across the Internet. While some are used for entertainment, others are weaponized for fraud and social engineering attacks on social media users. Existing detectors overfit to generators seen during training, treat detection as opaque binary classification, or rely on costly Large Language Models (LLMs) to explain their outputs. In this paper, we present TruEye, a novel model for fine grained detection and localization of AI manipulated or AI generated humans and scenes. Unlike conventional detectors that assign a single authenticity label, TruEye is the first to distinguish among five compositional categories of synthetic content, including the most challenging case in which a real human is composited into a real scene where they were never physically present. At its core is a mask conditioned dual stream transformer that separates human and scene tokens while preserving patch level spatial correspondence. Specialized reasoning within each stream and region gated cross attention enforce semantic coherence between subject and background, while token level supervision and global compositional classification yield robust, interpretable predictions without invoking an LLM. By restricting intra stream attention to semantically coherent tokens, TruEye also runs over $100\times$ faster than LLM based competitors. Experiments on 6 datasets and our newly curated FineSyn dataset, show that TruEye surpasses state of the art detectors with higher accuracy, faster inference, and stronger generalization to unseen AI generated or manipulated images.

[21] Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge cs.CV | cs.AI | cs.LGPDF

Thomas Shih-Chao Liang, Zhuoran Yu, Yong Jae Lee

TL;DR: 本文提出LaViD框架，通过语言模型生成多项选择题来提取细粒度语义知识，并将其蒸馏到视觉模型中，无需配对多模态数据，在多个细粒度基准测试中优于现有方法。

Details

Motivation: 大型语言模型（LLMs）通过大规模文本预训练获得了广泛的概念知识，但其监督其他模态模型的潜力尚未充分探索，本文旨在利用LLMs的语义知识提升视觉模型的细粒度识别能力。

Result: 在多个细粒度基准测试中，LaViD consistently outperforms recent methods like MaKD that distill from vision-language models across multiple fine-grained benchmarks. It also achieves competitive or superior performance compared to state-of-the-art visual distillation methods such as DKD and MLKD, with further gains when combined with logit standardization. On the Waterbirds dataset, LaViD substantially improves worst-group accuracy, demonstrating enhanced robustness to spurious correlations with distillation.

Insight: 创新点在于使用语言模型生成多项选择题作为概念信号，将细粒度语义知识从纯语言教师蒸馏到纯视觉学生模型中，无需图像数据，增强了模型对虚假相关性的鲁棒性，为跨模态知识转移提供了新思路。

Abstract: Large Language Models (LLMs) possess broad conceptual knowledge acquired through large-scale text pretraining, yet their potential to supervise models in other modalities remains underexplored. In this work, we propose LaViD–Language-to-Visual Knowledge Distillation–a simple and effective framework for transferring high-level semantic knowledge from a language-only teacher to a vision-only student model. Instead of relying on paired multimodal data, LaViD elicits conceptual signals from an LLM by prompting it to generate multiple-choice questions (MCQs) that probe semantic distinctions between visual classes. Each class is mapped to a soft label distribution over these MCQs, forming a rich conceptual signature that guides the student through an auxiliary distillation loss. Notably, despite using a language-only teacher without access to image data, LaViD consistently outperforms recent methods like MaKD that distill from vision-language models across multiple fine-grained benchmarks. It also achieves competitive or superior performance compared to state-of-the-art visual distillation methods such as DKD and MLKD, with further gains when combined with logit standardization. On the Waterbirds dataset, LaViD substantially improves worst-group accuracy, demonstrating enhanced robustness to spurious correlations with distillation. Code is available at https://github.com/lliangthomas/lavid.

[22] MemoBench: Benchmarking World Modeling in Dynamically Changing Environments cs.CVPDF

Haoyu Chen, Kaichen Zhou, Hang Hua, Kaile Zhang, Jingwen Qian

TL;DR: 本文介绍了MemoBench，一个用于评估动态变化环境中世界建模能力的诊断性基准。该基准围绕‘消失-重现’范式构建，要求模型在目标物体经历物理过程、从视野中消失后，能正确恢复其更新后的状态。研究涵盖了360个合成与真实场景的标注视频片段，并设计了一套结合自动化指标和基于VQA评估的测试套件，对八个SOTA模型进行了评估。

Details

Motivation: 现有视频生成模型的评测基准大多只评估目标物体在视野内的记忆一致性，少数迫使物体移出视野的基准也仅针对静态场景，忽略了遮挡期间环境动态变化的情况。本文旨在填补这一空白，评估模型在动态变化环境中对物体状态变化的记忆一致性。

Result: 在MemoBench基准上对八个最先进模型（SOTA）的评估揭示了它们在‘消失-重现’范式下记忆一致性的关键发现和开放挑战。

Insight: 创新点在于提出了首个专注于动态变化环境中‘消失-重现’范式的诊断性基准，强调了对物体在遮挡期间状态变化的记忆建模能力。这为评估和推动视频生成模型的世界建模能力提供了更精细、更具挑战性的新方向。

Abstract: Video generation models aspire to simulate dynamic environments, and several benchmarks now evaluate memory consistency across frames. However, most assess consistency only while the target remains in view, and the few that force objects out of view evaluate static scenes where nothing changes during occlusion. To bridge this gap, we introduce MemoBench, a diagnostic benchmark built around the disappear-and-reappear paradigm in dynamically changing environments: a target object undergoes a physical process, disappears from view, and must be correctly recovered in its updated state upon reappearance. We curate 360 ground-truth clips spanning synthetic and real-world scenes, and design an evaluation suite combining automated metrics with VQA-based assessment across four diagnostic pillars. Evaluation of eight state-of-the-art models reveals key insights and open challenges regarding memory consistency under the disappear-and-reappear paradigm.

[23] Perceptual 3D Simulation With Physical World Modeling cs.CVPDF

Wanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, Jared Watrous, Daniel L. K. Yamins

TL;DR: 这篇论文提出了P3Sim系统，一个用于感知3D模拟的物理世界建模系统。它能够在部分观测和不完整的3D变换信号下，模拟未来场景状态。系统结合了学习到的物理世界模型、几何条件模块和持久场景记忆，旨在实现通用的3D场景理解和变换。

Details

Motivation: 解决从图像预测场景在经历期望的3D变换后如何演化的核心问题。由于现实世界系统只能依赖部分、不完整的感知输入和局部动作，而非拥有完整3D几何和动力学的理想模拟器，因此需要一种能够处理这种不完整性的模拟方法。

Result: 论文表明，P3Sim的设计平衡了数据驱动的灵活性和内置的归纳偏置，使其成为一个灵活的感知模拟器。该系统能够泛化到多种3D变换任务，如新视角合成、物体操纵和动态场景预测，推动了通用3D场景理解的发展。摘要中未提及具体的定量基准测试结果或SOTA比较。

Insight: 宣称的创新点在于结合了学习推断与显式几何结构（通过物理世界模型、几何条件模块和持久记忆），以处理感知和动作信号固有的不完整性。从客观角度看，其核心创新在于将概率推断、几何条件化和在线记忆更新整合到一个统一的框架中，以应对部分观测下的3D场景模拟这一挑战。

Abstract: Predicting how a scene will evolve after a desired 3D transformation from images is a central goal in vision, graphics, and robotics. Yet unlike ideal simulators with full access to 3D geometry and dynamics, real world systems must rely on perceptual inputs and local actions that are inherently partial and incomplete. In this work, we present P3Sim, a physical world modeling system that simulates future scene states under both partial observations and incomplete 3D transformation signals. P3Sim is composed of three interacting components: a learned physical world model, a geometric conditioning module, and a persistent scene memory. The world model interprets perception as probabilistic inference over multimodal scene variables, providing predictions of the distributions of any scene variable conditioned on any combination of others. The geometric conditioning module provides a partial 3D transform signal for conditioning the world model at inference time. The persistent scene memory integrates predictions over time, enabling online updates and consistency under uncertainty. By combining learned inference with explicit geometric structure, P3Sim balances data-driven flexibility with built-in inductive bias. This design yields a flexible perceptual simulator that generalizes across diverse 3D transformation tasks, such as novel view synthesis, object manipulation, and dynamic scene prediction, advancing toward general purpose 3D scene understanding and transformation.

[24] Beyond Points: Spherical Distributional Part Prototypes for Interpretable Classification cs.CVPDF

Duarte Leão, Diogo Pereira Araújo, Catarina Barata, Carlos Santiago

TL;DR: 本文提出vMFProto，一种基于分布的原型网络框架，用于可解释分类。该方法将每个类别建模为超球面上冯·米塞斯-费舍尔分布的混合，通过熵最优传输实现结构化补丁到原型的分配，并采用两阶段训练策略。在多个细粒度分类数据集上，vMFProto实现了最先进的解释质量与竞争力的准确率。

Details

Motivation: 现有基于点原型的神经网络在处理归一化、方向性嵌入空间时，由于类内语义部分存在较大变异性，导致原型冗余或不稳定，损害了解释质量和鲁棒性。

Result: 在CUB-200-2011、Stanford Dogs和Stanford Cars数据集上使用冻结DINO骨干网络的实验表明，vMFProto在解释质量（一致性、稳定性和区分性）上达到SOTA水平，同时保持有竞争力的分类准确率。

Insight: 创新点包括：将原型建模为超球面上的分布（冯·米塞斯-费舍尔混合）以捕获部分特异性变异性；利用熵最优传输进行结构化补丁分配；以及结合补丁级蒸馏和分布感知多样性正则化的两阶段训练策略。

Abstract: Prototype-based neural networks aim to provide intrinsic interpretability by grounding predictions in a small set of part prototypes. However, modern vision backbones typically operate in normalized, directional embedding spaces where each semantic part exhibits substantial intra-class variability. As a result, point prototypes often become redundant or unstable, hurting both explanation quality and robustness. We propose vMFProto, a distributional part-prototype framework that models each class as a mixture of von Mises-Fisher components on the hypersphere. Each prototype learns its own concentration, capturing part-specific variability, and we use entropic optimal transport (OT) to obtain structured patch-to-prototype assignments. A two-stage training schedule performs OT-driven prototype discovery followed by end-to-end refinement with patch-level distillation and distribution-aware diversity regularization. Experiments on CUB-200-2011, Stanford Dogs, and Stanford Cars with frozen DINO backbones show that vMFProto achieves state-of-the-art explanation quality (consistency, stability, and distinctiveness) with competitive accuracy. Qualitative results confirm that vMFProto yields localized, non-redundant part evidence.

Bartosz Stachowiak, Dariusz Brzezinski

TL;DR: 本文提出了一种名为DeLux的新型跨模态修复范式，利用神经形态事件流作为结构先验，来指导RGB视频中光照伪影的针对性检测与修复。该方法在合成基准和真实世界车载视频上验证了其有效性，能够有效抑制局部伪影并恢复受损区域。

Details

Motivation: 传统RGB相机易受光晕、眩光、闪烁和过曝等光照伪影影响，导致信息不可逆丢失，而现有方法孤立处理这些问题，难以恢复被复杂空间离散图像退化完全遮蔽的结构细节。

Result: DeLux在合成基准和真实世界车载视频上均表现优异，其性能超越了现有的纯RGB基线方法和事件引导的HDR模型，在所有伪影类型上平均MS-SSIM超过0.99，并在真实车载视频中将伪影严重程度降低了高达88%。

Insight: 论文的核心创新在于提出了一种利用神经形态事件流作为跨模态先验来引导RGB视频修复的新范式，其模块化概念验证流程（检测与修复）具有启发性。同时，公开的合成伪影生成工具和真实世界评估数据集对推动该领域研究有重要价值。

Abstract: Conventional RGB cameras suffer from lighting artifacts such as flare, glare, flicker, and overexposure, leading to irrecoverable information loss that necessitates computational restoration. However, existing approaches treat these problems in isolation, failing to recover structural details completely obscured by complex spatially discrete image degradations. In this paper, we propose a novel cross-modal restoration paradigm and present DeLux, a modular proof-of-concept pipeline that leverages neuromorphic event streams as a structural prior to guide the targeted detection and inpainting of lighting artifacts in RGB video. Validation on synthetic benchmarks and real-world automotive footage demonstrates that DeLux effectively suppresses local artifacts and restores affected regions. The proposed approach outperforms existing RGB-only baselines and event-guided HDR models, achieving an average MS-SSIM of over 0.99 across all artifact types and demonstrating up to an 88% reduction in artifact severity in real-world automotive footage. The synthetic artifact generation tools and curated real-world evaluation datasets are made publicly available to foster future research on cross-modal restoration.

[26] Dismantling Pathological Shortcuts: A Causal Framework for Faithful LVLM Decoding cs.CV | cs.AIPDF

Liu Yu, Can Chen, Ping Kuang, Zhikun Feng, Fan Zhou

TL;DR: 本文提出了一种名为Fox的训练无关推理框架，旨在解决大型视觉语言模型（LVLM）中的物体幻觉问题。研究发现幻觉源于特定注意力头在关键决策步骤中与视觉证据解耦并锁定语言先验，形成病理性捷径。Fox通过视觉注意力熵探针无监督定位风险中介，采用数值logit饱和进行因果干预，并利用冲突门控协同解码策略平衡忠实性与流畅性，在多个基准测试中实现了SOTA性能。

Details

Motivation: 大型视觉语言模型虽具备复杂推理能力，但仍易产生物体幻觉。研究动机是揭示并解决导致幻觉的根本原因——一种动态结构错位，即特定注意力头在决策关键步骤中脱离视觉证据，形成绕过视觉接地的病理性捷径。

Result: 在广泛的实验中，Fox在多个基准测试上达到了SOTA性能，其性能优于SID方法29.1%，同时保持了语言的丰富性。

Insight: 论文的创新点在于从因果角度揭示了幻觉的结构性根源（风险中介注意力头），并提出了一个无需训练、在推理时通过定位和干预特定因果路径来物理切断病理性捷径的框架。其核心洞察是将忠实性解码问题转化为对注意力流的结构性诊断和针对性因果干预。

Abstract: Large Vision-Language Models (LVLMs) exhibit sophisticated reasoning but remain susceptible to object hallucination. Deviating from the prevailing attention intensity assumption, we reveal a deeper dynamic structural misalignment: hallucination is triggered at decision-critical steps where specific attention heads, acting as risky mediators, decouple from visual evidence to lock onto language priors. This establishes a pathological shortcut that bypasses visual grounding. To dismantle this, we propose Fox (Faithfulness and Observational-flow via eXpression-rectification), a training-free inference-time framework. Fox diagnoses structural misalignment using a visual attention entropy probe to localize risky mediators unsupervisedly. We then execute a targeted causal intervention via numerical logit saturation to physically sever the shortcut path. Finally, a conflict-gated cooperative decoding strategy reconciles interventional faithfulness with observational fluency. Extensive experiments demonstrate that Fox achieves SOTA performance, outperforming SID by 29.1% while preserving linguistic richness. Code is available at https://github.com/Cc2021start/Fox.

[27] AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers cs.CVPDF

Xuan-Bach Mai, Hoang-Minh Nguyen-Huu, Quoc-Nghia Nguyen, Hoang-Tung Vu, Minh-Triet Tran

TL;DR: 本文提出了一种融合CNN和Vision Transformer的鲁棒方法，用于识别AI生成的图像，以应对合成数据技术带来的数据真实性和可靠性挑战。通过在CIFAKE数据集上的广泛实验，该方法取得了97.32%的准确率，有效区分了AI生成图像和真实图像。

Details

Motivation: 合成数据技术的进步使得AI生成的图像质量极高，难以与真实图像区分，这给数据可靠性和真实性带来了重大挑战，因此需要鲁棒的检测方法。

Result: 在CIFAKE数据集上，模型展示了卓越性能，达到了97.32%的准确率，表明该方法在区分AI生成图像和真实图像方面非常有效。

Insight: 创新点在于采用融合策略，结合了CNN和Vision Transformer等多种检测方法的优势，以提升识别AI生成图像的准确性和鲁棒性，为数据认证技术提供了新思路。

Abstract: Recent advancements in synthetic data technology have opened a new era where images of remarkable quality are generated, blurring the lines between real-life images and those produced by Artificial Intelligence (AI). This evolution poses a significant challenge to ensuring the reliability and authenticity of data, underscoring the need for robust detection methods. In this paper, we present a robust approach aimed at addressing these pressing concerns. Our methodology revolves around leveraging fusion strategies, combining the strengths of multiple detection methods for identifying AI-generated images. Through extensive experimentation on the CIFAKE dataset, our model showcases remarkable performance, achieving an impressive accuracy rate of 97.32%. This accomplishment underscores the efficacy of our approach in accurately distinguishing between AI-generated images and real-life images, thus contributing to the advancement of data authentication techniques amidst the proliferation of synthetic data.

[28] Qwen-Image-2.0-RL Technical Report cs.CV | cs.LGPDF

Yixian Xu, Kaiyuan Gao, Yuxiang Chen, Yilei Chen, Zecheng Tang

TL;DR: 本文介绍了Qwen-Image-2.0-RL，这是一个基于强化学习从人类反馈（RLHF）和策略蒸馏（OPD）的后训练流程，旨在提升Qwen-Image-2.0扩散模型的视觉质量和指令遵循能力。通过构建任务特定的复合奖励模型，并采用基于GRPO的可扩展RL训练框架与策略蒸馏，模型在文本到图像生成和图像编辑任务上均取得了显著改进。

Details

Motivation: 为了解决扩散模型在视觉质量和指令遵循能力上的不足，特别是提升其在文本到图像生成和图像编辑任务中的表现，论文提出了一个结合RLHF和策略蒸馏的后训练流程。

Result: 在Qwen-Image-Bench上，模型总体得分达到57.84（比基础模型提升2.61），在文本到图像竞技场Elo评分为1193（提升78），在图像编辑竞技场Elo评分为1349（提升93），显示出在美学质量、提示遵循和编辑准确性方面的持续增益。

Insight: 创新点包括构建基于点式评分和思维链推理的任务特定复合奖励模型，以及开发结合混合无分类器引导（CFG）、组内奖励范围过滤和按类别奖励权重校准的可扩展GRPO-based RL训练框架，最后通过策略蒸馏将多个专家策略合并到单一学生模型中。

Abstract: We present Qwen-Image-2.0-RL, a post-training pipeline that applies reinforcement learning from human feedback (RLHF) and on-policy distillation (OPD) to improve both the visual quality and instruction-following capability of the Qwen-Image-2.0 diffusion model. To provide reliable reward signals, we construct task-specific composite reward models by fine-tuning vision-language models with a pointwise scoring paradigm and chain-of-thought reasoning. For text-to-image generation, the reward models cover alignment, aesthetics, and portrait fidelity dimensions. For image editing tasks, the reward system addresses instruction-following accuracy and face identity preservation. Building on this reward system, we develop a scalable GRPO-based RL training framework, incorporating a hybrid classifier-free guidance (CFG) strategy to preserve pre-trained knowledge, prompt curation via intra-group reward range filtering, and per-category reward weight calibration. To merge the task-specialized RL policies for T2I and editing, we propose on-policy distillation as the final training stage, which consolidates multiple teachers into a single student model through trajectory-level velocity matching. Extensive evaluation shows that Qwen-Image-2.0-RL achieves 57.84 overall score on Qwen-Image-Bench (+2.61 over the base model), Elo ratings of 1193 in text-to-image arena (+78) and 1349 in image edit arena (+93), demonstrating consistent gains in aesthetic quality, prompt adherence, and editing accuracy.

[29] CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations cs.CVPDF

Kyumin Hwang, Wonhyeok Choi, Jaeyeul Kim, Jihun Park, Daehee Park

TL;DR: CascadeOcc是一种新型的3D占据世界模型，它通过引入级联向量量化（VQ）机制和时空双层次结构，专注于挖掘占据表示本身的内在结构层次，而非依赖外部模态或大语言模型，以增强对复杂自动驾驶场景的表征能力。

Details

Motivation: 当前基于占据的世界模型在连接感知与规划时，过度依赖外部模态或大语言模型，未能充分利用占据表示自身固有的结构潜力。本文旨在通过优化其内在表征来提升模型性能。

Result: 在4D占据预测和运动规划的基准测试中，CascadeOcc在以视觉为中心的方法中取得了优越的性能，验证了优化内在表征是依赖外部基础模型的有效替代方案。

Insight: 主要创新点在于将级联VQ机制与自回归框架结合，遵循由粗到细的原则，通过多尺度架构从全局结构中逐步细化细节；同时引入TimeMixer捕获多尺度时间依赖性，建立了空间和时间上的双层次机制。

Abstract: This letter proposes CascadeOcc, a novel occupancy world model that prioritizes intrinsic structural hierarchy over extrinsic auxiliary modalities for autonomous driving. Occupancy world models – forecasting the future driving environment and planning the driving trajectory – effectively bridge perception and planning, but current approaches often heavily rely on external modalities or large language models, failing to fully exploit the inherent structural potential of occupancy representations themselves. To enhance representational capacity for complex 3D scenes, we integrate a cascaded Vector Quantized (VQ) mechanism into an autoregressive framework. Following a coarse-to-fine principle, CascadeOcc progressively refines fine-grained details from global structures through a multi-scale architecture. Additionally, we incorporate a TimeMixer to capture multi-scale temporal dependencies, establishing a dual-hierarchy mechanism in both space and time. Experimental results on 4D occupancy forecasting and motion planning benchmarks demonstrate that CascadeOcc achieves superior performance among vision-centric approaches, validating that optimizing inherent representations is a powerful alternative to relying on external foundation models.

[30] VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models cs.CV | physics.opticsPDF

Chanik Kang, Raphaël Pestourie, Haejun Chung

TL;DR: 本文提出了一种名为CODA的协同设计框架，用于优化面向冻结视觉语言模型（VLM）的连续密度超表面光学前端。该框架通过可微分的图像形成和基于麦克斯韦仿真的伴随梯度更新，直接优化固定零样本CLIP分类器的交叉熵损失，而无需学习重建、图像信号处理或图像保真度辅助目标。

Details

Motivation: 传统机器视觉流水线依赖高质量光学器件，其设计标准（如分辨率、像差校正）旨在产生清晰、人类可解释的图像，但这在尺寸、成本或外形受限的应用中不切实际。紧凑型超表面光学提供了替代方案，但受限于严格的物理效率。本文旨在将光学设计与下游冻结视觉模型的目标对齐，而非传统的图像形成标准，以提升受限超表面成像下的识别性能。

Result: 在ImageNet-100的二维模拟成像基准测试中，CODA将CLIP ViT-L/14的零样本准确率从基线（焦距集中）的53.75±3.57%提升至65.41±3.99%。优化后的光学器件无需重新优化，即可在CLIP、SigLIP和DINOv2等模型上跨ImageNet-100、CIFAR-100和Food-101数据集实现性能迁移。

Insight: 论文的核心创新在于将光学前端设计与冻结的视觉模型目标进行端到端协同优化，跳过了传统图像保真度标准，直接针对下游识别任务（如交叉熵损失）优化光学器件。这为在物理约束下设计专用光学系统提供了新范式，表明光学设计可以与特定AI模型的目标紧密结合，而非追求通用的人类可解释图像质量。

Abstract: Conventional machine-vision pipelines typically rely on high-quality optics that produce clean, human-interpretable images, and optical design has therefore been driven by image-level criteria such as resolution, aberration correction, and pixel fidelity. However, such optics are often impractical for size-, cost-, or form-factor-constrained applications, where compact meta-optics offer an attractive alternative but operate under strict physical efficiency limits. We propose CODA, a co-design framework that optimizes a continuous-density meta-optic front-end for frozen-model recognition using differentiable image formation and adjoint-gradient updates of Maxwell-based simulations. CODA directly optimizes the cross-entropy loss of a fixed zero-shot CLIP classifier without learned reconstruction, image signal processing, or image-fidelity auxiliary objectives. In a two-dimensional simulated imaging benchmark on ImageNet-100, CODA improves CLIP ViT-L/14 zero-shot accuracy from 53.75 $\pm$ 3.57$%$ with a focal-concentration baseline to 65.41 $\pm$ 3.99$%$. The optimized optics further transfer without re-optimization across CLIP, SigLIP, and DINOv2 on ImageNet-100, CIFAR-100, and Food-101. These results demonstrate that, under constrained meta-optic imaging, downstream recognition can be improved by aligning optical design with frozen vision-model objectives rather than conventional image-formation criteria.

[31] MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving cs.CVPDF

Nan Yang, Zhanwen Liu, Linfeng Zhang, Shangyu Xie, Yang Wang

TL;DR: MVPruner是一种用于加速自动驾驶中多视角视觉语言模型（VLM）的动态令牌剪枝方法。它通过两阶段自适应剪枝策略，根据视图信息多样性和指令文本动态分配剪枝预算并选择令牌，解决了现有方法因固定剪枝率和静态重要性指标导致的效率问题。

Details

Motivation: 多视角VLM在自动驾驶中因长视觉令牌序列导致效率低下，现有令牌剪枝方法采用固定的剪枝率分配和静态重要性指标，忽略了视图间动态重要性差异和推理过程中信息重要性的演变。

Result: 在四个基准测试上的实验结果表明，该方法性能优越。例如，配备MVPruner的DriveMM模型在DriveLM基准上实现了87.3%的FLOPs减少、预填充阶段4.97倍加速，同时保持了98.5%的准确率。

Insight: 创新点在于提出了一种两阶段自适应令牌剪枝方法，其剪枝行为与模型的动态信息需求对齐：第一阶段基于视图信息多样性分配预算并保留跨阶段贡献一致的令牌；第二阶段在指令文本引导下分配预算和选择令牌以确保任务对齐。这利用了多视角VLM在深层编码任务相关视图先验并表现出动态信息需求的特点。

Abstract: Vision-Language Models (VLMs) improve generalization and interpretability in autonomous driving but suffer from efficiency issues due to long visual token sequences, particularly in standard multi-view settings. Existing token pruning methods employ fixed pruning rate allocation and static importance metrics, ignoring dynamic inter-view importance differences and the evolving information importance during inference. Our analysis reveals that multi-view VLMs inherently encode task-related view priors in deeper layers and exhibit dynamic information requirements. Motivated by these findings, we propose MVPruner, a two-stage adaptive token pruning method that aligns pruning behavior with the model’s dynamic information requirements. The first stage allocates pruning budgets based on the information diversity of each view, and retains tokens with consistent contribution across stages, ensuring semantic representational capacity. The second stage allocates budgets and selects tokens guided by instruction text to guarantee task alignment. Experimental results on four benchmarks demonstrate the superior performance of our method. For example, DriveMM equipped with MVPruner achieves 87.3% reduction in FLOPs, 4.97* speedup in prefilling phase while retaining 98.5% accuracy on DriveLM benchmark.

[32] Explainable AI for Biodiversity Monitoring and Ecological Image Analysis cs.CV | cs.AI | q-bio.QMPDF

Brinnae Bent, Holly R. Houliston, Jiayi Zhou, Günel Aghakishiyeva, David W. Johnston

TL;DR: 本文探讨了可解释人工智能（XAI）在生物多样性监测和生态图像分析中的应用，强调XAI应成为生态模型验证的标准组成部分，以提升AI模型在生态保护决策中的可靠性和可理解性。文章提供了将XAI应用于生态计算机视觉任务（如图像分类、目标检测和图像分割）的实用指南，并通过两个航空图像案例研究（海豹检测和鲸类解剖分割）展示了XAI如何帮助识别生物线索、揭示误报原因并指导模型优化。

Details

Motivation: 生态保护实践中，计算机视觉模型虽然能自动分析图像数据以扩大监测规模，但其预测往往难以检查，可能基于虚假相关性或采样偏差，从而影响保护决策的可靠性。因此，需要XAI来帮助理解模型预测的生态学依据，确保模型推理与生态知识一致。

Result: 通过两个案例研究（海豹检测和鲸类解剖分割），XAI方法被证明能有效识别生物有意义的线索、揭示由背景和形状混淆导致的假阳性、发现边缘和遮挡效应，并指导数据收集、增强和再训练策略，从而提升模型的可靠性和可操作性。

Insight: 创新点在于将XAI系统性地整合到生态计算机视觉任务中，作为模型验证的关键工具，以增强模型透明度和科学可解释性。这有助于确保AI支持的生态证据更可靠、可理解且可行动，推动生物多样性保护的实践应用。

Abstract: Artificial intelligence is transforming biodiversity monitoring by enabling automated analysis of ecological imagery collected from camera traps, drones, satellites, underwater platforms, and other sensing systems. These tools can expand the scale and speed of conservation assessments, yet many computer vision models remain difficult to inspect, making it challenging to determine whether predictions are based on ecologically meaningful signals or on spurious correlations, sampling biases, and other artifacts that may undermine conservation decisions. We argue that explainable artificial intelligence (XAI) should become a standard component of ecological model validation because conservation practitioners increasingly depend on understanding not only whether a model is accurate, but why it is accurate. We provide practical guidance for applying XAI to three common ecological computer vision tasks: image classification, object detection, and image segmentation. To illustrate how XAI can support ecological model auditing, refinement, and deployment, we present two case studies using aerial imagery: harbor seal detection and cetacean anatomical segmentation. These examples demonstrate how explanation methods can identify biologically meaningful cues, reveal false positives driven by background and shape confounds, uncover edge and occlusion effects, and guide data collection, augmentation, and retraining strategies. More broadly, they show how explainability can help assess whether model reasoning aligns with ecological understanding. We conclude by identifying key challenges and opportunities. By making model behavior more transparent and scientifically interrogable, XAI can help ensure that AI-supported ecological evidence is more reliable, understandable, and actionable for biodiversity conservation.

Do-Eon Kim, Dongryul Park, Seungyoung Ahn, Namwoo Kang, Seong-heum Kim

TL;DR: 该论文提出了一种多模态条件高分辨率Transformer框架，用于从建筑布局图像和天线配置中预测城市电磁场（EMF）强度图。该方法通过FiLM和交叉注意力机制融合天线参数与空间特征，并引入发射器相对空间通道以支持坐标一致性的测试时增强，同时设计了结合掩码L1、多尺度结构相似性和焦点L1的复合损失函数来优化预测性能。

Details

Motivation: 基于物理模拟器预测城市环境中的电磁场强度计算成本高昂，但这对蜂窝网络规划至关重要，因此需要一种高效的数据驱动方法来生成高分辨率EMF图。

Result: 在生成500×500 EMF图的任务中，最佳模型实现了0.0461的测试平均绝对误差（MAE），比普通UNet基线提升了25.2%，比仅使用HRFormer的基线提升了31.8%；测试时增强（TTA）进一步将测试MAE降低了6.3%。

Insight: 创新点包括：结合FiLM和交叉注意力的多模态条件机制，用于融合标量天线参数和辐射模式；引入发射器相对空间通道以实现坐标一致的测试时增强；以及设计针对EMF图预测难度不平衡的复合损失函数，有效提升了预测精度。

Abstract: Predicting electromagnetic field (EMF) strength in urban environments is essential for cellular network planning but computationally expensive with physics-based simulators. We propose a multi-conditioned dense prediction framework that generates 500 500 EMF maps from building layout images and antenna configurations. Our architecture uses a High-Resolution Transformer (HRFormer) backbone with two complementary conditioning mechanisms: Feature-wise Linear Modulation (FiLM) injects scalar antenna parameters into all backbone stages, while cross-attention fuses 1-D radiation pattern tokens with spatial features at the deepest stage. We further introduce transmitter-relative spatial channels encoding distance, proximity, and bearing from the antenna, enabling coordinate-consistent test-time augmentation (TTA) that reduces test MAE by 6.3%. To address the prediction difficulty imbalance across EMF maps, we design a composite loss combining masked L1, multi-scale structural similarity (MS-SSIM), and a focal L1 term that upweights high-signal pixels, outperforming individual loss components in all metrics. Our best model achieves a test MAE of 0.0461, a 25.2% improvement over a plain UNet baseline and 31.8% over an HRFormer-only baseline.Do-

[34] Joint Transcription and Decryption of Images of Encrypted Handwritten Documents: A Comparison with the Traditional Pipeline cs.CV | cs.CL | cs.LGPDF

Marino Oliveros-Blanco, Lei Kang, Alicia Fornés, Beáta Megyesi

TL;DR: 本文提出了一种名为’直接图像解密’的端到端方法，用于处理加密手写历史文档图像。该方法绕过了传统的先转录密文符号再解密的双阶段流程，直接从图像映射到明文。以Copiale密码为案例研究，通过合成数据生成管道进行实验，结果表明这种联合建模方法比传统流程更具前景。

Details

Motivation: 当前自动破译历史加密手稿的方法依赖于转录后解密的两阶段流程，该设计对转录错误敏感，错误会传播到最终输出。本文旨在解决这一误差传播问题。

Result: 在Copiale密码案例研究中，通过合成数据生成管道创建大规模训练数据，比较了传统流程与提出的联合架构。结果表明，联合图像到明文建模是传统基于转录流程的一个有前景的替代方案。

Insight: 主要创新点在于提出了端到端的直接图像解密架构，跳过了易错的中间转录步骤。从客观角度看，将计算机视觉任务（图像理解）与密码学/语言学任务（解密）联合建模，是跨领域问题解决的一个有效思路，尤其适用于历史文档分析这类噪声大、标注稀缺的场景。

Abstract: Historical encrypted manuscripts present a challenging problem at the intersection of cryptology, linguistics, paleography, and computer vision. Current automatic decipherment approaches usually rely on a two-stage pipeline: transcription of cipher symbols from manuscript images, followed by decryption into plaintext. However, this design is sensitive to transcription errors, which propagate to the final output. We present Direct Image Decryption, an end-to-end approach that directly maps encrypted manuscript images to plaintext, bypassing the intermediate transcription stage. Using the Copiale cipher as a case study, we build a synthetic data generation pipeline to create large-scale cipher-like training data and compare the traditional pipeline with the proposed joint architecture. Results show that joint image-to-plaintext modeling is a promising alternative to traditional transcription-based pipelines.

[35] ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval cs.CVPDF

Siqiao Xue, Chunxue Xu

TL;DR: 本文提出了ZooClaw-FashionSigLIP2模型，通过结合全参数微调、知识蒸馏和WiseFT权重插值技术，解决了基础视觉-语言模型在适应时尚检索任务时泛化性与专业性之间的权衡问题。同时，作者发布了一个新的高质量时尚检索基准ZooClaw-Fashion，并对现有基准进行了系统性质量分析以缓解其结构偏差。

Details

Motivation: 解决基础视觉-语言模型在适应特定检索任务（如时尚检索）时，目标分布性能提升与模型广泛泛化能力丧失之间的根本性权衡问题。

Result: 在公平评估下，ZooClaw-FashionSigLIP2在作者测试套件的所有基准上都超越了所有基线模型，包括LoRA、更大参数量（高达10亿参数）的骨干网络以及使用外部训练数据的方法，达到了SOTA水平。

Insight: 创新点在于提出了一种简单的配方：在精选领域数据上进行全参数微调与知识蒸馏，然后通过WiseFT与基础模型进行权重插值。该方法在保持泛化性的同时显著提升了专业任务性能，超越了参数高效微调等方法。同时，构建高质量基准和系统性分析公开数据偏差也具有重要价值。

Abstract: Adapting a foundation vision-language encoder to a specialized retrieval task creates a fundamental tradeoff: gains on the target distribution come at the cost of the foundation model’s broad generalization, and fashion retrieval is a stringent instance of this problem. We present ZooClaw-FashionSigLIP2, a fashion-specialized SigLIP2-base model that resolves this tradeoff with a simple recipe – full fine-tuning with knowledge distillation on curated in-domain data, followed by \wiseft~\citep{wortsman2022wiseft} weight interpolation with the base model – and outperforms LoRA, larger backbones (up to 1B parameters), and external training data. Under fair evaluation, ZooClaw-FashionSigLIP2 outperforms all baselines on every benchmark in our suite. In addition, we release ZooClaw-Fashion, a new high-quality fashion retrieval benchmark, and a systematic quality analysis of widely-used benchmarks that exposes and mitigates structural biases in their public ground truth. We open-source the model weights and all evaluation artifacts to facilitate future research.

Jun-Sang Yoo, Seung-Won Jung

TL;DR: 本文提出了一种名为MASS（Motion-Aligned Selective Scan）的新型视频帧插值框架，旨在解决大位移和非线性运动带来的挑战。该方法将特征扫描从静态空间网格重新规划为动态运动轨迹，通过流引导的轨迹构建特征序列，并利用选择性状态空间模型（SSM）进行聚合，最终通过细化模块端到端地修正中间光流和遮挡掩码。

Details

Motivation: 基于光流的视频帧插值方法在处理大位移、非线性运动和复杂遮挡时，常因对应关系模糊而性能受限；而现有的基于选择性状态空间模型的方法仍受限于静态网格扫描，无法与物理运动对齐。

Result: 在标准基准测试上的大量实验表明，MASS取得了极具竞争力的整体性能，特别是在大位移和复杂动态的挑战性场景中，达到了最先进的（SOTA）水平。

Insight: 核心创新在于将特征扫描与运动轨迹对齐，引入了可学习的非线性路径积分来近似复杂曲线轨迹，以及基于运动幅度动态调整采样预算和步长的速度感知SSM；这种自适应策略能更高效地处理快速运动区域，同时保持静态区域的计算效率。

Abstract: Video frame interpolation (VFI) remains a challenging task, particularly when dealing with large, non-linear motions and complex occlusions. While flow-based methods are prevalent, they often struggle with ambiguous correspondences. Recent VFI methods based on selective State Space Models (SSMs) are still limited by static grid-based scanning that misaligns with physical motion. In this paper, we propose Motion-Aligned Selective Scan (MASS), a novel framework that reformulates feature scanning from static spatial grids to dynamic motion trajectories. MASS builds a feature sequence along each pixel’s flow-guided trajectory and aggregates it with an SSM. Specifically, we introduce a learnable non-linear path integration to approximate complex curved trajectories via residual velocity updates, and a velocity-aware SSM that dynamically adjusts the sampling budget and step size based on motion magnitude. This adaptive strategy allocates denser sampling to fast-motion regions while keeping static regions efficient. Furthermore, the aggregated states guide a refinement module to rectify intermediate flows and masks in an end-to-end manner. Extensive experiments indicate that MASS achieves highly competitive overall performance on standard benchmarks, establishing state-of-the-art results particularly in challenging scenarios with large displacements and complex dynamics.

[37] Scene and Human in One World: Reconstruction in a Feedforward Pass cs.CVPDF

Boao Shi, Qiao Feng, Yiming Huang, Lingjie Liu

TL;DR: 本文提出SHOW框架，通过将前馈式3D场景重建与人体网格恢复耦合在统一度量空间中，实现从单目视频中同时重建动态场景和人体。该方法利用参数化人体模型提供语义结构和尺度先验，同时利用场景几何约束人体定位，并通过可提示掩码机制处理多人遮挡场景。

Details

Motivation: 解决移动单目相机下动态场景中人体重建的尺度模糊、人场景不对齐和遮挡干扰问题，主张人体网格恢复与场景重建应相互促进以实现精确重建。

Result: 大量实验表明，SHOW在具有挑战性的相机运动、遮挡和杂乱背景下，显著提升了度量尺度一致性、人场景对齐和重建精度。

Insight: 创新点在于将人体语义与尺度先验注入归一化点云预测以实现度量尺度场景重建，并利用场景几何约束人体网格估计；可借鉴的联合训练机制使模型学习到人体感知的几何特征和几何约束的人体特征。

Abstract: Reconstructing humans in dynamic scenes from moving monocular cameras remains challenging due to scale ambiguity, human-scene misalignment, and occlusion interference. Rather than treating human mesh recovery and scene reconstruction as separate tasks, we believe that accurate human-scene reconstruction requires the two tasks to mutually inform each other: parametric human models offer semantic structure and metric-scale priors, while scene geometry provides spatial context for human localization and alignment. Built on this insight, we introduce SHOW, a mask-promptable human mesh recovery framework that couples feed-forward 3D scene reconstruction with Human Mesh Recovery in a unified metric space. SHOW injects human semantics and scale priors from parametric human models into normalized point-map prediction, enabling metric-scale scene reconstruction from inherently scale-ambiguous monocular input. In turn, the recovered scene geometry constrains human mesh estimation, encouraging spatially consistent human placement and improved human-scene alignment. To handle complex multi-person and cluttered scenes, SHOW further incorporates a promptable masking mechanism that enables flexible target-human selection while suppressing background distractions and occlusion interference. Through joint training, the model learns both human-aware geometric features and geometry-constrained human features, producing aligned metric-scale reconstructions from monocular human-centric videos. Extensive experiments demonstrate that SHOW improves metric-scale consistency, human-scene alignment, and reconstruction accuracy under challenging camera motion, occlusion, and cluttered backgrounds.

[38] SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models cs.CVPDF

Ruoyu Wang, Jialun Liu, Huayang Huang, Haibin Huang, Jiepeng Wang

TL;DR: 本文提出了一种名为SIFT的自想象微调范式，旨在解决视频扩散模型中生成的运动违反物理合理性的问题，特别是‘运动纠缠’现象。该方法通过让模型从自身生成的视频中学习，而非直接重建真实视频，并辅以运动感知判别监督和渐进式困难案例重放策略，显著提升了生成视频的物理真实感、运动解耦性和可控性。

Details

Motivation: 当前视频扩散模型在视觉保真度上虽有进步，但生成的运动常违反物理合理性，存在‘运动纠缠’问题，即独立的运动源（如相机运动和物体运动）发生非预期的耦合。作者认为这源于数据偏见和扩散模型基于重建的训练设计，导致模型倾向于复制现有运动而非学习建模基于运动学的合理运动。

Result: 广泛的实验表明，该方法在物理真实性、运动解耦和可控性方面显著提升了生成视频的质量。

Insight: 核心创新点是提出了自想象微调范式，通过打破重建捷径，让模型从自身生成中学习，并结合运动感知监督和渐进式重放策略，有效覆盖广阔的运动空间，包括真实数据中罕见或精细解耦的场景，从而提升运动建模的物理基础。

Abstract: Recent advances in video diffusion models have greatly improved visual fidelity, yet their generated motions often violate physical plausibility. We observe a common kinematic failure, “motion entanglement”, the unintended coupling of independent motion sources, such as camera movement and object motion. We identify that this issue stems from data bias and the reconstruction-based training design of diffusion models. Training on noisy videos that still retain coarse motion cues inadvertently encourages the model to replicate existing motion without an incentive to learn how to model kinematically-grounded motions. To address this, we propose a Self-Imagination Fine-Tuning (SIFT) paradigm, which enables the model to learn from its own generated videos rather than directly reconstructing real ones, breaking the reconstruction shortcut. We further employ motion-aware discriminative supervision and a progressive hard-case replay strategy to stabilize and accelerate learning. By leveraging freely-generated text prompts, our method can densely cover a broad motion space, including rare or finely-disentangled scenarios that would be costly to collect as video data. Extensive experiments demonstrate that our approach substantially improves the physical realism, motion disentanglement, and controllability of generated videos.

[39] Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling cs.CVPDF

Qinfeng Zhu, Lei Fan

TL;DR: 这篇综述论文系统梳理了全景场景分析领域的方法演进，从基于投影的适应方法、到感知畸变的工程优化、再到球面原生建模和几何感知的基座模型分词技术，并指出这一演进反映了对几何本质理解的深化而非单纯技术堆叠。论文从架构设计和训练范式两个维度组织文献，涵盖密集预测、多任务理解、开放世界感知、视觉语言推理和动态视频分析等任务，揭示了当前方法在同时实现严格球面等变性和完全复用透视预训练基座模型权重方面的结构性缺口。

Details

Motivation: 全景图像能捕获完整的视觉球面，但其平面表示必然引入畸变，这违背了标准视觉架构的底层假设。本文旨在通过综述该领域的方法演进，揭示其核心挑战与未解决的张力，并推动领域向通用全景智能发展。

Result: 本文是一篇综述，未提出具体模型，因此没有定量实验结果。它系统性地分析了现有方法的局限，并识别出当前评估协议中存在的五个系统性缺口，如缺少球面面积加权指标、接缝一致性测试等。

Insight: 论文的核心洞见在于提出了从‘畸变感知工程’到‘球面原生基座建模’的演进框架，并指出当前全景分析面临的核心结构性矛盾：无法同时满足严格的球面几何等变性和对现有透视预训练基座模型权重的完全复用。这为未来研究指明了方向，即需要开发真正球面原生的基座模型架构和训练范式。

Abstract: Panoramic images capture the complete visual sphere in a single frame, providing spatial context unattainable by conventional cameras. Yet this completeness comes at a geometric cost: the 2-sphere cannot be faithfully mapped to the plane, and every planar representation introduces distortions that violate the assumptions underlying standard vision architectures. This survey traces the evolution of panoramic scene analysis along a methodological trajectory, from projection-based adaptation, through distortion-aware engineering, to sphere-native modeling and geometry-aware tokenization for foundation models, and argues that this evolution reflects a progressive deepening of geometric commitment rather than a simple accumulation of techniques. We organize the literature along two orthogonal dimensions: architectural design (how operators interact with spherical geometry) and training paradigm (how knowledge is transferred across domains). Covering dense prediction (semantic segmentation, depth estimation, and room layout estimation), unified multi-task understanding, open-world perception, vision-language reasoning, and dynamic video analysis, we identify a central unresolved tension: among the methods surveyed, none simultaneously delivers strict spherical equivariance and full reuse of perspective-pretrained foundation-model weights, and we argue that this is a structural rather than incidental gap. We further expose five systematic gaps in current evaluation protocols, namely the absence of spherical-area-weighted metrics, seam-consistency testing, polar-robustness stratification, cross-projection generalization, and open-world protocol standardization, and propose a six-point research roadmap toward general-purpose panoramic intelligence. The corresponding repository is publicly available at: https://github.com/zhuqinfeng1999/Awesome-Panoramic-Scene-Analysis.

[40] MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations cs.CVPDF

Hejia Chen, Haoxian Zhang, Xu He, Xiaoqiang Liu, Pengfei Wan

TL;DR: 本文提出MindFlow框架，通过模拟神经科学中的腹背侧通路模型，将对话中的面部动画生成解耦为语义理解与动态控制双路径，以协调高层认知意图与低层运动反射。

Details

Motivation: 现有方法在对话上下文语义理解与精确动态控制方面存在不足，难以生成逼真的双人对话面部动画。

Result: 在多个基准测试中，MindFlow在语义适当性和运动自然度方面均优于现有最先进方法。

Insight: 创新点包括将句子-动作建模转变为块-状态建模以捕捉副语言细微特征，以及采用条件自回归流匹配网络与选择性音频注入器实现高保真运动生成与鲁棒性控制。

Abstract: Generating lifelike facial animation for dyadic conversations requires reconciling high-level cognitive intent with precise low-level motor reflexes, yet existing methods fall short in the semantic understanding of dialogue context and in precise dynamic control. In this paper, we propose MindFlow, a dual-pathway generative framework inspired by the Ventral-Dorsal pathway model in neuroscience, which decouples generation into two collaborative streams, thereby harmonizing deep semantic reasoning with fine-grained control. In the Ventral module, we transform the conventional Sentence-Action approach into a novel Chunk-State approach that models raw acoustic streams as a context-aware, evolving emotional state chain, capturing subtle paralinguistic nuances and mid-utterance emotional shifts missed by sentence-level modeling. The Dorsal module features a conditional autoregressive flow matching network for high-fidelity facial motion, driven by high-frequency acoustic cues and modulated by emotion states, plus a Selective Acoustic Injector for adaptive audio gating to ensure robustness in talking-and-listening dynamics without interference. Extensive experiments demonstrate that MindFlow achieves superior semantic appropriateness and motion naturalness compared to state-of-the-art baselines.

[41] ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On cs.CVPDF

Xiangyu Sai, Meysam Madadi, Sergio Escalera, Yong Xu

TL;DR: 本文提出ModaFlow，一种基于模态感知流匹配的高保真虚拟试穿框架，旨在解决现有方法在保持服装细节语义和适应不同人体几何形状方面的不足。该框架通过视觉和文本模态的差异化引导、正则化损失以及掩码操作策略，实现了文本描述与服装外观的精确对齐，并在成对和非成对基准测试中取得了最先进的性能。

Details

Motivation: 现有基于图像的虚拟试穿方法难以在大幅服装-身体变形下同时保留精细的服装语义并适应多样的人体几何形状，因此需要一种能更精确对齐文本描述与服装外观的新方法。

Result: ModaFlow在定性和定量评估中均达到了最先进水平，在成对基准上将FID降低了约30%，在非成对基准上降低了约20%。

Insight: 创新点包括：1) 模态感知引导方案，对视觉嵌入（确定性结构引导）和文本嵌入（通过自适应缩放和零初始化速度的CFG控制）进行差异化处理；2) 结合余弦相似度和感知流判别的正则化损失，提升速度场的方向一致性和感知真实感；3) 训练中随机采样不同掩码（框、透明、宽松）的策略，增强了在非成对设置（仅提供框掩码）下的鲁棒性。

Abstract: Image-based virtual try-on has emerged as a compelling task in e-commerce and augmented reality, yet existing methods struggle to simultaneously preserve fine garment semantics and adapt to diverse person body geometries under large clothing-body deformations. We present ModaFlow, a modality-aware flow-matching based framework for high-fidelity virtual try-on that achieves precise alignment between textual descriptions and garment appearance. Unlike prior methods that treat multimodal conditions uniformly, ModaFlow introduces a modality-aware guidance scheme: visual garment embeddings extracted by a pretrained image prompt adapter provide deterministic, persistent structural guidance, while textual embeddings generated from garment descriptions are controlled via classifier-free guidance (CFG) with adaptive scaling and zero-initialized velocity. To further enhance flow field accuracy, we propose two regularization losses, cosine similarity and perceptual flow discrimination, that jointly improve directional consistency and perceptual realism of the velocity field. Additionally, a mask manipulation strategy stochastically samples among box, transparent, and relaxed masks during training, simulating diverse occlusion scenarios and enabling robust inference under unpaired settings where only a box mask is available. Experiments show that ModaFlow achieves state-of-the-art results in both qualitative and quantitative evaluations, reducing FID by approximately 30% on paired and 20% on unpaired benchmarks.

[42] TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning cs.CVPDF

Enguang Wang, Hao Zhou, Shuo Gao, Tuo Liu, Guangquan Zhou

TL;DR: 本文提出TRUST框架，一种扫描感知的参数高效图像到视频迁移学习（PEIVTL）方法，用于提升腹部创伤超声视频识别的准确性和泛化能力。该框架通过三个核心模块：跨频协作适配器（CFCA）增强空间特征提取，多粒度运动感知（MGMA）模块捕获复杂扫描动态，以及视觉查询语义聚合（VQSA）模块实现自适应视觉-文本对齐，有效解决了因医生依赖的扫描实践带来的时空和语义变化问题。

Details

Motivation: 腹部超声对于快速、无创的创伤分诊至关重要，但解读连续扫描中嵌入的细微动态线索耗时且依赖于操作者。现有的参数高效图像到视频迁移学习（PEIVTL）框架在超声视频分析中面临因扫描实践差异导致的显著时空和语义变化，限制了其有效性和泛化性。

Result: 在内部超声创伤数据集上的实验表明，TRUST框架在计算效率优越的同时，性能超越了现有最先进方法9.63%。

Insight: 创新点在于显式建模细粒度时空变化以提升超声视频理解的可靠性，具体包括：CFCA通过低频与高频成分的相互约束增强空间特征判别力；MGMA结合局部时间卷积与运动先验引导的全局自注意力，联合捕获稳定视图内模式和突变的视图间转换；VQSA根据视觉特征动态生成文本原型，实现对不同扫描条件下类内变化鲁棒的自适应视觉-文本对齐。

Abstract: Abdominal ultrasound is indispensable for rapid, noninvasive trauma triage. However, interpreting the subtle dynamic cues embedded in continuous scanning is time-intensive and operator-dependent. Parameter-Efficient Image-to-Video Transfer Learning (PEIVTL), which efficiently adapts pre-trained image models to the video domain, notably through visual-textual alignment, offers a promising paradigm for ultrasound video analysis. Nevertheless, substantial spatiotemporal and semantic variations arising from physician-dependent scanning practices continue to limit the effectiveness and generalizability of this framework. We propose TRUST, a scan-aware PEIVTL framework that explicitly models fine-grained spatiotemporal variations to enable reliable ultrasound video understanding. First, we introduce a Cross-Frequency Collaborative Adapter (CFCA) that establishes mutual constraints between low- and high-frequency components, enhancing discriminative spatial feature extraction under heavy speckle corruption. Second, we design a Multi-Granularity Motion-Aware (MGMA) module that integrates local temporal convolutions with motion-prior-guided global self-attention, jointly capturing stable intra-view patterns and abrupt inter-view transitions to characterize complex scanning dynamics. Third, a Visual Query Semantic Aggregation (VQSA) module dynamically generates text prototypes conditioned on visual features, enabling adaptive visual-textual alignment robust to intra-class variability under diverse scanning conditions. Experiments on in-house ultrasound trauma datasets demonstrate that TRUST outperforms state-of-the-art methods by 9.63% with superior computational efficiency.

[43] Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation cs.CVPDF

Jian Shi, Cheng Zhen, Pingping Zhang, Rui Xu, Yanan Lv

TL;DR: 本文提出了一种名为TIRNet的新型Retinex启发式框架，用于语言引导的医学图像分割（LMIS）。该方法将文本嵌入视为语义照明，通过Retinex启发的文本调制块和一致性细节补偿块进行特征调制，并引入多尺度照明监督损失来确保跨模态语义一致性，从而提升分割性能。在MosMedData+和QaTa-COV19数据集上的实验表明，TIRNet达到了最先进的性能水平。

Details

Motivation: 现有语言引导医学图像分割方法通常依赖文本与视觉特征的隐式交互或粗粒度监督进行跨模态对齐，缺乏显式且细粒度的约束来确保语义一致性，导致语言描述与分割输出之间的不匹配。

Result: 在MosMedData+和QaTa-COV19数据集上进行了广泛实验，TIRNet实现了最先进的性能（SOTA）。

Insight: 创新点在于将文本嵌入视为语义照明，并基于Retinex理论设计了文本调制块和细节补偿块，通过多尺度照明监督损失（包括区域对比损失和背景抑制损失）实现了细粒度的跨模态对齐，从而提升了分割的语义一致性。

Abstract: Language-guided Medical Image Segmentation (LMIS) has shown great potential to improve the delineation of anatomical structures and lesions by integrating clinical textual information. Existing methods generally rely on either implicit interaction between textual and visual features or auxiliary coarse-grained supervision for cross-modal alignment. However, these methods lack explicit and fine-grained constraints to ensure semantic consistency, causing a mismatch between language and the segmentation outputs. To address this issue, we propose Text-as-Illumination Retinex Network (TIRNet), a novel Retinex-inspired framework that treats text embeddings as semantic illumination for feature modulation, thereby improving semantic consistency in LMIS. TIRNet introduces two key blocks integrated at each decoder stage: (1) the Retinex-inspired Text Modulation Block (RTMB), which employs positive and negative illumination maps to enhance text-relevant foreground features and suppress background interference; and (2) the Consistent Detail Compensation Block (CDCB), which selectively recovers high-frequency details via a consistency-gated mechanism conditioned on illumination reliability. Furthermore, we propose a Multi-Scale Illumination Supervision Loss (MSIS-Loss), comprising a Region-Grounded Contrastive Loss (RGC-Loss) that enforces cross-modal similarity to be concentrated in text-relevant foreground regions and suppressed in background regions, and a Background Suppression Loss (BS-Loss) that provides pixel-level supervision for negative illumination maps, jointly ensuring a precise cross-modal alignment at each decoder stage. Extensive experiments on the MosMedData+ and QaTa-COV19 datasets demonstrate that TIRNet achieves state-of-the-art performance in LMIS. The code is available at: https://github.com/anaanaa/TIRNet.

[44] Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning cs.CVPDF

Hohin Kwan, Hongyu Li, Ray Zhang, Manyuan Zhang, Xianghao Kong

TL;DR: 该论文提出了Video-MME-Logical，一个用于评估多模态大语言模型视频时序逻辑推理能力的可控诊断基准。该基准围绕状态追踪、顺序计数、时序排序、动态空间性和结构组合五个核心操作构建，包含25个细粒度任务类别，支持通过调整时间跨度和推理复杂度来控制难度，并能对模型的中间推理状态进行诊断。实验表明，当前最先进的MLLMs在此基准上表现不佳，与人类存在显著差距，即使进行大规模监督微调也难以弥合。

Details

Motivation: 当前对多模态大语言模型的研究引发了一个核心问题：它们能否对动态视觉证据进行推理，而不仅仅是识别单帧中的物体或事件？现有的视频基准常常将这种时序逻辑推理能力与场景复杂性、静态识别或不受控的时间变化混为一谈。为了分离并专门评估这种能力，作者引入了Video-MME-Logical。

Result: 在Video-MME-Logical基准上对最先进的MLLMs进行实验，揭示了显著的人-模型性能差距，尤其是在时序逻辑复杂性增加时。对多达50万个生成样本进行监督微调可以提升性能，但不足以弥合这一推理差距。

Insight: 论文的创新点在于构建了一个可控、可诊断的基准，能够系统地隔离和评估视频时序逻辑推理这一特定能力。其核心在于通过控制物体状态、转换、时序依赖和逻辑组合来生成任务，并支持对最终答案和中间推理轨迹的评估，为分析和改进MLLMs的时序逻辑推理能力提供了一个可扩展的测试平台。

Abstract: Recent interest in multimodal large language models (MLLMs) raises a central question: can they reason over dynamic visual evidence rather than merely recognize objects or events in individual frames? This ability, which we refer to as video temporal-logical reasoning, requires models to maintain, update, and compose evidence as visual states evolve across frames. Existing video benchmarks often conflate this capability with scene complexity, static recognition, or uncontrolled temporal variation. To isolate this capability, we introduce Video-MME-Logical, a controlled benchmark organized around five temporal-logical operations: state tracking, sequential counting, temporal ordering, dynamic spatiality, and structural composition. The benchmark contains 25 fine-grained task categories generated with controlled object states, transitions, temporal dependencies, and logical compositions. It enables difficulty-controlled final-answer evaluation by varying temporal horizon and reasoning complexity, and supports intermediate-state diagnostics by verifying whether models recover the required logical reasoning trace before producing the final answer. Experiments with state-of-the-art MLLMs reveal a substantial human-model gap, especially as temporal-logical complexity increases. Supervised fine-tuning on up to 500K generated samples improves performance but remains insufficient to close the reasoning gap, positioning Video-MME-Logical as a scalable testbed for analyzing and improving temporal-logical reasoning in MLLMs.

[45] Hippocampus-DETR: An Explicit Memory Object Detection Framework Based on Hippocampus Modeling cs.CV | cs.AIPDF

Zhaoning Shi, Bo Ma, Hao Xu, Zepeng Yang, Bo Liang

TL;DR: 本文针对当前目标检测模型缺乏显式记忆机制的问题，提出了一种基于海马体建模的新型检测框架Hippocampus-DETR。该框架将海马记忆网络模块HipNet集成到DETR架构中，模拟海马亚区的解剖结构和功能组织，实现了视觉编码特征的模式分离、模式补全、重要性过滤和信息整合。实验表明，该框架不仅提高了检测精度，还在少样本分类、多模态特征构建和图像修复等任务中展现出优异的泛化能力和数据效率。

Details

Motivation: 解决当前目标检测模型缺乏显式记忆机制的问题，旨在通过模拟生物海马体的记忆功能来提升模型的性能。

Result: 在目标检测任务上，Hippocampus-DETR的检测精度超越了当前主流模型；在少样本图像分类、多模态特征构建和图像修复等任务中，模型展现出优秀的泛化能力和数据效率。

Insight: 创新点在于将神经认知机制（海马体记忆模型）与深度学习模型（DETR）相结合，通过模拟海马亚区的功能构建了具有记忆检索和补全能力的显式记忆系统，为提升模型学习效率和任务鲁棒性提供了新途径。

Abstract: This paper addresses the lack of explicit memory mechanisms in current object detection models and proposes Hippocampus-DETR, a novel detection framework based on biological hippocampal memory modeling. This framework integrates a hippocampal memory network module, HipNet, into the DETR architecture and systematically simulates the anatomical structure and functional organization of hippocampal subregions, including the entorhinal cortex, dentate gyrus, CA3, CA1, and subiculum. Through this design, Hippocampus-DETR realizes pattern separation, pattern completion, importance filtering, and information integration of visual encoding features. During training, different memory submodules are optimized using a layer-wise training strategy, ultimately forming a memory system with memory retrieval and completion capabilities. Experimental results demonstrate that Hippocampus-DETR achieves higher detection accuracy than current mainstream models. More importantly, models equipped with this framework also exhibit excellent generalization ability and data efficiency in tasks such as few-shot image classification, multimodal feature construction, and image restoration. Subsequent experiments further validate the functional necessity and internal interpretability of each memory submodule. This study not only provides a novel object detection framework, but also offers a feasible technical pathway for integrating neurocognitive mechanisms with deep learning models, highlighting its significant value in improving model learning efficiency and task robustness. The project is available at https://github.com/2186cloud/hipnet.

[46] A Unified Framework for Vision Transformers Equivariant to Discrete Subgroups of $\mathrm{O}(2)$ cs.CV | cs.LGPDF

Tīkun Ông, Georg Bökman

TL;DR: 本文提出了一个统一的框架，用于构建对O(2)的任意离散子群具有等变性的视觉Transformer（ViT）家族。该框架推广了先前的翻转和D4等变Transformer架构，并构建了与六边形补丁兼容的D6等变模型。论文在PatternNet航空图像数据集上进行了评估，初步结果表明等变性可以在匹配参数预算下提高识别精度。

Details

Motivation: 标准视觉Transformer模型没有显式编码许多视觉领域中存在的平面对称性。本文旨在提供一个统一的框架，使ViT能够对O(2)的任意离散子群（如旋转和反射对称群）具有等变性，从而将对称性先验知识融入架构设计。

Result: 在PatternNet航空图像数据集上，在人为制造的数据稀缺场景下，对D4和D6子群的等变模型进行了评估。初步结果表明，在匹配的参数预算下，等变性可以提高识别准确率。

Insight: 主要创新点是提出了一个统一且理论完备的框架，用于构建对任意离散平面对称群等变的ViT，并提供了核心组件的等变类比及表达能力保证。从客观角度看，其将群论与Transformer架构的系统性结合，以及对不同等变注意力机制和齐次空间配置影响的实验分析，为设计具有几何先验的视觉模型提供了新思路。

Abstract: Vision transformers have become a dominant architecture for visual recognition. However, standard models do not explicitly encode the planar symmetries that arise in many vision domains. We introduce a family of vision transformers equivariant to arbitrary discrete subgroups of $\mathrm{O}(2)$, providing a unified framework that generalizes prior flipping- and $D_4$-equivariant transformer architectures. Our construction yields equivariant analogues of the core transformer components, together with expressivity guarantees for the resulting layers. In particular, we show that whenever $H \le G$, the class of $G$-equivariant ViTs embeds naturally into the class of $H$-equivariant ViTs. We also prove that, in the single-head setting, the corresponding equivariant self-attention layer realizes every $G$-equivariant self-attention map representable by ordinary self-attention. We further construct a $D_6$-equivariant model based on hexagonal patches, making the architecture compatible with six-fold rotational symmetries. We evaluate the resulting models on the PatternNet aerial image dataset in artificially data-scarce regimes across subgroups of $D_4$ and $D_6$. Our experiments compare two equivariant attention mechanisms and analyze how the choice of homogeneous-space configurations used in the nonlinearities affects performance. Preliminary results under matched parameter budgets indicate that equivariance can improve recognition accuracy, motivating further study of how discrete symmetry groups shape transformer-based visual recognition models.

[47] A Multi-Attribute Latent Space for Visual Analysis of Watches cs.CV | cs.HCPDF

Kai Lawonn, Tobias Günther, Monique Meuschke

TL;DR: 本文提出了一种用于探索大型腕表收藏的多属性潜在空间模型及交互式视觉分析系统。该系统通过结合视觉和语义属性，解决了传统电商界面在支持开放式视觉相似性探索、风格替代品发现以及混合美学功能标准方面的局限性。

Details

Motivation: 传统商品目录和电商界面通常只支持基于元数据的过滤，缺乏对视觉相似性、风格替代品以及混合美学与功能标准的开放式探索支持，因此需要一种能够整合异构视觉和语义属性的系统来改善用户体验。

Result: 通过参数分析、运行时测量以及与腕表专家和新手的定性试点研究进行评估，结果表明该系统支持发现和比较任务，但也揭示了在可扩展性评估、示例搜索验证以及需要更广泛领域研究方面的局限性。

Insight: 创新点包括使用分离的属性图（表盘颜色和设计）表示腕表，并以腕表类型作为显式语义组织器；扩展UMAP方法，通过结合属性特定的邻域图和添加类别感知布局项，在统一概率目标中分离全局类型结构与局部视觉邻域；系统提供了交互式界面，支持空间导航、元数据过滤、细节检查和示例搜索插入。

Abstract: We present a design rationale, embedding model, and interactive visual-analysis system for exploring large wristwatch collections through heterogeneous visual and semantic attributes. The system addresses a common limitation of catalog and e-commerce interfaces: users can filter by metadata, but they receive little support for open-ended exploration of visual similarity, stylistic alternatives, and mixed aesthetic-functional criteria. We therefore represent watches with separate attribute graphs for dial color and dial design, while using watch type as an explicit semantic organizer. Dials are segmented with a U-Net, watch types are predicted with a Vision Transformer, colors are represented through a shared CIELAB reference palette, and dial structure is described with a gradient-based image descriptor. We extend UMAP by combining attribute-specific neighborhood graphs in a unified probabilistic objective and by adding a class-aware layout term that separates global type structure from local visual neighborhoods. The resulting map is exposed in an interactive interface with spatial navigation, metadata filtering, detail inspection, and search-by-example insertion. We evaluate the approach through parameter analysis, runtime measurements, and a qualitative pilot study with watch experts and novices. The results suggest that the system supports discovery and comparison, while also revealing limitations in scalability assessment, search-by-example validation, and the need for broader domain studies. We explicitly discuss these limitations and derive design implications for multi-attribute latent-space visualization across heterogeneous visual collections.

[48] There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion cs.CVPDF

Lishen Qu, Yao Liu, Shihao Zhou, Jie Liang, Hui Zeng

TL;DR: 本文提出了FreeMEF，一种用于多曝光融合（MEF）的灵活帧数Transformer模型，能够无缝处理任意数量的输入曝光图像而无需重新训练或修改架构。该方法通过循环状态空间模块（RSSM）和全局特征引导块（GFGB）两个关键模块，实现了对任意序列的特征融合与图像恢复，在多个基准数据集上取得了优于现有方法的性能。

Details

Motivation: 传统MEF方法通常针对固定数量的输入帧设计，导致部署系统需要为不同帧数需求维护多个模型，降低了部署效率。本文旨在解决这一限制，提出一种能灵活适应不同输入曝光数量的统一模型。

Result: 在三个基准数据集上的大量实验表明，该方法在定量和定性评估上均优于最先进的（SOTA）方法。

Insight: 主要创新点包括：1）提出首个灵活帧数的MEF Transformer（FreeMEF），通过循环状态空间模块（RSSM）实现任意序列的特征融合；2）设计了全局特征引导块（GFGB），其中包含的极值感知混合注意力（EAHA）和仿射注入前馈网络（AFFN）有效解决了相似性悖论并优化了对比度与亮度调节。模型架构的灵活性是其核心优势。

Abstract: Multi-exposure fusion (MEF) brings the dynamic range of conventional cameras closer to that of human vision, producing images with rich scene content. Given the large variability in scene luminance, exposure strategies often require different numbers of frames to capture the full radiance range faithfully. However, conventional MEF techniques are typically designed for a fixed number of inputs, forcing deployment systems to maintain separate models for different frame-count requirements, which undermines deployment efficiency. To address this limitation, we propose FreeMEF, the first flexible-frame transformer for MEF that seamlessly accommodates varying numbers of input exposures without retraining or architectural changes. The proposed approach consists of two key modules. First, we introduce a recurrent state space module (RSSM) that sequentially fuses features from arbitrary sequences via adaptive alignment and state-space recurrent modeling, thereby providing global information guidance for the subsequent restoration. Second, we devise a global feature guided block (GFGB) incorporating an extremity-aware hybrid attention (EAHA) and an affine-injection feed-forward network (AFFN), which effectively resolves the similarity paradox while simultaneously optimizing contrast and brightness regulation. Extensive experiments on three benchmark datasets demonstrate the effectiveness of our method, which performs favorably against state-of-the-art methods both quantitatively and qualitatively.

[49] SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion cs.CV | cs.AIPDF

Haoyu Zhang, Meng Liu, Qianlong Xiang, Kun Wang, Yaowei Wang

TL;DR: 该论文提出了SpatialUAV基准测试，用于全面评估低空无人机在空间智能方面的能力，包括感知、协作和运动理解。该基准包含4,331个实例，涵盖14种细粒度任务类型，支持多种输入配置和答案格式，并采用严谨的数据构建流程确保评估可靠性。

Details

Motivation: 现有无人机基准测试主要关注图像级识别、单视图理解或狭窄的答案格式，未能充分评估3D空间推理、多视图协作、场景动态和多样化任务制定等关键空间智能能力。

Result: 在评估了三大类代表性视觉语言模型后，发现当前模型性能远未达到人类水平，在跨视图关联、结构化基础、几何推理和时间视角理解等方面存在明显瓶颈。

Insight: 创新点在于构建了一个统一、全面且严谨的低空无人机空间智能基准测试框架，其数据构建流程整合了检测器辅助区域、深度监督、元数据规则、人工标注和验证等多种技术，并支持异构输出的任务特定指标，为推进该领域研究提供了实证指导。

Abstract: Spatial intelligence is essential for low-altitude unmanned aerial vehicle (UAV) perception, collaboration, and navigation. However, existing UAV benchmarks often emphasize image-level recognition, single-view understanding, or narrow answer formats, leaving 3D spatial inference, multi-view collaboration, scene dynamics, and diverse task formulations insufficiently evaluated. To address these gaps, we introduce SpatialUAV, a real low-altitude UAV benchmark comprising 4,331 curated instances across 14 fine-grained task types, covering semantic discrimination, spatial relation, aerial–aerial collaboration, aerial–ground collaboration, and motion understanding. SpatialUAV organizes all samples into a unified visual-input–question–answer schema, while supporting seven input configurations and nine answer formats, including option labels, region identifiers, geometric values, cross-view correspondences, and free-form motion descriptions. To ensure reliable and grounded evaluation, our data construction pipeline integrates detector-assisted regions, depth supervision, metadata-derived rules, extensive manual annotation, blind filtering, and multi-turn human validation, together with task-specific metrics for heterogeneous outputs. Evaluating representative vision-language models across three categories, we show that current models remain far from human-level performance, with pronounced bottlenecks in cross-view association, structured grounding, geometric reasoning, and temporal viewpoint understanding. These results offer empirical guidance for advancing low-altitude UAV spatial intelligence. Code and data are available at https://github.com/Hyu-Zhang/SpatialUAV.

[50] Every Step of the Way: Video-based Parkinsonian Turning Step Counting cs.CV | cs.AIPDF

Qiushuo Cheng, Jingjing Liu, Catherine Morgan, Alan Whone, Majid Mirmehdi

TL;DR: 本文提出了一种基于视频的帕金森病（PD）患者转身步数计数框架，以被动、非接触的方式解决传统可穿戴设备的不便。该方法采用从粗到细的策略，首先从3D人体网格恢复中提取足部运动信号进行初步估计，然后通过运动编码器融合网格和光流信息，利用交叉注意力机制捕捉细微的步态动态，并结合多示例学习（MIL）处理可变长度视频，最终实现步数残差预测。

Details

Motivation: 帕金森病的转身障碍是核心症状，其步数计数直接反映运动功能障碍，但现有方法主要依赖可穿戴设备，给日常连续使用带来不便；且真实世界转身动作多变及帕金森步态异常（如拖曳步）使得精确计数具有挑战性。

Result: 在真实世界的帕金森转身数据集上进行的大量实验表明，该方法在步数计数任务上持续优于现有方法，取得了先进性能。

Insight: 创新点在于提出了一种完全基于视频的被动监测框架，通过从粗到细的多模态运动表征（3D网格与光流）融合，并利用交叉注意力机制查询像素级运动线索以捕捉细微的帕金森步态动态，同时采用多示例学习处理可变长度视频，为非侵入式、便捷的帕金森运动功能评估提供了新思路。

Abstract: As a prominent symptom of Parkinson’s disease (PD), turning impairment is evaluated through parameters such as turning angle, duration, and particularly, the number of steps required to complete a turn, which directly reflects motor dysfunction. Accurate step counting is challenging due to variability in real-world turning movements and atypical shuffling patterns in parkinsonian gait. Existing methods are predominantly wearable-based, requiring users to wear and manage dedicated devices, which can be inconvenient for continuous daily use. To address this, we propose a passive, video-based framework that estimates step count in a coarse-to-fine manner using diverse motion representations. Specifically, an initial step count is estimated from foot movement signals derived from 3D human mesh recovery, providing high-level motion structures. To incorporate fine-grained motion details, a motion encoder learns complementary gait dynamics from mesh and optical flow to refine the initial estimate. In this process, coarse foot movement signals query the pixel-level motion cues via cross attention to capture subtle parkinsonian gait dynamics. To handle varying video lengths, we partition each video into clips and integrate clip-wise motion embeddings via multiple instance learning (MIL) for step count residual prediction. Extensive experiments show our method consistently outperforms existing step counting methods on real-world PD turning datasets.

[51] Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding cs.CV | cs.AIPDF

Shuimu Chen, Yuteng Chen, Yuanshen Guan, Zebang Cheng, Zeyu Zhang

TL;DR: 本文提出了Reflect-R1，一个用于长视频理解的证据驱动自校正框架。该框架构建了一个包含直觉、验证和仲裁的三阶段流程，通过动态检索客观视觉证据来验证初始直觉，并自主执行多次时间搜索来解决冲突，从而打破幻觉循环。为了克服策略耦合问题，作者设计了一种名为SD-GRPO的阶段解耦强化学习算法，并构建了一个包含12万个样本的数据集来弥补训练数据的不足。

Details

Motivation: 当前长视频理解的多模态反思机制主要依赖于内部参数的闭环自我反思，缺乏客观外部证据，导致模型经常陷入盲目自信且难以纠正错误。此外，在多阶段反思流程中应用强化学习会引入严重的策略耦合问题，且缺乏专门的训练数据加剧了这一挑战。

Result: 在VideoMME和LongVideoBench等基准测试上的大量实验表明，Reflect-R1实现了最先进的性能。该方法显著提高了真实校正率，并实现了严格基于客观证据的真实自校正。

Insight: 论文的主要创新点在于提出了首个证据驱动的自校正框架，通过三阶段流程和动态证据检索来打破幻觉循环。从客观角度看，其设计的阶段解耦强化学习算法SD-GRPO能够独立计算不同推理阶段的优势函数，有效解决了策略耦合问题，同时构建的大规模专用数据集也为该领域的研究提供了重要资源。

Abstract: Current multimodal reflection mechanisms for long video understanding predominantly rely on closed-loop self-reflection within internal parameters. Lacking objective external evidence, models are frequently trapped in blind confidence and often fail to correct errors. Furthermore, applying reinforcement learning to multi-stage reflection pipelines introduces severe policy coupling, which is exacerbated by a critical scarcity of dedicated training data. To address these limitations, this work proposes Reflect-R1, the first Evidence-Driven self-correction framework for long video understanding. The framework constructs a three-stage pipeline consisting of intuition, verification, and arbitration. By dynamically retrieving objective visual evidence to verify initial intuitions and autonomously executing multiple temporal searches to resolve conflicts, it completely breaks the hallucination loop. To overcome policy coupling, we design a stage-decoupled reinforcement learning algorithm named SD-GRPO that independently computes advantage functions across different reasoning stages. Concurrently, we construct a dataset of 120K samples to bridge the training data gap. Extensive experiments on benchmarks such as VideoMME and LongVideoBench demonstrate that Reflect-R1 achieves state-of-the-art performance. Our method significantly improves the genuine rectification rate and enables authentic self-correction strictly grounded in objective evidence.

[52] Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design cs.CV | cs.AIPDF

Yiyun Fei, Guoqiu Li, Jin Song, Chuqiao Wu, Delong Wu

TL;DR: Home3D 1.0是一个针对室内设计和电子商务应用的模块化图像到3D生成系统，能够从单张参考图像生成高质量的3D资产。该系统通过四个紧密耦合的模块（几何、纹理、材质和部件）输出带有基于物理渲染材质的网格，并可将网格分解为特定材质的组件。

Details

Motivation: 解决从单张家具或装饰品照片高效生成高质量、可编辑3D资产的问题，以满足室内设计和电子商务领域对高保真3D内容的需求。

Result: 每个模块都使用专用指标进行了独立评估，结果突显了当前系统的能力以及距离更广泛部署尚存的差距。

Insight: 创新点在于将复杂的图像到3D生成任务分解为四个专门化且紧密耦合的模块（几何、纹理、材质、部件），并整合了多种先进技术（如潜在SDF建模、流匹配DiT、多模态材质匹配、PartVAE/DiT），实现了从单张图像生成具有PBR材质和可分解部件的完整3D网格。系统设计具有模块化和可评估性，为后续改进指明了方向。

Abstract: We present Home3D 1.0, a modular image-to-3D generation system that produces high-quality 3D assets from a single reference image, targeting interior design and e-commerce applications. Given a photograph of a furniture or decor item, the system outputs a mesh with physically-based rendering (PBR) materials, and the mesh can be decomposed into material-specific components. The pipeline is organized into four tightly coupled modules: Geometry reconstructs a watertight mesh through latent SDF modelling with a geometry VAE and a coarse-to-fine flow-matching DiT; Texture predicts multiview albedo observations, reprojects them onto the mesh, and completes unseen surface regions with a 3D texture field; Material uses MatWeaver to obtain component masks through video-based segmentation and UV-space voting, then retrieves and bakes PBR maps from a curated material library through hierarchical multi-modal matching; and Parts generates material-editable semantic part meshes with a PartVAE and PartDiT, decoding multi-head part-specific SDF fields in one pass. Each module is evaluated independently with dedicated metrics, highlighting both the current system capability and the remaining gaps toward broader deployment.

[53] Understanding How MLLMs Describe Artworks Using Token Activation Maps cs.CVPDF

Nicola Fanelli, Pasquale De Marinis, Raffaele Scaringi, Eva Cetinic, Gennaro Vessio

TL;DR: 本文提出使用Token Activation Map（TAM）技术来研究多模态大语言模型（MLLMs）在描述艺术作品时的视觉推理机制，分析模型生成不同语义类别词汇（如物体、风格、元数据等）时对画布特定区域的视觉依据，并比较了其与SAM-3分割模型的差异。

Details

Motivation: 旨在揭示MLLMs在流畅描述艺术作品背后，其输出是依赖于画布的相关区域、未分化的视觉信号还是文本先验知识，以解决模型视觉推理过程不透明的问题。

Result: 研究发现视觉依据程度随词汇语义类别变化显著；在艺术家归属任务上准确率高于作品标题预测，后者幻觉更频繁；并与SAM-3开放词汇分割进行了比较。

Insight: 创新点在于将TAM应用于艺术分析领域，系统量化了MLLMs对不同语义类别词汇的视觉依据模式，为理解模型的多模态推理提供了可解释性工具。

Abstract: Multimodal Large Language Models (MLLMs) describe artworks with remarkable fluency, yet the visual reasoning behind their outputs remains opaque. When an MLLM names a style, identifies a subject, or recognizes an iconographic symbol, does it ground each claim in the relevant region of the canvas, draw on an undifferentiated visual signal, or rely primarily on textual priors? We study this using the Token Activation Map (TAM), which produces, for each generated token, a heatmap isolating the visual evidence specific to that token from prior-context interference. Applying TAM to a curated set of paintings spanning multiple periods and genres, we analyze grounding patterns across five semantically distinct token categories: common visual objects, style descriptors, metadata, iconographic tokens, and affective expressions. We find that visual grounding varies substantially with token semantics. We further show that MLLMs attempt to identify artworks and artists, achieving higher accuracy in artist attribution than in title prediction, where hallucinations are more frequent. Finally, we compare TAM with SAM~3 open-vocabulary segmentation. To ensure reproducibility, we release our code, experimental configurations, prompts, and qualitative results on the project page at https://nicolafan.github.io/tamart/.

[54] Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control cs.CVPDF

Haoyuan Wang, Yabo Chen, Haibin Huang, Chi Zhang, Xuelong Li

TL;DR: 本文提出了一种名为’Directing the World’的快速自回归视频生成框架，旨在通过组合式的人体运动和相机轨迹控制，实现可控的世界模型视频生成。该方法通过解耦控制学习、引入快慢记忆训练策略以及改进的运动引导机制，解决了长序列生成中的误差累积、时间退化以及异质控制干扰等问题，并在构建的大规模数据集上验证了其有效性。

Details

Motivation: 构建交互式世界模型需要生成真实视频并在长时域内保持可控的动态。现有的自回归视频生成方法在长序列展开时存在误差累积和时间退化问题，尤其是在人体运动和相机轨迹等异质控制下，控制性与视觉质量往往难以兼得。

Result: 大量实验表明，该方法能够实现稳定的长时域视频生成，具有精确的可控性和高视觉质量。

Insight: 核心创新点在于将控制学习解耦以保持统一的视频先验，并设计了快慢记忆训练策略来稳定长序列学习。此外，提出的t引导动态投影机制和精炼的运动CFG策略，能在不损害视觉保真度的前提下实现平滑准确的运动对齐，并支持多人控制。第二阶段相机轨迹控制模块的引入，则实现了人体动态与视角变化的组合，用于连贯的世界探索。

Abstract: Building interactive world models requires generating realistic videos while maintaining controllable dynamics over long horizons. Autoregressive video generation offers a scalable foundation, but suffers from error accumulation and temporal degradation during extended rollouts. This issue is further amplified under heterogeneous controls such as human motion and camera trajectories, which may interfere and destabilize a pretrained video prior, while existing methods often trade off controllability and visual quality. We propose “Directing the World”, a fast autoregressive framework for controllable world-model video generation with compositional human-motion and camera-trajectory control. Our key idea is to decouple control learning while preserving a unified autoregressive video prior. We introduce a Fast-Slow Memory training strategy to stabilize long-horizon rollout learning and improve convergence. For human motion control, we design a t-guided Dynamic Projection mechanism and a refined Motion-CFG strategy, enabling temporally smooth and accurate motion alignment without degrading visual fidelity, and supporting multi-person control.After learning a robust motion prior, we introduce a second-stage camera-trajectory control module to compose human dynamics with viewpoint changes for coherent world exploration. We further construct a large-scale dataset with synchronized video, text, human-motion, and camera-trajectory annotations, organized into motion-centric and camera-centric subsets for decoupled training. Extensive experiments show stable long-horizon generation with precise controllability and high visual quality. See more at https://whydahuzi.github.io/Directing-the-World.github.io/.

[55] ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering cs.CV | cs.AIPDF

ZhengXian Wu, Hangrui Xu, Kai Shi, Zhuohong Chen, Yunyao Yu

TL;DR: 该论文提出了ProMSA，一种用于知识库视觉问答（KB-VQA）的渐进式多模态搜索智能体。它通过迭代选择图像搜索、文本搜索或停止操作，在明确的工具调用预算和去重机制下进行自适应推理，以替代传统的固定检索-生成流程。

Details

Motivation: 解决现有KB-VQA方法中固定检索-生成流程（如预选检索器和静态top-k设置）在推理过程中缺乏自适应性的问题。

Result: 在E-VQA和InfoSeek基准测试上，ProMSA相比强大的检索增强生成（RAG）和智能体基线取得了持续的性能提升，提高了检索和端到端准确率。

Insight: 创新点在于将KB-VQA建模为渐进式搜索过程，并引入序列级强化学习目标（TN-GSPO）进行优化，通过工具调用预算和去重机制实现更高效、自适应的多模态知识检索。

Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires models to combine image understanding with external knowledge. Most prior methods use a fixed retrieve-then-generate pipeline with a pre-selected retriever and a static top-k setting, which is not adaptive during reasoning. We propose ProMSA, a progressive multimodal search agent for KB-VQA. Given an image-question pair, the agent iteratively chooses image search, text search, or stop, under explicit tool-call budgets and with deduplication to avoid redundant retrieval. For training, we first use rejection-sampling SFT to learn valid tool-use formats, then optimize the agent with TN-GSPO, a sequence-level RL objective that normalizes updates by both generation length and tool-interaction depth. Experiments on E-VQA and InfoSeek show consistent gains over strong RAG and agent baselines, and improved retrieval and end-to-end accuracy. The code is available at https://github.com/DingWu1021/Promsa.

[56] Latent Visual Diffusion Reasoning with Monte Carlo Tree Search cs.CVPDF

Xirui Teng, Nan Xi, Junsong Yuan

TL;DR: 本文提出了一种名为潜在视觉扩散推理（LVDR）的新框架，用于分析细粒度技能活动（如体育、手术）的质量评估。该框架结合了关键点引导的蒙特卡洛树搜索（MCTS）来建模和可视化潜在的视觉推理过程，不仅能提高评估准确性，还能揭示导致最终判断的关键视觉推理序列。

Details

Motivation: 现有动作质量评估模型虽然性能显著，但缺乏显式揭示其判断背后推理过程的能力，即模型是黑箱的。本文旨在解决这一局限性，使评估过程具有可解释性。

Result: 在涵盖多种体育和手术领域的四个数据集上进行的大量实验表明，LVDR在保持有竞争力的定量性能的同时，提供了可解释的、通向最终预测的视觉推理轨迹。

Insight: 创新点在于将关键点引导的蒙特卡洛树搜索（MCTS）集成到视觉推理框架中，以显式建模和可视化潜在的推理步骤，从而在保持性能的同时增强了模型的可解释性。从客观角度看，这是一种将规划搜索算法（MCTS）与视觉推理任务结合以提升透明度的新颖尝试。

Abstract: Analyzing fine-grained skill activities (e.g., sports, surgery) requires not only recognizing visual patterns but also performing step-by-step visual reasoning that leads to the final judgment. While recent advances in action quality assessment have achieved remarkable progress in evaluating performance, existing models remain black boxes, where they lack the ability to explicitly reveal the reasoning processes underlying their judgments. To address this limitation, we propose Latent Visual Diffusion Reasoning (LVDR), a novel framework that integrates keypoint-guided Monte Carlo Tree Search (MCTS) to model and visualize the latent visual reasoning process. LVDR not only produces more accurate skill assessments but also uncovers the critical visual reasoning sequences that contribute to the final evaluation. Extensive experiments across four datasets spanning diverse sports and surgical domains demonstrate that LVDR achieves competitive quantitative performance while providing interpretable visual reasoning trajectories leading to the final predictions. Source codes and models can be found through the following link: https://github.com/XiruiTeng/LVDR_Official.git.

[57] TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL cs.CVPDF

Jing Wang, Xiangxin Zhou, Jiajun Liang, Kaiqi Liu, Wanyun Pang

TL;DR: TempAct提出了一种规划器-执行器强化学习框架，用于提升自回归视频扩散模型的时间合理性。该方法通过LLM规划器探索可执行的步骤提示，并训练视频模型在自身生成的历史条件下遵循这些提示，从而解决分块生成中时间指令跟随模糊的问题。

Details

Motivation: 自回归视频扩散模型通过分块合成实现低延迟流式生成，但全局提示无法指定每个块应实现的子事件，而简单切换为逐步提示又会导致延迟反应、步骤语义混合及错误传播。现有监督微调或蒸馏方法难以直接优化动作顺序和提示转换的正确性。

Result: 在Self-Forcing和LongLive基准测试中，TempAct在保持整体视觉质量的同时，显著提升了时间一致性。

Insight: 创新点包括分层组探索机制（规划组与执行组）实现长视野时间结果的规划级信用分配和提示切换行为的执行器级信用分配，以及结合规划质量、全视频时间反馈与局部转换级跟随奖励的分层奖励设计。

Abstract: Autoregressive (AR) video diffusion models enable low-latency streaming generation by synthesizing videos chunk by chunk with cached visual context, but this chunk-wise formulation makes temporal instruction following ambiguous. A single global prompt does not specify which sub-event should be realized in each chunk, while naively switching to step-wise prompts often leads to delayed reactions, blended step semantics, and error propagation across prompt transitions. These failures are difficult to address with supervised fine-tuning or distillation alone: SFT suffers from exposure bias, while rollout-based distillation still optimizes low-level denoising or teacher-distribution matching rather than directly enforcing action ordering and prompt-transition correctness. We address these challenges with TempAct, a planner–executor reinforcement learning framework that jointly optimizes temporal decomposition and step-conditioned execution for temporally plausible AR video generation. TempAct uses an LLM planner to explore span-aware step prompts that are executable by the video model, and trains an AR diffusion executor to follow these prompts under its own generated histories. Its key mechanism is hierarchical group exploration: candidate plans form planning groups, and each plan induces an execution group of multiple continuations from a shared visual context, enabling plan-level credit assignment for long-horizon temporal outcomes and executor-level credit assignment for prompt-switch behavior. We further design hierarchical rewards that combine plan-quality and full-video temporal feedback for the planner with local transition-level step-following rewards, aesthetic regularization, and KL constraints for the executor. Experiments on Self-Forcing and LongLive show that TempAct improves temporal consistency while preserving overall visual quality.

[58] HumanMoveVQA: Can Video MLLMs reason about human movement in videos? cs.CVPDF

Pulkit Gera, Faegheh Sardari, Asmar Nadeem, Valentina Bono, Padraig Boulton

TL;DR: 本文提出了HumanMoveVQA，这是首个用于评估多模态大语言模型（MLLMs）从外中心视角理解视频中人体全局运动（轨迹和朝向变化）能力的基准。该基准通过一个多阶段流程，将2D视频提升为世界坐标系下一致的3D运动轨迹，并生成了超过1万个结构化问答对。实验揭示了当前SOTA模型在此深度运动理解任务上存在显著能力差距，但通过使用该基准进行针对性微调，可以显著提升模型性能。

Details

Motivation: 现有MLLMs和基准测试大多将复杂人体运动简化为粗糙的语义标签，或只关注场景事件或局部关节动作，缺乏对全局人体在时空中的运动（如轨迹和朝向变化）的深入探究。

Result: 对最先进的专有模型的广泛评估揭示了一个关键的能力差距。然而，通过使用该基准生成的世界一致的监督数据对开源基线模型进行微调，实现了显著的性能提升。

Insight: 创新点在于构建了首个专注于评估全局人体轨迹和朝向推理的基准，并引入了以第一帧为锚点的世界坐标系来保持运动的一致性。这为开发下一代具备运动感知能力的视频理解模型奠定了严格的几何基础。

Abstract: Despite the rapid advance of Multimodal Large Language Models (MLLMs) in high-level video understanding, a fundamental bottleneck remains: these models collapse complex human motion into coarse semantic labels. Existing benchmarks mostly focus on scene-centric events or local joint articulations, failing to probe global human motion in space over time (trajectory and orientation changes). We introduce HumanMoveVQA, the first comprehensive benchmark designed to evaluate global trajectory and orientation reasoning from an exocentric perspective. Our benchmark utilizes a first-frame anchored world coordinate system, preserving translation and rotation relative to a fixed starting point. We propose a scalable, multi-stage pipeline that lifts 2D video observations into world-consistent 3D motion tracks to generate over 10K structured question-answer pairs across seven reasoning categories, including motion aggregation, sequential ordering, and trajectory-level inference. Our extensive evaluation reveals a critical capability gap in state-of-the-art proprietary models on deep human motion understanding. However, we demonstrate that this is a learnable problem; by fine-tuning an open-source baseline with our targeted, world-consistent supervision, we achieve a significant improvement.HumanMoveVQA establishes a rigorous geometric foundation for developing next-generation, movement-aware video understanding models.

[59] EMOSH: Expressive Motion and Shape Disentanglement for Human Animation cs.CVPDF

Dongbin Zhang, Hao Liu, Binquan Dai, Kangjie Chen, Chuming Wang

TL;DR: 本文提出EMOSH框架，用于高保真、可控制的人类视频生成，通过引入表达性人体模型（EHM）和粗到细混合运动注入策略，解决了现有方法在表达性和解耦性之间的权衡问题，实现了对形状和运动的有效分离，并提升了面部表情和复杂手势的生成质量。

Details

Motivation: 现有方法在人类动画生成中存在表达性与解耦性的矛盾：2D姿态条件方法存在‘运动-形状纠缠’问题，导致驱动主体身体形状泄露；而基于3D先验（如SMPL）的方法虽实现几何解耦，却难以捕捉面部表情和复杂手势，导致动画僵硬。

Result: 大量实验表明，EMOSH在自驱动和跨驱动场景下均优于先前方法，能生成高保真、表情生动的视频，同时保持形状解耦。

Insight: 创新点包括：1）引入表达性人体模型（EHM）作为核心控制表示，通过显式解耦形状和姿态参数，从根本上解决身体形状泄露问题；2）设计粗到细混合运动注入策略，实现对表情和手势的更细粒度控制；3）提出空间对齐条件机制，弥合训练与推理间的领域差距，提升身份一致性。

Abstract: High-fidelity and expressive controllable human animation is essential for content creation and digital avatar applications. However, existing methods face a dilemma between expressiveness and disentanglement. Mainstream 2D pose-conditioned approaches suffer from “motion-shape entanglement”, leading to the leakage of the driving subject’s body shape. Conversely, methods relying on 3D priors (e.g., SMPL) achieve geometric disentanglement but struggle to capture facial expressions and complex gestures, resulting in rigid animations. To this end, we propose EMOSH, a novel framework for high-fidelity controllable human video generation. First, an Expressive Human Model (EHM) is introduced as the core control representation. By explicitly disentangling shape and pose parameters, we fundamentally resolve the body shape leakage issue. Alongside this, a robust motion tracker is designed to accurately estimate EHM parameters from video. Second, we propose a Coarse-to-Fine Hybrid Motion Injection strategy, enabling more fine-grained control over expressions and gestures. Furthermore, we introduce a Spatially-Aligned Conditioning mechanism to bridge the domain gap between training and inference, improving identity consistency. Extensive experiments demonstrate that EMOSH outperforms previous methods in both self-driven and cross-driven scenarios, producing high-fidelity videos with vivid expressions while maintaining shape disentanglement.

[60] ReScene: Structured Indoor Scene Reconstruction from Multi-View Captures cs.CVPDF

Haoran Xu, Lechao Zhang, Daoguo Dong, Yan Gao, Xin Tan

TL;DR: ReScene是一个从多视角捕获重建结构化室内3D场景的框架，旨在解决下游具身人工智能任务对物体级结构、显式物体间关系和物理合理性的需求。该方法通过HierView组件基于语义一致性和3D覆盖完整性优先选择重建视角，并利用Relation-Aware Assembly将多帧关系预测与几何先验融合为置信度加权的场景图，从而实现物理一致的场景组装。

Details

Motivation: 现有方法依赖专用硬件、存在单视角重建偏差或产生几何合理但物理不一致的布局，核心问题在于跨视角关系融合和物理合理的场景组装。

Result: 在ScanNet场景集上，ReScene在几何、渲染和感知质量上均达到新的SOTA，Chamfer Distance降低17%，LPIPS降低26%，且运行速度比先前多视角方法快10倍；基于重建场景生成的具身视觉问答数据集中，微调的Qwen-VL在多项空间推理任务上接近强闭源模型性能。

Insight: 创新点在于将多视角几何作为统一先验贯穿流程，提出基于语义和覆盖的视角选择策略替代启发式方法，并融合视觉语言模型的关系预测与几何先验构建置信加权场景图以实现物理一致性组装。

Abstract: Constructing simulation-ready 3D scenes from multi-view captures is a key bottleneck for Embodied Artificial Intelligence, as downstream tasks require object-level structure, explicit inter-object relations, and physical plausibility. Existing approaches either rely on specialized capture hardware, suffer from single-view bias in object reconstruction, or yield layouts that are geometrically reasonable but physically inconsistent. We identify that the problem is not single-object reconstruction but cross-view relation fusion and physically plausible scene assembly. To address this challenge, we present ReScene, a framework that threads multi-view geometry throughout the pipeline as a unifying prior. Our method consists of two main components: HierView prioritizes reconstruction views based on semantic consistency and 3D coverage completeness, replacing the largest-mask heuristic that conflates image occupancy with object coverage; and Relation-Aware Assembly fuses multi-frame relation predictions from a vision-language model with geometric and room-shell priors into a confidence-weighted scene graph, enabling physically consistent scene assembly. ReScene sets a new state of the art across geometry, rendering, and perceptual quality on a set of ScanNet scenes, achieving a 17% reduction in Chamfer Distance and 26% in LPIPS over the strongest prior baseline, while running up to 10x faster than prior multi-view methods. Based on the reconstructed scenes, we also generate an embodied visual question answering dataset, on which fine-tuned Qwen-VL approaches the performance of strong closed-source models on several spatial reasoning tasks.

Jiyao Wang, Qingyong Hu, Duoxun Tang, Xiao Yang, Kaishun Wu

TL;DR: 本文提出RPM-Distill，一种生理引导的自适应跨模态蒸馏框架，用于提升基于视频的远程生理测量（RPM）的鲁棒性。该方法仅在训练阶段使用同步的雷达信号，在推理时仅需视频输入，通过将雷达信号中提取的生理结构频谱知识蒸馏到视频模型中，以应对光照、肤色和运动变化带来的挑战。

Details

Motivation: 基于视频的RPM易受光照、肤色和运动干扰，而射频雷达对这些因素具有不变性并能提供互补的心肺微动线索，但雷达在推理时部署不便。因此，作者旨在利用雷达仅在训练时提供监督，以增强纯视频模型的鲁棒性。

Result: 在具有挑战性的条件和跨数据集设置下的大量实验表明，RPM-Distill相比单模态基线，在平均绝对误差（MAE）上提升了81%，在相关性上提升了21%。

Insight: 核心创新在于观察到RGB和RF信号在时域形态不同，但在频域共享潜在的周期性节律，因此设计了生理引导的频谱蒸馏损失。此外，引入了一个频谱策略网络，通过元双层目标学习，根据学生-教师频谱关系图预测样本级的蒸馏门控和组件权重，以自适应地处理教师信号质量和对齐的不确定性，避免负迁移。

Abstract: Video-based remote physiological measurement (RPM) is highly accessible but remains fragile under varying illumination, skin tones, and motion. Radio frequency (RF) radar is largely invariant to illumination and appearance, providing complementary cardio-respiratory micro-motion cues; however, requiring radar at inference is often impractical due to its limited ubiquity and deployment overhead. We propose RPM-Distill, a physiology-guided cross-modal distillation framework that leverages synchronized radar only during training while retaining video-only inference. Our key observation is that although RGB and RF waveforms differ in sensing physics and time-domain morphology, they share similar latent periodic rhythm in the frequency domain. We thus distill physiology-structured spectral evidence to improve robustness, via losses that (i) anchor the fundamental peak, (ii) match the off-peak background distribution, and (iii) preserve spectral morphology and sharpness. To avoid negative transfer under sample-level teacher quality and alignment uncertainty, a spectral policy network predicts sample-level distillation gates and component weights from the student–teacher spectral relation map, learned with a meta bilevel objective on a small labeled validation split. Through extensive experiments in challenging conditions and cross-dataset settings, RPM-Distill brings 81% MAE and 21% correlation improvement over unimodal baselines. Code is at https://github.com/WJULYW/RPM-Distill.

[62] AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration cs.CVPDF

Haotian Li, Yida Wang, Leyuan Wang, Jinshan Lai, Keyang Wang

TL;DR: 本文提出了AirGroundBench，一个用于评估异构无人机-地面机器人协作中多视角空间智能的诊断性基准。该基准包含11个高保真仿真环境中的1,021对同步空地观测数据，生成了约62,000个双视角视觉问答实例和115个闭环视觉语言导航任务，覆盖了从空间感知到具身决策的四个能力维度。对13个代表性多模态大模型的评估揭示了它们在跨视角对齐和空间变换推理方面的瓶颈，表明几何一致性是当前具身MLLMs的关键限制。

Details

Motivation: 现有基准主要关注单智能体、单视角感知，缺乏对异构空地协作场景的系统性评估，而该场景中多尺度观测互补但会引入尺度不匹配、非对称遮挡和参考系不一致等问题。

Result: 在仅无人机、仅地面机器人和双视角输入三种设置下评估了13个代表性MLLMs。模型在空间感知上表现相对较好，但在跨视角对齐和变换密集型推理上存在困难，这些缺陷会传播到视觉语言导航的顺序决策中。双视角输入相比单视角变体有可测量的提升，但与人类性能仍存在持续差距。

Insight: 论文的创新点在于构建了一个专注于异构多视角具身协作中空间智能诊断的基准，并提供了结构化的空间标注以支持基于几何的评估。客观来看，该工作系统地揭示了当前MLLMs在跨视角几何一致性理解这一核心能力上的具体短板，为未来模型改进指明了方向。

Abstract: In recent years, multimodal large language models (MLLMs) have shown strong potential for embodied intelligence, yet their ability to maintain geometrically consistent spatial understanding across heterogeneous views remains under-evaluated. Existing benchmarks largely focus on single-agent, single-view perception, leaving a gap in the systematic assessment of collaborative air-ground settings, where multi-scale observations are complementary but introduce scale mismatch, asymmetric occlusion, and reference-frame inconsistencies. We present AirGroundBench, a diagnostic benchmark for evaluating multi-view spatial intelligence in heterogeneous UAV-UGV collaboration. AirGroundBench is built from 11 high-fidelity simulated environments with 1,021 synchronized air-ground observation pairs, yielding approximately 62,000 dual-view, four-option single-choice visual question answering instances and 115 closed-loop vision-language navigation episodes. It covers 10 task types organized into four progressively demanding capability dimensions: spatial perception, cross-view alignment, spatial transformation and reasoning, and embodied decision-making. To support geometry-grounded evaluation and analysis, we provide structured spatial annotations, including cross-view object identities and metric 2D and 3D bounding boxes. Evaluations of 13 representative MLLMs under UAV-only, UGV-only, and dual-view input settings reveal consistent bottlenecks: models perform relatively well on spatial perception but struggle with cross-view alignment and transformation-intensive reasoning, and these deficits propagate to sequential decision-making in vision-language navigation. Although dual-view inputs provide measurable gains over single-view variants, a persistent gap from human performance remains, highlighting geometric consistency as a key limitation of current embodied MLLMs.

[63] STAG: Spatio-temporal Evolving Structural Representation of Action Units for Micro-expression Recognition cs.CV | cs.AI | cs.GR | cs.HC | cs.MMPDF

Nandani Sharma, Varun Sharma, Dinesh Singh

TL;DR: 本文提出STAG，一种动态ROI-AU耦合的时空网络，用于微表情识别。该网络通过基于幅度的帧选择和时序注意力提取光流，采用双分支架构结合增强图注意力网络进行结构化空间推理和Transformer编码器进行时序建模，并引入双向交叉注意力模块实现时空特征的相互细化。

Details

Motivation: 现有微表情识别方法过度依赖顶点帧和起始帧，忽略细粒度帧间动态，且将空间与时序信息分开建模，导致跨数据集泛化能力受限。

Result: 在CASME II、4DME、DFME、NaME、SAMM和SMIC-HS等多个数据集上进行广泛实验，结果表明该方法在鲁棒性、泛化性、可解释性和计算效率方面均有提升，证实了自适应关系推理、AU引导的动态连接和深度时空特征融合的有效性。

Insight: 创新点包括AU引导的动态面部区域连接性，可根据肌肉激活模式自适应调整交互；以及双向交叉注意力模块实现时空特征的相互细化，超越了仅基于顶点帧的时序建模方法，提升了语义一致性和可解释性。

Abstract: Micro-expression recognition is challenging due to subtle and short-lived facial muscle movements. Existing methods rely heavily on apex-onset frames, overlook fine-grained inter-frame dynamics, and separately model spatial and temporal information, limiting generalization across datasets. To address these challenges, we propose STAG, a dynamic ROI-AU-coupled spatial-temporal network that jointly models motion flow and adaptive facial connectivity. The framework extracts optical flow from discriminative frames using magnitude-based selection and temporal attention. A dual-branch architecture combines an enhanced graph attention network for structured spatial reasoning with a transformer encoder for temporal modeling. A bidirectional cross-attention module enables mutual refinement of spatial and temporal features, while AU-guided dynamic connectivity adapts facial region interactions according to muscle activation patterns. The transformer captures subtle temporal dynamics beyond apex-based approaches, improving semantic consistency and interpretability for explainable micro-expression recognition. The fused representation is optimized using focal loss and evaluated on CASME II, 4DME, DFME, NaME, SAMM, and SMIC-HS. Extensive experiments demonstrate improved robustness, generalization, interpretability, and computational efficiency, confirming the effectiveness of adaptive relational reasoning, AU-guided dynamic connectivity, and deep spatial-temporal feature fusion for accurate cross-dataset micro-expression recognition.

[64] OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal cs.CV | cs.AIPDF

Qinming Zhou, Chenxi Sun, Deyang Kong, Junhao He, Xiangheng Tang

TL;DR: 本文提出OSOR（One-Step Object Removal），一种用于效果感知物体移除的单步扩散修复方法，旨在解决真实世界物体移除中的两大难题：目标物体的非局部效应（如阴影和反射）难以建模，以及用户提供的掩码通常不准确或不完整。OSOR通过引入占用引导判别器、alpha预测头和语义锚定验证管道（SAVP），实现了高效、效果感知且对掩码鲁棒的物体移除。

Details

Motivation: 解决真实世界物体移除中非局部效应建模困难以及用户掩码不准确的问题，同时降低基于扩散模型的多步去噪过程带来的高计算成本，使其更适用于交互式应用和边缘设备。

Result: 实验表明，OSOR在感知质量上超越了强大的多步扩散基线模型，同时实现了4倍到30倍的推理加速。

Insight: 创新点包括：1) 占用引导判别器实现稳定的单步扩散训练；2) 利用预训练扩散模型知识的alpha头处理不完美掩码；3) 语义锚定验证管道（SAVP）用于大规模生成效果感知的监督数据。此外，构建了包含28万对验证移除数据的CORNE数据集，并标注了AnimeEraseBench和TextEraseBench用于评估更复杂的移除任务。

Abstract: Real-world object removal is challenging due to two key difficulties: the target object’s non-local effects, such as shadows and reflections, which are difficult to model, and the fact that user-provided masks are often inaccurate or incomplete. With billions of parameters and tens of denoising steps, diffusion-based models achieve strong removal performance at the expense of substantial computational cost, limiting their use in interactive applications and on edge devices. To address these challenges, we present OSOR (One-Step Object Removal), which simultaneously achieves efficient, effect-aware, and mask-robust object removal. Concretely, OSOR introduces: (1) an occupancy-guided discriminator for precise boundary supervision, enabling stable single-step diffusion training; (2) an alpha head that leverages knowledge from pretrained diffusion models to predict appropriate removal regions with minimal overhead, thereby handling imperfect masks; and (3) a semantic-anchored verification pipeline (SAVP) that filters noisy instruction-based triplets to produce effect-aware supervision at scale. Using SAVP, we curate CORNE, which contains 280K verified removal pairs, and further annotate AnimeEraseBench and TextEraseBench to evaluate performance on more complex removal tasks. Experiments show that OSOR surpasses strong multi-step diffusion baselines in perceptual quality while achieving $4\times$ to $30\times$ faster inference.

[65] Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training cs.CV | cs.LGPDF

Francis Xiatian Zhang, Hao Yao, Shengxuan Chen, Hong Zhu, Hongxiao Jia

TL;DR: 本文提出了一种名为CME-AQA的跨视图多模态视觉评估框架，用于中医康复训练的动作质量评估。该框架融合视觉与姿态信息以增强环境上下文理解，并利用训练期间的第一人称和第三人称视频提升推理鲁棒性。在自建的中医针灸和推拿双视角数据集上，该方法在关键评分任务上取得了优于或可比拟基线模型的性能。

Details

Motivation: 现有基于计算机视觉的物理治疗自动动作质量评估框架通常依赖单一视角的骨骼数据，这对于涉及密集手部自遮挡和复杂手-物交互的中医技术（如针灸、推拿）效率低下。

Result: 在自建的TCM-AQA61-A（针灸）和TCM-AQA61-T（推拿）数据集上，该方法在关键评分任务（如针深、快针）上相比最佳竞争方法取得了超过10%的相对加权F1分数提升，并在插入时间、操作频率等定量指标上降低了平均绝对误差。在CPR数据集上的测试也表明其在多个基于姿态的标准上具有可比性能。

Insight: 创新点在于提出了一个融合视觉与姿态的跨视图多模态框架，通过整合第一人称和第三人称视角视频来应对手部遮挡和复杂交互的挑战，提升了在结构化临床技能评估中的准确性和鲁棒性。

Abstract: Vision-based assessment can provide convenient and cost-effective evaluation in Traditional Chinese Medicine (TCM) rehabilitation training, where action quality assessment (AQA) from computer vision offers a promising solution. Existing automatic AQA frameworks for physical therapy typically rely on skeletal data captured from a single viewpoint, which is inefficient for TCM techniques such as acupuncture or Tuina that involve dense hand self-occlusion and complex hand-object interactions. To address these challenges, we propose CME-AQA, a cross-view, multimodal vision-based assessment framework that integrates visual-pose fusion to enhance understanding of environmental context and leverages both first-person and third-person videos during training to improve inference robustness. We collected two dual-view datasets, TCM-AQA61-A (Acupuncture) and TCM-AQA61-T (Tuina), each containing synchronized first-person and third-person recordings of 61 subjects with expert annotations. Experimental results show that our approach achieves superior or comparable mean performance against competitive baselines, achieving over 10% relative improvement in weighted F1 over the best competing method on key rating tasks such as Needle Depth and Quick Needle Insertion, while also reducing mean absolute error in quantitative measures such as insertion time and manipulation frequency. Testing on a CPR dataset further demonstrates comparable performance on several posture-based criteria, suggesting applicability to related structured simulated clinical skill assessments where participant motion is central to evaluation. Overall, CME-AQA enhances assessment accuracy for structured TCM rehabilitation training and facilitates more convenient and effective training-oriented skill evaluation.

[66] PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation cs.CV | cs.AI | cs.ROPDF

Peiwen Zhang, Yufan Deng, Shangkun Sun, Juncheng Ma, Duomin Wang

TL;DR: 本文提出了PhysisForcing，一个用于增强具身世界模拟物理一致性的可扩展训练框架。该框架通过联合优化像素级和语义级特征，将监督重点放在物理信息丰富的区域，以解决现有视频生成模型在机器人操作模拟中产生的物理不合理问题，如不连续运动轨迹和不一致的机器人-物体交互。

Details

Motivation: 现有用于具身世界模拟的视频生成模型（包括通用领域视频生成器和机器人专用微调模型）仍会产生物理上不合理的操作，这限制了其作为世界模拟器的可靠性。论文旨在解决由移动物体变形和交互实体间（尤其是接触时）不合理的时空相关性引起的物理不稳定性问题。

Result: 在R-Bench、PAI-Bench和EZS-Bench上的大量实验表明，PhysisForcing持续改进了具身视频生成，将Wan2.2-I2V-A14B和Cosmos3-Nano基础模型在R-Bench上的性能分别提升了22.3%和9.2%（相比普通微调分别提升7.1%和3.7%）。在WorldArena动作规划协议下作为世界模型，它将闭环成功率从16.0%提升至24.0%，并进一步提高了下游策略的成功率。

Insight: 论文的核心创新点在于提出了一个联合像素级轨迹对齐损失和语义级关系对齐损失的训练框架，通过聚焦于物理信息丰富的区域（如接触点）来强化物理一致性。这提供了一种通过多层级特征监督来增强生成模型物理合理性的可扩展方法，从而产生更适合机器人操作的更强表征。

Abstract: Video generation models have emerged as a promising paradigm for embodied world simulation. However, both general-domain video generators and robot-specific data fine-tuned models can still produce physically implausible manipulations, including discontinuous motion trajectories and inconsistent robot-object interactions, which limits their reliability as world simulators. Through extensive experiments, we find that such physical instability mainly arises from two factors: deformation of moving objects and implausible spatio-temporal correlations among interacting entities, particularly during contact. Building on this observation, we propose PhysisForcing, a scalable training framework that strengthens physical consistency by focusing supervision on physics-informative regions through joint optimization of pixel-level and semantic-level features. The framework consists of a pixel-level trajectory alignment loss, which supervises DiT features using reference point trajectories, and a semantic-level relational alignment loss, which aligns DiT features with inter-region relations extracted from a frozen video understanding encoder. Extensive experiments on R-Bench, PAI-Bench, and EZS-Bench show that PhysisForcing consistently improves embodied video generation over strong baselines, improving the Wan2.2-I2V-A14B and Cosmos3-Nano base models on R-Bench by 22.3% and 9.2% (7.1% and 3.7% over vanilla finetuning), with the Cosmos3-Nano variant attaining the best overall score. Beyond generation, as a world model under the WorldArena action-planner protocol it raises the closed-loop success rate from 16.0% to 24.0% and further improves downstream policy success, indicating that physically aligned video models yield stronger representations for robotic manipulation.

[67] BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration cs.CV | cs.AIPDF

Xinrui Wu, Lichen Huang

TL;DR: 本文提出BiDeMem，一种用于可解释图像恢复的双向退化记忆机制。该方法通过从恢复特征和输入统计构建查询，检索内存槽的紧凑top-k子集，在推理时支持恢复路径，并在训练时提供前向退化解释路径。研究重点在于可控多退化NAFNet设置中的可验证性，通过新控制分离校正头、密集查询先验和静态全局先验的增益，并证明BiRank在保持恢复质量的同时提高了错误先验和原生先验的敏感性。

Details

Motivation: 当前图像恢复中使用的退化感知提示、条件和潜在先验通常仅通过PSNR等单一端点评估，这是一种弱语义测试，这些条件可能仅通过增加容量、作为全局校正偏差或利用数据集捷径来提升性能，而未能成为可解释的退化先验。

Result: 在可控多退化NAFNet设置中，校正头、密集查询先验和静态全局先验的变体分别比BiRank低0.2588、0.2586和0.2839 dB；强残差监督和更宽的退化头也低于完整的双向记忆模型。BiRank在保持恢复质量的同时提高了对错误先验和原生先验的敏感性。

Insight: 创新点在于将退化记忆设计为双向机制，既作为恢复模块，又作为可证伪的解释机制；通过检索式内存槽选择实现可解释的退化先验，避免了传统方法中可能存在的语义弱测试问题。

Abstract: Degradation-aware prompts, conditions, and latent priors are increasingly used in image restoration, yet they are usually judged by a single endpoint: whether the restored image obtains higher PSNR. This is a weak test of semantics. A condition can help by adding capacity, acting as a global correction bias, or exploiting dataset shortcuts, without becoming an interpretable degradation prior. We propose BiDeMem, a bidirectional degradation memory for explainable image restoration. A query built from restoration features and input statistics retrieves a compact top-k subset of memory slots. The same selected slot identity supports the restoration path at inference time and a training-only forward-degradation explanation path. The study centers on verifiability in a controlled multi-degradation NAFNet setting. New controls separate the gain from a correction head alone, a dense query prior, and a static global prior: these variants are 0.2588, 0.2586, and 0.2839 dB below BiRank, respectively. Strong residual supervision and a wider degradation head also remain below the full bidirectional memory model. Intervention probes show that BiRank preserves restoration quality while increasing wrong-prior and native-prior sensitivity, framing degradation memory as both a restoration module and a falsifiable explanation mechanism.

[68] Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading cs.CVPDF

Hong Li, Minqi Meng, Yanjun Liang, Chongjie Ye, Houyuan Chen

TL;DR: 本文提出了一种数据高效的单目图像三维头像重建框架，通过级联扩散先验和UV空间可微着色，从单张野外图像重建高保真、可重照明的三维头像。该方法利用预训练扩散模型的强大先验，通过低秩适应（LoRA）依次解决纹理补全、去光照和材质分解问题，并在分解阶段引入UV空间可微BRDF着色损失以确保物理合理性。

Details

Motivation: 从单张野外图像重建高保真、可重照明的三维头像是一个不适定问题，主要受限于高质量PBR数据的稀缺性以及从固有材质中分离光照的复杂性。现有方法依赖于碎片化流程或大量专有数据集，本文旨在提出一个数据高效的框架来解决这些问题。

Result: 在少于100个真实3D扫描数据上训练后，该方法能生成全面的4K分辨率PBR资产，在真实感和泛化性方面优于现有最先进方法，所有训练代码和模型权重将在论文被接受后开源。

Insight: 创新点包括利用级联LoRA适配扩散模型先验来处理UV空间中的子任务，引入跨内在注意力机制进行去光照和材质分解，以及使用UV空间可微BRDF着色损失来强制生成过程遵循渲染方程，避免了基于光栅化监督的典型伪影，从而实现了数据高效和高保真重建。

Abstract: Reconstructing high-fidelity, relightable 3D avatars from a single in-the-wild image is a challenging ill-posed problem, primarily hindered by the scarcity of high-quality PBR data and the complexity of disentangling illumination from intrinsic materials. In this paper, we present a data-efficient framework that leverages the robust priors of a unified pre-trained diffusion backbone to sequentially address texture completion, delighting, and material decomposition. Unlike existing methods that rely on fragmented pipelines or extensive proprietary datasets, we utilize cascaded Low-Rank Adaptations (LoRAs) to adapt the strong generative prior of the diffusion model for each sub-task in UV space. Specifically, we first employ an Inpainting LoRA to complete missing UV textures caused by occlusion, leveraging the model’s semantic understanding to generate semantically and photometrically coherent details. Subsequently, a Light-Homogenization LoRA and a novel Cross-Intrinsic Attention mechanism are introduced to remove baked-in lighting and collaboratively synthesize pixel-aligned PBR maps (Albedo, Normal, Roughness, Specular, and Displacement). To ensure physical plausibility, we impose a UV-space differentiable BRDF shading loss during the decomposition stage, forcing the generative process to adhere to the rendering equation without the artifacts typical of rasterization-based supervision. Extensive experiments demonstrate that our method, trained on fewer than 100 real 3D scans, generates comprehensive, 4K-resolution PBR assets with superior realism and generalization compared to state-of-the-art methods, and all training code and model weights will be released upon acceptance.

[69] Toward Robust In-Context Segmentation via Concept Guidance cs.CV | cs.AIPDF

Zhigang Chen, Xiawu Zheng, Rongrong Ji

TL;DR: 本文提出了一种名为概念引导上下文分割（CG-ICS）的新范式，旨在提升上下文分割任务的鲁棒性。该方法通过从参考图像中提取高层语义概念，并结合视觉范例，来激活冻结的SAM3主干网络进行分割，而非仅仅依赖低层视觉匹配。

Details

Motivation: 现有上下文分割研究大多忽视了系统鲁棒性这一关键方面，即模型能否在不同参考图像下对同一查询图像产生稳定的分割结果。本文旨在从鲁棒性角度重新审视上下文分割问题。

Result: 在标准上下文分割基准上的大量实验表明，CG-ICS不仅达到了最先进的准确率，而且显著提升了鲁棒性，大幅降低了在不同参考选择下的结果方差。

Insight: 核心创新在于引入概念推理模块，利用MLLM生成候选概念，并通过SAM3驱动的评分函数结合树搜索优化来选择可靠的文本概念，同时并行使用视觉范例路径提供空间定位，从而将高层语义概念与低层视觉信息相结合，提升了分割的稳定性和可靠性。

Abstract: In-context segmentation (ICS) requires a model to segment target regions in a query image using only a few reference images and their corresponding masks, without updating any parameters. Despite recent progress, prior ICS studies have largely overlooked a critical aspect: system robustness, ie, whether the model can produce stable segmentation results for the same query under different references. In this work, we revisit ICS from the robustness perspective and introduce a novel paradigm, Concept-Guided In-Context Segmentation (CG-ICS), which performs segmentation by extracting high-level semantic concepts from references rather than relying solely on low-level visual matching. Specifically, CG-ICS introduces a concept reasoning module that uses an MLLM to propose candidates and a SAM3-driven scoring function with tree-search refinement to select reliable textual concepts, together with a parallel visual exemplar route that provides query-side spatial grounding via a simple context construction. Both the textual concept and the visual exemplar are then used to activate the segmentation capability of a frozen SAM3 backbone. Extensive experiments on standard ICS benchmarks demonstrate that CG-ICS not only achieves state-of-the-art accuracy but also substantially improves robustness, yielding a more reliable ICS system with significantly reduced variance across diverse reference choices.

[70] EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography cs.CV | cs.LGPDF

Darya Taratynova, Ahmed Aly, Numan Saeed, Mohammad Yaqub

TL;DR: 本文提出了EchoSonar-R，一个用于超声心动图的多视图推理视觉语言模型，它结合了时空视频编码器和结构感知的心脏检测器，以联合执行多标签疾病分类和报告生成。该模型通过两阶段训练（监督微调和基于特定任务奖励的强化学习优化），旨在提高诊断的可解释性和临床医生的信任度。

Details

Motivation: 当前超声心动图分析模型大多缺乏明确的诊断推理和基于空间位置的解剖学证据，这限制了临床医生的信任。本文旨在开发一个能够进行跨视图推理、提供可解释诊断依据的模型。

Result: 在私有多视图数据集和两个公共基准测试（包括MIMICEchoQA）上，EchoSonar-R将宏观平衡准确率分别提高了17.1%和6.1%，超过了最强基线，并获得了0.800的GREEN临床忠实度分数。

Insight: 创新点在于将结构感知的心脏检测器提供的空间解剖学线索与跨视图推理相结合，并通过统一的强化学习框架（GRPO）联合优化分类和报告生成任务，从而生成基于多视图视觉证据的可解释推理轨迹。

Abstract: Echocardiography is the most widely used non-invasive cardiac imaging modality, providing essential information for cardiovascular diagnosis. Interpreting an echocardiogram requires synthesizing complementary evidence across multiple heart views to identify abnormalities and produce structured clinical reports. While recent efforts focus on improving classification performance, most models lack explicit diagnostic reasoning and spatially grounded anatomical evidence, limiting clinician trust. We present EchoSonar-R, a multi-view reasoning-enabled vision-language model that jointly performs multi-label disease classification and report generation from echocardiography studies. EchoSonar-R combines a spatiotemporal video encoder with a structure-aware cardiac detector that provides spatially grounded anatomical cues to improve interpretability and clinician trust during cross-view reasoning. EchoSonar-R is trained in two stages: supervised fine-tuning (SFT) on reasoning-annotated targets, followed by Group Relative Policy Optimization (GRPO) with task-specific rewards that jointly align classification and report generation within a unified reinforcement-learning framework. Across a private multi-view dataset and two public benchmarks, EchoSonar-R improves macro balanced accuracy by 17.1% on the private set and 6.1% on MIMICEchoQA over the strongest baseline, achieves a GREEN clinical faithfulness score of 0.800, and produces interpretable reasoning traces grounded in multi-view visual evidence.

[71] HAT-4D: Lifting Monocular Video for 4D Multi-Object Interactions via Human-Agent Collaboration cs.CV | cs.AI | cs.GRPDF

Jiaxin Li, Yuxiang Wu, Zhenkai Zhang, Xinrui Shi, Haoyuan Wang

TL;DR: 本文提出了HAT-4D，这是首个用于从单目视频中重建多个物体3D几何、时序动态和物理交互的智能体框架。该框架通过整合视觉语言模型和多层次的人类在环反馈机制，有效解决了3D生成和4D传播过程中的深度歧义和交互遮挡问题，从而生成物理上合理的资产。

Details

Motivation: 现有单目4D重建方法主要关注孤立物体，在多物体交互场景中，由于严重的遮挡和复杂的动态，往往失效。本文旨在填补这一空白，从海量单目视频中高效提取动态4D物体交互，为具身AI和视觉语言模型的规模化训练提供数据收集途径。

Result: 大量实验表明，HAT-4D在大多数评估指标上达到了SOTA性能，同时保持了有竞争力的语义对齐。消融研究表明，引入少量人工反馈能改善交互重建。此外，HAT-4D生成的数据用于微调时，有效提升了基线模型的性能。

Insight: 核心创新在于提出了一个结合视觉语言模型与多层次人类在环反馈的智能体框架，以协作方式解决复杂交互场景下的重建难题。同时，构建了开放世界的单目4D交互重建基准MVOIK-4D及专注于物理合理性和时序一致性的多维评估协议，推动了该领域的发展。

Abstract: Extracting dynamic 4D object interactions from massive, in-the-wild monocular videos offers a highly efficient data collection pathway for scaling Embodied AI and training VLAs. However, existing monocular 4D reconstruction methods primarily focus on isolated objects, often failing under the severe occlusions and complex dynamics inherent in multi-object interactions. To bridge this gap, we propose HAT-4D, the first agentic framework designed to reconstruct the 3D geometry, temporal dynamics, and physical interactions of multiple objects from a single video. By integrating VLMs with a multi-level human-in-the-loop feedback mechanism, HAT-4D efficiently resolves depth ambiguities and interaction-induced occlusions during 3D generation and 4D propagation, yielding physically plausible assets without relying on expensive multicamera rigs. As a scalable data engine, HAT-4D facilitates the creation of MVOIK-4D, an open-world benchmark for monocular 4D interaction reconstruction, accompanied by a novel multi-dimensional evaluation protocol focused on physical plausibility and temporal consistency. Extensive experiments demonstrate that HAT-4D achieves SOTA performance on most evaluation metrics, while maintaining competitive semantic alignment. Ablation studies show that introducing a small amount of human feedback improves interaction reconstruction. Moreover, the data produced by HAT-4D effectively improves baseline performance when used for fine-tuning. Our data and code are available at https://lijiaxin0111.github.io/HAT4D/

[72] Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching cs.CV | cs.AIPDF

Guanbo Huang, Jingjia Mao, Fanding Huang, Fengkai Liu, Xiangyang Luo

TL;DR: 本文提出DEFAR框架，通过方向性和频率自适应校正来缓解Flow Matching中的曝光偏差问题。该方法在训练中模拟单步推理过程，利用偏差本身的动态信号进行自校正，包含抗漂移校正和频率补偿两个核心组件。实验表明DEFAR在多个数据集上优于现有基线，并展现出良好的可扩展性和推理鲁棒性。

Details

Motivation: Flow Matching在训练和推理阶段存在差异导致曝光偏差，现有方法多依赖静态约束或外部启发式策略，本文认为偏差本身包含动态信号可用于自校正。

Result: 在CIFAR-10、CelebA-64和ImageNet-256/512等数据集上的实验表明，DEFAR超越了先前基线方法，并显示出优越的可扩展性、兼容性和推理鲁棒性。

Insight: 创新点在于提出曝光偏差可通过自身动态信号进行自校正，具体通过方向性抗漂移校正和频率补偿机制，使模型具备内在主动校正能力，而非依赖外部约束。

Abstract: Flow Matching (FM) has achieved remarkable generative performance, yet it suffers from exposure bias due to discrepancies between training and inference. Existing mitigation strategies typically rely on static constraints or external heuristics. In this work, we propose that exposure bias itself inherently contains dynamic signals that can guide its own rectification. To leverage this, we introduce DEFAR (DirEctional-Frequency Adaptive Rectification). This framework simulates the single-step inference process during training to identify exposure bias. It utilizes directional and frequency-adaptive feedback signals from the bias itself to enhance the model’s bias tolerance. It consists of two key components: (1) Anti-Drift Rectification (ADR). ADR treats inference-time drift as a signal to learn the direction to steer deviated states back toward the target. ADR endows the model with intrinsic active self-rectification capabilities; (2) Frequency Compensation (FC). Empirically, we observe that accumulated bias often stems from a lack of low-frequency components in high-noise stages, and exposure bias carries the missing frequency. FC leverages the bias itself as a self-feedback weighting factor to reinforce the missing frequency components. Experiments on CIFAR-10, CelebA-64, and ImageNet-256/512 show that DEFAR outperforms prior baselines and further demonstrates favorable scalability, compatibility, and inference robustness.

[73] PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception cs.CVPDF

Yana Wei, Hongbo Peng, Yanlin Lai, Liang Zhao, Kangheng Lin

TL;DR: 本文提出了PerceptionRubrics评估框架，通过基于量规的细粒度审计来解决现有基准测试分数饱和但模型实际表现脆弱的问题。该框架包含超过12,000个实例特定量规，采用双流系统（Must-Right和Easy-Wrong）和门控评分机制，对模型在密集视觉信息下的感知能力进行严格评估。

Details

Motivation: 动机在于弥合现有基准测试分数饱和与模型在真实世界中表现脆弱之间的差距，将评估从整体语义匹配转向严格的原子级审计，以更准确地衡量多模态模型的感知可靠性。

Result: 在构建的包含1,038张信息密集图像和大量量规的数据集上评估发现：模型在碎片化元素上表现良好但无法满足严格联合约束；开源与专有模型之间存在8%的感知差距；门控评分指标比传统基准更符合人类感知对齐。

Insight: 创新点包括：基于环形同行评审共识构建黄金标注的量规生成流程；Must-Right（必需事实）和Easy-Wrong（细粒度细节）的双流量规系统；以及引入二进制惩罚的门控评分机制，强调严格感知保真度是可靠生成的前提。

Abstract: We introduce PerceptionRubrics, a rubric-based evaluation framework that addresses the gap between saturated benchmark scores and real-world brittleness. Shifting evaluation from holistic semantic matching to rigorous atomic auditing, PerceptionRubrics pairs 1,038 information-dense images with over 12,000 instance-specific rubrics. These criteria are derived from golden captions constructed via a novel Circular Peer-Review consensus pipeline and then distilled into a dual-stream system of Must-Right (essential facts) and Easy-Wrong (fine-grained details) rubrics. Crucially, PerceptionRubrics implements a Gated Scoring mechanism: unlike linear averages, failure on mandatory visual facts triggers sharp binary penalties. Extensive evaluation yields critical insights: (1) The Reliability Gap: models often verify fragmented elements correctly yet fail strict conjunctive constraints, exposing brittleness in dense domains; (2) Open-Closed Stratification: contrary to reasoning trends, we reveal a persistent 8% perception deficit between open-source and proprietary frontiers; and (3) Human-Aligned Rigor: our gated metrics substantially out-align conventional benchmarks, validating that strict perceptual fidelity is the prerequisite for reliable generation.

[74] RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning cs.CVPDF

Yelin Wang, Zijia Song, Shuo Ye, Chuanguang Yang, Miaoyu Wang

TL;DR: 本文提出了RSICCLLM，一个用于遥感图像变化描述（RSICC）的多模态大语言模型后训练框架。该框架通过设计数据生成范式、发布指令数据集RSICI并建立特定任务基准，结合差异感知监督微调（Difference-aware Supervised Fine-tuning）和双负偏好优化（DNPO）策略，有效提升了模型对双时相遥感图像间细粒度变化的理解与描述能力。实验表明，仅使用7B参数的RSICCLLM在RSICC任务上取得了优异性能，超越了规模更大的模型。

Details

Motivation: 现有遥感图像变化描述方法多基于传统深度学习架构，模型能力有限，而通用领域大模型后训练技术因数据稀缺和细粒度变化理解需求难以直接迁移到RSICC任务。

Result: 在提出的RSICC基准上进行了广泛实验，RSICCLLM仅用7B参数就取得了出色的结果，超越了规模大得多的模型，展现了其卓越能力。

Insight: 创新点包括：1）首个针对RSICC任务的大视觉语言模型后训练框架；2）设计了数据生成范式并发布了指令数据集RSICI；3）提出了差异感知监督微调以显式提取变化表征；4）提出了双负偏好优化（DNPO）策略，通过两种互补的负样本构建策略进一步精炼模型性能。

Abstract: Remote Sensing Image Change Captioning (RSICC) aims to describe changes between bi-temporal remote sensing images and holds significant research and application value. However, most existing methods rely on conventional deep learning architectures, and the limited model capacity constrains performance. Although large-model post-training techniques have achieved great success in general domains, their direct transfer to RSICC remains challenging due to data scarcity and the need for fine-grained change understanding. To address this, we propose RSICCLLM, the first post-training framework for large vision-language models in RSICC. Specifically, we design a data generation paradigm, release the instruction dataset RSICI, and establish a task-specific RSICC benchmark. We further introduce Difference-aware Supervised Fine-tuning to explicitly extract change representations and guide the model in perceiving and understanding temporal differences. In addition, we propose Dual-Negative Preference Optimization (DNPO), which employs two complementary negative-sample construction strategies to construct the preference dataset RSICP and further refine model performance. Extensive experiments validate the superior capability of RSICCLLM, which achieves outstanding results with only 7B parameters, surpassing models of substantially larger scales. The code and dataset will be made publicly available at https://github.com/keaill/RSICCLLM.

[75] Learning Topology-Aware Representations via Test-Time Adaptation for Anomaly Segmentation cs.CV | cs.AIPDF

Ali Zia, Usman Ali, Abdul Rehman, Umer Ramzan, Kang Han

TL;DR: 本文提出了一种名为TopoTTA的新框架，将拓扑数据分析中的持久同调工具集成到测试时适应（TTA）流程中，以增强异常分割任务中的几何和结构一致性。该方法通过在多级立方体复形过滤中处理异常得分图，生成鲁棒的拓扑伪标签来指导轻量级测试时分类器，从而在不重新训练骨干模型的情况下提升分割质量。

Details

Motivation: 现有用于异常分割的测试时适应方法主要依赖像素级启发式方法（如置信度阈值或熵最小化），这些方法在噪声和纹理变化下难以保持结构一致性，并且通常将异常图视为平坦的强度场，忽略了描述复杂缺陷几何的高阶空间关系。

Result: 在六个标准基准（MVTec AD, VisA, Real-IAD, MVTec 3D-AD, AnomalyShapeNet和MVTec LOCO）上的广泛实验表明，该方法相比最先进的无监督异常检测与分割方法，平均F1分数提升了15%，在具有复杂几何或结构变化的异常上提升最大。

Insight: 创新点在于将拓扑推理（持久同调）引入测试时适应，以生成结构感知的伪标签，从而避免了对方法特定原始得分阈值的依赖，保持了连通性，并实现了跨2D和3D模态的泛化，为几何学习与鲁棒适应之间搭建了桥梁。

Abstract: Test-time adaptation (TTA) has emerged as a promising paradigm for mitigating distribution shifts in deep models. However, existing TTA approaches for anomaly segmentation remain limited by their reliance on pixel-level heuristics, such as confidence thresholding or entropy minimisation, which fail to preserve structural consistency under noise and texture variation. Moreover, they typically treat anomaly maps as flat intensity fields, ignoring the higher-order spatial relationships that characterise complex defect geometries. We introduce TopoTTA (Topological Test-Time Adaptation), a novel framework that integrates persistent homology, a tool from topological data analysis, into the TTA pipeline to enforce geometric and structural coherence during adaptation. By applying multi-level cubical complex filtration to anomaly score maps, TopoTTA derives robust topological pseudo-labels that guide a lightweight test-time classifier, enhancing segmentation quality without retraining the backbone model. The approach avoids reliance on method-specific raw-score thresholding for mask binarisation, preserves connectivity, and generalises across both 2D and 3D modalities. Extensive experiments across six standard benchmarks (MVTec AD, VisA, Real-IAD, MVTec 3D-AD, AnomalyShapeNet, and MVTec LOCO) demonstrate an average 15% F1 improvement over state-of-the-art unsupervised anomaly detection and segmentation methods, with the largest gains on anomalies exhibiting complex geometric or structural variations. These findings suggest that integrating topological reasoning into test-time adaptation provides a principled route to structure-aware generalisation, bridging the gap between geometric learning and robust adaptation.

cs.RO [Back]

[76] DIM-WAM: World-Action Modeling with Diverse Historical Event Memory cs.RO | cs.CVPDF

Kai Wang, Zhaopeng Gu, Yixiang Chen, Yuan Xu, Qisen Ma

TL;DR: 本文提出了DiM-WAM，一种用于机器人操作的世界-动作模型，通过整合多尺度历史上下文、局部未来动态和全局任务进度来增强长期任务性能。该方法利用记忆模块提取并存储紧凑的视觉事件信息，通过独立的基于相似性的合并更新多个记忆库，并读取嵌入身份和时间信息的长期上下文来指导视频和动作的去噪。

Details

Motivation: 现有世界-动作模型主要依赖短期历史和短视距未来预测，难以处理需要依赖早期观察和任务进度的长视距任务，存在长期遗忘和对全局任务状态感知不足的问题。

Result: 在RMBench基准上，DiM-WAM将平均成功率从LingBot-VA的28.4%提升至69.8%，超过了显式记忆基线Mem-0的42.0%。在四个真实世界的Franka任务中，平均阶段成功率从70.7%提升至91.5%，全任务成功率从52.5%提升至80.0%。

Insight: 创新点在于设计了一个记忆增强架构，通过多记忆库和基于相似性的合并机制来有效整合互补的时间信息（近期局部上下文、跨阶段历史事件、即时未来动态和全局任务进度），并引入进度监督目标使记忆令牌编码已完成的历史事件、当前任务阶段及其对剩余任务的影响。

Abstract: World-action models have shown promising robot-manipulation performance by jointly predicting future visual states and actions. However, existing methods mainly rely on short-term history and short-horizon future prediction, which is insufficient for long-horizon tasks whose correct execution depends on earlier observations and task progress. Such temporally dependent tasks require effective use of complementary temporal information, including recent local context, cross-stage historical events, immediate future dynamics, and global task progress. To address long-term forgetting and poor awareness of the global task state, we introduce DiM-WAM, a memory-augmented world-action model that integrates multi-scale historical context, local future dynamics, and global task progress. The memory extracts compact visual event information from real observations, updates multiple memory banks through independent similarity-based merging, and then reads the bank-identity- and time-embedded long-term context to condition video and action denoising. A progress-supervision objective further encourages memory tokens to encode not only completed historical events but also the current task stage and its implications for the remaining task. On RMBench, DiM-WAM raises average success from 28.4% with LingBot-VA to 69.8%, exceeding the explicit-memory Mem-0 baseline at 42.0%. On four real-world Franka tasks, it improves average stage success from 70.7% to 91.5% and full-task success from 52.5% to 80.0%. Project page: https://wangkai-casia.github.io/dim-wam/{\texttt{https://wangkai-casia.github.io/dim-wam/}}.

[77] Translation as a Bridging Action: Transferring Manipulation Skills from Humans to Robots cs.RO | cs.CVPDF

Sijin Chen, Kaixuan Jiang, Haixin Shi, Yanhui Wang, Weiheng Zhong

TL;DR: 本文提出了一种名为’桥接动作’的表示方法，用于将人类操作技能迁移到双臂机器人上。该方法通过使用初始头部相机坐标系下的相对手腕平移作为动作空间，避免了人类手部姿态噪声和抓取模式差异带来的问题，并构建了一个结合视觉、语言和动作的模型来处理不同执行器间的动作缺失。

Details

Motivation: 人类动作数据廉价、丰富且多样，是扩展机器人学习的重要资源，但直接将人类动作（如带噪声的6自由度手部姿态）迁移到机器人上效果不佳，因为人类手指的接触模式与平行夹爪存在根本差异。

Result: 在一系列新颖的双臂操作任务上，所提出的桥接动作表示方法在将人类操作知识迁移到机器人方面，远比带噪声的6自由度人类动作表示更有效，并且其性能随着人类数据量的增加而提升。

Insight: 核心创新在于提出了一个共享于人类和机器人之间的’桥接动作’表示（相对手腕平移），它绕过了旋转动作的噪声问题，并设计了一个具有交错动作令牌和注意力掩码的视觉-语言-动作模型来处理不同执行器间的动作不匹配。

Abstract: We study whether we can learn novel manipulation skills from human actions to a bi-manual robot with parallel grippers. Human action data is cheap, abundant, and diverse, making it one of the most promising resources for scaling up robot learning. Yet transferring skills from humans to robots remains hard: most prior work treats humans as just another bi-manual 6DoF embodiment, where hand-pose estimates are noisy and the contact patterns of human fingers differ fundamentally from those of a parallel gripper. We argue that learning rotation-inclusive action signals from human data is therefore sub-optimal, and instead propose a bridging action representation: the relative wrist translation within the initial head-camera frame, an action space shared by humans and robots. To handle the potential absence of certain action components in different embodiments, we build a $π_0$-like vision-language-action model with interleaved action tokens and attention masking. On a suite of novel bi-manual manipulation tasks, our bridging action transfers human manipulation knowledge to robots far more effectively than noisy 6DoF human actions and scales with the amount of human data.

eess.IV [Back]

[78] MLVC: Multi-platform Learned Video Codec for Real-World Deployment eess.IV | cs.AI | cs.CV | cs.LGPDF

Tanel Pärnamaa, Martin Lumiste, Ardi Loot, Evgenii Indenbom, Andrei Znobishchev

TL;DR: MLVC是一种面向实际部署的多平台学习型视频编解码器，通过超先验显式传输尺度参数来保证跨设备熵编码一致性，结合架构改进、长期参考恢复机制和感知训练，在保持实时速度的同时实现了优于硬件HEVC的压缩性能。

Details

Motivation: 现有神经视频编解码器虽在编码效率上超越传统编解码器，但存在跨平台不兼容和高计算成本的问题，量化方案在不同硬件上无法产生确定性结果，导致解码失败，因此需要设计一种硬件鲁棒且实用的跨平台神经视频编解码器。

Result: 在VCD视频会议基准测试中，MLVC相比最强可部署基线硬件HEVC实现了>70%的BD-rate（MOS）提升，主观质量与无法跨平台运行的DCVC-RT相当，编码器和解码器在苹果、英特尔和高通等消费级NPU上平均运行速度达100 FPS。

Insight: 创新点包括通过超先验传输尺度参数确保跨平台熵编码一致性，以及结合门控内存、ReGLU激活等架构改进、长期参考恢复和感知训练来恢复编码效率，首次实现了竞争性压缩性能、实时速度和跨平台鲁棒性的结合。

Abstract: Neural video codecs have surpassed classical codecs in coding efficiency but remain impractical for deployment due to cross-platform incompatibility and high computational cost. Existing quantization-based solutions fail to produce deterministic results across diverse hardware platforms, leading to catastrophic decoding failures. We introduce MLVC, a hardware-robust neural video codec designed for practical cross-platform inference. The key idea is to explicitly transmit scale parameters through the hyperprior, which guarantees entropy coding consistency across devices without requiring bit-exact arithmetic. While this increases bitrate overhead, we recover most of the coding efficiency through architectural improvements (gated memory, ReGLU activation), a long-term reference recovery mechanism, and domain-specific perceptual training. On the VCD video conferencing benchmark, MLVC achieves >70% BD-rate (MOS) improvement over hardware HEVC, the strongest deployable baseline, while reaching subjective quality competitive with DCVC-RT, which cannot operate across diverse platforms. Both the encoder and decoder run at 100 FPS on average on commodity NPUs from Apple, Intel, and Qualcomm. MLVC is the first neural video codec to combine competitive compression performance, real-time speed, and cross-platform robustness across diverse consumer devices, making it suitable for widespread deployment. Code will be released.

[79] Enhanced Neural Video Representation Compression across Extreme Complexity and Quality Scales eess.IV | cs.CVPDF

Ho Man Kwan, Tianhao Peng, Fan Zhang, Mike Nilsson, Andrew Gower

TL;DR: 本文提出了一种名为NVRC++的新型隐式神经表示（INR）视频编解码器，旨在解决现有神经视频编解码器在复杂性与可扩展性之间难以平衡的问题。该方法采用轻量级INR结合多分辨率特征网格，并配合一个优化框架，能够在保持较低复杂度的同时，支持从低到高的广泛码率和质量范围，并实现实时解码。

Details

Motivation: 现有基于INR的视频编解码器难以在保持模型复杂度一致的前提下，灵活扩展到不同的码率或质量级别，这限制了其在多样化实际场景中的部署。本文旨在设计一个统一的架构，能够在广泛的比特率范围内维持稳定的复杂度，并实现高效的时空冗余利用。

Result: 实验结果表明，NVRC++提供了从7kMACs/像素到360kMACs/像素的四个复杂度级别，每个级别都能覆盖较宽的码率和质量范围。与当前最先进的INR视频编解码器NVRC相比，NVRC++的解码速度提升了高达7.6倍，同时保持了可比的率失真性能。

Insight: 主要创新点在于将轻量级INR与多分辨率特征网格相结合，并设计了支持长视频序列高效过拟合的优化框架，从而在不显著增加计算或内存开销的情况下有效利用时空冗余。此外，针对高维网格参数设计了先进的熵模型，进一步提升了压缩效率。这种架构实现了复杂度与可扩展性的统一，为神经视频压缩的实际应用提供了新思路。

Abstract: Implicit neural representations (INRs) have recently emerged as a promising approach to video compression, delivering competitive rate-distortion performance alongside rapid decoding. However, existing neural video codecs struggle to balance complexity and scalability. Lightweight models often suffer from degraded compression performance when scaled to different bitrate/quality levels, whereas high-performance models exhibit limited scalability, as their model complexity typically increases with quality. This lack of a unified architecture capable of maintaining consistent complexity across a wide range of bitrates severely limits their diverse real-world deployment. To address these challenges, we introduce NVRC++, a novel INR-based video codec that utilizes a lightweight INR with multiple high-resolution feature grids, providing high scalability at any given complexity level. This is paired with an optimization framework that enables efficient overfitting on high-resolution grids for long video sequences, thereby exploiting spatio-temporal redundancies without prohibitive computational or memory overhead. Additionally, an advanced entropy model is designed for efficiently compressing the high-dimensional grid parameters. As a result, NVRC++ provides four complexity levels (from 7kMACs/pixel to 360kMACs/pixel), each spanning wide bitrate and quality ranges while supporting real-time decoding. The experimental results show that NVRC++ offers a much faster decoding speed (up to 7.6x) compared to the SOTA INR-based video codec, NVRC, while delivering comparable performance.

cs.LG [Back]

[80] Textual Belief States for World Models: Identifiable Representation Learning Under Strict Mediation cs.LG | cs.CLPDF

Xiang Gao, Kaiwen Dong, Yuguang Yao, Padmaja Jonnalagedda, Kamalika Das

TL;DR: 本文针对基于LLM的世界模型中因历史信息泄露导致潜在状态不可识别的问题，提出了严格中介原则下的文本潜在状态表示学习方法。通过引入离散、可解释的变长文本潜在状态和树状结构强化学习算法fGRPO，在TextWorld和ScienceWorld基准上实现了预测精度保持的同时，显著提升了表示质量和长程推演性能。

Details

Motivation: 解决部分可观测环境中世界模型因历史信息绕过导致潜在表示质量与预测性能脱节的问题，传统严格中介原则在文本领域因离散性和LLM解码器强表达能力而难以实施。

Result: 在TextWorld和ScienceWorld基准测试中，方法在保持一步预测精度的同时，表示质量提升最高达57%，推演性能提升最高达98%，且任务越复杂、时间跨度越长改善越显著。

Insight: 创新点在于将严格中介原则成功应用于文本领域，通过离散文本潜在状态和树状强化学习结构强制信息流经瓶颈，使表示质量可实证检验，解决了LLM架构中潜在状态不可识别性的根本问题。

Abstract: World models in partially observed environments rely on latent representations that summarize interaction history, but in many modern LLM-based architectures predictive performance fails to reflect representation quality due to history bypass, rendering the latent state unidentifiable. Strict latent state mediation, requiring predictions to depend only on the latent state and action, is a classical principle that resolves this, but enforcing it in text-based settings is an open challenge: textual latent states are discrete and non-differentiable, precluding variational training, and expressive LLM decoders readily ignore the bottleneck. We show how to make strict mediation work in the text domain. We formalize why it is necessary, showing that strict mediation makes representation quality empirically testable while history-leaky architectures break this connection. We then introduce textual latent states, which are discrete, interpretable, and variable-length, and factorized GRPO (fGRPO), a tree-structured reinforcement learning method that enforces strict mediation during training. Experiments on TextWorld and ScienceWorld show preserved one-step prediction accuracy alongside up to 57% gains in representation quality and 98% improvements in rollout performance, increasing with task complexity and horizon.

[81] NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning cs.LG | cs.CVPDF

Tianlin Pan, Lianyu Pang, Cheng Da, Huan Yang, Changqian Yu

TL;DR: 本文提出NormGuard方法，用于在基于流匹配的强化学习（RL）后训练中约束速度范数，以解决RL微调导致生成图像感知质量下降的问题。该方法通过添加一个仅在速度范数超过参考范数时激活的铰链惩罚项，在保持奖励对齐的同时改善图像质量和真实感。

Details

Motivation: RL后训练虽然能提升基于流生成器的奖励对齐，但会导致感知质量下降，这种退化未被奖励代理捕获。研究发现RL微调会使每步速度范数相对于参考值膨胀5%到15%，而推理时重新缩放速度范数无法改善奖励或修复质量退化，因为膨胀已适应到模型权重中。

Result: 在两个基础模型、三种后训练方法和两种奖励代理上，NormGuard一致地改善了由MLLM评判的图像质量和法医真实感，同时保持了奖励。在少步推理下增益更为明显，且不能由早停解释。

Insight: 创新点在于识别了RL后训练中速度范数膨胀的结构性特征，并提出了一种训练时干预的铰链惩罚策略，该惩罚仅在速度范数超标时激活，可与任何速度局部基础损失相加，从而在不牺牲奖励的情况下抑制范数膨胀并提升生成质量。

Abstract: Reinforcement learning (RL) post-training improves the reward alignment of flow-based generators, but often degrades perceptual quality in ways that are not captured by the reward proxy. We identify a simple structural signature of this drift: across three post-training methods (NFT, AWM, DPO), RL fine-tuning inflates the per-step velocity norm $|v_θ|$ by $5%$ to $15%$ relative to the reference. A form of norm inflation has been studied in classifier-free guidance (CFG), where rescaling the velocity back to a reference norm at inference time can mitigate the resulting artifacts. However, this inference-time correction does not transfer cleanly to RL: rescaling $v_θ$ to match $|v_{\text{ref}}|$ at inference time neither improves reward nor fixes the quality degradation, because the inflation is co-adapted into the model weights. Furthermore, an adjoint sensitivity analysis shows that velocity magnitude rescaling carries no coherent first-order reward signal at the batch level, indicating that suppressing norm inflation is unlikely to remove a consistently reward-carrying component. Since inference-time renormalization fails while norm suppression carries no reward cost, training-time intervention is the appropriate strategy. Together, these findings motivate \methodname, a hinge penalty that activates only when $|v_θ|$ exceeds $|v_{\text{ref}}|$ and composes additively with any velocity-local base loss. Across two base models, three post-training methods, and two reward proxies, \methodname consistently improves MLLM-judged image quality and forensic realism while preserving reward, with gains that amplify under few-step inference and are not explained by early stopping.

[82] LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior cs.LG | cs.AI | cs.CV | cs.ROPDF

Qinhong Zhou, Chuang Gan, Anoop Cherian

TL;DR: 本文提出了LLawCo框架，旨在解决具身智能体在去中心化、部分可观测环境中因行为不协调导致的合作效率低下问题。该框架通过分析历史失败案例提取行为模式，并提炼为高层行为法则（如“必要时交谈”、“等待伙伴”），再通过监督微调将这些法则融入智能体的思维链，以使其推理与环境状态及其他智能体行为对齐。

Details

Motivation: 现有基于大语言模型的具身智能体在合作任务中常出现行为与伙伴不协调或与环境状态不一致的问题，导致合作效率低和任务成功率差。

Result: 在提出的新基准PARTNR-Dialog以及现有基准TDW-MAT上，该方法在四种骨干大语言模型上均取得了显著提升，平均成功率分别比最先进的开源通信智能体框架提高了4.5%和6.8%。

Insight: 创新点在于从失败经验中自主提炼可解释的高层行为法则，并将其显式整合到智能体的推理过程中，以实现与伙伴和任务目标的对齐。这提供了一种通过结构化反思和法则归纳来提升多智能体协作协调性的新范式。

Abstract: Embodied agents operating in decentralized and partially observable environments have attracted growing attention in recent years. However, existing large language model (LLM)-based agents often exhibit behaviors that are misaligned with their partners or inconsistent with the environment state, leading to inefficient cooperation and poor task success. To address this challenge, we propose a novel framework, Learning Laws of Cooperation (LLawCo), that enables embodied agents to autonomously align with both their partners and task objectives. Our framework allows agents to reflect on past failures to extract misaligned behavioral patterns, which are used to derive high-level behavioral laws, such as “Talk when necessary” and “Wait for partner.” These laws are explicitly incorporated into the agents’ chains of thought via supervised fine-tuning, aligning their reasoning with task requirements and the behavior of other agents. To evaluate our approach, we introduce PARTNR-Dialog, a large-scale multi-agent communicative and cooperative planning benchmark built on the PARTNR environment. Experiments on existing tasks and our new benchmark demonstrate significant improvements in cooperative efficiency and task success rates. Across four backbone LLMs, our method achieves average success rate improvements of 4.5% on the PARTNR-Dialog benchmark and 6.8% on the TDW-MAT benchmark over state-of-the-art open-source communicative agent frameworks. See the LLawCo project page for details: https://www.merl.com/research/highlights/LLawCo

cs.AI [Back]

[83] DysLexLens: A Low-Resource LLM Framework for Analysing Dyslexic Learners Insights from Online Forums cs.AI | cs.CL | cs.HC | cs.IR | cs.LGPDF

Dana Rezazadegan, Atie Kia, Phongpadid Nandavong, Dominique Carlon, Jeremy Nguyen

TL;DR: 本文提出了DysLexLens，一个面向低资源论坛数据的LLM分析框架，用于分析阅读障碍学习者在在线论坛中分享的使用AI工具的经验。该框架通过字典驱动的语料库构建、知识图谱推理和可验证的查询响应生成，旨在从嘈杂的社交媒体数据中提取有意义的见解。

Details

Motivation: 阅读障碍学习者越来越多地使用AI工具，但他们在使用这些工具时的真实体验尚未得到充分研究。论文旨在通过分析在线论坛讨论，系统性地探究这一群体与AI的互动经验。

Result: 研究使用与阅读障碍相关的Reddit论坛数据和30个问题验证了DysLexLens的有效性，结果表明该框架有潜力推广到其他低资源论坛数据场景。

Insight: 创新点在于提出了一个端到端、证据可追溯的低资源LLM分析框架，结合了字典驱动的噪声过滤、LLM语义分析与知识图谱推理，并引入了RAGAS和查询鲁棒性等定量评估指标以及针对幻觉和证据对齐的结构化定性验证指南。

Abstract: Dyslexic learners increasingly use artificial intelligence (AI) tools to support reading, writing, organisation, and study-related tasks. However, their lived experiences with these tools remain largely underexamined. This paper proposes DysLexLens, a low-resource LLM framework, designed to analyse dyslexic learners experience with AI through online forum discussions. DysLexLens is designed as an end-to-end, evidence-traceable architecture which transforms noisy social media posts into a dictionary-driven corpora, provides knowledge-graph (KG)-based question reasoning, generates verifiable query responses, and enables response evaluation through quantitative and human-grounded assessment. DysLexLens has four key features. First, it employs a dictionary-driven filtering method to construct a more focused Reddit corpus on dyslexia and AI, filtering out noisy and weakly related posts to improve the relevance of data collected from low-resource forum contexts. Second, it integrates LLM-assisted semantic analysis with KG-based query reasoning to uncover meaningful patterns. Third, it has quantitative evaluation metrics (RAGAS and Query Robustness) to measure LLM-generated response performance. Fourth, it provides structured qualitative validation guidelines for assessing response quality, with a specific focus on hallucination and evidence alignment. We demonstrate the effectiveness of DysLexLens using dyslexia-related Reddit forum data and 30 questions. The results show its potential generalisability to other low-resource forum data contexts. DysLexLens, sample data, questions and evaluation results are available at Github to support reproducibility.

[84] Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing cs.AI | cs.CL | cs.CVPDF

Can Li, Ting Zhang, Junbo Zhao, Hua Huang

TL;DR: 本文提出SD-GPS框架，通过将符号求解器作为执行预言机，统一驱动自动形式化和定理提出过程，以解决几何问题求解中形式化与下游求解器脱节、以及固定规则库导致演绎僵局的两个核心瓶颈。

Details

Motivation: 当前神经符号几何问题求解框架在自动形式化（视为与求解器兼容性脱节的静态任务）和定理预测（因固定规则库常陷入演绎僵局）两个核心阶段存在严重瓶颈，需要更紧密地结合感知与符号执行。

Result: 在Geometry3K和PGPS9K基准测试中，SD-GPS在标准完成、多项选择和跨模态参考等任务上持续优于现有的MLLM、纯神经和神经符号方法。

Insight: 创新点在于提出求解器驱动的自动形式化（将可执行性作为核心训练信号）和经过验证的定理提出（通过符号验证过滤辅助引理），实现了多模态感知与符号执行的闭环，为神经智能体如何通过形式系统实现可验证的问题解决能力提供了深刻见解。

Abstract: Geometry Problem Solving have increasingly adopt the neuro-symbolic paradigm, combining neural intuition with symbolic rigor. However, current frameworks suffer from severe bottlenecks in two core stages: autoformalization, which treats multimodal translation as a static task decoupled from downstream solver compatibility, and theorem prediction, where solvers frequently hit a deductive impasse due to fixed rule libraries. To address these, we propose SD-GPS, a solver-driven framework that treats the symbolic solver as an execution oracle throughout both formalization and deduction. First, Solver-Driven Autoformalization unifies supervised formal-language adaptation and solvability-guided reinforcement learning into a single module built on QwenVL3-2B, making executability the central training signal. Second, Verified Theorem Proposing introduces an impasse-aware agent that proposes local auxiliary lemmas from current proof states, ensuring soundness by filtering all proposals through symbolic verification. Empirical evaluations on Geometry3K and PGPS9K demonstrate that SD-GPS consistently outperforms existing MLLM, neural, and neuro-symbolic methods across standard completion, multiple-choice, and cross-modal reference regimes, proving that closing the loop between multimodal perception and symbolic execution significantly improves geometric reasoning, offering profound insights into how neural agents can be grounded by formal systems to achieve verifiable problem-solving capabilities.

cs.DL [Back]

[85] CalBrief: A Pilot Diagnostic Benchmark for Evidence-Calibrated Scientific Briefing with Large Language Models cs.DL | cs.AI | cs.CLPDF

Yu Fu, Yongqi Kang, Yong Zhao

TL;DR: 本文提出了CalBrief基准，用于评估大语言模型在证据校准科学简报任务中的能力，即根据一组相关论文生成包含证据强度、范围边界和缺失证据说明的总结。研究发现结构化组织能提升角色和缺口推理，但显式的强度校准策略过于保守，低于多数基准和直接LLM基线。通过诊断分析，保守性主要源于标签空间扩展和管道策略本身。

Details

Motivation: 研究动机是探究大语言模型作为研究助手时，能否根据支持证据的强度和范围来校准研究结论，解决现有模型在证据校准科学简报任务中能力不明确的问题。

Result: 在公平模式评估下，结构化组织提升了角色和缺口推理，但显式强度校准策略系统性地过于保守，表现低于多数基准和直接LLM基线。诊断分析显示，约63%的保守性差距可归因于标签空间从二元扩展到四元，36%源于管道策略本身。四元预测后处理折叠回二元后，可匹配或超过直接二元提示。

Insight: 创新点包括提出CalBrief诊断框架和验证的试点基准，用于定位简报任务中的故障点。客观分析表明，标签级强度判断和可审计证据组织是当前存在张力的两种能力，应分开评估LLM研究助手；扩展标签空间虽增加保守性，但携带额外信息，后处理可优化性能。

Abstract: Large language models (LLMs) are increasingly used as research assistants, yet it remains unclear whether they can calibrate research takeaways to the strength and scope of the supporting evidence. We study evidence-calibrated scientific briefing: given a bounded package of related papers, a system should generate package-level takeaways with evidence strength, scope boundaries, and missing-evidence caveats. We contribute a verified pilot benchmark of 16 heterogeneous scientific evidence packages and 96 human-verified takeaways, and we use CalBrief, an auditable role/gap/strength framework, as a diagnostic probe to locate where briefing breaks down. Under a fair-schema evaluation, structured organization improves role and gap reasoning, but an explicit strength-calibration policy is systematically over-conservative and falls below majority and direct-LLM baselines. To explain why, we run a controlled diagnostic across three closed-model backbones (GPT-4o, Claude Sonnet, Gemini Flash) that separates three potential causes of conservatism. Approximately 63% of the conservatism gap is attributable to expanding the label space from binary {moderate, weak} to four-way {moderate, weak, uncertain, insufficient_evidence} (p < 0.001 across all backbones); only 1% is attributable to gap/scope signal injection (not significant); the remaining 36% arises from the pipeline policy itself. We also find that 4-way predictions can be post-hoc collapsed back to binary and then match or exceed direct binary prompting, so the extra labels carry information that strict matching hides. Label-level strength judgment and auditable evidence organization are distinct abilities currently in tension, and should be evaluated separately for LLM research assistants.

Table of Contents

cs.CL [Back]

[1] A Survey of Automated Presentation Coaching: Systems, Methods, and Open Challenges cs.CLPDF

[2] Formalizing Latent Thoughts: Four Axioms of Thought Representation in LLMs cs.CL | cs.LGPDF

[3] Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents cs.CL | cs.AI | cs.LGPDF

[4] Masked Language Flow Models cs.CL | cs.LGPDF

[5] Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety cs.CLPDF

[6] When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search cs.CLPDF

[7] Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment cs.CL | cs.AI | cs.CE | cs.LGPDF

[8] Position Bias Correction is Insufficient for One-Pass Attention Sorting cs.CL | cs.AIPDF

[9] Triadic Werewolf: A Jester Role for Multi-Hop Theory of Mind in LLMs cs.CL | cs.AI | cs.GT | cs.MAPDF

[10] From Black-Box to Clinical Insight: A Multi-Stage Explainable Framework for Speech-Based Cognitive Impairment Detection cs.CL | cs.AIPDF

[11] ToxiREX: A Dataset on Toxic REasoning in ConteXt cs.CLPDF

[12] Dialogue to Detection: A Multimodal Hybrid NLP Pipeline for Insurance Fraud Detection cs.CL | cs.AI | eess.ASPDF

[13] Cognitive Episodes in LLM Reasoning Traces Enable Interpretable Human Item Difficulty Prediction cs.CL | cs.AI | cs.CY | cs.LGPDF

[14] Vision-Default, Prior-Override: Causal Mechanisms of Perception-Knowledge Conflict in Vision-Language Models cs.CLPDF

cs.CV [Back]

[15] Not All Relations Rotate Alike: Transformation-Aware Decoupling for Viewpoint-Robust 3D Scene Graph Generation cs.CV | cs.AI | cs.GR | eess.IVPDF

[16] ReWorld: Learning Better Representations for World Action Models cs.CVPDF

[17] Aloe-Vision: Robust Vision-Language Models for Healthcare cs.CV | cs.CLPDF

[18] Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos cs.CVPDF

[19] DMV-Bench: Diagnosing Long-Horizon Multimodal Agents’ Visual Memory with Incidental Cue Injection cs.CV | cs.AI | cs.CLPDF

[20] TruEye: Fine-Grained Detection of AI-Generated Human Subjects in Images cs.CVPDF

[21] Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge cs.CV | cs.AI | cs.LGPDF

[22] MemoBench: Benchmarking World Modeling in Dynamically Changing Environments cs.CVPDF

[23] Perceptual 3D Simulation With Physical World Modeling cs.CVPDF

[24] Beyond Points: Spherical Distributional Part Prototypes for Interpretable Classification cs.CVPDF

[25] DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data cs.CVPDF

[26] Dismantling Pathological Shortcuts: A Causal Framework for Faithful LVLM Decoding cs.CV | cs.AIPDF

[27] AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers cs.CVPDF

[28] Qwen-Image-2.0-RL Technical Report cs.CV | cs.LGPDF

[29] CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations cs.CVPDF

[30] VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models cs.CV | physics.opticsPDF

[31] MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving cs.CVPDF

[32] Explainable AI for Biodiversity Monitoring and Ecological Image Analysis cs.CV | cs.AI | q-bio.QMPDF

[33] Multi-Modal Conditioned High-Resolution Transformer for Urban Electromagnetic Field Map Prediction Download PDF cs.CVPDF

[34] Joint Transcription and Decryption of Images of Encrypted Handwritten Documents: A Comparison with the Traditional Pipeline cs.CV | cs.CL | cs.LGPDF

[35] ZooClaw-FashionSigLIP2: Distilled Fine-tuning for Robust Fashion Retrieval cs.CVPDF

[36] MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation cs.CVPDF

[37] Scene and Human in One World: Reconstruction in a Feedforward Pass cs.CVPDF

[38] SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models cs.CVPDF

[39] Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling cs.CVPDF

[40] MindFlow: Harmonizing Cognitive Semantics and Acoustic Dynamics for Facial Animation Generation in Dyadic Conversations cs.CVPDF

[41] ModaFlow: Modality-Aware Flow Matching for High-Fidelity Virtual Try-On cs.CVPDF

[42] TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning cs.CVPDF

[43] Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation cs.CVPDF

[44] Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning cs.CVPDF

[45] Hippocampus-DETR: An Explicit Memory Object Detection Framework Based on Hippocampus Modeling cs.CV | cs.AIPDF

[46] A Unified Framework for Vision Transformers Equivariant to Discrete Subgroups of $\mathrm{O}(2)$ cs.CV | cs.LGPDF

[47] A Multi-Attribute Latent Space for Visual Analysis of Watches cs.CV | cs.HCPDF

[48] There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion cs.CVPDF

[49] SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion cs.CV | cs.AIPDF

[50] Every Step of the Way: Video-based Parkinsonian Turning Step Counting cs.CV | cs.AIPDF

[51] Reflect-R1: Evidence-Driven Reflection for Self-Correction in Long Video Understanding cs.CV | cs.AIPDF

[52] Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design cs.CV | cs.AIPDF

[53] Understanding How MLLMs Describe Artworks Using Token Activation Maps cs.CVPDF

[54] Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control cs.CVPDF

[55] ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering cs.CV | cs.AIPDF

[56] Latent Visual Diffusion Reasoning with Monte Carlo Tree Search cs.CVPDF

[57] TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL cs.CVPDF

[58] HumanMoveVQA: Can Video MLLMs reason about human movement in videos? cs.CVPDF

[59] EMOSH: Expressive Motion and Shape Disentanglement for Human Animation cs.CVPDF

[60] ReScene: Structured Indoor Scene Reconstruction from Multi-View Captures cs.CVPDF

[61] RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement cs.CVPDF

[62] AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration cs.CVPDF

[63] STAG: Spatio-temporal Evolving Structural Representation of Action Units for Micro-expression Recognition cs.CV | cs.AI | cs.GR | cs.HC | cs.MMPDF

[64] OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal cs.CV | cs.AIPDF

[65] Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training cs.CV | cs.LGPDF

[66] PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulation cs.CV | cs.AI | cs.ROPDF

[67] BiDeMem: Bidirectional Degradation Memory for Explainable Image Restoration cs.CV | cs.AIPDF

[68] Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading cs.CVPDF

[69] Toward Robust In-Context Segmentation via Concept Guidance cs.CV | cs.AIPDF

[70] EchoSonar-R: A Multi-View Reasoning-Enabled Model for Disease Classification and Report Generation in Echocardiography cs.CV | cs.LGPDF

[71] HAT-4D: Lifting Monocular Video for 4D Multi-Object Interactions via Human-Agent Collaboration cs.CV | cs.AI | cs.GRPDF

[72] Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching cs.CV | cs.AIPDF

[73] PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception cs.CVPDF

[74] RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning cs.CVPDF

[75] Learning Topology-Aware Representations via Test-Time Adaptation for Anomaly Segmentation cs.CV | cs.AIPDF

cs.RO [Back]

[76] DIM-WAM: World-Action Modeling with Diverse Historical Event Memory cs.RO | cs.CVPDF