Table of Contents

cs.CV [Back]

[1] RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation cs.CVPDF

Shaohua Dong, Zexuan Meng, Haiyan Sun, Bing Fan, Cuicui Zhang

TL;DR: RGBD20K提供2万对RGB-D图像和160种细粒度语义类别，并提出分数净化融合分割方法。

Details

Motivation: 已有RGB-D语义分割基准类别少、数据有限，历史标注噪声也可能损害模型泛化。

Result: 数据集重新复核并修正标签；SPF在所有被评估基准上达到先进性能，显示高质量多模态信息融合的有效性。

Insight: 相较NYUv2的40类和SUN RGB-D的37类，RGBD20K扩展到160类且规模达20,000对，为训练更通用的RGB-D分割模型提供资源。

Abstract: In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D semantic segmentation by encompassing abundant categories and high-quality annotations. RGBD20K possesses several attractive properties: (1) Expanded Semantic Space. In particular, it covers 160 fine-grained categories, largely surpassing the category diversity of existing popular RGB-D benchmarks (e.g., NYUv2 with 40 classes and SUN RGB-D with 37 classes). With such enriched semantic coverage, we expect to promote the learning of more generalizable segmentation models. (2) Larger Scale. Compared with current benchmarks, RGBD20K offers 20,000 RGB-D image pairs, providing a substantially larger training resource that benefits the development of more powerful deep models. (3) High-Fidelity Annotation. We perform rigorous re-evaluation and correction of existing labels to resolve long-standing annotation noise, resulting in a clean and reliable ground-truth foundation. Furthermore, we propose a novel score-purified fusion (SPF) method, which achieves state-of-the-art performance across all evaluated benchmarks, demonstrating the effectiveness of our approach in leveraging high-quality multimodal information for RGB-D semantic segmentation. The dataset is here: https://github.com/ShaohuaDong2021/RGBD20K/.

cs.CL [Back]

[2] SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data cs.CL | cs.CV | cs.MMPDF

Wenhao Li, Zhibin Wu, Chong Xiao, Qiangchang Wang

TL;DR: SemMSA利用潜在情感语义和无锚点谱对齐，在模态不完整时改善多模态情感分析。

Details

Motivation: 常见缺失模态方法重建特征或用复杂融合，但在部分观察下缺少高层语义依据，容易带来虚假生成和噪声指导。

Result: 在SIMS、MOSI和MOSEI基准上达到先进性能；摘要未报告具体量化结果。

Insight: 跨模态细化模块在冻结LLM空间中逐步产生判别性潜在语义而不生成显式文本；谱对齐以核矩阵主导成分连接各模态，并用实例级约束保留样本区分度。

Abstract: Recent research on Multimodal Sentiment Analysis (MSA) has focused on learning from language, visual, and acoustic modalities with incomplete data to infer human sentiment. Most studies typically compensate for missing information by reconstructing modality features or designing complicated fusion mechanisms. However, these methods still suffer from spurious generation and noisy guidance due to the lack of high-level semantic grounding in partially observed multimodal evidence. To address these issues, we propose SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment. It mainly consists of Cross-modal Semantic Refinement (CSR) and Cross-modal Spectral Alignment (CSA). Specifically, CSR first adaptively extracts visual and acoustic representations by corresponding adapters to form a unified multimodal prefix with language in the frozen LLM embedding space. It then iteratively produces continuous discriminative semantic states through a token-efficient latent refinement process without decoding explicit text. Next, CSA simultaneously aligns the refined semantics with all modalities by enhancing the dominant spectral component of their kernel Gram matrix. This captures global nonlinear dependencies among all representations without relying on a predefined anchor modality. In addition, an instance-level spectral separation constraint preserves cross-sample discriminability and mitigates representation collapse. Extensive experiments on SIMS, MOSI, and MOSEI benchmarks demonstrate that SemMSA achieves state-of-the-art performance.

[3] Agentic Detection of Online Conspiracies cs.CL | cs.LGPDF

Lior Biton, Oren Tsur

TL;DR: 用工具增强的智能体结合社交语境识别阴谋论言论的真实意图，而非仅根据关键词分类。

Details

Motivation: 相同阴谋论相关内容可能表达支持、合理质疑、批评或讽刺；判断关键在于话语意图及社会背景。

Result: 在覆盖四年大部分公开希伯来语推文的数据上，人工标注对抗评测显示情境感知方法优于纯文本分类，智能体也优于获取同等语境的非智能体方案。

Insight: 让智能体针对每个案例自适应调用社交查询，只补充当前推理步骤所需证据；结果支持将检测视为嵌入社会语境的解释任务。

Abstract: Conspiratorial discourse on social media is not always expressed through explicit claims or stable lexical markers. The same surface content may express endorsement, legitimate concerns, criticism, satire, or mockery. The main challenge is therefore not only recognizing conspiracy-related claims, but inferring the speaker’s intent – the utterance’s illocutionary force. We argue that this can be achieved through the use of relevant social contexts and propose an agentic framework, equipped with a set of tools supporting social queries. We demonstrate the benefits of our approach on a unique dataset of Hebrew tweets, covering 80%–90% of the public Hebrew tweets published over a four-year span (late 2018– early 2023), encompassing several election cycles as well as the COVID pandemic years and related vaccination campaigns. This extensive coverage can be used in recovering different social contexts. Evaluating our framework on a manually-annotated adversarial dataset, we find that context-aware workflows consistently outperform text-only classification and that the agentic framework performs significantly better than other frameworks and settings, including a non-agentic model exposed to the same contexts available to the agent. We further provide an analysis of the results, the errors and efficiency (token economy) tradeoffs. These findings support viewing the task of conspiracy detection as a socially embedded interpretation task, in which effective classification depends not only on access to contexts, but also on adaptive reasoning in which the agent uses tools on a per-case basis, asking only for evidence relevant to its current reasoning step.

cs.AI [Back]

[4] Clinical Knowledge Graphs for Chest X-Ray Device Reasoning cs.AI | cs.CVPDF

Harshil Lodhiya

TL;DR: 构建不确定性感知的胸片临床知识图，将设备实例、尖端位置估计、放置判断和报告事件组织为可追溯证据。

Details

Motivation: 现有图像模型常只输出标签或分割，报告处理系统又无法访问图像几何，两者难形成完整设备评估依据。

Result: 在30,083项检查的RANZCR CLiP测试归档上构建91万余证据节点和88万余关系；较直接基线保留尖端协方差、放置概率、片段来源及数量等信息。

Insight: 图层提供类型化数据契约、不确定性表达、拒答、报告—图像关联及纵向查询接口；当前结果是事后描述性材料，尚未证明报告依据、纵向表现或临床效用。

Abstract: Chest radiographs are routinely used to verify the position of catheters, tubes, and other support devices. Existing image models often return labels or segmentations, while report-processing systems structure text without access to image geometry. We present an uncertainty-aware clinical knowledge graph that represents device instances, tip estimates, placement assessments, provenance, report events, and temporal links as separate but connected evidence. We evaluate the implemented visual graph layer using saved predictions from the complete RANZCR CLiP test archive, comprising 30,083 studies from 3,255 patients across five non-overlapping outer folds. The graph builder materializes 914,632 B7 evidence nodes and 884,549 typed relationships. All 118,647 B7 predicted-device nodes retain tip covariance, placement probabilities, fragment provenance, and fragment counts, whereas the direct B2 baseline retains none of these fields. We further define typed data contracts, uncertainty representations, abstention rules, report-image grounding, and longitudinal query mechanisms for extending the graph to report-bearing cohorts. The reported graph-materialization analysis is post-hoc descriptive and does not establish report grounding, longitudinal performance, or clinical utility. It demonstrates a reproducible foundation for evidence-preserving AI reasoning over chest X-ray device assessments.