Table of Contents

cs.CL [Back]

[1] Graph-Based Inference for Feedback-Driven Word Deduction: A Scalable Framework for the Jotto Problem cs.CLPDF

Dakshi Arora, Prakhar Kumar Srivastava, Ranjib Banerjee

TL;DR: 将Jotto猜词建模为加权词图上的迭代约束传播，支持不同词长和重复字母的可解释推断。

Details

Motivation: 既有方法多限于固定长度且无重复字母的词，无法统一处理更真实的猜词规则。

Result: 约3,000场模拟中发现预期迭代次数随词长增加而减少，统计检验和回归支持其对数关系；摘要未提供具体迭代量。

Insight: 有效词作节点、共享字母数作边权，每次反馈删除不兼容假设；图剪枝为反馈驱动的可解释推理提供通用框架。

Abstract: A feedback-based word deduction framework based on the Jotto problem is proposed, and the problem space is represented as a weighted graph where all valid words correspond to nodes, and the edge weight is defined by the number of common letters between the two words. Finally, the gameplay is defined as an iterative constraint propagation mechanism where feedback is used to iteratively narrow the incompatible space of the graph, facilitating the reduction of the hypothesis space in a structured and interpretable manner. In contrast to existing approaches, where the problem space is typically defined for fixed-length isograms, the proposed framework generalizes to variable-length words (between 3 and 8 letters) and naturally extends to repeated letter cases, facilitating the treatment of realistic Jotto problem instances within a unified framework for the first time. The proposed framework’s applicability and solver dynamics are also discussed through an interactive implementation and a qualitative case study, respectively. Significant automated tests on approximately 3,000 simulated gameplay scenarios identify a novel convergence behavior: the expected number of iterations diminishes with increasing word length. A strong relationship is confirmed using statistical tests to verify a logarithmic relationship, which is also verified using regression modeling and goodness-of-fit tests. In addition to the initial problem statement, this formulation introduces graph pruning as a viable paradigm for feedback-driven inference with interpretability and its association with symbolic reasoning and interactive intelligent systems.

[2] Matryoshka attribution: Learning to attribute language model outputs to representations and weights cs.CL | cs.LGPDF

Aryaman Arora, Kirill Acharya, Nathan Hu, Yanzhe Zhang, Noah Goodman

TL;DR: MAttr把语言模型归因转为学习嵌套内部组件子集的任务，并按不同稀疏度同时训练组件重要性排序。

Details

Motivation: 因果干预、梯度或可学习掩码方法可能代价过高，也未必找到真正对行为有因果作用的计算组件。

Result: 在机制可解释性基准官方排行榜排名第一，并能识别稀疏且可跨任务迁移的回路；把拒绝评分作为训练信号时，恢复Llama 3.1 8B Instruct仅1%的权重即可消除拒绝行为，同时保留能力。

Insight: 可微sigmoid top-k掩码通过训练时随机化k，在多种稀疏度共同优化下学习嵌套子集及其归因顺序；该方法也可用RL识别微调引起的关键权重变化。

Abstract: Attributing language model outputs to their internal computations is an open problem in interpretability. Existing methods, which use causal interventions, gradients, or learnable masks, either are infeasibly expensive or struggle to identify actual causally-important internal computations. We propose framing attribution as the problem of identifying nested subsets of internal components which minimise a downstream loss. To learn this task, we introduce Matryoshka Attribution (MAttr), a mask learning method that parametrises the mask with a simple differentiable sigmoid top-$k$ operator. We supervise training over all sparsities simultaneously by randomising $k$ over training, resulting in a learned ordering of components by attribution score. MAttr achieves number 1 on the official leaderboard of the Mechanistic Interpretability Benchmark (Mueller et al., 2025); our method identifies sparse and task-transferrable circuits across varying circuit bases. As a practical application, we show that MAttr can be trained with reinforcement learning to identify weight changes responsible for downstream behaviours in LLM finetuning. We train MAttr on refusal judge scores and find that restoring $1%$ of Llama 3.1 8B Instruct’s weights to their base model state is sufficient to remove refusals while maintaining capabilities. We view MAttr as a successful formulation of interpretability into a learnable objective that we can tackle with gradient descent, and encourage future work along these lines.

[3] Qwen3.8-Omni: Towards Native Omni-Modal Agents cs.CL | cs.CV | cs.MMPDF

Qwen Team

TL;DR: 介绍Qwen3.8-Omni-Flash原生全模态智能体及配套工具，支持长上下文音视频推理与多轮生产任务。

Details

Motivation: 既有全模态模型侧重感知和交互，复杂长程智能体任务以及现有工具框架的原生音视频支持仍不足。

Result: 摘要报告模型在多模态理解、推理、长程智能体执行和视频生产任务上表现强；支持百万token上下文，并发布音视频插件和实时交互运行框架。

Insight: 原生多模态协同训练在保留文本能力的同时迁移音视频智能体能力，继承稀疏MoE架构；实时交互被作为系统编排问题处理，涉及上下文、记忆、工具和子智能体协作。

Abstract: We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3.8-Omni-Flash substantially improves multimodal understanding and reasoning, as well as performance on long-horizon agentic tasks. These capabilities are supported by a native multimodal co-training strategy that preserves strong text-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks. The model inherits the sparse mixture-of-experts (MoE) architecture of Qwen3.8-Next and extends the context window to one million tokens, supporting long-context multimodal reasoning and long-horizon planning. These advances enable integration into production workflows as a primary agent or a specialized sub-agent, supporting video editing, long-form audio and video translation, music-conditioned music video or movie generation, and video-based note or omni-skill creation. To address the lack of native audio and video support in existing agent harnesses, we release Qwen-MM-Plugins, a lightweight open-source plugin framework for multimodal productivity. We further frame real-time multimodal interaction as a system-level challenge requiring orchestration of context and memory management, tool use, and sub-agent delegation. Accordingly, we release Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash. Extensive evaluations demonstrate that Qwen3.8-Omni-Flash achieves strong performance across multimodal understanding, reasoning, long-horizon agentic execution, and video productivity tasks. These results and the accompanying open-source tools support Qwen3.8-Omni-Flash as a practical foundation for deploying natively multimodal agents in research and production.

cs.CY [Back]

[4] From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Health cs.CY | cs.AI | cs.CLPDF

He Hu, Yucheng Zhou, Qianning Wang, Yingjian Zou, Chiyuan Ma

TL;DR: 综述将心理健康领域大语言模型的发展概括为评估工具、即时共情对话者和纵向个性化陪伴三阶段。

Details

Motivation: 心理健康支持需求增长，但服务受资源、费用、污名和隐私等因素限制；相关LLM研究快速增加且分散，缺少连贯的发展脉络。

Result: 综述按三阶段梳理技术、Profile/Memory/Reasoning/Planning智能体架构及数据集与基准，为负责任、有效和以人为本的研究提出发展路线。

Insight: 研究重点正从被动评估与无状态对话转向可持续记忆用户信息的状态化认知智能体；基础设施和评测也需随这一转型演进。

Abstract: The rising global prevalence of mental health conditions, together with longstanding barriers in traditional healthcare, such as limited resources, high cost, stigma, and privacy concerns, has created an urgent need for accessible and scalable support. Large Language Models (LLMs) have emerged as a transformative technology with strong potential to democratize mental health support through advanced natural language understanding and generation. However, the rapidly expanding, fragmented body of work in this area lacks a coherent evolutionary narrative, making it difficult to contextualize current progress and identify future directions. This survey addresses this gap by organizing and analyzing the literature around a central thesis: the role of LLMs in mental health is evolving through three distinct, increasingly sophisticated phases. We trace this trajectory from Phase I, in which LLMs act primarily as passive Information Tools and Pattern Recognizers for assessment; through Phase II, where they function as Empathetic Conversationalists for in-the-moment, stateless interactions; to the current frontier, Phase III, which seeks Longitudinal, Personalized Companions implemented as stateful cognitive agents. To support this framework, we systematically review core technologies, agent architectures (Profile, Memory, Reasoning, and Planning), and the critical infrastructure of datasets and benchmarks, highlighting how their evolution underpins this developmental path. Viewing the field through this developmental lens, we provide a comprehensive synthesis of existing work, an insightful narrative of its trajectory, and a clear roadmap for future innovation in responsible, effective, and human-centered AI for mental healthcare. A curated collection of the resources reviewed in this survey is available at our project repository: https://github.com/Emo-gml/Awesome-Mental-Health-LLMs.