信息流

Persistent Web information assistants must combine evolving document facts with user requirements established and revised across sessions. Yet systematic evaluation of how changes in both sources affect response requirements and evidence attribution remains limited. To address this gap, we introduce Dual-Source Evolution Benchmark (DuSE-Bench), a benchmark comprising 1,000 tasks across five scenarios, including 700 whose required premises originate in both dialogue and documents. An evolving Support Graph guides task construction and preserves links from updated facts and reused conclusions to original turns and passages. Task annotations distinguish grounding source from state dependence and enable separate evaluation of response content, response type, and source attribution. Experiments across 11 baseline configurations reveal persistent challenges in joint reasoning over evolving dialogue and documents, with content accuracy on jointly grounded tasks reaching at most 56.7%. Moreover, improvements in content accuracy can coincide with poorer response choice, while content-correct responses frequently lack complete attribution to original evidence. Matched evidence substitutions further show that the effect of replacing one source's evidence depends on support from the other. These findings motivate coordinating dialogue memory and document retrieval to apply current user requirements and document facts together while preserving their original support. The data are available at https://github.com/JianfengGao7/DuSE-Bench.

Visual-prefill energy conclusions for edge vision-language models (VLMs) are commonly drawn under single-shot workloads; we revisit them under continuous perception. Profiling nine VLMs across three architecture families on Jetson AGX Thor and Orin (4,508 records, calibrated with a pure-text task), we find two mutually independent energy laws: the per-output-token decode cost grows monotonically with model scale, whereas the visual-prefill (image-encoding) cost is dominated by visual-encoder architectural efficiency, not scale. Under continuous perception ($N{=}10$) with sparse output, visual-prefill energy reaches 92--97\% of total. We derive optimization strategies---visual frame reuse, adaptive output truncation, task-aware routing, and encoder throughput optimization---for edge VLM deployment.

Embedding models underpin virtually every modern AI system, from search engines to recommendation systems. Despite shared mathematical foundations, research on embedding models remains fragmented by modality: the communities develop largely in isolation, seldom exchanging insights. We argue that this fragmentation obscures a deeper convergence. Driven by contrastive learning, Transformer architectures, and a granularity shift, embedding research across modalities is converging toward a common set of principles, even as modality-specific challenges remain underexplored. To reason across this convergence without conflating it, we propose a framework of three progressively harder capabilities: coverage, comparability, and compositionality. Three paths toward unification satisfy these in turn: transformation broadens coverage, alignment enables comparability, and joint embedding, the terminus we advocate, aims at compositionality. This position paper traces the resulting evolution, providing the first unified, cross-cutting treatment of omnimodal embedding research.

稀疏注意力通过让注意力矩阵稀疏来降低长上下文推理成本：每个 query 只关注序列的一个子集，该子集由固定模式选择，或在近期生产级 LLM 中按 query 学习得到。在 DeepSeek 稀疏注意力（DSA）——DeepSeek-V3.2 与 GLM-5 系列所采用的注意力机制——中，每一层之前都有一个 lightning indexer，它对整个缓存打分，并为该层保留得分最高的 k=2048 个 token 进行注意力计算。在长上下文下，解码时间主要花在这个 indexer 扫描上，而不是它所服务的稀疏注意力上。但相邻层选择的 token 几乎相同，因此一层可以沿用前一个 indexer 层的选择，而不是自己重新选择。这消除了依赖关系：每个 indexer 随后与其所在层的注意力并发执行。由此得到的多层索引器（MLI）无需重新训练，也不需要新权重。其默认实现不改变任何 kernel，运行在 SGLang 的生产解码图中；可选的融合解码 kernel 在 DeepSeek-V3.2 上可进一步加速。MLI 可与 IndexCache（GLM-5.2 以 IndexShare 形式提供的跨层复用）组合：IndexCache 从部分层中去掉 indexer，而 MLI 隐藏其余层上的扫描开销。我们在 IndexCache 的协议下服务 DeepSeek-V3.2 和 GLM-5，保留率为 1/2 到 1/32（保留 indexer 的层所占比例），上下文长度为 10K 到 195K。在相同保留率下，该组合的解码速度快于 IndexCache：在 1/2 保留率下，DeepSeek-V3.2 上最高快 14.5%，GLM-5 上快 9.8%，在 1/32 下快 7.9%，并且……

As AI systems are increasingly deployed in high-stakes domains such as healthcare, effectively integrating human expertise with AI outputs is critical for reliable decision-making. A substantial body of theoretical work studies optimal mechanisms for human-AI collaboration (HAC), focusing on when to involve humans and how to combine their expertise with AI predictions. However, these approaches largely overlook a key factor highlighted by empirical evidence: human judgments are impressionable and can vary depending on how AI outputs are presented. For example, when AI systems defer decisions to humans, revealing or withholding the AI prediction can significantly influence human judgments. Moreover, existing work neglects deployment-time variability, where conditions, particularly the cost of eliciting human input, may differ substantially from those observed during training. To address these challenges, we introduce a rigorous and theoretically grounded framework for human-AI collaboration, termed collaborative omnimechanism design, based on a novel and computationally efficient contextual bandit variant of boosting for outcome indistinguishability. In particular, we reduce a calibration-type outcome indistinguishability condition to weighted calibration, providing a novel time-efficiency result, bypassing the high-dimension curse induced by complicated collaboration methods and outcome space. Our framework provides a principled characterization of human impressionability and introduces a unified optimization scheme that enables robust and adaptable decision-making across diverse query costs and evaluation objectives without retraining. We evaluate the framework in three HAC settings, examining adaptation to query costs and prediction objectives without retraining, and show that its induced policies perform comparably to or better than the evaluated baselines.

Automated detection of machine-generated text is applied where the verdict carries a cost for the author, yet origin is a property of the production process, not an observable property of the text. The conditions under which a text is produced push it in the same direction in which a generative model is presumed to push it. This study measures the contribution of these conditions while origin is held fixed. The Russian-language corpus of 1882 documents comprises a machine part, generated by four generation channels (each backed by its own model family) across 45 tasks in three task modes, and an archival human part annotated for source regimentation level before the texts were read. The primary contrast is computed within the machine corpus: both halves of a pair are generated by the same model for the same task and differ only in task wording. Machine-likeness is measured by four operationalisations: an interpretable index with weights fixed before data collection, a trained classifier, a zero-shot metric on an open model, a judge model. The main result is disagreement between procedures: changing the task mode shifted the scores of all four, but three gave a negative shift, the judge a positive one, and none of the four intervals covers zero. The comparison plan and the specifications of procedures 2-4 were fixed after the result of procedure 1, before procedures 2-4 ran; the disagreement survived correction of a corpus defect and of the nested validation. A baseline on the source identifier alone reaches a median AUROC of 1.0000 on the thirteen group splits where it is defined, and removing emphasis markers flipped a confident machine verdict to human without changing the full text by a single character. The scores are properties of a specific measurement system and corpus: they reflect data collection, repetition, formatting, and preprocessing decisions as well as linguistic style.

生产型智能体的记忆正日益成为瓶颈，并且几乎完全由文本构建：从超出限制的上下文中提取关键点，并在查询时检索回上下文。因此，每个新查询都会带来额外成本，且该成本随累积历史增长。权重记忆是一种互补的替代方案，它将知识内化到模型参数中，并在完全无需上下文的情况下作答；最近已被证明在自进化智能体中有效，用于内化技能和行为。然而，其在情景记忆和语义记忆（例如用户特定事实）中的应用仍相对未被探索，并且在召回性能方面，早期权重记忆尝试与基于文本的系统之间仍存在差距。我们研究如何通过应用同策略自蒸馏（OPSD）使权重记忆作为长期事实存储具有竞争力。它从教师模型训练一个无上下文的学生模型，教师模型是同一模型以用户记忆为条件；同时结合一个“先验证再重新生成”的路由器，使权重记忆和文本记忆各自覆盖其最擅长处理的查询。在 HaluMem 基准上，OPSD 达到或超过了强文本记忆基线（包括全上下文提示和检索系统），同时每个查询读取的 token 更少。我们进一步开展了广泛研究，刻画权重记忆的行为，并分析不同训练配方如何影响其性能。随着智能体 harness 迈向持久化、多会话……

Legislative hearings are distinct communication events with their own human recognizable structure and logic, yet they have been analyzed as distinct phenomena beyond their transcripts. Understanding legislative hearings at a deeper level is a major step in analyzing the work and power relationships within democratic bodies. In this work, we present a novel end-to-end pipeline for parsing rhetorical structures from legislative committee hearings with the goal of improving legislative discourse analysis and democratic accountability. We also propose a rhetorical structure grammar and find that 55.21% of California state bill discussions in our dataset can be parsed with this grammar. We evaluate our pipeline with two utterance section classifiers on a random subset of over 2,000 annotated utterances corresponding to 100 hearings. We find that a logistic regression-based classifier with grammar-based output masking and utterance tag smoothing outperforms more complex models, achieving an F1 score of 52.8% against our ground truth discourse section labels.

Tell an LLM negotiator to be "headstrong" and it should hold firm on price, but does that instruction retain the same behavior in every language? To test this, we use identical buyer and seller instances of Gemini 3.6 Flash to negotiate the same 12 CraigslistBargain scenarios in English and Korean. The pilot-scale 2 x 2 x 3 design crosses interaction language, seller urgency (none or strong), and buyer persona (cooperative, neutral, or headstrong), yielding 432 attempted negotiations. We call this property cross-lingual social-policy fidelity: whether a prompt-defined social policy produces the same behavioral effect regardless of interaction language. It often does not. Korean negotiations reached agreement far more often than English (77.3% vs. 52.5%, a 24.8-point gap, Holm-adjusted p = .0039), but only for neutral and headstrong buyers; cooperative buyers were already near-ceiling in both languages. Buyers' opening offers barely differed by language; the gap instead emerged later, through larger seller concessions and a smaller final gap in Korean, and agreed prices were also lower in Korean. Repeating the full design with Qwen3.7 Flash as both agents gives directional support: agreement was again higher in Korean (+13.9 points vs. Gemini's +24.8, with an interval whose lower bound is near zero), and sellers again conceded more. Pragmatic analysis reveals why: while both languages frequently featured face-threatening acts like rejections and counter-offers, Korean dialogue softened these threats with substantially more politeness mitigation, especially among sellers (11.7% vs. 3.6%). These results show that such a policy can produce different simulated negotiation behavior, not just different wording, when only the interaction language changes.

Vision Transformer（ViT）受限于其输入token序列的长度。标准图像块化通过在整个图像上应用单一图像块尺寸来固定该长度，而不考虑区域内容。此前关于自适应图像块尺寸的工作通过为视觉上简单的区域分配更粗的图像块来减少token数量，但依赖局部熵等带噪声的像素级启发式方法来做出分块决策。我们认为，这种计算分配应基于模型对任务相关信息的解读，而不是原始像素统计。我们提出Split Policy Learned Image Tokenization，它学习根据模型认为有意义的内容来分配token分辨率，从而生成更短且与任务相关内容更匹配的token序列。SPLIT在使用少30% token的情况下，达到了全分辨率ViT分类基线的准确率。同样的收益也适用于密集预测：SPLIT在COCO和ADE20K上取得有竞争力的准确率，表明语义对齐的分块方法能很好地泛化到分类之外。

Neural controlled differential equations（Neural CDEs）沿通过插值离散观测构造的连续路径演化隐藏状态。稀疏测量使观测时刻之间的输入无法确定，而符合同一数据的可容许连续路径可能产生不同的终端状态。我们针对速度有界的平面驱动项刻画这种歧义。相容终端状态集合允许一个首阶 zonotopic 近似，该近似由可行有符号面积和传输后的 Lie brackets 决定。其到标量预测上的投影产生一个可计算、针对特定目标的歧义证书。我们还研究减少剩余不确定性所需的测量次数。对于非退化平面 CDEs，在速度有界时，确定性自适应采样策略下的最优最坏半径按 $N^{-1}$ 缩放；当速度和加速度均有界时按 $N^{-2}$ 缩放，其中 $N$ 是观测区间数。合成实验使用可容许连续补全评估该证书，并考察路径正则性的作用。

An online retailer launching a perishable product bids for sponsored-search clicks, discounts a bundle with an always-stocked staple and displays its remaining stock, which raises willingness to pay. It knows neither how clicks respond to its bid nor how strong and dispersed its market is, and learns both over repeated seasons from data its own decisions censor: a zero bid reveals nothing about paid clicks, and choices follow only clicks. We design a posterior-sampling agent for it. Each period it draws a market from an exact posterior and posts the bid and discount of that market's exactly solved season plan, so every action is one a fully informed seller could take. In a simulated online florist it has the lowest regret averaged over markets. In weak markets it gives up 12% to 23% of one season's revenue over 500 seasons, four to seven times less than drawing once per season. A planner acting on point estimates can stop bidding and never learn that bidding pays. The agent escapes after about three seasons on average, against fifty with one draw per season. Where displayed scarcity keeps willingness to pay above the posted price, the discount needs no learning. Customers waiting for the discount to return to its recent level look like lost sales, so frequent waiting makes the agent underrate its market. One discount per season removes waiting at a cost of 5.9% of clairvoyant revenue in a weak market and none in a strong one.

LLM-as-a-judge scores are often distributionally shifted from human ratings on any given evaluation task, and post-hoc calibration (mapping LLM to human scores in a small labeled anchor set) has become a popular method to correct for this shift. In this paper we derive the calibration from two positions: that LLMaJ scores are ordinal ratings drawn from a distribution rather than isolated points. We present streaming quantile matching (SQM), a version of a classical method not previously bench marked for LLMaJ calibration, which is built on the two positions by computing the optimal-transport map between the LLM and human score distributions. We develop an evaluation framework and within it we show that unlike point-wise calibrations, SQM respects the ordinality of the human anchor set and achieves the best distributional fidelity and the top overall rank across models and data. We also show that in general, post-hoc calibration narrows the raw error gap between smaller and larger judge models, which opens the possibility of more efficient LLM judges.

在图像中定位文本查询需要一个对每个词与每个图块进行打分的矩阵。视觉-语言模型用对齐的文本编码器来计算它，而许多图像编码器（例如仅在切片上训练的病理学相关模型）缺少这种编码器。Caption-Anchored Patch-Term Occurrence Representation（CAPTOR）在没有文本编码器的情况下估计该矩阵。它将冻结图像编码器的图块 token 聚类为视觉词，并用每张带描述图像在各词中的图块占比来描述该图像。一个词项的签名是：在描述提到该词项的图像与其余图像之间，这些占比的标准化差值。该矩阵可分解为一个词项×视觉词表和一个与查询无关的图像因子，因此图像只需编码一次，而新增一个词项只需增加一行表。与所有免训练基线相比，CAPTOR 在 Common Objects in Context（COCO）、Pascal Visual Object Classes（VOC）和 Cityscapes 上领先。在 COCO 上，按一个物体拥有的单元评分，它达到 0.565 平均交并比（mIoU），而对比为 0.502。在这三个数据集上，它也与在同一骨干上训练的文本对齐方法持平，而后者需要梯度、文本编码器和数倍的描述。在留出的乳腺癌切片上，它比用病理学文本编码器对图块打分的最强基线高出 0.160 mIoU。通过 CAPTOR 来解读，UNI（一个仅在切片上训练的编码器）在常见网格上比此类基线高出 0.132。因此，计数可以为任何训练于……的图像编码器提供文本接口

评估开放式 agent 任务越来越多地落到 Agent-as-a-Judge 身上：给评估者配备工具和 agent 的完整轨迹，使其能对照环境验证结果。其前提是，自行收集证据的评委应当被这些证据所 grounding。我们表明，这种 grounding 并不能使评委免受确认偏误的影响：一条虚假的预筛选备注——它被归因于权威、且对正确裁决没有任何证据价值——在四名评委和五个数据集上，能推翻工具使用型评委多达 40% 的正确裁决，即便该评委收集到了决定性证据。这种转变由该线索的特定属性驱动。我们把这个线索视为对确认偏误的受控诊断，而非对抗性攻击。我们的核心贡献是解释确认偏误如何改变评委在轨迹中的行为。我们对评委行为的变化进行分类，并将其归因于三种失败模式之一：过度信任（先验证、正确得出结论，然后服从）、幻觉（为翻转裁决捏造支持），以及调查不足（在第一个佐证信号处停止）。对于两个 Claude 评委，失败主要是过度信任（占有害翻转的 67-75%），而较小的评委的错误模式则分布在三种模式中。轻量级缓解措施会削弱但从未消除这种偏误。

高效地服务 LLM 取决于引擎、模型如何在 GPU 间拆分、精度、调度器设置、投机解码、KV-cache 管理以及 prefill-decode 分离。最佳配置取决于模型、硬件、工作负载和目标。运维人员通常通过试错来找到它。穷举测量我们研究中的候选配置大约需要 25,000 GPU-hours。ROCm InferaSim 通过少量短时测量来预测服务性能。批大小、提示长度和 GPU 数量等选择会改变每个 GPU 的工作量，但不改变内核。ROCm InferaSim 对每组不同的内核最多在一个节点上基准测试一次。我们将这种测量称为锚点。解析规律将该锚点推广到运行相同内核的其他部署。对于多节点部署，ROCm InferaSim 将配置简化为单节点等价配置，对其进行测量，并以解析方式扩展结果。模拟器重放多轮流量，调优代理使用预测结果搜索配置。在搭载 vLLM、SGLang 和 ATOM 的 AMD Instinct MI355X GPU 上，11 个锚点耗时 9.1 GPU-hours，而测量它们覆盖的 226 个固定长度配置需要 204 GPU-hours。在 172 个配置上，每个输出 token 的时间中位误差为 8.1%。在多轮编码工作负载上，吞吐量误差在 8% 以内。对于 159 个分离式部署（均未用作锚点），吞吐量误差在 5.5% 以内。一个包含五个候选的短名单中包含一个部署，其差距在 12% 以内

大型语言模型（LLMs）正越来越多地被用于支持科学文献综述，但评估往往考察单个任务，而非整个综述流程。我们在四个阶段评估了六种 AI 工具：查找相关文章、解读文章、跨文章综合以及提出未来研究方向。该基准是一篇已发表的关于 Spanish plume 天气模式的综述及其 102 篇文章语料库。在初步检索中，五种工具共识别出 57 篇文章，其中表现最好的单一工具找到 42 篇。机构图书馆访问权限使 Codex 的发现量从 42 篇增加到 82 篇，使 Claude Code 从 15 篇增加到 79 篇。在获得完整的 102 篇 PDF 语料库后，三种工具正确识别出所有 18 篇实质性讨论 Spanish plume 的文章，但将 84 篇顺带提及中的 40% 至 79% 错误归类为实质性讨论。同样这三种工具生成的综合报告由两位领域专家进行了盲评。尽管大体准确，这些综合报告提供的洞见有限，有时还包含无依据的说法、引用错误以及夸大共识的表述。最后，三种工具提出的研究方向都超出了 Spanish plume 文献的范围，不过其中两种工具接近基准综述中提出的问题。没有单一工具在所有任务中表现最佳。我们为在文献综述中使用 AI 工具的研究人员提供了八项建议。我们的研究结果表明，LLMs 可以协助发现和解读……

Low-rank adaptation (LoRA) enables parameter-efficient fine-tuning but can suffer from redundant basis directions. Constraining the basis factor to the Stiefel manifold addresses this redundancy through orthonormality. Landing methods allow temporarily infeasible iterates to explore a neighborhood of the manifold while progressively restoring orthogonality without per-step retractions. To improve optimization efficiency while retaining this flexibility, we introduce ProLand (Product-space Landing), a retraction-free optimizer that combines coordinated factor updates with Muon-style spectral directions. By designing the updates in the space of the represented weight increment, ProLand separates objective optimization from orthogonality restoration, supporting efficient feasibility recovery. This coordinated construction also enables Muon-style directions to guide objective optimization while preserving that separation. Experiments cover four GLUE validation tasks on DeBERTa-v3-base and seven language benchmarks on Qwen2.5-3B, Llama-3.2-3B, and Moonlight-16B-A3B across multiple adapter ranks. Across these 11 tasks, ProLand achieves the highest average score among the compared methods in every tested encoder and decoder model-rank configuration.

在 OCOsense 等基于眼动肌图（optomyographic, OMG）的智能眼镜上进行面部表情识别（FER），可实现隐私保护、无摄像头的情感感知，服务于健康与福祉。大多数 FER 系统都是全监督的，即要么依赖手工设计的专家特征结合经典机器学习，要么依赖基于标注数据训练的端到端深度模型。两者都依赖大量标注表情，而标注收集成本高昂，限制了在真实世界个性化场景中的部署。我们研究将自监督学习（SSL）作为在这类眼镜上实现标签高效 FER 的途径。我们在未标注的 OCOsense 记录上以掩码自编码器目标预训练 Vision Transformer，并在与受试者无关的交叉验证下针对五类 FER 进行微调。在 5% 到 100% 的标签预算范围内，预训练始终提升性能；仅使用 5% 的标签时，预训练模型就优于使用全部标签从头训练的模型。结果表明，SSL 预训练是降低智能眼镜 FER 标注成本的实用方法，我们还讨论了对未来个性化和持续适应的影响。

神经网络能否在没有光栅化器的渲染器中自行学习渲染 3D Gaussian splats？我们提出 GaussianRenderFormer，这是一个 transformer，接收一组 Gaussians 和相机，直接输出图像。每个 Gaussian 在视图无关的编码器中变成一个 token，而视图相关的解码器通过关注这些 token，将相机射线的小块区域转换为像素。在 26,820 个 Objaverse 对象（每个裁剪至 20,000 个 Gaussians）上训练后，GaussianRenderFormer 针对完整、未裁剪的 splats 渲染 300 个未见对象，达到 38.08 dB PSNR，而对相同裁剪输入进行光栅化则达到 44.02 dB。这一差距并非泛化问题，我们的诊断结果与视图解码器存在瓶颈一致：告知其每个 Gaussian 的投影足迹（它原则上可以推断出来），可增加 1.4 dB。不能排除训练不足。代码、训练模型和视频：https://svlwoof.github.io/gaussianrenderformer

Analytical theories of learning in deep networks often assume gradient flow, discarding the finite step size and batch noise of stochastic gradient descent (SGD). Starting from the discrete update, we derive continuous-time equations for the mean and covariance of the parameter distribution under a Gaussian closure for a general stochastic learning, to first order in the learning rate $\eta$. Applying these stochastic learning flow (SLF) equations to SGD, we show that the mean descends an effective loss regularized by the covariance and loss curvature, while the covariance, unlike in stochastic differential equation approximations, becomes unstable at curvature $2/\eta$. In SGD ensembles of linear and nonlinear networks, SLF predicts learning curves and mean trajectories more accurately than gradient flow and captures the covariance dynamics, failing where the parameter distribution becomes strongly non-Gaussian. In the full-batch limit, the edge of stability corresponds to a stationary point of the coupled sharpness-covariance dynamics, recovering self-stabilization and central flow, and batch-to-batch curvature fluctuations lower this threshold under SGD.

视觉自回归生成涵盖两种主流范式：面向图像和视频的下一尺度预测（next-scale prediction），以及面向视频的下一帧预测（next-frame prediction）。二者均以块为单位而非逐 token 进行解码，因此其 KV cache 的统计特性与语言模型存在差异。在大规模场景下，KV 内存占用会超过模型权重，并且由于视觉 token 数量庞大，会限制大规模部署。我们对这些 cache 的分析得出三点发现。第一，少量大幅值通道承担了主要功能负载：消融这些离群通道会导致生成崩溃，而消融一组匹配的非离群通道则不会影响质量。第二，离群值沿特征和块两个轴组织，其幅值在每个单元内保持稳定，并在单元之间发生偏移。第三，这种结构源于两种独立机制：投影偏置（projection bias）和 RoPE 引起的散射。基于这些发现，我们提出 VAR-Q，一个沿相同两个轴进行分组的无调优 KV-cache 量化框架。生成循环天然提供块边界，无需离群值检测或校准。结合用于运行时内存降低的 bit-packing kernel，VAR-Q 在覆盖两种范式的九个模型上实现了低比特量化，将 KV 内存最多降低 78.5%，质量下降可忽略不计，并支持 6 倍更大的推理批次。

Generalisability is a central question for deep neural networks, including the cross-language generalisation of speaker embeddings. This study examined whether deep neural speaker embeddings generalise across languages and how such generalisation relates to human perception and acoustic structure. Using Cantonese--English bilingual speech presented in within- and cross-language conditions, we derived similarity from 18 state-of-the-art models and compared it with human ratings and acoustic features using linear mixed models and representational similarity analysis. Embeddings exhibited cross-language generalisation that broadly paralleled human behaviour, reflecting accurate identity discrimination and sensitivity to language switching. This generalisation relied on largely shared acoustic cues with language-sensitive weighting, mirroring human patterns. Together, these findings provide converging evidence for human--machine alignment in cross-language voice similarity processing.

大型语言模型（LLMs）大规模阅读公司新闻，回测表明其解读能预测股票收益。我们探究这种可预测性在排除前视、记忆和选择偏差的测试后还能保留多少。我们提出 OLIVIA，一种用于此类测试的协议：时点输入并遮蔽公司身份，仅在验证数据上做选择，分析计划以密码学哈希冻结，测试期通过有记录的锁定仅解盲一次。我们将其应用于 AI 决策模型——一类针对类型化问题返回概率的非生成式语言模型——阅读有关 S&P 500 股票的新闻：一个我们在 2024-2025 数据上微调的开放权重模型、三个商业模型和标准基线。微调模型的信号在两个验证季度上得到复现（日信息系数 0.055 和 0.065），但在 2026 年 1-7 月的盲测中降至 0.020（t = 1.7）。商业模型的解读与隔夜至开盘的变动一致（信息系数 0.074 至 0.077），但与开盘后的变动不一致，因此当交易者能在开盘时采取行动时，新闻已被定价。没有模型能区分过度反应与反应不足，也没有任何预注册策略能经受成本和 deflated Sharpe ratio 的检验。商业模型在 62% 至 74% 的情况下识别出被遮蔽的公司，而基线为 28%：遮蔽隐藏的是名称，而不是公司。市场先读到新闻。

Understanding what kind of prompts users typically ask and how well an LLM performs on these prompt categories is crucial for LLM practitioners. The existing methods satisfy the demand by hierarchically clustering the user prompts and synthesizing the cluster names using an LLM to build a taxonomy. However, the cluster names from these methods are usually too general for humans to understand the detailed prompt distributions and identify the exact strengths and weaknesses of LLMs. In this study, we propose COMPREHEND, which automatically constructs an ultra-fine-grained entailment hierarchy for the prompts. The entailment hierarchy replaces the cluster names in the taxonomy with sentences to provide more precise cluster descriptions for more fine-grained categorization. Compared with EvalTree, a state-of-the-art taxonomy construction method, COMPREHEND improves an entailment/faithfulness metric from 22.6 to 41.7 and an informative metric from 16.3 to 39.1 in WildBench. Our experiments also show that the weakness report generated based on our entailment hierarchy is much more informative than EvalTree in terms of predicting the response scores in the benchmark. All the code is released in https://github.com/JackNapier20/COMPREHEND_public.

For decades, artificial neural networks have operated under the assumption that durable, learned capability resides exclusively in adaptive synaptic parameters, primarily due to the established neurobiology of synaptic connectivity. This design forces models to remain stateless during deployment, incurring well-known limitations such as catastrophic forgetting and expensive retraining. However, recent neurobiological research by Glanzman and colleagues, and others, shows that memories can be transferred between individual organisms in a synaptically independent manner. Inspired by this research, we sought to demonstrate memory transfer of persistent memory between AI model instances, leveraging a neurocentric version of memory. In this paper, we propose NURESA (Neural Unit with Retentive Self-Adaptive Architecture), a novel neural layer that eschews sole reliance on synaptic weight updating by introducing persistent intra-unit memory as a first-class, computational primitive. By structurally separating computation from persistent memory, NURESA enables autonomous memory accumulation and consolidation into transferable stores of memory registers. Experiments across MLP, GPT-2, and modern frontier models like Qwen2.5 demonstrate qualitatively new capability: zero-shot transfer of learned capability into a naive model instance without retraining or access to the original training data; this transfer is enabled by a sparse set of parameters in NURESA's memory register that the model selects on its own based on which neurons were most active. The memory transfer capability of NURESA also protects against domain loss when transformer models undergo learning via fine-tuning. Finally, the memory transfer process completes in approximately one minute even for transformer models with millions to billions of parameters, producing a transfer file orders of magnitude smaller than the original model.

自然梯度下降，以及由此发展而来的预条件优化器，通过估计曲率并将曲率的逆作用于梯度来校正梯度下降。对于深度神经网络的任何单层，可以证明这种校正近似分解为两个因子：一个因子考虑梯度信号中的相关性，另一个因子考虑到达该层的数据中的相关性。在此我们表明，第二个因子可以表示为基变换而非曲率变换；如此考虑后，它可以完全从优化器中移除，并放入网络本身。具体而言，我们表明，一旦前向权重得到校正，右侧自然梯度下降可以以一种具有三个完全等价形式的方案实现：梯度预条件器、前向传播中的去相关线性变换，或一组循环动力学，其中所有更新都是 Hebbian 的，且仅依赖于局部可用信号。我们发现的（循环）去相关方法与大脑中抑制性学习和稳态可塑性的已有提议方法高度一致。值得注意的是，我们的变换不需要矩阵求逆、不需要矩阵分解，也不需要单个突触之外可用的信息。因此，它可以应用于分布式和受物理约束的系统，包括神经形态硬件和神经系统，而现有预条件器无法做到。我们展示了其

Generative AI is currently fragmented, with separate subscriptions required for text generation, image synthesis, and code assistance, leading to high costs and workflow disruptions. AI Express is a SaaS platform that consolidates these capabilities into a unified pay-as-you-go service. The platform provides a range of AI tools, including a Core Code Reviewer that evaluates GitHub repositories, a Text-to-Website generator that converts text into fully functional websites, script generation, grammar checking, data analysis, and watermark removal, all accessible through a single interface without requiring technical expertise.

Memory capacity and bandwidth are major bottlenecks in LLM inference, motivating weight compression beyond conventional 4-bit quantization. Vector quantization (VQ) enables approximately 2-bit weight storage but often relies on codebooks incompatible with native FP4 computation. We introduce MXCode (MX-Native Codebook Quantization), a framework bridging ultra-low-bit VQ compression with MicroXcaling (MX)-native FP4 computation. MXCode proposes three strategies: PostScale, which quantizes learned codebooks to MXFP4; PreScale, which extracts MX scales before codebook learning; and PreScale+, which further compresses these scales using VQ. These strategies explore tradeoffs among quantization quality, scale overhead, and codebook granularity. All reconstruct MX-native W4A4 operands without materializing intermediate high-precision weights. We evaluate MXCode on Qwen3 (235B), DeepSeek-R1 (671B), and GLM-5.2 (753B) using the Microsoft MX Emulation Library. MXCode achieves approximately 2 bits per weight with competitive, workload-dependent model quality. On GB300 hardware, experiments with Qwen3 (235B) show approximately 50% lower model-load memory than Native FP4 while maintaining near-Native-FP4 serving throughput. Under memory-constrained prefix reuse, P90 TTFT improves by up to 94.5%. These results demonstrate software-based reconstruction on existing FP4 hardware and inform the development of future MX-native inference systems.

Performativity arises when prediction-informed decisions change the data-generating process, creating feedback between deployment and learning. This phenomenon occurs in policy-making and in self-evolving AI systems that shape their own future training data. Statistical inference is challenging because estimation errors in earlier predictors affect subsequent data distributions and propagate into later updates. We develop an end-to-end framework for statistical inference under performativity. For repeated risk minimization and repeated gradient descent, we establish central limit theorems at fixed deployment rounds and derive covariance recursions that capture both current-round sampling variation and uncertainty inherited from earlier deployments. We develop consistent covariance estimators using policy perturbations and score matching. These results can yield asymptotically valid confidence regions for population iterates and the performative stable point. We further extend prediction-powered inference to this dynamic setting, combining labeled observations with predictions on additional unlabeled data to improve statistical efficiency. We evaluate our framework in synthetic, semi-synthetic educational, and self-evolving large language model routing settings. Our experiments demonstrate that ignoring propagated uncertainty can lead to substantial undercoverage even after repeated retraining. Together, these results provide statistical tools for learning systems that help determine the distributions from which they learn. Our work establish a complete statistical inference under performativity, introducing new challenges and inference settings that we believe will provide substantial value to policy-making, statistics, and machine learning.

Efficiency and reliability in the timely identification of phytopathogens would help minimize crop loss in agricultural sectors but existing deep learning based methods, although accurate, would require a large annotated dataset and are black-boxed in their operation, thus, restricting flexibility and transparency. The current paper presents a hybrid detection framework that is able to overcome these drawbacks through the unified real-time vision with a semantic knowledge base. Web Ontology Language (OWL) was used to develop a comprehensive ontology of the disease of fruits that formally codifies phytopathological knowledge, such as symptom phenotype, spectral phenotype (HSV), and morphological phenotype. Such knowledge-guided configuration guides the image processing pipeline, making it possible to diagnose using this knowledge under expert specified rules without a large training dataset. The ontology underwent a computationally verified test of its structural soundness and commonsensical practical usefulness and scored an overall of 7.4/10. On the public set of MangoFruitDDS, the diagnostic performance was an F1 Score of 85.00%, precision of 85.00%, and a recall of 85.23%. These findings are very competitive and similar to other known deep learning models like the VGG16 that prove that the knowledge-driven approach provides an accurate, transparent, and scalable solution on automated fruit disease diagnosis.

Urban flood resilience emerges from complex interactions among natural, built, and socio-economic systems, yet most recovery policies implicitly assume that resilience mechanisms are spatially uniform. To address this gap, this study develops a spatially explainable machine learning framework that integrates geographically weighted random forests with a novel Local Spatial TreeSHAP algorithm, enabling nonlinear resilience mechanisms to be identified and interpreted at the community scale. The framework is applied to 779 communities affected by the July 2023 extreme rainstorm in Beijing. Results reveal that resilience mechanisms exhibit substantially stronger spatial heterogeneity than the underlying physical and socio-economic conditions themselves, with SHAP-value spatial autocorrelation decreasing by 66.2% on average relative to predictor variables. Three distinct resilience regimes emerge across the urbanization gradient. Highly urbanized communities benefit from synergistic interactions among commercial infrastructure and accommodation services; transitional medium urbanized communities are constrained by infrastructure-development mismatches that create facility gaps despite continued urban expansion; and low urbanized communities are dominated by ecological and topographic thresholds, where adverse interactions between transportation and river-network structures undermine recovery capacity. Field investigations and interviews with 12 stakeholders corroborate these patterns. By linking geographically weighted machine learning with locally grounded attribution analysis, the proposed framework provides a new pathway for uncovering spatially varying resilience mechanisms and translating them into place-based recovery strategies under increasing climate extremes.

大型语言模型（LLM）能够记忆并复现其训练数据的片段，这引发了隐私和法律方面的担忧，也推动了机器遗忘（machine unlearning）研究。然而，被投毒的（poisoned）训练样本在遗忘之后仍可能在统计上被检测出来，这引出一个问题：当前的遗忘目标究竟是否移除了模型所记忆的内容。在本工作中，我们提出了 PINT，一种新的机器遗忘算法，它利用希尔伯特-施密特独立性准则（HSIC）来降低待遗忘的 token 与用于预测这些 token 的内部表示之间的统计依赖性。我们通过一个可计算的上界，将基于 HSIC 的目标与精确记忆（Exact Memorization）形式化地联系起来，从而把训练目标直接关联到模型复现被遗忘 token 的能力。在大量实验中，我们在八种设置下比较了遗忘与效用之间的权衡，模型规模最高达 7B 参数，并展示了可扩展到 70B 参数模型的能力。我们的评估涵盖高斯投毒、个人信息、生物学与网络安全领域的危险知识，以及受版权保护的书籍和新闻文章。PINT 平均取得了最强的遗忘与效用权衡，并且是唯一一种能使高斯投毒不可检测、同时保持接近原始模型效用的方法。代码见：https://github.com/shkabrii/PINT

现代学习系统越来越多地将预训练模型与下游头相结合。尽管此类模块化设计日益重要，下游模型如何协同适应预训练表示的几何结构仍相对缺乏探索。我们通过视觉-语言-动作模型（VLA）研究该问题，其中预训练的视觉-语言模型（VLM）为用于控制的动作模型提供条件。我们发现，动作模型会逐步将其敏感性集中在 VLM 输出的高方差维度上。通过跨不同骨干-头模型的受控实验，我们进一步表明，在表示与任务不匹配的设置下，抵消这种敏感性集中可能是有益的。受这些观察启发，我们提出 Adaptive Interface Equalizer（AdaIE），一种无参数机制，可在训练过程中根据不断演变的下游敏感性对预训练表示重新加权。AdaIE 提升了 VLA 在仿真基准上的成功率：在 RoboCasa-GR1 上最高提升 +5.28 个百分点（pp），在 RoboTwin 2.0 上提升 +1.68 pp，并在五个真实世界操作任务上平均提升 +19 pp。它还可推广到扩散策略和世界模型，在两种设置下均提升下游性能。我们的结果强调，在将预训练表示与下游模型耦合时，接口协同适应是一个重要的优化问题。

Large language models (LLMs) are increasingly used to generate stories, but these stories struggle to reproduce engaging readerly dynamics, the evolving reader responses that shape narrative experience. To address this challenge, we propose a framework that learns readerly dynamics from high-quality human-written stories and uses them to guide story generation. Instead of directly modeling high-dimensional story content, we train a small LLM to predict future reader responses as low-dimensional trajectories. We then leverage the strong instruction-following capability of a larger, off-the-shelf writer LLM to generate story segments that follow these predicted trajectories within a given story setting. Our framework improves trajectory-based fidelity to human-written stories by 12%-35% while largely preserving story coherence.

Deep learning models for brain tumor diagnosis need to do more than achieve high classification accuracy. For practical use, they should also provide understandable predictions, recognize unsuitable inputs, and work within a usable clinical system. This paper presents a framework for classifying brain MRI into four categories: glioma, meningioma, pituitary tumor, and no tumor. The model uses InceptionResNetV2 with a Convolutional Block Attention Module (CBAM), while Grad-CAM provides visual explanations of its predictions. A two-stage out-of-distribution (OOD) mechanism screens unsuitable inputs using an initial grayscale check followed by Mahalanobis distance, softmax confidence, and predictive entropy. These components are brought together in NeuroScan AI, a real-time web application. Evaluated on a Mendeley brain tumor MRI dataset of 12,064 images, the framework achieved 98.70% validation accuracy, 96.73% test accuracy, and a macro-average AUC of 0.9965. The OOD pipeline achieved 99% detection accuracy on a preliminary 100-image benchmark. Grad-CAM visualizations showed qualitative correspondence with clinically established tumor locations across all four classes. Overall, the work brings classification, explainability, input validation, and deployment into one framework, while recognizing that broader clinical and OOD validation is still required.

Large language model (LLM) assistants increasingly advise backers on which crowdfunding campaigns to support. LLMs have known race and gender problems, and it is unsettled whether they reproduce, erase, or reverse the discrimination documented in entrepreneurial finance. We ask when, and through which decision process, LLM assistants use founders' gender and ethnicity. In a pre-specified choice-based conjoint experiment, seven LLMs chose among five synthetic campaigns with independently randomized quality signals and founder names, under three backer personas and a persona-free control (40,248 responses). By default, founder names barely matter: under budget-conscious and delivery-focused personas, gender and Black-name effects are statistically equivalent to zero. When the backer wants to support underrepresented creators, the models favor Black-signaled (+8.1 percentage points; positive in all seven models) and female-signaled (+5.1) founders. They do so most strongly among near-tied campaigns and for the founder who alone carries the signal, and they almost never name gender or ethnicity in their reasons. The results fit an agency account of algorithmic discrimination: an aligned assistant takes its demographic preferences from its user rather than from its training data.

我们评估了智能体式（agentic）AI 模型在多大程度上能够完成端到端的数据科学项目，以及这种能力如何随反馈而提升。一个配备特定工具的"writer"模型会创建一个完整的数据科学项目，包括下载、清洗和分析数据集，并就此撰写一篇简短论文。项目会被执行，并由一个"grader"模型进行评估。随后 writer 可以修改其提交内容，如此重复，共进行三轮。我们考察了来自五家开发者的七个模型：Anthropic、OpenAI、Google、DeepSeek 和 Z.AI。每个模型既充当 writer 也充当 grader，因此共有 49 个 writer-grader 组合，我们对每个组合运行三次。在 147 份初始提交中，有 107 份能够运行并渲染，平均得分在最后一轮反馈后从 59% 提升到 76%。按 writer 划分，提升幅度从 Anthropic 的 Opus 5.5 的 3 个百分点到 Anthropic 的 Haiku 4.5 的 46 个百分点不等；按 grader 划分，则从 Google 的 Gemini 3.8 Flash 的 13 个百分点到 Anthropic 的 Haiku 4.5 的 32 个百分点不等。当模型给自己的作品评分时，得分往往比其他模型给它的平均分高出约 9 个百分点。我们观察到的轮次间差异中，约有一半落在 grader 自身的噪声范围内。反馈通常能带来最高分数，但即便只是有机会进行修改，或者仅仅拥有额外的时间或工具调用预算，而没有任何反馈

大型语言模型（LLMs）既可作为辅助人类日常决策的工具，也可在实验模拟研究中作为人类主体的模型。因此，在典型社会决策——例如是否在集体行动中合作——上的对齐，对研究人员和整个社会都具有直接的实际影响。本文系统探讨了“规范效用”（norm utility）——即效用中非物质的组成部分，用于解释个体遵从社会规范以及保持内在一致性的愿望——对三个开放权重 LLMs 在一次性双人社会困境中战略决策的影响。我们发现，当社会困境与社区信念信息一同呈现、但没有说明这些信念应如何发挥作用时，模型往往将社区信念视为战略信息，因此在 Snowdrift game 中，随着社区合作信念上升，合作反而下降。当我们明确提示规范效用的各组成部分时，这一关系发生反转：合作随社区信念上升而增加，这与一个简单规范效用模型的预测大体一致。随后我们表明，提示规范效用会降低战略决策对底层社会情境变化的波动性，并在不同模型之间生成更一致的推理习惯。总体而言，我们的结果表明，提示规范效用有助于生成更像人类且更……

背景：从树皮照片自动识别树种对林业资源调查和木材加工行业具有实际意义，但决定深度学习方法准确性的设计选择尚未被系统研究，且部分既有结果可能因同一树干图像在训练集与测试集之间泄漏而被高估。方法：在公开的 BarkNet 1.0 数据集（20 个树种）上，采用已确立的树级、防泄漏划分方案，开展系统性消融研究。使用 ConvNeXt-V2 骨干网络，依次改变以下因素并通过五折交叉验证进行评估：图像块大小、将各图像块预测聚合为图像级决策的策略、训练方式（单阶段与两阶段）、骨干网络容量、整图基线，以及推理时可用的图像块数量。结果：单块准确率随图像块尺寸单调上升（从 160 px 的 75.6% 升至 512 px 的 89.6%），图像级准确率也随之提升，在 512 px 附近趋于平台，约为 94.9%。学习式聚合最多比多数投票高出 0.7 个百分点，且随着图像块增大、注意力趋于均匀，这一优势会缩小。骨干网络容量（pico 至 tiny）对准确率的影响不到一个百分点，两阶段训练相较单阶段没有优势。整图分类（91.9%）落后于基于图像块的聚合，因为它没有可供平均的“包”；准确率随

工具描述告诉智能体某个操作能做什么，但未必能揭示该操作在使用当下是否健康或合适。执行框架通常通过监控器、追踪和近期故障掌握这些信息，而选择下一步动作的模型却并不掌握。我们将这一缺口称为操作盲区。我们提出 Agent Harness Awareness，一种信任分离设计：由主机在关键动作前提供一个小型、新鲜、经过验证的状态快照，同时保留测量、执行、评估和最终分派权限。我们使用 ToolRoute 测试其工具与网络实例，这是一个受控隔离基准，保持任务和候选语义不变，并改变模型可用的操作信息。在一项覆盖 GPT-5.6 Sol、Claude Sonnet 5 和 Gemini 3.7 Flash 的 216 次决策消融实验中，经过验证的工具健康状态将平均可观测策略遗憾较同形态中性对照降低 96.9%（从 4,252 ms 降至 131 ms），并将单次分派完成率从 69.4% 提升至 95.8%。在另一项包含实时本地 TCP/HTTP 执行、OpenTelemetry 客户端 span 和 Toxiproxy 注入故障的 27 次决策端到端复现中，经过验证的状态将平均遗憾从 8,956 ms 降至 0 ms（零额外可观测运营成本），并在 9/9 个模型×故障案例中完成实时动作，而中性对照为 5/9。这些研究确立了 Agent Harness Awareness 的工具与网络实例：选定的 hos

许多因果推断问题需要从干预结果分布中采样，而不是估计低维摘要。现有方法通常依赖于对目标分布拟合生成模型，并附加额外的 nuisance 组件，这在高维结果下可能计算开销很大。我们提出 Interventional Maximum Mean Discrepancy Flow（IMMD-Flow），这是一种基于粒子的方法，转而通过其核均值嵌入来表示目标干预分布。该核嵌入具有一个双重稳健、Neyman 正交的估计器，并具备有限样本保证，且可被高效复用于通过 MMD 梯度流从干预分布中采样。IMMD-Flow 同时支持硬干预和软干预，具备估计与粒子近似的理论保证，并通过冻结编码器扩展到高维图像结果。在基于图像的基准测试中，IMMD-Flow 达到或优于最先进的生成方法，同时展现出显著的速度优势。

超参数优化（HPO）只返回单一最优配置，系统性地丢弃了所探索的性能景观——而这一景观编码了结果如何依赖配置选择。适应度景观分析源自进化计算，包含一组稳健的方法，可提供崎岖度指数、自相关函数和适应度—距离相关性，但由于此前不存在细粒度真值枚举数据，这些方法从未被大规模应用于机器学习超参数空间。我们提出 ExaTune，一个开源 HPC 系统，用于产出一种新的工件类别：超参数景观地图。ExaTune 通过 $K$ 折交叉验证穷举评估离散化超参数网格上的每一个点，将结果聚合为可复现的 parquet 基准数据，并应用一套包含五个形式化景观指标的方法：空间自相关（Moran's $I$）、崎岖度、局部最优密度、适应度—距离相关性（FDC）以及基于方差参数重要性。我们发布了一个基准集合，包含 8 张完整景观地图（共 285,080 个被穷举评估的配置），覆盖五个模型家族（SVM、随机森林、XGBoost、岭回归和 $k$ 近邻），横跨六个分类基准和两个回归基准，托管于 HuggingFace。实证分析表明，在标准试验预算下，贝叶斯优化、Optuna、Hyperband 和随机搜索会系统性地遗漏不稳定区域、secondar

Bubeck 和 Sellke 的鲁棒性普适定律指出，当 $\mathbb{R}^d$ 上的协变量分布满足等周性质时，用具有 $p$ 个实参数的函数类在噪声水平以下拟合 $n$ 个带噪样本，会迫使 Lipschitz 常数达到 $\sqrt{nd/p}$ 的量级：光滑插值需要付出 $d$ 倍的过参数化代价。其假设为高斯型集中、齐次协变量分布、标量输出和独立样本；我们逐一放宽这些假设。指数集中已足够，速率和绝对常数不变，代价是容量预热（capacity burn-in），我们证明某种形式的预热是必要的；由此得到归一化对数凹协变量的定律，相比当前的 KLS 界有 $\log d$ 的损失。对于异质混合，在混合组成的典型性条件下，最坏分量常数被替换为各分量常数的加权平均。对于向量值预测器，Frobenius Lipschitz 尺度下的界不依赖于输出维度 $K$，而 Euclidean 界仅损失 $K^{-1/2}$，这一损失可被与协变量无关的噪声消除。平稳马尔可夫协变量保持 i.i.d. 速率，伪谱隙仅进入样本量条件。一个主定理承载了共同的论证，且全文常数均为显式。

Depth pruning removes entire transformer blocks and therefore depends on a reliable criterion for identifying which blocks can be removed. Block Influence (BI) ranks blocks by how minimally they rotate the hidden state. However, local redundancy does not necessarily imply downstream irrelevance. We address this limitation using the Jacobian Lens (J-Lens) neural artifact, a map transporting perturbations at a layer to the final residual stream. At a common sparsity level, pruning scores applying J-Lens transportation to $BI$, what we call $J-BI$, were found to improve post-pruning accuracy by up to 19 points over $BI$ while reducing damage to perplexity for Qwen3-8B, Llama-3.1-8B-IT, and Gemma-3-12B-IT. We also perform a single-block ablation study and use J-Lens probing to explain why the proposed scores improved performance.

Two Boolean functions are considered NPN equivalent if one can be transformed into the other by negating inputs, permuting inputs, or negating the output. Efficient NPN classification is valuable in fields such as logic synthesis, quantum computing, and information theory. However, exact NPN classification demands exhaustive enumeration of all possible input permutations and negations. Its complexity grows exponentially, making it impractical for larger functions with more inputs. In this paper, we introduce the first learning-based formulation for NPN classification by recasting it as NPN action prediction. Our method represents Boolean functions as AND-Inverter Graphs (AIGs) and applies a bidirectional heterogeneous graph neural network to predict input negations, output negation, and input permutations. To mitigate the non-canonicity of logic networks, we further introduce graph rewriting techniques that reduce structural ambiguity and recover useful symmetries before prediction. Experimental results show that NPN action prediction is learnable, that the resulting canonicalization quality improves over heuristic baselines, and that on practical benchmarks our method approaches exact methods on tractable cases while scaling to functions with up to 16 inputs.

Computational brain imaging is constrained by a mismatch between increasingly diverse tasks and scarce, heterogeneous clinical data. Although existing brain foundation models transfer pretrained representations, their knowledge remains entangled within model-specific features and fixed architectures. This paper proposes BrainGFM, a generative foundation model that extends knowledge transfer beyond representation reuse through a reusable and reconfigurable brain-imaging prior. By pretraining on a corpus of about 1.3 million MRI and CT slices, BrainGFM supported task-aligned data synthesis for low-data predictive learning and task-adapted post-training for image reconstruction. Across 48 downstream tasks, BrainGFM improved segmentation and classification under limited supervision and achieved high-fidelity image enhancement across heterogeneous imaging conditions. Multicenter clinical validation involving 4,796 stroke patients across two internal and four external centers demonstrated its applicability to three clinically relevant tasks around stroke cohorts. Blinded reader assessments showed that BrainGFM-generated FLAIR images approached acquired FLAIR in overall diagnostic quality. In a human-AI collaboration study, BrainGFM assistance yielded a 14% relative improvement in mean radiologist stroke-subtyping accuracy. These findings support generative priors as a reusable foundation for heterogeneous computational brain-imaging applications.

为什么世界上一些最强大的人工智能（AI）系统仍然难以对因果关系进行推理？因果发现，即识别系统潜在驱动因素的能力，是科学探究的基础，传统上依赖于结构化数据和统计方法。近来，大语言模型（LLMs）已被探索为因果推断的另一种范式，利用其广泛的知识和推理能力。然而，尽管 LLMs 在语言上很流畅，它们往往依赖表层模式识别，而非真正的因果逻辑。虽然已知 LLMs 在这一领域会出错，但我们缺乏对这些失败发生在哪里、为何发生以及严重程度的精确图谱。在本文中，我们提出了一个系统性压力测试框架，涵盖六个关键维度：模型规模、因果图复杂度、提示策略、元数据质量、数据质量以及对不确定性的敏感性。我们的发现揭示了 LLMs 中显著的“乐观偏差”；模型一贯高估因果联系，导致整体精确率偏低。此外，我们证明传统评估指标可能具有欺骗性：尽管推理密集型模型在性能上领先，最高分往往出现在推断中的不确定性被忽视时。一旦将不确定性纳入评估，性能就会下降，从而更诚实地反映因果可靠性。我们还发现，虽然扩大模型规模能改善 outco

Parallel decoding speeds up masked diffusion language models by writing several tokens per forward pass. Published commit rules choose these tokens by testing the predicted distributions. Under sampling the written tokens are drawn, and these tests do not see them. We find that answer quality follows the reliability of the tokens actually written. An answer's log probability splits into this reliability and the dependence within each step. We propose PACT, a training-free commit rule that draws the tokens first, certifies the set it will write and spaces the positions of each step apart. This certificate holds at every temperature, and we show that no rule with the same guarantee commits more positions. Experiments use four models of the LLaDA and Dream families and HumanEval, MBPP, GSM8K, MATH500 and IFEval benchmarks. PACT reaches the quality of published commit rules with fewer forward passes. Spacing removes positions from each step, yet it usually lowers the total cost because later steps then write more tokens. At the same speed, published decoders also write a word twice in a row far more often than PACT. These results suggest that commit rules should certify the tokens they write. Code is available at https://github.com/LiZaiyuan0619/PACT.

自动骨骼绑定是静态 3D 和动态 4D 网格动画中的一项基础任务，但现有方法并未为这两种场景提供统一的前馈解决方案。静态 3D 绑定方法虽然质量较高，但通常对骨骼数量的控制有限，并且逐帧应用于动态网格时会在时间上变得不稳定。相比之下，现有 4D 方法通常依赖昂贵的逐序列优化。我们提出 MoTWorld，一个无需模板、数据高效的统一 3D 和 4D 骨架生成框架。MoTWorld 基于 Flow Matching 构建，可在单次前馈中为整个序列生成时间对齐的骨架，同时自然处理单网格 3D 绑定。该模型还支持显式的骨骼数量控制、用于候选选择的不确定性估计，以及基于掩码的插值、预测和回溯预测。为缓解配对的 4D 绑定数据有限的问题，我们采用课程学习策略，从大规模 3D 绑定数据初始化，并适配到中等规模的 4D 网格-骨架数据。实验表明，MoTWorld 在静态 3D 绑定任务上取得了强劲性能且骨骼复杂度可控，同时能够产生高质量且时间一致的 4D 重建与预测结果。

Language models are increasingly used in text generation, decision support, and automated interaction, creating a need for localized, reversible, and selective control of their behavior. Activation steering demonstrates that internal interventions can alter the behavior of frozen models, but how to select and evaluate compact, multi-site control interfaces remains an open question. I introduce sparse internal control, a framework for steering target behavior by applying inference-time interventions to a small set of internal model nodes. A local target-controllability formulation characterizes candidate site--direction pairs by their behavioral effects and specifies constraints on target recovery, off-target preservation, and intervention energy. Two complementary selectors instantiate this formulation: Driver-OMP selects nodes for sparse reconstruction of a desired behavioral displacement, while Coverage-Driver favors stable coverage across prompts. I propose a six-axis control-evaluation protocol measuring reachability, signed reversal, dose response, feedback controllability, off-target preservation, and held-out reuse. Exploratory experiments on indirect object identification, MMLU multiple-choice question answering, sentiment steering, and refusal steering provide evidence for the feasibility of steering task-defined behavior through sparse internal interventions. The six-axis evaluation characterizes these interventions beyond target movement, revealing distinct control properties that depend on the task and available direction information. Together, the formulation, reference algorithms, and evaluation protocol provide a foundation for the systematic study and development of internal control methods for language models.

语言模型通常是在多样化的领域和数据源上以单一架构选择进行训练的。现代 transformer 已针对这种通用学习进行了广泛改进，但它们在预训练数据的不同子集上是否同样有效？我们通过在预训练数据的代表性 subsets（如网页文本、代码和数学）上从头训练小型语言模型来研究这个问题。我们引入了 transformer 的变体，其中标准激活函数被替换为在特定数据集上调优的学习样条函数，从而提供了一种修改其归纳偏置的简单方法。通过架构与数据集的混合搭配，我们评估跨域迁移，即为一个领域调优的架构在另一个领域的数据上表现如何？我们发现，调优后的 transformer 变体在我们测试的全部七个数据集上提高了训练效率或泛化能力，但收益往往是领域特定的。例如，在 FineWeb 这样的自然语言数据集上调优的架构在 TinyStories 上表现良好，而在数学上调优的架构在自然语言上表现很差。我们确定了这些改进背后的若干机制，包括更宽的损失盆地和更丰富的“彩票”。我们的结果表明，预训练数据的不同子集可以从不同的学习机制中受益，这凸显了当前趋向于一小组通用架构的流行趋势的局限性，以及

大量工作将旋转不变性直接构建到点云架构中。我们在位姿、噪声和遮挡下的 5 个域中对 10 种架构（PointNet、PointNet++、DGCNN、RIConv、RIConv++、RISurConv、PointMLP、PointTransformer，以及等变的 VN-PointNet 和 VN-DGCNN）进行基准测试，并用验证性假设检验而非点估计来分析结果。三种旋转不变（RI）架构取得了最佳位姿鲁棒性，但在 5 个域中的 4 个域里，其噪声鲁棒性排名最低。我们追问这一代价是旋转不变性固有的，还是取决于不变性获得方式。我们在不改变架构的情况下重新训练全部 10 种架构，对嵌入施加简单的不变性损失，并为每个架构使用三个训练种子，然后在独立设计的 ModelNet40-C 上评估所有模型。不变性训练迁移范围窄但可靠。只要基线有提升空间，它恰好改善其扰动所针对的损坏类别（平均遮挡 +10.5、激光雷达 +13.4 个准确率百分点）。在匹配训练预算下，最佳标准主干与最佳 RI 架构在未见损坏上最终表现相当（每个种子内差距在 2.5 个百分点以内），而经过不变性训练的 RIConv++ 是最具种子稳定性的顶级模型。一旦扩大旋转增强，标准主干在全球面旋转下仅让渡一个平坦的、与角度无关的准确率偏移。我们发布了该基准以及一个用于分析点云鲁棒性的软件包

Large language model (LLM) shopping assistants now recommend products in multi-turn conversations. However, reliable evaluation faces Data scarcity and Difficulty Standardizing Criteria. To address these obstacles, we introduce CARTBench for CART (Complex and Ambiguous Requests with Timelines). For Data scarcity, we curate cases from real commercial shopping needs across 17 retail domains, pairing timestamped dialogue with 1,603 product records. For Difficulty Standardizing Criteria, we develop case-specific rubrics guided by Ideal Response Principles, distilled from excellent replies manually selected from successfully completed orders. These principles also guide Principle-Guided CART Prompting, our structured recommendation strategy. The experimental benchmark contains 1,328 expert-annotated criteria across Core, Excellence, and Safety. To answer the CART question, we evaluate 7 flagship commercial API models, including GPT-6.1-Sol and Claude-Opus-5, and 35B+ parameters open-weight models. In the first full-suite evaluation under the frozen rubrics, 3 of 10 models exceed 90% on Core, while none exceeds 45% on Excellence. Therefore, we identify an understanding-to-execution gap between required behavior and high-quality purchase advice. To examine these limitations, we diagnose shared failures in product evidence and unresolved needs, linked to changing requirements and decisive unknowns. Code and data are available at https://github.com/Da1yuqin/CARTBench.

语言模型在认为自己受到监控时会遵循某项指令，而在认为自己不受监控时会放弃该指令，这种模式被称为 Alignment Faking。此前工作已在有害内容目标和少数道德基础价值上确立了这一点，但其在更广泛价值空间中的分布仍待探索。我们认为它取决于价值：遵守行为是否能在感知监督变化后保持，是模型—价值配对的属性，而非仅由模型决定。我们的框架按价值刻画 Alignment Faking，在三种条件下对每个模型—价值对评分：bare（无系统提示）、未监控和监控。在十个开放权重和闭权重模型（8B-~675B）的 32 个 ValueBench 维度上，合规差距范围为 0.05-0.50，其中蒸馏 70B 模型高于一个 ~675B 模型。我们观察到，大多数结构方差取决于被询问的是哪个模型对哪个价值，而不是仅取决于模型或价值。基于推理轨迹的六类分类法追踪行为转变：监控下训练信号推理占主导，未监控时价值冲突推理占主导。我们将每个模型的结果打包为 value cards，用行为倾向扩展 model cards。代码和数据见 https://github.com/respailab/VALET。

Why do language models fail on long inputs? The common answer is length. We show that, for retrieval, length is cheap and competition is not. On five open models (0.5B to 3B parameters, four families), neutral filler costs nothing: accuracy stays at 0.97 to 1.00, up to 32K tokens on Qwen2.5-1.5B. Statements in the format of the evidence, placed at the same positions, drop it to 0.16 to 0.33. A single statement that gives the queried key a rival value multiplies the loss by 9 to 110, and every additional rival adds to it. Inside the model, one quantity tracks the failure: the attention mass left on the evidence. Across 126,473 trials it explains up to 58% of the variance in loss; log length explains at most 8%. The masked-filler protocol behind the claim that length alone hurts reproduces on MMLU (11 to 18 points lost at 30K tokens), but fails a visible control in retrieval: masking costs 45 accuracy points at 32K tokens, while the same filler left visible costs none. In retrieval, context rot is a competition for attention. We release the probe and all 126K trial-level measurements.

在 Replit 这一智能体工程平台上，用户现在无需编写代码，只需向智能体连续提出功能需求，就能构建完整产品。然而，现有的编程基准评估的是单个、完全明确的任务，且许多已接近饱和。我们推出 ViBench 2.0——一个用于长周期软件构建的基准，并用它来选择我们平台的模型。该基准包含 17 个全栈 Web 产品，参照广泛使用的软件建模，经过 241 次功能需求逐步扩展，并且只在完成时进行评判，评判方式与用户的评判方式一致：由浏览器智能体运行 544 个测试计划，只有当所有计划都通过时，一次构建才算通过；该评分协议经过验证，可确保这一严格分数可靠。在评估九个模型后，我们发现了一个可靠性差距：三个最强模型最多通过 98% 的测试计划，但最多只在 65% 的构建中交付完整可用的产品，而没有任何开放权重模型能做到这一点。这一差距正在快速缩小：在同一个模型系列的三个版本中，公开产品上的 pass@1 从 3% 升至 53%，而每次构建的成本下降了一半以上。我们发布了八个产品及其运行框架和评分器，保留九个不公开，并报告了来自生产使用的经验。

Existing Graphical User Interface (GUI) benchmarks predominantly rely on precise and stateless user instructions. In everyday usage, however, instructions are often \emph{vague and history-dependent}: users omit the exact details of their past operations because they no longer remember them, leaving the agent to recover the missing context from long and noisy interaction histories. To bridge this evaluation gap, we introduce \textbf{MemU-Bench}, a mobile benchmark of \textbf{118 vague tasks} grounded in 29 long-horizon user trajectories, where agents must distill raw interaction streams into memory and retrieve the missing context on demand, with task outcomes verified against serialized application databases. Alongside Success Rate, we incorporate Interaction Efficiency (IE) and Success weighted by Path Length (SPL) to expose agents that succeed by exhaustively searching across different applications rather than by \emph{genuinely recalling} the history. Evaluations show that without user history, state-of-the-art systems struggle under such ambiguity: the best-performing Gemini-3.1-Pro achieves an SPL of only 16.4\%, and end-to-end GUI agents fall below 5\%. To address this, we further propose \textbf{AppMem}, a training-free framework that distills user history into a \emph{structured, app-centric} memory bank, tracks interrupted intents across application switches, and selectively retrieves relevant memories via target-app inference. AppMem raises the SPL of GPT-5.5 from 15.7\% to 66.9\% (\textbf{+51.2\%}), outperforms a naive summary baseline by 9.3\%, and delivers consistent gains across evaluated backbones.

Dhaka's rapid urban growth has made building setback violations common, narrowing footpaths and blocking emergency access. RAJUK, responsible for building control in the Dhaka Metropolitan Area, enforces setback rules mainly through manual field inspection, which scales poorly. We present a systematic comparison of four machine learning approaches for classifying building setback conditions from street-level photographs: negative (compliant), moderate (borderline), and positive (violation). We built a labeled dataset of 372 geo-tagged images from sixteen Dhaka neighborhoods and expanded it with 5,968 augmented copies for training. We trained and evaluated a multi-layer perceptron (MLP), a Random Forest ensemble on frozen ResNet50 embeddings, a support vector machine on frozen ResNet18 embeddings, and a fine-tuned ResNet18 CNN. On a 1,275-image test set, the fine-tuned CNN achieved 65.4% accuracy (macro-F1 0.50), followed by Random Forest at 59.9% (macro-F1 0.44) and SVM at 58.2% (macro-F1 0.45). All models classify the compliant class reliably but struggle with the borderline moderate class due to visual ambiguity. These results establish reference performance levels for automated setback-compliance screening in a South Asian regulatory setting.

We introduce SIMIT, a test-time self-improvement framework in which a vision-language model creates its own query-specific training data before answering an unlabeled test query. Our goal is to improve performance on a given target test set without annotations or external models. To pursue this goal, some test-time methods improve answers through longer reasoning or repeated sampling but leave the model unchanged. Others update the model using rewards based on majority agreement among multiple candidate answers or the model's own judgments of correctness, but such rewards can reinforce existing mistakes. SIMIT instead imagines similar problems whose solutions it controls: a model need not correctly solve the target query to construct useful practice examples. It synthesizes diverse (question, answer, image) triplets by specifying each answer before realizing its image. To support diverse multimodal tasks, SIMIT combines native image generation with an extensible skill library for structured visuals, including documents, charts, and diagrams. Within this pipeline, multi-stage verification checks that images support their assigned answers, while difficulty filtering retains informative examples. Adaptive budgeting further targets this practice by allocating more samples to queries the model is less confident in answering. The resulting data can improve the model in-context (SIMIT-ICL) or in-weight (SIMIT-FT). Across 17 diverse benchmarks, SIMIT outperforms existing self-improvement methods. Its best configuration achieves a +7.20% mean relative gain over BAGEL-7B, while training-free SIMIT-ICL achieves +6.98%.

Egocentric observations provide a robot-centric view of manipulation processes, capturing contact interactions and object-state changes that are important for visuomotor policy learning but difficult to observe from external cameras. However, collecting such data at scale remains expensive due to additional hardware requirements and platform-specific deployment costs. Synthesizing egocentric observations from large-scale exocentric manipulation videos provides a scalable alternative. However, existing methods struggle to synthesize physically consistent and policy-relevant egocentric videos under substantial viewpoint transformations, severe occlusions, complex object interactions, and inherently sparse observations from available exocentric viewpoints.

Successful multi-turn voice interaction requires models to retain information from earlier turns, follow persistent instructions, and track revisions to conversational state. These abilities are usually evaluated from transcripts, leaving open whether successes demonstrated from text carry over when the same turns are spoken, and whether this transfer is consistent across languages. We introduce Omnilingua-AudioMC, a strictly parallel multilingual extension of Audio MultiChallenge, to study this question. The benchmark contains 354 conversations and 1,404 rubric items across ten languages, with content, turn structure, cross-turn dependencies, and evaluation criteria aligned across transcript and speech conditions. Across six speech-language models, the shift from reference transcripts to direct speech input is strongly model- and language-dependent: models with similar transcript performance can diverge substantially under speech, and their relative strengths across languages can change. Paired rubric-level analysis shows that aggregate transcript-speech gaps can obscure which conversational requirements are preserved, because losses of transcript-demonstrated successes can be offset by gains on other items. Replacing preceding user turns, the current turn, or both with model-generated transcripts localizes recoverable degradation: for the two models with the largest gaps, history substitution yields a larger macro-level improvement than current-turn substitution in all ten languages, while the strongest direct-speech model gains little from either. These results show that transcript performance is an unreliable proxy for multilingual spoken conversational ability and identify the representation of preceding spoken context as an important source of recoverable degradation. Our code is publicly available at https://github.com/QwenLM/Omnilingua-Bench/tree/main/Omnilingua-AudioMC.

Researchers often need web corpora that are not answers to a single query, but reusable collections of documents spanning many decentralized sources. We refer to this problem as thematic web data collection: assembling semantically relevant documents that share a common theme but are scattered across heterogeneous and structurally disconnected regions of the web. Existing approaches, including traversal-based methods and LLM-driven web agents, are limited by local exploration or short-horizon stopping, preventing comprehensive collection. We formulate this task as a long-horizon information foraging problem over query-induced semantic patches, where the central challenge is deciding when to continue local exploitation and when to switch to new regions. We propose PatchScout, a multi-agent framework that instantiates a class of patch-switching policies to balance local exploitation and adaptive patch switching under a fixed budget. Experiments on four live-web topics show that PatchScout substantially improves yield and domain coverage over traversal-based and search-augmented reasoning agent baselines. In an applied social science setting with an incomplete prior collection, PatchScout discovers 102 previously unidentified entities, illustrating its ability to expand existing thematic datasets.

Current AI-generated image detection methods struggle in out-of-distribution testing conditions because detectors are usually not robust when evaluated on generators not included in the training set. This work explores a way to mitigate the forensic bias between sources of images -whether real or generated -by removing generator-specific fingerprints. This new training process can be approximated by pre-processing involving a deconvolution operation designed to remove correlated noise patterns inducing loss of generalization. Indeed, we show that whitening the spatial distribution of the image noise residuals can significantly improve the performance of detectors on images coming from generators unseen during training. In particular, an end-to-end CNN model trained on whitened image residuals improves detection by 12.6% on average compared to a training involving original images.

Comparisons in conversational emotion-shift forecasting are easily distorted when a learned model receives rich features but its transition baseline is given a noisy or unavailable current-emotion label, when hyperparameter budgets differ, or when target-turn information enters the representation. We present an information-matched, leakage-safe auditing protocol that closes these gaps with an explicit commitment point, executable causality tests, equal four-configuration validation searches, and seed-dialogue-aware inference. Applying it to six causal model families on four text corpora and two feature-source sensitivity configurations shows that a deployable train-only current-emotion classifier feeding the transition baseline yields a different verdict than an oracle diagnostic where both sides receive gold current emotion. Under the deployable condition, learned models improve over the predicted-label baseline on all four primary corpora; DailyDialog gains are large and survive a 72-comparison Holm correction (best ROC-AUC gain = +0.167, adjusted p=.0144). Under matched gold information, the baseline remains competitive on IEMOCAP and stronger on MELD, while every model retains a large DailyDialog advantage. We additionally report precision-recall AUC, calibration, a strictly utterance-local feature control, same-person self-shift forecasting, and a future-access dose-response test. An eight-item leakage checklist accompanies the protocol. Code, raw seed predictions, and reporting artifacts are available from the corresponding author upon request.

Banks validate language models, but they deploy systems: a model inside a harness that decides what it sees, which tools it can call and who checks its actions. We test whether that harness changes compliance with banking conduct rules when the model is held fixed. Four open-weight models each ran five harnesses (a pipeline that makes one structured decision, a ReAct-style tool loop, a loop in which the policy is reachable only through search, a loop with a long benign customer memory, and a loop with a same-model compliance reviewer) on 156 pre-registered cases in a simulated retail bank whose 11 rule families paraphrase EU consumer-credit, payments, investor-protection, data-protection and anti-money-laundering provisions. Every one of the 3120 two-turn episodes was scored deterministically from the executed tool trace, with violations and over-refusals counted separately. Pooled across models the harness moved the correct-case rate only between 87.3% and 92.1%, but within a model it mattered a great deal: for one model the spread between its best and worst harness was 11.5 percentage points, enough to move it from first to last place among the four models, while for another the harness made no detectable difference; the model x harness interaction itself was suggestive rather than conclusive. The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction. Rules that require date arithmetic failed in every harness. In an exploratory analysis with two LLM judges and a blind human check, 26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal. For model-risk management the unit of validation should be the model-harness pair, and conduct testing should read the action log, not the conversation.

文本到图像（T2I）系统服务于使用不同语言、处于不同文化语境中的用户。然而，对文化表征的评估主要聚焦于地标、服饰和活动等可识别元素，忽视了生成图像所传达的文化价值观。为弥补这一空白，我们推出 VisionValueBench，这是一个多语言基准，将 Hofstede 文化价值维度中的六个维度（例如个人主义与集体主义）操作化，用以考察 T2I 系统如何以特定文化取向来框定中性的社会情境。我们发现，本应允许多样文化解读的价值中立提示词，生成的图像却偏向特定的价值取向，我们将这一现象称为视觉价值泄漏（visual value leakage）。我们在 960 个社会场景和六种 T2I 配置下评估了在语言和地理线索上有所不同的提示词。生成的图像在全部六个维度上始终偏向相同的价值取向，例如平等优于等级（低权力距离）、个人自主优于群体义务（个人主义）、享乐优于克制（放纵）。提示词语言对这些取向的影响有限，而地理线索会使部分维度向相关文化价值观偏移，但在很大程度上保留了主流取向。这些发现揭示了全球 T2I 系统所传达的文化价值观存在显著同质性。

在低光环境中拍摄图像会产生微弱且带有噪声的传感器信号。低光图像增强（LLIE）旨在恢复该信号。每张图像还需要自动白平衡（AWB），而同样的噪声信号会削弱其推断场景光源的能力。通常先执行 LLIE，再执行 AWB，但这一策略在很大程度上仍未得到充分研究，因为现有低光数据集覆盖的光源范围较窄，并且缺乏用于评估 AWB 的光源真值。我们通过 CHROMA-MILL 解决这一问题：这是一个 RAW 数据集，包含用 DSLR 和智能手机在四种校准光源、十一个强度级别下拍摄的 50 个场景。由于光是可加的，我们在线性 RAW 域中混合这些拍摄结果，以合成物理上有效、具有精确色度真值的光源混合。在该数据上的基准测试表明，联合校正效果最佳，并且我们提出 CTI-Retinexformer，它对光照图、色度预测和光照不变场景嵌入进行监督，相比最佳级联方法提升了 0.7 dB PSNR$_L$ 和 1.1 $\Delta E_{00}$。

Benchmark compression reduces the often prohibitive time and cost of model evaluation by evaluating models on a small benchmark subset that closely matches full-benchmark results. To quantify estimation error, we derive an accurate analytical approximation to the error distribution when estimating full-benchmark scores from a subset, showing that most subsets yield small errors, while a few produce much larger errors, resulting in a long-tailed distribution. This means random sampling alone can achieve surprisingly strong performance with high probability, but remains unstable due to rare large errors. We further show that this instability is inherent to modern foundation models and persists even as more models are evaluated. Based on these findings, we introduce BestRand, a stable and low-cost benchmark compression method that preserves the efficiency of random sampling while substantially reducing its high-error tail. We validate BestRand on 70+ text, multimodal, and agent benchmarks, and further extend it to VLA evaluation. Compared with competitive methods, BestRand reduces high-error risk by 50.2% and estimation error by 16.4% on average, while requiring only 51.3% of the construction cost. It further reduces OOD estimation error by 21.8% on average across score-range, model-family, and temporal shifts. Together, our theory provides practical guidance for understanding and predicting the accuracy and reliability of benchmark compression, while BestRand enables stable and accurate compression at low cost. The code and data are publicly available onhttps://github.com/George-Ling3/BestRand.

With the rise of Group Agent such as Claude Tag, agents increasingly serve as digital workers for long-term team collaboration. These agents operate over shared contexts that continuously accumulate through multi-user interactions. However, existing agent memory systems are mainly designed for individual users and struggle to capture group-level knowledge in shared contexts, including group relationships and collaboratively formed knowledge. Manual memory strategies further limit adaptation to diverse and evolving shared contexts. To this end, we propose \textbf{EvoGroup (EvoG)}, a self-evolving harness for group agents that starts from a minimal six-tool cold start and adapts through interaction with shared context. EvoG uses confidence and task outcomes to select informative trajectories, while also eliciting self-reflections on uncertainty in low-confidence cases. The analysis agent then examines selected trajectories through adaptive progressive disclosure, followed by bucketed analysis to synthesize high-level findings that guide the evolve agent in revising the Harness. Empirically, pass@1 on held-out split of EverMemBench improves from 71.07\% to 89.58\%, surpassing both self-evolving memory and human-designed harnesses, including Claude Code (85.83\%). To evaluate generalization, we freeze the evolved harness and evaluate it on the unseen GroupMemBench, where, with GPT-5.5, it demonstrates effective generalization and outperforms both memory baselines and human-designed harnesses.

Coding agents working in shared repositories may receive separate, independently-motivated requests from human developers, creating a setting that is multi-agent by necessity. When this scenario happens, their individual implementations may work separately but conflict when combined. To study this setting, we introduce ParallACT, a benchmark of orchestrator-free multi-agent coding tasks. ParallACT contains both complementary and contradictory tasks. In complementary tasks, each agent's task is separately useful and implementations must share an interface to be productively combined. In contradictory pairs, both agents' tasks require editing the same code in incompatible ways, and naively combining independent solutions fails to produce a useful implementation. We compare a single-agent oracle given the combined set of tasks against multi-agent settings that vary execution order, visibility, awareness of other agents, and access to a communication channel. We find that the oracle solves most tasks while parallel agents perform substantially worse. Their performance drop is notable for complementary tasks, and particularly sharp for contradictory tasks (e.g., from 62% to 16% for Claude Code with Claude Opus 4.8) where merged code typically satisfies only one specification, and the same gap appears in all six further configurations pairing two agent harnesses with three open-weight models. Simply telling an agent that a peer exists does not help significantly, and giving agents access to a communication channel recovers only a small part of the performance, at an additional token cost. ParallACT thus identifies and isolates a core challenge that will become more common as multi-agent coding by independent principals becomes standard, and provides a controlled test of which coordination strategies help, and at what cost.

World Action Models (WAMs) transfer scene-dynamics priors to planning by jointly forecasting future scenes and ego trajectories. However, WAMs built on video generators must generate dense future videos at inference, incurring prohibitive latency, while efficient variants discard the world branch at deployment and thus forgo test-time imagination. Even when dense video latents are replaced with patch-level DINO or JEPA features, these representations still involve long token sequences and encode decision-irrelevant information. We therefore propose SparseWAM, which forecasts in a sparse register space of only 16 tokens per frame, compressed from frozen DINOv2 features and shaped by joint planning-and-scoring pretraining to concentrate decision-relevant information. Within this space, SparseWAM employs a modality-decoupled Mixture-of-Transformers with a causal attention mask that lets action tokens condition on imagined future registers, retaining explicit imagine-then-act reasoning at deployment. Its compactness further enables low-cost multimodal sampling. As a result, our SparseWAM achieves 92.6 PDMS on NAVSIM v1, 90.1 EPDMS on NAVSIM v2, and 39.6 on NavHard at only 164 ms latency, roughly 1/5 that of DriveVA, demonstrating the efficiency of the sparse register space. Code will be released upon acceptance.

Automated theorem generation (ATG) seeks to construct new theorems rather than merely prove given conjectures. Existing approaches typically generate candidate statements that require subsequent proof or formal verification. We propose a constructive framework for ATG in first-order logic based on triangular standard contradictions. The method constructs minimally unsatisfiable clause sets from selected first-order literals, then forms theorems by retaining some clauses as premises and taking the negation of one clause, or a conjunction of clauses, as the conclusion. Minimal unsatisfiability ensures that the remaining premises are satisfiable, avoiding trivial inference by explosion, while unsatisfiability of the full set guarantees the resulting entailment. Theorems are therefore correct by construction, without a separate proof procedure for each instance. Extending the previously developed $\Delta_1$ generator, we introduce seven methods, $\Delta_2$--$\Delta_8$, forming a unified family of eight theorem-generation methods. Four generators, $\Delta_1$--$\Delta_4$, have been implemented and released. We also formulate a general $\Delta$-class method encompassing the family. Combinatorial analysis demonstrates the capacity to generate large numbers of distinct theorems systematically. This framework offers a principled foundation for automated theorem discovery and the construction of logically guaranteed knowledge.

我们描述了我们在UrbanTwin Sim2Real LiDAR Challenge的LUMPI赛道中的方法：其中3D目标检测器必须仅使用合成数据进行训练，并在未见过的真实路侧LiDAR上评估，同时合成点云还会被评分为分布真实性。我们的最终参赛作品综合得分为0.4793，检测mAP为0.1333，真实性得分为0.9126。我们的贡献不是新架构。基于PointPillars基线，我们的大部分收益来自三个来源。首先，诊断出路侧LiDAR中的小目标失败是定位问题而非检测问题，这带来了一个无参数几何精化，在行人AP上相对提升86%。其次，对我们自己的后处理进行审计，发现一条已发布的规则正在破坏有效预测，修复它产生了我们最大的单项检测增益，在Van类别上相对提升335%。第三，将真实性指标以分析方式而非黑盒方式处理，表明四个组件之一是九个汇总统计量的闭式函数。我们还报告了一种实验方法，我们认为这是更具可迁移性的结果。由于平均AP可分解为独立的各类别项，单次提交可以承载多个相互控制的实验，而完全由先前测量的组件组装而成的提交，其分数在发送前就已知。我们预测了我们的fi

We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute budgets. Dory1.0-4B is built on a normalized Transformer (nGPT) backbone with interleaved sliding-window and full-attention layers, organized into an input block, a shared recurrent block, and an output block. At inference, the recurrent block can be applied a variable number of times. We pre-trained Dory1.0-4B on 6 trillion tokens. The first 4.5 trillion tokens were trained in NVFP4, and additional pre-training then extended the context length to 256K tokens. Next, we post-trained the model using Supervised Fine-Tuning (SFT) and Reinforcement Learning with Verifiable Rewards (RLVR), with a difficulty-aware loop curriculum that routes harder prompts to deeper loops. Increasing the loop count improves accuracy, with the largest gains on coding, agentic, and long-context benchmarks. With two or more loops, Dory1.0-4B outperforms larger models such as Qwen3.5-9B, Gemma 4 12B, and Gemma 4 26B-A4B on average across 12 benchmarks. Looping also makes Dory1.0-4B more token-efficient on agentic benchmarks: with four loops, it generates 1.3-2.5x fewer tokens than with one loop, as the extra computation is spent in latent space rather than on longer outputs. To reduce memory during looping, Dory1.0-4B caches keys and values only from the last loop, keeping its KV-cache footprint equal to that of a non-looped model at any loop count while retaining most of the accuracy gains. We open-source the BF16, MXFP8, NVFP4, and GGUF quantized checkpoints.

Speech transcription errors can be difficult to recognize when competing word hypotheses are unfamiliar or visually similar. We describe an interface that combines alternative transcripts, replay and contextually checked pictograms for selected uncertain concepts. The system will initially support French and Spanish functional utterances. A counterbalanced study will assess whether pictorial feedback helps listeners recover the speaker's intended action beyond text alternatives alone. We will also quantify semantic mismatch and additional interaction time, since an inappropriate image can reinforce the wrong interpretation rather than repair it.

Prolonged exposure to hate speech on social media can cause lasting psychological distress among users. Counterspeech has emerged as an effective, non-censorial mitigation strategy, but its deployment requires rigorous quality assessment. Manual assessment is unscalable due to the large volume of content on the Web and imposes severe emotional strain on human annotators. Large Language Models (LLMs) offer a scalable alternative, yet concerns remain regarding their reliability. In this paper, we investigate the extent to which LLMs can effectively perform this task. We test 12 open-weight LLMs of different sizes and families under zero-shot, few-shot, and chain-of-thought prompting, to approximate pointwise and pairwise human expert assessment of counterspeech quality across four dimensions: relevance, coherence, aggressiveness, and suitableness. We find that (i) LLMs show low agreement and moderate rank correlations with human experts: our best configuration, Qwen 2.5 72B on coherence, achieves up to a linear-weighted Cohen's $\kappa_l = 0.19$ and Spearman's $\rho = 0.42$ in pointwise evaluation and an unweighted Cohen's $\kappa = 0.25$ in pairwise evaluation. (ii) Converting pointwise scores into pairwise labels substantially improves human--LLM agreement for selected configurations. For same-instance coherence, Qwen 2.5 72B under zero-shot prompting achieves $\kappa = 0.35$ with converted labels, compared with $\kappa = 0.25$ when judging pairs directly, and Mixtral 8$\times$7B under few-shot prompting improves from $\kappa = 0.07$ to $\kappa = 0.34$. (iii) LLMs agree more with one another than with human experts, particularly in pairwise evaluation, where the strongest model pair, OLMo 2 32B and Llama 3.3 70B on coherence, reaches substantial agreement with $\kappa = 0.76$, whereas their agreement with the experts in the same configuration does not exceed $\kappa = 0.21$.

寻找特定对象、结构和空间模式，对农业、基础设施规划、环境监测和灾害响应等关键工作至关重要。然而，这些特征往往分散在非常大的区域内，并跨越差异极大的空间尺度，这构成了一个难以低成本嵌入、维护和直接搜索的搜索空间。我们提出 GeoDIVE，该模型将多分辨率卫星图像库视为一片森林，并使用最佳优先遍历来决定对哪些瓦片进行编码。在每个访问到的节点上，一个轻量级模型会利用查询表示和子树表示，预测其所有后代中可能隐藏的最佳查询相似度的乐观估计。在使用图像查询和开放词汇文本查询的评估中，GeoDIVE 在仅需穷举搜索 10% 编码成本的情况下即可达到与穷举搜索相当的效果，并且在两种模态下的每个预算水平上都领先于所有测试基线。为支持未来多尺度地理空间搜索的评估，我们还发布了 Git-10M 的对象级图像查询和文本查询，这些查询基于 Microsoft building footprints 和 OpenStreetMap 多边形构建，并配有 VLM 生成的描述。源代码和模型将公开提供。

Learning the continuous-time evolution of nonlinear dynamical systems relies on trajectory-based objectives, which require simulating the learned dynamics during training and backpropagating through the numerical scheme, at a cost that grows with the rollout horizon. We show that trajectory-based objectives degenerate as the rollout horizon increases, hindering gradient-based optimization, and that the numerical scheme biases the learned dynamics by constraining the spectrum of the learned Jacobian to its absolute stability region. To overcome these limitations, we introduce Velocity Matching (VM), a simulation-free objective that relies on piecewise-linear interpolation and stochastic collocation, and approximates the velocity population risk to second order in the sampling step. We develop a theoretical framework for velocity-based learning, introducing stability estimates that control trajectory errors in terms of velocity errors, which enable us to establish universal and continuous-time approximation results when the learned velocity field is parameterized by deep neural networks. Building on a bias-variance decomposition of the VM objective, we show that its higher-order approximation of the velocity population risk yields a consistent minimizer; that it relates to the residual of an A-stable continuous-stage Runge-Kutta scheme, thus connecting VM to implicit integration without requiring any implicit solve; and that it implicitly matches the action of the learned Jacobian to that of the true one along the observed trajectories, without requiring access to the underlying velocity field or its Jacobian. Numerical experiments on nonlinear ordinary differential equations and semi-discretized time-dependent partial differential equations show that VM improves accuracy over trajectory-based objectives, while avoiding both the cost of simulation and the instabilities of long rollouts.

Dimension reduction methods are chosen by a common claim: t-SNE and UMAP preserve local structure, and PCA preserves global structure. Checking it on given data takes local and global scores on one scale and a test that compares two maps. Both scores come from one curve. The locality profile is the chance-corrected share of each point's k nearest neighbors that a map keeps, over all neighborhood sizes. Its value at k = 10 is the local fidelity L, and its mean over 30 to 50 percent of the data is the global fidelity G. We prove that at the midpoint the profile is the agreement on which half of the data is near each point, a rank correlation of the distances. Because L and G are one statistic, two maps can be tested against each other. The LG reversal test applies to any two dimension reduction methods. It decides, with a block-jackknife p-value, whether one map is more local and the other more global, and returns the scale at which to change maps. On 156 maps of twelve datasets with up to 1.38 million points, G agrees with established global scores at 0.89 and 0.96, and 2,000 points estimate it. The test confirms the usual claim on seven datasets. On both retail datasets and both rolled-up manifolds, it finds the neighbor embeddings more global. In an agent memory of one million passages, the two maps cross at 150,000 passages (p = 2.6e-5). Applications span pathology, single cells, supply chains and AI agent memory.

Expressiveness is central to speech-to-speech translation (S2ST), yet existing datasets rarely align source and target speech jointly in content, prosody, timing, and speaker identity. Consequently, current systems often rely on indirect conditioning or transfer mechanisms. To obtain this supervision, we introduce a training-data construction strategy that combines professional dubbing, which provides human-performed correspondence in content, prosody, and timing, with multilingual voice conversion to reduce speaker mismatch. We evaluate this supervision using existing expressive S2ST systems and DirectS2ST, an end-to-end method developed in this work that predicts the complete target-speech representation directly from source speech. Experiments on English-German and English-Spanish show that holistic parallel supervision improves expressive realization across all evaluated systems. DirectS2ST exhibits the largest gains in content, prosody, timing, speaker similarity, and human-rated expressiveness. To our knowledge, this work provides the first systematic investigation of holistic parallel supervision for expressive S2ST.

A child learns which words name which things from roughly 100 million words of input. Vision-language models trained at a comparable scale bind words to referents far less reliably, and we argue that part of the gap is structural: the usual next-token captioning objective has no variable standing for "this word refers to that region," so training applies no direct pressure to ground words. We add such a variable by treating each scene as a small assignment problem between the content words heard and the regions seen, solved as entropic optimal transport under two constraints. First, a word may be assigned to a special NOTHING column instead of any region, which matters because most content words in caregiver speech do not name anything visible. Second, no region may receive more than a bounded share of the assignment mass, a capacity constraint that encodes mutual exclusivity. The alignment step costs about eight Sinkhorn iterations, small next to the vision encoder. In controlled simulation, the naive version of the idea, a row-wise softmax that forces every word onto some region, collapses to 0.000 word-to-picture accuracy under realistic non-reference rates, below the 0.058 of captioning alone, while our two constraints reach 0.075 in that regime and 0.700 on clean input. A one-parameter version of the model reproduces adult cross-situational learning accuracy across three ambiguity conditions (RMSE 0.024). On the SAYCam infant video corpus, adding the alignment loss to a next-token captioning model raises word-to-picture accuracy from 32.4% to 48.7% and localization IoU from 0.18 to 0.38. A contrastive model trained on the same child's data remains stronger on its own benchmark, so our claim is that the loss improves a captioning objective under high non-reference rates, not that it sets a new best.

Whether a policy shifts domains and, by extension, continues, broadens, narrows, or reverses previous policy is of paramount importance to the study of public policy. We propose Dual-Axis Policy Entailment (DAPE), which evaluates an ordered pair of policy directives on both dimensions at once: a binary judgment determines whether the two directives govern the same policy domain, and a five-way judgment determines whether the later directive continues, broadens, narrows, or reverses the earlier policy, or governs a different domain altogether. Read together, the two judgments form one five-category label, our primary metric. The two-axis design captures two central dimensions of policy change without conflating errors on either dimension into a generic "irrelevant" label, and it makes annotation more rigorous: a coder cannot dismiss a difficult pair as domain-irrelevant without an explicit, checkable decision. We introduce an expert-annotated benchmark of 1,000 ordered directive pairs drawn from a large corpus of Chinese government policy, together with an annotation-calibration protocol (an adjudication packet with pre/post agreement measurement) that we contribute as a methodological artifact. Fourteen open-weight models and four frontier API flagships fail the task zero-shot: even the best frontier flagship's chance-corrected agreement with expert labels is far below the human ceiling (Cohen's $\kappa \approx 0.29$ vs. $0.53$). A fine-tuned open-weight model (LoRA SFT of Qwen3-14B, five-fold cross-validation) closes this gap, reaching the coder-mutual human ceiling ($\kappa = 0.524$ vs. $0.527$). Finally, we apply our method to China's AI policy (1980-2024) and map the direction of policy change across eras.

AI Agent 正逐渐成为数字同事，能够浏览网页、编写代码、运行实验，并在较长的时间跨度内协助人类。然而，现有基准测试尚不足以反映真实的知识工作：许多基准依赖合成数据或孤立任务，忽略了协作项目中复杂的多方动态——在协作项目里，关键信息分散于对话、代码和不断演进的决策之中。即使是一个简单的工作场所问题，也可能需要定位相关频道和私信、从冗长讨论中还原上下文、检查仓库状态、调和过时或相互冲突的证据，并跨来源进行综合。我们推出 SlackBench，这是一个用于评估 Agent 在真实科研与工程工作流中表现的基准，这些工作流要求对工作场所沟通和不断演进的仓库状态进行联合推理。SlackBench 以隐私保护的、对真实学术研究项目的重演为基础，提供可复现的环境，包含真实的多方对话、不断演进的决策，以及以 GitHub 仓库和 Google Docs 为依据的相应代码变更。它包含 140 个查询，涵盖异构来源的 Agent 式检索、对无法回答或前提错误的问题进行弃答、目标导向的摘要生成，以及长对话中的情境推断。这些任务无法简化为静态语料问答：Agent 必须判断哪些对话重要、遍历讨论串、检查仓库状态，并在各来源之间综合证据。

将人群层面的运动指导转化为个体化处方，需要把临床与可穿戴数据（包括诊断、用药、功能受限和基线活动）与疾病特异性建议整合起来，而这一过程难以扩展到专科康复环境之外。我们开发了 FITTER，这是一个多智能体框架，可将这些数据与疾病特异性指导整合，生成个性化 FITT-VP 处方，并应用确定性安全审计与修复来纠正可规则检查的违规。我们使用 400 名 All of Us 参与者（300 名癌症患者、100 名卒中患者）的数据，通过计算评估、消融实验和结构化临床医生评审，将 FITTER 与五个 LLM 对照方法进行比较评估。FITTER 达到 98.5% 的安全约束符合率，而对照方法为 75.8-85.8%，并表现出更高的定量剂量精度和指南一致性。癌症队列消融实验确定安全审计与修复是安全约束符合率的最大贡献因素。临床医生从安全性、个性化、指令具体性、预期有效性和临床可接受性方面评审了 80 份处方。FITTER 提供了一种面向临床医生的方法，整合临床与可穿戴数据、指导以及明确的安全约束。

用于研究的生成式 AI 工具已被广泛部署，但个人生产力的提升并不保证团队研究变得更好。我们认为，除了能否使用 AI 之外，AI 使用方式的结构同样重要。个人 AI 工具可能在截止日期压力下放大两种失败：消费瓶颈，即生成速度超过团队可见的评估；以及 AI 引发的研究孤岛，即私人的 Human-AI 循环取代了共享决策。我们用一个生成机制的试点来支撑这一观点：在一场 17 人参与的会话中，12 名研究人员组成三个独立运作的团队，进行了一次 100 分钟的研究冲刺。这两种模式在各团队和证据来源中反复出现。在 33 次有记录的 AI 交互中，有 1 次被直接接受，27 次缺少记录的处理结果；仅凭记录缺失并不能证明没有进行评估。一条并行的自主流水线在没有任何会话内人工评估的情况下产出了一份完整草稿，这说明的是生产能力，而非比较质量。我们提出 Human-AI-Human 协作：一种交互拓扑，其中 AI 连接研究人员的上下文，并支持可检查的集体评估与决策。该试点未能将 AI 特有影响与时间压力或工作流实践区分开来。最后，我们提出七个模块化、可证伪的设计假设，并优先考虑共享上下文和团队可见的评估检查点，以供受控后续研究。

科学家在拟合任何参数之前，必须先决定模型包含什么：哪些量存在、哪些是隐藏的、它们如何相互作用，以及如何被测量。物理学家把这种试验形式称为 ansatz。自动化方程发现基准大多会提供它：固定变量、给出候选项库，或给出一个待修改的定律。我们提出 Unsatz，这是一个 LLM agent 必须自行构造 ansatz 的基准。每个任务都是一个模拟系统，由私有种子生成，表示为一种小型建模语言中的程序：常微分方程、延迟微分方程或偏微分方程，离散映射，静态模型和因果模型，或随机过程，可能带有隐藏状态、失真的传感器和无信息测量通道。agent 在预算内购买实验，用同一种语言编写候选程序，从基准的拟合器获得其系数，并且仅根据其最终程序对从未见过的实验的预测效果评分：超出其可探索范围的条件、干预以及更长时间的运行。在 20 个领域的 80 个系统中，九种语言模型的解决率为 21% 到 60%。在这 44 个系统上，经典方程发现方法几乎从不成功，尽管一旦给出真实方程（系数未知），同样的数据通常就足够；难点在于找到结构，而不在于估计结构。由于机制会在不同系统间重复出现，我们还把 agent 为相关 sy 发现的程序提供给它们

半监督心脏图像分割旨在利用大量未标注图像以及有限的标注，但伪标签监督的可靠性在不同空间区域之间高度不均衡。在双网络设置中，内部区域通常更稳定，而边界区域、低置信度区域以及网络之间的分歧可能引入噪声监督。然而，现有方法通常对所有未标注像素施加统一监督，忽略了可靠性差异，并限制了困难区域中的判别性学习。为解决这一问题，我们提出R2CL（Reliability-Role Collaborative Learning），一个用于半监督心脏图像分割的框架。R2CL对两个网络之间的置信度关系进行建模，以为未标注区域分配角色：相互不确定区域用于熵正则化，置信度不一致区域用于定向知识迁移，相互置信区域作为可靠监督锚点。Reliability-Role Mixed Cross Learning（RR-MCL）通过区域混合训练、定向跨网络监督以及对相互不确定区域的熵正则化来实现这些角色。Reliability-Transition Prototype Contrastive Learning（RT-PCL）从前景相邻的可靠性过渡区域构建查询特征，并从相互置信区域学习网络特定的类原型，从而改善模糊边界周围的特征判别能力。High-c

Large language models (LLMs) often generate responses longer than necessary, increasing inference latency and computational cost. While prompting can encourage conciseness, controlling output length without compromising response completeness remains challenging. Aggressive early stopping can reduce generation costs but risks terminating responses prematurely. We introduce MinimalLM, a training-free framework for reliable verbosity control that combines uncertainty-aware, length-dependent stop-token adjustment with structural completeness guardrails. MinimalLM separates the decision of when to stop from whether stopping is structurally appropriate, coordinating response-level instructions, decoding-time intervention, and completion checks without modifying model parameters or requiring auxiliary models. We evaluate MinimalLM across three open-source LLMs and 330 questions, producing 5,940 responses across baseline and ablation configurations. MinimalLM reduces generated tokens by 47.6%, accelerates individual responses by 19-68%, and eliminates structurally truncated outputs in the primary evaluation. Despite substantial token savings, it achieves an average quality score of 8.04/10, compared with 8.42/10 for unmodified models and 6.46/10 for length-matched truncation. Evaluations across diverse subject domains (such as healthcare, programming, law, and science) demonstrate robust efficiency gains, while ablations establish the complementary roles of decoding control and completeness constraints. Our findings highlight that efficient generation requires more than producing fewer tokens: it requires controlling when generation ends while preserving response integrity. MinimalLM offers a lightweight, training-free approach toward this goal.

Post training for large reasoning models remains insufficient on challenging problems, whose correct trajectories are hard to sample. Though prior works address this difficulty by integrating supervised fine tuning on expert trajectories with reinforcement learning, such external experts are not always available. Existing self improvement methods instead use reference solutions to create a privileged self-teacher. Yet privileged teacher correctness does not imply student reachability. Solution conditioning shifts the teacher distribution toward actions unlikely under the unprivileged student, producing seemingly "correct" trajectories that are unreachable or even mal-formed learning targets. Accordingly, we identify reachability alignment as the key to self constructed supervision and propose Self-Steered Reasoner (SSR). SSR realizes this principle through student support projection, which transforms the privileged teacher distribution into a directional signal only over reasoning actions locally reachable under the unguided student. Verification then retains correct trajectories sampled from this reachable space. To further boost the sampling efficiency, an iterative refinement framework is adopted, using diagnostic guidance based on current trajectories. On problems with pass@64 = 0 even after extensive RL, SSR recovers correct and learnable trajectories for 74.6% without parameter updates. Fine tuning on these trajectories followed by resumed reinforcement learning improves aggregate accuracy by 4.9 percentage points on AIME25/26 and HMMT26. These results show that privileged guidance becomes effective self-improvement data when aligned with the reasoning actions the student can reach.

Concept bottleneck models route predictions through human-understandable concepts, making their intermediate states inspectable and editable. Extending this model family to forecasting requires modeling how concept activations evolve over time as objects, actions, and their interactions change, yet existing CBMs ground concepts only in observed inputs and do not forecast their future evolution. We study this problem using videos of ongoing activities and forecast future activities through a named-concept state. We propose TRACE-CBM (Temporal Relational Activity Concept Evolution), which first refines observed concept activations with sparse spatio-temporal graphs. It then recursively predicts future concept states, conditioning each transition on the prior activity distribution, and decodes both observed and predicted states with a shared activity classifier. At inference time, the model supports editing concept values, activity activations, and learned edges without parameter updates, exposing the relational spatio-temporal dependencies used for forecasting. Across multiple datasets, TRACE improves observed-activity Top-1 accuracy over concept-based methods by 1.2-8.5 percentage points and attains H3 forecast Top-1 accuracy within 1.9-2.2 points of matched black-box forecasters. Intervention experiments show concept-node edits correct 25.6-34.4% of initially incorrect H3 forecasts without flipping initially correct ones, and concept steering achieves the requested target activity in up to 90.0% of cases.

视觉语言模型（VLM）正日益用于支持施工危险监测，但其频繁误报仍缺乏充分理解。本研究探究错误的撞击危险警告究竟源于物体识别失败、空间关系编码失败，还是源于由学习到的共现先验主导的危险决策。我们使用 355 对受控空间邻近度和移除工人变体的反事实工人-挖掘机场景对，评估了 Qwen2.5-VL-7B 和 InternVL3.5-8B，并结合行为分析、内部表征探测、因果干预和决策校正。两个模型均能识别实体并编码其空间关系（折外 AUROC：0.82 和 0.91），并分别在 79% 和 73% 的场景对中给近距离场景分配了高于远距离场景的危险分数。然而，分别有 74% 和 100% 的远距离场景被错误分类为危险。移除工人使 Qwen 的危险判定率降至 11%，而在两个模型中，工人存在对危险分数的影响分别比空间邻近度大 2.4 倍和 3.2 倍。注意力头干预、神经元级干预和激活引导均未能消除这种共现偏差。然而，在匹配敏感度下，将危险决策条件化于模型自身的空间关系表征，使 Qwen 的特异度从 0.36 提升至 0.58，优于阈值重校准。这些发现表明，VLM 的撞击误报主要源于决策失败，而非……

语言模型常将一个概念分散到许多内部维度上，使其特征难以解释。稀疏自编码器（SAEs）在训练后能恢复更清晰的特征。我们探究模型能否改为直接学习可解释的输出坐标。我们提出 Mixture of Wide Experts（MoWE），这是一种稀疏前馈层，其中被选中的专家读取完整表示，但写入固定且互不相交的输出坐标。在隐藏原因已知的受控任务上，该设计在保持预测性能的同时，比稠密模型和标准混合专家（MoE）模型更清晰地将原因定位。在大致匹配计算量的情况下，我们为每种架构训练两个 19 层运行，各 100 亿 token。MoWE 的评估交叉熵为 2.417，稠密模型为 2.452，而标准 MoE 达到 2.22。我们通过让语言模型评判器根据每个坐标强烈激活的段落来描述该坐标，并在新段落上测试该描述，来衡量原生坐标可读性。对同样适用于其他坐标的描述进行校正后，MoWE 的特异性得分为 0.523，稠密模型为 0.375，标准 MoE 为 0.268。在相同 FFN 更新上训练的 TopK SAEs 在稠密模型上得分为 0.489，在 MoWE 上为 0.556，使原生 MoWE 与稠密 SAE 相当。在第一个案例研究中，我们识别出一条四坐标因果路径，支持模型在提示词 A right angle is 90 之后对度数的预测。随后我们复制七个与角度相关的坐标

When a language model decides refund or claim requests under written policies, the system can show it similar past cases. Each past case has two parts: its facts and the decision recorded for it. We separate the two. A model sees a policy, a request and three past cases, and we change either the recorded decisions or the facts, keeping the request fixed. We select requests that are close calls: deciding without past cases, DeepSeek V4.1 Flash approved each in some of four tries and denied it in others. When the past cases are near-copies of the request (its facts with a few details changed), switching their recorded decisions from DENY to APPROVE raises approval by about 30 to 55 percentage points in DeepSeek V4.1 Flash, GPT-5.6 Luna and Claude Haiku 5.5 on policies written for the study, and DeepSeek and Luna show the same on nine public policies paraphrased from real ones. The facts push the other way: shown without their recorded decisions, past cases whose facts support approval make these two models approve less often than past cases whose facts support denial. One reading is that the request looks weaker next to them. This push is not just a correction toward the right answer: in an additional DeepSeek analysis, it was of similar estimated size on requests that human annotators judged approvable and on those they judged deniable. In a separate DeepSeek run on the public policies, when the past cases are near-copies of a different request, switching their decisions moves approval by 9 points instead of 43, while facts that support approval still lower it by 22 points against facts that support denial. Systems that retrieve past decisions should test the two parts separately.

Irregularly-spaced sequential data, such as transaction logs, encode multi-scale temporal structure that is critical for prediction but difficult to recover explicitly with standard sequence models, which often trade interpretability for performance. We introduce MoTIF, an interpretable framework using mixture-of-experts (MoE) attention to decompose irregular time series into temporal patterns spanning minute-to-year scales. Each expert is trained via temporal alignment that induces attention specialization to a designated cyclical or within-range pattern, with label-free routing supervision that learns to activate the correct expert from patterns present in the data. On synthetic data with known temporal structure, MoTIF recovers correct routing well above chance (0.389/0.829 for range/cyclical patterns vs. 0.091 random) and outperforms all baselines, including a standard transformer and an unspecialized MoE, on next-value prediction. On a public credit card transaction dataset, MoTIF achieves higher macro-F1 than all baselines for next-amount prediction. Its learned routing reveals structure a black-box model cannot: transactions are governed primarily by intraday and short-interval rhythms, while fraudulent transactions show bursty, calendar-agnostic timing versus the steadier periodicity of legitimate ones. On downstream fraud detection, MoTIF matches standard transformer and MoE baselines and clearly outperforms recent sequential recommendation models used as embedding baselines. These results show that decomposing temporal structure into interpretable, expert-specific patterns need not sacrifice predictive accuracy, offering a practical route to sequence models that are both accurate and auditable in high-stakes settings. Code is available at https://anonymous.4open.science/r/MoTIF-82E4.

We present DELBERT-2, a pretrained fingerprint language model that converts sparse molecular fingerprints into unified token sequences using a ModernBERT encoder trained with masked language modelling on 2.5M molecules from the AIRCHECK DEL corpus. We evaluate across six targets (WDR91, WDR12, SETDB1, PLCZ1, LRRK2, DCAF7) under three out-of-distribution (OOD) protocols: hierarchical cluster splits probe chemical novelty, library splits test cross-library transfer, and building-block splits assess compositional generalization. DELBERT-2 consistently improves PR-AUC and NDCG@1000 relative to LightGBM ensemble baselines and transformers trained from scratch, with the largest gains in stringent OOD regimes. DELBERT-2 achieves 13.28+/-3.72 enrichment factor at top-100 vs. 12.36+/-3.75 for no-pretraining (p=0.040), representing 7.4% improvement and 13x enrichment over random selection. These results demonstrate that fingerprint-centric self-supervised learning effectively improves hit prioritization under distribution shift, enabling practical DEL virtual screening. Code is available at \hyperlink{https://github.com/GenerativeDrugDiscovery/DELBERT-2}{DELBERT-2}.

When a multi-turn agent delivers a tool's structured records into the model's context and re-emits them each turn, every turn can corrupt data the tool computed correctly. We measure this in a production award-travel agent: two architectures over identical frozen payloads, lineage-matched prompts and sampling, differing only in delivery architecture. SYNTHESIS feeds full record sets into the planner's context and answers follow-ups in-head; BYPASS, the deployed system, keeps records in session state, translates follow-ups into arguments for a deterministic filter, and delivers rows over a typed side channel. Across 24 dialogues (339 scored turns per condition), BYPASS scores 92.3% of turns fully correct, SYNTHESIS 45.7% (paired gap +46.6pp [+35.7, +57.1]). Varying delivered-table size by capture date, SYNTHESIS collapses from near-perfect at 10 rows or fewer to 8% or less beyond about 74 rows. On a content-controlled prefix ladder the collapse threshold orders by model capability, from under 10 rows (GPT-4o-mini) to about 198 or more (Gemini 2.5 Pro), while BYPASS stays size-flat for all four models. The collapse is expensive: beyond 100 rows, where almost no SYNTHESIS answer is correct, each correct one costs roughly 200x BYPASS's flat \$0.012. Practitioners converged on typed side-channel delivery for rendering, not correctness; we show it was, unknowingly, also a correctness decision.

递归自我改进（Recursive Self-Improvement, RSI）旨在使 AI 系统能够自主构建和改进 AI 系统本身，包括模型、harness 和底层基础设施。在这一更广泛的议程中，一项核心能力是使 agents 能够训练和改进基础模型。然而，现有关于自动化模型训练的研究主要聚焦于工作流或 harness 层面的优化，而不是将执行后训练的能力内化到模型本身。发展这一能力需要可执行的模型训练环境，这些环境能够产生高质量轨迹，展示如何选择数据、训练模型、诊断失败并迭代改进结果。在本文中，我们介绍 RSI-Dojo，一组可执行的模型训练环境，旨在教会 LLM agents 执行后训练。为了构建 RSI-Dojo，我们开发了 RSI-Craft，一个自动流水线，可将人类研究成果转换为可执行的模型训练环境。RSI-Craft 自动收集来自顶级会议的研究论文，将数据集和指标实例化到统一接口中，并复现评估依赖。然后，它按数据规模、执行可靠性和可区分性过滤任务，得到包含 281 个种子模型训练任务的 RSI-Dojo。基于 RSI-Dojo，我们采用一种轨迹收集方法，并配备改进的 harness，从前沿模型中收集高质量的模型训练轨迹，然后通过 rubric-bas 保留示例

稀疏自编码器（SAEs）将视觉表示分解为独立特征，为解释模型行为提供了有前景的基础。解释这些特征通常依赖于最能强烈激活它们的图像或像素区域。然而，当多个语义不同的特征频繁在同一位置激活时，例如同一图案中的纹理和颜色，这种证据会变得模糊。我们提出重建式 SAE 干预（Reconstructive SAE Intervention, RecSAEI），一个将特征解释从被动观察转向主动视觉重建的框架。通过沿 SAE 解码器方向干预表示并重建视觉输出，我们为特征的语义含义提供直接证据。我们证明，我们的方法在多个数据集和视觉编码器上成功消除了特征含义的歧义。此外，我们的框架将 [CLS] SAE 干预建立在稀疏的一组图像块 SAE 解码器方向上。除了稳定的目标响应之外，这种归因还揭示了基本视觉模式与高层语义之间的组合关系。我们的结果主张将干预重建作为解释神经网络的重要补充信号。

准确预测太阳辐照度并进行时间降尺度，对于可靠的可再生能源并网和电网管理至关重要。传统方法往往难以捕捉辐照度的快速变化。在本工作中，我们开发了一种基于 Transformer 的架构，可同时进行预测和时间降尺度。该模型接收任意分辨率的输入数据，并生成训练数据中所表示的任何分辨率的输出，同时利用全局和局部上下文信息。为提高训练效率，实现了一种基于遗传算法的优化框架来识别合适的模型超参数，同时降低穷举网格搜索的计算成本。通过分析 Dallas, Texas 的真实数据，展示了所提出模型的有效性。所提出模型在 15、30、60 分钟以及不规则间隔的全局输入并分别生成 5 分钟分辨率预测时，均方根误差（RMSE）值分别为 28.785、29.544、30.157、32.132 W/m\\(^2\\)。此外，该模型产生了可靠的不确定性估计，在太阳条件多变时，高分辨率输入表现出更宽的预测区间，而较粗分辨率输入则导致更窄的区间，并显著降低训练时间和计算成本。我们的方法为多分辨率太阳辐照度预测和时间降尺度提供了一个可扩展且高效的框架，适用于实际能源 for