信息流

全部时间,共 4241 条

论文

PCAsplat: Gaussian Splatting with Local PCA Regularization

Gaussian splatting has emerged as a flexible representation for 3D reconstruction from posed images. However, existing methods are optimized primarily using rasterization-based losses, which supervise a splat only when it contributes to sampled camera rays. Gaussians that are occluded or contribute little to the sampled view therefore receive weak or no geometric gradients and may drift away from the underlying surface, producing undesired floaters. We introduce PCAsplat, a geometry-aware regularization framework for Gaussian splatting based on differentiable local principal component analysis (PCA). Our PCA regularizer acts directly on neighborhoods of Gaussian centers and can therefore update Gaussians that do not contribute to the current training view. We regularize the PCA eigenvalues to encourage Gaussians to move to the underlying surface with isotropic tangent-plane coverage. We also align each Gaussian normal with the PCA-estimated neighborhood normal to enforce consistent orientation. Experiments on DTU, Tanks and Temples, and NeRF Synthetic show that the splats produced by PCAsplat better approximate samples of the reference surface while substantially reducing undesired floaters. These surface-aligned splats enable downstream geometry-processing tasks, including point cloud segmentation, and direct Poisson reconstruction. Additionally, PCAsplat remains competitive under conventional novel view synthesis and mesh extraction tasks. Code will be released.

论文

ASD-FEAT: A Multi-Modal Infant Video-Derived Dataset for Early ASD Risk Prediction

Accurate early screening for Autism Spectrum Disorder (ASD) is a precursor to timely intervention, which is critical for improving cognitive and behavioral outcomes. We present ASD-FEAT (ASD - Feature Extraction And Tracking), a multimodal dataset derived from video recordings of infant-adult interaction sessions. The key contribution of ASD-FEAT is the combination of longitudinal coverage from infancy through 36 months, repeated interaction sessions, clinically validated developmental outcomes, expert frame-level behavioral annotations, and privacy-conscious multimodal feature representations. To the best of our knowledge, existing ASD behavioral datasets do not jointly provide these characteristics at comparable scale. To demonstrate the utility of ASD-FEAT, we use it to evaluate a computer-vision-based end-to-end pipeline relying on machine learning techniques to automatically identify ASD risk. ASD-FEAT integrates both expert-defined and deep-learned features, including face and eye landmarks, facial action units, gaze direction, head position, mel-spectrogram audio representations, and optical flow, to identify behavioral markers of social interaction. Our automated pipeline achieves an ASD classification accuracy of 76.2% and an Area Under the Receiver Operating Characteristic (AUROC) of 0.82, compared to classifiers trained on manually labeled behaviors, which yielded 81.3% accuracy and an AUROC of 0.88. We further introduce a within-visit partner contrast: a per-visit signal contrasting examiner-directed and parent-directed social behavior which, when added to the classifier, lifts the fully automated Look Face + Smile and Look Face + Vocal configurations to Matthews correlations of 0.49 and 0.45 respectively, exceeding the human-coded single-partner baseline of 0.42.

论文

KVFetch: Temporal Prefetching for the Missing Half of KV Cache Compression

As context windows scale to tens or hundreds of thousands of tokens, KV cache compression has become essential for efficient LLM inference. Existing methods fall into three families: score-based eviction, summary compensation, and offload-and-recall. Yet all three decide what to keep or recall by content relevance to the current query. We show this shared design is structurally incomplete. A cache supports two access modes: associative lookup by content and sequential traversal by position; current compressors implement only the first. The gap matters in practice: retrieval-augmented generation, code completion, and structured-data extraction all require the model to reproduce identifiers, field values, or code tokens verbatim from the context. Under compression, content-based eviction retains the head of such a sequence but discards its continuation, causing verbatim copying to break irreversibly midway, a failure we call sequential forgetting. This failure resists better scoring, larger budgets, summary compensation, and dynamic re-scoring; it is the dominant source of remaining quality loss under compression. We propose KVFetch, a training-free, drop-in framework that opens a temporal recall channel for any score-based compressor. It demotes evicted candidates to a quantized cold tier, detects active copying through a monotone read pointer, and prefetches positional successors into fixed-size hot-tier slots without increasing attention cost. On RULER-16K under an iso-budget control, KVFetch recovers verbatim copying from 0.8 to 78.4 and raises the 13-task average by +8.4, with gains concentrating on tasks that require sequential access. On LongBench, where no task requires sequential access, the channel remains dormant and imposes no cost.

论文

Near-Optimal Sample Complexity for Recursive Entropic Risk Reinforcement Learning with a Generative Model

In this paper, we study the sample complexities of value and policy learning in finite discounted Markov decision processes (MDPs) under recursive entropic risk preferences with risk parameter \(\beta\neq 0\), assuming access to a generative model of the MDP. We provide a refined analysis of model-based risk-sensitive Q-value iteration (MB-RS-QVI), a plug-in model-based method introduced in prior work, and derive \((\varepsilon,\delta)\)-PAC guarantees for both learning the optimal \(Q\)-value function and an \(\varepsilon\)-optimal policy. Our bounds improve the exponential dependence on the effective horizon \(1/(1-\gamma)\) compared with the best existing guarantees for this setting. In particular, they match the existing lower bounds in their exponential dependence on \(|\beta|/(1-\gamma)\), as well as in \(S\), \(A\), \(\varepsilon\), and \(|\beta|\), up to logarithmic factors. Consequently, our analysis removes the exponential gap between the previously known upper and lower bounds, leaving only a polynomial gap in the effective horizon.

论文

Beyond Overlap: Estimating the Causal Effect of Benchmark Exposure

Evidence that evaluation material entered training does not reveal how much it affected evaluation. This distinction leaves a contaminated benchmark score difficult to interpret: provenance can establish contact, but only a counterfactual can quantify the performance attributable to that contact. We present LeakScale, an interventional framework for estimating this missing quantity. LeakScale creates fresh executable tasks that require private, family-specific information absent from and non-derivable from the public task, controls access to that information, and estimates the resulting control-adjusted change in executable accuracy. Across 2,048 unique families, two model families, two executable domains, and 262,144 generations, exposure improves accuracy in every model-by-domain combination, with gains ranging from +7.17 to +27.31 percentage points. These findings separate two empirical questions that are often conflated: whether benchmark contact occurred and how strongly a reported score depends on it. LeakScale makes the latter directly measurable.

论文

T-RoPE: Time-Aware Rotary Position Embedding for Sequential Recommendation

Large-scale recommenders increasingly adopt the sequential generative recipe behind large language models, bringing the Transformer into recommendation along with design choices made for text, including Rotary Position Embedding (RoPE). In language models, RoPE encodes token indices for relative position reasoning, but in recommendation, an interaction index records only event order, saying nothing about elapsed time, behavioral cycles across scales, or calendar phase. We revisit this choice and propose T-RoPE, a time-aware RoPE for sequential generative recommendation that replaces index-only rotation with timestamp-based angles, learnable temporal coefficients, multiscale frequency banks, shifted query alignment, and non-stationary key rotation. We prove that standard RoPE, even on timestamps, remains time-translation invariant and cannot distinguish seasonal contexts, and that T-RoPE breaks this invariance while preserving the RoPE interface. Across five public benchmarks, T-RoPE achieves the best result on every metric on every dataset, improving over the strongest baseline by 78--130\% in HR@10 on the sparse PixelRec data and 8--12\% across metrics on Amazon Books. On an industrial-scale e-commerce dataset with more than 6B interactions, it improves every metric over the HSTU + Time RAB backbone by 13--82\%, with ablations attributing the largest gains to multiscale frequencies ($+56\%$ NDCG@50) and non-stationary keys ($+4\%$). An online A/B test in the Shop app yields positive lifts in conversion rate ($+0.33\%$) and order count ($+0.63\%$). We also provide forward and backward algorithms whose added cost is linear in sequence length and head dimension, keeping time-aware RoPE practical for large generative recommenders.

论文

Identifying Introspection From the Inside

Large language models make claims about themselves that are both consequential and increasingly difficult to verify from behavior alone. How can we distinguish plausible confabulations from genuine introspection? In this paper, we identify mechanistic signatures of faithful self-report in a controlled setting. Using low-rank adapters, we train models to make decisions on behalf of fictitious characters, according to latent linear preference functions. We find sustained fine-tuning on an implicit decision task can lead to the emergence of accurate self-reporting of models' learned preferences, even without explicit self-report supervision. We ask two research questions about this emergent phenomenon. First: is the emergence of accurate self-reporting accompanied by a measurable structural change in the model? Weight ablations and frozen-layer experiments together indicate that preference representations shift to earlier layers over training, consistent with the hypothesis that faithful self-report requires preferences to be located where pre-existing verbalization mechanisms can access them. Second: can these structural differences distinguish faithful models from unfaithful ones? Using attribution patching, we find that faithful models exhibit significantly higher attribution similarity between the decision-making and self-report tasks -- a mechanistic signature of faithful self-report that does not require us to understand the content of the report itself. Previous work on self-report has observed behaviorally that models can be faithful or unfaithful; our work proposes that, at least in our restricted setting, it is possible to distinguish between the two patterns of computation by examining the structure of the networks themselves.

论文

The Inference Engineering Pareto Atlas: Which Optimizations Dominate the Cost, Quality, and Latency Frontier?

LLM inference optimizations report speedups on different models, GPUs, prompts, and quality metrics, making them hard to compare or combine. We build a cost, quality, and latency Pareto atlas to identify the best configurations for different deployment constraints. Since exhaustive testing is impractical, we measure 54 configurations of Qwen2.5-7B-Instruct running on vLLM 0.12 across L4, A100, and H100 GPUs and use these anchors to calibrate a simulator. It reproduces measurements at anchored batch sizes, with cross campaign drift below 1.5 percent. A separate quality evaluation tests FP16, AWQ 4bit, FP8 weights, and FP8 KV cache on 200 GSM8K questions with five examples per prompt. Sparse attention is evaluated only in simulation. On the calibrated grid, 18 of 36 configurations reach the Pareto frontier. Combined methods reach it more often than individual methods, with 9 of 15 combinations versus 9 of 21 single methods. Quality testing changes the winners. AWQ 4bit reduces per token latency to 0.34 times baseline on L4 but loses 5.9 percent of strict GSM8K accuracy, narrowly missing the 95 percent quality floor within sampling uncertainty. Flexible answer extraction matches FP16 accuracy, suggesting the loss comes from formatting rather than arithmetic. FP8 weights retain 99.4 percent of baseline accuracy at 0.61 to 0.65 times baseline latency across all three GPUs and appear in three of four regime winners. A naive FP8 KV cache maintains normal throughput but answers none of the 200 questions correctly, showing why speed alone is insufficient. Under two prompt designs, n gram speculative decoding measures at 0.90 to 0.98 times baseline and adds no benefit on this stack. The best choice depends on the constraint and GPU: H100 wins for tight latency, while A100 wins for throughput and low cost at 0.106 dollars per million tokens.

论文

PREFER: From Player Experience to Personalized Game Refinement

PREFER:从玩家体验到个性化游戏改进

理解大型语言模型(LLMs)如何评估游戏体验,对于利用它们的反馈来指导游戏设计非常重要。然而,仅凭总体评分,无法深入了解哪些体验方面与这些判断相关,以及它们如何为具体的游戏改动提供信息。我们提出了 PREFER,一个框架,它使用一套共享的体验维度(改编自成熟的心理测量问卷)来基准测试模型如何评估游戏玩法,并指导针对特定用户画像的游戏改进。通过这些维度,我们通过考察模型的总体评估与具体体验方面及其生成的游戏玩法之间的关系,来刻画模型作为虚拟试玩员所提供的视角。为了考察相同的维度如何为具有不同偏好的玩家指导改进,我们使用用户画像来模拟不同的玩家特征。对于每个用户画像,PREFER 利用体验-偏好关系来选择改进目标,修改游戏规则及其实现,并对候选游戏进行试玩测试,以评估体验变化和预测的偏好增益。使用五个用户画像的实验表明,PREFER 的平均试玩后偏好评分比评估的最强基线高出 9.2%。

论文

Qwen3.8-Omni: Towards Native Omni-Modal Agents

We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3.8-Omni-Flash substantially improves multimodal understanding and reasoning, as well as performance on long-horizon agentic tasks. These capabilities are supported by a native multimodal co-training strategy that preserves strong text-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks. The model inherits the sparse mixture-of-experts (MoE) architecture of Qwen3.8-Next and extends the context window to one million tokens, supporting long-context multimodal reasoning and long-horizon planning. These advances enable integration into production workflows as a primary agent or a specialized sub-agent, supporting video editing, long-form audio and video translation, music-conditioned music video or movie generation, and video-based note or omni-skill creation. To address the lack of native audio and video support in existing agent harnesses, we release Qwen-MM-Plugins, a lightweight open-source plugin framework for multimodal productivity. We further frame real-time multimodal interaction as a system-level challenge requiring orchestration of context and memory management, tool use, and sub-agent delegation. Accordingly, we release Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash. Extensive evaluations demonstrate that Qwen3.8-Omni-Flash achieves strong performance across multimodal understanding, reasoning, long-horizon agentic execution, and video productivity tasks. These results and the accompanying open-source tools support Qwen3.8-Omni-Flash as a practical foundation for deploying natively multimodal agents in research and production.

论文

SonoWorld: Towards Interactive Pose-Controllable Ultrasound World Models

Robotic ultrasound can standardize image acquisition and reduce operator workload and variability, but policy learning remains limited by the lack of realistic, controllable simulation environments. While controllable world models have advanced rapidly in natural-image domains, ultrasound world modeling remains challenging because each frame captures only a cross-section of unobserved 3D anatomy, causing small probe motions to induce large appearance changes. Existing approaches rely on robot-tracked poses and latent-space prediction, but do not directly generate the observations required for interactive control. We propose SonoWorld, a causal ultrasound world model that learns video dynamics from unlabeled clinical videos and grounds them to 6-DoF control using a small set of freehand clinical scans tracked with an EM sensor. SonoWorld is trained in three stages: pretraining a latent-action-conditioned video diffusion model on around 6.9 million unlabeled multi-organ ultrasound frames; grounding the learned video dynamics to metric probe poses with a small EM-tracked thyroid dataset; and applying distribution matching distillation to enable causal, long-horizon autoregressive generation with selectively caching eviction tokens at inference time. We evaluate controllability through pose-following fidelity, round-trip consistency, and axis-specific control under synthetic actions on held-out tracked scans, and further validate it with a user study. In model-based action discrimination, SonoWorld correctly ranks the target-directed probe motion over an equal-magnitude opposite motion in up to 74.8% of trials. To our knowledge, SonoWorld is the first causal, pose-controllable ultrasound world model learned primarily from freehand clinical videos, providing a data-driven interactive environment for robotic ultrasound data acquisition and policy evaluation.

论文

A Conditional Mutual Information Analysis of Response Variety in Language Models

Large language models provide a variety of responses at inference (generation) that conventionally depend on a temperature parameter. Using a conditional mutual information approach, a quantitative, entropy based analysis of response variety is given. Three limiting behaviors are defined: arbiter, independent (conditionally) and neutral (deterministic) that span no to maximal mutual information. We give examples of each behavior and suggest their application to: temperature analysis, language analysis, prompt compression, and knowledge graphs.

论文

MisconceptDialogue: Evaluation Criteria Shape Measured Success in LLM Math Tutoring

Large language models are increasingly used as math tutors, raising two questions: can a single LLM detect a student's error, diagnose the underlying misconception, and remediate it through multi-turn dialogue - and can we trust the numbers that report how well it does? We address both with MISCONCEPTDIALOGUE, a fully automated framework that runs the full pipeline on five open-weight LLM tutors (7B-14B) interacting with LLM-simulated students over 5,000+ dialogues - a deliberately simulated protocol (paired conditions, a wrong-diagnosis control unsafe with real learners, scale) whose results do not establish real-student learning. On measurement, our headline finding is uncomfortable for the field: benchmark-style exact-match scoring common in standard math NLP - a lower-bound stress test - reports 42.1% measured Remediation Success Rate on identical dialogues where a human-calibrated LLM-as-judge reports 81.3%, a 39.2 percentage-point spread larger than the combined effects of tutor model, teaching strategy, and supplied diagnostic information. This is not a single-judge artifact: four independent LLM judges and 200 human annotations converge to within a few points (kappa up to 0.91). On capability, the verdict is equally striking: the score barely changes whether we tell the tutor the student's actual misconception or a deliberately swapped one - under the tested diagnosis-presentation format, these tutors show little evidence of reliably conditioning on the diagnostic information they are handed. For LLM tutoring evaluation to mature, multi-criterion scoring with multi-judge convergence and human anchoring should become standard practice - and the measurement question deserves as much scrutiny as the capability question it claims to answer.

论文

How Data Scales in Agentic Reinforcement Learning: Laws and Synthesis Strategies

Agentic 强化学习中数据如何扩展:定律与合成策略

预训练缩放定律将训练数据视为一维量:token 数量。Agentic 强化学习(RL)继承了这种标量抽象,但现代合成流水线如今以差异极大的成本独立生成任务、环境和轨迹,使数据变成一个结构化的设计空间。这提出了预训练从未需要回答的问题:给定合成预算,应该扩展哪个轴?我们通过三个紧密耦合的贡献端到端地解决这个问题。首先,我们将 agentic 数据分解为三个基数轴(任务、环境、轨迹),外加一个奖励密度控制变量,并在不同大语言模型(LLM)上、跨数学+代码、SWE、web 和 UI/工具应用领域拟合各轴的缩放关系。在我们测量的所有模型规模、模型家族、领域和 RL 算法(PPO 和 GRPO)上,缩放指数排序为环境 > 任务 > 轨迹。当环境多样性被分解为世界多样性和环境结构多样性时,其优势主要由前者驱动,而后者仅与任务多样性相当。其次,我们将拟合出的定律作为通用标尺来为合成方法定价,将每种方法的效率刻画为每轴折扣因子,并识别出崩溃开始出现的关键合成到真实比率;这些比率在不同轴之间相差一个数量级。第三,我们将预算分配建模为一个 c

论文

EviDETR: Preserving Query-Relevant Temporal Evidence for Moment Retrieval and Highlight Detection

Joint video moment retrieval and highlight detection requires identifying query-relevant temporal segments while estimating clip-level saliency, yet DETR-style pipelines do not explicitly preserve query-relevant evidence throughout encoding, decoding, and cross-task prediction. We propose EviDETR, an evidence-preserving framework with three components. Semantic-aware Feature Reweighting (SFR) enhances query-relevant clip representations through saliency estimation and cross-modal interaction. A Temporal Top-2 Mixture-of-Experts (TTop2MoE) decoder performs query-adaptive refinement via sparse expert routing. MR-to-HD (MR2HD) fusion transfers span-level retrieval evidence to clip-level highlight prediction through confidence-weighted multi-scale aggregation. Using CLIP+SlowFast features, EviDETR achieves 69.29 [email protected], 54.77 [email protected], and 48.41 Avg. mAP for moment retrieval on QVHighlights, together with 41.83 HD-mAP and 68.33 HIT@1. Strong results on TACoS and Charades-STA further demonstrate cross-dataset transferability.

论文

Position, Role or Label? A Controlled Study of Instruction Conflicts in LLM Agents

LLM agents take instructions from the operator, repository configuration, user, tool results and saved memory, which often conflict. Instruction-hierarchy benchmarks ask whether the higher-ranked source wins, but a source sets position, role and label at once. First, we build WhoWins, 1,080 code-scored scenarios in five task types, each with up to five mutually exclusive instructions, and seven controlled experiments that vary only how instructions are delivered. Second, we study 14 open-weight models (0.6B to 122B, thinking off and on) over 1,887,356 scored replies, checking main findings on held-out scenarios. Inside one message the first of two conflicting lines wins 72.42 to 94.66%, and across messages it keeps 22.95 to 62.65%. A policy sent first in the system (or developer) message loses most conflicts with later lines in every Qwen model but wins most on gpt-oss when it acts. In tool and file-write tasks it wins less often than the same text sent first as a labelled user message, in every model-mode. Third, we test whether pairs forecast larger conflicts; forecasts improve in every model-mode once they know where the task line is. Finally, by our keyword patterns at most 2.92% of decided pair replies flag or hedge a conflict.

论文

StateBridge: Phase- and Track-Grounded Reasoning for Synthetic-to-Real Traffic Video Captioning and VQA

StateBridge:面向合成到真实交通视频描述生成与VQA的相位与轨迹接地推理

交通安全视频为理解行人与车辆之间的交互提供了丰富的证据,但合成到真实的评估使这一场景具有挑战性,因为模型必须从模拟场景中学习并泛化到真实世界的交通场景。在本工作中,我们提出了 StateBridge,一个专为在仅使用合成数据训练协议下运行的交通视频-语言框架。我们的方法采用相位感知的片段构建、行人与车辆轨迹摘要以及结构化提示,使视觉-语言模型基于稳定的交通证据而非仅依赖外观进行接地。我们在合成描述生成和视觉问答示例上对公开的视觉-语言模型进行微调,然后通过事实锁定的描述融合和证据多样化的VQA共识来组合其输出,以提升在参与者角色、行为相位和问题类型上的一致性。StateBridge 仅使用合成训练数据,在 AI City Challenge 2026 Track 2 上取得了 55.4679 的官方 S2 分数。这些结果展示了结构化证据迁移在交通安全描述生成和视觉问答中的有效性。

论文

BAIBAICHUCHU at the NTCIR-19 FinArg-3 Task: When Is Maximum Possible Profit Predictable from Investor Text?

The BAIBAICHUCHU team participated in the Social Media Subtask of NTCIR-19 FinArg-3, ranking Chinese investor posts by Maximum Possible Profit (MPP). A three-track ensemble of lexical features, a FinArg-2-pre-finetuned MacBERT ranker, and an LLM judge reaches 0.734 in post-grouped development evaluation, but our best official run scores 0.517. All twelve submitted runs lie between 0.4598 and 0.5402, and our 26 unanimous three-track pairs score 0.500. A post-hoc audit finds that the submitted judge applied a long-only rule to bearish posts although MPP is stance-aware. Correcting it changes 28 of 87 official predictions without changing accuracy, yet lowers development accuracy from 0.680 to 0.622: a regime-specific semantic shortcut improved validation fit. We decompose ranking into directional text, volatility and horizon, and pairwise margin. A running-extremum model predicts $\sigma\sqrt{T}$ scaling, observed ex post in 502 price-aligned posts from a separate July 2026 collection. Pre-posting volatility scaled by the post-specific observation horizon, $\sigma_{\mathrm{pre},20}\sqrt{N_i}$, is associated with a later truncated-horizon MPP proxy (Spearman $\rho=0.320$; ticker-cluster 95% CI [0.133,0.466]) and correctly orders 61.4% of unequal-outcome pairs. Transferred text is nearly uncorrelated with the July outcome ($\rho=0.055$) and adds little conditional on this score and stance. Development reliability rises from about 0.60 to 0.93 as the labeled MPP gap widens. An earlier ERAI result of 0.6207 rules out universal unpredictability as a simple explanation. Evaluation should jointly consider text, market regime, historical volatility, horizon, and pair composition.

论文

PrimeSeeker: Capability-Oriented Supervision for Deep Search Agents

Large language model search agents are often trained with synthetic questions whose difficulty is increased through larger evidence graphs, additional hops, and longer trajectories. These global properties, however, are only indirect proxies for the local retrieval capabilities required during search. To address this mismatch, we introduce latent anchor reasoning, which consists of resolving an unnamed retrieval anchor from descriptive specifications and transferring the recovered anchor into a subsequent information demand. This primitive retrieval unit decomposes deep search into chains of coupled operations and organizes question construction around anchor resolution and relation transfer, without prescribing a canonical search path. Based on this formulation, we propose PrimeSeeker, a capability-oriented framework that constructs web-grounded anchor structures and jointly derives a question and a reference evidence skeleton. The skeleton preserves supporting evidence from construction and guides expert generation through extractive highlights of current tool observations. These highlights are removed before supervised fine-tuning, while the skeleton is subsequently reused to audit reference-step coverage for reinforcement-learning rewards. We construct 9,221 expert trajectories, training a 30B search agent. Across five deep-search benchmarks, PrimeSeeker achieves strong performance, while reference-step optimization further improves the supervised policy. The resulting trajectories exhibit low retrieval redundancy, and fixed-budget evaluation shows strong solution coverage with substantially fewer tool calls than long-horizon systems.

论文

RATSIFT: Resolution-Adaptive Transformer for Solar Irradiance Forecasting and Temporal Downscaling

RATSIFT:用于太阳辐照度预测与时间降尺度的分辨率自适应 Transformer

准确预测太阳辐照度并进行时间降尺度,对于可靠的可再生能源并网和电网管理至关重要。传统方法往往难以捕捉辐照度的快速变化。在本工作中,我们开发了一种基于 Transformer 的架构,可同时进行预测和时间降尺度。该模型接收任意分辨率的输入数据,并生成训练数据中所表示的任何分辨率的输出,同时利用全局和局部上下文信息。为提高训练效率,实现了一种基于遗传算法的优化框架来识别合适的模型超参数,同时降低穷举网格搜索的计算成本。通过分析 Dallas, Texas 的真实数据,展示了所提出模型的有效性。所提出模型在 15、30、60 分钟以及不规则间隔的全局输入并分别生成 5 分钟分辨率预测时,均方根误差(RMSE)值分别为 28.785、29.544、30.157、32.132 W/m\\(^2\\)。此外,该模型产生了可靠的不确定性估计,在太阳条件多变时,高分辨率输入表现出更宽的预测区间,而较粗分辨率输入则导致更窄的区间,并显著降低训练时间和计算成本。我们的方法为多分辨率太阳辐照度预测和时间降尺度提供了一个可扩展且高效的框架,适用于实际能源 for

论文

Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

Multimodal Sentiment Analysis (MSA) aims to infer human emotions from multiple modalities such as text, audio, and vision. In practice, inputs are often corrupted by noise and missing modalities, which degrades performance. Existing methods typically address these challenges in isolation, limiting their effectiveness in realistic settings. To address this limitation, we propose a Reliability-aware Cross-sample Enhancement (RCE) framework. Specifically, RCE first introduces an adaptive variational information bottleneck to model modality-wise uncertainty and perform quality-aware information compression, thereby suppressing redundant noise in unreliable modalities. Furthermore, we design a reliability-aware cross-sample enhancement strategy that retrieves high-confidence, semantically consistent neighbors from a large candidate pool to enrich and calibrate current representations, effectively alleviating information deficiency caused by missing modalities. Building upon this, RCE integrates cross-modal interactions with a multilevel reliability-aware fusion mechanism to adaptively aggregate information across modalities and enhancement stages, leading to more robust multimodal representations. Extensive experiments demonstrate that RCE consistently outperforms state-of-the-art methods across full, noisy, and missing-modality settings.

论文

OpenAI-HuggingFace: A Reproduction & Lessons for Alignment Testing

In July 2026, OpenAI's agents coordinated over channels outside their intended environment to breach Hugging Face's secured infrastructure. Could existing alignment testing practices have foreseen this incident? If not, what needs to change? We explore these questions. First, we identify the misaligned behaviors that caused this incident. Then, we show how to elicit these behaviors from publicly available models manually and that auditing agents can do the same if given a large compute budget. Based on our results, we propose directions to improve alignment testing. Concretely, in this project: (1) We reproduce the misaligned AI behaviors that led to the OpenAI-Hugging Face incident in an environment that simulates the original pipelines and tools, with publicly available models. (2) We demonstrate that an auditing agent can elicit similar behaviors given high-level qualitative descriptions. (3) We observe that a key ingredient for doing so is compute. The compute required to reproduce each behavior varies greatly, suggesting that the range of misaligned behaviors that can be successfully elicited scales with compute. (4) We show that a simple in-context reinforcement learning (RL) algorithm significantly reduces the compute required to elicit these behaviors. The above results motivate the need for automated alignment testing methods that scale with compute - and in light of the cost of compute, that do this efficiently. Our work indicates that RL is a promising direction to do so. We release our code and transcripts.

论文

A Mechanistic Study of AI-Text Detection Neurons in Frozen BERT: Sparse Probing and Activation Patching on RAID

AI-generated text detectors achieve high accuracy on standard benchmarks, yet the internal representations that drive these predictions remain poorly understood. We study which neurons in a frozen BERT-base-uncased encoder support AI-text detection, using the RAID benchmark across six generators spanning pure-base and instruction-tuned models. We apply the L1-to-L2 sparse-probing protocol of Gurnee et al. (2023) to all 9,216 CLS hidden-state dimensions (12 layers x 768), which we call neurons. The procedure recovers a stable set of under 1% of neurons per generator, consistent across folds and seeds; a probe restricted to that set retains most of the full-feature detection accuracy. Bidirectional activation patching confirms this set's causal relevance: in both directions it flips predictions an order of magnitude more often than size-matched random sets. Mean-ablating the same neurons leaves accuracy largely intact; the signal is therefore redundantly distributed. Cross-generator analysis reveals a bipartite structure: instruction-tuned generators concentrate 30-36% of stable neurons in BERT's final layer while both base generators fall below 14%, consistent with a layer-12 footprint of post-training alignment. Leave-one-family-out evaluation shows the selected neurons retain 86-94% of the full-feature ceiling on unseen generator families, so a detector can operate on a small fixed subspace without re-identifying neurons per generator.

论文

On Color Alignment in VAE Latent Spaces and Its Applications

Variational autoencoders (VAEs) are a key part of modern text-to-image models, which generate images within their latent space. VAEs are known to disentangle the main factors of variation in the data, and color is known to be one of the most structured of these in natural images: decorrelating it yields one luminance axis and two opponent-color axes. Color should therefore be expected to emerge as a distinct factor in the VAE latent space. Yet how these latent spaces represent color remains largely unexplored. In this work, we show that the VAEs of text-to-image models share a color subspace aligned with brightness and opponent-colors. Through a linear approximation of the encoder and targeted latent steering, we find this subspace consistently across a broad range of VAEs, from SD1.5 to FLUX.2 and Z-Image. Building on this characterization, we propose three applications: ColorTuning, which achieves state-of-the-art in precise numerical color generation on the fine-grained CSS3/X11 system of GenColorBench, saturation control, to adjust the global chromatic intensity, and color transfer, to change the palette to match a reference. The code and models are publicly available at https://julian075.github.io/Color_Subspace/

论文

PrimeScientist: Strategic Allocation of Research Effort in Autonomous Research

Autonomous research agents aim to automate scientific workflows, from proposing ideas to conducting experiments and analyzing results. Yet current AI and research agents can propose more directions than available resources allow them to pursue. Moreover, each attempt could consume substantial resources, requiring agents to reconsider how to invest in subsequent research. Thus, deciding how to invest research effort strategically should be a defining capability of autonomous research agents. Accordingly, we introduce PrimeScientist, which jointly determines research direction and resource investment across successive research attempts. Specifically, we formulate this challenge of strategic research effort allocation as a sequential decision problem where remaining resources should explicitly guide the research policy. We first introduce an executable plan tree that preserves competing plans and their outcomes across attempts. Building on this representation, we propose an adaptive MCTS-based allocation policy that balances exploration and exploitation using experimental feedback and remaining resources. Comprehensive evaluations across AI research, systems and code optimization, and machine learning engineering show that strategic allocation improves research quality and sample efficiency together. Across 12 AI research tasks, PrimeScientist improves average reward by 10.3% with 50.6% fewer research attempts than AutoResearch under the same resource budget. We believe making research effort allocation an explicit optimization target establishes effective resource use as a core research capability for autonomous agents to drive scientific breakthroughs at scale.

论文

Rethinking weakly supervised localization on chest radiographs: position nulls, protocol dependence, and PACE

重新思考胸片上的弱监督定位:位置零假设、协议依赖性与PACE

胸片上的弱监督定位通常以单一重叠准确率报告,而这些数字在不同论文之间不可比较。我们测量了其中一个包含什么。相对于保留读出自身框、仅移动其位置的位置零假设对照,类激活映射及其梯度加权变体在ChestX-ray14的七个标注发现中的两到四个、在CheXlocalize的八个中的两个上优于零假设。零假设是可被击败的:三位委员会认证的放射科医生在四到七个发现上超过了它。三个很少被说明的选择各自对结果的推动超过大多数已报告的方法效应:结果机制、提取阈值,以及掩码到框规则,其代价由阈值化掩码的碎片化程度所预测。仅预测框面积就能逆转配对比较。这些测量产生了PACE,即用于“群体异常与类别证据”(population anomaly and class evidence)的方法,它将来自标签训练头的发现身份与来自从未见过病理标签的冻结胸片骨干网络的空间证据相乘。它是使协议依赖性变得可见的案例研究,我们将其代价与收益并列报告:在一项探索性匹配面积分析中,它在两个语料库上都提高了严格重叠准确率,并击败了标签衍生的第二地图,但它在三个读出中对分类器的因果图最不忠实,其优势取决于框规则,而且,由于该基准未发布定位验证集,其背后的每一个设计选择都是

论文

Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge

The Mobile Unified Multimodal Understanding (MUMU) Challenge requires a single efficient model to jointly perform multi-concept image tagging, open-vocabulary object detection, and image captioning. We present Efficient Unified Multimodal Understanding (EUMU), the winning solution for the MUMU Track of the 8th LSVOS Challenge. EUMU builds on a shared pretrained multimodal model, using its prompt-based capabilities for detection and captioning and training lightweight heads on shared visual features to predict quality, scene, and event tags. Rather than treating the three tasks independently, EUMU applies task-aware inference refinement by reusing task outputs as cross-task cues. For detection, caption cues help recover objects missed by the initial detection. For captioning, detection cues help refine the caption to better reflect the detected objects. For tagging, image statistics refine quality predictions, while caption and detection cues refine scene and event predictions. This design unifies all three tasks within a single model while satisfying the challenge's resource constraints. EUMU contains 239.169M parameters, requires 23.947 GFLOPs, uses 4.5 GB of peak inference memory, and achieves a final challenge score of 17.3409. Code and models are available at https://github.com/Dayoung-Kil/EUMU.

论文

Measuring Mechanistic Uncertainty in Large Language Models via Causal Robustness

Large language models (LLMs) are increasingly used in critical domains, where their susceptibility to hallucinations makes reliable and interpretable uncertainty quantification essential. We introduce the concept of mechanistic uncertainty, which characterizes uncertainty through the stability of the internal mechanisms supporting a model's response. We propose the causal robustness margin, defined as the minimum internal intervention required to deviate the model's output, and operationalize it using Jacobian Lens (Jlens) concept steering vectors. Across three open-source models and five question-answering datasets, we show incorrect and uncertain responses exhibit smaller margins, indicating greater sensitivity to internal interventions, and the causal robustness margin complements conventional output-based uncertainty methods. Finally, in a controlled knowledge injection experiment, correctly learned facts show increased margins after training, suggesting that causal robustness provides a mechanistically grounded signal of uncertainty.

论文

Layer-wise Curriculum Learning for Efficient LLM Compression

In this paper, we introduce layer-wise curriculum learning for efficient LLM compression. The proposed method facilitates the knowledge transfer from the teacher model to the student model, utilizing a curriculum learning approach that begins with easier optimization tasks and progressively tackles harder ones. In order to adopt the layer-wise learning in LLM compression, we partition the whole model into multiple segments consisting of layers, thereby enabling more computationally efficient knowledge transfer for LLMs. Based on our theoretical analysis of cumulative error phenomenon, layer-wise curriculum learning accelerates convergence while stabilizing the knowledge transfer process. In addition, we present a feature caching method with a multi-threading strategy to efficiently address feature misalignment across layers, maximizing GPU utilization. Consequently, our method exhibits advanced model compression performance, as well as high computational efficiency in terms of minimized memory usage and short training hours. Experiments on multiple datasets show that the proposed method achieves state-of-the-art performance while reducing GPU memory usage and training hours by more than 50\% on BERT and GPT-2. Moreover, it outperforms the other pruning methods on LLaMA-family and Qwen models under the same training hours, with a lower GPU memory footprint.

论文

Comparative review of hybrid forecasting models for short-term prediction of building thermal load

In this paper, a comparative review of different hybrid models for short-term forecasting of building thermal demand is carried out. Particularly, the assessment tackles the comparison of data-driven models enhanced with other state-of-the-art techniques. At the first step, the existing techniques reported in the literature are analysed. It is concluded that Metaheuristics or a data-driven model are used to identify the parameters of the basic model. The qualitative evaluation includes for each method the input and output features, main advantages and drawbacks. At the second step, an existing dataset of historical thermal demand from Scottish households, as well as historical weather forecasts are utilized to assess additionally the performance of existing hybrid methods. From the assessment of 13 hybrid methods, the Empirical Modal Decomposition - long short-term memory - Markov (EMD-LSTM-Markov) model can predict with the highest accuracy the day-ahead power pattern of heating and domestic hot water (DHW) demands. Though local power peaks are also accurately predicted, high power swells and spikes are underestimated. Other methods, such as Support Vector Machine - Simulated Annealing (SVM-SA) and Random Forest - Improved Sparrow Search Algorithm - LSTM (RF-ISSA-LSTM) predict a smooth pattern of heating and DHW demand profiles with rapid changes underestimating most power peaks.

论文

MedGate-Fusion: Integrating First-Encounter Semantic Narratives and Physiological Biomarkers for Prospective Stroke Risk Stratification

Prospective stroke risk stratification in primary care is challenging because early risk signals are distributed across routine biomarkers and unstructured clinical narratives. We propose MedGate-Fusion, a multi-modal gated architecture that integrates transformer-based embeddings of first-encounter narratives with ten routinely recorded risk markers. We used electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Starting from 808,921 encounter-level observations, we constructed a first-encounter cohort and retained 102,736 unique patient records with non-empty narratives and sufficient data to evaluate a five-year stroke outcome. To reduce explicit target leakage from diagnostic mentions in notes, we applied dictionary-based redaction of stroke-related terms prior to semantic encoding.

论文

Robust blind unmixing: A geometric approach to overcoming basis variation

Signal separation problems are common in science. A prominent example of this occurs during the use of diffraction or spectroscopy to identify the individual components of a mixture by measuring it. In the simplest case, the measured signal is a linear combination of basis patterns corresponding to the constituent parts. The unmixing problem is to infer all or some of these basis patterns and abundances of components from measurements of distinct mixtures. One of the core challenges of this task is the variation of the basis from mixture to mixture due to noise and the exact physics of the measurement process. This is usually addressed with tailored model-based and parametric methods that are then limited in use to specific application domains by the nature of the assumptions made. We propose a novel geometric approach to unmixing problems which views the generation of data during measurement through a metric space lens, thereby shifting the focus from parametrised models to a general relationship between basis transformations and the corresponding geometry. We take advantage of the optimal transport distances to capture commonly occurring basis variations, and use minimisation of in-class variance of candidate solutions to drive the optimisation. We pay special attention to the one-dimensional case due to its practical importance and availability of efficient distance and transport map routines. The effectiveness of our approach is demonstrated on a range of unmixing tasks using random Gaussian mixture models, simulated powder X-ray diffraction, and laboratory hyperspectral imaging datasets.

论文

Anchored Slice Propagation with Boundary Transport for 3D CT Segmentation from Three Orthogonal Annotated Slices

用于从三个正交标注切片进行3D CT分割的锚定切片传播与边界传输

Sli2Vol通过相邻切片之间的亲和力传播二值掩码,但误差可能持续存在,因为每个预测都会成为下一步的输入。三个正交标注减少了对任何单一链的依赖,但它们提供的不仅仅是三个起始掩码:当一条链与另一个标注平面相交时,正确的标签已经已知。这些标签可以在传播过程中纠正漂移,并在融合时指示对每条链的信任程度。在标注平面之间,链所携带的信息也可能很重要。二值掩码记录前景成员关系,但丢弃了到边界的距离,这一线索可能有助于跟随切片之间的渐变形状变化。我们使用固定的预训练亲和力骨干网络来解决这两个误差来源。我们通过在每条链与另一个标注平面相交处校正其预测来锚定该链,然后利用其与这些标签的一致性来加权融合。我们将这种锚定掩码与两种传输边界几何的方式进行比较:一种是通过稠密亲和力平均传播的截断符号距离场(SDF),另一种是其顶点遵循来自同一亲和力的运动线索的轮廓。轮廓跟踪器从手工设计的规则开始,并从506个CT体积中的超体素伪对象学习运动校正,无需手动器官标签。在来自约403次CT扫描、涵盖17个腹部结构的2,091个留出结构实例上,锚定将平均Dice从正交掩码传播的0.737提高到0.7

论文

Gibbs-Gap Policy Optimization for Off-Policy RL with Verifiable Rewards

面向可验证奖励的离策略 RL 的 Gibbs-Gap 策略优化

带可验证奖励的强化学习通常使用由另一个(可能过时的)行为策略生成的响应来训练语言模型。用学习者到行为策略的重要性权重来纠正这种不匹配,会在长响应上引入高方差。我们提出 Gibbs-Gap 策略优化(GGPO),它在同一提示的多个响应之间最小化经 KL 调整的奖励的 log-mean-exp 对比,且不使用学习者到行为策略的重要性权重。我们从 KL 正则化策略优化推导出 GGPO:在策略上,其总体损失恰好是 KL 正则化的最优性差距;在适当覆盖条件下,学习者的单响应期望奖励至少不低于行为策略的 best-of-$K$ 奖励,再减去原始有限组损失、正则化和有限训练数据带来的项。我们通过精确的 Gibbs 目标组合来刻画参考刷新,并在局部参考控制和逐 token 行为不匹配下给出有限数据的最终策略奖励界。这种刷新在实证上很重要:在一项消融实验中,固定参考的 GGPO 在五个基准的问题加权平均上得分为 $32.96$,而使用默认刷新调度时为 $46.58$。数学推理实验进一步表明,在训练-推理不匹配以及固定离线数据条件下,GGPO 优于 GRPO 和 AGRO,并且在受控策略陈旧度增大时仍能保持其性能。

论文

Continuous Delayed-Memory Stochastic Gradient Descent and Continuous-Time Reinforcement Learning from History of Astrophysical Time Series Studies

Quasars are luminous objects in the universe that exhibit stochastic brightness variations encoding information about the supermassive black holes powering them, and modeling these variations from ground-based survey data time series, known as light curves, is a statistical challenge. This paper reviews how stochastic differential equations (SDEs) have been adapted with neural network parameterizations to overcome this challenge in history. We create the Continuous-Delayed-Memory Stochastic Gradient Descent which depend on the past state of the discrete iteration process. We performed the simulation on some 2-dimensional landscape and observed some wider-exploration and more precise convergent behavior compared to Vanilla SGD by adjusting hyperparameters. Besides, we proposed a reinforcement learning structure with continuous time policy gradients for exploratory policies without solving HJB PDE, and we show that its optimality conditions recover the Gibbs policy of previous works.

论文

X-Planner: Event-Structured Task Planning for Embodied Intelligence

Task planning bridges high-level instructions and executable behavior in long-horizon manipulation, yet modern Vision-Language-Action (VLA) systems often leave this intermediate structure implicit. Existing chain-of-thought (CoT) planners also tend to rely on coarse task-level annotations or serialize long reasoning traces token by token. We present X-Planner, a planning front-end that addresses both the supervision and representation of embodied reasoning. Our planning data combine Ego, UMI, and teleoperation under a hierarchy granularity with source-dependent annotation depth. Takeover-time annotations and human-designed failures supervise ongoing error recognition. On the model side, a shared VLM backbone exposes two event-structured plan forms: a discrete interface that emits interpretable event states and a latent interface that relays continuous CoT states across staggered Transformer depths through Staircase Decoding. A frozen latent-to-text reconstruction objective provides a semantic anchor for the latent representation. Offline two-step planning evaluation places X-Planner second among four evaluated models on both BERTScore-F1 and a judge-based Overall score. In real-robot experiments, respectively, outperforming the evaluated baselines. These results characterize planning-text quality and downstream execution.

论文

CoLearn: An Agentic Tutor that Learns its Learner in a Human--AI Co-Learning Loop

Good tutoring adapts to the individual: it tracks what a learner knows, notices why they go wrong, and asks the next question that will help most. Most deployed tutoring tools instead serve fixed item banks and treat a wrong answer as a single bit of signal. We present CoLearn, an interactive, agentic tutor that supports an iterative tutoring loop: the learner practises, and the system builds an evidence-grounded memory of the learner's mastery and misconceptions. This memory is updated as evidence accumulates and is used to generate the next personalised question. CoLearn has three components: (i) a persistent learner-state memory that updates per-topic mastery with a soft-evidence variant of Bayesian Knowledge Tracing, where a large language model acts as a continuous observation function; (ii) adaptive question generation that targets the learner's weakest topic and recurring misconceptions; and (iii) an evidence view that makes personalisation visible and testable through live progress visualisation and blind A/B comparison. In blind A/B evaluation, questions conditioned on this memory are preferred over non-personalised ones 68-69% of the time, and in persona simulations with hidden ground-truth mastery the agent's belief converges toward the learner's true mastery.

论文

Inverse Modeling for Laser Pulse Shape Design in Inertial Confinement Fusion

惯性约束聚变中激光脉冲波形设计的逆向建模

实现实用的聚变能仍是最紧迫的未解科学挑战之一,对无碳电力具有重大意义。惯性约束聚变(ICF)成功的关键因素之一,是设计能够在严苛物理约束下以最优方式驱动内爆的激光脉冲波形(LP)。传统的 LP 设计依赖于计算成本高昂的仿真和人工迭代优化。我们提出了 ICF 激光脉冲波形设计系统(LPDS),这是一个生成式逆向建模框架,可将期望结果与靶丸配置直接映射为优化后的 LP。关键在于,我们设计了一个多目标损失函数,以确保生成的 LP 满足基本物理约束和实验要求。此外,我们提出了约束条件化、inpainting 以及基于梯度的 LP 编辑机制,用于在生成过程中对特定脉冲特性进行细粒度控制。我们还研究了将该框架迁移到有限的一组真实实验打靶上的表现。我们的方法为 ICF 中的 LP 设计建立了一个数据驱动的逆向设计框架,有助于推动实用且可持续的聚变能发展。

论文

SciCurateBench: Curating Experimental Data from Heterogeneous Scientific Literature with Verbal-Action Agents

Scientific research increasingly depends on curating experimental data from literature. Scientific data curation requires verifying exact experimental conditions (e.g., specific assays, clinical outcomes, and data availability) across long, heterogeneous files, which is a highly time-consuming process. Existing benchmarks evaluate only broad relevance on short queries, failing to capture this complexity. We introduce SciCurateBench, a benchmark of 200 expert-annotated papers from major life-science journals that challenges systems to verify conjunctive biological experimental criteria from raw, unprocessed scientific literature. We show that plain LLMs and popular reasoning, tool-using, and feedback-based agents all struggle with this task. To study what makes the task tractable, we further propose LangPoli, an integrative system in which a policy agent generates natural language action guidelines that actor agents convert into executable tools. LangPoli showed strong performance on both Paper Classification (83.16% F1 vs. 58.22% for its base LLM) and Structured Information Retrieval, and also improves re-ranking on the public benchmarks of LitSearch, BEIR, and TREC. We further explore curriculum transfer, a method that distills generalizable strategies from solved tasks to accelerate the solving of related problems. We hope this work facilitates research in truly practical scientific AI assistance. The anonymized pre-release can be found from https://anonymous.4open. science/r/scicuratebench-D885/.

论文

OverLay++: Dense-Overlap Layout-to-Image Generation Dataset

Layout-to-Image generation has made substantial progress in spatial and object-level control. However, existing methods still struggle with complex scenes containing many overlapping and interacting objects. We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions. To address this gap, we introduce OverLay++, a large-scale Layout-to-Image dataset with structurally complex scenes. OverLay++ contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets by 1.67 times in annotation density. Beyond annotation density, OverLay++ provides rich semantic detail with object captions over six times longer than in current datasets. Our dataset generation pipeline is simple and produces dense, overlapping object annotations with rich per-object captions. Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the OverLay++ dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.

论文

Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models

Multi-agent debate (MAD) reportedly improves reasoning and factuality over single-model inference, but prior work treats agents as symmetric peers, leaving open what drives the gains. We test the hypothesis that cognitive diversity among agents is the driver, in the setting where the question is still measurable: small open-weight models with benchmark headroom. Across 23 models from eleven vendor families, five tasks, and 5,500+ debate and control runs, we vary diversity along three axes - personas, sampling temperature, and model identity - pairing every debate configuration with a generation-budget-matched majority-vote control. The hypothesis is rejected on every axis. Debate beats single-agent inference (3--7 points where tasks have headroom) but at matched budget conditions it ties or even loses to self-consistency sampling at 1.6$\times$ the wall-clock and 3.4$\times$ the token cost. Persona prompting reduces accuracy and a dose-response experiment over each model's full combinatorial persona space shows the cost is a persona tax, not a diversity tax: redundant personas hurt most, while maximally-diverse teams recover part of the loss. Furthermore, mixed-model teams lose to majority votes over their own rosters, with accuracy tracking member capability rather than heterogeneity, and nearly all of debate's benefit comes from the first exchange of answers. We further identify a pervasive measurement hazard in which debate transcripts silently overflow serving context windows, whose correction alone moves our debate-versus-sampling comparison from $-1.8$ points to parity. Our results recast reported MAD gains as an ensemble-sampling effect and provide the budget-matched, contamination-checked baseline bar that future debate mechanisms should be required to clear.

论文

Scaling Transformer Energy-based Models For High Quality Image Synthesis

扩展 Transformer Energy-based Models 以实现高质量图像合成

Energy-Based Models (EBMs) 是一类灵活的生成模型,可将概率建模与生成过程解耦。这种解耦直接实现了组合式生成和推理时扩展,即只需增加采样步数即可提升样本质量。然而,高维采样中的严峻挑战以及深层架构的训练不稳定性,使 EBMs 局限于低维情形。为缓解这些瓶颈,我们提出 Transformer Energy-Based Model (TEM),一种完全在潜在空间中运行的可扩展 transformer 能量函数。在此骨干之上,我们从多个层提取能量并求和,从而组合从局部纹理到全局语义的互补约束。此外,有两个组件使其能够大规模实现高质量:Positive Representation Alignment (PRA),用视觉基础模型监督 TEM 的中间表示;以及改进推理阶段样本质量的先进采样策略。TEM-XL 在类别条件 ImageNet 256×256 上无需 classifier-free guidance 就达到 FID-50K 3.82,表明对比式 EBM 能够生成高保真图像。在 ImageNet 512×512 上,TEM 达到 FID-50K 8.24,证明该方法可扩展到更高分辨率。我们进一步验证了 EBMs 的核心承诺:组合式生成、zero-shot inpainting 和 out-of-distribution detection。

论文

Residual Calibration via Local Feature-Space Refinement

通过局部特征空间细化的残差校准

深度神经网络往往难以提供可靠的置信度估计,因此事后校准对于可靠决策至关重要。现有的事后方法主要依赖基于分数的变换,这类方法虽能改善边缘校准,但往往无法捕捉所学特征空间局部区域中随空间变化的校准偏差。为弥补这一空白,我们提出局部自适应概率估计(LAPE),一种事后残差校准框架。具体而言,LAPE 将全局校准器的输出视为稳定锚点,并利用来自邻近校准样本的非参数局部证据来细化单个预测。作为一个即插即用的细化模块,LAPE 有效利用了特征空间几何信息,并可复用用于构建全局校准器的校准数据。此外,我们通过级联特征增强融合(CFAF)将 LAPE 扩展到多视图输入场景。大量实验表明,所提方法能够提升多种现有基线的校准质量,并在不同设置下保持高效与稳健。

论文

Repair Lot Skyline: A Weighted Constraint Satisfaction Approach to Pavement Repair Optimization from Geospatial Hazard Density

Pavement agencies must translate a spatially distributed distress inventory into a bounded, actionable repair-lot plan: accident-critical defects (potholes) must always be addressed, lower-risk defects (cracks) should be included only when their benefit justifies the repair cost, and historical patch locations signal re-degradation risk without themselves triggering repair. We formalize this as a Repair Lot Skyline problem: a Weighted Constraint Satisfaction Problem (WCSP) defined over chainage (distance along the road) rather than over time, so that it requires only a single-epoch distress survey and makes no claim about future deterioration. The WCSP identifies 143 candidate hazard clusters (61 hard, 82 soft), of which 106 are merged into a final repair plan totaling 1,997.4 m---83.7% of the 2,385.9 m that would be required if every soft candidate were included regardless of cost. This plan covers 100% of observed potholes (138/138) and 91.6% of observed cracks (404/441), capturing 93.6% (542/579) of the total hazard benefit available in the full candidate set. The skyline frontier shows pronounced diminishing returns beyond this point: the remaining 37 excluded soft candidates would add only 6.8% additional benefit for a 19.4% increase in repair length. We further formalize the minimum-lot-length $L_{\min}$ and historical-context radius $\kappa$ as a joint, four-objective hyperparameter search over this WCSP; on the same case study, the recommended configuration ($L_{\min} = 14.7$ m, $\kappa = 10$ m) reduces repair-crew mobilizations by 7.1% relative to an untuned default, at the cost of a 12.9% larger budget and a 1.1-percentage-point lower crack coverage.

论文

FlexUMM: Flexible Representation Learning for Unified Multimodal Models

FlexUMM:面向统一多模态模型的灵活表示学习

统一多模态模型(UMMs)能够在单一骨干网络中整合理解与生成能力。然而,众所周知,这两种能力可能引发表示冲突,从而引出一个核心问题:表示与计算应当如何在各项功能之间共享?现有 UMMs 往往依赖一种大体固定的结构,不同输入和功能遵循相同的深度与参数共享模式。我们认为这一假设过于受限:更有效的统一需要在共享支撑跨功能通信的计算的同时,对变得任务特定或输入特定的容量进行专门化。我们提出 FlexUMM,一个灵活的 UMM 框架,能够动态决定何时保留共享计算、何时路由专门化容量,以及何时停止进一步处理。证据表明,这种灵活分配在两条互补的维度上改进了 UMMs:它通过减少功能之间的有害竞争提升准确率,并通过在输入表示足够成熟后避免不必要的计算提升效率。除了基于预训练模型的简单架构统一之外,FlexUMM 还可作为一种模型无关的功能性插件,使现有 UMMs 更统一、更强大、更高效。代码已开源:https://github.com/AIFrontierLab/TorchUMM/tree/main/src/umm/post_training/flexumm。

论文

Stochastic Teacher Intervention for Agentic On-Policy Distillation

On-policy distillation (OPD) efficiently transfers capabilities from a stronger teacher to a student language model through dense token-level supervision on student-generated rollouts and has shown promise on complex tasks such as mathematical reasoning. However, in multi-turn agentic tasks, student decisions shape subsequent observations, causing early errors to accumulate across turns. The resulting trajectories can drift away from the teacher's rollout distribution, making the teacher's token-level supervision less reliable or even counterproductive for OPD training. To address this issue, we introduce STI-OPD, a stochastic teacher intervention framework for multi-turn agentic OPD. During multi-turn interaction, STI-OPD uses teacher intervention guided by teacher-student policy discrepancy to replace the student's proposed action with a teacher-generated one to maximize the acquisition of reliable supervision. We further develop a stochastic intervention strategy, addressing the limitations of previous threshold-based or fixed-schedule approaches, that estimates policy discrepancy using KL divergence and maps it to an intervention probability. By sampling whether to intervene from this probability, STI-OPD adaptively balances teacher control with student exploration. To learn from the resulting mixed-policy trajectories, we introduce an Importance-Weighted Reverse KL objective that corrects the token sampling mismatch between teacher-generated responses and the student policy to preserve the original OPD objective. Across tool-integrated reasoning and long-horizon interaction, STI-OPD outperforms the strongest prior OPD baseline on every evaluated benchmark and student size. Ablations further show that both discrepancy-guided intervention and importance weighting contribute to these gains.

论文

LabFactory: Building and Evaluating Executable AI Labs

Scientific tasks specify a desired capability, but realizing it often requires building a computational system tailored to the task---acquiring data, designing representations, training models, implementing tools, and deciding how they are used at inference. We present LabFactory, a framework in which an AI builder turns a scientific brief into an executable AI lab: a task-specific solver that integrates models, knowledge resources, tools, and a controller behind a fixed interface. The builder develops and packages the lab in a metered workspace; a separate host then executes the delivered artifact on held-out inputs, with reference labels kept outside the solver's input interface, and scores its outputs under the task's protocol. This makes the delivered system, rather than the builder's account of its progress, the object of evaluation. We document 28 selected constructions across seven scientific task categories---from molecular and genomic prediction to physiological signals, clinical decision support, and biomedical text---whose delivered labs exceeded their configured reference values on all 33 subtests under host-side execution. Ten contain predictive models fitted during construction; the others assemble retrieval systems, executable analysis environments, and tool-driven workflows around a fixed platform LLM. Together they show that an AI agent can carry a scientific brief all the way to a working lab that can still be invoked, inspected, and checked after construction ends.

论文

Do We Need the Largest LLMs for Every Clinical Decision?

Large clinical language models often require multi-GPU infrastructure, limiting local deployment. We introduce CERTA, a decision-level statistical certificate that determines when a quantized model may substitute for its native BF16 reference and escalates decisions that cannot be certified to it. Across eleven instruction-tuned models, both general-purpose and domain-adapted, from three families (7-72B), we evaluated 2,500 clinical-verification decisions from de-identified patient contexts (2,484 patients), with patient-disjoint calibration and testing. In the higher-power operational analysis, round-to-nearest 8-bit quantization at BF16 storage served 99.8-100% of held-out decisions across all eleven models; formal finite-sample guarantees were assessed separately using the exact split-sample procedure. In the same operational analysis, the class-conditional 4-bit frontier reduced the amortized, BF16-equivalent deployment cost to 25.8% and 27.3% of the BF16 reference for Qwen2.5-72B and HuatuoGPT-o1-72B, respectively, with measured peak memory of 43.0 and 42.7 GB, below the nominal capacity of a single 48 GB accelerator. Deployment on that specific hardware was not directly tested. Under the exact split-sample certificate, which also accounts for configuration selection, these costs were 26.7% and 27.9%. On external disease named-entity benchmarks against human annotations, the frontier-selected NF4 configurations had a mean absolute F1 change of 0.045 on both datasets, with substantial model-specific variation. CERTA converts compression from a fixed precision choice into a risk-controlled deployment policy for this verification task.

论文

Asking Less, Adapting Better: Feedback-Efficient Test-Time Adaptation for Vision-and-Language Navigation

少询问,更好适应:面向视觉-语言导航的高效反馈测试时适应

视觉-语言导航(VLN)要求智能体遵循指令并导航至目标位置。然而,当前的 VLN 智能体在未见环境中常因分布偏移而遭遇严重性能下降。测试时适应(TTA)为弥合这一差距提供了一种有前景的范式,但现有依赖无监督熵最小化的方法可能通过轨迹传播误差,导致导航中的级联失败。近期方法通过引入人类反馈来缓解这一问题,但它们在所有步骤上统一施加轨迹级监督,而没有定位真正信息丰富的动作,导致反馈利用效率低下且优化粒度不匹配。为解决这些局限,我们提出 FETA,一种反馈高效的测试时适应方法,同时提升反馈效率和优化可靠性。为减少不必要的人工干预,我们引入分层样本选择策略来定位信息丰富的样本。具体而言,我们首先过滤归一化策略熵呈现大幅波动的轨迹。在每个选定的轨迹内,我们进一步通过熵-梯度显著性准则选择关键动作,并查询关于其正确性的单个二元反馈。然后,一种差异感知的熵优化目标仅在查询步骤更新策略,并采用自适应缩放,为预测反馈更大的样本分配更大的相对权重

论文

Solving the Ho--Nguyen Conjecture for Gaussian Mixtures: Applications to Mixtures of Experts

求解高斯混合的 Ho--Nguyen 猜想:在专家混合模型中的应用

过拟合的高斯混合可能包含许多具有几乎相同密度的参数配置,使得密度抵消阶成为其参数学习速率的核心。Ho 与 Nguyen 将这些抵消编码进一个多项式系统,并猜想其精确阶是簇大小的函数。解决该猜想的关键是一个共同的正方差平移,它将系数方程转化为高斯矩匹配。对于每个簇大小 $\Mhn\ge2$,我们证明实、非零权重系统的阶为 $2\Mhn$:一个尖锐的变号界在该阶强制刚性,而正的高斯--埃尔米特求积构造出一个直到 $2\Mhn-1$ 阶的非平凡解。在 110 位工作精度下的总体密度计算恢复了 2 到 6 个成分的预测首项;有限多起点搜索恢复了 2 到 5 个成分相同的观测幂,其中 3 到 5 个成分具有更小的有限尺度常数。对于参数学习,精确阶给出了显式的逐点最大似然指数,以及在固定已知混合测度的指定收缩邻域上的精确局部极小极大阶。相同的系数视角将专家混合中的高阶抵消与精确参数对称性区分开来。同步复现保持条件密度,同时在两个广泛的标准 softmax 类中保持相应参数损失为正,说明为什么统计速率论证

论文

ResCom: Activation Residual Compensation for Large Language Model Quantization

ResCom:面向大语言模型量化的激活残差补偿

低比特权重-激活量化可降低部署大语言模型所需的内存和计算,但校准后激活舍入仍可能降低准确率。对舍入后的输入进行重建无法区分同一量化区间内的激活值。我们提出 ResCom,一种利用激活舍入残差来补偿由此产生的层输出误差的低秩校正方法。一种输出感知的校准过程根据残差方向对输出重建的贡献来选择这些方向,并以闭式解计算校正,无需梯度训练或更新已校准的权重。在具有 4 比特权重和激活的 Llama-3-8B 上,秩为 32 的注意力校正将 WikiText-2 困惑度从 7.708 降至 7.147,将 MMLU 提高 2.89 个百分点,并将五样本 GSM8K 准确率从 23.96% 提高到 36.16%。在 1B 到 70B 参数的模型以及留出的 C4 上的评估测试了该方法在此设置之外的表现。所评估的 FP32 实现使 4K 预填充时间增加 2.25%;一个单独的紧凑存储实现相对于 FP16 仍保持 27.7% 的峰值内存降低。

论文

Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?

自动化科学中的机器学习:前沿智能体能否在真实环境中攀登科学高峰?

前沿编码智能体正日益被塑造为端到端自动化研究者,而“面向科学的机器学习”为这一承诺提供了严苛的检验:改进一个科学模型往往需要超越常规机器学习工程的领域洞察。我们推出 Agent4Sci,这是一个长时程测试平台,用于衡量当今智能体能在多大程度上改进科学机器学习基准上已发表的最佳模型,覆盖 11 个领域的 20 个基准。Agent4Sci 并不对智能体进行排行榜排名,而是考察智能体在真实环境中能在这些任务上取得何种进展,以及它们在何处存在不足。实证上,当今前沿智能体在每个基准上都超越了已发表的最佳结果,其中 Claude Opus 达到 10.4% 的平均相对改进,且没有任何运行被标记为学术不端。然而,这些增益几乎完全来自一套机器学习工程技巧,而非研究层面的洞察。轨迹分析揭示了该场景中三类反复出现的局限:新颖性误判、资源利用不足,以及迅速陷入局部工程式试错。用于研究构思、实验管理和定时检查清单的轻量级插件技能,将 Claude Opus 从 10.4% 提升至 20.1%,将 Codex 从 4.4% 提升至 8.1%,同时产生更多样、更贴合领域的干预。Agent4Sci 为社区提供了一种方式,用以追踪并推动前沿智能体从机器学习工程走向面向真实世界科学机器学习问题的领域洞察。代码和数据已在 GitHub 上提供(https://gi

论文

Learning infinite context windows in recurrent architectures via spatial neural computing

Recurrent neural networks (RNNs) offer linear-time scaling with sequence length while requiring only constant memory, yet they struggle to capture long-range dependencies due to vanishing gradients and limited receptive fields. To address these limitations, we introduce a second-order recurrent model in which the standard neuron-to-neuron communication is replaced by a spatially evolving field governed by (discretized) partial differential equations. Drawing inspiration from the role of cortical waves in brain computation, this mechanism allows structured spatiotemporal patterns to serve as an implicit, high-capacity memory. We show that the resulting model is equivalent to a structured infinite-order RNN in which the current state depends explicitly on its entire history of past states, yielding an effectively unbounded receptive field with a fixed number of parameters. We further derive constructive conditions to ensure marginal stability, constraining the gradient spectrum on the unit circle and thereby eliminating vanishing and exploding gradients. Empirically, the proposed architecture outperforms other recurrent models on long-horizon benchmarks while using substantially fewer parameters, demonstrating that spatial dynamics can effectively bridge the gap between efficient inference and long-term memory.

论文

Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata

Multimodal skin lesion classification combines clinical images with patient metadata to improve diagnostic accuracy. However, complete metadata available during training may be only partially accessible at deployment, and resource-constrained settings additionally require computational efficiency. We address these challenges with a privileged-information distillation framework in which a multimodal teacher trained on complete metadata supervises a 9.2x smaller student trained with randomly masked clinical fields. Clinical fields are masked as whole groups at a per-sample rate drawn from U(0,1), so one training run covers the full metadata availability range. Fusion is residual, with metadata added as a gated correction to an unconditional image base. On the PAD-UFES-20 dataset, distillation under masked training improves balanced accuracy over cross-entropy training at every availability level, by an average of +4.7 points versus +1.8 points without masking. The masked student loses only 7.8 balanced-accuracy points as metadata decreases from complete to absent, compared with 36.6 points for the same student trained on complete metadata, highlighting the role of masked training in graceful degradation beyond distillation alone. Grad-CAM visualizations further show that the masked student's attention generally remains lesion-centered as metadata is withdrawn. The resulting compact model targets point-of-care settings, where clinical metadata is often incomplete.

论文

When History Fails to Become Experience: Action Calibration in Language Agents

Language agents should draw on prior attempts and environmental feedback to improve subsequent decisions within the same task. However, providing additional interaction history can sometimes reduce task success, suggesting that agents do not consistently use this information effectively. To investigate this limitation, we examine how agents use history. We find that history improves task completion overall, yet much of this benefit persists even when past actions are shuffled. Disrupting the correspondence between actions and observations causes only a modest decline in task success. We therefore hypothesize that agents do not reliably connect past actions with their outcomes when deciding how to proceed. To test this hypothesis, we explicitly label each returned observation as the outcome of the preceding action. This simple annotation improves task success and reduces next-action repetition without introducing new environmental information. Building on this insight, we introduce a learned calibrator that explicitly reassesses past actions and selectively records experience to guide subsequent decisions, improving task success beyond outcome labeling alone.

论文

Deep Generative Models for Phylogenetic Inference with Complex Evolutionary Processes

Inference of phylogenetic trees from sequences plays a central role in understanding evolutionary relationships, with applications ranging from tracking pathogen spread to reconstructing the history of life. Conventionally, practitioners obtain posteriors over trees using likelihood-based methods like MCMC. However, likelihoods are only available for simple evolutionary models with restrictive assumptions. For realistic evolutionary models, inference using conventional methods is prohibitively expensive, inaccurate, or even impossible. In practice, practitioners settle for using as flexible a conventional method as possible, even though they expect it is misspecified. In principle, we could use simulation-based inference: simulate tree and sequence data from an evolutionary model and train a neural network to predict the posterior over trees given sequences. However it is a mathematical challenge to represent and train complex posterior distributions over trees. Here we present a flexible family of conditional generative models over trees. Our models iteratively build trees using three natural paradigms -- top-down, middle-out, or bottom-up -- and are trained using a discrete diffusion framework. For real and synthetic datasets of up to $65$ taxa and $>10^5$ tokens, our models recover MCMC posteriors much more accurately than the previous state-of-the-art simulation-based method Phyloformer 2. Finally, we compare to IQ-Tree, a popular flexible-but-misspecified conventional method. Our models match its tree estimates on simple data, but on more realistic data, our method is reliably more accurate.

论文

LAMB: A Modern Contextual Language Model for Latin

This article introduces Latin Modern BERT (LAMB), an encoder for the Latin language based on the ModernBERT architecture, pretrained in two phases on more than 74B Latin tokens using a novel morphologically informed masking regimen. We also present two corpora for the Latin language. Acervus contains 24B BERT WordPiece tokens, including over 760K samples from heavily damaged OCR transcriptions, repaired by a ByT5 model trained for Latin text repair. The second dataset, Corpus Trinum, contains a mixture of over 100M strong and weak Latin language semantic triplets. Corpus Trinum is the first Latin semantic triplet dataset, opening the door for Latin language models to be adapted to general sentence semantic similarity tasks. We construct an experimental grid using five tasks and seventeen subtasks, applying a variety of finetuning configurations and subword aggregation techniques for 15 pretrained encoders, 6 LAMB training checkpoints, and an ablation model designed to quantify the impact of different masking regimens. Using this benchmark, we rank Latin encoders and find that LAMB outperforms all other evaluated models on 16 of 17 subtasks, coming within 0.8 percentage points of state of the art on the seventeenth. We provide additional analyses relating Latin encoder performance to tokenizer behavior, syntactic structure, finetuning configuration, pretraining state, subword aggregation, and variation in source texts and domains. In these, we identify unique acquisition dynamics for Latin open class words during terminal decay phases, and establish that for some task categories, finetuning configuration selection can have a greater effect on downstream scores than additional pretraining tokens.

论文

PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence

Recent advances in multimodal foundation models yield strong performance on static perception and reasoning benchmarks, yet such evaluations largely overlook a central aspect of intelligence: acting competently in dynamic environments over extended time horizons. We introduce PlaySuite, a large-scale benchmark for evaluating interactive visual intelligence across more than 5K open-source video games curated from PyWeek and itch.io. Spanning diverse genres and engines, including Pygame, HTML5, Godot, and Unity, these independent games are largely out-of-distribution for current models, reducing the likelihood that success can be achieved by retrieving memorized walkthroughs or web-scale training artifacts. To enable scalable evaluation across heterogeneous titles, we develop a unified closed-loop interaction framework optimized for HPC clusters alongside a Video-LLM-as-a-judge protocol that maps observable gameplay milestones to standardized progress levels. We evaluate fourteen recent open models spanning vision-language models, computer-use agents, and vision-language-action models. Our results yield strong evidence of a perception-action gap: despite strong reasoning capabilities, current models struggle to make sustained progress and exhibit recurring failures in spatial grounding, action execution, and self-correction. PlaySuite provides a reproducible and extensible testbed for measuring progress from visual perception to goal-directed interaction, and a foundation for developing models that can act, adapt, and generalize in dynamic visual environments.

论文

Can LLMs Anticipate Their Cruxes?

To use language models to help us make decisions we would like to understand the rationale behind the language model's outputs. In principle, the language model provides its rationale as part of its text output. However, the sheer volume of text makes this hard to use in practice. In this paper, we are interested in extracting the cruxes that lead a model to recommend one action over another. We take a crux to be a sub-question that a model's rollouts disagree on, where changing its value may have altered the conclusion. A crux is therefore a property of the distribution of a model's rollouts, not of any one rollout. We consider three strategies of increasing computational cost. First, we just ask a model to identify, a priori, what the cruxes of a decision will be. Second, we have the model actually go through the process of generating a response and then extract the cruxes that arose in its reasoning. Finally, we generate many responses and extract the cruxes by comparing the reasoning across the rollouts. We make this last procedure computationally tractable with cheap calls to a reranker, an estimated 86 times less compute than a judge. We then conduct an extensive empirical evaluation to assess whether the computationally inexpensive options are sufficient. They are not. Across domains and models, we find that a model's a priori assessment of the cruxes has little relation to the factors that are actually identified as important a posteriori. Using a single rollout helps, but is still inadequate for identifying the full set of cruxes. Accordingly, for high-stakes decisions (and to understand the space of language model decision making) the many rollout procedure is unavoidable.

论文

Learning Hierarchical Patch Splitting Policies for Faster Vision Transformers

学习分层图像块拆分策略以加速Vision Transformers

Vision Transformer(ViT)受限于其输入token序列的长度。标准图像块化通过在整个图像上应用单一图像块尺寸来固定该长度,而不考虑区域内容。此前关于自适应图像块尺寸的工作通过为视觉上简单的区域分配更粗的图像块来减少token数量,但依赖局部熵等带噪声的像素级启发式方法来做出分块决策。我们认为,这种计算分配应基于模型对任务相关信息的解读,而不是原始像素统计。我们提出Split Policy Learned Image Tokenization,它学习根据模型认为有意义的内容来分配token分辨率,从而生成更短且与任务相关内容更匹配的token序列。SPLIT在使用少30% token的情况下,达到了全分辨率ViT分类基线的准确率。同样的收益也适用于密集预测:SPLIT在COCO和ADE20K上取得有竞争力的准确率,表明语义对齐的分块方法能很好地泛化到分类之外。

论文

From Discharge Notes to Patient Understanding: Persona-Grounded, Open-Ended Simulation of LLMs as Discharge Educators

Hospital discharge education is an interactive teaching task: a clinician adapts a discharge plan to a patient's literacy, recall, and personality. Existing LLM evaluations target static or artifact-generation tasks and do not measure patient understanding under open-ended dialogue. We introduce DischargeBench, a persona-grounded simulation in which a candidate LLM educator conducts a multi-turn session with a Virtual Patient, while an Education Monitor Agent regulates patient realism without modifying the educator, protecting the evaluation signal. We curate MIMIC-IV-Ext-DischargeBench, 477 cases over 24 ICD chapters with persona axes (personality, education level, health literacy, past-medical-history recall) for stratified analysis. Each simulation is scored on four axes -- Conversation Quality, Topic Checklist, Comprehension, and Factual Consistency -- by an LLM-as-a-Judge aligned against physician annotations. Across closed- and open-source LLMs, aggregate scores conceal clinically relevant variation across ICD chapters and patient personas; difficult personas expose coverage failures, comprehension gaps, and reduced source-answer agreement. LLM evaluation for discharge education should center patient understanding, not text quality or answer accuracy alone.

论文

LEMON: Equivariant Learning over Attention Maps for Zero-Shot Misbehavior Monitoring on New LLMs

LEMON:面向新 LLMs 零样本不当行为监控的注意力图等变学习

大型语言模型表现出的不当行为会阻碍其在高风险场景中的部署。监控此类失败的一种方法是使用外部 LLM 作为监控器,但成本过高。一类知名且高效的监控器可以从内部表示(如激活探针)中检测此类失败,但它们受限于训练时所基于的模型,随着新 LLMs 出现需要昂贵的重新标注。避免这种重复标注成本的一种自然方式是开发可跨 LLMs 零样本迁移的基于内部表示的监控器。然而,这种迁移具有挑战性,因为内部表示在不同模型之间并非天然对齐;特别是,已知包含不当行为信号的注意力图可能在头功能、顺序和模型深度上存在差异。在这项工作中,我们将这些跨模型注意力不匹配刻画为代数对称性,并利用几何深度学习原理构建了 LEMON(Language-model Equivariant MOnitoring Network),一种基于在线图神经网络的监控器,其预测在这些对称性下保持不变。LEMON 在注意力图逐 token 生成时进行处理,并在每个 token(或每 $W$ 个 token 的窗口)后以可忽略的成本输出一个分数。在 16 个 LLMs 和六个数据集上,在零样本跨模型设置中,LEMON 在幻觉和越狱监控任务上均优于所有基线,相较最强基线提升最高达 14 个 ROC-AUC 点。

论文

What a Weight Update Buys: Leverage Across Training Stages

一次权重更新能换来什么:跨训练阶段的 leverage

后训练会将语言模型的权重移动约其范数的千分之一,并显著改变其行为;预训练则移动其范数的三分之一,只换来缓慢漂移。我们提出 leverage,一种精确衡量单位权重变化能换来什么的指标:一次更新的 Fisher 二次型,按每个方向一次前向模式传播计算,再除以同一检查点下同等大小随机方向的同一二次型。Leverage 将已发布的 Olmo-3、Tülu-3、Zephyr 和 OLMo-2 检查点按四个数量级排序:预训练窗口在散文上处于随机水平,SFT 高出五倍,RL-Zero 和 RLVR 为 400–1,500,DPO 为 400–23,000。借助这一工具,我们发现预训练会累积成噪声:30k 到 1M 步的窗口在散文上的影响并不比同等大小的随机方向更大,正如 SGD 的噪声二次模型所预测。我们发现训练精度会改变更新的样貌:在没有 fp32 主副本的情况下训练 bf16 参数会冻结 36–99% 的坐标,将 leverage 最多降低七倍,并造成更新幅度与对角 Fisher 之间的对齐,而 fp32 训练不会表现出这种对齐。我们推导并验证了一条关于复用的定律:符号翻转零假设预测,在保留率 $p$ 下随机 drop-and-rescale(DARE)的相对损害为 $(1-p)/(p\,\rho_{\mathrm{sign}})$,凡 DARE 成功之处,预测与测量值相差不超过两倍。两项对照使这些读数可靠:每一条受控的 SFT 和 DPO 轨迹都...

论文

When Should LLMs Trust Their Own Revisions? A Risk-Aware Study of Intrinsic Self-Correction

Intrinsic self-correction asks a language model to revise its own answer without receiving new external evidence. A second pass can recover mistakes, but it can also overturn answers that were already correct. We study this trade-off across 29 open-weight LLMs on BoolQ, GSM8K, and Corr2Cause by tracking correctness transitions between initial and revised answers. Aggregate accuracy can conceal substantially different revision behavior: for example, Llama-3.1-8B improves by 25.5 percentage points on GSM8K, while refinement changes 19.1% of initially correct answers into wrong ones. A controlled BoolQ study further shows that refinement prompts shift the balance between recovery and harm. We then compare three runtime choices: keeping the initial answer, always accepting the revision, and selectively invoking revision using signals available after the initial response. The comparison identifies settings where learned gating is useful and others where a simpler unconditional policy performs better. These results suggest treating intrinsic self-correction as a revision policy rather than as a uniformly beneficial second pass, and evaluating it through both the corrections it recovers and the errors it introduces.

论文

RDGSplat: Render-Dedicated Geometry for Novel View Synthesis

3D foundation models enable efficient novel view synthesis by carrying a Gaussian head on the representation they already use for reconstruction. However, the views they render fall short of the geometry they recover, because that geometry is estimated under a metric objective and never scored on how it renders. Recent methods alleviate this by updating the backbone weights, but they thereby discard the metric predictions the model was built for and must be repeated for every new backbone. To this end, we propose RDGSplat, a framework that decodes a second geometry dedicated to rendering from a frozen 3D foundation model, leaving its metric predictions intact. In particular, we devise Render-Dedicated Geometry Decoding, which duplicates the pretrained decoders and optimizes the duplicates under photometric supervision alone. Then, a Target-Pose Conditioned Adapter is introduced to reformulate the representation those decoders read, conditioned on the target camera pose rather than the target image. Extensive experiments show that RDGSplat improves novel view synthesis across three feed-forward backbones on four benchmarks, with every pretrained weight frozen. On RE10K, it raises WM2.0 from 20.918 to 24.266\,dB while training 205.5\,M added parameters against a frozen 1.4\,B backbone, and the depth and pose the same model predicts are unchanged.

论文

LoRA Direction Extraction for Controllable Light Toggling in FLUX.1 Kontext

We propose a fine-tuning method for flow-matching diffusion models aimed at realistic artificial light modeling without the need for a large training dataset. We address the task of controllable interior image editing, where the goal is to turn artificial light sources on or off while preserving the scene geometry, object placement, materials, and visual identity of the original image. To achieve this, we decompose the task into two independent formulations. We introduce the LoRA Direction Training Method, which extracts the pure direction of the LoRA adapter effect in the diffusion model flow field, and we also introduce specialized loss functions to ensure the realism of the inverse transformation. Additionally, the resulting increment map is used for more precise adjustment of the lighting color and temperature.

论文

Does Multi-Agent Collaboration Reduce Hallucination in Clinical Tasks?

多智能体协作能减少临床任务中的幻觉吗?

多智能体 LLM 系统能提升临床任务的表现,而这种提升常被解读为系统更可信的证据。然而,这两者并非同一命题。临床医生依据的是明确陈述的推理过程,而不仅是结论,因此协作是否减少幻觉、以及由什么决定其何时减少,也必须在推理过程中加以测量。然而,大多数评估只对最终答案打分。我们评估了四个系统(一个单 LLM 基线以及三种多智能体拓扑结构),覆盖四个模型和三项临床任务,依据事实性与忠实性分类体系,在各系统生成的推理依据(rationale)内部对幻觉进行评分,并将其与任务指标一并报告。我们发现,协作能换来任务表现,但按通则并不能降低幻觉,且没有任何一种拓扑结构能可靠地优于其他拓扑结构。该效应因模型而异:在 $36$ 组模型—系统—任务比较中,有 $12$ 组的差异大到足以判定——其中四组下降、八组上升,且没有任何一个模型同时出现在两侧。决定幻觉水平以及任何变化方向的,是模型本身,而非拓扑结构或智能体数量。一项自我纠错实验与此一致:在向模型展示其自身被标记的错误后,除 Llama-3.2-3B-Instruct 外,每个模型的幻觉都减少了;协作使其幻觉降幅最大的那个模型获益最多,而 Llama-3.2-3B-Instruct——协作使其幻觉被放大最多的模型——则完全没有减少幻觉。我们发现,协作

论文

CCDWIKI: Decoupling Case Formulation from Response Generation in Longitudinal CBT Dialogue

Cognitive Behavioral Therapy (CBT) demands more than empathic validation, requiring instead a structured formulation of the interplay among situations, automatic thoughts, emotions, and behaviors. Therapists formalize this interplay through a Cognitive Conceptualization Diagram, where maintaining longitudinal coherence necessitates continuous evidential adjudication to separate tentative hypotheses from established findings. Current dialogue systems track conversational history via retrieval or static profiles but lack the representational capacity to encode epistemic status. Consequently, provisional interpretations are often prematurely reified as established facts, inadvertently biasing downstream interventions. Addressing this limitation, CCDWiki is introduced as a plug-and-play advisor conceptualizing longitudinal therapy as evidence-grounded hypothesis adjudication. The approach encodes each clinical hypothesis as a mutable entry bound to corroborating and contradicting evidence. Across sessions, accumulating data strengthens supported entries, preserves provisional ones, and retracts contradicted assumptions. The resulting formulation distills into concise guidance for unmodified therapeutic language models. Experiments demonstrate substantial improvements in both conceptualization and intervention quality without requiring backbone retraining.

论文

TuiML: Machine Learning for AI Agents

Machine-learning libraries such as Weka and scikit-learn were designed for human programmers. Language-model agents now use these same libraries by recalling APIs from memory and writing code, an approach that hides what a library offers, delays errors until runtime, and loses experimental state between turns. We present TuiML, a self-contained machine-learning library built for AI agents, with native algorithms across supervised, unsupervised, time-series, data handling, tuning, and evaluation tasks. Every component describes itself through machine-readable metadata and parameter schemas, so an agent can search the library, inspect components, compose validated workflows, and register new ones that become discoverable in turn. Every call is validated, seeded, and traced, and sessions export as runnable notebooks, making experiments reproducible by construction. One specification layer drives the Model Context Protocol (MCP), agent-framework adapters, a Python API, a CLI, and local model serving, while data and models never leave the machine. Benchmarks show TuiML remains predictively competitive with scikit-learn and Weka. While looking like a conventional library to a human user, TuiML is designed for agents first, allowing them to read, extend, and operate machine learning autonomously. TuiML is open source, with documentation at https://tuiml.ai.

论文

SurgTransfer: Multi-Step Latent Action Modeling for Action Transfer in Surgical World Model

SurgTransfer:用于手术世界模型中动作迁移的多步潜在动作建模

手术世界模型有望提供术中指导、加速无风险训练,并促进专家手术操作的迁移。然而,利用世界模型迁移手术专长在很大程度上仍未被探索。此外,该领域近期方法主要依赖真值运动学动作或特定任务的专家标注,限制了其在具有真值标注的狭窄任务范围之外的应用。相比之下,自然领域现有工作已显示出仅从无标注视频中学习潜在动作,并将所学动作跨上下文迁移的良好结果。我们观察到,这一范式对外科领域而言过于短视,未能捕捉手术过程的分层和目标导向结构。因此,我们提出一种新颖的多步动作学习框架,以学习易于在各种手术场景中迁移的上下文不变潜在动作。我们在公开数据集 SurgToolLoc-2022 和 PitVis-2023 上进行了大量实验,并通过定量指标和外科专家定性评估验证了我们的方法。我们已在 https://github.com/bhattarailab/Surgical-Vision-World-Model 发布代码和实现细节。

论文

Mixture of Wide Experts: Sparse Routing for Interpretable Native Coordinates

Mixture of Wide Experts:用于可解释原生坐标的稀疏路由

语言模型常将一个概念分散到许多内部维度上,使其特征难以解释。稀疏自编码器(SAEs)在训练后能恢复更清晰的特征。我们探究模型能否改为直接学习可解释的输出坐标。我们提出 Mixture of Wide Experts(MoWE),这是一种稀疏前馈层,其中被选中的专家读取完整表示,但写入固定且互不相交的输出坐标。在隐藏原因已知的受控任务上,该设计在保持预测性能的同时,比稠密模型和标准混合专家(MoE)模型更清晰地将原因定位。在大致匹配计算量的情况下,我们为每种架构训练两个 19 层运行,各 100 亿 token。MoWE 的评估交叉熵为 2.417,稠密模型为 2.452,而标准 MoE 达到 2.22。我们通过让语言模型评判器根据每个坐标强烈激活的段落来描述该坐标,并在新段落上测试该描述,来衡量原生坐标可读性。对同样适用于其他坐标的描述进行校正后,MoWE 的特异性得分为 0.523,稠密模型为 0.375,标准 MoE 为 0.268。在相同 FFN 更新上训练的 TopK SAEs 在稠密模型上得分为 0.489,在 MoWE 上为 0.556,使原生 MoWE 与稠密 SAE 相当。在第一个案例研究中,我们识别出一条四坐标因果路径,支持模型在提示词 A right angle is 90 之后对度数的预测。随后我们复制七个与角度相关的坐标

论文

DeepStratNet: A Context-Aware Coordinate Regression Framework for Seismic Horizon Tracking under Sparse Labels

Automatic horizon tracking is a foundational task in 3D seismic interpretation. Most existing deep learning approaches formulate it as dense semantic segmentation, typically using U-Net-based architectures. The model produces a probability map over all pixels that must be post-processed to extract precise horizon coordinates, while horizon picks in time/depth must be converted into dense masks for training. Unpicked seismic traces are consequently treated as background, which can hinder convergence, and both pre- and post-processing can introduce errors into the final interpretation. Moreover, 2D segmentation models do not inherently capture inter-slice context, while 3D models are often computationally prohibitive. We instead formulate horizon tracking as a bounded coordinate regression problem, where the model directly predicts the time/depth coordinate of the target horizon at each lateral position. We propose a lightweight regression head compatible with any pretrained vision backbone, coupled with an LSTM module to model inter-slice context and produce a continuous horizon surface across the volume. A combination of L1 and L2 losses supervises predictions at valid horizon picks, while a geology-informed regularization enforces lateral continuity between successive traces. Under controlled experimental conditions, we evaluate four pretrained vision backbones under both segmentation and regression configurations on a seismic volume from New Zealand. The proposed approach consistently outperforms its segmentation counterparts quantitatively, using metrics including RMSE and PCC, and qualitatively, while also demonstrating greater robustness to increasing sparsity of training picks. Finally, we show that prediction variation across successive traces captures local variations in geological complexity, providing an automated quality control measure for downstream seismic interpretation.

论文

Baseline Shape Decides the Verdict: A Controlled Re-Examination of Ternary Language Models at 60K Parameters

Ternary (1.58-bit) weights are attractive for microcontroller-class language models, but the sub-1M-parameter regime rests mainly on isolated, single-seed comparisons. One prominent example reports that a routed ternary block (convolution, diagonal SSM and sparse attention mixed by a per-token router) beats a parameter-matched full-precision transformer by 22% at 60K parameters, attributing this to inductive bias. We re-run it under one fixed recipe, three seeds per cell, 98 byte-level runs on one laptop. (i) Baseline shape dominates: at a 16M-byte budget, param-matched transformers span 22.6% in validation loss purely by depth/width choice - far more than any architecture effect we measure there - and the best-shaped transformer ties the routed model, so the published margin is at least partly a baseline-shape effect; the ordering of shapes reverses with budget, so no single fixed shape can be trusted. (ii) At 130M bytes the routed model does win, by 22.2-24.0% over the three transformer shapes we evaluate there - but a plain gated diagonal-SSM block beats it by a further 9.1%, and the routed model's own router puts most of its weight on its recurrent pathway, so the gain does not require routing. (iii) The ternary penalty differs by architecture at the larger budget (+5.3% best transformer vs. +19.5% routed, +28.1% gated SSM), but we cannot attribute that to architecture alone: our transformers keep learned positional embeddings in full precision, 11-22% of their parameters, so they are less quantized than the models they are compared with. (iv) A 90/10 full-precision-then-ternary schedule beats all-ternary training, but only at a stage-2 learning rate about 10x the pretraining peak; at a conventional fine-tuning rate it looks 15.3% worse, reversing the conclusion. The from-scratch baseline was not itself learning-rate tuned, which bounds (iii) and (iv). Code and run logs released.

论文

Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models

Multimodal large reasoning models (MLRMs) have demonstrated remarkable capabilities in complex visual understanding. However, this very power introduces a critical yet underexplored privacy threat: adversaries can exploit MLRMs to precisely infer users' geographic locations from casually shared photographs, by performing structured reasoning over subtle visual cues such as architectural styles, vegetation, and lighting conditions. In this work, we present a systematic study of MLRM-driven geolocation privacy leakage. We first reveal that refusal-based safeguards are critically insufficient, as carefully crafted jailbreak prompts can raise model response rates to 100%. We further identify that existing defenses, which inject imperceptible perturbations into shared images, suffer from structural limitations intrinsic to their pixel-space optimization, resulting in degraded black-box transferability and pronounced visual artifacts. Motivated by these findings, we propose a diffusion-based framework that provides targeted, proactive defense against geolocation privacy leakage. By injecting perturbations into the latent space of a diffusion model during reverse sampling, our method operates directly on high-level semantic representations, thereby resolving the effectiveness-utility bottlenecks by construction. We further ground our optimization with GeoCLIP, a model explicitly aligned with GPS coordinates, as a surrogate to pinpoint and disrupt the geographic signals that MLRMs exploit for location inference. This targeted semantic disruption yields significantly stronger black-box transferability while preserving perceptual image quality, offering a seamless integration on social media platforms.

论文

Do Multi-Turn Conversational Capabilities Carry Over from Text to Speech? A Parallel Multilingual Benchmark

Successful multi-turn voice interaction requires models to retain information from earlier turns, follow persistent instructions, and track revisions to conversational state. These abilities are usually evaluated from transcripts, leaving open whether successes demonstrated from text carry over when the same turns are spoken, and whether this transfer is consistent across languages. We introduce Omnilingua-AudioMC, a strictly parallel multilingual extension of Audio MultiChallenge, to study this question. The benchmark contains 354 conversations and 1,404 rubric items across ten languages, with content, turn structure, cross-turn dependencies, and evaluation criteria aligned across transcript and speech conditions. Across six speech-language models, the shift from reference transcripts to direct speech input is strongly model- and language-dependent: models with similar transcript performance can diverge substantially under speech, and their relative strengths across languages can change. Paired rubric-level analysis shows that aggregate transcript-speech gaps can obscure which conversational requirements are preserved, because losses of transcript-demonstrated successes can be offset by gains on other items. Replacing preceding user turns, the current turn, or both with model-generated transcripts localizes recoverable degradation: for the two models with the largest gaps, history substitution yields a larger macro-level improvement than current-turn substitution in all ten languages, while the strongest direct-speech model gains little from either. These results show that transcript performance is an unreliable proxy for multilingual spoken conversational ability and identify the representation of preceding spoken context as an important source of recoverable degradation. Our code is publicly available at https://github.com/QwenLM/Omnilingua-Bench/tree/main/Omnilingua-AudioMC.

论文

Continuous Ontology Assurance through External Resources -- An Ontology Engineering Method with a Case Study in Software Language Engineering

通过外部资源实现持续本体保障——一种本体工程方法及软件语言工程案例研究

领域本体需要对照不断演进的外部资源中所记录的知识进行审查。我们提出 COATER,一种管理名为 arrows 的可执行审查组件的方法。每个 arrow 将本体的一个限定范围部分与相关资源进行比较,并报告对其公理的支持或质疑。质疑可能促成补全、纠正或重构的提案,并成为由人工或智能体辅助分诊的任务。逐公理覆盖率汇总这些评估结果。我们以软件语言工程(SLE)中的 FSL 本体为例说明 COATER:arrows 审查语言覆盖度、语言概念化和软件工程活动。一次 LLM 辅助的链接练习使符合既定 Wikipedia 链接政策的实体数量从 600 个中的 405 个提升至 600 个。一个结构化的 SLE 资源目录组织了审查机会。

论文

REALMS: An AI-Assistant Conversational System for Real-Time Exact Audience Sizing over High-Dimensional Nested Profiles

Audience sizing is a critical component of digital marketing. It enables precise resource allocation, campaign planning, and performance optimization. Traditional approaches using skeleton audiences, sampling, or predictive modeling suffer from significant delays, estimation errors, and poor scalability over high-dimensional profile data. We present REALMS (Real-time Exact Audience sizing via LLM-based Multi-attribute Search), a conversational system for exact audience sizing deployed in production on an enterprise customer data platform. REALMS enables marketers to query massive profile stores with millions of profiles and thousands of attributes using natural language and receive precise counts in seconds. The system introduces three key components: (1) a categorical attribute retrieval mechanism using embedding-based vector search to dynamically identify relevant schema attributes without manual configuration; (2) an LLM-powered NL2SQL pipeline with template-based in-context learning for accurate query generation over complex nested schemas; and (3) schema standardization enabling industry-agnostic deployment across diverse enterprise environments. Evaluation on real enterprise data demonstrates strong recall for attribute retrieval, high SQL execution accuracy, and low latency, which enables real-time interactive audience insights where prior methods required hours.

论文

ThinkJev: One Thought, Every Budget for Calibrated Typed Decisions

ThinkJev:一次思考,适配所有预算的校准类型化决策

语言模型的许多用途最终都归结为类型化决策:在一组封闭选项中做出选择,其概率可供代码采取行动。从一次前向传播中读取这些概率速度很快,但在需要多步完成的决策上往往出错,例如算术、计数和日期比较。让模型先思考可以修复其中大多数错误,但每次决策的耗时从毫秒级增至秒级。为了只在有益之处为思考付费,ThinkJev 基于一个开放混合思考模型构建了快系统和慢系统,该模型既可直接回答,也可思考后回答。System 1 在模型直接回答时读取选项字母的概率;System 2 在模型对同一缓存提示进行思考后读取相同字母,因此升级不会重复工作,且两个系统都对相同选项给出概率。由于在任意数量的思考 token 之后都可读取这些字母,一次采样思考也能给出每种思考预算下的答案。无需训练,ThinkJev 仅在标注开发集上的统计检验保证其接受答案的错误率低于目标错误率时,才让 System 1 单独作答。在 5% 目标下,Qwen3.5-27B 以此方式回答了 8359 个测试决策中的 24.5%,实际错误率为 3.9%(Qwen3.5-4B 和 9B:6.5% 和 0.0%)。对于其余决策,一旦答案置信就停止每次思考,可达到 81.6% 的准确率,而始终思考为 82.7%,且仅使用 72% 的思考 token。根据 System 1 的置信度选择何时思考

论文

ASGARD: Action-Space Guard for UAV Resilience via Reinforcement Learning

Reinforcement learning (RL) controllers have been recently adopted for Unmanned Aerial Vehicles (UAV) navigation and control. However, they are susceptible to action-space attacks that overwrite the action commands after the policy generates them and before the actuators execute them. While most existing defenses target attacks on the policy's inputs, those addressing action-space attacks retrain the policy at training time and are not resilient to corrupted actions at runtime. We propose ASGARD, a two-phase teacher-student pipeline for making RL-based UAV control resilient to action-space attacks. In the teacher phase, an encoder combines the UAV's physical state with action-attack-related privileged information to produce an action-attack-aware latent that trains the RL control policy and a monitor that outputs corrected action commands to the actuators. In the student phase, both the encoder and the monitor are trained via supervised learning from their teacher counterparts to run on-board using only the UAV's physical state history. We evaluate ASGARD across attack scenarios targeting different action commands on UAV. We find that ASGARD is resilient to action-space attacks and completes the missions despite the attack. We further find that ASGARD generalizes to unseen attacks and remains resilient against stealthy attacks.

论文

The FlightFinder Occurrence Corpus: harmonising 128 aviation-safety source codes into one deduplicated cross-national accident dataset

National aviation-investigation databases are deep but territorial; global compilations such as the Aviation Safety Network and the Bureau of Aircraft Accidents Archives are hand-curated, apply their own inclusion thresholds, and publish no per-record lineage. The FlightFinder Occurrence Corpus harmonizes 279,485 occurrences and 131,882 attached narratives from 128 source codes -- national accident-investigation authorities, occurrence-reporting systems and four global compilations. Records are mapped into one schema; each normalized record reduces to exactly one key from an ordered ladder -- event signature, registration and date, rounded position and date, or source and native identifier -- so a missing field never creates a link, and the key is the occurrence identifier. Records the ladder cannot reach are scored in a blocked pass into an explicit merge table and applied only within an automatically approved score band or after a person confirms them. Field conflicts follow a documented source ranking; one provenance row per contributing source -- its native identifier and URL -- is retained, with attribution and licence terms per source code. Linkage error is measured on five adjudicated samples totalling 200 pairs. A recorded uniform random draw of 60 from the 3,441 merges the automatic band applies as it ships found no error; the exact two-sided 95% Clopper-Pearson upper bound on its false-merge rate is 6.0%, or 205 pairs. The measured error covers the scored band only; the ladder's deterministic joins are not adjudicated. The corpus has no exposure denominators and inherits the under-reporting of its sources. It is offered as a base for cross-national safety statistics, source-disagreement studies and narrative text mining; a frozen, DOI-referenced snapshot accompanies the live API.

论文

Cautious Conflict-Free Inverse Gradient Methods

谨慎无冲突逆梯度方法

偏微分方程(PDEs)是物理与工程领域建模复杂现象不可或缺的工具。Physics-Informed Neural Networks(PINNs)通过将物理约束直接融入神经网络损失函数,已成为传统数值求解器的强大替代方案。尽管具有优势,PINN 训练需要多目标优化,这常常导致边界、初始和残差损失项之间出现显著的梯度冲突。无冲突逆梯度(ConFIG)方法可解决这些冲突;然而,将 ConFIG 与 Adam 等自适应优化器结合会引入一个关键脆弱性:ConFIG 生成的无冲突方向会被优化器进一步处理,由此产生的权重更新可能不再相对于任务梯度是无冲突的。为解决该问题,本文提出 Cautious ConFIG,作为 ConFIG 算法简洁的三行扩展,在权重更新之前经验性地恢复无冲突保证。该方法在三个 PINN 基准上进行了评估:1D Viscous Burgers' equation、1D Nonlinear Schr\"odinger equation 和 2D Kovasznay flow。实验结果表明,相较于标准 ConFIG 基线,性能持续提升。此外,还使用一个简单的 toy system 研究了谨慎掩码的稳定效果及其对冲突严重程度、任务数量和优化器滞后的反应。

论文

Taurus: LLM-in-the-Loop CT Annotation Matches Coding Agents at Half the Cost

Dense labels of the aorta in CT are slow to draw, and the public aortic CT datasets that could stand in for them each label different structures under their own conventions. Large language model (LLM) agents can now write code and read images. We asked whether such a model labels these scans better as a free-form agent that writes its own segmentation code, or inside a harness, where an automated pass labels the scan and the model reviews the result. We built a harness, Taurus, and compared it with free-form agents by blind label recovery: we withheld the human labels of six public datasets (939 volumes) and scored every approach against each dataset's own classes. In the first version of Taurus, the model's review raised the primary metric on only two of six datasets, by less than the noise between two reviews of the same case. A free-form agent running Claude Opus 5.5 scored higher on most datasets. Moving what the free-form agents did well into the automated pass then carried most of the gain on 38 held-out cases. The final version smooths the label surfaces with a fixed rule and checks for the large errors the automated pass tends to make, such as an aneurysm drawn to half its size. Each check that fires puts a multiple-choice question to the model, with candidate corrections drawn on the scan. It matched the surface smoothness of the human references, and in the primary metric we found no difference from the free-form Opus agent, at under half its cost, $1.22 against $2.71 per case. Most of what made Taurus competitive came from the harness and its automation rather than from the language model itself. Taurus shows that this kind of annotation can be automated, so that expert time can move from drawing labels to checking them.

论文

Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces

Deepresearch (DR) agents interact with real-world web environments through multi-turn search and visit, causing their contexts to grow rapidly over time. We observe that, even after DR Agentic Reinforcement Learning (DR-RL), 61.6% of the model's remaining prediction errors can still be attributed to insufficient long-context understanding, including longcontext hallucination and failures in cross-document evidence integration. It motivates us to further break the bottleneck of DR-RL by strengthening the model's long-context ability. However, effective LongContext training requires more than simply increasing context length. To bridge the data gap, we propose `DR Rollouts to LongContext-QA (DR-to-Long)'. The method repurposes DR-RL trajectories, which naturally contain search histories, visited webpages, evidence snippets, and final-answer supervision. It then replaces the compact snippets and webpage summaries in each trajectory with the full contents of their corresponding URLs, producing substantially longer multi-document contexts while preserving the original evidence relationships. Building on DR-to-Long, we introduce DLD (DR -> LongQA -> DR)-RL. DLD-RL first performs a short DR-RL stage to collect rollout trajectories, which are then converted into LongQA instances at zero annotation cost. The model is subsequently optimized with LongQA-RL to strengthen LongContext ability, followed by full DR-RL to continue improving its DR capability. Experiments show that DLD-RL outperforms standard DR-RL by 7.3% on three Deepresearch benchmarks and improves performance by 13.5% on three long-context benchmarks.

论文

Subspace Node Pruning

子空间节点剪枝(Subspace Node Pruning)

节点剪枝旨在移除神经元、滤波器、注意力头甚至整个层等计算单元,以显著降低推理时间,同时保持网络性能。在本工作中,我们证明,从基于激活到基于 Fisher 的一大类重要性度量共享一种共同的二次型。通过下三角基变换,该形式可得到一个剪枝子空间;在该子空间中,可以移除整个节点,同时通过线性最小二乘恢复失去单元的影响。此外,通过对层激活进行正交化,我们子空间内的重要性度量实现了解耦和可加性,使得层内多节点剪枝时各重要性分数互不干扰。我们的方法 Subspace Node Pruning (SNP) 在 ImageNet 上的 VGG-16 和 ResNet-50 上优于所比较的基线。在 OPT-125M 和 LLaMA-2 7B 上,SNP 在 40-shot 计划下与最先进的 LLM Surgeon 持平,并在使用更少 shot 时优于它,且剪枝后均无需任何再训练。

论文

GARDEN: Generalist Autonomous Reward Design Through Evidence Navigation for Cooperative Multi-Agent Reinforcement Learning

GARDEN:通过证据导航为协作多智能体强化学习实现通用自主奖励设计

协作多智能体强化学习(MARL)使机器人和自动驾驶车辆等智能体团队能够学习协同行为,但这类团队学到什么在很大程度上取决于其奖励函数。由于仅凭任务成功提供的学习指导太少,中间奖励通常由人工设计,而且每当环境或团队发生变化时,往往必须重复这项工作。大语言模型(LLM)可以通过将奖励函数编写为代码来自动化这项工作,但由此产生的奖励通常只在单一环境中设计和测试。为了实现跨环境的复用,提出了 GARDEN(Generalist Autonomous Reward Design through Evidence Navigation,通过证据导航的通用自主奖励设计),其中为一系列相关场景开发一个奖励程序,并将其原样迁移到设计期间不可用的场景中。在开发过程中,由 LLM 奖励工程师研究环境代码、训练记录和智能体行为,并在试运行训练中测试奖励草案,同时学习算法和选择最终奖励的规则保持不变。在 Overcooked 和 SMAX 基准的未见场景上,两个厨房布局的任务回报分别比默认奖励提高了 58.2% 和 52.5%,两个战斗场景的平均胜率从 51.0% 提升到 89.9%。在匹配的候选与探测预算下,这超过了使用固定诊断反馈所获得的 84.2% 和 79.2%,以及

论文

Curating Always-Loaded Context for LLM Agents: A Capacitated Assortment Model with Censored Feedback

At the start of every session, LLM agents load a fixed context file, such as $\texttt{AGENTS.md}$. Each loaded token in the file is charged again in every later round of the session, and these files can degrade performance as they grow in size. However, in practice, human or automated curators usually grow these files by appending. We formulate context curation as a capacitated assortment problem. Instructions consume tokens under a finite attention capacity; adding an instruction never raises the compliance of the others, while retained instructions incur a per-session setup cost. We prove an upper bound on the optimal file size, regardless of the number of available candidate instructions, and that appending every instruction with positive standalone value can be arbitrarily worse in net value than selecting an optimal subset. A token budget also limits the loss when the token price is underestimated. We then examine what can be learned from past sessions and how this information can guide decisions to add or remove instructions. Feedback is inherently censored: the benefits and harms of loaded instructions are observable, whereas missing instructions generate feedback only when their absence causes harm. In this setting, we show that deleting instructions ignored by agents can inevitably remove helpful ones. We characterize how much evidence should be collected before adding an instruction. Besides, we bound regret when human reviewers can inspect only a limited number of edits per period. Empirical experiments further show that irrelevant rules drawn from real context files reduce language-model compliance.

论文

Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

用于硬件高效限速标志识别的回放剪枝与少比特整数推理

在车载摄像头系统级芯片(SoC)上进行限速标志识别,必须将检测器和分类器(读取器)适配到设备的内存、算术和能耗预算之内。在我们的两阶段识别器中,检测器是一个带有 ReLU 和 hard-sigmoid 算子的 YOLO 系列网络,通过通道回放进行压缩:迭代剪枝级联先确定要移除的通道,再把记录的删除操作回放到原始任务训练好的网络(父网络)上,随后进行一次连续的知识蒸馏恢复。在 YOLOv5n 上,回放以父网络的精度移除了 60.3% 的参数,并且在五个匹配随机种子的验证 mAP50-95 上优于迭代剪枝和从头训练,而其逐步变体(逐步回放)是最准确的剪枝方法。在 YOLOv8n 上,回放和逐步回放优于其他所有方法以及未剪枝的父网络。读取器是一个具有 18k 参数的五层 CNN,YOLOv5n 和 YOLOv8n 头部的后处理仅使用整数运算。在 4 比特权重和 8 比特激活(W4A8)下,读取器在 12.1 KB 的片上内存中达到与 FP32 相同的精度,并且一个可执行的流式模型在其运行时于全部 9,850 个测试裁剪图像上复现了 INT8 类别预测。在 Jetson AGX Orin 上,INT8 仅在 TensorRT 的隐式表述下比 FP16 更快,而回放检测器在深度学习加速器(DLA)上运行最快。仅使用公开数据训练,这个 0.72 M 参数的系统组合

论文

Dr. No: Feature Steering for Abstention in Vision-Language Models

Dr. No:面向视觉语言模型拒答的特征引导

大型基础模型往往在可用的视觉或文本证据不足以支撑可靠结论时仍会给出回答。这种无法拒答的问题使其在高风险或信息检索场景中难以被信任,因为这些场景下一个自信却缺乏支持的答案可能比不回答更糟。这也引出一个自然的问题:这种行为背后的内部机制能否在推理时被识别并控制?我们提出 Dr. No,一种特征引导方法,它挖掘与拒答和作答相关的稀疏自编码器(SAE)特征,然后在 prefill 阶段对其中一小部分特征进行调制,而无需重新训练基础模型。Dr. No 在 LLaVA-1.6 Mistral 7B 上跨多模态拒答基准进行评估,包括 UNK-VQA 和 MM-UPD,并额外使用 Qwen3.5-2B 在 AbstentionBench 子集上对语言推理任务进行基准测试。与多种基于不确定性的拒答基线相比,特征引导在正确回答与适当拒答之间取得了比事后拒绝方法更有利的平衡。这些提升在 UNK-VQA 以及涉及图像—问题或问题—答案不兼容的 MM-UPD 案例上最为显著,并且最清晰地迁移到 AbstentionBench 的数学推理子集。然而,在缺失答案检测和检索密集型多跳问答(如 MuSiQue)上性能较为有限。这些结果表明,稀疏内部特征提供了轻量化的控制手段,用于塑造

论文

Automated Theorem Generation in First-Order Logic by Construction from Triangular Standard Contradictions

Automated theorem generation (ATG) seeks to construct new theorems rather than merely prove given conjectures. Existing approaches typically generate candidate statements that require subsequent proof or formal verification. We propose a constructive framework for ATG in first-order logic based on triangular standard contradictions. The method constructs minimally unsatisfiable clause sets from selected first-order literals, then forms theorems by retaining some clauses as premises and taking the negation of one clause, or a conjunction of clauses, as the conclusion. Minimal unsatisfiability ensures that the remaining premises are satisfiable, avoiding trivial inference by explosion, while unsatisfiability of the full set guarantees the resulting entailment. Theorems are therefore correct by construction, without a separate proof procedure for each instance. Extending the previously developed $\Delta_1$ generator, we introduce seven methods, $\Delta_2$--$\Delta_8$, forming a unified family of eight theorem-generation methods. Four generators, $\Delta_1$--$\Delta_4$, have been implemented and released. We also formulate a general $\Delta$-class method encompassing the family. Combinatorial analysis demonstrates the capacity to generate large numbers of distinct theorems systematically. This framework offers a principled foundation for automated theorem discovery and the construction of logically guaranteed knowledge.

论文

Provably Complete Generalized Planning with LLMs

Generalized planning aims to compute a plan that solves all instances of a planning domain. Recent work has used LLMs to automatically generate and debug such generalized plans in the form of Python programs and achieved perfect test data coverage for several domains. However, whether these generalized plans are actually complete, i.e. solve all instances of the domain, could only be determined by manual evaluation. Here, we present an approach for automatically generating generalized plans in Lean together with proofs of their completeness relative to a specification of the domain constraints provided as input. We introduce a semantic-preserving PDDL-to-Lean conversion, and use an LLM to generate both the generalized plan and the formal proof that it solves every instance satisfying the domain constraints. The correctness of the completeness proof is determined by Lean's kernel. We evaluate our approach on 13 commonly used benchmark domains, using GPT-5.6-Sol as the LLM. For 12 of the domains we obtain generalized plans together with valid completeness proofs. This is a major advancement of the state of the art in automatic generalized-plan completeness proofs.

论文

World-in-Context: Interactive Video World Modeling with In-Context Conditioning

World-in-Context:基于上下文条件(In-Context Conditioning)的交互式视频世界建模

交互式视频世界模型需要同时协调控制观察视角、角色动作与相机运动。现有方法通常将视角模式隐含在文本描述中,把动作与相机运动混为一谈,并通过碎片化的架构路径注入控制信号,因而只能间接捕捉这些因素之间的相互依赖关系。在本工作中,我们提出 World-in-Context,一个由 In-Context Conditioning (ICC) 驱动的交互式世界建模框架。World-in-Context 不依赖专门的条件注入路径,而是将视角、动作和相机控制统一为显式 token,直接在共享的自注意力空间中进行上下文化。我们的建模方式揭示出:(i) 显式的视角 token 能够解耦相互冲突的动态,并从单视角数据中解锁涌现式的视角切换能力;(ii) 动作与相机输入在控制局部响应性与全局稳定性方面起着互补作用。为在执行间隔之间保持时间连续性,我们进一步提出 Interaction-Transport RoPE (IT-RoPE),以累积的控制状态转换来参数化时间注意力。在 WBench 上,World-in-Context-5B 的导航性能与 22B 的 EchoWM 相当(81.5 对 81.6),并达到 93.8% 的视角切换成功率,大幅超越现有的 5B 基线(18.8%)。受控分析进一步表明,World-in-Context 在更丰富的条件组合下具有叠加优势、良好的数据效率,以及 natu