arXiv

arXiv 在 slackoff.org 的全部收录,按发布时间排列,每条保留原文链接。

全部时间,共 4241 条

论文

Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation

Expert deactivation at inference time changes both token routing and expert weights, and its effect on performance depends on how these changes are implemented. We compare removal, freezing, remaining-expert renormalization, and unnormalized re-routing on identical disabled sets across five instruction-tuned checkpoints from four model families, with a base OLMoE checkpoint as an additional comparison. We develop a weight-sum model that relates the loss of expert contributions and changes in branch scale to the weight rule used during training. With half of the experts deactivated according to activation-based rankings, remaining-expert renormalization yields the highest perplexity in models trained with raw router probabilities, whereas unnormalized re-routing yields the highest perplexity in models trained with normalized weights. Perplexity ranges from 1.4 to 73 times the intact baseline when the training rule is retained, and from 14 to 28,740 times the baseline under a rule mismatch. Task outcomes vary across evaluation types: on OLMoE, GSM8K strict-match accuracy falls to zero under all four implementations. Extending the model to changes in the number of active experts yields a further prediction, supported by the OLMoE experiments: the perplexity penalty from additional renormalization increases as fewer experts are activated.

论文

Self-Supervised Pretraining for Label-Efficient Facial Expression Recognition using Smart Glasses

使用智能眼镜进行标签高效面部表情识别的自监督预训练

在 OCOsense 等基于眼动肌图(optomyographic, OMG)的智能眼镜上进行面部表情识别(FER),可实现隐私保护、无摄像头的情感感知,服务于健康与福祉。大多数 FER 系统都是全监督的,即要么依赖手工设计的专家特征结合经典机器学习,要么依赖基于标注数据训练的端到端深度模型。两者都依赖大量标注表情,而标注收集成本高昂,限制了在真实世界个性化场景中的部署。我们研究将自监督学习(SSL)作为在这类眼镜上实现标签高效 FER 的途径。我们在未标注的 OCOsense 记录上以掩码自编码器目标预训练 Vision Transformer,并在与受试者无关的交叉验证下针对五类 FER 进行微调。在 5% 到 100% 的标签预算范围内,预训练始终提升性能;仅使用 5% 的标签时,预训练模型就优于使用全部标签从头训练的模型。结果表明,SSL 预训练是降低智能眼镜 FER 标注成本的实用方法,我们还讨论了对未来个性化和持续适应的影响。

论文

VAR-Q: Tuning-free KV Cache Quantization for Visual Autoregressive Image and Video Generation

VAR-Q:面向视觉自回归图像与视频生成的无调优 KV Cache 量化

视觉自回归生成涵盖两种主流范式:面向图像和视频的下一尺度预测(next-scale prediction),以及面向视频的下一帧预测(next-frame prediction)。二者均以块为单位而非逐 token 进行解码,因此其 KV cache 的统计特性与语言模型存在差异。在大规模场景下,KV 内存占用会超过模型权重,并且由于视觉 token 数量庞大,会限制大规模部署。我们对这些 cache 的分析得出三点发现。第一,少量大幅值通道承担了主要功能负载:消融这些离群通道会导致生成崩溃,而消融一组匹配的非离群通道则不会影响质量。第二,离群值沿特征和块两个轴组织,其幅值在每个单元内保持稳定,并在单元之间发生偏移。第三,这种结构源于两种独立机制:投影偏置(projection bias)和 RoPE 引起的散射。基于这些发现,我们提出 VAR-Q,一个沿相同两个轴进行分组的无调优 KV-cache 量化框架。生成循环天然提供块边界,无需离群值检测或校准。结合用于运行时内存降低的 bit-packing kernel,VAR-Q 在覆盖两种范式的九个模型上实现了低比特量化,将 KV 内存最多降低 78.5%,质量下降可忽略不计,并支持 6 倍更大的推理批次。

论文

Phonological Knowledge of Chinese Characters in Language Models

How much phonological knowledge do language models (LMs) possess about Chinese characters, and how is this knowledge represented and used? We introduce PinyinBench, a controlled benchmark covering homophones, phonological features (initials, finals, and tones), and polyphonic characters. We investigate 17 text-only and multimodal LMs through three complementary approaches: behavioral evaluation, layer-wise probing, and activation steering. Behaviorally, models demonstrate substantial knowledge of initials and finals, with a frontier model (DS-v4-flash) scoring 90%+ in homophone judgment, when two characters share no phonological features. However, its accuracy drops sharply to 72% when two characters differ only in lexical tone. Probing reveals that tone is highly decodable from embeddings and improves modestly across layers, whereas segmental information starts less decodable and improves substantially with depth. Activation steering shows that segmental representations can systematically influence generation, while tone exhibits much weaker effects. Furthermore, audio-bearing training improves phonological decodability, including tone, without corresponding improvements in steering effectiveness. Together, these findings reveal distinct representational and functional profiles for segmental and tonal information, with tonal information much harder to access and manipulate, demonstrating the necessity for combined evaluation, probing, and causal intervention for understanding linguistic knowledge in LMs.

论文

How Do Artificial Agents Make Decisions in Light of Visual Data?

人工代理如何根据视觉数据做出决策?

视觉语言模型(VLM)在利用视觉数据进行推理方面已取得显著进展,这一点尤其重要,因为人类知识很大一部分以视觉形式编码在科学文章和其他来源中。然而,在理解由VLM驱动的人工代理如何在存在视觉数据的情况下感知和处理不确定性下的决策方面,仍存在空白。本研究通过评估和分析自主决策过程来探讨这一空白。在可视化素养和决策理论的既有工作基础上,我们开展了两项互补研究:一项考察代理如何感知和量化可视化中编码的不确定性,另一项研究人工代理如何基于图像形式的视觉数据做出决策。我们分析了不同模型和可视化类型下的感知准确性和决策表现。结果表明,在测试模型中,GPT-4o在感知饼图和柱状图中的不确定性方面表现出最高准确率。在决策方面,当不确定性通过圆形图、图标阵列或文本表示时,自主代理与理性决策理论的一致性最佳。

论文

MA-SafeDiffuser: Safe Multi-Agent Planning with Diffusion Probabilistic Models

MA-SafeDiffuser:基于扩散概率模型的安全多智能体规划

我们提出 MA-SafeDiffuser,这是 SafeDiffuser 的多智能体扩展,为基于扩散的轨迹规划器提供针对联合智能体安全规范的有限时间扩散不变性保证。基于将控制屏障函数(CBF)约束嵌入逆向扩散更新的单智能体构造,我们:(i) 将联合安全集形式化为各智能体屏障集与成对屏障集的交集;(ii) 推导集中式和去中心化(通信感知)的约束去噪过程,并在温和假设下具有可证明的不变性;(iii) 通过时变规范与活性 CBF 处理局部陷阱和死锁现象;(iv) 开发轻量级基准测试套件,包括多智能体 Maze2D 域。实验表明,相对于无约束扩散基线,MA-SafeDiffuser 在保持规划质量的同时减少了违规次数。我们提供算法、证明和参考实现。

论文

GeoDIVE: Geospatial Descent Informed by Value Estimation

GeoDIVE:由价值估计引导的地理空间下降搜索

寻找特定对象、结构和空间模式,对农业、基础设施规划、环境监测和灾害响应等关键工作至关重要。然而,这些特征往往分散在非常大的区域内,并跨越差异极大的空间尺度,这构成了一个难以低成本嵌入、维护和直接搜索的搜索空间。我们提出 GeoDIVE,该模型将多分辨率卫星图像库视为一片森林,并使用最佳优先遍历来决定对哪些瓦片进行编码。在每个访问到的节点上,一个轻量级模型会利用查询表示和子树表示,预测其所有后代中可能隐藏的最佳查询相似度的乐观估计。在使用图像查询和开放词汇文本查询的评估中,GeoDIVE 在仅需穷举搜索 10% 编码成本的情况下即可达到与穷举搜索相当的效果,并且在两种模态下的每个预算水平上都领先于所有测试基线。为支持未来多尺度地理空间搜索的评估,我们还发布了 Git-10M 的对象级图像查询和文本查询,这些查询基于 Microsoft building footprints 和 OpenStreetMap 多边形构建,并配有 VLM 生成的描述。源代码和模型将公开提供。

论文

Agent Harness Awareness: Turning Verified Telemetry into Operational Control for Tool-Using Agents

Agent Harness Awareness:将经过验证的遥测转化为工具使用型智能体的运行控制

工具描述告诉智能体某个操作能做什么,但未必能揭示该操作在使用当下是否健康或合适。执行框架通常通过监控器、追踪和近期故障掌握这些信息,而选择下一步动作的模型却并不掌握。我们将这一缺口称为操作盲区。我们提出 Agent Harness Awareness,一种信任分离设计:由主机在关键动作前提供一个小型、新鲜、经过验证的状态快照,同时保留测量、执行、评估和最终分派权限。我们使用 ToolRoute 测试其工具与网络实例,这是一个受控隔离基准,保持任务和候选语义不变,并改变模型可用的操作信息。在一项覆盖 GPT-5.6 Sol、Claude Sonnet 5 和 Gemini 3.7 Flash 的 216 次决策消融实验中,经过验证的工具健康状态将平均可观测策略遗憾较同形态中性对照降低 96.9%(从 4,252 ms 降至 131 ms),并将单次分派完成率从 69.4% 提升至 95.8%。在另一项包含实时本地 TCP/HTTP 执行、OpenTelemetry 客户端 span 和 Toxiproxy 注入故障的 27 次决策端到端复现中,经过验证的状态将平均遗憾从 8,956 ms 降至 0 ms(零额外可观测运营成本),并在 9/9 个模型×故障案例中完成实时动作,而中性对照为 5/9。这些研究确立了 Agent Harness Awareness 的工具与网络实例:选定的 hos

论文

How Finely Can Vision-Language Models See Biology? Bio-VQA: A Benchmark for Taxonomic, Morphological, Spatial and Individual Reasoning

视觉语言模型能多精细地观察生物学?Bio-VQA:一个用于分类学、形态学、空间与个体推理的基准

在生物多样性监测中,单张图像会引出若干问题:属于哪个分类单元、有多少个、具有哪种性状,以及该个体此前是否被见过。视觉语言模型(VLM)本可从图像中回答所有这些问 题,但其在生物学中的能力在很大程度上尚未得到检验,因为现有基准大多聚焦于少数分类类群内的物种识别。我们提出 Bio-VQA,这是最大的生物视觉问答(VQA)基准,也是唯一覆盖生物视觉理解四个方面的基准:层级分类学推理、细粒度属性定位、定量空间推理和个体重识别。Bio-VQA 包含来自 11 个公开数据集的 217K 张图像上的 1.86M 个问题,并将对错评分扩展为分级评分,因此接近正确的答案比相距甚远的答案得分更高。在评估来自 3.75B 至 38.4B 参数的 18 个开放权重模型后,我们发现通用视觉能力并不能迁移到生物有机体上:最佳模型在包含 2 至 10 个个体的图像上仅对 41.7% 的图像实现精确计数,不到其在相同计数日常物体上准确率的一半。分类学准确率降至六分之一,从门水平的 0.72 降至学名水平的 0.12,而规模扩展主要在粗糙分类层级上有帮助。与领域专家的差距也相应扩大,从纲水平上 0.731 对 BioCLIP-2 的 0.874(1.2 倍)扩大到学名水平上 0.269 对 0.544(2 倍)。在性状尺寸测量上,18 个模型中有 15 个的表现并不优于一个图像盲

论文

Agents, Think Only When it Helps

智能体:只在有帮助时思考

LLM 智能体蒸馏通过训练完整教师轨迹(通常交错思维与动作)将智能体能力迁移到学生模型。我们质疑思维监督对智能体最终动作性能有多关键。为回答这一问题,我们在蒸馏期间独立扰动教师的思维和动作,以解耦其影响。在跨模型规模广泛采用的智能体基准上,改变或丢弃思维对学生性能影响甚微。然而,我们发现,当训练时思维信息未在对应动作中披露,思维监督会变得重要。通过识别此类不一致案例,我们的发现挑战了为 LLM 智能体蒸馏完整教师轨迹的常见做法,并提供新见解:根据思维信息是否在动作中披露,思维监督可以成为效率上的可辨别选择。

论文

A Feasibility Condition for Confidence-Gated Tiered LLM Inference

置信度门控分层 LLM 推理的可行性条件

分层推理将大语言模型的计算分配到从端侧、边缘硬件到数据中心的设备层级上,并日益被视为实现更廉价、更低延迟、更具隐私性的服务路径。这类系统大多编排冻结的模型检查点,并且大多利用前向部署模型产生的置信度信号来决定哪些查询在本地解决、哪些向上升级。我们给出了一个闭式条件,用于判定在何种情况下,对该信号的任何阈值都无法使分层级联相对于将所有查询都发送至后备端更具价值。我们将路由决策建模为二元检验,并通过架构成本比 $\kappa$ 将本地成本与升级成本分离,从而推导出一个可行性条件,该条件由无信号下限与完美信号上限所界定:低于下限时,无论信号质量如何,级联均可行;高于上限时,任何级联均不可行。沿 $\kappa$ 轴来看,该条件会发生反转:在本地计算需要计费的情况下,成本起约束作用,这与近期的一项实证发现相符;而在本地计算为沉没成本的情况下(例如在去中心化硬件上),可行性变为无条件,信号质量转而决定级联所能达到的效果。我们将该条件转化为三项设计要求,而现有的训练内置原语仅能孤立地满足其中各项;并提出一种协同设计的架构与用于检验该架构的协议作为未来工作。该条件及其反转结论独立于该架构成立,它们正是本文的贡献。

论文

Adapting Qwen3 to Tajik from 0.6B to 8B: Lower Text Loss Did Not Mean Better Understanding

Small LoRA adapters trained on Tajik news and books lowered Qwen3's Tajik text loss at every size we tried, from 0.6B to 8B, by 0.60 to 1.45 nats per token, but none of them improved Tajik reading comprehension where it can be measured. On Belebele the 1.7B and 8B adapters left accuracy unchanged and the 4B adapter lowered it by 3.7 points; at 0.6B the score rose by 4.2 points but sits near chance and coincides with a change in which answer letter the model prefers, so we do not read it as understanding. At 8B, continued pretraining on about 375 million tokens of raw Tajik text was followed by a Belebele gain of 9.9 points. After a further supervised fine-tuning stage, our main model, e3, is 11.4 points above Qwen3-8B on Belebele; its English MMLU changed by -1.2 points, and a loss larger than 3.3 points is excluded. The same heavy recipe applied to Qwen3-0.6B-Base brought its text loss close to that of the 8B model after books-only pretraining, while its multiple-choice answers stayed near chance and its English MMLU fell by 7.6 points. We report 15 trained models and their 5 starting models from June to October 2025, scored in 2026 on one harness with paired intervals, and we report what went wrong: lost training records, a thinking-mode dataset with almost no reasoning in it, later branches whose training data was never documented, and a 4-bit release that contains no transformer layers.

论文

From Type to Token: Petri Nets, Individual Token Philosophy, and Individualized Causal Effects

从类型到令牌:Petri Nets、Individual Token Philosophy 与个体化因果效应

Structural Causal Models 与 Bayesian Networks 是表示因果关係的主导框架。它们本质上是类型层面的形式化方法,因为其估计量——Average Treatment Effects 与 Conditional Average Treatment Effects——是总体上分布的性质,而非个体单元的性质。当处理效应表现出无界异质性时,这些估计量就会失效。而持续存在的是因果关系的结构性、令牌层面的核心。我们认为,在 Individual Token Philosophy 下的 Petri Nets 是这些令牌层面因果结构的自然表示。我们开发了一种从 Bayesian Networks 到 Petri Nets 的形式化转换,为个体化因果性提供了双层解释。PN 层提供了因果机制的结构性表示,不依赖于分布假设。相应地,一个 conformal prediction 层以有限样本覆盖保证来量化因果效应。二者共同构成了对个体因果效应的完整解释。

论文

Learning When Human Decisions Matter: Executor-Relative Consultation Value for LLM Agents

Large language models increasingly automate complex tasks, but human decision capacity does not scale with their capabilities. In many applications, humans remain essential for providing private context, authority, or judgments unavailable to the agent. We formulate human decision capacity allocation: given multiple consultation opportunities and a limited budget, at which decisions should an LLM agent consult a human? The central challenge is estimating consultation value, which is executor-dependent because the same human input may benefit different downstream agents differently. We introduce Consultation Value Distillation (CVD), which estimates consultation values offline using Monte Carlo executor rollouts and distills these values into lightweight predictors for budgeted allocation, requiring no rollout-based value estimation at deployment. Across five batch and three sequential settings with two frontier executors, CVD improves allocation through joint and continuation-aware value learning, while independent consultation values remain competitive in several settings. CVD also broadly outperforms direct prompting and Value of Information where applicable, remains robust with substantially less rollout supervision, and enables nearly lossless approximate allocation at low search cost.

论文

When Does Better Confidence Improve a Knowledge-Graph Audit?

Confidence estimates guide human review in LLM-built knowledge graphs, but better error prediction can yield little improvement in an audit. We study this gap through repairability, selection headroom and label validity. Modelling non-adaptive auditing as budgeted covering, we characterise the minimal decision-relevant error statistics and bound the regret of scalar-preserving first-order planning by a structural mass $\Delta^{\mathrm{cl}}$. We simulate ideal repair against benchmark-aligned labels for five extraction configurations and two cross-document graphs on Re-DocRED, followed by frozen confirmation on test and replication on 500 hash-selected training documents. On the held-out cross-document graphs, an error-rate $\times$ fan-out queue leaves 3.98-4.74 percentage points more errors than a joint model with the same actions. By comparison, opening shared actions for that joint planner reduces residual errors by 0.89-1.43 points relative to its own fact-only plans, in point estimates. Equivalence between joint and independent-block models remains inconclusive. Generic LLM verification improves three of four model-budget configurations on each held-out set. LLM adjudication identifies possible benchmark omissions.

论文

How Well Can Large Language Models Impersonate Individual Authors? A Comparative Evaluation

This study investigates the authorship impersonation capacity of six widely used large language models (LLMs): Gemini 3 Pro, Claude Opus, GPT 5.2, GPT 5.2 Pro, DeepSeek 3.2, and Grok 4.1 Fast. The evaluation was conducted using short product review texts selected to ensure high within author consistency in individual writing style. Two types of in context prompt were designed: a simple prompt with minimal instruction and a complex prompt incorporating explicit stylometric guidance for mimicry. Authorship mimicry was evaluated using a cosine distance based distance to training metric, supplemented by visual analyses of embedding distributions. The results indicate that authorship impersonation remained challenging for most LLMs, with Gemini 3 Pro showing the strongest apparent mimicry performance. However, subsequent overlap analysis revealed that Gemini 3 Pro extensively copied and reused sentences and phrases from the training texts, at levels far exceeding those observed among human authors. Follow up factor analyses showed that training set consistency was the most robust predictor of mimicry success across models, whereas author distinctiveness did not generalise as a reliable predictor. Global embedding visualisations further revealed a consistent macro level pattern: for most models, generated texts occupied regions of the embedding space that were largely separated from the corresponding human training clusters. This indicates limited convergence towards target author style and suggests the presence of model specific lexical and phraseological preferences. The findings highlight the importance of distinguishing genuine stylistic imitation from direct textual reuse and have implications for the forensic analysis of textual evidence involving potential LLM enabled impersonation.

论文

TRUST-Stereo: Teacher-Assisted Robust Uncertainty-Guided Search and Transfer for Fast Stereo Matching

TRUST-Stereo:面向快速立体匹配的教师辅助鲁棒不确定性引导搜索与迁移

由粗到细的立体匹配能够实现高效视差估计,但仍对传播视差中的误差敏感,这些误差可能使真实对应关系落在后续局部搜索范围之外。我们提出 TRUST-Stereo(Teacher-Assisted Robust Uncertainty-Guided Search and Transfer for Fast Stereo Matching),通过不确定性引导残差搜索模块(UGRSM)解决这一局限。UGRSM 估计传播视差的可靠性并预测残差偏移,以自适应地重新定位局部代价体中心。此外,我们引入两阶段 Senior-Junior Teacher Assistant 知识蒸馏策略,将大型基础模型中丰富的单目表征迁移到轻量级骨干网络,以实现快速立体匹配性能。在 KITTI 2012、KITTI 2015、ETH3D 和 Middlebury 上的实验展现出较强的零样本泛化能力。仅使用 1.4M 合成立体图像对,TRUST-Stereo 在多项基准指标上取得当前最优结果,优于使用规模大得多的数据集(包括真实世界伪标注样本)训练的竞争性高效方法。具体而言,其在 KITTI 2015 上 EPE 达到 0.93,在 ETH3D 上 Bad 1.0 为 2.13%,在 Middlebury 上 Bad 2.0 为 6.79%,同时保持每对立体图像约 50 ms 的推理速度。

论文

Anchored Slice Propagation with Boundary Transport for 3D CT Segmentation from Three Orthogonal Annotated Slices

用于从三个正交标注切片进行3D CT分割的锚定切片传播与边界传输

Sli2Vol通过相邻切片之间的亲和力传播二值掩码,但误差可能持续存在,因为每个预测都会成为下一步的输入。三个正交标注减少了对任何单一链的依赖,但它们提供的不仅仅是三个起始掩码:当一条链与另一个标注平面相交时,正确的标签已经已知。这些标签可以在传播过程中纠正漂移,并在融合时指示对每条链的信任程度。在标注平面之间,链所携带的信息也可能很重要。二值掩码记录前景成员关系,但丢弃了到边界的距离,这一线索可能有助于跟随切片之间的渐变形状变化。我们使用固定的预训练亲和力骨干网络来解决这两个误差来源。我们通过在每条链与另一个标注平面相交处校正其预测来锚定该链,然后利用其与这些标签的一致性来加权融合。我们将这种锚定掩码与两种传输边界几何的方式进行比较:一种是通过稠密亲和力平均传播的截断符号距离场(SDF),另一种是其顶点遵循来自同一亲和力的运动线索的轮廓。轮廓跟踪器从手工设计的规则开始,并从506个CT体积中的超体素伪对象学习运动校正,无需手动器官标签。在来自约403次CT扫描、涵盖17个腹部结构的2,091个留出结构实例上,锚定将平均Dice从正交掩码传播的0.737提高到0.7

论文

Familiar letters, not related languages, let unseen languages into a shared space of meaning

Hundreds of languages have written text but almost no translations, and whether a model learning one from untranslated text builds on a related language or familiar letters is unclear: they usually coincide. Here we show that familiar letters, not a related language, let an unseen language into a shared space of meaning. GlyphMind, a tokenizer-free vision transformer that reads text as pixels and lets any sentence be shown in any script, was pretrained to align translations across 27 writing systems. Adapted on untranslated Lao, a language and script it had never seen, it retrieved English translations seven times as often as the strongest simple baseline. Rewritten in unfamiliar letters, Lao did not enter although its close relative Thai was in pretraining; Santali, which had none, entered in Devanagari, familiar from Hindi, but not in its own script. Transliteration into familiar scripts may thus open multilingual models to languages without translations.

论文

Grounded but Not Immune: Confirmation Bias in Agent-as-a-judge

有据可依但并非免疫:Agent-as-a-judge 中的确认偏误

评估开放式 agent 任务越来越多地落到 Agent-as-a-Judge 身上:给评估者配备工具和 agent 的完整轨迹,使其能对照环境验证结果。其前提是,自行收集证据的评委应当被这些证据所 grounding。我们表明,这种 grounding 并不能使评委免受确认偏误的影响:一条虚假的预筛选备注——它被归因于权威、且对正确裁决没有任何证据价值——在四名评委和五个数据集上,能推翻工具使用型评委多达 40% 的正确裁决,即便该评委收集到了决定性证据。这种转变由该线索的特定属性驱动。我们把这个线索视为对确认偏误的受控诊断,而非对抗性攻击。我们的核心贡献是解释确认偏误如何改变评委在轨迹中的行为。我们对评委行为的变化进行分类,并将其归因于三种失败模式之一:过度信任(先验证、正确得出结论,然后服从)、幻觉(为翻转裁决捏造支持),以及调查不足(在第一个佐证信号处停止)。对于两个 Claude 评委,失败主要是过度信任(占有害翻转的 67-75%),而较小的评委的错误模式则分布在三种模式中。轻量级缓解措施会削弱但从未消除这种偏误。

论文

Lesion Overlap Ranks PET Segmentation Models but Does Not Certify Patient-Level Tumor Burden

病变重叠度可对 PET 分割模型进行排名,但不能证明患者层面的肿瘤负荷

代谢肿瘤体积(MTV)概括全身 PET 疾病负荷,用于预后分层和治疗评估。自动化 MTV 只有在个体患者的估计可靠时才有用,但分割模型通常使用 Dice 等重叠指标而非负荷误差进行评估。我们使用 1,014 项 autoPET FDG PET/CT 研究,考察重叠指标是否能识别不可靠的 MTV 估计。我们评估了未参与微调的 LesionTracer 预测,在 489 例肿瘤阳性患者上比较了五个选定的已发布模型,并在 597 项 PSMA 研究中检验了这些发现。在五个 FDG 模型中,按较高平均 Dice 排名与按较低平均相对 MTV 误差排名得到的顺序相同($\rho=-1.00$,精确 $p=0.017$)。然而,在患者层面,折外 Dice 与相对 MTV 误差强相关($\rho=-0.75$),但 489 例患者中有 82 例(16.8\%)在 Dice 0.80 和 MTV 误差 25\% 阈值上处于相反侧。在暴露于训练的已发布模型中,相关性在更窄的高 Dice 范围内为 $-0.47$ 至 $-0.74$。在折外,相反方向的假阳性和假阴性体积抵消了净 MTV 中约三分之一的空间误差。在 489 例患者中的 236 例中,五个模型各自至少漏掉一个病变,尽管不一定是同一病变。因此,平均模型排名的一致性并不能证明个体 MTV 估计的可靠性,也不能揭示共同的病变漏检。PET 分割基准应报告

论文

Iterated creation, grading, and revision of data science projects by language models

语言模型对数据科学项目的迭代式创建、评分与修订

我们评估了智能体式(agentic)AI 模型在多大程度上能够完成端到端的数据科学项目,以及这种能力如何随反馈而提升。一个配备特定工具的"writer"模型会创建一个完整的数据科学项目,包括下载、清洗和分析数据集,并就此撰写一篇简短论文。项目会被执行,并由一个"grader"模型进行评估。随后 writer 可以修改其提交内容,如此重复,共进行三轮。我们考察了来自五家开发者的七个模型:Anthropic、OpenAI、Google、DeepSeek 和 Z.AI。每个模型既充当 writer 也充当 grader,因此共有 49 个 writer-grader 组合,我们对每个组合运行三次。在 147 份初始提交中,有 107 份能够运行并渲染,平均得分在最后一轮反馈后从 59% 提升到 76%。按 writer 划分,提升幅度从 Anthropic 的 Opus 5.5 的 3 个百分点到 Anthropic 的 Haiku 4.5 的 46 个百分点不等;按 grader 划分,则从 Google 的 Gemini 3.8 Flash 的 13 个百分点到 Anthropic 的 Haiku 4.5 的 32 个百分点不等。当模型给自己的作品评分时,得分往往比其他模型给它的平均分高出约 9 个百分点。我们观察到的轮次间差异中,约有一半落在 grader 自身的噪声范围内。反馈通常能带来最高分数,但即便只是有机会进行修改,或者仅仅拥有额外的时间或工具调用预算,而没有任何反馈

论文

Toward an Optimal Configuration for Tree Species Classification from Bark Images: A Leakage-Safe Ablation Study

面向树皮图像树种分类的最优配置:一项防泄漏的消融研究

背景:从树皮照片自动识别树种对林业资源调查和木材加工行业具有实际意义,但决定深度学习方法准确性的设计选择尚未被系统研究,且部分既有结果可能因同一树干图像在训练集与测试集之间泄漏而被高估。方法:在公开的 BarkNet 1.0 数据集(20 个树种)上,采用已确立的树级、防泄漏划分方案,开展系统性消融研究。使用 ConvNeXt-V2 骨干网络,依次改变以下因素并通过五折交叉验证进行评估:图像块大小、将各图像块预测聚合为图像级决策的策略、训练方式(单阶段与两阶段)、骨干网络容量、整图基线,以及推理时可用的图像块数量。结果:单块准确率随图像块尺寸单调上升(从 160 px 的 75.6% 升至 512 px 的 89.6%),图像级准确率也随之提升,在 512 px 附近趋于平台,约为 94.9%。学习式聚合最多比多数投票高出 0.7 个百分点,且随着图像块增大、注意力趋于均匀,这一优势会缩小。骨干网络容量(pico 至 tiny)对准确率的影响不到一个百分点,两阶段训练相较单阶段没有优势。整图分类(91.9%)落后于基于图像块的聚合,因为它没有可供平均的“包”;准确率随

论文

Holistic Parallel Supervision for Expressive Speech to Speech Translation

Expressiveness is central to speech-to-speech translation (S2ST), yet existing datasets rarely align source and target speech jointly in content, prosody, timing, and speaker identity. Consequently, current systems often rely on indirect conditioning or transfer mechanisms. To obtain this supervision, we introduce a training-data construction strategy that combines professional dubbing, which provides human-performed correspondence in content, prosody, and timing, with multilingual voice conversion to reduce speaker mismatch. We evaluate this supervision using existing expressive S2ST systems and DirectS2ST, an end-to-end method developed in this work that predicts the complete target-speech representation directly from source speech. Experiments on English-German and English-Spanish show that holistic parallel supervision improves expressive realization across all evaluated systems. DirectS2ST exhibits the largest gains in content, prosody, timing, speaker similarity, and human-rated expressiveness. To our knowledge, this work provides the first systematic investigation of holistic parallel supervision for expressive S2ST.

论文

Rewrite, Then Veto: Rewriter-Agnostic Edit Gating for LLM-Based Post-OCR Correction

LLMs can repair noisy OCR transcripts of historical documents, but they also change text that was already correct. We propose EditVeto, a veto gate placed after a full-context LLM rewrite. The rewrite is character-aligned to the OCR input, its differences are split into blocks, and a 0.6B-parameter gate keeps or reverts each block. An oracle analysis motivates the design: given the true error locations, per-span generation is worse than no correction, whereas vetoing a full rewrite's edits helps. Trained on rewrites by two Qwen3 models and evaluated, frozen, on the eight HIPE-OCRepair-2026 test sets, the gate improves all five rewriters tested, two of them unseen in training: weighted cMER falls by 0.0026-0.0044 and the preference score rises by 0.15-0.25 (paired bootstrap, p ~ 0.0002 each). On published competition outputs it lowers cMER for three of four teams but raises it for the winning run (0.0050 to 0.0065). In a second, disclosed test look, a retrained gate still improves LoRA-tuned rewriters (cMER -0.0011 to -0.0021), and an ensemble of their gated edits reaches a cMER of 0.0069 and a preference score of 0.928, mostly through fine-tuning and pooling rather than gating. Built only on public models and data, it is behind the winner (0.0050) and tied with the second-ranked run (0.0071), both from the only team using domain pre-training, and ahead of all other published runs. A third, secondary look shows the unchanged gate improving zero-shot Qwen3.8-27B (cMER 0.0114 to 0.0108) but only the preference score of its LoRA-tuned version.

论文

TandemBench: Benchmarking Decision Models for Multi-Agent Collaboration

Decision models choose among predefined options in tasks such as routing and action selection. In multi-agent collaboration, a decision determines how members divide work, exchange resources, and act in parallel. We introduce TandemBench, a benchmark of 1,200 questions in multi-agent cooking scenarios where coordination choices affect goal completion. Models receive complete global information and candidate team plans, with reference answers established through execution and exact search. Models select an optimal team plan and, in paired variants that retain or remove it, judge whether better arrangements exist beyond the supplied options. We evaluate 40 native decision models and compare them with 10 general-purpose language models. The best native decision model achieves 62.50% decision accuracy. Native decision models remain close to chance in optimality verification. Paired tests reveal that some report better alternatives regardless of whether an optimal plan is already present. These findings show that team-plan decision accuracy alone can conceal systematic errors in judging whether the supplied options contain an optimal arrangement. The dataset and evaluation code are publicly available at https://github.com/lililibaohang/TandemBench.

论文

Can Large Language Models Review the Scientific Literature? A Test Against a 102-Article Benchmark

大型语言模型能否开展科学文献综述?基于102篇文章基准的测试

大型语言模型(LLMs)正越来越多地被用于支持科学文献综述,但评估往往考察单个任务,而非整个综述流程。我们在四个阶段评估了六种 AI 工具:查找相关文章、解读文章、跨文章综合以及提出未来研究方向。该基准是一篇已发表的关于 Spanish plume 天气模式的综述及其 102 篇文章语料库。在初步检索中,五种工具共识别出 57 篇文章,其中表现最好的单一工具找到 42 篇。机构图书馆访问权限使 Codex 的发现量从 42 篇增加到 82 篇,使 Claude Code 从 15 篇增加到 79 篇。在获得完整的 102 篇 PDF 语料库后,三种工具正确识别出所有 18 篇实质性讨论 Spanish plume 的文章,但将 84 篇顺带提及中的 40% 至 79% 错误归类为实质性讨论。同样这三种工具生成的综合报告由两位领域专家进行了盲评。尽管大体准确,这些综合报告提供的洞见有限,有时还包含无依据的说法、引用错误以及夸大共识的表述。最后,三种工具提出的研究方向都超出了 Spanish plume 文献的范围,不过其中两种工具接近基准综述中提出的问题。没有单一工具在所有任务中表现最佳。我们为在文献综述中使用 AI 工具的研究人员提供了八项建议。我们的研究结果表明,LLMs 可以协助发现和解读……

论文

When to Ask, When to Answer: Strategic Clarification for Ambiguous Reference Resolution in Dialogue

For humans, referential disambiguation is a collaborative process involving clarification questions asked when they will meaningfully change the outcome. However, large language models (LLMs) have been shown to be biased toward premature answering, preferring definite single-turn responses over more clarification exchanges. In this paper, we study the problem of "strategic clarification" -- asking clarification questions in a reference game when their answers will narrow the set of candidate referents. We construct a controlled test environment from the SIMMC 2.1 dataset that records how many questions each ambiguous reference needs to be successfully resolved, and examine how baseline LLM behavior and common post-training methods ask clarifying questions vs. attempt to answer the referent. We also propose BACE (Belief-Aware Critic with Epistemic tracking), a lightweight action chooser method on top of a frozen LM backbone, and show that BACE more consistently chooses the optimal number of clarifying questions than methods such as GRPO and ArCHer.

论文

Discourse Analysis of Legislative Bill Discussions

Legislative hearings are distinct communication events with their own human recognizable structure and logic, yet they have been analyzed as distinct phenomena beyond their transcripts. Understanding legislative hearings at a deeper level is a major step in analyzing the work and power relationships within democratic bodies. In this work, we present a novel end-to-end pipeline for parsing rhetorical structures from legislative committee hearings with the goal of improving legislative discourse analysis and democratic accountability. We also propose a rhetorical structure grammar and find that 55.21% of California state bill discussions in our dataset can be parsed with this grammar. We evaluate our pipeline with two utterance section classifiers on a random subset of over 2,000 annotated utterances corresponding to 100 hearings. We find that a logistic regression-based classifier with grammar-based output masking and utterance tag smoothing outperforms more complex models, achieving an F1 score of 52.8% against our ground truth discourse section labels.

论文

ARIDA - Active railway infrastructure dataset annotation using neural network predictions

ARIDA - 使用神经网络预测的主动式铁路基础设施数据集标注

现代铁路感知需要大规模综合图像数据集,但人工标注(尤其是轨道折线和其他复杂基础设施几何)拖慢了创建过程。本文提出 Active Railway Infrastructure Dataset Annotation 框架,这是一种铁路专用的半自动流水线,可将 mask scoring 实例分割网络的实例预测转换为边界框、多边形、折线和成对折线。为在无真值情况下保持自动轨道几何标注的可靠性,它采用置信度阈值和独特的轮廓一致性质量评分作为接受门控。主动学习循环按不确定性对剩余图像排序,并调整每轮人工查询数量。这通过一种新颖的数量控制机制实现,其中简单图像被自动接受,人力集中于困难案例。在不相交、多样化影像以及时间序列、冗余影像上的实验量化了工作量减少与精度权衡,在不相交场景中减少约三分之二,在序列场景中最高减少 93%。该研究还为初始标注预算和停止时机提供指导,以避免过度标注。

论文

SO(3)-Equivariant Learning on CAD Boundary Representations

CAD 边界表示上的 SO(3) 等变学习

在边界表示(B-reps)上学习需要模型对零件位姿具有鲁棒性,因为 CAD 模型并非以规范朝向存储。现有的 B-rep 网络要么基于世界坐标系坐标和法向进行运算,因而在旋转下性能下降;要么将每个面编码在局部参考坐标系中。局部坐标系带来不变性,但会把面间消息退化为标量,并丢弃相邻面的相对朝向。我们提出 SO3brep,一种在 B-rep 面邻接图上的 SO(3) 等变图神经网络。节点特征在局部坐标系中计算,并通过 Wigner D-矩阵映射到共享坐标系。Clebsch-Gordan 张量积将这些特征与相邻面之间的方向耦合,使相对朝向在整个消息传递过程中得以保留,且输出保持 SE(3) 不变。在三个面分割和两个分类基准上(测试部件随机旋转),SO3brep 在对比的 B-rep 网络和等变点云网络中取得最高准确率,且参数量最少。在标注部件较少时优势最大,这是工业 CAD 的典型场景。代码见 https://github.com/UGent-CVAMO/so3brep。

论文

Assurance-Conditioned Continuous Authorization for Autonomous AI Agents

面向自主 AI Agents 的 Assurance-Conditioned Continuous Authorization

自主软件 Agents 可以通过工具行动、委派任务,并在先前的授权仍在生效的过程中更换其模型或执行环境。我们提出 Assurance-Conditioned Continuous Authorization (ACCA),这是一种被设计为与 harness 无关的方法,用于依据当前具备合理依据的 assurance 来维持运行权限。它区分证据有效性与上下文适用性,从合格证据中推导出 assurance 主张,并在主体声明的上限与适用策略范围内解析出多维度的有效权限包络。类型化依赖图支持对与授权相关的变更进行选择性重新评估。当有效权限发生变化时,authority epoch 随之变更;一个独立的可选 authorization-basis version 用于支持对特定动作的授权条件进行重新验证。受保护的 effect-time enforcement 可以在产生实际后果的资源变更之前拒绝过期动作,具体取决于可用的提交机制。可组合的 Domain Governance Profile 表达领域特定语义,但不授予权限。作为回归套件实现、使用交易类 profile 的受控场景测试,检验了默认拒绝规则、受证据约束的收缩与恢复、策略分歧、选择性不响应,以及在 simulated-broker 边界之前的本地网关处拒绝过期动作。该研究在单一领域内建立了实现层面的证据,而非跨领域的危害保证。

论文

Whose Values Are Generated? Measuring Visual Value Leakage in Multilingual Text-to-Image Generation

谁的价值观被生成?测量多语言文本到图像生成中的视觉价值泄漏

文本到图像(T2I)系统服务于使用不同语言、处于不同文化语境中的用户。然而,对文化表征的评估主要聚焦于地标、服饰和活动等可识别元素,忽视了生成图像所传达的文化价值观。为弥补这一空白,我们推出 VisionValueBench,这是一个多语言基准,将 Hofstede 文化价值维度中的六个维度(例如个人主义与集体主义)操作化,用以考察 T2I 系统如何以特定文化取向来框定中性的社会情境。我们发现,本应允许多样文化解读的价值中立提示词,生成的图像却偏向特定的价值取向,我们将这一现象称为视觉价值泄漏(visual value leakage)。我们在 960 个社会场景和六种 T2I 配置下评估了在语言和地理线索上有所不同的提示词。生成的图像在全部六个维度上始终偏向相同的价值取向,例如平等优于等级(低权力距离)、个人自主优于群体义务(个人主义)、享乐优于克制(放纵)。提示词语言对这些取向的影响有限,而地理线索会使部分维度向相关文化价值观偏移,但在很大程度上保留了主流取向。这些发现揭示了全球 T2I 系统所传达的文化价值观存在显著同质性。

论文

Whose Transparency is it Anyway? Understanding Generative AI Transparency Needs and Gaps Across Stakeholders

透明性究竟属于谁?理解跨利益相关者的生成式AI透明性需求与差距

透明性已成为AI治理的核心原则,但关于透明性意味着什么、为谁服务以及在何种情境下适用,仍缺乏共识。本文借鉴技术的社会建构(Social Construction of Technology)中的解释灵活性,考察不同利益相关者如何理解和体验生成式AI中的透明性。本研究基于一项覆盖400名最终用户、AI开发者和政策制定者的全球调查,并辅以与最终用户开展的结构化焦点小组,将定量发现扎根于当前透明性实践中最未被充分服务群体的定性见解。我们呈现三项关键发现。第一,三组群体对透明性的含义及其应提供什么有着相似理解,核心在于确保准确性和隐私。第二,最终用户在透明性特征的重要性与其感知可用性之间的差距显著大于开发者,揭示了权力如何塑造所构建的内容及其服务对象。仅28%的最终用户报告当前透明性实践非常好地反映了其需求,而开发者和政策制定者分别为53%和49%。第三,透明性是情境性建构的,优先级随情境和任务结构而变化,角色特定框架在情境需要时被激活,在不需要时则退隐。我们认为,有意义的AI透明性需要超越一刀切方案,包括当前对AI披露和静态文档的强调。

论文

From Tokens to Trajectories: Parameter-Efficient Continuous Adaptation of Unified Multimodal Models

从 Token 到轨迹:统一多模态模型的参数高效连续适配

统一多模态模型(UMMs)中的离散 token 化虽然建立了强大的语义推理能力,但也引入了严格的量化瓶颈,导致细粒度视觉细节退化,通常生成结构准确但伪影严重的图像。我们提出 FlowShift,一种参数高效的后训练框架,通过将预训练的离散 UMMs 转换为连续 rectified-flow 生成器来绕开这一瓶颈。FlowShift 不丢弃骨干网络的语义先验,而是用连续潜变量投影替换离散视觉接口,并对注意力层应用 LoRA。为了在不产生语义漂移的前提下高效提升视觉质量,我们提出双目标速度向量蒸馏(Dual-Objective Velocity Vector Distillation, DOVD),使模型与高保真连续教师模型以及真值连续轨迹对齐。该方法在显著提升感知质量的同时,保持了提示词遵循能力和推理能力。将 FlowShift 应用于领先的离散 UMMs 时,COCO-30K FID 和美学分数显著提升,同时保留超过 99.5% 的多模态理解能力。消融实验证实 DOVD 驱动了生成质量的提升。最终,FlowShift 在不牺牲预训练语义基础的情况下实现了高保真连续生成。

论文

BrainBind: Bridging Synchronized EEG and fMRI through Long-Form Naturalistic Video Representations

BrainBind:通过长时自然视频表征桥接同步EEG与fMRI

真实世界视觉是动态且场景丰富的,而EEG和fMRI分别在互补的时间尺度和空间尺度上对其进行解析。然而,大多数神经解码系统仅孤立地对单一模态进行对齐,且主要针对静态图像或短片段。我们研究同步场景:EEG与fMRI在同一长时自然观看过程中被记录,既提供了共享刺激,也带来了反复出现的叙事上下文和许多语义相近的候选。我们提出BrainBind,一个将同步EEG和fMRI映射到冻结的长时视频嵌入空间、并将这些空间视为共同视觉语义参照而非字面神经编码的框架。在CineBrain上,一个跨两个视频锚点和四种系统配置的五种子Recall@K 2 x 4矩阵显示出不同的检索特征。使用Omni时,fMRI对完整候选列表的组织最强(MRR = 23.82,nDCG@10 = 25.31),而Joint-Dual给出最高的平均标签感知R@1(13.52%),并具有不同的全排名分布特征。互补的按片段不相交评估量化了重复刺激身份和叙事上下文对随机划分的贡献。在这些实验中,代理选择和系统配置在当前同步数据集内产生了不同的最高排名与全排名检索特征。代码见 https://github.com/Forainest789/Brainbind。

论文

Visual Forensic Detection of Fabricated Bangla News Photocards using Deep Learning

使用深度学习对伪造的孟加拉语新闻图片卡进行视觉取证检测

在孟加拉国,许多本地化的虚假信息以图片卡形式传播:这些单图新闻摘要模仿知名新闻机构的品牌标识。由于误导信息存在于像素中而非机器可读文本中,基于文本的事实核查工具无法发现它。我们将图片卡假新闻检测重新定义为视觉图像伪造检测。我们构建了一个数据集,包含从公开Facebook页面抓取的969张真实和1,077张伪造孟加拉语图片卡:真实卡片来自17家国家电视广播机构的认证页面,伪造卡片来自伪广播机构页面、匿名个人资料和公开群组。每张图像进行16种光度与形态学变换,将语料库扩充至32,736个样本。一个全连接ANN仅达到约52%的准确率,其损失停滞在ln(2) ~ 0.693,表明展平图像破坏了伪造检测所需的空间线索。一个紧凑的、全批量归一化的四块CNN,具有489,954个参数,约为ANN的1,644倍小,使用无泄漏的分层分组五折交叉验证进行评估,该验证将一张卡片的每个增强版本保留在同一折中。在此协议下,CNN从头训练达到87.45% +/- 0.53%的汇总准确率,当其分类器头从ANN热启动时达到88.75% +/- 1.55%。一个ImageNet预训练的YOLOv8n-cls骨干(144万参数)在相同折上微调达到97.36% +/- 0.42%,标志着紧凑模型之上的余量。我们报告了pe

论文

Spatio-Temporal Multi-Order Interaction for Video Recognition

用于视频识别的时空多阶交互

许多用于视频识别的时间方法依赖显式的跨通道聚合投影,其复杂度在通道数量上呈二次增长,从而引入显著的计算开销。此外,用于视频识别的时空表示存在偏置:CNN 偏向局部阶交互,而 transformer 偏向全局阶交互。我们的方法从 MogaNet 的多阶空间表示出发,引入两项互补贡献来解决这些问题。首先,在时间建模方面,我们引入仅使用深度卷积的并行多阶处理以及基于隐式门控的聚合,其复杂度在通道数量上呈线性,从而大幅降低计算量。其次,我们提出空间与时间维度之间的双重交互,能够在不增加计算成本的情况下获得更好的时空表示。结合这两项贡献,我们提出的 VideoMogaNet 在多个视频基准(UCF101、HMDB51、Kinetics-400、Diving48)上达到与最先进动作识别方法相当或更优的性能,同时显著降低了时间分支的成本。

论文

Cognitive Bias Signatures in Search-Equipped LLM Agents: A Stage-Resolved Analysis

Search can help LLM agents correct mistakes, but their starting conditions may shape which evidence they find and use. Drawing on cognitive-bias paradigms, we develop a controlled search harness to examine result order, records of prior work, and initial hypotheses while holding each question and document collection fixed. Matched controls distinguish order effects from differences in document composition and the effects of failed work from context length. Across 10 models and 1,000 synthetic search worlds, we track queries, retrieved documents, document openings, and final answers. Our comparisons suggest that final answers are more sensitive to initial evidence order during active search than when all evidence is supplied in full. Dead-end histories can reduce strategy switching relative to matched neutral histories, indicating an effect beyond context length. Under wrong hypotheses, stage measurements distinguish reduced retrieval or opening from errors that persist after counter-evidence is opened. Exploratory interventions show that opening counter-evidence more often can coincide with lower accuracy, while accuracy can improve with little change in opening.

论文

Challenge-Aware Knowledge Recruitment with Meta-Agent Supervision for Medical Multi-Agent Reasoning

用于医疗多智能体推理的挑战感知知识招募与元智能体监督

大型语言模型在标准医学问答上表现强劲,但在更难的推理任务上性能下降,多智能体辩论往往无法击败强单模型提示。我们认为一个关键限制是现有系统仅根据问题本身选择专家和检索知识,而不是根据推理过程中出现的缺口。我们提出挑战感知的自适应招募:一个外部 CHALLENGER 检查不断演化的推理轨迹,并识别具体的事实或专业缺口。这些信号触发有针对性的知识检索或讨论中途的专家招募。在 MEDAGENTSBENCH 困难子集(涵盖九个生物医学数据集的 862 个问题)上,预先检索几乎没有收益,而挑战感知的中间检索表现更好;在多专家骨干上,它在 9 个数据集中的 8 个上提高了准确率,并比 Challenger Only 高出 6 个百分点。消融实验表明检索时机和缺口特定查询信号都带来收益,实时网络搜索实验显示该时机优势在不同检索后端上持续存在。对于专家招募,自触发适应不可靠,而 Challenger 触发的招募将 GPT-4.1-mini 在 MedQA 上的准确率从 46% 提高到 54%,在所有测试的泛化数据集上均呈正向趋势。简单地结合检索和专家招募会降低性能,凸显了协调自适应干预渠道的必要性。这些结果表明,何时以及

论文

ChangeJEPA: Predict Before You Compare for Remote Sensing Change Detection

ChangeJEPA:先预测后比较的遥感变化检测

遥感变化检测通常被表述为孪生特征比较:两幅图像分别独立编码,然后由解码器判断哪些差异对应有意义的变化。这具有挑战性,因为编码器会同时保留真实场景变化和干扰性变化,例如光照、季节、辐射和几何差异。我们提出 ChangeJEPA,一种双时相联合嵌入预测架构,将变化检测重新表述为潜在后状态预测。给定变化前图像和部分变化后证据,ChangeJEPA 在两种互补条件下预测完整的变化后表示:一个由变化前场景推导出的先验假设,以及一个以观测到的变化后上下文为条件的更新假设。联合嵌入预测损失将两个假设与目标潜在表示对齐,在抑制瞬态外观变化的同时鼓励语义一致性。随后,变化由变化前表示、观测到的变化后目标和预测的潜在状态之间的不一致推断得到,捕获变化、先验意外、上下文更新和预测可靠性的互补证据。在 SYSU-CD、LEVIR-CD+ 和 CDD 上,ChangeJEPA 始终优于其解码器匹配的孪生基线,最高提升 1.51 个 IoU 点,并在三个基准上均取得最佳 IoU 和 F1-score,展示了潜在后状态预测相较于 di 的优势

论文

RAGCompass: Generalizable Retriever Routing via Reranking

Different retrievers exist for retrieval-augmented generation, yet none performs best for all queries. Therefore, the key question is: given a query and retrieved passages from different retrievers, which one is most suited for that query? Existing routers usually make predictions from query-specific features and a fixed pool of retrievers; such routers have no output for an unseen retriever and are incapable by design on a new corpus. To fill these gaps, RAGCompass reads the retrieved passage sets themselves: passages from an unfamiliar retriever or corpus stay directly comparable to other passages, so routing stays well designed where a query-only map would fail. We contrastively fine-tune a reranker against the answer each evidence set produces, which accounts for most of the gain; a small comparison head adds a moderate improvement, and neither component has retriever-specific parameters. RAGCompass improves answer F1 by 28% relative to the best fixed retriever, and outperforms fusion baselines, three query-only routers, and a prompted 8B language model. Generalization experiments show that RAGCompass keeps most of its gain under an unseen corpus, retriever, or reader, while query-only baselines fall to the best fixed retriever or below.

论文

Prospective Memory for Proactive LLM Agents

Most memory systems for LLM agents are retrospective, preserving and retrieving past information to inform current decisions. Proactive agents, however, also require prospective memory: retaining future-directed intentions and realizing them when appropriate opportunities arise, even without explicit requests. Crucially, remembering the right intention does not guarantee acting at the right time: a related observation may call for waiting, while a later cue may make the same intention actionable. Inspired by cognitive theories of human prospective memory, we introduce Pro-Memory, a memory framework that separates maintaining future intentions from deciding when and how to realize them. Pro-Memory preserves pending objectives linked to their supporting evidence, assesses new observations against their original goals and activation conditions, and coordinates appropriate contributions with the agent's ongoing actions. It further updates intention states based on actions actually issued or evidence of resolution, while an experience memory distills feedback from completed episodes into guidance for future decisions. Experiments on two benchmarks spanning delayed-intention tasks and open-ended proactive assistance demonstrate consistent improvements in proactive task performance over representative memory approaches across multiple LLM backbones, while limiting unnecessary interventions.

论文

When Does Sharing Work? Scaling a Shared SigLIP2 Across Image, Video, Audio, and Audio-Visual Representations

共享何时奏效?将共享的 SigLIP2 扩展到图像、视频、音频和视听表示

对比预训练推动了图文理解的发展,但图像、视频和音频编码器仍被独立训练,跨模态对齐主要通过事后绑定到一个冻结的锚点空间来实现。我们提出 Omni-Encoder,一种通用的多模态编码器,在单个 SigLIP-2 Vision Transformer 中以完全共享的参数处理图像、视频、音频和视听输入。与以锚点为中心的绑定或逐模态适配器不同,所有模态都进行端到端联合优化,且该框架从输入到训练进行了系统组织。模态原生输入阶段首先将每种信号映射到共享嵌入空间,其中包括一个一维卷积音频分词器,将 mel 频谱图转换为与视觉 patch 对齐的 token。随后,由绝对时间戳参数化的多模态旋转位置嵌入将视觉帧和音频片段置于统一的时空坐标系中。最后,交替模态训练将图像、视频、音频和时间对齐的视听批次交错排列,并将其梯度累积到一次更新中,我们发现这对稳定的联合优化至关重要。Omni-Encoder 用一套共享参数在全部四种模态的 16 个基准上取得了有竞争力的结果,并且联合训练使每种模态都优于其单独训练的对应版本。代码和模型将公开发布。

论文

DS@GT ARC at CheckThat! 2026: A Verdict-Anchored Pipeline for Generating Fact-Checking Articles

Misinformation spreads faster than professional fact-checkers can manually verify it and write articles explaining their verdicts. This creates a need to automate the production of fact-checking articles. This paper details work done by the DS@GT ARC team for CLEF 2026 CheckThat! Lab Task 3 Fact-Checking Article Generation. We seek to generate a full fact-checking article from a claim, its original verdict, and a set of scraped source documents. Our team built a four-stage pipeline that cleans noisy evidence, retrieves and clusters relevant sources, generates the article by conditioning \texttt{Llama-3.1-8B-Instruct} on the original fact-checker verdict, and recovers inline citations through deterministic post-processing. We achieved a mean score of 0.428 and ranked 3rd out of 9 teams for the CLEF 2026 CheckThat! Lab Task 3, compared to a baseline mean score of 0.272. Our code is available on GitHub at https://github.com/dsgt-arc/checkthat-2026-task3.

论文

From Visual Matching to Textual Conditioning: Cross-Domain Few-Shot Segmentation via Reference Inversion

从视觉匹配到文本条件化:通过参考反演的跨域小样本分割

跨域小样本分割(CD-FSS)旨在仅使用少量带标注的参考来分割来自未见域的对象。近期基于 Segment Anything Model(SAM)的方法推动了 CD-FSS 的发展,但其参考-目标视觉匹配对目标外观变化高度敏感。SAM3 引入了文本条件分割,使自然语言描述能够引导跨目标图像的分割,但在严重域偏移下直接使用类别名称作为条件仍会导致性能不稳定。我们提出面向 SAM3 的 Reference Inversion(RI-SAM3),利用 SAM3 的大规模视觉-语言预训练为每个目标类别学习合适的文本 token。RI-SAM3 包含三项核心设计:(i)双层参考反演(Bi-level Reference Inversion),在冻结的文本编码器前后学习互补 token:前者保持锚定在 SAM3 的文本空间中,后者更灵活地表示类别;(ii)层自适应文本条件化(Layer-adaptive Textual Conditioning),随着对象查询在不同解码器层中演化,以不同方式组合这些 token;(iii)存在感知置信度监督(Presence-aware Confidence Supervision),联合监督查询置信度和目标存在性以获得可靠预测。在 SAM3 冻结的情况下,RI-SAM3 每个类别仅优化约 12K 参数,并且通过可复用的文本条件化在单次前向传播中高效分割每个目标,无需逐样本的参考-目标视觉匹配。在多个广泛采用的

论文

Reasoning is topologically simple

推理在拓扑上是简单的

我们提出并研究如下假设:与非推理文本相比,推理文本具有更简单的共现拓扑结构;并且与质量较低的推理相比,质量较高的推理具有更简单的共现拓扑结构。我们讨论并测试了其在 AI safety 和 AI evaluation 中的应用。

论文

Recursa: Toward Recursively Self-Improving Foundation Model Systems

Recursa:迈向可递归自我改进的基础模型系统

在不断变化的环境中,基础模型可能会遇到其原始训练未覆盖的陌生领域知识。然而,新领域很少提供大量由专家创建的训练数据或可靠的监督信号来进一步训练。我们提出 Recursa,这是一种基础模型系统,无需人类专家或更强的教师模型,就能通过从自身经验中学习来适应新领域。Recursa 使用知识库来存储所学内容:领域特定技能以及何时应用这些技能的指令,还有过往任务经验的记忆以及关于改进方向的反思。Recursa 从领域材料中自举构建知识库,然后通过递归自我改进对其进行精炼。它使用并行学习器执行任务并合成局部改进,然后验证这些改进并将其合并到知识库中。在 Harvey LAB 的 Firm Knowledge 基准上,Recursa 使用 DeepSeek-V4.1-Flash 将留出测试任务的全通过率从 30.0% 提升至 55.0%,使用 Qwen3.8-Flash 从 35.0% 提升至 46.0%。

论文

RATSIFT: Resolution-Adaptive Transformer for Solar Irradiance Forecasting and Temporal Downscaling

RATSIFT:用于太阳辐照度预测与时间降尺度的分辨率自适应 Transformer

准确预测太阳辐照度并进行时间降尺度,对于可靠的可再生能源并网和电网管理至关重要。传统方法往往难以捕捉辐照度的快速变化。在本工作中,我们开发了一种基于 Transformer 的架构,可同时进行预测和时间降尺度。该模型接收任意分辨率的输入数据,并生成训练数据中所表示的任何分辨率的输出,同时利用全局和局部上下文信息。为提高训练效率,实现了一种基于遗传算法的优化框架来识别合适的模型超参数,同时降低穷举网格搜索的计算成本。通过分析 Dallas, Texas 的真实数据,展示了所提出模型的有效性。所提出模型在 15、30、60 分钟以及不规则间隔的全局输入并分别生成 5 分钟分辨率预测时,均方根误差(RMSE)值分别为 28.785、29.544、30.157、32.132 W/m\\(^2\\)。此外,该模型产生了可靠的不确定性估计,在太阳条件多变时,高分辨率输入表现出更宽的预测区间,而较粗分辨率输入则导致更窄的区间,并显著降低训练时间和计算成本。我们的方法为多分辨率太阳辐照度预测和时间降尺度提供了一个可扩展且高效的框架,适用于实际能源 for

论文

Camera Radar LiDAR Fusion via Point-Cloud Projection for Multi-Task Learning

通过点云投影的相机雷达LiDAR融合用于多任务学习

自动驾驶汽车需要稳健的感知系统,以在多样化环境条件下安全运行。虽然相机提供高分辨率视觉数据,但其在低光照和恶劣天气下的性能会显著下降。高清(HD)雷达在此类条件下具有更高的可靠性和角分辨率,但缺乏丰富的视觉特征识别能力。LiDAR虽然昂贵,但能提供高精度距离测量和密集点云。每种传感器都有独特的权衡,因此需要开发先进的传感器融合算法,以利用互补优势,同时最小化计算复杂度并保持准确性。在本研究中,所提出的融合架构通过将相机图像与来自HD雷达和LiDAR传感器的透视视图点云数据相结合,实现早期融合。所提出的模型被训练用于同时检测车辆和分割可自由行驶空间。实验在RADIal数据集上进行,我们证明在前视图中将点云数据与相机图像融合,超越了最新独立模型和融合模型的性能。

论文

The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules, Unevenly Across Models

Banks validate language models, but they deploy systems: a model inside a harness that decides what it sees, which tools it can call and who checks its actions. We test whether that harness changes compliance with banking conduct rules when the model is held fixed. Four open-weight models each ran five harnesses (a pipeline that makes one structured decision, a ReAct-style tool loop, a loop in which the policy is reachable only through search, a loop with a long benign customer memory, and a loop with a same-model compliance reviewer) on 156 pre-registered cases in a simulated retail bank whose 11 rule families paraphrase EU consumer-credit, payments, investor-protection, data-protection and anti-money-laundering provisions. Every one of the 3120 two-turn episodes was scored deterministically from the executed tool trace, with violations and over-refusals counted separately. Pooled across models the harness moved the correct-case rate only between 87.3% and 92.1%, but within a model it mattered a great deal: for one model the spread between its best and worst harness was 11.5 percentage points, enough to move it from first to last place among the four models, while for another the harness made no detectable difference; the model x harness interaction itself was suggestive rather than conclusive. The same-model reviewer cut violations from 9.6% to 6.4% without raising over-refusals, contrary to our pre-registered prediction. Rules that require date arithmetic failed in every harness. In an exploratory analysis with two LLM judges and a blind human check, 26% of violations were accompanied by a customer message that denied the action the agent had just executed, which a transcript-only review would record as a correct refusal. For model-risk management the unit of validation should be the model-harness pair, and conduct testing should read the action log, not the conversation.

论文

NitroFusion2: Bringing Adversarial Loss to the Text Stream of Multimodal Diffusion Transformers

NitroFusion2:将对抗损失引入多模态扩散 Transformer 的文本流

对抗扩散蒸馏传统上依赖图像特征进行判别。我们针对多模态扩散 Transformer(MMDiTs)重新审视了这一选择:其文本流通过联合注意力变得依赖图像。我们提出文本流对抗蒸馏(TSAD),利用中间文本 token 状态作为一种新的对抗表示。由于文本流已经读取图像,同时仍与文本条件绑定,改变该条件会改变它从图像中提取的信息。基于这一特性,我们提出方面线索判别(ACD),让判别器以样本的不同方面(如排版、物体或风格)为条件,从而引导对抗训练中强调哪些属性。基于 NitroFusion 的专家判别器设计,我们在 NitroFusion2 中集成了 TSAD 和 ACD。NitroFusion2 将少步蒸馏从传统的 4-8 步范围降至仅 1-2 步,同时保持相当的质量。在一步时,它能生成清晰渲染的文本和丰富的细粒度细节,使一步生成变得实用,而不仅仅是蒸馏的压力测试。在两步时,它在所评估的基准上仍具竞争力。这些结果确立了 MMDiT 文本流作为对抗扩散蒸馏中强大且可引导的表示。

论文

Same Origin, Different Verdicts: Text Production Conditions Confound Machine-Generated Text Detection in Russian

Automated detection of machine-generated text is applied where the verdict carries a cost for the author, yet origin is a property of the production process, not an observable property of the text. The conditions under which a text is produced push it in the same direction in which a generative model is presumed to push it. This study measures the contribution of these conditions while origin is held fixed. The Russian-language corpus of 1882 documents comprises a machine part, generated by four generation channels (each backed by its own model family) across 45 tasks in three task modes, and an archival human part annotated for source regimentation level before the texts were read. The primary contrast is computed within the machine corpus: both halves of a pair are generated by the same model for the same task and differ only in task wording. Machine-likeness is measured by four operationalisations: an interpretable index with weights fixed before data collection, a trained classifier, a zero-shot metric on an open model, a judge model. The main result is disagreement between procedures: changing the task mode shifted the scores of all four, but three gave a negative shift, the judge a positive one, and none of the four intervals covers zero. The comparison plan and the specifications of procedures 2-4 were fixed after the result of procedure 1, before procedures 2-4 ran; the disagreement survived correction of a corpus defect and of the nested validation. A baseline on the source identifier alone reaches a median AUROC of 1.0000 on the thirteen group splits where it is defined, and removing emphasis markers flipped a confident machine verdict to human without changing the full text by a single character. The scores are properties of a specific measurement system and corpus: they reflect data collection, repetition, formatting, and preprocessing decisions as well as linguistic style.

论文

C-WFDM: A ControlNet-Guided Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Completion

C-WFDM:一种ControlNet引导的小波融合扩散模型,用于多模态脑MRI补全

多模态脑MRI可提供互补的解剖、组织和病理信息,以支持下游人工智能(AI)应用。然而,在公开和汇总的神经影像数据集中,各模态的可用性并不均衡:T1加权(T1w)MRI广泛存在,T2加权(T2w)和液体衰减反转恢复(FLAIR)MRI的可用性相对较低,而钆增强T1加权(T1Gd)MRI则较为稀缺。因此,汇总数据集包含具有不同已采集MRI对比组合的受试者,这反映了各贡献研究在研究设计、采集协议以及临床或研究目标上的差异。许多缺失模态基准通过从完整的四模态病例中扣留对比来模拟不完整MRI,这可能无法代表汇总数据集中观察到的可用性模式。为弥补这一空白,我们提出C-WFDM,这是我们的Wavelet-Fusion Diffusion Model(WFDM)的ControlNet扩展,用于受试者特定的缺失模态补全。C-WFDM构建于早期BrainScape快照之上,该快照包含157个公开MRI数据集和45,880次预处理扫描。预训练的WFDM主干保留目标模态和元数据条件,而目标特定的ControlNet适配器使用同一受试者的MRI对比来指导合成。C-WFDM从T1w合成T2w,从T1w和T2w合成FLAIR,并从T1w、T2w和FLAIR合成T1Gd。已采集的条件对比在可用时会被使用。

论文

PersonaCodeBench: Evaluating Coding Agents in Persona-driven Human-Interactive Sessions

PersonaCodeBench:在人格驱动的多人交互会话中评估编码智能体

编码智能体必须在交付正确软件的同时,尊重用户的知识水平、偏好和工作条件。现有基准测试越来越多地纳入交互,但个性化需求的满足仍未被充分探索。我们提出 PersonaCodeBench,将用户特征转化为可验证的义务,置于人格驱动的多轮编码会话中。我们的人格池涵盖角色、技术能力、交互偏好和实际约束,从而为需求实现、权限、测试、解释和交付生成有任务依据的演化需求。在运行时,由控制器管理用户模拟器的响应和需求披露,并利用在线需求评估提供反馈并推进交互。需求逐步浮现,其内容、披露条件和验收标准在评估前即已固定。完成验证器和个性化验证器分别评估原生正确性和人格满足情况。联合通过要求同时遵守声明的预算并符合有效性条件。我们评估了所有主要前沿智能体,建立了全面的排行榜,并开展了详细的实验分析以验证有效性。PersonaCodeBench 支持对编码智能体在实现编码目标的同时满足明确、个性化用户期望的能力进行可复现评估。

论文

Human-like cross-language generalisation in deep neural speaker embeddings and its acoustic foundations

Generalisability is a central question for deep neural networks, including the cross-language generalisation of speaker embeddings. This study examined whether deep neural speaker embeddings generalise across languages and how such generalisation relates to human perception and acoustic structure. Using Cantonese--English bilingual speech presented in within- and cross-language conditions, we derived similarity from 18 state-of-the-art models and compared it with human ratings and acoustic features using linear mixed models and representational similarity analysis. Embeddings exhibited cross-language generalisation that broadly paralleled human behaviour, reflecting accurate identity discrimination and sensitivity to language switching. This generalisation relied on largely shared acoustic cues with language-sensitive weighting, mirroring human patterns. Together, these findings provide converging evidence for human--machine alignment in cross-language voice similarity processing.

论文

PointNDF: Cascaded Neural Displacement Fields for Point Cloud Denoising

PointNDF:用于点云去噪的级联神经位移场

点云去噪旨在从含噪的三维观测中恢复干净的几何形状,同时保留精细的表面细节和点集底层的空间分布。许多基于学习的方法采用两阶段流程:先从含噪输入中提取逐点特征,再通过简单回归预测逐点位移。然而,这些方法往往缺乏稳健的特征引导和分布感知的几何细化,导致其无法维持最优的点均匀性与几何质量。为解决这些局限,我们提出 PointNDF,一种将 patch 级几何上下文与局部位移预测相结合的去噪框架。具体而言,Point Transformer V3(PTv3)编码器将多尺度几何信息聚合为全局 patch 描述符。神经位移场(NDF)并非直接回归无约束的位移向量,而是将该全局 patch 描述符与逐点邻域特征融合,随后通过有界向量分支和尺度因子分支预测每个位移,从而实现更优、更均匀的点分布。三个级联的 NDF 阶段传播局部特征并逐步细化点位置。在 PU-Net 和 ModelNet10 上的实验表明,该方法具有有竞争力的去噪精度和良好的推理效率。源代码已公开于 https://github.com/peridous/PointNDF。

论文

Attributing Agent Failures to Their History Needs an Executed Counterfactual: Toward a Reporting Standard

将 Agent 失败归因于其历史需要已执行的反事实:迈向报告标准

已发表的关于长时程 agent 为何失败的解释,通常是对完整轨迹进行标注的分类体系:评判者阅读转录文本并命名失败。我们认为,将 agent 的行为归因于其历史的主张应附带经干预验证的证据,按实例或通过经过验证的估计器:冻结一个可执行的轨迹中状态,仅改变 agent 所看到的历史,然后继续——是执行而非从转录文本推断,在一个其恢复已被测量的状态上,并带有与估计目标匹配的重放证书。我们命名的四类操纵中的每一类都有先例,且若干方法已经能够从检查点、重新执行的前缀或记录的对话状态执行干预(例如 DoVer、REFLECT、Min et al.、Who&When Pro、Causal Agent Replay),但没有任何一个报告经过测量的重放证书。接下来是两个警示性测量,二者均未应用该标准:一个是载体分类体系,其“集中度”无法与基准构建分离(调整后的比值比为 1.15,区间跨过 1);另一个是哈希相同的快照,将其恢复到相同种子的进程中时,在 24/24 个状态上彼此一致,而在 24 个状态中有 9 个和 20 个与实时继续不同。恢复随机流的捕获位置使所有 24 个状态都与实时运行一致。

论文

Multimodal Fusion Methods for Whole-Slide Images and Clinical Data in Inflammatory Bowel Disease

炎症性肠病中全切片图像与临床数据的多模态融合方法

组织学与临床数据的多模态 AI 融合是计算病理学中一个活跃的研究方向,但融合方法很少在相同条件下、跨不同临床终点进行比较。我们提出一个模块化框架:切片级嵌入(通过在冻结基础模型的 patch 嵌入上训练基于注意力的聚合器获得)与每次就诊的临床嵌入一起,被输入 15 种可互换的融合方法,这些方法共享相同的输出维度和预测头(决策级方法除外)。使用一个新诊断炎症性肠病患者的前瞻性队列,我们从基线或随访就诊中预测符合 STRIDE-II 的缓解结局。最佳融合方法达到 macro-F1 为 0.57–0.75,在六种场景中的四种中优于两个单模态模型,并且因结局和输入而异。图像依赖度,即移除切片嵌入后平衡准确率的下降幅度,倾向于随缓解类型而变化——组织学缓解最高,内镜缓解最低;准确率相近的方法对切片的依赖程度却差异很大。

论文

Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers

This paper presents an overview of \emph{SciClaimEval}, a pilot task at NTCIR-19 on verifying scientific claims against the tables and figures of the papers in which they appear. Our dataset pairs authentic claims from 180 papers in machine learning, natural language processing, and medicine with contrastive versions of their tables and figures, one supporting the claim and one minimally modified so that it does not. The task comprises two subtasks: deciding whether a piece of evidence supports a claim, and selecting which of two evidence versions does. Twenty-two teams registered, the highest number among NTCIR-19 tasks, and 14 submitted 177 runs. Most systems built on multimodal large language models, relying on prompting and multi-stage inference rather than task-specific fine-tuning. On the first subtask, the best systems reached 98.1\% pair accuracy, but all six top-ranked systems relied on the contrastive pairs; the best system that judged each claim-evidence pair on its own scored 24.3 points lower. Open-weight models, embedded in carefully designed pipelines, matched proprietary ones. Yet verifying a single claim against its evidence, the setting that matters in practice, remains an open problem.

论文

Quantifying Trait-State Hierarchy in EEG Foundation Model and Signal Processing Embeddings

量化 EEG 基础模型与信号处理嵌入中的特质-状态层级

脑电图(EEG)通过记录头皮电位来测量大脑活动。EEG 记录在信号中捕获两组不同的特征:(1) 特质(Traits)——在记录会话期间保持相对恒定的信息,例如受试者身份、年龄和性别;(2) 状态(States)——编码对外部刺激(包括视觉、听觉和运动信息)响应的特征。目前对不同 EEG 建模特征(信号处理与基础模型)如何编码状态和特质特性的理解仍然有限。在本工作中,我们使用层级度量和 kNN 纯度,在脑机接口(BCI)数据集试验上量化 EEG 嵌入所捕获的状态级和特质级特征,并发现大多数 EEG 特征形成宏观特质层级(嵌入形成特质级簇,其中包含微观状态)。我们的线性探针结果表明,这种层级结构导致状态可区分性次优,对 EEG 基础模型的 BCI 性能产生负面影响。为缓解这一问题,我们探索了减少嵌入中特质特定信息的归一化技术,并在状态分类的平衡准确率上带来约 10% 的提升。此外,我们观察到,当下游状态解码对模型进行微调时,嵌入空间会从宏观特质层级转变为宏观状态层级,从而带来更好的状态解码效果。

论文

Anduin: A sybil-resistant agentic marketplace reputation system

Anduin:一个抗女巫攻击的智能体市场声誉系统

随着自主 AI 智能体进入无需许可的链上市场,选择新的服务提供商仍是一项核心挑战。现有声誉系统依赖于稀缺资源,如人工策展、身份凭证或自愿评价,而简单的交易量排名容易受到女巫攻击。我们评估现有的链上支付历史能否产生对女巫攻击具有韧性的提供商评分。使用涵盖 16 条区块链、价值 610 万美元的 6600 万笔智能体交易的 157 天数据集,我们将支付流建模为买家与提供商之间的二分图。提供商的评分由与买家现有可信网络相关联的图路径推导而来。我们提出三种抗女巫攻击的评分算法:一种最大流评分,以及两种为获得更强评分表现而优化的松弛算法。在 813 名买家上针对模拟对手评估这些算法,我们表明评分操纵的成本相当于这些买家总支出额的 20%,且其被操纵的难度约为标准相似性规则(协同过滤)的 23 倍。

论文

When Every Choice Is Correct: A Causal Study of Numerical Preference in Language Models

When a language model chooses a number between 1 and 30, every integer in the range is valid, yet the model can favor particular answers. We use numerical choice to study how preference is processed across layers and tokens. Perturbation probing and gradient attribution nominate neurons for activation interventions. In a selected Qwen3-4B case, a pre-answer edit changes 17 to 15 while both runs first emit 1. After the edit ends, selective cache and attention-output replacements trace part of its continuing influence on the second digit. Replacing one attention head's output or the other heads' outputs jointly produces similar immediate readout contributions; both interventions restore 17 but have different final log-odds effects on 7 versus 5. Holding later multilayer perceptron (MLP) outputs at their values from the edited run without either replacement reduces this effect gap from 0.119 to 0.0025 nat. Later computation therefore changes how similar local contributions affect the continuation. Retrospective estimates across eighteen contexts capture much of the probability movement but miss the selected answer switch. Prompt tests also separate influence from answer changes: one held-out prompt retains influence without switching, and only one of twelve fresh wordings qualifies for the reader/MLP test; there, joint MLP clamping again reduces the gap between the two reader effects while the answer remains 17. These results use numerical choice as a controlled case for studying persistent state and conditional downstream processing; they do not establish the origin or a complete circuit of natural numerical preference.

论文

Discarded or Unreachable? Diagnosing and Repairing Spatial Relation Failure in Vision--Language Similarity

被丢弃还是不可达?诊断并修复视觉--语言相似性中的空间关系失效

对比视觉-语言模型对左/右关系的评分接近随机水平,但该症状有两个需要相反修复的成因:关系可能仍存在于池化嵌入中,却无法通过原生图像-文本相似度访问;或者池化将其丢弃,而稠密特征仍保留它。在干净的双物体照片上,跨越十个编码器,横向极性可从池化向量的翻转奇分量中以 0.77-0.99 的线性可解码性读出,但在百万条描述上进行搜索时,十中有九在原生评分下仍处于随机水平:这是一种访问失败。在受控的 C4 轨道上,关系是唯一变化因素,池化将排列轴保持在 0.998-1.000 并丢失其极性,而 patch 网格保留极性:这是一种池化失败。两者都位于稠密特征的下游,因此一个读出即可覆盖两者。我们的零参数、查询条件化空间矩从 patch 网格重新计算几何,并将其作为向量存储在原生嵌入旁边。在 118,287 张图像的索引上,它将针对反向几何负样本的左/右成对准确率从 0.51-0.53 提升到 0.81-0.96,并将 21 个类别匹配候选中的条件 R@1 从 0.05 提升到 0.37-0.75,每个批查询耗时低于一毫秒,同时对未指明关系的查询精确复现原生排名。

论文

CCDWIKI: Decoupling Case Formulation from Response Generation in Longitudinal CBT Dialogue

Cognitive Behavioral Therapy (CBT) demands more than empathic validation, requiring instead a structured formulation of the interplay among situations, automatic thoughts, emotions, and behaviors. Therapists formalize this interplay through a Cognitive Conceptualization Diagram, where maintaining longitudinal coherence necessitates continuous evidential adjudication to separate tentative hypotheses from established findings. Current dialogue systems track conversational history via retrieval or static profiles but lack the representational capacity to encode epistemic status. Consequently, provisional interpretations are often prematurely reified as established facts, inadvertently biasing downstream interventions. Addressing this limitation, CCDWiki is introduced as a plug-and-play advisor conceptualizing longitudinal therapy as evidence-grounded hypothesis adjudication. The approach encodes each clinical hypothesis as a mutable entry bound to corroborating and contradicting evidence. Across sessions, accumulating data strengthens supported entries, preserves provisional ones, and retracts contradicted assumptions. The resulting formulation distills into concise guidance for unmodified therapeutic language models. Experiments demonstrate substantial improvements in both conceptualization and intervention quality without requiring backbone retraining.

论文

Selective, Risk-Controlled Emotion Forecasting in Conversation: From a Persistence Barrier to Departure Detection with Conformal Guarantees

Forecasting emotion in conversation is increasingly framed as predicting the next emotional state's value. We show this targets a hard quantity in a state-observed testbed and propose a learnable, deployable reformulation instead. On valence-arousal-dominance trajectories from a dyadic corpus, repeating a speaker's own previous state sets a persistence baseline that no frozen-encoder correction meaningfully improves upon and a state-space filter exceeds; the floor requires the historical state to be observed, since an estimated anchor collapses persistence below a direct forecaster. What survives is the timing of a departure from persistence, learnable on three of four corpora and near chance on the highest-base-rate corpus, a negative result we report. We recast the task as selective departure forecasting: a lead-time-weighted metric with a leakage protocol, and commitment policies whose best choice switches with the departure rate. A dialogue-level conformal risk control bounds the expected loss of committed predictions, meeting the target in all twelve configurations tested, though the guarantee is bought through abstention, with coverage and alarm recall falling sharply on the hardest corpus. One tested language model's confidence fails as a ranking signal where another succeeds, a model-dependent failure not yet attributable to family versus scale. Code and result logs are available from the corresponding author upon request.

论文

Uncertainty-Aware Resource Orchestration for Agentic AI Systems

面向 Agentic AI 系统的不确定性感知资源编排

由大语言模型(LLMs)驱动的 Agentic 人工智能(AI)系统以自主多步流水线方式执行,动态调用工具、将观察结果整合到记忆中,并迭代直到任务解决或资源预算耗尽。与具有固定图的经典工作流不同,此类流水线的总计算、带宽和端到端延迟需求在调度时是未知的:它们在运行时由中间观察和随机 token 采样产生,形成重尾、多峰随机变量。这种不可预测性迫使基础设施编排器陷入两难:资源供给不足可能导致执行中途被限流和违反截止时间,而资源过度供给则会浪费稀缺的边缘或云容量。现有调度器要求完全已知的流水线图,而边缘资源管理方法依赖参数化或平稳需求模型,二者都不适合 Agentic 流水线未知、非平稳的负载特征。我们将这一设定形式化为不确定性感知的 Agentic 编排问题,其目标是在调度时预留能够覆盖实际流水线需求的计算和带宽分配,并验证流水线能够满足其截止时间,每项均具有规定概率。我们随后提出 Conformal Reservation for Orchestration(CRO),一种在线算法,它将过去执行轨迹的滑动窗口转换为调度时资源分配,并具有有限样本、分布

论文

Towards Efficient Whole Page Ranking with One-Pass Inference

迈向高效单次推理的整页排序

整页排序联合优化广告与自然内容,在复杂布局和业务约束下平衡商业结果与用户参与度。现有的非自回归(NAR)方法能够实现高效的页面生成,但通常独立于先前已选物品对候选物品打分,限制了其捕捉顺序依赖交互的能力。自回归(AR)方法通过序列条件化解决了这一限制,但会带来大量推理开销,给大规模部署带来挑战。弥合这种质量与效率之间的差距仍是工业整页排序中的一项挑战。我们提出 Multi-Item Scoring (MIS),一种前缀感知的 NAR 风格框架,将序列上下文融入高效的多物品打分。MIS 在共享表示架构中集成了全局候选交互、局部前缀条件化和位置感知打分。通过每次请求只计算一次可复用表示,并在约束束搜索期间执行轻量级前缀条件化打分,MIS 无需重复全模型推理即可捕捉重要的序列依赖。在 KuaiRand-1K 和 RL4RS 上的实验表明,MIS 接近自回归 CGA 基线的生成质量,同时 CPU 解码速度分别提升 4.07 倍和 3.54 倍。在一项大规模社交视频平台上的随机评估中,MIS 将 realization 指标提升 0.104%,观看时长提升 0.058%,w

论文

Towards Robust Long-Lived Agents: Benchmarking Experience Lifecycles in Evolving Environments

迈向稳健的长寿智能体:在不断演变的环境中基准测试经验生命周期

随着智能体能力不断增强,它们正从一次性任务转向跨连续用户目标的持续协助。这种协助要求智能体发现陌生环境如何运作、跨任务复用所学内容,并在环境演变时保持这些经验不过时。现有基准越来越多地研究经验复用与适应,但对智能体会修订、保留或丢失积累经验中的哪些部分所提供的洞察有限。为弥补这一空白,我们提出 ReScopeBench,这是一个覆盖 18 个交互环境的经验生命周期基准。它将关于环境如何组织和访问的结构性经验,与关于指导跨任务决策的可复用原则和约束的规则性经验区分开来。为研究经验如何被获取、复用和修订,我们提出一种经验优先的构建方法。它围绕共享经验构建任务流,并引入静默环境变化。我们评估任务表现,并跟踪每条任务流中已保存经验的变化。在 20 个模型上,我们发现保留的经验能提升任务表现,但智能体难以在环境变化时保持其时效性。即使所需经验被正确记录,智能体也并不总能成功完成任务。这些发现将选择性维护和有效使用确定为长期存续智能体的互补挑战。

论文

Augmentation with Reinforcement Transformation for Low-textured Scientific Sketch Image Retrieval

用于低纹理科学草图图像检索的强化变换增强方法

低纹理草图图像广泛应用于野生动物保护、考古绘图和法医合成等科学领域。从此类图像中学习和检索具有挑战性,因为它们缺乏现代深度学习模型通常依赖的详细表面纹理和视觉变化。本文提出强化变换增强(Augmentation with Reinforcement Transformation,ART),用于微调预训练模型,以学习有效表征,从而实现准确的草图图像检索。我们的关键观察是:草图对旋转、翻转、缩放和拉伸等图像变换尤为敏感。一些变换能保持其结构完整性,另一些则可能引入失真,从而阻碍表征学习。ART 不是随机选择变换来构建微调视图,而是将增强选择建模为多臂老虎机(multi-armed bandit,MAB)问题,将变换视为臂,并通过奖励持续评估其有效性。这使 ART 能够在自监督微调之前自适应地构建由奖励引导的视图库;后续的表征损失不会反馈给 ART。在 Mote Marine Laboratory 提供的 Florida manatee 草图上,ART 在变换疤痕检索上取得 71.40% 的平均 Top-1 准确率,而随机增强选择为 68.83%;在位置感知草图检索上为 55.84%,而冻结 CLIP 为 18.18%。

论文

Who May Overrule the Agent? Evidence-Gated Authority in LLM Review Institutions

谁可以推翻智能体?LLM 审查制度中的证据门控权限

多智能体语言模型系统常常加入审查者来改进上游智能体的决策。然而,审查者既可能修复错误,也可能替换原本已经正确的决策。我们将此视为制度性管辖权问题:在相同提案、任务信息、模型和审查输出条件下,审查者何时被授权使其建议具有约束力?我们比较宽泛的推翻权限与一种证据门控——仅当审查者给出关于违反约束且修复合规的机械有效记录后,才允许替换。在两个本地运行的开源权重模型、96 个空间策略任务以及一个 96 任务的投资组合迁移基准上,门控大幅减少对正确提案的破坏,同时保留大多数对违规的修复。这种权衡的方向部分由规则本身决定;其幅度取决于审查者的状态转换和上游提案状态。随后一项前瞻性验证让审查者明确选择保留、替换或上报。这消除了 Qwen 的正确提案被破坏问题,但 Mistral 仍替换全部 48 个正确提案;Qwen 也拒绝了 Mistral 经常尝试的所有仅涉及福利的修复。因此,接口设计会改变审查者行为,但不是与模型无关的保障。结果并不是受限审查普遍更好,而是审查者能力、行动接口和约束性管辖权共同决定纠正域……

论文

mmHand: Toward Pixel-Level-Accuracy Hand Localization Using a Single Commodity mmWave Device

mmHand:利用单台商用毫米波设备实现像素级精度的手部定位

由于应用场景广泛,手部定位问题长期以来一直是研究重点。该任务将手部建模为单个点,并确定其在给定坐标系中的位置。然而,受数据模态限制,现有手部定位技术面临若干挑战。例如,基于视觉的定位会引发隐私问题,而基于可穿戴设备的方法会降低用户舒适度。本文提出 mmHand,一种全新的非接触式、隐私保护的动态手部定位系统,利用单台商用毫米波设备实现像素级精度。我们首先提出 mmImage 生成工具,从原始毫米波数据中充分提取空间信息,并引入一种新颖的毫米波数据二维图像格式表示。接下来,我们设计了一个框架,为毫米波数据提供新的质量评估方法和像素空间标注。最后,我们提出一种跨模态空间特征增强模型,具备强大的空间特征提取能力,能够在毫米波雷达 U-V 像素坐标系中以像素级精度准确定位手部位置。我们在三种场景下对 12 名受试者进行实验评估,四项指标的结果证明了我们手部定位系统的有效性。

论文

AI-Driven SaaS Platform Integration: AI Express for Unified Generative AI Services with Pay-As-You-Go Credit Systems and Scalable Microservice Architecture

Generative AI is currently fragmented, with separate subscriptions required for text generation, image synthesis, and code assistance, leading to high costs and workflow disruptions. AI Express is a SaaS platform that consolidates these capabilities into a unified pay-as-you-go service. The platform provides a range of AI tools, including a Core Code Reviewer that evaluates GitHub repositories, a Text-to-Website generator that converts text into fully functional websites, script generation, grammar checking, data analysis, and watermark removal, all accessible through a single interface without requiring technical expertise.

论文

From Activation to Intervention: Interpreting Sparse Visual Features through Reconstruction

从激活到干预:通过重建解释稀疏视觉特征

稀疏自编码器(SAEs)将视觉表示分解为独立特征,为解释模型行为提供了有前景的基础。解释这些特征通常依赖于最能强烈激活它们的图像或像素区域。然而,当多个语义不同的特征频繁在同一位置激活时,例如同一图案中的纹理和颜色,这种证据会变得模糊。我们提出重建式 SAE 干预(Reconstructive SAE Intervention, RecSAEI),一个将特征解释从被动观察转向主动视觉重建的框架。通过沿 SAE 解码器方向干预表示并重建视觉输出,我们为特征的语义含义提供直接证据。我们证明,我们的方法在多个数据集和视觉编码器上成功消除了特征含义的歧义。此外,我们的框架将 [CLS] SAE 干预建立在稀疏的一组图像块 SAE 解码器方向上。除了稳定的目标响应之外,这种归因还揭示了基本视觉模式与高层语义之间的组合关系。我们的结果主张将干预重建作为解释神经网络的重要补充信号。

论文

Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription

Streaming speech recognition is increasingly consumed by machines, such as translators and voice agents, that act on each token as it appears. A token that is later revised costs wasted work or a wrong action. In this work, we present Confucius4-R2T2 (short for Real Real-Time Transcription), a stable-prefix streaming ASR model that never modifies its earlier output while maintaining high accuracy and low latency. R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of Chinese and English audio while freezing its pre-trained audio encoder and projector. The adaptation is based on the concept of Longest Stable Prefix (LSP), a new notion that we introduce in this work. We prove that LSP is monotone under the prefix order, consistent with the full-audio output, and maximal among labels that equal a whole earlier output. Learning from LSP labels converts a full-context model into a stable-prefix streaming one without any architectural change. Extensive evaluations show that R2T2 brings streaming recognition close to the base model's full-context quality while delivering stable text with low emission lag. Its gains extend beyond the post-training languages, demonstrating a practical path from full-context ASR to stable streaming. We open-source the model weights and code at https://huggingface.co/netease-youdao/Confucius4-R2T2 and https://github.com/netease-youdao/Confucius4-R2T2.

论文

Hybrid Spark: Adaptive Speculative Decoding That Lets the Content Choose the Drafter

Hybrid Spark:让内容选择草稿器的自适应推测解码

推测解码(SD)可加速大语言模型(LLM)服务,但其收益取决于工作负载的形态(如批大小和上下文长度)以及内容。基于模型的草稿器可针对任意内容提出短块,而无模型草稿器(如 n-gram 查找)在输出重复其输入时(例如代码编辑)能以几乎零成本提出长复制。自适应验证将整个批次的验证预算花在最可能被接受的草稿 token 上,但它仅支持一个基于模型的草稿器。无模型草稿器不提供逐 token 置信度,因此无法参与预算分配,部署时必须固定一个草稿器或在草稿器之间拆分 GPU。我们提出 \sys,一个在每一步同时运行基于模型和无模型草稿器的框架,并在自适应验证内、完全在 GPU 上为每个请求提供两者链中更优者,从而保持异步调度不受影响。关键思想是每个已验证草稿 token 的价格:该槽位在批次其他位置本可获得的有效吞吐量。一旦无模型草稿器的 token 携带校准后的接受概率估计(在通用文本上一次性拟合),这一价格就将两个草稿器的链放在同一尺度上。在 vLLM 中以 \dspark 和 n-gram 草稿器实例化后,\sys 在代码编辑、批大小为 4 时输出吞吐量达到 \dspark 的 1.10--1.62 倍,批大小为 128 时为 1.04--1.27 倍,而在温度为 0 的聊天场景中保持为其 0.97--1.01 倍。单一部署

论文

Role-based Effectiveness of an Epistemic Uncertainty Estimate in Training Models for Semantic Segmentation of 3D LiDAR Point Clouds

基于角色的认知不确定性估计在3D LiDAR点云语义分割训练模型中的有效性

点云分割是3D数据分析中的一项基础任务,应用遍及机器人、增强现实与虚拟现实以及遥感等领域。然而,点云固有的稀疏性、噪声和无序特性带来了显著挑战,尤其是在实现可靠分类方面。尽管最先进的方法依赖训练模型来显式建模不确定性,但在探索使用生成式方法估计不确定性所能扮演的不同角色方面仍存在空白。本工作通过显式建模认知不确定性并将其用于不同角色(即作为特征和用于损失函数)来研究确定性不确定性在点云分割中的影响。我们在四个大规模LiDAR基准(涵盖机载和移动采集,即ISPRS Vaihingen、AHN3、Paris-Lille-3D和Toronto-3D)上评估了一个基线人工神经网络(ANN)和两个不确定性感知变体(不确定性作为额外输入特征,以及作为训练损失中的逐样本置信度权重),并纳入了PointNet++和RandLA-Net参考模型及其不确定性增强对应模型,采用规范的空间不相交训练/测试划分。在该协议下,不确定性感知建模提升了平均交并比(mean Intersection over Union),找回了基线ANN完全无法预测的少数类,并在半数配置中改善了预测误差与估计不确定性之间的一致性(以Patch衡量)。

论文

Learning Hierarchical Patch Splitting Policies for Faster Vision Transformers

学习分层图像块拆分策略以加速Vision Transformers

Vision Transformer(ViT)受限于其输入token序列的长度。标准图像块化通过在整个图像上应用单一图像块尺寸来固定该长度,而不考虑区域内容。此前关于自适应图像块尺寸的工作通过为视觉上简单的区域分配更粗的图像块来减少token数量,但依赖局部熵等带噪声的像素级启发式方法来做出分块决策。我们认为,这种计算分配应基于模型对任务相关信息的解读,而不是原始像素统计。我们提出Split Policy Learned Image Tokenization,它学习根据模型认为有意义的内容来分配token分辨率,从而生成更短且与任务相关内容更匹配的token序列。SPLIT在使用少30% token的情况下,达到了全分辨率ViT分类基线的准确率。同样的收益也适用于密集预测:SPLIT在COCO和ADE20K上取得有竞争力的准确率,表明语义对齐的分块方法能很好地泛化到分类之外。

论文

Combining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps

使用反馈模糊认知图混合来组合相关专家知识

一个神经符号系统应当只组合来自专家代理或其他知识源的相关答案。随着知识网络不断增长并连接越来越多的知识源,针对给定输入查询仅使用相关专家对准确性和可扩展性变得愈发重要。我们扩展了证据法理论中相关性的标准定义:一个答案当且仅当在现有知识下对当前事项既具有证明力又具有实质性时才是相关的。我们将这一相关性方案应用于混合真实或人工专家的反馈模糊认知图(FCM)。专家FCM的有向因果图混合或组合成一个共同知识网络。我们将专家的平衡极限环预测或答案与混合FCM的答案进行比较,然后通过它们的差异或变化来估计答案的证明力状态。一个新的类贝叶斯定理解混知识混合物,得到相应的类后验FCM,这些FCM也允许基于相关性的比较。结果是一组最终的相关性混合权重,为给定查询生成一个相关性混合的FCM知识网络。因此不同查询会产生不同的相关性混合FCM。我们使用由实际13节点专家FCM生成的合成FCM来演示这种相关性方法,该专家FCM建模缺血性卒中风险的成因和反馈。

论文

SRRM: A Retrieval-Reconstruction Benchmark for Evaluating Long-Context Memory in Small Language Models

Small Language Models (SLMs) are increasingly deployed on consumer-grade hardware, yet their ability to preserve information across progressively longer contexts remains insufficiently understood. Existing benchmarks primarily evaluate retrieval-oriented tasks, providing limited insight into whether successful retrieval reflects comprehensive long-context memory preservation. To address this limitation, this paper introduces Simple Retrieval-Reconstruction Memory (SRRM), a lightweight and fully reproducible benchmark that jointly evaluates Targeted Retrieval and Global Information Reconstruction. This study also proposes the Memory Preservation Ratio (MPR), a benchmark-level metric that quantifies the relationship between retrieval and reconstruction performance. SRRM was evaluated using a synthetic dataset on three Qwen2.5 models (0.5B, 1.5B, and 3B parameters) across context loads ranging from 10 to 100 factual statements. Experimental results show that reconstruction performance deteriorated substantially faster than retrieval accuracy as contextual information increased, indicating that retrieval alone is insufficient to characterize long-context memory preservation. Among the evaluated models, Qwen2.5-1.5B achieved the highest retrieval accuracy (86.7%), reconstruction performance (45.7%), and MPR (0.53), outperforming the larger Qwen2.5-3B model (72.2%, 18.5%, and 0.26, respectively). These findings demonstrate that increasing parameter count does not necessarily improve long-context memory preservation. Overall, SRRM provides a reproducible and extensible benchmark for systematically evaluating long-context memory while revealing complementary memory behaviors that remain hidden under retrieval-only evaluation frameworks.

论文

ViBench 2.0: A Benchmark for Long-Horizon Software Building

ViBench 2.0:长周期软件构建基准

在 Replit 这一智能体工程平台上,用户现在无需编写代码,只需向智能体连续提出功能需求,就能构建完整产品。然而,现有的编程基准评估的是单个、完全明确的任务,且许多已接近饱和。我们推出 ViBench 2.0——一个用于长周期软件构建的基准,并用它来选择我们平台的模型。该基准包含 17 个全栈 Web 产品,参照广泛使用的软件建模,经过 241 次功能需求逐步扩展,并且只在完成时进行评判,评判方式与用户的评判方式一致:由浏览器智能体运行 544 个测试计划,只有当所有计划都通过时,一次构建才算通过;该评分协议经过验证,可确保这一严格分数可靠。在评估九个模型后,我们发现了一个可靠性差距:三个最强模型最多通过 98% 的测试计划,但最多只在 65% 的构建中交付完整可用的产品,而没有任何开放权重模型能做到这一点。这一差距正在快速缩小:在同一个模型系列的三个版本中,公开产品上的 pass@1 从 3% 升至 53%,而每次构建的成本下降了一半以上。我们发布了八个产品及其运行框架和评分器,保留九个不公开,并报告了来自生产使用的经验。

论文

PEEK: One-Step-Look-Ahead Exposure Bias Correction for Diffusion Sampling

PEEK:用于扩散采样的单步前瞻曝光偏差校正

扩散图像生成器的成功得益于精确的去噪网络和强大的数值采样器。然而,这两个组件并未完全匹配。在采样过程中,去噪器基于与真实数据差异很大的有缺陷输入来预测下一步。这种训练-测试差距,即曝光偏差,限制了图像生成质量(例如模糊、缺乏细节或形状不自然)。为缓解这一问题,我们提出 PEEK,一种新颖的无需训练的确定性采样器插件。在每个符合条件的去噪步骤中,PEEK 首先执行一次临时的单步更新,在向前看的状态下对去噪器评估一次,并将其与再下一步的预测进行插值,以形成下一个噪声状态。通过采取额外的一步,我们从更高信噪比的噪声状态中获得通常更接近图像特征的预测,从而缓解曝光偏差。为优化插值位置,PEEK 搜索插值调度,并通过前缀缓存和基线噪声调度重定基准缓存提高效率。在 8 个像素空间和潜空间扩散模型上,涵盖无条件、标签引导和文本引导设置以及多种输出分辨率,PEEK 在 NFE 匹配的基线上持续改进,FID 提升最高达 49.3%,且额外计算成本极低(例如,在我们的实验中,每个模型的一次性校准最多耗时 2.2 分钟)。项目网站为 https://dachengruoque.github.io/PEEK-Video/。

论文

Information-Matched Auditing of Conversational Emotion-Shift Forecasting: A Leakage-Safe Evaluation Protocol

Comparisons in conversational emotion-shift forecasting are easily distorted when a learned model receives rich features but its transition baseline is given a noisy or unavailable current-emotion label, when hyperparameter budgets differ, or when target-turn information enters the representation. We present an information-matched, leakage-safe auditing protocol that closes these gaps with an explicit commitment point, executable causality tests, equal four-configuration validation searches, and seed-dialogue-aware inference. Applying it to six causal model families on four text corpora and two feature-source sensitivity configurations shows that a deployable train-only current-emotion classifier feeding the transition baseline yields a different verdict than an oracle diagnostic where both sides receive gold current emotion. Under the deployable condition, learned models improve over the predicted-label baseline on all four primary corpora; DailyDialog gains are large and survive a 72-comparison Holm correction (best ROC-AUC gain = +0.167, adjusted p=.0144). Under matched gold information, the baseline remains competitive on IEMOCAP and stronger on MELD, while every model retains a large DailyDialog advantage. We additionally report precision-recall AUC, calibration, a strictly utterance-local feature control, same-person self-shift forecasting, and a future-access dose-response test. An eight-item leakage checklist accompanies the protocol. Code, raw seed predictions, and reporting artifacts are available from the corresponding author upon request.

论文

Mitigating Spurious Invariance in Contrastive Learning: A Probabilistic Self-Supervised Learning Framework for Medical Image Analysis

缓解对比学习中的虚假不变性:面向医学图像分析的概率自监督学习框架

由于对海量医学图像进行人工标注的成本高昂,自监督学习(SSL)受到了广泛关注,并在多种医学影像任务中展现出前景。在 SSL 方法中,对比学习已成为一种突出的方法,鼓励模型编码在不同增强视图之间保持不变性的语义信息。然而,对于医学图像而言,这种不变性可能是虚假的,因为在增强过程中细微但关键的医学特征可能被抑制。本文通过将学习到的特征嵌入编码为概率分布而非固定向量来缓解该问题,从而捕获更丰富、更细致的信息谱。此外,我们提出了一个统一概率框架,无缝集成多种 SSL 方法。我们的方法在多个数据集上的多种下游任务(包括医学图像分割和分类)中优于最先进的 SSL 方法。我们进一步通过针对更强增强的鲁棒性、有限微调标签下的标签效率以及计算权衡的额外分析来验证该方法。代码发布于 https://github.com/wwzjer/ProbSSL。

论文

GaussianRenderFormer: Transformer-based Rendering of 3D Gaussian Splats

GaussianRenderFormer:基于 Transformer 的 3D Gaussian Splats 渲染

神经网络能否在没有光栅化器的渲染器中自行学习渲染 3D Gaussian splats?我们提出 GaussianRenderFormer,这是一个 transformer,接收一组 Gaussians 和相机,直接输出图像。每个 Gaussian 在视图无关的编码器中变成一个 token,而视图相关的解码器通过关注这些 token,将相机射线的小块区域转换为像素。在 26,820 个 Objaverse 对象(每个裁剪至 20,000 个 Gaussians)上训练后,GaussianRenderFormer 针对完整、未裁剪的 splats 渲染 300 个未见对象,达到 38.08 dB PSNR,而对相同裁剪输入进行光栅化则达到 44.02 dB。这一差距并非泛化问题,我们的诊断结果与视图解码器存在瓶颈一致:告知其每个 Gaussian 的投影足迹(它原则上可以推断出来),可增加 1.4 dB。不能排除训练不足。代码、训练模型和视频:https://svlwoof.github.io/gaussianrenderformer

论文

ProcessPrefBench: Evaluating Cross-Task Transfer of Individual Process Preferences from Naturalistic Human-AI Interaction

In natural human-AI dialogue, users' corrections, requests, and self-descriptions carry reusable signals about how they want work to be done. These signals reveal individual process preferences, user-specific standards for evidence, depth, analytical focus, procedure, and delivery. We ask whether a preference revealed in one dialogue can shape an assistant's later answer when the task does not restate it. ProcessPrefBench uses three months of natural dialogues from two knowledge workers to build 66 source-target cases separately judged for source evidence and target applicability. Sources are preselected, so the benchmark tests application rather than retrieval. We test three models with target-only, full-history, and distilled-preference prompts. Target-specific 0-2 rubrics score preference realization, and a task gate flags severe failures. Compared with target-only prompting, full-history and imperative distilled-preference prompting raise preference realization by 0.204 and 0.244 points on the 0-2 scale, respectively, with no reliable advantage from distillation. Fabricated-evidence failures rise from 5.8% under target-only prompting to 10.1% under full-history and 10.4% under imperative prompting. ProcessPrefBench highlights a tension in learning from dialogue, where drawing on prior interactions can improve preference realization yet also invite fabricated evidence. We hope it helps build assistants that honor a user's process preferences without sacrificing factual reliability.

论文

Verified but Vacuous: Three Failure Surfaces of LLM-Driven Verified Code Generation

已验证却空洞:LLM 驱动的已验证代码生成的三个失效面

在评估 LLM 生成的代码时,“已验证”究竟应当意味着什么?许多现有流水线只报告一个单一的验证数字。我们认为,这种做法掩盖了在条件审计序列中测得的三个不同属性:验证器接受(Surface A)、\emph{语法规范绑定(Surface B:证明义务是否绑定到规范?)},以及 \emph{语义规范保真度}(Surface C:规范是否捕捉到了非形式化需求?)。两个实证演示表明,这些层面是可分离的。\textbf{第一($A \neq B$),通过 Li@Opus(在 Claude Opus 4.7 下对 \citet{li2025dafny} 的 Dafny-as-intermediate-representation (IR) 流水线进行的同模型复现)在三个 Python 基准上}:它在 HumanEval 上达到 \textbf{99.1\% 的验证器接受率},而只有 \textbf{1.9\%} 携带绑定到规范定义的谓词或函数的证书。\textbf{第二($B \neq C$),通过 VCG 在两个 Rust 基准上}:我们在 Rust 上使用 VCG(这是我们自研的 Dafny-as-intermediate 流水线),因为 Rust 目标让我们能够强制产出完全可验证的输出(每个组件都以 Dafny 证书形式交付,通过构造即确保绑定门通过)。即使在这一构造内部,\textbf{11.48\%(MBPP-Rust)和 14.82\%(VeriContest LC 切片)的结构化验证样本仍然无法通过隐藏测试}。在 VeriContest 的 LC 切片上,\textbf{VCG 报告的 End2End 率为 7.79\%(535/6870)。}引用的外部比率为 5.51\%(GPT-5.5)和 1.88\%(单次 Opus 4.7)。这些给出了描述

论文

VirtualTrialHarness: Coordinating Agentic Operationalization of Virtual Trial Protocols Across Complex Clinical Schemas

VirtualTrialHarness:跨复杂临床 Schema 协调虚拟试验方案的可执行化

虚拟试验利用常规收集的临床数据来评估治疗策略,但将研究方案转化为可执行的分析,需要确定临床概念和研究要求应如何在可用数据中表示,并在整个工作流中一致地应用。这些决策取决于本地数据表示和操作惯例,可能涉及数据源选择、患者和就诊身份、关联以及时间解释。本文介绍 VirtualTrialHarness(VTHarness),这是一个 agent 框架,通过为每个工作流阶段选择可复用的流程性技能,并使用显式契约在各阶段之间保持一致的研究决策,从而协调虚拟试验的可执行化。我们还提出 VTBenchmark,用于评估数据源选择和队列构建。在三个复杂的合成环境中,VTHarness 在需求澄清后成功生成了所有必需的队列输出,并在 95.1% 的工作流中与参考结果匹配,而使用同一流程语料库进行检索的方式为 60.4%。流程性技能在三个语言模型上改善了数据源恢复,并在 13 个 Mayo Clinic 案例中提高了与分析人员代码的数据源重叠度。站点特定适配使八个 MIMIC-IV 任务能够实现与参考匹配的队列执行。在 Mayo Clinic Virtual Trials Program 中,该框架支持研究者对队列构建和终点分析进行审查。这些发现支持协调

论文

CAPTOR: text-encoder-free grounding by counting caption co-occurrence over the visual words of a frozen encoder

CAPTOR:通过对冻结编码器的视觉词统计描述共现,实现无需文本编码器的定位

在图像中定位文本查询需要一个对每个词与每个图块进行打分的矩阵。视觉-语言模型用对齐的文本编码器来计算它,而许多图像编码器(例如仅在切片上训练的病理学相关模型)缺少这种编码器。Caption-Anchored Patch-Term Occurrence Representation(CAPTOR)在没有文本编码器的情况下估计该矩阵。它将冻结图像编码器的图块 token 聚类为视觉词,并用每张带描述图像在各词中的图块占比来描述该图像。一个词项的签名是:在描述提到该词项的图像与其余图像之间,这些占比的标准化差值。该矩阵可分解为一个词项×视觉词表和一个与查询无关的图像因子,因此图像只需编码一次,而新增一个词项只需增加一行表。与所有免训练基线相比,CAPTOR 在 Common Objects in Context(COCO)、Pascal Visual Object Classes(VOC)和 Cityscapes 上领先。在 COCO 上,按一个物体拥有的单元评分,它达到 0.565 平均交并比(mIoU),而对比为 0.502。在这三个数据集上,它也与在同一骨干上训练的文本对齐方法持平,而后者需要梯度、文本编码器和数倍的描述。在留出的乳腺癌切片上,它比用病理学文本编码器对图块打分的最强基线高出 0.160 mIoU。通过 CAPTOR 来解读,UNI(一个仅在切片上训练的编码器)在常见网格上比此类基线高出 0.132。因此,计数可以为任何训练于……的图像编码器提供文本接口

论文

CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with Timelines

Large language model (LLM) shopping assistants now recommend products in multi-turn conversations. However, reliable evaluation faces Data scarcity and Difficulty Standardizing Criteria. To address these obstacles, we introduce CARTBench for CART (Complex and Ambiguous Requests with Timelines). For Data scarcity, we curate cases from real commercial shopping needs across 17 retail domains, pairing timestamped dialogue with 1,603 product records. For Difficulty Standardizing Criteria, we develop case-specific rubrics guided by Ideal Response Principles, distilled from excellent replies manually selected from successfully completed orders. These principles also guide Principle-Guided CART Prompting, our structured recommendation strategy. The experimental benchmark contains 1,328 expert-annotated criteria across Core, Excellence, and Safety. To answer the CART question, we evaluate 7 flagship commercial API models, including GPT-6.1-Sol and Claude-Opus-5, and 35B+ parameters open-weight models. In the first full-suite evaluation under the frozen rubrics, 3 of 10 models exceed 90% on Core, while none exceeds 45% on Excellence. Therefore, we identify an understanding-to-execution gap between required behavior and high-quality purchase advice. To examine these limitations, we diagnose shared failures in product evidence and unresolved needs, linked to changing requirements and decisive unknowns. Code and data are available at https://github.com/Da1yuqin/CARTBench.

论文

AGORA: Reliability-Aware Aggregation of LLM Judges via Item-Response Theory

AGORA:基于项目反应理论的LLM评审可靠性感知聚合

LLM-as-a-judge 是替代昂贵人工评估的常用方案,而聚合多个评审则是缓解单一评审偏见的标准化补救措施。评审池中混合了可靠性差异很大的评审,而用于验证它们的人工标注集合往往只有几百条或更少。在这种情况下,逐项求均值会赋予弱评审与强评审相同的权重,而 Dawid-Skene 等混淆表模型必须从过少的条目中估计每个评审的误差表。我们提出 AGORA(Aggregation Of Reliability-weighted Assessments),一种项目反应理论聚合器,它将每个条目置于单一潜在质量量表上,并用敏感度参数和有序评分阈值来描述每个评审,从而在所有条目上联合学习评审可靠性,且无需人工标签。在三个基准上,AGORA 在大型评估集上达到或超过 Dawid-Skene,且随着集合缩小至几百条,其优势进一步扩大。当评审池变得更加不均衡时,它仍保持准确;一种无标签的离散度统计量可提前指示信任加权何时有帮助,而其学习到的信任权重与每个评审的人工有效性保持一致。

论文

SurgTransfer: Multi-Step Latent Action Modeling for Action Transfer in Surgical World Model

SurgTransfer:用于手术世界模型中动作迁移的多步潜在动作建模

手术世界模型有望提供术中指导、加速无风险训练,并促进专家手术操作的迁移。然而,利用世界模型迁移手术专长在很大程度上仍未被探索。此外,该领域近期方法主要依赖真值运动学动作或特定任务的专家标注,限制了其在具有真值标注的狭窄任务范围之外的应用。相比之下,自然领域现有工作已显示出仅从无标注视频中学习潜在动作,并将所学动作跨上下文迁移的良好结果。我们观察到,这一范式对外科领域而言过于短视,未能捕捉手术过程的分层和目标导向结构。因此,我们提出一种新颖的多步动作学习框架,以学习易于在各种手术场景中迁移的上下文不变潜在动作。我们在公开数据集 SurgToolLoc-2022 和 PitVis-2023 上进行了大量实验,并通过定量指标和外科专家定性评估验证了我们的方法。我们已在 https://github.com/bhattarailab/Surgical-Vision-World-Model 发布代码和实现细节。

论文

Contextual Pictograms for Repairing Multilingual ASR Errors

Speech transcription errors can be difficult to recognize when competing word hypotheses are unfamiliar or visually similar. We describe an interface that combines alternative transcripts, replay and contextually checked pictograms for selected uncertain concepts. The system will initially support French and Spanish functional utterances. A counterbalanced study will assess whether pictorial feedback helps listeners recover the speaker's intended action beyond text alternatives alone. We will also quantify semantic mismatch and additional interaction time, since an inappropriate image can reinforce the wrong interpretation rather than repair it.

论文

Route to Remember: Adaptive Memory Selection for LLM Agents

记住之路:面向 LLM 智能体的自适应记忆选择

生产型智能体的记忆正日益成为瓶颈,并且几乎完全由文本构建:从超出限制的上下文中提取关键点,并在查询时检索回上下文。因此,每个新查询都会带来额外成本,且该成本随累积历史增长。权重记忆是一种互补的替代方案,它将知识内化到模型参数中,并在完全无需上下文的情况下作答;最近已被证明在自进化智能体中有效,用于内化技能和行为。然而,其在情景记忆和语义记忆(例如用户特定事实)中的应用仍相对未被探索,并且在召回性能方面,早期权重记忆尝试与基于文本的系统之间仍存在差距。我们研究如何通过应用同策略自蒸馏(OPSD)使权重记忆作为长期事实存储具有竞争力。它从教师模型训练一个无上下文的学生模型,教师模型是同一模型以用户记忆为条件;同时结合一个“先验证再重新生成”的路由器,使权重记忆和文本记忆各自覆盖其最擅长处理的查询。在 HaluMem 基准上,OPSD 达到或超过了强文本记忆基线(包括全上下文提示和检索系统),同时每个查询读取的 token 更少。我们进一步开展了广泛研究,刻画权重记忆的行为,并分析不同训练配方如何影响其性能。随着智能体 harness 迈向持久化、多会话……

论文

SlackBench: Benchmarking Agents on Collaborative Projects Grounded in Real Code Repositories

SlackBench:在基于真实代码仓库的协作项目上对 Agent 进行基准测试

AI Agent 正逐渐成为数字同事,能够浏览网页、编写代码、运行实验,并在较长的时间跨度内协助人类。然而,现有基准测试尚不足以反映真实的知识工作:许多基准依赖合成数据或孤立任务,忽略了协作项目中复杂的多方动态——在协作项目里,关键信息分散于对话、代码和不断演进的决策之中。即使是一个简单的工作场所问题,也可能需要定位相关频道和私信、从冗长讨论中还原上下文、检查仓库状态、调和过时或相互冲突的证据,并跨来源进行综合。我们推出 SlackBench,这是一个用于评估 Agent 在真实科研与工程工作流中表现的基准,这些工作流要求对工作场所沟通和不断演进的仓库状态进行联合推理。SlackBench 以隐私保护的、对真实学术研究项目的重演为基础,提供可复现的环境,包含真实的多方对话、不断演进的决策,以及以 GitHub 仓库和 Google Docs 为依据的相应代码变更。它包含 140 个查询,涵盖异构来源的 Agent 式检索、对无法回答或前提错误的问题进行弃答、目标导向的摘要生成,以及长对话中的情境推断。这些任务无法简化为静态语料问答:Agent 必须判断哪些对话重要、遍历讨论串、检查仓库状态,并在各来源之间综合证据。

论文

SettleSplat: Monocular Gaussian Mapping under In-View Scene Changes

SettleSplat:视野内场景变化下的单目 Gaussian 映射

在线 3D Gaussian 映射能够实现快速、高保真的新视角合成,在增强现实、机器人学和自主系统中具有广泛应用。然而,当前许多方法假设场景为静态,或将动态部分作为离群值过滤掉。本文研究视野内的场景变化,即在单次在线序列中物体在相机前方被操作移动;这与先前在相机视野之外或不同次采集之间检测变化的工作不同。这种设定将瞬态动态与持久动态纠缠在一起,因为物体在移动时可能成为干扰物,而一旦稳定下来又会变成持久物体。尽管近期研究开始通过移除干扰物以获得干净的静态背景来处理它们,但视野内场景变化仍缺乏充分探索。为解决这一问题,我们提出 SettleSplat,一个单目映射系统,可在这种变化下维护最新的 3D Gaussian 地图。具体而言,我们将粗略的逐像素不确定性提升为 Gaussian 动态性场,然后剪除瞬态部分。对于持久变化,我们推导出由无参数渲染深度不确定性加权的几何矛盾,以将真实变化与优化不足的区域区分开。在 Bonn 和 Co-Fusion 上,SettleSplat 实现了一致的 3D Gaussian 地图,在完整图像和变化区域上均优于当前基线,同时保持相当的速度。

论文

Sparse Internal Control of Language Models

Language models are increasingly used in text generation, decision support, and automated interaction, creating a need for localized, reversible, and selective control of their behavior. Activation steering demonstrates that internal interventions can alter the behavior of frozen models, but how to select and evaluate compact, multi-site control interfaces remains an open question. I introduce sparse internal control, a framework for steering target behavior by applying inference-time interventions to a small set of internal model nodes. A local target-controllability formulation characterizes candidate site--direction pairs by their behavioral effects and specifies constraints on target recovery, off-target preservation, and intervention energy. Two complementary selectors instantiate this formulation: Driver-OMP selects nodes for sparse reconstruction of a desired behavioral displacement, while Coverage-Driver favors stable coverage across prompts. I propose a six-axis control-evaluation protocol measuring reachability, signed reversal, dose response, feedback controllability, off-target preservation, and held-out reuse. Exploratory experiments on indirect object identification, MMLU multiple-choice question answering, sentiment steering, and refusal steering provide evidence for the feasibility of steering task-defined behavior through sparse internal interventions. The six-axis evaluation characterizes these interventions beyond target movement, revealing distinct control properties that depend on the task and available direction information. Together, the formulation, reference algorithms, and evaluation protocol provide a foundation for the systematic study and development of internal control methods for language models.

论文

Typological Feature Induction as a Benchmark for Inductive Metalinguistic Reasoning

Existing metalinguistic reasoning benchmarks require both inference of rules and their application, making failures hard to diagnose. We introduce typological feature induction (TFI) which targets the former step. Given sentences in an unnamed language paired with translations in a known pivot language, models must predict a typological feature of the unnamed language. From Grambank and multi-parallel corpora, we automatically build evaluation questions over 195 languages. We find that LLMs identify 59--80% of these languages from only 16 sentence pairs; and misaligning the translations barely affects their accuracy, suggesting reliance on prior knowledge of the language. Enciphering text to prevent recognition increases the corpus' utility, but mainly for features where target and pivot languages agree. On languages which models cannot identify, neither open model outperforms a majority-value baseline. Since induction from raw text aligns with field linguists' use-case, this work indicates the models tested are not yet ready for this role. TFI offers a scalable path to track progress in this direction.

论文

Measuring Model-Specific Alignment Drift in LLM-Based Opinion Dynamics

测量基于LLM的观点动力学中模型特定的对齐漂移

大型语言模型(LLM)智能体越来越多地被用作观点动力学实验中的合成参与者,人们常常假设智能体的行为完全由其提示词决定。我们用一个框架检验这一假设:在该框架中,LLM智能体围绕一个有争议的政策议题进行多轮讨论,而其立场由一套固定的心理测量工具量化,该工具独立于任何动力学模型。在六个LLM上,具有坚定立场的人设本质上是稳定的:在没有同伴输入的五个模型中,每个智能体都在20轮内保持其被分配的一方。因此,讨论中观察到的对齐丧失是由交互引发的,我们称之为对齐漂移,并且它具有模型特异性:gpt-4.1 使观点簇保持分离,claude-sonnet-5 部分维持,而 gpt-5.6-sol 和 claude-opus-5 则放弃了它们。在选择性注意下,一个LLM在立场同质性注意下仍能维持分离的观点簇。定性特征在种群规模和时间跨度加倍以及第二个议题上依然保持。这种异质性使得LLM的选择成为社会模拟中一等重要的效度变量。

论文

Dory1.0-4B: A Looped Normalized-GPT

We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute budgets. Dory1.0-4B is built on a normalized Transformer (nGPT) backbone with interleaved sliding-window and full-attention layers, organized into an input block, a shared recurrent block, and an output block. At inference, the recurrent block can be applied a variable number of times. We pre-trained Dory1.0-4B on 6 trillion tokens. The first 4.5 trillion tokens were trained in NVFP4, and additional pre-training then extended the context length to 256K tokens. Next, we post-trained the model using Supervised Fine-Tuning (SFT) and Reinforcement Learning with Verifiable Rewards (RLVR), with a difficulty-aware loop curriculum that routes harder prompts to deeper loops. Increasing the loop count improves accuracy, with the largest gains on coding, agentic, and long-context benchmarks. With two or more loops, Dory1.0-4B outperforms larger models such as Qwen3.5-9B, Gemma 4 12B, and Gemma 4 26B-A4B on average across 12 benchmarks. Looping also makes Dory1.0-4B more token-efficient on agentic benchmarks: with four loops, it generates 1.3-2.5x fewer tokens than with one loop, as the extra computation is spent in latent space rather than on longer outputs. To reduce memory during looping, Dory1.0-4B caches keys and values only from the last loop, keeping its KV-cache footprint equal to that of a non-looped model at any loop count while retaining most of the accuracy gains. We open-source the BF16, MXFP8, NVFP4, and GGUF quantized checkpoints.