16 papers across AI, ML, NLP, and CV from the last 24 hours.
Today's batch is dominated by papers working inside the black box rather than around it. Multiple submissions probe the internal machinery of large models — attention sinks, in-context learning as implicit gradient descent, reversible fine-tuning behaviors — treating the transformer not as a tool but as a system to be reverse-engineered. The second major thread is agent evolution: skill curation, autonomous scientific discovery, and vulnerability reconstruction all treat LLM-based agents as persistent learners rather than one-shot query engines. A smaller but notable cluster applies ML to specialized domains (quantitative finance, computational fluid dynamics, network security), suggesting the technique is moving outward from its core turf.
The standout is Patch2Vuln, which asks whether an LM agent can reconstruct the security meaning of Linux binary patches using only binary-derived evidence — no source code, no advisory text. It's a tight, adversarial framing that inverts the usual vulnerability disclosure pipeline.
What's missing from today's batch: no multimodal foundation models, no reinforcement learning agents, no scaling law papers. The focus has shifted inward. The field seems to be entering a phase of mechanism and control over capability.
Siru Ouyang, Jun Yan, Yanfei Chen · 2026-05-07
LLM-based agents are increasingly deployed to handle streaming tasks, yet they often remain one-off problem solvers that fail to learn from past interactions. Reusable skills distilled from experience provide a natural substrate for self-evolution, where high-quality skill curation serves as the key bottleneck. Existing approaches either rely on manual skill curation, prescribe heuristic skill ope.
Nithin Somasekharan, Rabi Pathak, Manushri Dhanakoti · 2026-05-07
Recent LLM-based agents have closed substantial portions of the scientific discovery loop in software-only machine-learning research, in chemistry, and in biology. Extending the same loop to high-fidelity physical simulators is harder, because solver completion does not imply physical validity and many failure modes appear only in field-level imagery rather than in solver logs. We present AI CFD S.
Isaac David, Arthur Gervais · 2026-05-07
Security updates create a short but important window in which defenders and attackers can compare vulnerable and patched software. Yet in many operational settings, the most accessible artifacts are binary packages rather than source patches or advisory text. This paper asks whether a language-model agent, restricted to local binary-derived evidence, can reconstruct the security meaning of Linux d.
Ronaldo Canizales, Divya Gopinath, Corina Păsăreanu · 2026-05-07
Concept-based explanations offer a promising approach for explaining the predictions of deep neural networks in terms of high-level, human-understandable concepts. However, existing methods either do not establish a causal connection between the concepts and model predictions or are limited in expressivity and only able to infer causal explanations involving single concepts. At the same time, th.
Yuping Lin, Pengfei He, Yue Xing · 2026-05-07
Supervised fine-tuning (SFT) induces new behaviors in large language models, yet imposes no structural constraint on how these behaviors are distributed within the model. Existing behavior interpretation methods, such as circuit attribution approaches, identify sparse subnetworks correlated with SFT-induced behaviors post-hoc. However, such correlations do not imply causal necessity, limiting th.
Prateek Paudel, Nitin Jha, Abhishek Parakh · 2026-05-07
Classical generative adversarial networks (GANs) have been applied to generate adversarial network traffic capable of attacking intrusion detection systems, but they suffer from shortcomings such as the need for large amounts of high-dimensional datasets, mode collapse, and high computational overhead. In this work, we propose a hybrid quantum-classical GAN (QC-GAN) framework where a variational q.
Dan Jacobellis, Neeraja J. Yadwadkar · 2026-05-07
Modern sensors generate rich, high-fidelity data, yet applications operating on wearable or remote sensing devices remain constrained by bandwidth and power budgets. Standardized codecs such as JPEG and MPEG achieve efficient trade-offs between bitrate and perceptual quality but are designed for human perception, limiting their applicability to machine-perception tasks and non-traditional modaliti.
Ilya Borovik · 2026-05-07
Symbolic music datasets with matched scores and performances are essential for many music information retrieval (MIR) tasks. Yet, existing resources often cover a narrow range of composers, lack performance variety, omit note-level alignments, or use inconsistent naming formats. This work presents PianoCoRe, a large-scale piano MIDI dataset that unifies and refines major open-source piano corpora..
Hongyi Tao, Dingzhi Yu, Lijun Zhang · 2026-05-07
Sign-based optimization algorithms, such as SignSGD and Muon, have garnered significant attention for their remarkable performance in training large foundation models. Despite this empirical success, we still lack a theoretical understanding of when and why these sign-based methods outperform vanilla SGD. The core obstacle is that under standard smoothness and finite variance conditions, SGD is kn.
Yang Xu, Chiwoo Park · 2026-05-07
Bayesian model calibration is central to digital twins and computer experiments, as it aligns model outputs with field observations by estimating calibration parameters and correcting systematic model bias. Classical Bayesian calibration introduces latent parameters and a discrepancy function to model bias, but suffers from parameter--discrepancy confounding and is typically formulated as an offli.
Siquan Li, Kaiqi Jiang, Jiacheng Sun · 2026-05-07
Despite the prevalence of the attention sink phenomenon in Large Language Models (LLMs), where initial tokens disproportionately monopolize attention scores, its structural origins remain elusive. This work provides a \textit{mechanistic explanation} for this phenomenon. First, we trace its root to the value aggregation process inherent in self-attention, which induces a systematic variance discre.
Chenyang Zhang, Yuan Cao · 2026-05-07
Transformers have demonstrated remarkable in-context learning (ICL) capabilities. The strong ICL performance of transformers is commonly believed to arise from their ability to implicitly execute certain algorithms on the context, thereby enhancing prediction and generation. In this work, we investigate how transformers with softmax attention perform in-context learning on linear classification da.
Shai Feldman, Yaniv Romano · 2026-05-07
Evaluating and predicting the performance of large language models (LLMs) in multi-turn conversational settings is critical yet computationally expensive; key events -- e.g., jailbreaks or successful task completion by an agent -- often emerge only after repeated interactions. These events might be rare, and under any feasible computational budget, remain unobserved. Recent conformal survival fr.
Jan Fillies, Ronald E. Robertson, Jeffrey Hancock · 2026-05-07
As large language models (LLMs) increasingly mediate both content generation and moderation, linguistic evasion strategies known as Algospeak have intensified the coevolution between evaders and detectors. This research formalizes the underlying dynamics grounded in a joint action model: when Algospeak increases, detectability and understandability decrease. Further, the concept of Majority Unders.
Kateryna Husar, Alexander Volfovsky · 2026-05-07
Randomized controlled trials typically assume that prognostic covariates are known and available at no cost. In practice, obtaining high-dimensional pretreatment data is costly, forcing a trade-off between covariate-adaptive precision and a measurement budget. We introduce Dynamic Adaptive Rerandomization via Thompson Sampling (DARTS), which treats covariate acquisition as a sequential optimizatio.
Adil Reghai, Lama Tarsissi, Gérard Biau · 2026-05-07
This paper proposes a hybrid methodology to improve the approximation of SABR (Stochastic Alpha Beta Rho) implied volatility by combining analytical structure with machine learning. The approach augments the neural-network input representation with geometric features derived from the stochastic differential equations of the SABR model. Unlike approaches that fully replace analytical formulas with .
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.