arXiv Digest — Tuesday, August 4, 2026
40 papers across AI, ML, NLP, and CV from the last 24 hours.
Three threads connect today's batch. The first is memory and state management in long-running language systems: LiveMem formulates state continuity under context turnover, RoMeRL addresses the memory-reward trap in self-evolving agents, and Structured Memory for Edge LLMs collapses RAG prefill to O(1) using SSM state injection. These papers treat context not as something to retrieve but as something to maintain — a shift from retrieval to persistence.
The second thread runs through efficiency in diffusion and video generation. Token Radius Attention allocates compute per-token rather than per-head for video DiTs, CMuon fixes late-stage convergence bottlenecks in DiT training via chunked momentum orthogonalization, and c-Rectified Flow provides the first computational and statistical guarantees for the framework powering FLUX and Stable Diffusion 3. Meanwhile, a surprising finding in Pseudorandom Streams within Diffusion Models shows that the PRNG sequences consumed during training are partially predictable and affect generation quality — a quiet reminder that "randomness" in deep learning is often just deterministic orbits we haven't looked at closely enough.
A third cluster addresses robustness under uncertainty: value-of-information routing for LoRA mixtures, analytic planning with moment closure in RL, minimax regret in uncertain MDPs, and nonasymptotic guarantees for logistic regression likelihood ratios. These papers reject sampling-based approximations in favor of principled bounds.
The most notable paper is AURORA-LM, which pushes back against tokenization itself by building a high-capacity continuous latent space for language that diffusion models can operate on directly — preserving token-level fidelity without compressing to ease the generator. If text can be modeled in continuous latents the way images and audio now are, the last boundary separating generative modalities collapses.
The batch collectively suggests the field is moving from "bigger models" to harder constraints: memory continuity, computational guarantees, uncertainty-aware routing, and the mechanics of what happens inside models we can no longer treat as black boxes.
Junjie Yin, Buxin She, Xinyu Feng · 2026-08-03
Artificial intelligence (AI) is increasingly central to power and energy systems, supporting modeling, forecasting, optimization, and control. Yet most existing works emphasize specialized applications and offer little reusable material for newcomers or interdisciplinary learners, who increasingly rely on large language models rather than building their own. This gap points to a need for engineeri
Qiushi Lin, Chaojie Zhang, Inigo Goiri · 2026-08-03
The efficiency of a datacenter rests on its control plane policies. Designing these policies is increasingly hard: the hardware-software stack grows fast, the design space is vast and interdependent, and prototyping a single policy takes months. Agentic AI promises to automate this search. Off the shelf, however, it falls short on three fronts. It is not formal: with no structured, searchable stat
Taye Akinrele, Sindhuja Penchala, Noorbakhsh Amiri Golilarz · 2026-08-03
Cognitive AI seeks to move beyond language generation and autonomous task execution toward systems capable of sustained reasoning, adaptive behavior, persistent memory, and self-regulation. While generative and agentic AI have demonstrated impressive capabilities across a wide range of tasks, many fundamental cognitive functions remain fragmented or weakly developed, limiting reliable operation ov
Zeshen Zheng, Yujia He, Qianmian Lin · 2026-08-03
Fairness evaluation concerns not only what a model produces, but also what its outputs ought to be compared against. When a model generates a CEO in the United States, the prompt leaves demographic realization to the model. Existing group fairness definitions assume that sensitive attributes are given on the input side. Generative audits instead examine output-side demographic composition, yet the
Natalie Isak, Matthew Dressman · 2026-08-03
The most capable AI deployments are not single models but ensembles of specialized agents that delegate and act in coordination. This architecture unlocks powerful new capabilities, and it also introduces risks that existing frameworks for monitoring, detection, and mitigation were not designed to address. Most state-of-the-art AI abuse detection literature focuses on single-turn or multi-turn (si
Sterre Lutz, Daniel Vos, Matthijs T. J. Spaan · 2026-08-03
Sequential decision-making in real-world applications often involves uncertainty about the environment's model. Uncertain Markov decision processes (UMDPs) represent the possible environments as a set of MDPs with shared states and actions but potentially different transition probabilities and rewards. Optimizing a single policy across all possible MDPs may sacrifice performance, while preparing a
Michael Farmer · 2026-08-03
Can scientific abduction occur without continuous sensorimotor embodiment? Recent arguments in AI and philosophy of science hold that genuine hypothesis generation requires an agent continuously coupled to the physical world. We defend a narrower claim: online embodiment is not necessary for every abductive scientific act. Our focus is identity abduction: the inference that two independently devel
Chuyan Chen, Peng Sun, Kun Yuan · 2026-08-03
Diffusion Transformers (DiTs) have achieved state-of-the-art (SOTA) performance in visual generative modeling, yet their training remains computationally prohibitive. While the recently proposed Momentum Orthogonalization (Muon) optimizer offers a promising alternative to AdamW, its direct application to DiTs yields suboptimal late-stage convergence. In this paper, we identify the root cause of th
Yuqiao Tan, Jinxiang Meng, Fangyu Lei · 2026-08-03
Real-world software development requires coding agents to operate in shared workspaces where users may inspect and modify code during an ongoing task, yet existing repository-level benchmarks typically evaluate agents working alone or restrict user participation to messages. This leads us to ask: how do coding agents understand and respond to code changes in a shared workspace? We introduce SWE-To
Nicole Mitchell, Dhruv Agarwal, Maty Bohacek · 2026-08-03
Language models have taken on the role of a very new type of technology, by virtue of their human-ness and rapid integration into users' daily lives. This combination of features can introduce longitudinal risks---cognitive, developmental and socio-affective changes in humans---that might not surface in short-term interactions, but can have lasting long-term effects on users. This forms the basis
Brandon Wang, Andrei S. Tyrin, Daniil A. Boiko · 2026-08-03
Language models are playing an increasingly important role in laboratory science, performing tasks such as experiment planning, execution, and post-hoc analysis. However, precisely measuring their abilities is difficult, as scientific capabilities require a mixture of both problem-solving skills and domain-specific intuition. Existing evaluations rarely measure the capabilities required to make re
Honghao Lin, Vahab Mirrokni, David P. Woodruff · 2026-08-03
In [AS21], Axiotis and Sviridenko conjectured that the linear dependence on the restricted condition number in sparse convex optimization cannot be improved by a polynomial-time algorithm. We establish their conjectured lower bound for least-squares objectives, conditional on the randomized exact-volume Small-Set Expansion Hypothesis in the weighted regular-graph formulation of Raghavendra, Steure
Zhaoxin Yu, Qi Shen, Hengli Li · 2026-08-03
Optimization-based latent reasoning improves large language model outputs by optimizing instance-specific continuous states at test time while keeping model parameters frozen. Existing methods, however, typically connect these states to the reasoning trajectory through decoded tokens, making sequence-level credit assignment indirect and obscuring how latent updates shape subsequent reasoning. We i
Shashwat Kumar, Arafat Rahman, Anuj Srivastava · 2026-08-03
We consider optimization problems defined on product spaces of simplices. Examples of this class of problems include learning low-rank discrete multivariate probability distributions via simplex constrained tensor decomposition and performing functional data registration under the Square Root Velocity Function (SRVF) representation. In this work, we demonstrate the feasibility of replacing the pro
Shengzhi Deng, Chenqi Ye, Yanze Guo · 2026-08-03
Diffusion models rely on stochastic inputs, yet on finite-precision hardware, the randomness they consume is realized as deterministic numerical orbits generated by pseudorandom rules. Accessible orbit structure can become a learnable input and affect both training and generation because the realized loss and its gradient depend on the concrete pseudorandom values consumed at each optimization ste
Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson · 2026-08-03
Retrieval-augmented generation (RAG) imposes a prefill cost proportional to retrieved context length, and with Transformer backbones a KV-cache that grows with each generated token. State-Space Models (SSMs) avoid the second cost by construction; we eliminate the first, collapsing prefill from O(L_context) to O(1) per query. We introduce PRECOG (Pre-Computed Context Injection), a retrieval mechani
Stefano Fiorini, Edoardo Coppola, Pietro Lio · 2026-08-03
Sheaf Neural Networks (SNNs) generalize message passing by replacing scalar edge weights of standard Graph Neural Networks (GNNs) with learnable, edge-dependent restriction maps between node stalks. Despite their strong theoretical foundations and promising transductive results, SNNs have been evaluated almost exclusively on transductive node classification, leaving their behaviour under inductive
Jose Luis Montiel Olea, Ryan Strong, Amilcar Velez · 2026-08-03
We present a simple Gaussian approximation to the finite-sample distribution of the classical ridge regression estimator. Our approximation captures the fact that, in finite samples, the ridge regression estimator trades off bias and variance to reduce estimation and prediction error. Our approximation is based on nonstandard asymptotics where we let the estimator's regularization parameter grow p
Chirag Pabbaraju · 2026-08-03
We construct unambiguous DNFs having width O(n) but 0-certificate complexity Omega(n^2). By utilizing the special structure of these DNFs, we prove a lifting theorem with a constant-sized gadget that lifts the DNF to a communication problem, while losslessly translating the separation in certificate complexity to a separation in communication complexity. This leads to an optimal refutation of the
Tom Saliencro, Rohan Desai, Priya Nair · 2026-08-03
Mixtures of low-rank adaptation experts increase parameter-efficient capacity by routing each input through a subset of adapters. Recent dynamic routers activate more experts when the router or prediction is uncertain. This rule silently equates uncertainty with useful additional computation: an uncertain example may contain complementary, unqueried expert evidence, but it may instead remain ambig
Shishir Sharma, Doina Precup · 2026-08-03
Effective model-based reinforcement learning in stochastic environments requires planning that accounts for predictive uncertainty. Propagating full state distributions analytically offers a principled way to do this, but has traditionally required restrictive policy or reward structures to remain tractable. Consequently, modern deep reinforcement learning has largely retreated to either stochasti
Yi Yang, Zhennan Chen, Yihong Zhuang · 2026-08-03
Learning-based memory systems for self-evolving LLM agents face two tightly coupled challenges. First, trajectory-indexed utilities grow with the interaction history, thereby dispersing limited feedback over an ever-expanding state space. Second, because trajectory-level rewards are jointly assigned to co-retrieved memories, irrelevant experiences may receive misleading utility updates and consequ
Hugo Chardon, Reese Pathak, Nikita Zhivotovskiy · 2026-08-03
We characterize the finite sample behavior of the log-likelihood ratio statistic in binary logistic regression, uniformly over both the design and the target parameter. For n>=d>=3, we determine, up to universal constants, its worst case (1-delta) quantile over all fixed collections of design vectors and all target parameters. This is a nonasymptotic analogue of the Wilks chi^2_d phenomenon and re
Jiajun Liang, Yucheng Liao, Yukang Cao · 2026-08-03
Language remains an outlier in generative modeling: while images, video, and audio are increasingly modeled in continuous latent spaces, text generation still relies predominantly on discrete tokens. Existing continuous language models either inherit embedding spaces not designed for joint generation and decoding, or compress autoencoded latents to ease diffusion, sacrificing token-level fidelity.
Amr Keleg, Ahmed Amine Ben Abdallah, Taha Yassine · 2026-08-03
Arabizi refers to Arabic written in Latin script. Although previous studies have shown that the prevalence and usage of Arabizi vary by factors such as region and age group, most NLP research on Arabic texts treats it as a temporary phenomenon resulting from limited technological support for the Arabic script. In this work, we engage with Arabic speakers to collect insights on their perceptions an
Saman Sarker Joy, Niloy Farhan · 2026-08-03
Large language models (LLMs) are increasingly used for health-related advice. Existing research measures their safety with static questions rather than pressured patient-facing conversations. We introduce MedPRESS, a multi-turn benchmark for measuring patient-pressure-induced sycophancy in LLMs. MedPRESS contains 600 medically grounded five-turn dialogues across three scenario families: medication
Zhichen Liu, Ruihan Sun, Hengjie Yang · 2026-08-03
Long-running assistants and agents consume interaction streams that eventually outgrow the context. Existing context retention, summarization, and retrieval preserve access to selected history, but do not provide a persistent state over the full lifecycle when working context changes. We formulate this missing inference capability as state continuity under context turnover: carrying computation fo
Iaroslav Chelombitko, Ekaterina Chelombitko, Mika Hamalainen · 2026-08-03
Open-source LLMs reliably name Zeus, Jupiter, and Thor, but recover their counterparts in less-represented traditions like Finnish, Slavic, Egyptian, or Chinese mythology far less consistently. We ask where inside the model this cultural default is produced. On a parallel cross-cultural substrate of Thompson-motif entities, we instrument 18 open-source LLMs from 8 architecture families with linear
Yuxue Yang, Shuyao Shang, Jiahe Wang · 2026-08-03
Controllable video generation models are increasingly being developed as world models. Accordingly, evaluating them in this role extends beyond the apparent appearance of generated videos to the inherent reactivity of the worlds they depict: the ability to infer from the scene state how the world should react and to generate plausible consequences not explicitly described in the input. Yet existin
Chao Ji, Shiyu Xuan, Zechao Li · 2026-08-03
Aerial-ground person re-identification is a challenging task due to cross-platform viewpoint variations, which cause severe occlusion and geometric deformation. Existing methods attempt to learn view-invariant representations exclusively within the 2D image space, where drastic viewpoint variations cause the learned features to remain coupled with viewpoint bias. To address this, we propose VR3D,
Zhipeng Liu, Haochen Wang, Zhaoxiang Zhang · 2026-08-03
Captions serve as a primary supervision signal for both multimodal understanding and text-to-image generation. However, previous evaluations treat the caption quality as a single scalar objective, which conflates two distinct properties: (1) how much visual information a caption covers and (2) how reliably the image supports its stated claims. To this end, we design a decoupled caption evaluation
Tingyu Song, Mingxin Li, Yanzhao Zhang · 2026-08-03
Sparse retrieval underpins modern search systems, from web search to retrieval-augmented generation. Existing work has introduced Learned Sparse Retrieval (LSR) to push beyond exact lexical matching toward richer semantics. Yet LSR has so far remained tied to encoder-style bidirectional architectures, and its extension to multimodal settings still relies heavily on auxiliary cross-modal modules. T
Nan Bi, Taoyue Wang, Lijun Yin · 2026-08-03
Automated pain assessment in real clinics is limited by scarce clinically grounded facial video data with weak labels (often sequence-level self-report) and by the fact that pain cues can be subtle or near-neutral in RGB, while thermal and depth signals are informative yet impractical to deploy routinely. To address these challenges, we propose ReMi-MAE (Reconstructing Missing Channel Cross-Modal
Luc Trudeau, Maria G. Martini · 2026-08-03
Efficient and perceptually meaningful quality assessment is a fundamental requirement for image and video processing, compression, and streaming systems. This article shows that, in the context of Discrete Cosine Transform ( DCT)-based compressed images, Structural Similarity Index ( SSIM ) can be approximated from global Peak Signal to Noise Ratio (PSNR) or Mean Square Error ( MSE) using local st
Jiayu Chen, Zhikun Jiang, Maoliang Li · 2026-08-03
Video Diffusion Transformers (VDiTs) enable high-fidelity generation but incur quadratic cost from dense 3D self-attention. Existing head- and block-level sparse methods share computation budgets across queries, overlooking token-specific attention demand. We observe that retained density varies across queries yet correlates log-linearly with attention entropy, while dominant interactions form que
Zihan Yang, Yang Guo, Hongxing Zhang · 2026-08-03
Despite the remarkable progress over the past decades, accurately identifying small objects remains challenging because of their insufficient visual cues. Previous works typically attempt to construct discriminative representation of the small objects. However, the wide range frequency domain noises and label ambiguities have been greatly overlooked, which significantly hinders the accurate locali
Vutichart Buranasiri, James M. Murphy · 2026-08-03
Two active learning algorithms for hyperspectral image (HSI) classification are proposed that combine density-aware Fermat distances with Poisson-reweighted harmonic label propagation. Our methods actively query points using an uncertainty-based acquisition function, extending Poisson ReWeighted Laplace Learning (PWLL). Our first algorithm, Fermat Active Laplace Learning (FALL), builds an affinity
Shuaijun Liu, Qifu Wen, Shuyang Hao · 2026-08-03
World Action Models (WAMs) augment robot policies with action-conditioned predicted futures, but a plausible future alone does not justify changing the action that a bimanual policy would execute. We present CoWAM, a selective intervention layer that expresses synchronization, role compatibility, and collision convergence as coordination contracts. Each contract combines typed admissibility checks
Jiachen Hu, Han Zhong · 2026-08-03
This paper is concerned with one-bit mean estimation, where each independent sample is represented by a single binary message. We consider distributions on R with mean in [-lambda,lambda] and absolute k-th central moment at most sigma^k, where k>1 is fixed. For this class, previous work attained the optimal sample complexity for general queries using a two-stage protocol. The first stage localizes
Leda Wang, Zhehao Xu, Qiang Liu · 2026-08-03
Recently, rectified flow has emerged as a fundamental framework for large-scale image generation, powering state-of-the-art systems such as FLUX.1 and Stable Diffusion 3. Despite its remarkable empirical success, the computational and statistical guarantees of iterative rectified flow have remained largely unexplored. We address this problem by studying c-rectified flow, a cost-aware class of rect
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.