40 papers across AI, ML, NLP, and CV from the last 24 hours.
Three interconnected themes dominate today's batch. First, inference-time control is becoming a serious engineering discipline: papers on agentic chain-of-thought steering, value-aware KV cache eviction, and vision-anchored token selection for RL all address the same problem—how to guide model reasoning during execution rather than relying solely on post-training alignment. The field is moving from static capabilities toward controllable, steerable computation.
Second, physically grounded 3D reconstruction is gaining momentum. Multiple papers—SimuScene, GARDEN, and NewtPhys—share a common goal: producing environments that survive contact with physics engines rather than just looking plausible. The constraint is shifting from visual fidelity to physical plausibility, which matters for robotics.
Third, alternatives to backpropagation are no longer fringe. Forward-Forward learning for regression, spiking neural networks with quadratic integrate-and-fire neurons, and hyper-epoch pretraining that treats multi-epoch budgets as population exploration all suggest growing appetite for training paradigms that sidestep global gradient computation.
The most notable paper is "Language Models Need Sleep," which frames continual knowledge consolidation through a sleep-biology lens: models self-modify their own long-term parameters during offline periods, rather than relying on fresh fine-tuning. It's a genuinely novel framing of the plasticity-stability problem.
What today's batch collectively suggests: the field is shifting from "bigger models trained the same way" toward better control, better grounding, and fundamentally different training dynamics.
Mahtab Bigverdi, Lindsey Li, Weikai Huang · 2026-05-29
Vision language models (VLMs) excel at many tasks but still struggle with spatial reasoning when critical information is not directly observable. Many such problems require imaginative perception: inferring what would be seen from an unseen viewpoint, tracing paths through occluded spaces, or integrating partial observations into a coherent spatial representation. We introduce Imaginative Perce...
Zekun Qi, Xuchuan Chen, Dairu Liu · 2026-05-29
We introduce Humanoid-GPT, a GPT-style Transformer with causal attention trained on a billion-scale motion corpus for whole-body control. Unlike prior shallow MLP trackers constrained by scarce data and an agility-generalization trade-off, Humanoid-GPT is pre-trained on a 2B-frame retargeted corpus that unifies all major mocap datasets with large-scale in-house recordings. Scaling both data and...
Ali Behrouz, Farnoosh Hashemi, Vahab Mirrokni · 2026-05-29
The past few decades have witnessed significant advances in the design of machine learning algorithms, from early studies on task-specific shallow models to more general deep Large Language Models (LLMs). Despite showing promising results in tasks that require instant prediction or in-context learning, existing models lack the ability to continually learn and effectively transfer their temporal...
Lianghuan Huang, Yihao Li, Saeed Salehi · 2026-05-29
Representations of the world, arguably, contain information about features (e.g. something is blue, something is a circle) but also information about which features are part of the same object (e.g. the circle is blue), which we call binding information. Any system with the ability to understand scenes with multiple objects must be able to solve the binding problem: it needs to know which featu...
Areeb Gani, Asal Meskin, Gabrielle Kaili-May Liu · 2026-05-29
Reliable uncertainty communication is critical to the trustworthiness of LLMs, yet faithful calibration (FC)--the alignment between models' intrinsic and (linguistically) expressed confidence--is a persistent failure mode. This challenge is key for large reasoning models (LRMs), whose extended reasoning traces are often interpreted by users as evidence of deliberation, competence, and confidenc...
Rongzhi Zhang, Rui Feng, Zhihan Zhang · 2026-05-29
Rubric-based RL is a promising route for extending reinforcement learning beyond verifiable rewards, yet existing methods optimize rubrics while treating the query distribution as fixed. We identify a structural bottleneck: rubric quality is constrained by query structure. Open-ended queries yield vague rubrics; naively narrowing them introduces fabricated references that no model can verify, s...
Quentin Fuxa, Dominik Mach'a\v{c}ek · 2026-05-29
We describe AlignAtt4LLM, an IWSLT 2026 simultaneous speech translation system for English to German, Italian, and Chinese. The system is a synchronous cascade: Qwen3-ASR with forced alignment produces an incrementally updated source transcript, and Gemma-4 E4B-it translates that prefix under an MT-side AlignAtt policy. To our knowledge, this is the first application of AlignAtt to a decoder-...
Yu Xia, Zhouhang Xie, Xin Xu · 2026-05-29
Large language models improve final-answer accuracy through extended chain-of-thought reasoning, but often spend tokens inefficiently and offer little inference-time control. Existing efficient reasoning methods control thinking length by shortening, early-stopping, or compressing traces, leaving how the model thinks implicit. In this paper, we propose Agentic Chain-of-Thought Steering (ACTS), ...
Roohan Ahmed Khan, Yasheerah Yaqoot, Muhammad Ahsan Mustafa · 2026-05-29
Deep reinforcement learning has shown strong potential for enabling autonomous robots to learn complex navigational tasks. However, its practical use still depends heavily on human designed reward functions and repeated manual fine tuning, which is time consuming and does not guarantee high success in the desired task. This paper presents AgenticRL, agent guided reinforcement learning framework...
Anthony GX-Chen, Ankit Anand, Gheorghe Comanici · 2026-05-29
Classical reinforcement learning (RL) typically seeks a deterministic policy that maximizes the expected sum of a scalar reward. Yet, modern applications such as language model fine-tuning or scientific discovery demand diversity. Existing remedies such as entropy regularization or diversity bonuses often require fragile trade-offs that sacrifice performance for stochasticity or rely on heurist...
M'at'e Gedeon, P'eter Mihajlik · 2026-05-29
Conversational ASR for lower-resource languages and niche domains is limited by the scarcity of domain-matched multi-speaker training data. We propose an augmentation pipeline that generates scenario-level dialogues with participant metadata, maps speaker attributes to TTS voice profiles, and assembles synthesized utterances into speaker-aware simulated conversations. We evaluated five LLM fami...
Amil Dravid, Yasaman Bahri, Alexei A. Efros · 2026-05-29
We investigate whether neuron populations within neural networks evolve predictably with scale, extending scaling laws beyond macroscopic observables such as loss. To probe this question, we study Rosetta Neurons, a previously characterized class of neurons whose activation patterns are similar across independently trained models (Dravid et al., 2023). In separate analyses of language models up...
Tao Chen, Gangwei Jiang, Pengyu Cheng · 2026-05-29
Reward models (RMs) provide critical feedback signals for LLM post-training, notably in reinforced fine-tuning (RFT) and reinforcement learning (RL) pipelines. However, current reward evaluation relies on heterogeneous criteria such as rule-based verifiers, ground-truth references, procedural checklists, and complex rubrics, where a unified mechanism to integrate all types of evidence remains u...
Hanjiang Hu, Yiyuan Pan, Jiaxing Li · 2026-05-29
As AI systems increasingly assist humans in physical tasks, ensuring safety becomes paramount -- physical actions carry immediate and irreversible consequences that digital errors do not. We introduce the Vision-Language Embodied Safety Agent (VLESA), a framework that monitors human activities from egocentric video and triggers real-time safety interventions when dangerous actions are predicted...
Mihail Stoian, Mark Gerarts, Pascal Ginter · 2026-05-29
Database vendors recently released AI functions that can be used in filter predicates. As such functions often rely on costly, black-box ML models, they unveil new data management challenges. Concretely, traditional data skipping techniques for integer and string data fail to be applicable to the new filter type. Indeed, there is no known mechanism for pruning non-qualifying row groups, e.g., w...
Dan Jacobellis, Neeraja J. Yadwadkar · 2026-05-29
In robotics systems, vast amounts of visual data are easily captured at high resolution using low-cost, low-power hardware. Yet, limited bandwidth and on-device compute resources prevent full utilization when transmitted via conventional codecs like JPEG/MPEG. Newer codecs, like AV1/AVIF, improve the rate-distortion trade-off, but demand far more resources for encoding, impractical without cust...
Mutsumi Sasaki, Go kamoda, Ryosuke Takahashi · 2026-05-29
Quantities with measurement units, such as 110 cm and 1.2 m, require language models (LMs) to combine a numeral with a symbolic unit scale. Here, we study how LMs compare such quantities in controlled settings spanning several unit systems. We find that accuracy degrades near the comparison boundary, where small changes in value determine the correct answer. The resulting errors are systematic:...
Aziz Sharipov Ortega, Dominik Mach'a\v{c}ek · 2026-05-29
We implement simultaneous translation capability with the offline direct speech-to-text translation model Canary, using the state-of-the-art policy AlignAtt, and submit it to IWSLT 2026 Simultaneous Speech Translation Shared task for Czech to English and English to German and Italian. The strengths of our system are: (1) high translation quality, outperforming similarly sized baselines both i...
Inhee Lee, Sangwon Baik, Sungjoo Kim · 2026-05-29
Reconstructing interactive, simulation-ready 3D scenes from a single image is a critical bottleneck for robotic manipulation. While recent single-image lifters recover plausible per-object shapes, composing them yields scenes that collapse under physical simulation due to interpenetrating, hovering, or sinking objects. Existing physics-aware methods address this strictly as a post-hoc layout co...
Tetiana Martyniuk, Jonathan Seele, Alexandre Boulch · 2026-05-29
This paper investigates "free lunch" strategies to boost the performance of lidar semantic scene completion (SSC) without requiring complex architectural redesigns. We first demonstrate that endowing input point clouds with semantic pseudo-labels from off-the-shelf segmentors significantly improves the performance of existing architectures. By evaluating these models against an oracle, we estab...
Shinjeong Kim, Ignacio Alzugaray, Callum Rhodes · 2026-05-29
Images composed of 2D pixel arrays are the standard input to computer vision algorithms, yet many underlying computations can be distributed across pixels. Transmitting raw, redundant, and noisy pixel data off the sensor remains inefficient, motivating a shift toward focal-plane sensor-processors that perform a significant part of the computation directly within each pixel. We envision pixels s...
Sebastian Cavada, Soumava Paul, Tuan-Hung Vu · 2026-05-29
Previous work has evaluated physics reasoning in foundation models using synthetic or semi-synthetic scenes and visual question-answering tasks. However, these benchmarks emphasize high-level events and lack the visual fidelity required to assess true low-level Newtonian understanding. We introduce NewtPhys, a 4D physically annotated dataset built from multiview images of real-world scenes with...
Haobo Li, Yanhong Zeng, Yunhong Lu · 2026-05-29
We present AAD-1, an Asymmetric Adversarial Distillation framework for One-step autoregressive image-to-video generation. State-of-the-art methods adopt adversarial distillation but suffer from motion collapse and training instability, resulting in static videos. AAD-1 addresses these challenges through two key designs in architecture and training strategy. Our key architectural insight is to b...
Yonghao Yu, Lang Huang, Runyi Li · 2026-05-29
Causal video generators must predict from the past, but they need not learn only from it. In streaming autoregressive video diffusion, each emitted segment becomes a commitment that future segments must preserve. Standard training, however, only asks each causal state to explain the present. This creates what we call a representation-level planning gap: states that fit the current segment may d...
Zechen Bai, Zhiheng Chen, Yiqi Lin · 2026-05-29
Human experience in digital environments offers a vast, underexplored resource of authentic, untrimmed interactions that contain rich procedural knowledge. We introduce Demo2Tutorial, a framework that transforms this experience captured via screen recordings and interaction logs into structured, multimodal software tutorials for teaching both humans and agents. Demo2Tutorial first collects huma...
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.