A new AI-driven framework can direct networks of reconfigurable wireless reflectors to boost signal strength by up to 7.79 dB over conventional methods — without requiring the computationally expensive channel measurements that currently limit real-world deployment of such systems.

The paper, posted to ArXiv by researchers working on next-generation millimetre-wave (mmWave) networks, addresses a central tension in the design of so-called Reconfigurable Intelligent Surfaces (RIS): these panels can reshape wireless signals in useful ways, but coordinating them at scale demands enormous amounts of real-time channel data and centralised computation that quickly becomes impractical.

Why Channel Estimation Is a Bottleneck

In standard wireless systems, devices and base stations continuously exchange pilot signals — known reference transmissions — to map how radio waves are behaving across the environment. This process, known as Channel State Information (CSI) estimation, lets the network adapt its behaviour to reflections, interference, and movement. For a handful of antennas, the overhead is manageable. For large RIS arrays operating across dense mmWave deployments, it scales badly: the number of parameters to estimate grows with every additional reflector element, and the required computation can outpace the network's ability to act on the results.

By substituting pilot-based channel estimation with accessible user localization data, the framework leverages spatial intelligence for macro-scale wave propagation management.

The researchers' solution is to sidestep CSI estimation entirely. Instead of measuring the channel directly, their system uses user location data — coordinates of where devices actually are — as the primary input. Location information is increasingly available through GPS, Wi-Fi positioning, and other tracking methods, and it carries enough spatial information to make useful decisions about where to aim reflective surfaces, even if it doesn't capture every nuance of the radio environment.

A Two-Tier Control Architecture

The technical core of the paper is a Hierarchical Multi-Agent Reinforcement Learning (HMARL) architecture that splits the control problem across two levels. A high-level controller handles the slower, strategic task: deciding which users should be served by which reflectors at any given moment. These are discrete allocation decisions, made less frequently, covering the broad organisation of the system.

Below that sits a layer of low-level controllers, one per reflector, each responsible for continuously fine-tuning where exactly the surface focuses its beam — a continuous optimisation problem that demands faster, more granular responses. These low-level agents are trained using Multi-Agent Proximal Policy Optimization (MAPPO), a reinforcement learning algorithm suited to cooperative multi-agent settings.

The training follows a Centralized Training with Decentralized Execution (CTDE) scheme: during training, agents share information to learn better joint behaviour; at deployment, each agent acts on its own observations without needing a central coordinator. This distinction matters for practical deployment, where real-time communication between all nodes would introduce latency and single points of failure.

Simulation Results and Scalability

The team evaluated the framework using deterministic ray-tracing, a physics-based simulation method that models how radio waves reflect, diffract, and scatter through an environment. This is a more rigorous approach than simplified analytical channel models, though the results are self-reported and have not yet been independently replicated or tested in a live network deployment.

Under these conditions, the hierarchical framework delivered RSSI (Received Signal Strength Indicator) improvements of up to 7.79 dB compared to centralised optimisation baselines. A gain of that magnitude represents a meaningful improvement in effective signal power — roughly equivalent to more than doubling the received signal strength, depending on how it translates into a specific deployment scenario.

The system also demonstrated what the authors describe as robust performance under sub-metre localisation errors — meaning the system continued to function well even when the position data feeding the model was slightly inaccurate. This is an important practical consideration: no positioning system is perfect, and a framework that degrades sharply under small location errors would be fragile in real conditions. The paper also reports that performance held up as the number of users scaled, addressing a concern common to centralised systems that struggle as network size grows.

Eliminating CSI Without Sacrificing Performance

The authors argue that the combination of location-based input, hierarchical control, and decentralised execution creates an approach that is both scalable and cost-effective for intelligent wireless environments. The elimination of pilot-based channel sounding reduces both computational load and the signalling overhead that eats into available bandwidth — costs that become increasingly significant at mmWave frequencies, where channel conditions change rapidly and the antenna arrays involved are large.

The work builds on a growing body of research applying reinforcement learning to wireless network optimisation, where the environment is too complex and dynamic for hand-crafted rules to remain effective. Multi-agent approaches are attractive here because wireless networks are inherently distributed systems: many nodes, many users, many decisions happening simultaneously.

That said, the gap between simulation and deployment remains significant. Ray-tracing provides a realistic testbed, but real environments introduce hardware imperfections, mobility patterns, and interference sources that models approximate but cannot fully capture. The framework's dependence on location data also introduces its own requirements — reliable, low-latency positioning infrastructure is not universally available, particularly indoors or in dense urban canyons where mmWave networks are most needed.

What This Means

For engineers and researchers working on next-generation wireless infrastructure, this paper offers a concrete demonstration that AI-driven, CSI-free control of reconfigurable reflectors can outperform conventional centralised approaches in simulation — a signal that the architectural assumptions underlying large-scale RIS deployment may merit revision.