Abstract
Unmanned Aerial Vehicles (UAVs) acting as Flying Access Points (FAPs) are being used to provide on-demand wireless connectivity in extreme scenarios. Despite ongoing research, the optimization of UAVs' positions according to dynamic users' traffic demands remains challenging. We propose the Traffic-aware UAV Placement Algorithm (TUPA), which positions a UAV acting as FAP according to the users' traffic demands, in order to maximize the network utility. Using a DRL approach enables the FAP to autonomously learn and adapt to dynamic conditions and requirements of networking scenarios. Moreover, the proposed DRL methodology allows TUPA to generalize knowledge acquired during training to unknown combinations of users' positions and traffic demands, with no additional training. TUPA is trained and evaluated using network simulator ns-3 and ns3-gym framework. The results demonstrate that TUPA increases the network utility, compared to baseline solutions, increasing the average network utility up to 4x in scenarios with heterogeneous traffic demands.

Abstract
In the last few decades, there has been a growing interest in exploring the sea. The activities of the so-called blue economy can go from applications such as offshore maritime wind farms to ocean environment monitoring, which are supported by sensed platforms such Autonomous Surface Vehicles (ASVs) and Autonomous Underwater Vehicles (AUVs) that require the use of reliable underwater communications. Currently, there is no suitable solution that is able to combine long-range and broadband underwater communications. The integration of different technologies, namely acoustics, RF, and optical on a multimodal approach, has been considered a suitable solution to overcome the limitations caused by the water propagation medium. Since missions at the ocean are usually expensive and demand large human and technological resources, it is important to have accurate simulation platforms for these multimodal underwater wireless networks. This paper presents the first version of a novel simulation framework - MultiUWSim (Beta) -, built upon ns-3, which integrates multiple communications technologies (RF, acoustics and optical). The current version of the simulation platform offers the possibility of simulating acoustic-based and radio-based physical wireless interfaces in a single node in a ns-3 simulation environment, enabling fully-customizable underwater network simulations.

Abstract
The increasing complexity of recent Wi-Fi amendments is making optimal Rate Adaptation (RA) a challenge. The use of classic algorithms or heuristic models to address RA is becoming unfeasible due to the large combination of configuration parameters along with the variability of the wireless channel. We propose a simple Deep Reinforcement Learning approach for the automatic RA in Wi-Fi networks, named Data-driven Algorithm for Rate Adaptation (DARA). DARA is standard-compliant. It dynamically adjusts the Wi-Fi Modulation and Coding Scheme (MCS) solely based on the observation of the Signal-to-Noise Ratio (SNR) of the received frames at the transmitter. Our simulation results show that DARA achieves higher throughput when compared with Minstrel High Throughput (HT)

Abstract
The ability to move and hover has made rotary-wing unmanned aerial vehicles (UAVs) suitable platforms to act as flying communications relays (FCRs), aiming at providing on-demand, temporary wireless connectivity when there is no network infrastructure available or a need to reinforce the capacity of existing networks. However, since UAVs rely on their on-board batteries, which can be drained quickly, they typically need to land frequently for recharging or replacing them, limiting their endurance and the flying network availability. The problem is exacerbated when a single FCR UAV is used. The FCR UAV energy is used for two main tasks: Communications and propulsion. The literature has been focused on optimizing both the flying network performance and energy efficiency from the communications point of view, overlooking the energy spent for the UAV propulsion. Yet, the energy spent for communications is typically negligible when compared with the energy spent for the UAV propulsion. In this article, we propose energy-aware relay positioning (EREP), an algorithm for positioning the FCR taking into account the energy spent for the UAV propulsion. Building upon the conclusion that hovering is not the most energy-efficient state, EREP defines the trajectory and speed that minimize the energy spent by the FCR UAV on propulsion, without compromising in practice the quality of service offered by the flying network. The EREP algorithm is evaluated using simulations. The obtained results show gains up to 26% in the FCR UAV endurance for negligible throughput and delay degradation.

Abstract
Unmanned Aerial Vehicles (UAVs) have emerged as adequate platforms to carry communications nodes, including Wi-Fi Access Points and cellular Base Stations. This has led to the concept of flying networks composed of UAVs as a flexible and agile solution to provide on-demand wireless connectivity anytime, anywhere. However, state of the art works have been focused on optimizing the placement of the access network providing connectivity to ground users, overlooking the backhaul network design. In order to improve the overall Quality of Service (QoS) offered to ground users, the placement of Flying Gateways (FGWs) and the size of the queues configured in the UAVs need to be carefully defined to meet strict performance requirements. The main contribution of this article is a traffic-aware gateway placement and queue management (GPQM) algorithm for flying networks. GPQM takes advantage of knowing in advance the positions of the UAVs and their traffic demand to determine the FGW position and the queue size of the UAVs, in order to maximize the aggregate throughput and provide stochastic delay guarantees. GPQM is evaluated by means of ns-3 simulations, considering a realistic wireless channel model. The results demonstrate significant gains in the QoS offered when GPQM is used.

Abstract
Several research works have applied Reinforcement Learning (RL) algorithms to solve the Rate Adaptation (RA) problem in Wi-Fi networks. The dynamic nature of the radio link requires the algorithms to be responsive to changes in link quality. Delays in the execution of the algorithm due to implementional details may be detrimental to its performance, which in turn may decrease network performance. These delays can be avoided to a certain extent. However, this aspect has been overlooked in the state of the art when using simulated environments, since the computational delays are not considered. In this paper, we present an analysis of computational delays and their impact on the performance of RL-based RA algorithms, and propose a methodology to incorporate the experimental computational delays of the algorithms from running in a specific target hardware, in a simulation environment. Our simulation results considering the real computational delays showed that these delays do, in fact, degrade the algorithm’s execution and training capabilities which, in the end, has a negative impact on network performance. © ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2024.