在城市地区部署蜂窝网络时，需要解决各种挑战。例如，高耸且形状和高度各异的建筑物会导致信号衰减、反射、衍射和散射效应，这使得在建筑物附近出现覆盖空洞（CHs）的可能性很高。对于网络运营商而言，检测这些CHs至关重要，因为这些区域的用户可能会遇到信号弱或无信号的情况。为了解决这一问题，我们提出了一种利用自主车辆（如无人机，UAV）进行CHs检测的方法，以减少路测工作量并降低人力成本。该无人机通过强化学习（RL）利用存储的局部建筑地图、当前位置以及测量到的信号强度来定位CHs。随着无人机移动，它会动态更新对信号环境的认知，并调整方向以接近最近的CH，同时避免与建筑物发生碰撞。我们使用来自OpenStreetMap的建筑地图和由NVIDIA Sionna射线追踪模拟生成的信号强度数据创建了广泛的测试场景。结果显示，基于强化学习的方法在检测城市地区的CHs方面优于非机器学习、基于几何的方法。此外，即使无人机的测量次数有限，该方法的性能也接近假设完全掌握所有信号强度的理论上限。

Deployment of cellular networks in urban areas requires addressing various challenges. For example, high-rise buildings with varying geometrical shapes and heights contribute to signal attenuation, reflection, diffraction, and scattering effects. This creates a high possibility of coverage holes (CHs) within the proximity of the buildings. Detecting these CHs is critical for network operators to ensure quality of service, as customers in these areas may experience weak or no signal reception. To address this challenge, we propose an approach using an autonomous vehicle, such as an unmanned aerial vehicle (UAV), to detect CHs, for minimizing drive test efforts and reducing human labor. The UAV leverages reinforcement learning (RL) to find CHs using stored local building maps, its current location, and measured signal strengths. As the UAV moves, it dynamically updates its knowledge of the signal environment and its direction to a nearby CH while avoiding collisions with buildings. We created a wide range of testing scenarios using building maps from OpenStreetMap and signal strength data generated by NVIDIA Sionna raytracing simulations. The results show that the RL-based approach outperforms non-machine learning, geometry-based methods in detecting CHs in urban areas. Additionally, even with a limited number of UAV measurements, the method achieves performance close to theoretical upper bounds that assume complete knowledge of all signal strengths.