White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Accelerating Reinforcement Learning for Dynamic Spectrum Access in Cognitive Wireless Networks

Morozs, Nils (2015) Accelerating Reinforcement Learning for Dynamic Spectrum Access in Cognitive Wireless Networks. PhD thesis, University of York.

Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (1575Kb) | Preview


This thesis studies the applications of distributed reinforcement learning (RL) based machine intelligence to dynamic spectrum access (DSA) in future cognitive wireless networks. In particular, this work focuses on ways of accelerating distributed RL based DSA algorithms in order to improve their adaptability in terms of the initial and steady-state performance, and the quality of service (QoS) convergence behaviour. The performance of the DSA schemes proposed in this thesis is empirically evaluated using large-scale system-level simulations of a temporary event scenario which involves a cognitive small cell network installed in a densely populated stadium, and in some cases a base station on an aerial platform and a number of local primary LTE base stations, all sharing the same spectrum. Some of the algorithms are also theoretically evaluated using a Bayesian network based probabilistic convergence analysis method proposed by the author. The thesis presents novel distributed RL based DSA algorithms that employ a Win-or-Learn-Fast (WoLF) variable learning rate and an adaptation of the heuristically accelerated RL (HARL) framework in order to significantly improve the initial performance and the convergence speed of classical RL algorithms and, thus, increase their adaptability in challenging DSA environments. Furthermore, a distributed case-based RL approach to DSA is proposed. It combines RL and case-based reasoning to increase the robustness and adaptability of distributed RL based DSA schemes in dynamically changing wireless environments.

Item Type: Thesis (PhD)
Related URLs:
Academic Units: The University of York > Electronics (York)
Identification Number/EthosID: uk.bl.ethos.677373
Depositing User: Mr Nils Morozs
Date Deposited: 13 Jan 2016 14:46
Last Modified: 08 Sep 2016 13:33
URI: http://etheses.whiterose.ac.uk/id/eprint/11523

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)