White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

A self-learning motorway traffic control system for ramp metering

Lu, Chao (2014) A self-learning motorway traffic control system for ramp metering. PhD thesis, University of Leeds.

PhD thesis Chao Lu final version.pdf - Final eThesis - complete (pdf)
Available under License Creative Commons Attribution-Noncommercial-Share Alike 2.0 UK: England & Wales.

Download (3210Kb) | Preview


Self-learning systems have attracted increasing attention in the ramp metering domain in recent years. These systems are based on reinforcement learning (RL) and can learn to control motorway traffic adaptively. However, RL-based ramp metering systems are still in their early stages and have shown limitations regarding their design and evaluation. This research aims to develop a new RL-based system (known as RAS) for ramp metering to overcome these limitations. A general framework for designing a RL-based system is proposed in this research. It contains the definition of three RL elements in a ramp metering scenario and a system structure which brings together all modules to accomplish the reinforcement learning process. Under this framework, two control algorithms for both single- and multi-objective problems are developed. In addition, to evaluate the proposed system, a software platform combining the new system and a traffic flow model is developed in the research. Based on the platform developed, a systematic evaluation is carried out through a series of simulation-based experiments. By comparing with a widely used control strategy, ALINEA, the proposed system, RAS, has shown its effectiveness in learning the optimal control actions for different control objectives in both hypothetical and real motorway networks. It is found that RAS outperforms ALINEA on improving traffic efficiency in the situation with severe congestion and on maintaining user equity when multiple on-ramps are included in the motorway network. Moreover, this research has been extended to use indirect learning technology to deal with incident-induced congestion. Tests for this extension to the work are carried out based on the platform developed and a commercial software package, AIMSUN, which have shown the potential of the extended system in tackling incident-induced congestion.

Item Type: Thesis (PhD)
Keywords: motorway traffic control, traffic simulation, traffic flow model, cell transmission model, reinforcement learning, multi-objective optimisation
Academic Units: The University of Leeds > Faculty of Environment (Leeds) > Institute for Transport Studies (Leeds)
Identification Number/EthosID: uk.bl.ethos.638904
Depositing User: Mr Chao Lu
Date Deposited: 26 Feb 2015 11:44
Last Modified: 11 Apr 2020 09:53
URI: http://etheses.whiterose.ac.uk/id/eprint/7895

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)