White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Enhancement of Model Generalisation in Multiobjective Genetic Programming

Ni, Ji (2013) Enhancement of Model Generalisation in Multiobjective Genetic Programming. PhD thesis, University of Sheffield.

[img] Text (Ji Ni's thesis)
jnThesis_1.0.5.docx
Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (11Mb)

Abstract

Multiobjective genetic programming (MOGP) is a powerful evolutionary algorithm that requires no human pre-fixed model sets to handle regression and classification problems in the machine learning area. We aim to improve the model generalisation of MOGP in both regression and classification tasks. The work in this thesis has three main contributions. First, we propose replacing the division operator used in genetic programming with an analytic quotient (AQ) operator in regression to systematically achieve lower mean squared error due principally to removing the discontinuities or singularities caused by conventional protected or unprotected division. Further, this AQ operator is differentiable. Second, we propose using Tikhonov regularisation, in conjunction with node count (using an extension of Pareto comparison from vectors to tuples) as a general complexity measure in MOGP. We demonstrate that employing this general complexity yields mean squared test error measures over a range of regression problems which are typically superior to those from conventional node count. We further analysed the reason why our new method outperforms the conventional complexity measure and conclude that it forms a decision mechanism which balances both syntactic and semantic information. Third, we propose using a loss measure complementary to Vapnik's statistical learning theory, which can effectively stabilise classifiers trained by MOGP. We demonstrate that this loss measure has a number of attractive properties and has a better correlation with generalisation error compared to 0/1 loss, so that better generalisation performance is achievable.

Item Type: Thesis (PhD)
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Electronic and Electrical Engineering (Sheffield)
Identification Number/EthosID: uk.bl.ethos.589326
Depositing User: Mr Ji Ni
Date Deposited: 27 Jan 2014 16:04
Last Modified: 03 Oct 2016 11:03
URI: http://etheses.whiterose.ac.uk/id/eprint/5021

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)