White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Cross-format integration between spoken number words and Arabic digits

Lin, Chia-Yuan (2017) Cross-format integration between spoken number words and Arabic digits. PhD thesis, University of York.

CY_PhDThesis_CorrectionDone.pdf - Examined Thesis (PDF)
Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (11Mb) | Preview


Spoken number words and Arabic digits are the most commonly used numerical symbols. We often transcode numerals from one to another, thus, the correspondence between them should become over-learned and automatic after years of usage. It has been shown that an integration usually exists when pairing of stimulus is over-learned, and is often reflected in the mismatch negativity (MMN). The current thesis conducted two behavioural experiments (Chapter 2) and three EEG experiments (Chapter 3 - 5) to systematically investigate the cross-modal correspondence, i.e., the integration, between spoken number words and Arabic digits in adult participants. In the behavioural experiments, a clear distance effect is shown in an audiovisual matching task. This suggests that an amodal, shared magnitude representation is activated for cross-modal numerals during a matching judgment. Moreover, the distance effect is modulated by stimulus onset asynchrony (SOA). That is, the distance effect becomes smaller with the increase of SOA. This is similar to the data pattern of a common integration effect because an integration usually shows when cross-modal stimuli are temporally close. However, a disadvantage of a behavioural task is that the RTs could be influenced by response-selection or response-execution. Hence, I then used an oddball paradigm in which no responses are required for the cross-modal numerals in my EEG experiments. The results of three EEG experiments showed that an early integration effect exists between spoken number words and Arabic digits in the mismatch negativity (MMN). This result is first to show the presence of a cross-format integration between spoken number words and Arabic digits. However, the integration effect is also modulated by distance as well as stimulus onset asynchrony (SOA), which may suggest that the cross-modal correspondence between audiovisual numerals is more complicated than other kinds of audiovisual stimuli, such as letters and speech sounds.

Item Type: Thesis (PhD)
Academic Units: The University of York > Psychology (York)
Identification Number/EthosID: uk.bl.ethos.736588
Depositing User: Mr Chia-Yuan Lin
Date Deposited: 20 Mar 2018 15:10
Last Modified: 21 Mar 2020 10:53
URI: http://etheses.whiterose.ac.uk/id/eprint/19401

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)