New speech-inspired tools for exploring timbre in computer-based composition and music production

Abstract

Speech processing can be used in music to transfer the qualities of the human voice to another recorded sound. The use of technologies employed in phonetics and telecommunications provide the creative potential to use speech to design sound transformations over time and to use the features of the human voice to control other sound sources. Computer music tools are often viewed as treating the voice as a time-varying resonator, and this is true, but it could also be argued that the voice and its time-varying anti-resonant capabilities have been under-emphasised in the tools and in the literature. This thesis explores possibilities of including anti-resonance and examines types of vocal sound that are characterised at least partly by anti-resonance. The aim of the research presented in this thesis is to explore technology as a means of transferring the timbre of human voice to another sound source. The estimation of the resonant structures of the vocal tract, through the audio analysis of recorded speech, provides a way to extract the features of voice and combine its timbre with another sound. This enables the extraction of the colour of speech sounds to control sound synthesis, in order to design transformation over time informed by knowledge of the acoustics of the human voice.

Metadata

Supervisors:	Wells, Jez
Keywords:	Music Production; Computer Music; Speech Coding; LPC ;Prony's Method; Formant Analysis; Vowels; Nasal Consonants; Anti-formants; Pole-Zero filter; Sound Morphing; Timbre interpolation; MATLAB; Csound; Music Production Techniques; Sound Synthesis Techniques; Speech Synthesis; Spectral Envelope; Formant Synthesis; Digital Waveguide Synthesis
Awarding institution:	University of York
Academic Units:	The University of York > Music (York)
Identification Number/EthosID:	uk.bl.ethos.832548
Depositing User:	Mr Michele Pizzi
Date Deposited:	05 Jul 2021 10:29
Last Modified:	21 Jul 2023 09:53

Downloads

Examined Thesis (PDF)

Filename: Pizzi_109048776_CorrectedThesisClean.pdf.pdf

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_PZeroSynth.zip.zip

Description: PZero Synth - Audio Interpolation System

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_AudioTrack_1_Vocal_Fry_(2015)_44.1kHz.wav.wav

Description: Michele Pizzi - Vocal Fry (2015)

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_AudioTrack_2_Fricatives_(2016)_44.1kHz.wav.wav

Description: Michele Pizzi - Fricatives (2016) - 44.1 kHz version

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_AudioTrack_2_Fricatives_(2016)_48kHz.wav.wav

Description: Michele Pizzi - Fricatives (2016) - 48kHz version

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_AudioTrack_3_Whispers_(2018)_44.1kHz.wav.wav

Description: Michele Pizzi - Whispers (2018) - 44.1 kHz version

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_AudioTrack_3_Whispers_(2018)_48kHz.wav.wav

Description: Michele Pizzi - Whispers (2018) - 48 kHz version

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_1.1_Example_vowels_cascade_formant_synthesizer.wav.wav

Description: Example 1.1

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_1.2_Isolated_formants_vowel_a.wav.wav

Description: Example 1.2

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_1.3_Example_of_dipthong.wav.wav

Description: Example 1.3

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_1.4_Example_of_synthetic_vocal_fry_voice_source.wav.wav

Description: Example 1.4

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_1.5_Technique_Fry_Texture_synthesis.wav.wav

Description: Example 1.5

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_2.1_Two_tube_vowels.wav.wav

Description: Example 2.1

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_2.2_Fricative_consonants.wav.wav

Description: Example 2.2

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_2.3_t_consonant_example.wav.wav

Description: Example 2.3

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_2.4_Pulse_train_from_t_consonant.wav.wav

Description: Example 2.4

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_2.5_Audio_editing_technique_transition_in_Fricatives.wav.wav

Description: Example 2.5

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_2.6_Model_exaggerated_parameters.wav.wav

Description: Example 2.6

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_2.7_Waveguide_vocal_tract_chorusing.wav.wav

Description: Example 2.7

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_3.1_Nasal_consonants.wav.wav

Description: Example 3.1

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_3.2_Example_subharmonics_m_to_a_interpolation.wav.wav

Description: Example 3.2

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Supplementary Material

Filename: Pizzi_109048776_Example_3.3_Example_noise_o_a.wav.wav

Description: Example 3.3

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_3.4_Successive_filtering_interpolations_in_cascade.wav.wav

Description: Example 3.4

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

Examined Thesis (PDF)

Filename: Pizzi_109048776_Example_3.5_Fry_texture_Prony.wav.wav

Description: Example 3.5

Licence:
This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License

CLICK TO DOWNLOAD

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

CORE (COnnecting REpositories)

New speech-inspired tools for exploring timbre in computer-based composition and music production

Abstract

Metadata

Downloads

Examined Thesis (PDF)

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Examined Thesis (PDF)

Supplementary Material

Supplementary Material

Examined Thesis (PDF)

Examined Thesis (PDF)

Examined Thesis (PDF)

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Supplementary Material

Examined Thesis (PDF)

Examined Thesis (PDF)

Export

Statistics