Artificial Intelligence for Bias Detection in Higher Education Online Content

This thesis develops and evaluates Artificial Intelligence (AI) and Natural Language Pro-cessing (NLP) approaches for detecting bias in higher education online resources, ad-dressing the lack of systematic computational methods in this area. Bias in higher educa-tion content shapes knowledge production, representation and equity, making its detec-tion both academically and socially significant.
To address this gap, three sets of novel datasets were created: 1. a corpus of university news articles annotated for subjectivity, sentiment and gender representation; 2. three university reading list datasets with demographic annotations enabling comparative analy-sis across Western and Middle Eastern contexts; and 3. two domain-specific collections of learning materials, one from humanities-oriented open resources and the other from Science, Technology, Engineering and Mathematics (STEM) lecture transcripts. Togeth-er, these datasets provide the first systematic resources for investigating representational, stereotypical and linguistic bias across diverse higher education domains.
Using these resources, a range of Pre-trained Language Models (PLMs) and Large Lan-guage Models (LLMs) were evaluated for bias detection. PLM revealed significant gen-dered and representational disparities in university discourse, while fine-tuned LLM achieved improved performance on humanities data but showed limited transferability to STEM materials. A hybrid framework integrating fine-tuned LLMs with Retrieval-Augmented Generation (RAG) enhanced detection transparency and prediction balance. These methods were operationalised in a prototype web application for bias detection in higher education learning content.
The contributions of this research are fourfold: 1. the creation of multiple novel annotat-ed datasets spanning university news, reading lists and academic learning resources; 2. the introduction of LLM-based strategies for bias annotation, fine-tuning and cross-domain evaluation 3. methodological innovations including a structured framework for catego-rising bias, a hybrid human–AI annotation approach and a replicable NLP pipeline for demographic and thematic analysis; and 4. the design of a hybrid bias detection system and accompanying web application.
This work advances computational approaches to bias detection, provides reproducible resources for future research and offers practical tools to support greater fairness and equity in higher education online environments.