The Influence of Domain-Based Preprocessing on Subject-Specific Clustering
This work addresses the increased workload for academics in online teaching by enhancing clustering of student queries, but it is incremental as it builds on previous methods with domain-specific preprocessing.
The paper tackles the problem of clustering student queries with code excerpts by implementing tagging of technical terms during preprocessing, resulting in improved clustering efficiency as demonstrated by empirical results.
The sudden change of moving the majority of teaching online at Universities due to the global Covid-19 pandemic has caused an increased amount of workload for academics. One of the contributing factors is answering a high volume of queries coming from students. As these queries are not limited to the synchronous time frame of a lecture, there is a high chance of many of them being related or even equivalent. One way to deal with this problem is to cluster these questions depending on their topic. In our previous work, we aimed to find an improved method of clustering that would give us a high efficiency, using a recurring LDA model. Our data set contained questions posted online from a Computer Science course at the University of Bath. A significant number of these questions contained code excerpts, which we found caused a problem in clustering, as certain terms were being considered as common words in the English language and not being recognised as specific code terms. To address this, we implemented tagging of these technical terms using Python, as part of preprocessing the data set. In this paper, we explore the realms of tagging data sets, focusing on identifying code excerpts and providing empirical results in order to justify our reasoning.