Transfer Learning for T-Cell Response Prediction
This work addresses a key challenge in bioinformatics for developing personalized cancer vaccines, though it is incremental as it builds on existing transformer models and transfer learning techniques.
The paper tackled the problem of T-cell response prediction for peptides, which is crucial for personalized cancer vaccines, by addressing shortcut learning in multi-domain data and demonstrating that a per-source fine-tuning approach achieves competitive performance with state-of-the-art methods for human peptides.
We study the prediction of T-cell response for specific given peptides, which could, among other applications, be a crucial step towards the development of personalized cancer vaccines. It is a challenging task due to limited, heterogeneous training data featuring a multi-domain structure; such data entail the danger of shortcut learning, where models learn general characteristics of peptide sources, such as the source organism, rather than specific peptide characteristics associated with T-cell response. Using a transformer model for T-cell response prediction, we show that the danger of inflated predictive performance is not merely theoretical but occurs in practice. Consequently, we propose a domain-aware evaluation scheme. We then study different transfer learning techniques to deal with the multi-domain structure and shortcut learning. We demonstrate a per-source fine tuning approach to be effective across a wide range of peptide sources and further show that our final model is competitive with existing state-of-the-art approaches for predicting T-cell responses for human peptides.