Question answering system of bridge design specification based on large language model
This provides a useful reference for developing question answering systems in professional domains like bridge design, but it is incremental as it applies existing methods to a new dataset.
The paper tackled the problem of building a question answering system for bridge design specifications using large language models, achieving 100% accuracy on training, validation, and test datasets with a fully fine-tuned BERT model, while other methods showed limited generalization.
This paper constructs question answering system for bridge design specification based on large language model. Three implementation schemes are tried: full fine-tuning of the Bert pretrained model, parameter-efficient fine-tuning of the Bert pretrained model, and self-built language model from scratch. Through the self-built question and answer task dataset, based on the tensorflow and keras deep learning platform framework, the model is constructed and trained to predict the start position and end position of the answer in the bridge design specification given by the user. The experimental results show that full fine-tuning of the Bert pretrained model achieves 100% accuracy in the training-dataset, validation-dataset and test-dataset, and the system can extract the answers from the bridge design specification given by the user to answer various questions of the user; While parameter-efficient fine-tuning of the Bert pretrained model and self-built language model from scratch perform well in the training-dataset, their generalization ability in the test-dataset needs to be improved. The research of this paper provides a useful reference for the development of question answering system in professional field.