Data-driven insight into the puzzle-based cybersecurity training
This addresses a specific need for cybersecurity educators by providing a tool to analyze training data, though it appears incremental as it builds on existing visualization design methods.
The researchers tackled the problem of lacking tools for post-training data analysis in puzzle-based cybersecurity education by developing a Training Analysis Tool that supports learning analysis of single hands-on sessions, enabling trainee comparison and identification of assignment flaws, with qualitative evaluation showing participants appreciated its positive impact on workflows.
Puzzle-based training is a common type of hands-on activity accompanying formal and informal cybersecurity education, much like programming or other IT skills. However, there is a lack of tools to help the educators with the post-training data analysis. Through a visualization design study, we designed the Training Analysis Tool that supports learning analysis of a single hands-on session. It allows an in-depth trainee comparison and enables the identification of flaws in puzzle assignments. We also performed a qualitative evaluation with cybersecurity experts and students. The participants apprised the positive influence of the tool on their workflows. Our insights and recommendations could aid the design of future tools supporting educators, even beyond cyber security.