Virtual Machine Introspection Based Malware Behavior Profiling and Family Grouping
This addresses the problem of expedient malware threat mitigation for cybersecurity practitioners, though it is incremental as it builds on existing techniques like Jaccard distance and phylogenetic trees.
The paper tackles malware family identification by proposing a malware profiler (VMP) that uses virtual machine introspection to record API calls, and it shows that VMP outperforms most existing anti-malware engines in constructing malware families, with results indicating high similarity within families and distinctiveness from others.
The proliferation of malwares have been attributed to the alternations of a handful of original malware source codes. The malwares alternated from the same origin share some intrinsic behaviors and form a malware family. Expediently, identifying its malware family when a malware is first seen on the Internet can provide useful clues to mitigate the threat. In this paper, a malware profiler (VMP) is proposed to profile the execution behaviors of a malware by leveraging virtual machine introspection (VMI) technique. The VMP inserts plug-ins inside the virtual machine monitor (VMM) to record the invoked API calls with their input parameters and return values as the profile of malware. In this paper, a popular similarity measurement Jaccard distance and a phylogenetic tree construction method are adopted to discover malware families. The studies of malware profiles show the malwares from a malware family are very similar to each others and distinct from other malware families as well as benign software. This paper also examines VMP against existing anti-malware detection engines and some well-known malware grouping methods to compare the goodness in their malware family constructions. A peer voting approach is proposed and the results show VMP is better than almost all of the compared anti-malware engines, and compatible with the fine tuned text-mining approach and high order N-gram approaches. We also establish a malware profiling website based on VMP for malware research.