Efficient Transformations in Deep Learning Convolutional Neural Networks
This addresses energy efficiency in CNNs for image classification, offering a practical solution for energy-constrained applications, though it is incremental as it builds on existing transformations and models.
The study integrated signal processing transformations into ResNet50 for image classification on CIFAR-100, finding that Walsh-Hadamard Transform (WHT) improved accuracy from 66% to 79% while reducing energy consumption from 25,606 kJ to 39 kJ per model.
This study investigates the integration of signal processing transformations -- Fast Fourier Transform (FFT), Walsh-Hadamard Transform (WHT), and Discrete Cosine Transform (DCT) -- within the ResNet50 convolutional neural network (CNN) model for image classification. The primary objective is to assess the trade-offs between computational efficiency, energy consumption, and classification accuracy during training and inference. Using the CIFAR-100 dataset (100 classes, 60,000 images), experiments demonstrated that incorporating WHT significantly reduced energy consumption while improving accuracy. Specifically, a baseline ResNet50 model achieved a testing accuracy of 66%, consuming an average of 25,606 kJ per model. In contrast, a modified ResNet50 incorporating WHT in the early convolutional layers achieved 74% accuracy, and an enhanced version with WHT applied to both early and late layers achieved 79% accuracy, with an average energy consumption of only 39 kJ per model. These results demonstrate the potential of WHT as a highly efficient and effective approach for energy-constrained CNN applications.