Exploring the Performance of Perforated Backpropagation through Further Experiments
It addresses model efficiency and accuracy for ML practitioners, but is incremental as it builds on prior work with further experiments.
The paper explores Perforated Backpropagation, a neural network optimization technique inspired by biological dendrites, through experiments from a hackathon, showing it can achieve up to 90% model compression without accuracy loss or up to 16% accuracy improvement in various projects.
Perforated Backpropagation is a neural network optimization technique based on modern understanding of the computational importance of dendrites within biological neurons. This paper explores further experiments from the original publication, generated from a hackathon held at the Carnegie Mellon Swartz Center in February 2025. Students and local Pittsburgh ML practitioners were brought together to experiment with the Perforated Backpropagation algorithm on the datasets and models which they were using for their projects. Results showed that the system could enhance their projects, with up to 90% model compression without negative impact on accuracy, or up to 16% increased accuracy of their original models.