Generative Dataset Distillation: Balancing Global Structure and Local Details
This work addresses the issue of long redeployment time and poor cross-architecture performance in dataset distillation for machine learning applications, representing an incremental improvement.
The paper tackles the problem of dataset distillation by proposing a method that balances global structure and local details, using a conditional generative adversarial network to generate a distilled dataset, resulting in improved information density.
In this paper, we propose a new dataset distillation method that considers balancing global structure and local details when distilling the information from a large dataset into a generative model. Dataset distillation has been proposed to reduce the size of the required dataset when training models. The conventional dataset distillation methods face the problem of long redeployment time and poor cross-architecture performance. Moreover, previous methods focused too much on the high-level semantic attributes between the synthetic dataset and the original dataset while ignoring the local features such as texture and shape. Based on the above understanding, we propose a new method for distilling the original image dataset into a generative model. Our method involves using a conditional generative adversarial network to generate the distilled dataset. Subsequently, we ensure balancing global structure and local details in the distillation process, continuously optimizing the generator for more information-dense dataset generation.