Just Noticeable Difference Modeling for Deep Visual Features
This work addresses the need for feature quality control in vision systems, offering a practical method for resource-constrained applications, but it is incremental as it extends existing JND concepts to deep features.
The paper tackles the problem of controlling deep visual feature quality for machine perception by proposing FeatJND, a task-aligned just noticeable difference formulation that predicts maximum tolerable per-feature perturbations while preserving downstream task performance, showing consistent gains over unstructured perturbations and clear improvements in token-wise dynamic quantization under the same noise budget.
Deep visual features are increasingly used as the interface in vision systems, motivating the need to describe feature characteristics and control feature quality for machine perception. Just noticeable difference (JND) characterizes the maximum imperceptible distortion for images under human or machine vision. Extending it to deep visual features naturally meets the above demand by providing a task-aligned tolerance boundary in feature space, offering a practical reference for controlling feature quality under constrained resources. We propose FeatJND, a task-aligned JND formulation that predicts the maximum tolerable per-feature perturbation map while preserving downstream task performance. We propose a FeatJND estimator at standardized split points and validate it across image classification, detection, and instance segmentation. Under matched distortion strength, FeatJND-based distortions consistently preserve higher task performance than unstructured Gaussian perturbations, and attribution visualizations suggest FeatJND can suppress non-critical feature regions. As an application, we further apply FeatJND to token-wise dynamic quantization and show that FeatJND-guided step-size allocation yields clear gains over random step-size permutation and global uniform step size under the same noise budget. Our code will be released after publication.