CVDec 20, 2024

Monkey Transfer Learning Can Improve Human Pose Estimation

arXiv:2412.15966v1h-index: 15
Originality Incremental advance
AI Analysis

This addresses the challenge of limited clinical data for AI training in pose estimation, though it is incremental as it builds on existing transfer learning methods.

The study tackled the problem of improving human pose estimation in clinical populations by using transfer learning from macaque monkey data, resulting in better precision and recall with fewer human training examples (1,000 vs. 19,185).

In this study, we investigated whether transfer learning from macaque monkeys could improve human pose estimation. Current state-of-the-art pose estimation techniques, often employing deep neural networks, can match human annotation in non-clinical datasets. However, they underperform in novel situations, limiting their generalisability to clinical populations with pathological movement patterns. Clinical datasets are not widely available for AI training due to ethical challenges and a lack of data collection. We observe that data from other species may be able to bridge this gap by exposing the network to a broader range of motion cues. We found that utilising data from other species and undertaking transfer learning improved human pose estimation in terms of precision and recall compared to the benchmark, which was trained on humans only. Compared to the benchmark, fewer human training examples were needed for the transfer learning approach (1,000 vs 19,185). These results suggest that macaque pose estimation can improve human pose estimation in clinical situations. Future work should further explore the utility of pose estimation trained with monkey data in clinical populations.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes