CVFeb 28, 2023

Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance

arXiv:2302.14268v134 citationsh-index: 30
Originality Incremental advance
AI Analysis

This work addresses the need for reduced annotation effort in category-level articulated object pose estimation, though it is incremental as it builds on existing self-supervised and equivariance concepts.

The paper tackles the problem of estimating articulation-aware poses for unseen articulated objects without human annotations by introducing a self-supervised method based on part-level SE(3) equivariance and fine-grained pose-shape disentanglement, achieving effective results on synthetic and real datasets.

Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category. To reduce the heavy annotations needed for supervised learning methods, we present a novel self-supervised strategy that solves this problem without any human labels. Our key idea is to factorize canonical shapes and articulated object poses from input articulated shapes through part-level equivariant shape analysis. Specifically, we first introduce the concept of part-level SE(3) equivariance and devise a network to learn features of such property. Then, through a carefully designed fine-grained pose-shape disentanglement strategy, we expect that canonical spaces to support pose estimation could be induced automatically. Thus, we could further predict articulated object poses as per-part rigid transformations describing how parts transform from their canonical part spaces to the camera space. Extensive experiments demonstrate the effectiveness of our method on both complete and partial point clouds from synthetic and real articulated object datasets.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes