3D Pick & Mix: Object Part Blending in Joint Shape and Image Manifolds
This addresses the need for more flexible and meaningful retrieval in applications such as furniture catalog browsing, though it appears incremental as it builds on existing retrieval systems by adding part-level reasoning.
The paper tackles the problem of limited search capabilities in 3D shape retrieval by introducing a system that allows users to query based on object parts, enabling semantically rich searches like combining legs from one chair with armrests from another. The result is a new approach that provides greater freedom in exploring 3D shape and image collections.
We present 3D Pick & Mix, a new 3D shape retrieval system that provides users with a new level of freedom to explore 3D shape and Internet image collections by introducing the ability to reason about objects at the level of their constituent parts. While classic retrieval systems can only formulate simple searches such as "find the 3D model that is most similar to the input image" our new approach can formulate advanced and semantically meaningful search queries such as: "find me the 3D model that best combines the design of the legs of the chair in image 1 but with no armrests, like the chair in image 2". Many applications could benefit from such rich queries, users could browse through catalogues of furniture and pick and mix parts, combining for example the legs of a chair from one shop and the armrests from another shop.