CVMar 29, 2023
CN-DHF: Compact Neural Double Height-Field Representations of 3D ShapesEric Hedlin, Jinfan Yang, Nicholas Vining et al.
We introduce CN-DHF (Compact Neural Double-Height-Field), a novel hybrid neural implicit 3D shape representation that is dramatically more compact than the current state of the art. Our representation leverages Double-Height-Field (DHF) geometries, defined as closed shapes bounded by a pair of oppositely oriented height-fields that share a common axis, and leverages the following key observations: DHFs can be compactly encoded as 2D neural implicits that capture the maximal and minimal heights along the DHF axis; and typical closed 3D shapes are well represented as intersections of a very small number (three or fewer) of DHFs. We represent input geometries as CNDHFs by first computing the set of DHFs whose intersection well approximates each input shape, and then encoding these DHFs via neural fields. Our approach delivers high-quality reconstructions, and reduces the reconstruction error by a factor of 2:5 on average compared to the state-of-the-art, given the same parameter count or storage capacity. Compared to the best-performing alternative, our method produced higher accuracy models on 94% of the 400 input shape and parameter count combinations tested.
GRSep 9, 2024
NESI: Shape Representation via Neural Explicit Surface IntersectionCongyi Zhang, Jinfan Yang, Eric Hedlin et al.
Compressed representations of 3D shapes that are compact, accurate, and can be processed efficiently directly in compressed form, are extremely useful for digital media applications. Recent approaches in this space focus on learned implicit or parametric representations. While implicits are well suited for tasks such as in-out queries, they lack natural 2D parameterization, complicating tasks such as texture or normal mapping. Conversely, parametric representations support the latter tasks but are ill-suited for occupancy queries. We propose a novel learned alternative to these approaches, based on intersections of localized explicit, or height-field, surfaces. Since explicits can be trivially expressed both implicitly and parametrically, NESI directly supports a wider range of processing operations than implicit alternatives, including occupancy queries and parametric access. We represent input shapes using a collection of differently oriented height-field bounded half-spaces combined using volumetric Boolean intersections. We first tightly bound each input using a pair of oppositely oriented height-fields, forming a Double Height-Field (DHF) Hull. We refine this hull by intersecting it with additional localized height-fields (HFs) that capture surface regions in its interior. We minimize the number of HFs necessary to accurately capture each input and compactly encode both the DHF hull and the local HFs as neural functions defined over subdomains of R^2. This reduced dimensionality encoding delivers high-quality compact approximations. Given similar parameter count, or storage capacity, NESI significantly reduces approximation error compared to the state of the art, especially at lower parameter counts.
17.3GRMay 5
ADS: Random Sampling of Occupancy Functions using Adaptive Delaunay ScaffoldingSuzuran Takikawa, Leo Foord-Kelcey, Oliver Oxford et al. · oxford
Dense random sampling and surfacing of shapes encoded via implicit occupancy functions (OFs) are critical elements of many applications. Existing methods largely provide either one or the other of random sampling or mesh surfaces: ray shooting approaches deliver random samples with no connectivity, and grid-based methods deliver mesh surfaces but their sampling is highly biased. We propose a new method which delivers both pseudo-random OF surface samples and an isosurface mesh connecting them. Our method achieves these goals while requiring an order of magnitude fewer function evaluations than prior approaches. Key to our Adaptive Delaunay Sampling (ADS) approach is a progressively computed Delaunay tetrahedralization of points in 3D space, which we use as a sampling and surfacing scaffold. Starting from an initial coarse Delaunay scaffold, we repeatedly refine crossing edges, ones whose end vertices lie on opposite sides of the surface, augmenting the scaffold with points closer and closer to the surface. Each refinement step uses the Delaunay criterion to incorporate the newly added vertices into the scaffold, introducing new crossing edges. We use the intersections of fine crossing edges with the OF surface as the output samples, and use the marching tetrahedra method to surface these samples. We subsequently use normal estimation to densify the sampling near fine features and in areas of high surface curvature. We validate ADS by sampling 150 inputs at different resolutions, and provide extensive comparisons to existing alternatives. Our experiments demonstrate significant improvement in accuracy/function evaluation count trade-off, and showcase downstream applications.
HCSep 8, 2021
StripBrush: A Constraint-Relaxed 3D Brush Reduces Physical Effort and Enhances the Quality of Spatial DrawingEnrique Rosales, Jafet Rodriguez, Chrystiano Araújo et al.
Spatial drawing using ruled-surface brush strokes is a popular mode of content creation in immersive VR, yet little is known about the usability of existing spatial drawing interfaces or potential improvements. We address these questions in a three-phase study. (1) Our exploratory need-finding study (N=8) indicates that popular spatial brushes require users to perform large wrist motions, causing physical strain. We speculate that this is partly due to constraining users to align their 3D controllers with their intended stroke normal orientation. (2) We designed and implemented a new brush interface that significantly reduces the physical effort and wrist motion involved in VR drawing, with the additional benefit of increasing drawing accuracy. We achieve this by relaxing the normal alignment constraints, allowing users to control stroke rulings, and estimating normals from them instead. (3) Our comparative evaluation of StripBrush (N=17) against the traditional brush shows that StripBrush requires significantly less physical effort and allows users to more accurately depict their intended shapes while offering competitive ease-of-use and speed.