Lagrangian Motion Fields for Long-term Motion Generation
This addresses the problem of temporal redundancy in motion generation for applications like animation and robotics, offering a versatile and lightweight solution, though it appears incremental as it builds on existing motion representation methods.
The paper tackles the challenge of generating coherent long-term motion sequences by introducing Lagrangian Motion Fields, which treat joints as particles with uniform velocity to create condensed 'supermotions', resulting in enhanced efficiency, superior quality, and greater diversity in tasks like music-to-dance and text-to-motion generation.
Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial details and overlook temporal dynamics. This approach leads to significant redundancy across the temporal dimension, complicating the generation of effective long-term motion. To overcome these limitations, we introduce the novel concept of Lagrangian Motion Fields, specifically designed for long-term motion generation. By treating each joint as a Lagrangian particle with uniform velocity over short intervals, our approach condenses motion representations into a series of "supermotions" (analogous to superpixels). This method seamlessly integrates static spatial information with interpretable temporal dynamics, transcending the limitations of existing network architectures and motion sequence content types. Our solution is versatile and lightweight, eliminating the need for neural network preprocessing. Our approach excels in tasks such as long-term music-to-dance generation and text-to-motion generation, offering enhanced efficiency, superior generation quality, and greater diversity compared to existing methods. Additionally, the adaptability of Lagrangian Motion Fields extends to applications like infinite motion looping and fine-grained controlled motion generation, highlighting its broad utility. Video demonstrations are available at https://plyfager.github.io/LaMoG.