Ke Ma

Yushu Wu, Yanyu Li, Anil Kag et al.

Diffusion Transformers (DiT) have shown strong performance in video generation tasks, but their high computational cost makes them impractical for resource-constrained devices like smartphones, and practical on-device generation is even more challenging. In this work, we propose a series of novel optimizations to significantly accelerate video generation and enable practical deployment on mobile platforms. First, we employ a highly compressed variational autoencoder (VAE) to reduce the dimensionality of the input data without sacrificing visual quality. Second, we introduce a KD-guided, sensitivity-aware tri-level pruning strategy to shrink the model size to suit mobile platforms while preserving critical performance characteristics. Third, we develop an adversarial step distillation technique tailored for DiT, which allows us to reduce the number of inference steps to four. Combined, these optimizations enable our model to achieve approximately 15 frames per second (FPS) generation speed on an iPhone 16 Pro Max, demonstrating the feasibility of efficient, high-quality video generation on mobile devices.

Xi Liu, Ke Ma, P. R. Kumar

Currently, we are in an environment where the fraction of automated vehicles is negligibly small. We anticipate that this fraction will increase in coming decades before if ever, we have a fully automated transportation system. Motivated by this we address the problem of provable safety of mixed traffic consisting of both intelligent vehicles (IVs) as well as human-driven vehicles (HVs). An important issue that arises is that such mixed systems may well have lesser throughput than all human traffic systems if the automated vehicles are expected to remain provably safe with respect to human traffic. This necessitates the consideration of strategies such as platooning of automated vehicles in order to increase the throughput. In this paper, we address the design of provably safe systems consisting of a mix of automated and human-driven vehicles including the use of platooning by automated vehicles. We design motion planing policies and coordination rules for participants in this novel mixed system. HVs are considered as nearsighted and modeled with relatively loose constraints, while IVs are considered as capable of following much tighter constraints. HVs are expected to follow reasonable and simple rules. IVs are designed to move under a model predictive control (MPC) based motion plans and coordination protocols. Our contribution of this paper is in showing how to integrate these two types of models safely into a mixed system. System safety is proved in single lane scenarios, as well as in multi-lane situations allowing lane changes.