Dense ReLU Neural Networks for Temporal-spatial Model
This work addresses temporal-spatial modeling for real-world data with dependencies, offering incremental theoretical extensions to neural networks in more general contexts.
The paper tackled nonparametric estimation for temporal-spatial data using dense ReLU neural networks, deriving non-asymptotic bounds and convergence rates that enhance predictive performance and theoretical robustness, with empirical simulations showing superior performance over existing methods.
In this paper, we focus on fully connected deep neural networks utilizing the Rectified Linear Unit (ReLU) activation function for nonparametric estimation. We derive non-asymptotic bounds that lead to convergence rates, addressing both temporal and spatial dependence in the observed measurements. By accounting for dependencies across time and space, our models better reflect the complexities of real-world data, enhancing both predictive performance and theoretical robustness. We also tackle the curse of dimensionality by modeling the data on a manifold, exploring the intrinsic dimensionality of high-dimensional data. We broaden existing theoretical findings of temporal-spatial analysis by applying them to neural networks in more general contexts and demonstrate that our proof techniques are effective for models with short-range dependence. Our empirical simulations across various synthetic response functions underscore the superior performance of our method, outperforming established approaches in the existing literature. These findings provide valuable insights into the strong capabilities of dense neural networks (Dense NN) for temporal-spatial modeling across a broad range of function classes.