J. Ma

CV
4papers
16citations
Novelty46%
AI Score22

4 Papers

CVAug 13, 2022
A new way of video compression via forward-referencing using deep learning

S. M. A. K. Rajin, M. Murshed, M. Paul et al.

To exploit high temporal correlations in video frames of the same scene, the current frame is predicted from the already-encoded reference frames using block-based motion estimation and compensation techniques. While this approach can efficiently exploit the translation motion of the moving objects, it is susceptible to other types of affine motion and object occlusion/deocclusion. Recently, deep learning has been used to model the high-level structure of human pose in specific actions from short videos and then generate virtual frames in future time by predicting the pose using a generative adversarial network (GAN). Therefore, modelling the high-level structure of human pose is able to exploit semantic correlation by predicting human actions and determining its trajectory. Video surveillance applications will benefit as stored big surveillance data can be compressed by estimating human pose trajectories and generating future frames through semantic correlation. This paper explores a new way of video coding by modelling human pose from the already-encoded frames and using the generated frame at the current time as an additional forward-referencing frame. It is expected that the proposed approach can overcome the limitations of the traditional backward-referencing frames by predicting the blocks containing the moving objects with lower residuals. Experimental results show that the proposed approach can achieve on average up to 2.83 dB PSNR gain and 25.93\% bitrate savings for high motion video sequences

SIOct 22, 2021
Multiwave COVID-19 Prediction from Social Awareness using Web Search and Mobility Data

J. Xue, T. Yabe, K. Tsubouchi et al.

Recurring outbreaks of COVID-19 have posed enduring effects on global society, which calls for a predictor of pandemic waves using various data with early availability. Existing prediction models that forecast the first outbreak wave using mobility data may not be applicable to the multiwave prediction, because the evidence in the USA and Japan has shown that mobility patterns across different waves exhibit varying relationships with fluctuations in infection cases. Therefore, to predict the multiwave pandemic, we propose a Social Awareness-Based Graph Neural Network (SAB-GNN) that considers the decay of symptom-related web search frequency to capture the changes in public awareness across multiple waves. Our model combines GNN and LSTM to model the complex relationships among urban districts, inter-district mobility patterns, web search history, and future COVID-19 infections. We train our model to predict future pandemic outbreaks in the Tokyo area using its mobility and web search data from April 2020 to May 2021 across four pandemic waves collected by Yahoo Japan Corporation under strict privacy protection rules. Results demonstrate our model outperforms state-of-the-art baselines such as ST-GNN, MPNN, and GraphLSTM. Though our model is not computationally expensive (only 3 layers and 10 hidden neurons), the proposed model enables public agencies to anticipate and prepare for future pandemic outbreaks.

APP-PHApr 17, 2019
Grid Inadequacy Assessment against Power Injection Diversity from Intermittent Generation, Dynamic Loads, and Energy Storage

A. E. Tio, D. J. Hill, J. Ma

The integration of more intermittent generation, energy storage, and dynamic loads on top of a competitive market environment requires future grids to handle increasing diversity of power injection states. Grid planners need new tools and metrics that can assess how vulnerable grids are against this future. To this end, we propose grid inadequacy metrics that expose grid inability to accommodate power injection diversity from such sources. We define the metrics based on a previously unexplored characterization of grid inadequacy, that is, the size of the DC power flow infeasible set relative to the size of the power injection set is indicative of inherent grid inadequacy to accommodate power injection diversity without intervention. We circumvent the difficulty of characterizing the high-dimensional sets involved using three approaches: one sampling-based approach and two approaches that project the sets in lower dimensions. Illustrative examples show how the metrics can reveal useful insights about a grid. As with other metrics, the proposed metrics are only valid relative to the assumptions used and cannot capture all intricacies of assessing grid inadequacy. Nevertheless, the metrics provide a new way of quantifying grid inadequacy that is potentially useful in future research and practice. We present possible use-cases where the proposed metrics can be used.

ROJan 14, 2019
Optimal Needle Diameter, Shape, and Path in Autonomous Suturing

S. Aghajani Pedram, P. Ferguson, J. Ma et al.

Needle shape, diameter, and path are critical parameters that directly affect suture depth and tissue trauma in autonomous suturing. This paper presents an optimization-based approach to specify these parameters. Given clinical suturing guidelines, a kinematic model of needle-tissue interaction was developed to quantify suture parameters and constraints. The model was further used to formulate constant curvature needle path planning as a nonlinear optimization problem. The optimization results were confirmed experimentally with the Raven II surgical system. The proposed needle path planning algorithm guarantees minimal tissue trauma and complies with a wide range of suturing requirements.