Hashim A. Hashim

Hashim A. Hashim, Sami El-Ferik, Frank L. Lewis

This paper proposes an adaptive tracking control with prescribed performance function for distributive cooperative control of highly nonlinear multi-agent systems. The use of such approach confines the tracking error within a large predefined set to a predefined smaller set. The key idea is to transform the constrained system into unconstrained one through the transformation of the output error. Agents' dynamics are assumed unknown, and the controller is developed for a strongly connected structured network. The proposed controller allows all agents to follow the trajectory of the leader node, while satisfying the necessary dynamic requirements. The proposed approach guarantees uniform ultimate boundedness for the transformed error as well as a bounded adaptive estimate of the unknown parameters and dynamics. Simulations include two examples to validate the robustness and smoothness of the proposed controller against highly nonlinear heterogeneous multi-agent system with uncertain time-variant parameters and external disturbances. Keywords: Prescribed performance, Transformed error, Multi-agents, Distributed adaptive control, Adaptive Consensus, Transient, Steady-state error, Semi-global asymptotic stability, uniformly ultimately bounded, Nonlinear Networked Systems, Distributed Control, Robustness.

Hashim A. Hashim, Lyndon J. Brown, Kenneth McIsaac

Two nonlinear stochastic complimentary filters are developed on SO(3). They guarantee that errors in the Rodriguez vector and estimates are semi-globally uniformly ultimately bounded in mean square, and they converge to a small neighborhood of the origin. Simulation results are presented to illustrate the effectiveness of the proposed filters considering high level of uncertainties in angular velocity as well as body-frame vector measurements. Keywords: Attitude estimate, Attitude estimator, Attitude observer, Attitude filter, Nonlinear stochastic filter, stochastic differential equations, Brownian motion process, Ito, Stratonovich, Wong Zakai, Rodriguez vector, unit-quaternion, special orthogonal group 3, Euclidean, Euler angles, Angle-axis, Mapping, Parameterization, Representation, Robust, Invariant, Kalman Filter, Extended Kalman Filter, Multiplicative Extended Kalman Filter, Unscented Kalman Filter, Particle Filter, KF, EKF, MEKF, IEKF, first, second, Partial derivative, operator, probability, small, error, dynamics, kinematics, equilibrium, asymptotic, covariance, mean square, expected value, zero, unknown, time-varying, global, semi-global, stable, stability, uncertain, white noise, Gaussian noise, colored noise, bias, vectorial, vector measurement, angular velocity, singular value decomposition, bounded, rotational matrix, identity, deterministic, orientation, body frame, comparison, inertial frame, rigid body, three dimensional, 3D, space, Attitude Control, Lie algebra, Lie group, projection, Gyroscope, Inertial measurement units, micro electromechanical systems, sensor, IMUs, MEMS, Roll, Pitch, Yaw, UAVs, QUAV, SVD, Fixed, Moving, Vehicles, Robot, Robotic System, Spacecraft, submarine, Underwater vehicle, Problem, advantage, integral, integration, passive complementary filter, Disadvantage, autonomous, Review, Overview, Survey, comparative study, pose, SDEs, SE(3), SO(3).

Luca Tirel, Ali Mohamed Ali, Hashim A. Hashim

This paper introduces a novel approach to image denoising that leverages the advantages of Generative Adversarial Networks (GANs). Specifically, we propose a model that combines elements of the Pix2Pix model and the Wasserstein GAN (WGAN) with Gradient Penalty (WGAN-GP). This hybrid framework seeks to capitalize on the denoising capabilities of conditional GANs, as demonstrated in the Pix2Pix model, while mitigating the need for an exhaustive search for optimal hyperparameters that could potentially ruin the stability of the learning process. In the proposed method, the GAN's generator is employed to produce denoised images, harnessing the power of a conditional GAN for noise reduction. Simultaneously, the implementation of the Lipschitz continuity constraint during updates, as featured in WGAN-GP, aids in reducing susceptibility to mode collapse. This innovative design allows the proposed model to benefit from the strong points of both Pix2Pix and WGAN-GP, generating superior denoising results while ensuring training stability. Drawing on previous work on image-to-image translation and GAN stabilization techniques, the proposed research highlights the potential of GANs as a general-purpose solution for denoising. The paper details the development and testing of this model, showcasing its effectiveness through numerical experiments. The dataset was created by adding synthetic noise to clean images. Numerical results based on real-world dataset validation underscore the efficacy of this approach in image-denoising tasks, exhibiting significant enhancements over traditional techniques. Notably, the proposed model demonstrates strong generalization capabilities, performing effectively even when trained with synthetic noise.

Hussein Naser, Hashim A. Hashim, Mojtaba Ahmadi

This paper introduces an advanced Quaternion-based Unscented Kalman Filter (QUKF) for real-time, robust estimation of system states and external wrenches in assistive aerial payload transportation systems that engage in direct physical interaction. Unlike conventional filtering techniques, the proposed approach employs a unit-quaternion representation to inherently avoid singularities and ensure globally consistent, drift-free estimation of the platform's pose and interaction wrenches. A rigorous quaternion-based dynamic model is formulated to capture coupled translational and rotational dynamics under interaction forces. Building on this model, a comprehensive QUKF framework is established for state prediction, measurement updates, and external wrench estimation. The proposed formulation fully preserves the nonlinear characteristics of rotational motion, enabling more accurate and numerically stable estimation during physical interaction compared to linearized filtering schemes. Extensive simulations validate the effectiveness of the QUKF, showing significant improvements over the Extended Kalman Filter (EKF). Specifically, the QUKF achieved a 79.41\% reduction in Root Mean Squared Error (RMSE) for torque estimation, with average RMSE improvements of 79\% and 56\%, for position and angular rates, respectively. These findings demonstrate enhanced robustness to measurement noise and modeling uncertainties, providing a reliable foundation for safe, stable, and responsive human-UAV physical interaction in cooperative payload transportation tasks.

Aditya V. Jonnalagadda, Hashim A. Hashim

This research addresses the pressing challenge of enhancing processing times and detection capabilities in Unmanned Aerial Vehicle (UAV)/drone imagery for global wildfire detection, despite limited datasets. Proposing a Segmented Neural Network (SegNet) selection approach, we focus on reducing feature maps to boost both time resolution and accuracy significantly advancing processing speeds and accuracy in real-time wildfire detection. This paper contributes to increased processing speeds enabling real-time detection capabilities for wildfire, increased detection accuracy of wildfire, and improved detection capabilities of early wildfire, through proposing a new direction for image classification of amorphous objects like fire, water, smoke, etc. Employing Convolutional Neural Networks (CNNs) for image classification, emphasizing on the reduction of irrelevant features vital for deep learning processes, especially in live feed data for fire detection. Amidst the complexity of live feed data in fire detection, our study emphasizes on image feed, highlighting the urgency to enhance real-time processing. Our proposed algorithm combats feature overload through segmentation, addressing challenges arising from diverse features like objects, colors, and textures. Notably, a delicate balance of feature map size and dataset adequacy is pivotal. Several research papers use smaller image sizes, compromising feature richness which necessitating a new approach. We illuminate the critical role of pixel density in retaining essential details, especially for early wildfire detection. By carefully selecting number of filters during training, we underscore the significance of higher pixel density for proper feature selection. The proposed SegNet approach is rigorously evaluated using real-world dataset obtained by a drone flight and compared to state-of-the-art literature.

Ali Mohamed Ali, Luca Tirel, Hashim A. Hashim

Efficient planning of activities is essential for modern industrial assembly lines to uphold manufacturing standards, prevent project constraint violations, and achieve cost-effective operations. While exact solutions to such challenges can be obtained through Integer Programming (IP), the dependence of the search space on input parameters often makes IP computationally infeasible for large-scale scenarios. Heuristic methods, such as Genetic Algorithms, can also be applied, but they frequently produce suboptimal solutions in extensive cases. This paper introduces a novel mathematical model of a generic industrial assembly line formulated as a Markov Decision Process (MDP), without imposing assumptions on the type of assembly line a notable distinction from most existing models. The proposed model is employed to create a virtual environment for training Deep Reinforcement Learning (DRL) agents to optimize task and resource scheduling. To enhance the efficiency of agent training, the paper proposes two innovative tools. The first is an action-masking technique, which ensures the agent selects only feasible actions, thereby reducing training time. The second is a multi-agent approach, where each workstation is managed by an individual agent, as a result, the state and action spaces were reduced. A centralized training framework with decentralized execution is adopted, offering a scalable learning architecture for optimizing industrial assembly lines. This framework allows the agents to learn offline and subsequently provide real-time solutions during operations by leveraging a neural network that maps the current factory state to the optimal action. The effectiveness of the proposed scheme is validated through numerical simulations, demonstrating significantly faster convergence to the optimal solution compared to a comparable model-based approach.

Aditya V. Jonnalagadda, Hashim A. Hashim, Andrew Harris

Contemporary Artificial Intelligence (AI) and Machine Learning (ML) research places a significant emphasis on transfer learning, showcasing its transformative potential in enhancing model performance across diverse domains. This paper examines the efficiency and effectiveness of transfer learning in the context of wildfire detection. Three purpose-built models -- Visual Geometry Group (VGG)-7, VGG-10, and Convolutional Neural Network (CNN)-Support Vector Machine(SVM) CNN-SVM -- are rigorously compared with three pretrained models -- VGG-16, VGG-19, and Residual Neural Network (ResNet) ResNet101. We trained and evaluated these models using a dataset that captures the complexities of wildfires, incorporating variables such as varying lighting conditions, time of day, and diverse terrains. The objective is to discern how transfer learning performs against models trained from scratch in addressing the intricacies of the wildfire detection problem. By assessing the performance metrics, including accuracy, precision, recall, and F1 score, a comprehensive understanding of the advantages and disadvantages of transfer learning in this specific domain is obtained. This study contributes valuable insights to the ongoing discourse, guiding future directions in AI and ML research. Keywords: Wildfire prediction, deep learning, machine learning fire, detection

Marium Tawhid, Ajay Singh Ludher, Hashim A. Hashim

A robust nonlinear stochastic observer for simultaneous localization and mapping (SLAM) is proposed using the available uncertain measurements of angular velocity, translational velocity, and features. The proposed observer is posed on the Lie Group of $\mathbb{SLAM}_{n}\left(3\right)$ to mimic the true stochastic SLAM dynamics. The proposed approach considers the velocity measurements to be attached with an unknown bias and an unknown Gaussian noise. The proposed SLAM observer ensures that the closed loop error signals are semi-globally uniformly ultimately bounded. Simulation results demonstrates the efficiency and robustness of the proposed approach, revealing its ability to localize the unknown vehicle, as well as mapping the unknown environment given measurements obtained from low-cost units.

Hashim A. Hashim

Simultaneous Localization and Mapping (SLAM) is one of the key robotics tasks as it tackles simultaneous mapping of the unknown environment defined by multiple landmark positions and localization of the unknown pose (i.e., attitude and position) of the robot in three-dimensional (3D) space. The true SLAM problem is modeled on the Lie group of $\mathbb{SLAM}_{n}\left(3\right)$, and its true dynamics rely on angular and translational velocities. This paper proposes a novel geometric nonlinear stochastic estimator algorithm for SLAM on $\mathbb{SLAM}_{n}\left(3\right)$ that precisely mimics the nonlinear motion dynamics of the true SLAM problem. Unlike existing solutions, the proposed stochastic filter takes into account unknown constant bias and noise attached to the velocity measurements. The proposed nonlinear stochastic estimator on manifold is guaranteed to produce good results provided with the measurements of angular velocities, translational velocities, landmarks, and inertial measurement unit (IMU). Simulation and experimental results reflect the ability of the proposed filter to successfully estimate the six-degrees-of-freedom (6 DoF) robot's pose and landmark positions. Keywords: Simultaneous Localization and Mapping, nonlinear stochastic observer for SLAM, stochastic differential equations, pose estimator, position, attitude, Brownian motion process, inertial measurement unit, landmarks, features, SDE, SO(3), SE(3), SLAM.

Hashim A. Hashim, Abdelrahman E. E. Eltoukhy

Simultaneous Localization and Mapping (SLAM) is a process of concurrent estimation of the vehicle's pose and feature locations with respect to a frame of reference. This paper proposes a computationally cheap geometric nonlinear SLAM filter algorithm structured to mimic the nonlinear motion dynamics of the true SLAM problem posed on the matrix Lie group of $\mathbb{SLAM}_{n}\left(3\right)$. The nonlinear filter on manifold is proposed in continuous form and it utilizes available measurements obtained from group velocity vectors, feature measurements and an inertial measurement unit (IMU). The unknown bias attached to velocity measurements is successfully handled by the proposed estimator. Simulation results illustrate the robustness of the proposed filter in discrete form demonstrating its utility for the six-degrees-of-freedom (6 DoF) pose estimation as well as feature estimation in three-dimensional (3D) space. In addition, the quaternion representation of the nonlinear filter for SLAM is provided. Keywords: Simultaneous Localization and Mapping, Nonlinear observer algorithm for SLAM, inertial measurement unit, inertial vision system, pose, position, attitude, landmark, estimation, IMU, SE(3), SO(3), unmanned aerial vehicle, rigid-body, noise, nonlinear observer for SLAM, Gaussian filter, Kalman filtering, navigation.

Hashim A. Hashim, Lyndon J. Brown, Kenneth McIsaac

This paper formulates the pose estimation problem as nonlinear stochastic filter kinematics evolved directly on the Special Euclidean Group SE(3). Proposed filter guarantees that the errors present in position and Rodriguez vector estimates are semi-globally uniformly ultimately bounded (SGUUB) in mean square, and that they converge to small neighborhood of the origin in probability. Simulation results show the robustness and effectiveness of the proposed filter in presence of high levels of noise and bias associated with the velocity vector as well as body-frame measurements. Keywords: Pose estimator, pose observer, attitude estimate, control, estimator, observer, Nonlinear stochastic pose filter, stochastic differential equations, Brownian motion process, Ito, Stratonovich, Wong Zakai, unit-quaternion, special orthogonal group, homogeneous transformation matrix, complimentary filter, Euler angles, Angle-axis, mapping, Parameterization, Representation, Robust, Multiplicative Extended Kalman Filter, Unscented Kalman Filter, Particle filter, KF, EKF, IEKF, UKF, MEKF, partial derivative, small, dynamics, equilibrium, asymptotic, covariance, expected value, zero, unknown, time-varying, global, semi-global, stable, stability, uncertain, Gaussian, colored, white, noise, vectorial measurement, vector measurement, translational velocity, angular velocity, singular value decomposition, rotational matrix, identity, deterministic, comparison, inertial frame, rigid body, three dimensional, 3D, space, adjoint, Lie group, projection, landmark, feature, Gyroscope, micro electromechanical systems, Inertial measurement units, sensor, IMUs, Fixed, moving, orientation, Roll, Pitch, Yaw, SVD, UAVs, QUAV, unmanned, underwater vehicle, robot, Robotic System, Spacecraft, quadrotor, quadcopter, integral, advantage, disadvantage, Comparative study, Review, Overview, Survey, autonomous, xyz, axis, SO(3), SE(3).

Hashim A. Hashim, Sami El-Ferik, Mohamed A. Abido

L1 adaptive controller has been recognized for having a structure that allows decoupling between robustness and adaption owing to the introduction of a low pass filter with adjustable gain in the feedback loop. The trade-off between performance, fast adaptation and robustness, is the main criteria when selecting the structure or the coefficients of the filter. Several off-line methods with varying levels of complexity exist to help finding bounds or initial values for these coefficients. Such values may require further refinement using trial-and-error procedures upon implementation. Subsequently, these approaches suggest that once implemented these values are kept fixed leading to sub-optimal performance in both speed of adaptation and robustness. In this paper, a new practical approach based on fuzzy rules for online continuous tuning of these coefficients is proposed. The fuzzy controller is optimally tuned using Particle Swarm Optimization (PSO) taking into accounts both the tracking error and the controller output signal range. The simulation of several examples of systems with moderate to severe nonlinearities demonstrate that the proposed approach offers improved control performance. Keywords: Fuzzy logic control, single-objective, multi-objective particle swarm optimization, L1 Adaptive control, fuzzy L1 adaptive controller, L1 fuzzy adaptive control, L1 fuzzy adaptive controller, fuzzy L1 adaptive control, Filter tuning, Fuzzy membership function tuning, optimal, optimal tuning, Fuzzy membership function optimization, Robustness, Adaptation, multi-input multi-output, single-input single-output, estimate, PSO, FLC, nonlinear, adaptive, online, off-line, Fuzzy adaptive controller, Fuzzy adaptive control, single input single output, multi input multi output, SISO, MIMO, robust, uncertain, uncertain nonlinear system, disturbance, unknown, Adaptive Fuzzy Control Design, stable.