A Modern Approach to Real-Time Air Traffic Management System
This is an incremental improvement for air traffic management systems, addressing data volume and complexity issues.
The project tackled the challenge of handling increasing air traffic data by proposing a real-time big data processing architecture using Apache Spark and Kafka, resulting in a demonstration dashboard for U.S. airlines.
Air traffic analytics systems are pivotal for ensuring safety, efficiency, and predictability in air travel. However, traditional systems struggle to handle the increasing volume and complexity of air traffic data. This project explores the application of real-time big data processing frameworks like Apache Spark, HDFS, and Spark Streaming for developing a new robust system. By reviewing existing research on real-time systems and analyzing the challenges and opportunities presented by big data technologies, we propose an architecture for a real-time system. Our project pipeline involves real-time data collection from flight information sources through flight API's, ingestion into Kafka, and transmission to Elasticsearch for visualization using Kibana. Additionally, we present a dashboard of U.S. airlines on PowerBI, demonstrating the potential of real-time analytics in revolutionizing air traffic management.