This project analyzes U.S. flight delays and cancellations using PySpark and explores patterns across airlines, airports, routes, months, and departure times.
The project combines Big Data Analytics, Data Visualization, and an Interactive Dashboard to uncover operational insights and identify major factors contributing to flight delays.
The objective of this project is to:
- Identify major causes of flight delays and cancellations
- Analyze delay trends across different time periods
- Discover the most delayed routes and airports
- Visualize flight performance through interactive dashboards
- Generate actionable insights for airline operations
| Category | Technologies |
|---|---|
| Programming | Python |
| Big Data | PySpark |
| Data Analysis | Pandas |
| Visualization | Matplotlib, Seaborn, Plotly |
| Dashboard | Dash |
| Environment | Jupyter Notebook |
The analysis uses the following datasets:
| Dataset | Description |
|---|---|
| flights.csv | Flight-level operational data |
| airlines.csv | Airline information |
| airports.csv | Airport information |
β οΈ Note: The originalflights.csvdataset is not included in this repository due to GitHub file size limitations.
- Imported flight, airline, and airport datasets
- Removed missing values
- Processed delay and cancellation records
- Delay trends
- Cancellation analysis
- Route performance analysis
- Bar charts
- Pie charts
- Trend analysis
- Airport geo-mapping
- Interactive Dash dashboard using Plotly
- Flight cancellation analysis
- Cancellation reason distribution
- Airport delay analysis
- Average arrival delay by month
- Average arrival delay by departure hour
- Delay cause breakdown
- Most delayed flight routes
- Route performance comparison
- Airport delay geo-mapping
The interactive dashboard provides:
β Monthly Delay Trends
β Cancellation Reason Analysis
β Most Delayed Routes
β Airport Delay Insights
β Interactive Visual Exploration
Late aircraft delays were the largest contributor to overall delays.
Early morning departures generally experienced fewer delays.
Certain routes consistently showed significantly higher delays.
Airport geo-mapping helped identify major delay-prone regions.
Flight-Delay-Intelligence-System
β
βββ big_data_analysis/
βββ images/
β βββ cancellation_count.png
β βββ cancellation_reasons.png
β βββ delay_by_month.png
β βββ delay_by_hour.png
β βββ top_delayed_routes.png
β βββ delay_causes.png
β βββ airport_delay_map.png
β
βββ app.py
βββ main.py
βββ report.ipynb
βββ README.md
- Build a real-time flight delay prediction model
- Integrate weather data
- Add airline performance scorecards
- Deploy dashboard online
Unnati Patil
Aspiring Data Analyst | Business Analyst | Data Science Enthusiast
β Big Data Analytics using PySpark
β Interactive Dashboard Development
β Data Visualization & Storytelling
β Business Insight Generation
β End-to-End Analytics Project






