Daily Fuel Price Tracking Dashboard
Automated Market Intelligence & ETL
Python • Selenium • MySQL • Grafana
Role
Data Engineer & Dashboard Specialist
Technologies
Python (Requests, Selenium), MySQL, Grafana, Cron/Automation
Repository
Project Purpose & Overview
Fuel prices across municipal and regional distribution stations experience frequent daily volatility. For fleet managers and purchasing analysts, tracking these price shifts manually is unfeasible.
This system was built to provide automated daily pricing intelligence by autonomously crawling distributor websites, parsing historical price quotes, and delivering instant trend insights via Grafana.
Architecture & Pipeline
- Scheduled Extraction Engine: Daily automated crawlers triggered via Python, utilizing headless Selenium and optimized HTTP Requests.
- Data Validation & Cleansing: Sanitizes station names, tax codes, and currency formatting while handling dynamic web elements and pagination.
- Relational MySQL Storage: Structured schema supporting indexed time-series queries, price delta calculations, and geographic segmentation.
- Interactive Grafana Dashboards: Rich time-series graphs, moving average trendlines, volatility thresholds, and price anomaly heatmaps.