300+ File Data Consolidation

A large municipal infrastructure project had accumulated 300+ individual Excel report files with no central database. Built an automated consolidation pipeline that parsed, normalized, and merged all files into a single structured dataset. Reduced an estimated 30-40 hours of manual work down to 2.5 hours. The consolidated data enabled real-time progress visibility and streamlined monthly reporting.

• Automated consolidation pipeline for 300+ Excel files
• Parsed, normalized, and merged into a single structured dataset
• Reduced 30-40 hours of manual work to 2.5 hours
• Enabled real-time progress visibility and streamlined reporting

Without centralized data, the project team had no visibility into overall progress. I automated the consolidation to give them a single source of truth.

Learned how to build robust data pipelines that handle inconsistent Excel formats at scale. Understanding how to normalize messy real-world data into clean, queryable datasets.