Improved Reporting and Data Orchestration

IoT & Analytics

Client

Multi-dimensional reports are generated (using SCADA Data – up to 500K records per day) to identify and fix transmission losses, power failures and to improve service quality. With their existing on-premise IT setup on Oracle SuperCluster, the MIS team struggled to present reports to decision makers on time.

Project

  • Daily transfer of raw data to AWS cloud storage
  • AWS Architecture
  • Redshift cluster for data orchestration and EC2 for Report Generation App
  • Batch processing for data cleansing, transformation and loading
  • Reports generated by directly querying Redshift data sets

Result

  • Reports that needed 5-12 hours to be generated were now getting generated in less than 1 minute
  • Pay-as-you-go Cloud model reduced 60% costs on data storage

Improved Reporting and Data Orchestration