Client

The Honest Co is a wellness brand producing safe beauty, skincare, baby care and home-cleaning products

Services

Data Management, Data Migration, Data Analytics

Industry

eCommerce, FMCG

Tech

MySQL, Google BigQuery, Hadoop, Spark, Hive, Redshift, Java/Scala, Databricks, Amazon S3

Challenge

Robust data is hands-down at the heart of every strategic business decision. Consolidating data from diverse sources into a single view is critical to making data-informed decisions at the speed of business. The client asked our team to help them handle their company’s data: prepare statistics data from online shops for data warehouse and reporting.

Specifically, our team took on the following challenges:

●

Aggregate the company’s data from multiple data sources into one location using ETL jobs.

●

Transform the data into a proper structure along the way to make it more suitable for reporting purposes.

●

Create CSV reports for the analytics team.

●

Collaborate with the product teams to define the best reports format.

●

Analyze the incoming data structures.

●

Define data transformation rules.

Solution

●

A number of ETL scripts to load data from multiple data sources such as Google BigQuery and Amazon S3 into Apache Hive data warehouse.

●

A number of SQL scripts for Redshift to create CSV reports that contain data about online orders, quantities, prices, etc.

Impact

●

The analytics teams leverage the exported CSV reports to analyze the audience, their activity and preferences and derive meaningful analytics insights at the point of need.

●

The ETL and SQL scripts made it much easier to transfer the data into different storage, restructure it for quick analysis and reporting, and export it in a readable format, which would take a good deal of time if done by hand.