The ITRex team collaborated closely with the client to build their new data warehouse on Snowflake. Our contribution focused on the following key areas:
●
Data Source Evaluation: Our team conducted thorough audits to identify the most reliable and relevant sources of both structured and unstructured data
●
Data Collection: We set up systems to gather both data from various databases, APIs, and flat files, and real-time data from the client's website and Google Analytics to work with the most current data available
●
Data Processing Setup: We established ETL processes using dbt and other tools
●
Data Improvement: We cleaned and enhanced the data, removing inaccuracies. As the next step, we structured the data into several layers, making it easier to manage and interpret
●
Department-Specific Data Solutions: We developed specialized data marts for different business units, like sales, HR, and finance to address their unique requirements
●
Custom Reporting: Our team created bespoke reports for various business units using SQL, Snowflake procedures, and platforms like Looker and Tableau. We focused on gathering detailed business requirements and strategized on the best ways to collect data across disparate systems