Client

One of the largest retailers that operates a chain of hypermarkets, discount department stores, and grocery stores around the globe

Industry

Retail

Services

Product Development, Data Architecture, Data Management, Data Analytics, Data Visualization

Tech

Cosmos DB, MS Azure, Gremlin, JanusGraph, Cassandra, Java, Python, Kafka, React, Redis

Challenge

The importance of data, its accuracy and availability when and where needed, can not be overestimated when it comes to business prosperity and leadership. For a company operating on a large scale, getting as close to data as possible becomes even more critical. That’s what our client came to us for. With a huge number of internal users, disparate systems and isolated islands of data began to take a toll on the entire data analysis process resulting in inaccurate insights, poor business decisions and missed market opportunities. Our team was entrusted with the task of creating an AI-Driven Big Data and Self-Service BI Platform to provide the client’s almost 3 million internal users with hassle-free on-demand data access.

We took on the following challenges:

●

Create an easy-to-use custom web portal to enable a 360-degree view of all data sources and data available in any format (Excel spreadsheets, invoices, PDFs, text files, databases, etc.) across the entire organization.

●

Develop a self-service BI platform to provide business users with an opportunity to analyze data and create complex ad-hoc reports.

●

Create Master Data Repository to serve as a source of truth for all organizational data.

●

Break down data silos and achieve consistency across data sources by collecting and connecting petabytes of data from disparate systems.

●

Provide data cleansing by detecting and correcting incomplete, incorrect, inaccurate, or irrelevant data and then replacing, modifying, or deleting the dirty or coarse data records from original data sources.

●

Manage data security and set up role based access control.

Solution

●

Graph data structures a cutting-edge technology that has proven incredibly efficient at handling complex networks of relationships and swiftly dealing with deep and complex queries.

●

A specific close to natural language dialect that is much simpler than SQL to make search a breeze even for untrained users.

●

Integration with major data sources and systems: Enterprise Data Lake, Slack, Zoom, Atlassian Stack (Confluence, Jira), Office 365, Active Directory, SAP, Microsoft Exchange, etc.

●

The Report Builder feature that allows business users to create complex reports through querying multiple data sources at the same time and share them.

●

The Hashtag Autocomplete functionality to facilitate effective search among a massive volume of data.

●

The Hashtag Search feature that suggests the most relevant hashtags to users to simplify digging through search results.

●

An internal communication function enabling employees to send messages to various communication channels directly from the system.

●

A simple API which allows for even faster data collection and gives the opportunity to build custom apps and integrate internal systems.

●

Role-based security in graph databases to ensure sensitive data protection by limiting access to resources in the graph based on a user’s role.

Impact

●

3 million internal users now have access to a big-picture view of all previously inaccessible data.

●

A self-service Data Analytics platform allows non-tech-savvy business users to filter, sort, analyze and visualize data on their own.

●

Business users get timely and actionable insights to make smarter decisions based on data rather than intuition in just a few clicks.

●

The Data Analytics teams are now freed up from creating the majority of routine reports.

●

Multi-dimensional data presentation uncovers once hidden connections for unrelated data.

●

7-8m requests per day and 10k requests per second can now be handled by the high-loaded system.

●

The platform allows to drastically cut down the time and effort it takes to collect and analyze data, which opens up new market opportunities and helps make sound business decisions way faster.

●

Accurate and relevant data is provided for any internal application developed through the API.

We are making in minutes things that our teams have been stuck with for days before.