Client
One of the largest retailers that operates a chain of hypermarkets, discount department stores, and grocery stores around the globe
Industry
Retail
Services
Product Development, Data Architecture, Data Management, Data Analytics, Data Visualization
Tech
Cosmos DB, MS Azure, Gremlin, JanusGraph, Cassandra, Java, Python, Kafka, React, Redis

Challenge

The importance of data, its accuracy and availability when and where needed, cannot be overestimated when it comes to business prosperity and leadership. For a company operating on a large scale, getting as close to data as possible becomes even more critical. That’s what our client came to us for. With a huge number of internal users, disparate systems and isolated islands of data began to take a toll on the entire data analysis process resulting in inaccurate insights, poor business decisions and missed market opportunities. Our team was entrusted with the task of creating an AI-driven big data and self-service business intelligence platform to provide the client’s almost 3 million internal users with hassle-free on-demand data access.

We took on the following challenges:
Create an easy-to-use custom web portal to enable a 360-degree view of all data sources and data available in any format (Excel spreadsheets, invoices, PDFs, text files, databases, etc.) across the entire organization
Develop a self-service BI platform to provide business users with an opportunity to analyze data and create complex ad-hoc reports
Create a Master Data Repository to serve as a source of truth for all organizational data
Break down data silos and achieve consistency across data sources by collecting and connecting petabytes of data from disparate systems
Provide data cleansing by detecting and correcting incomplete, incorrect, inaccurate, or irrelevant data and then replacing, modifying, or deleting the dirty or coarse data records from original data sources
Manage data security and set up role-based access control
AI-powered Big Data Platform
Big Data Platform

Solution

Use of graph data structures, a cutting-edge technology that has proven to be incredibly efficient at handling complex networks of relationships and swiftly dealing with deep and complex queries
A specific close to natural language dialect that is much simpler than SQL to make search a breeze even for untrained users
Integration with major data sources and systems: Enterprise Data Lake, Slack, Zoom, Atlassian Stack (Confluence, Jira), Office 365, Active Directory, SAP, Microsoft Exchange, etc.
The Report Builder feature that allows business users to create complex reports through querying multiple data sources at the same time and share them
The Hashtag Autocomplete functionality to facilitate effective search among a massive volume of data
The Hashtag Search feature that suggests the most relevant hashtags to users to simplify digging through search results
An internal communication function enabling employees to send messages to various communication channels directly from the system
A simple API which allows for even faster data collection and gives the opportunity to build custom apps and integrate internal systems
Role-based security in graph databases to ensure sensitive data protection by limiting access to resources in the graph based on a user’s role
Global Retailer solution
Solution for Global Retailer

Impact

The self-service data analytics platform allows non-tech-savvy business users to filter, sort, analyze, and visualize data on their own, giving 3 million internal users a big-picture view of all previously inaccessible data
With multi-dimensional data presentation uncovering once hidden connections for unrelated data, business users can get actionable insights to make smarter decisions based on data rather than intuition in just a few clicks
Data analytics teams are now freed up from creating the majority of routine reports
13 million requests are serviced on the API and hundreds of millions of events are consumed per day, with almost 3 PB of data stored in the data lake
Accurate and relevant data is provided for any internal application developed through the API
We are making in minutes things that our teams have been stuck with for days before.
Product Owner
Global retailer

Latest projects