Background

Compare The Market faced challenges with their third party integration that introduced governance issues and a lack of strict data integrity standards across teams.  Additionally, there is a complexity in determining the correct email addresses for customer communications due to customers providing different names and addresses.

An improvement in these areas will contribute to the accelerated delivery of campaigns and overall efficiency.

Objectives

To enable CtM to address the issues they were facing, at a high level, the objectives outlined were:

• An updated architecture to increase data processing times
• A solution to the customer data integrity mismatch across the company
• Support on organisational data governance

Architecture

Architect enterprise platform solutions, introducing real-time data processing and enterprise data ingestion

Enterprise Integrations

Recommending the replacement of old SQL databases within the data pipeline to faster streaming databases

Data Governance

Establishing data governance best practices within the organisation and technical teams

Stakeholder Management

Work with stakeholders across the management team to agree on project requirements and explain the chosen technical approach

Enterprise Architecture

I introduced an updated enterprise architecture while working alongside their enterprise and solution architects to address their data processing issues. This enabled them to ultimately achieve their sub one minute goal of quotation processing.

Data Governance

We recommended the introduction of automated tools and processes to reduce the manual effort required for validating and sanitising data in big data projects.

This will help improve efficiency and accuracy in handling large volumes of data, ensuring that the data is clean and ready for use in email campaigns.