Cloud Migration Case Studies

Szabolcs Kun
Szabolcs Kun
06 Oct 2023 · 5 min read

At DATAPAO, we often talk about the significant benefits of migrating to the cloud for companies and how such a move unlocks immense potential for streamlining operations and innovation, including the deployment of machine learning and AI.

In our recent series of articles on cloud migration, we’ve also looked at particular aspects of migration, such as the roles required for the success of a migration project and the different approaches to data migration.

Today, we are going to bring it all together and look at how exactly DATAPAO helps organizations migrate smart, thanks to the One Stop Cloud Migration Solution. 

What were the challenges and obstacles? What benefits have companies seen? And how were they achieved? Join us as we explore three different migration journeys that DATAPAO helped see through to resounding success.

Cloud Migration Case Study 1: A Leading Airline

With a market capitalization of $6.3 billion and serving an estimated 70 million passengers every year, this airline is one of the most recognizable in the world. 

Goals & Challenges

In order to serve the business goal of reducing the total cost of ownership (TCO) as well as accelerating new use cases, the airline sought to migrate an AWS Cloudera installation to Databricks

Naturally, such a move comes with its fair share of complexity and requirements. The existing installation contained massive amounts of tables and ingestion pipelines, which provided further obstacles.

DATAPAO’s Solution 

DATAPAO’s team of data engineers designed the overall architecture with security and data governance in mind, using the Unity Catalog. 

We collaborated closely with the client to implement pipelines and optimized them wherever the runtimes were not optimal.

We designed and implemented a metadata-driven ingestion framework to automate landing in Bronze and Silver. The ingestion framework also handles anonymization. 

We also deployed automatic schema with change-controlled schema evolution.

As part of our automations, we migrated selected use cases and enabled teams to allow for workflow repetition.

Outcome & Results

  • Reduced runtime: Impressively, pipeline runs were reduced from 6 hours to 20 minutes.
  • Acceleration of tables & apps: The project accelerated the ingestion of thousands of tables and the next ≈75 data applications and use cases.

ARE YOU CONSIDERING MIGRATING TO THE CLOUD?

LEARN HOW TO MIGRATE SMARTLY AND REAP THE FULL BENEFITS!

Cloud Migration Case Study 2: A Prolific Pharma Brand

This well-known multinational company works across consumer healthcare, chemicals, biotechnology, pharmaceuticals, and agricultural products. 

Goals & Challenges

Frequently seen across the board, siloed data was a problem in this migration project, coming from both enterprise resource planning (ERP) and non-ERP systems and, as a result, preventing the company from utilizing the full potential of its vast data assets.

The pharma company’s need was for time-to-insight to be real-time, yet value was not extracted fast enough as it stood. What’s more, they weren’t sufficiently utilizing opportunities to build high-value use cases through machine learning and AI.

DATAPAO’s Solution 

To address the complex needs of this multinational, DATAPAO migrated SAP S/4HANA to Databricks Lakehouse, setting it up as a single source of truth for the entire organization. The resulting lakehouse combines 15+ data sources and more than 20,000 tables.

We designed and implemented a metadata-driven ingestion framework to enable low code interactions for complex transformations, setting the infrastructure up for future success.

To address the need for fast insights, we also designed and implemented a near-real-time ETL workflow through the parallelization of workloads.

Because of complex regulations and requirements across locales, we implemented a fine-grained data governance model based on AAD groups and users for restricted access to entire databases or subsets.

Outcome & Results

  • Increased productivity: Productivity was significantly boosted, as data teams now enjoy combined access to 15+ sources and 20k+ tables in near-real-time.
  • Future-proof scalability: One-click workspace deployment and low/no-code data onboarding increased scalability and boosted ease of use.

Cloud Migration Case Study 3: A Power Equipment Provider

This supplier of equipment related to the areas of power, temperature control, and energy services has been trading all over the world for over 50 years. 

Goals & Challenges

With a global client base and a wide range of products, this organization was already collecting vast amounts of information. However, siloing had become a pain point and meant that the value of the data was underutilized, with time-to-insights being slower than ideal.

Also, slowing down the process was complex legacy architecture and transformations, while the company had not taken full advantage of machine learning and artificial intelligence capabilities. 

DATAPAO’s Solution 

The solution implemented by DATAPAO’s team of data experts involved migrating from EDW to Lakehouse, which was conveniently set up as a single source of truth for the entire organization, combining more than 15 different data sources.

We designed and implemented a close to real-time ETL workflow with parallelized workloads.

In terms of data governance, we implemented a detailed model based on AAD groups and users so that access is provided on a need-to-know basis and compliance is assured in the various jurisdictions in which the company is active. 

Outcome & Results

  • Near-real-time access: By combining 15+ sources and approximately 4,000 tables, we greatly increased the productivity of data teams.
  • Scalable data platform: This convenience, based on our metadata-driven workload, means that workspace deployment and data onboarding are both easy and accessible to more staff.

Summing Up

These are just three of the many cloud migration case studies and success stories of DATAPAO’s smart migration projects. As trusted guides to your data journey, we’ve been assisting organizations in their efforts to become future-proof for over 7 years.

The goal? To help your organization truly leverage the data it collects, to increase productivity across the board, to provide near-real-time insights, to enable you to reach your potential – ultimately, to help your company grow and prosper.

Speak to one of our people today to find out how we can make the difference in your data infrastructure.