CloverETL is now CloverDX - Learn Why

Back to CloverDX Blog on Data Integration

Using data integration to develop data architectures

Posted by CloverDX on Mar 5, 2018 9:43:31 AM

Data integration tools aren’t just for data integration. With some creative thinking, there are many more processes that a data integration platform can improve.

For example, the right data integration tool can be just as valuable in developing a data architecture as it is in operating that architecture.

We’ve come across several instances of data architects using data integration to develop data architectures, and in our latest webinar, we took a look at three cases to see how organizations managed to significantly speed up development.

Watch Webinar (15 min)

The right data integration tool can be just as valuable developing an architecture as it is in operating that architecture

You can watch the full (15 minute) webinar here, but here’s a quick summary:

 

From a 10-month change cycle down to 4 weeks

A large financial services institution is reorganizing itself in a bold move to close the gap between IT and business teams, significantly reducing the delays and friction typically present with the traditional 'waterfall' approach.

On the user side, their business teams design and maintain data models. But then, instead of developers taking over, they use data integration to transform data models into executable 'LEGO bricks', automatically and error-free. These can be easily combined into visual workflows, with much less skill required.

This innovation allows for a very rapid turnaround, shortening the time from an idea to actual production from months down to just 3 or 4 weeks.

 

Automating regular updates to an analytics warehouse

Providers of an association management system were defining the layout of their analytics dataset with just an Excel file. They use a data integration platform to extract architecture from the Excel and load the resulting workflows into production, automating regular updates to the analytics warehouse.

All the architect needs to do is to maintain his Excel doc.

 

Testing data architecture changes

In another financial institution, as banking products and related applications come and go, the data architecture that supports them changes. The IT team needs a robust test environment to validate changes. By far the best way to do this is with real banking data, but for obvious privacy and security issues this isn't possible.

Using a data integration platform, they can extract real data, anonymize it, and load it into a test environment.

Developing architecture with CloverETL

We explain these three use cases in more detail in the webinar, and show you how thinking creatively about uses for data integration platforms can lead to some clever solutions. Watch the webinar now.

Watch Webinar (15 min)

Data integration software and ETL tools provided by the CloverDX platform (formerly known as CloverETL) offer solutions for data management tasks such as data integration, data migration, or data quality. CloverDX is a vital part of enterprise solutions such as data warehousing, business intelligence (BI) or master data management (MDM). CloverDX Designer (formerly known as CloverETL Designer) is a visual data transformation designer that helps define data flows and transformations in a quick, visual, and intuitive way. CloverDX Server (formerly known as CloverETL Server) is an enterprise ETL and data integration runtime environment. It offers a set of enterprise features such as automation, monitoring, user management, real-time ETL, data API services, clustering, or cloud data integration.