Data Vault Automation with Datavault Builder

Data Vault Automation with Datavault Builder

Cutting complexity of data warehouse automation can lead to faster insights

Changes in the technology within the world of data warehousing still show no sign of abating – whether you still employ a company like Oracle with a near 30-year track record or have come to the game in more recent times, in a Cloud environment using a platform like Snowflake.

So finding an automation tool that can not only bring both sides of the business together, but offers a very strong visual tool to create your business model – and replace eight or nine different pieces of software with just one – can be helpful with simplified tooling.

Datavault Builder CEO Petr Beles spoke at the latest Data Vault User Group about the benefits of their award-winning data warehouse automation solution, which offers data modelling, ETL, regression testing, deployment, documentation generation, data lineage and scheduling through to operations – all in one package.

And during a live demonstration, Data Vault User members were able to see how quickly and easily changes could be made in the Data Vault, thanks to Datavault Builder’s functionality – and its simple user-interface.

Petr believes your business data model can be far more constant and robust over time than some people imagine.

His presentation ‘Model Driven – Data Vault Automation with Datavault Builder,’ started with the premise that many companies struggle to integrate data – both in terms of time and quality.

Turning data into insightful information

After years working in the telecommunications and financial services sector, Petr has plenty of first-hand experience of dealing with the problems of managing increasingly complex sets of data, from an increasing variety of sources.So when developing the Datavault Builder automation tool, his first priority was to cover the full data quality process involved in maintaining a data warehouse solution.

Datavault Builder automatically converts the design of the business model into working code in real time, using a simple-to-use interface covering the full data warehouse lifecycle and is designed for a totally agile approach.

The tool removes the use of a repository, concentrating on a direct relationship between the automation tool and the database.The solution incorporates sandboxes – testing areas where code can be tried and tested – with no additional fees for those development and testing environments.

From producing the model – visually, conceptually and logically – with key inputs from business users – code is generated from the model, with the implementation updated over time.

Automated testing saves time and money

All jobs are created and executed automatically with automated testing saving time and money thanks to the use of APIs (application programming interfaces).

Once tested, the code is versioned in GIT before being deployed, and then integrated with Jira software – designed for agile project management.

That deployment is automated using the APIs to build a continuous integration (CI)/CD (continuous delivery) workflow.

Using Datavault Builder not only brings business users and IT togetherto make a better partnership for more effective data analytics, but it also reduces your time-to-market by speeding up the process considerably and eliminating many of the manual errors in “old school” data warehousing.

Petr demonstrated how simply and quickly his Datavault Builder tool can be implemented with a 15-minute demonstration of how the data sources can be fed into the staging and business vault, and the power of the automated Data Vault can quickly bring effective analytics and business intelligence gains.

One of the most impressive features is that changes made to the business model via the user interface, can be implemented in the database simply and quickly, without major disruption or costly changes, that only IT can fix.

Watch live demonstration of Datavault Builder

In the real world, the results Datavault Builder can bring are achieved using real-time data sources. It can be production ready within 10 minutes of connecting to a new data source as shown by Petr.

So if you are looking to upgrade your Data Vault, and make major changes in your data warehouse set-up, finding an efficient visual data integration solution such as Datavault Builder, offers the chance to replace up to nine different software tools.

And in doing so, you can not only reduce the total cost of ownership, but increase your data platform’s maintainability, while reducing the risk and complexity involved in many organisations and companies.