Jaco van der Laan
Active filters:Automation ×Clear all

Automating Dimensional Models with Metadata & dbt

Stop hand-coding stars. Let your data model drive SQL generation and keep your analytics layer agile. Use metadata and dbt to automatically generate PIT-based snapshots, facts, and dimensions — reproducible, testable, and easy to evolve. From Historized 3NF to Fast, Governed Analytics — A Metadata-Driven Journey (5 parts) Why Start from a Business-Shaped, Historized 3NF Generating Dimensional Models Automatically Automating with Metadata & dbt ← you’re here Solving Many-to-Many & Drill-Across with the Unified Star...
Read more

SQL ETL Migration Playbook (Legacy → New Dual‑SCD2 Platform)

How to turn messy legacy pipelines into a scalable, transparent, and future‑ready data foundation. If your organization has been around for more than a decade, chances are your ETL landscape is packed with SQL code that nobody wants to touch. Layers of historization logic, business rules, and data quality fixes often live in the same queries—making them fragile, hard to debug, and expensive to maintain. But there’s good news: migrating to a modern dual‑SCD2 platform...
Read more

Open Source collaboration update Roelant Vos

Roelant Vos has posted a brief status update on what’s happening in the open source #datawarehouse #automation ecosystem! The generic interface for Data Warehouse Automation had to be re-based (recreated) in GitHub due to various issues around forking and branching. The repository has been re-created with the same name and is available at https://github.com/RoelantVos/Data_Warehouse_Automation_Metadata_Interface . TEAM is nearing completion for the v1.6 release. The following Kanban board shows what’s happening for v1.6: https://github.com/RoelantVos/TEAM/projects/1 . Virtual Data Warehouse v.1.6.1...
Read more

Next Virtual Data Warehouse classroom training will be in Utrecht, The Netherlands!

The upcoming Virtual Data Warehouse implementation & automation classroom training will be located in The Netherlands. Check out the details & register at www.virtualdwh.com. The training is delivered in conjunction with Doerffler & Partner and DCYSIVE and will once again focus on the design and implementation of a data platform that is truly flexible, scaleable and resilient. This is a very practical training that will provide the end-to-end overview of how to deliver a hybrid data warehouse solution. Utrecht is centrally...
Read more
1 2