--- title: Using standardized building blocks for complex data projects description: Building a data lake from scratch is a lot of work and complex. Using standardized building blocks enable you to move quickly with a custom solution. image: https://blogs.itility.nl/hubfs/IDF%20Blog%20-%20Complexe%20projecten%20opstarten-featured-image.jpg --- [![itility](https://blogs.itility.nl/hubfs/blog/img/itility%20logo-01.png)](https://www.itility.nl) - Your industry - [Agriculture](https://www.itility.nl/agriculture) - [Energy](https://www.itility.nl/energy) - [Manufacturing](https://itility.nl/manufacturing) - Our expertise - [Business transformations](https://www.itility.nl/business-transformations) - [Software and data](https://www.itility.nl/software-development/) - [IT foundation](https://www.itility.nl/it-foundation) - [Managed services](https://www.itility.nl/managed-services) - [(Generative) AI](https://www.itility.nl/ai/) - [Who we are](https://www.itility.nl/who-we-are) - [Working at Itility](https://careers.itility.nl) - [About](https://itility.nl/about) - [About Itility](https://itility.nl/about) - [Offices](https://itility.nl/about#office-locations) - [Tech partners](https://itility.nl/tech-partners) - [Responsibility](https://itility.nl/responsibility) - [Contact](https://www.itility.nl/#contact) - Your industry - [Agriculture](https://www.itility.nl/agriculture) - [Energy](https://www.itility.nl/energy) - [Manufacturing](https://itility.nl/manufacturing) - Our expertise - [Business transformations](https://www.itility.nl/business-transformations) - [Software and data](https://www.itility.nl/software-development/) - [IT foundation](https://www.itility.nl/it-foundation) - [Managed services](https://www.itility.nl/managed-services) - [(Generative) AI](https://www.itility.nl/ai/) - [Who we are](https://www.itility.nl/who-we-are) - [Working at Itility](https://careers.itility.nl) - [About](https://itility.nl/about) - [About Itility](https://itility.nl/about) - [Offices](https://itility.nl/about#office-locations) - [Tech partners](https://itility.nl/tech-partners) - [Responsibility](https://itility.nl/responsibility) - [Contact](https://www.itility.nl/#contact) [![Picture of Maarten Pennings](https://blogs.itility.nl/hubfs/Maarten%20Pennings%20-%20Rond.png)](https://blogs.itility.nl/en/author/maarten-pennings?hsLang=en) Written by:   ## [Maarten Pennings](https://blogs.itility.nl/en/author/maarten-pennings?hsLang=en) # Using standardized building blocks for complex data projects **Starting a data project by building a data lake from scratch is a lot of work, making it expensive and prone to errors. Building the technical foundation while under pressure to deliver data use cases can result in short-term focus, increasing the chance of making mistakes that can be quite costly in the long run. Or, for example, databases and servers being set up without thorough monitoring.** Using standardized building blocks is a way to solve this problem. This is already common practice in the cloud world, where we see a catalog-approach of semi-finished products such as applications, databases, middleware, storage, computing or network products. Giving you the freedom to pick-and-mix your custom solution together. Why not use this approach for data projects? ## Best of both worlds: one size fits all vs. unique and customized Our Data DevOps team has developed many standard data building blocks. They are tried and tested, based on our experience and lessons learned from quite some data projects. From that experience, it became clear that although the data for every project is unique, the process to yield value is surprisingly similar. Comparable to a factory, the different steps in this process have an optimal sequence. We have cut up these steps in framed units to create standardized building blocks, enabling us to move fast in a controllable way. This accelerates the implementation of data use cases, while continuously delivering high availability and performance. For example a cloud-based scalable data processing platform to load and extract data. You have got at least four building blocks right there: cloud-based databases, either for storing large amounts of raw data or for rapid data I/O, data pre-processing pipelines, the data science flow, and a security and data governance model. Let’s zoom in on an example project: [StreetWise](https://blogs.itility.nl/en/tno-splitting-and-classifying-car-data?hsLang=en) project. Together with TNO, we created a scenario-based database with real-life traffic situations, by data-mining many thousands of miles of data via complex algorithms – to be used by companies to test software for self-driving cars. As the performance of these cars is directly reliant on the data quality, mistakes in gathering, processing, or analyzing this data could have disastrous consequences. Especially in the case of the TNO-project where the data is used to teach self-driving cars, it becomes clear that there can’t be any compromise on quality. That is why we used the data governance and security building block when architecting the platform. By design, the sensor data and mined scenarios are stored separately from the client-facing generated test cases. Additionally, the engineers and data scientists have read/write rights on the environment to perform their work, but cannot accidentally break the platform, as these rights are restricted. This allows the team to focus on their core responsibilities, without being limited or distracted by data security. Other examples of those building blocks in the standardized data factory are an Azure-based database that we can deploy almost instantly; data ingestion pipelines that ensure a smooth transition from raw data to use-case-specific data; or an Analysis Service server for fast access to the data sets. All these building blocks come with monitoring and performance controls. And by using a software-defined infrastructure, we constantly keep the building blocks up to date using the latest insights. Since in DevOps, the things you build (development) are also your responsibility in terms of support (operations) – you better make it right from the start. [![back](https://blogs.itility.nl/hubfs/blog/img/button_back.png)Back to overview](https://blogs.itility.nl?hsLang=en) Tags: Share: - [![](https://blogs.itility.nl/hubfs/blog/img/linked-in-02.png)](https://www.linkedin.com/shareArticle?mini=true&url=https://blogs.itility.nl/en/using-standardized-building-blocks-for-complex-data-projects&title=Using%20standardized%20building%20blocks%20for%20complex%20data%20projects&source=Itility) - [![](https://blogs.itility.nl/hubfs/blog/img/socmedicons-04.png)](https://www.facebook.com/sharer/sharer.php?u=https://blogs.itility.nl/en/using-standardized-building-blocks-for-complex-data-projects&t=Using%20standardized%20building%20blocks%20for%20complex%20data%20projects) # Author's picks [![](https://blogs.itility.nl/hs-fs/hubfs/Blog%20-Taking%20manual%20work%20out%20of%20invoice%20processing%20with%20AI.png?width=345)](https://blogs.itility.nl/en/taking-manual-work-out-of-invoice-processing-with-ai?hsLang=en) [(Gen) AI](https://blogs.itility.nl/en/topic/gen-ai?hsLang=en#b-overview)   |   [FinOps](https://blogs.itility.nl/en/topic/finops?hsLang=en#b-overview)   |   [Industry Solutions](https://blogs.itility.nl/en/topic/industry-solutions?hsLang=en#b-overview) ## [Taking manual work out of invoice processing with AI](https://blogs.itility.nl/en/taking-manual-work-out-of-invoice-processing-with-ai?hsLang=en) [![](https://blogs.itility.nl/hs-fs/hubfs/BMAD-party-mode-on-1920x1080-1.png?width=345)](https://blogs.itility.nl/en/from-bmad-to-agents-to-skills?hsLang=en) [(Gen) AI](https://blogs.itility.nl/en/topic/gen-ai?hsLang=en#b-overview)   |   [AI engineering](https://blogs.itility.nl/en/topic/ai-engineering?hsLang=en#b-overview) ## [From BMAD to agents to skills: Why we are building reusable engineering knowledge](https://blogs.itility.nl/en/from-bmad-to-agents-to-skills?hsLang=en) [![](https://blogs.itility.nl/hs-fs/hubfs/48629250503_d19c551163_b-1.jpg?width=345)](https://blogs.itility.nl/en/itilian-in-the-spotlight-max-heezemans?hsLang=en) [Careers](https://blogs.itility.nl/en/topic/careers?hsLang=en#b-overview)   |   [Itility & Careers](https://blogs.itility.nl/en/topic/itility-careers?hsLang=en#b-overview) ## [Itilian in the Spotlight: Where ownership creates impact](https://blogs.itility.nl/en/itilian-in-the-spotlight-max-heezemans?hsLang=en) # Technology, Data, People [Eindhoven (HQ)](https://itility.nl/about#nl-office) [Flight Forum 3360](https://goo.gl/maps/eEgqhvCsQ2wBY3rs6) 5657 EW, Eindhoven The Netherlands [info@itility.nl](mailto:info@itility.nl) [+31 (0)88 00 46 100](tel:+31880046100) [San Diego](https://itility.nl/about#us-office) [13500 Evening Creek Dr N #120](https://maps.app.goo.gl/Z9wtjcQK6Jn8QGa88) San Diego, CA 92128 United States [info@us-itility.com](mailto:info@us-itility.com) [+1-858-325-0120](tel:+18583250120) [Austin](https://itility.nl/about#us-office)[106 E 6th St #900](https://maps.app.goo.gl/tfFfowbYtwzCfwFN8) Austin, TX 78701 United States [info@us-itility.com](mailto:info@us-itility.com) [+1-858-325-0120](tel:+18583250120) [Romania](https://itility.nl/about#romania-office) [Palas Campus Iași](https://maps.app.goo.gl/6KEC5iTi8RUtM1QTA) B2 Building, 6th Floor Romania [contact@itility.nl](mailto:contact@itility.nl) [+31 (0)88 00 46 100](tel:+31880046100) - [Linkedin](https://www.linkedin.com/company/itility) - [Facebook](https://nl-nl.facebook.com/itilitybv) - [YouTube](https://www.youtube.com/@itility-bv) - [Mail](mailto:info@itility.nl) © Copyright - Itility 2026 | [Cookie policy](https://www.itility.nl/cookie-policy) | [Privacy policy](https://www.itility.nl/privacy) [![Itility](https://blogs.itility.nl/hubfs/blog/img/itility%20logo-01.png)](https://itility.nl)