Blogs

AI Engineering: from smart models to solid systems

Written by Itility | Apr 21, 2026 11:23:17 AM

AI in production: where expectations and reality collide

AI has become part of critical business processes. In our own processes, and at our customers. Decisions are supported or automated using models, LLM’s and agents.

Yet, AI is still often treated as a stand-alone component: a smart piece of logic added to an existing process. In many cases, the underlying business process itself is not sufficiently defined. When data changes, volumes increase or operational constraints emerge – problems follow. Not because AI fails, but because the surrounding system was never designed to support it.

AI Engineering as a necessary discipline

AI models are not deterministic. In operational environments, systems are expected to deliver a consistent level of quality across many runs. That is a fundamentally different dynamic.

That is where we see AI Engineering play a pivotal role. AI Engineering is not primarily about training better models. It is about designing systems in which AI can operate reliably and sustainably. Once AI becomes part of operational processes, it must meet the same standards as any other business-critical system.

That means paying attention to data quality and reliable pipelines, to integration and operational manageability, to scalability, and to security, compliance and governance. AI Engineering sits at the intersection of data science, software engineering and platform architecture, connecting technological innovation with operational reality.

From model to system: when AI delivers value

Many AI initiatives fail in the transition from experiment to production. Not because the model is inaccurate, but because it is not embedded in a robust system.

An AI model has no context. It does not recognize deviations, understand business impact or correct itself. So we need a system with clear responsibilities, feedback loops and fallback mechanisms. Successful AI solutions therefore consist of coherent systems for data ingestion, validation, decision-making, monitoring and continuous improvement.

Two customer examples illustrate this clearly

One of our customers delivers a spatial platform to local government organizations, where policy officers interact with geospatial data through a chat-based interface. Instead of navigating maps and filters, they can ask questions such as: “Which buildings in this district do not meet the green-space standard?”

What makes this work is not the AI layer alone, but the system around it. The agent combines structured geospatial data products derived from satellite data with public policy information retrieved from the web and stored in its knowledge base. Based on the user’s question, it selects the relevant sources and generates an answer in context.

The system does not depend on an active feedback loop in which user corrections are automatically reused. Instead, interactions are logged and analysed to improve prompts and identify missing knowledge over time, while both policy sources and underlying geospatial data are continuously refreshed. This is what keeps answers as current and reliable as the surrounding system allows.

A second example involves a manufacturer of industrial ovens. Previously, service engineers relied on a central support team to manually search documentation, leading to delays and inconsistent responses.

With a GenAI assistant, the process is structured differently. The system uses a knowledge base built from machine manuals and technical documentation, processed through a RAG pipeline: chunked, embedded and indexed in a searchable database. When an engineer describes an issue, the system interprets the request, retrieves the most relevant passages and summarizes them into a direct answer.

Reliability comes from more than retrieval alone. The assistant links back to the original source, allowing engineers to verify the output. New or updated documentation is processed through the same pipeline and added to the system.

The value lies not in the model itself, but in the coherent system around it: combining ingestion, retrieval, interpretation, verification and continuous updating within the service process.

The pitfall of “just build us an agent”

We used to have customers ask for “a dashboard”. Currently, a common request is: “Can you build us an AI agent?” What is often overlooked is that business processes rarely consist of a single task. They are made up of multiple reasoning steps, each requiring a specific approach.

A single agent that “does everything” may sound appealing, but in practice it almost always leads to inconsistent results. Good AI Engineering means breaking processes down into distinct steps and determining how an agent can best support each of them. The result is a system that performs more consistently, even if it is less spectacular than the idea of one all-knowing agent.

Engineering determines whether AI keeps working

There is no universal AI architecture. Cloud is not always the right choice. Edge computing is not inherently better. Streaming can be necessary, but also introduces complexity. Generative AI is powerful, but not suitable for every context.

Effective AI Engineering starts with context. For example: does a response need to be returned within milliseconds, or is a delay acceptable? Is the data sensitive and restricted to a specific environment, or can it be processed in the cloud? These constraints determine the architecture far more than the choice of model.

Engineering maturity shows in making deliberate trade-offs. Sometimes this leads to solutions that are less technically impressive, but far more robust and maintainable in operation. And: AI Engineering does not stop at go-live. AI systems operate in environments that continuously change. Designing for adaptation, evaluation and feedback is essential to maintain reliability over time. AI Engineering is not an extra layer on top of AI. It is the foundation required to make AI work - not once, but sustainably.