Revisited from the Foresaw archive. The argument and structure have been updated for this edition.

It is easy to demonstrate a model producing an impressive answer. It is harder to explain how that answer improves a business workflow, how often it is dependable, and what happens when it is wrong.

That is the gap between an AI demonstration and an engineered system. Closing it begins with the work rather than the model.

Define a useful unit of progress

Choose a bounded task: finding supporting information, drafting a response for review, or prioritizing a queue. Describe the inputs, the expected output, and the person responsible for the result.

Compare the proposed system with the existing workflow. The baseline may be a manual process or a simpler rule, not another model.

Evaluate with realistic examples

Build a set of examples that reflects the difficult cases as well as the routine ones. Include missing information, ambiguous requests, and inputs the system should decline to act on.

Agree on quality criteria with the people who understand the task. An answer can be fluent and still be unhelpful, unsupported, or inappropriate for the decision.

Engineer the surrounding system

Data access, permissions, latency, cost, logging, and recovery are part of the product. If an answer depends on internal knowledge, users need a way to inspect the evidence behind it.

When the workflow can change records or trigger actions, make the boundaries and review steps explicit.

Expand from evidence

Start with a scope that makes errors visible and recoverable. Learn from how people use the system, then decide what additional responsibility it has earned. The objective is useful, repeatable work—not a larger collection of AI features.

FROM THE ARCHIVE

Adapted from “The Rise of Artificial Intelligence: Transforming the IT Landscape.”

First published on Foresaw. Reworked for this edition.

← Back to all insights