Skip to main content

AI Demands Systems Thinking, Not Just Faster Tools

Alex Raeburn
Alex RaeburnMarketing Manager
10 min read
AI Demands Systems Thinking, Not Just Faster Tools

AI speeds the work, but not the decision

A modern engineering project can move fast in a way that would’ve felt a little absurd a few years ago. An engineer defines the problem in plain terms, then uses AI to search technical standards, skim research papers and pull together the parts that’d otherwise eat an afternoon or two. After that, the same person can ask the model for several design options, run simulations on each one and compare the results side by side. The paperwork gets lighter, and the loop gets shorter. And the coffee somehow gets colder.

That speed changes the daily rhythm of the job, but it doesn’t move the responsibility anywhere else. The model can draft a proposal, summarize a standard, or suggest a parameter change. It can’t own the consequences when a design fails in the field, when a tolerance’s off, or when a choice makes sense on paper and falls apart in practice. The go-or-no-go call still belongs to a person who understands the problem, the constraints and the cost of being wrong.

AI can speed up the path to an answer. It cannot tell you whether the answer deserves to ship.

And that distinction matters because the engineer’s role’s changing from solitary execution to coordination. A single person no longer has to read every paper line by line, write every draft from scratch and test every possible variation alone. Instead, the work often looks more like directing a small team where some members are human, some are software and some live in specialist knowledge that the engineer can reach only through the right questions. One person frames the problem. The tools gather material. Another specialist may later review a weak point that surfaced during testing. The engineer keeps the whole process moving without pretending that every part of it can be automated.

This is where AI in engineering feels useful in the real world rather than impressive in a demo. It can sort through a pile of standards faster than a person can, but the engineer still has to decide which standard applies. The reality: it can produce three or four design options before lunch, but someone has to notice when all four quietly assume the wrong load case. It can run simulations quickly, yet simulations only answer the question they were given. If the wrong question was asked, the speed just gets you to the wrong answer sooner.

That’s why the best use of these tools is often less glamorous than the marketing suggests. AI can trim repetitive work, surface references and turn a messy first pass into something readable. Human judgment then steps in to decide whether the output makes sense, whether the assumptions are fair and whether the project should continue at all. Sometimes the correct decision is to move ahead. Revise the problem, or bring in someone with a deeper specialty, sometimes it’s to slow down. A fast tool doesn’t save a project from a bad premise.

For engineers, that shift can feel oddly freeing. They no longer need to act like a one-person factory, grinding through every technical step by hand. They can spend more time defining the problem well, checking the reasoning, and deciding which parts deserve machine support and which parts need a human to stare at the numbers for a while and say, “Nope, that’s not passing the sniff test.” That’s not a loss of control. It’s a different way of working, one that depends on clear judgment more than sheer output.

The rest of the story’s where that coordination gets harder, because once a project reaches beyond a single specialty, speed alone stops being enough.

When one problem crosses several disciplines

When one problem crosses several disciplines

Engineering’s long been split into specialties for good reasons. Electrical engineers worry about signals, power and noise. Mechanical engineers think about motion, materials, and failure under load. Civil engineers deal with structures, soil, weather and safety margins. Software engineers live in code, systems and logic that breaks in annoyingly creative ways. Those boundaries are useful because the rules are different in each field, and the mistakes look different too.

AI helps most when a problem slips across those boundaries. A software engineer working on a medical device might need to read biomedical research, sort through unfamiliar terms, compare test data and sketch an early model before anyone’s built a prototype. The engineer doesn’t need to become a doctor. That’d be a strange career pivot, and probably a tiring one. What AI can do is make the first pass less clumsy. It can summarize studies, explain terminology, compare claims and point out where the data looks thin or inconsistent. That gives the engineer a better draft of the problem before the clinician, biomedical engineer, or regulatory specialist weighs in.

The job is not to know everything. It is to know which expert should be in the room before a bad assumption gets baked into the design.

But that pattern shows up far beyond medical devices. In energy, a software issue can quickly touch grid hardware, forecasting accuracy, maintenance schedules, economics, plus utility regulation. A model that predicts demand too aggressively might send operators to the wrong part of the system, cost money, or complicate compliance work. In transportation, one routing feature can pull in vehicle sensors, road safety, driver behavior, local policy and insurance rules. Manufacturing adds another layer. A scheduling tool may look tidy on a screen while creating bottlenecks on the plant floor, stressing equipment, or cutting into worker safety if it ignores how people actually move through the line.

This is where AI can be useful without pretending to be wise. It can help the engineer ask sharper questions before a specialist meeting turns into a guessing contest. What data’s missing? Which assumptions came from software habits that don’t fit the physical setup? Where does the problem depend on hardware tolerances, and where does it depend on how people behave under pressure? Those questions are often more useful than a neat answer generated too early. A fast answer to the wrong problem is still the wrong problem.

Because of this, when teams work this way, AI becomes part of the engineering workflow rather than a substitute for judgment. It can sort background material, translate jargon, compare options and surface likely failure points. Then the human team decides what matters. That handoff matters because the most expensive mistakes often happen at the boundary between fields, where each specialty can see only part of the picture. One person spots the software bug. Another notices the safety issue. A third sees the cost hit. Put those pieces together, and the real problem finally comes into view.

Frameworks can help here, especially when the work affects patients, vehicles, public infrastructure, or factory systems. NIST’s AI Risk Management Framework gives teams a way to think about risks, measurements, and responses without turning every project into a legal seminar. Its core functions and resources are useful when a team needs a common language for mapping out what the model does, what can go wrong, and where review should happen. UNESCO’s guidance on AI supervision readiness across diverse governance ecosystems asks a related question from the governance side: who is prepared to examine the system, in this setting, before the result is put into use?

That question’s where good cross-disciplinary collaboration starts. Not with everyone pretending to know every field, and not with one person trying to wear five hats at once. It starts when someone notices that the problem’s moved out of their lane and calls in the right people before the project wanders off a cliff. A software engineer can frame the first pass. And a clinician can judge real-world use. A controls engineer can see a hardware limit. A policy expert can spot a rule that changes the whole plan. AI helps them get to that table faster. It doesn’t replace the table.

Systems thinking decides what AI should do—and what humans must own

Once AI enters the workflow, the hard part stops being speed and starts being judgment. Systems thinking is the habit of seeing how a part behaves inside a larger whole: where one decision creates a bottleneck, where a hidden constraint limits the options, where a failure can slip through, and what trade-off is being accepted when the team picks one path over another. That mindset matters because AI can make almost any step look easier than it really is. It can draft, sort, summarize, predict and propose. And it can’t tell you which of those outputs deserves trust without help.

The new coordination question’s simple to ask and annoyingly hard to answer. What should the model do? It should a person verify? When does a specialist need to make the call? So the whole exercise needs to be redone?, when is the problem framed too narrowly. Those aren’t software questions alone, and they’re systems questions. A team that skips them may get a clean-looking answer and a messy real-world result.

A model can produce a polished answer long before anyone has checked whether the question was framed well enough.

AI’s limits usually show up in familiar, boring ways, which is part of the problem. A language model can produce a persuasive explanation built on weak assumptions. Code can pass one test and fail another the moment the input changes. A summary can leave out the strongest evidence and quote the easiest lines instead. Interesting. A design can be tuned for the wrong goal, say lower latency or cheaper parts, while quietly making safety, usability, or maintainability worse. None of that requires a dramatic failure. It just requires a team to trust the first answer too quickly.

That is why responsible AI work leans so heavily on process. The NIST AI Risk Management Framework gives teams a way to talk about risk, validity, and monitoring without pretending those things will sort themselves out. The AI RMF resources from NIST go even further by breaking risk into practical pieces that teams can actually discuss. That kind of structure matters because it keeps the conversation grounded. It asks what was checked, what remains uncertain, and who has the final say when the output looks neat but the assumptions look shaky.

Then Take medical device AI and a sensor that has to measure a patient’s condition in the real world, not just in a lab. The model might propose a few sensor layouts, estimate signal quality and predict which version will perform best under controlled conditions. And whatever regulatory constraints apply, given the engineer then checks the requirements, given the noise budget, the battery limit. A clinician looks at whether the device fits actual care routines, whether the alert pattern makes sense, and whether the readings can be used without slowing down treatment. Patients or practitioners may be the first to notice what the technical team missed, like a strap that irritates skin, a screen that’s hard to read in a dim room, or an alert that fires at the wrong moment. In medical device AI, those details aren’t side issues. They decide whether the system helps or gets in the way.

The same pattern shows up wherever judgment matters more than raw output. Context changes the meaning of a result. Values shape what counts as an acceptable trade-off. Responsibility sits with people, not with the model that generated a suggestion. The UNESCO guidance on the ethics of AI treats that plainly, and for good reason. When a system affects health, safety, or trust, the team needs more than a fast answer. It needs people who can ask whether the answer fits the setting, whether the risks are tolerable, and whether the problem itself needs to be reframed before anyone commits to a direction.

That’s the real value of systems thinking here. It tells a team where AI can do useful work and where human expertise has to stay in charge. The model may draft the path. People still decide whether to walk it.

The core of engineering still belongs to people

The engineer’s job has never been just “make thing work.” It has been more like this: frame the problem, question the premise, test the answer, then notice when the problem has quietly turned into a different problem. AI can speed up the middle steps. It can draft options, search standards, and compare results at a pace no person can match before lunch. Yet the most important part of engineering decision-making still sits with a human being who can say, “Hold on, this is the wrong question,” or, just as usefully, “We need another specialist in the room.”

That’s where the profession gets interesting. A strong engineer doesn’t cling to the first definition of the task. New evidence comes in, and the target moves. A lab result may reveal a hidden constraint. A field test may show that the original design works in controlled conditions and falls apart in ordinary use. And a safety review may prove that the elegant solution on paper creates a mess in practice. None of that’s a failure of method. It’s the work itself. Real engineering changes shape as more is learned.

The best engineer is not the person who says yes fastest. It’s the person who knows when the question itself needs to change.

That’s also why organizations like IEEE have room to matter here. Not by pretending every field can be folded into one neat rulebook. That’d be absurd, and engineers know better than to trust a neat rulebook on first contact with reality. Instead, IEEE can help build shared ground across specialties that rarely sit at the same table for long enough. Clinical AI needs computer scientists, physicians, data stewards and regulators to agree on what counts as acceptable evidence. Resilient framework needs power engineers, control systems people and security teams to talk about failure in plain language. Energy reliability, scientific discovery and safe autonomous systems all depend on the same basic habit: someone has to define what “good enough” means before the system meets the real world.

Standards can make that habit less fuzzy. IEEE can help shape rules for when AI-generated work needs a second check, what counts as a proper check, and who is allowed to sign off when a model has touched the design. It can push for uncertainty to be written down instead of waved away. A model that says “I’m 87 percent sure” without saying what the other 13 percent means is not done. Neither is a report that hides uncertainty in a footnote and hopes nobody notices. If a specialist must approve a medical, electrical, or safety-related decision, that should be stated clearly. If responsibility is shared between a person and a machine system, the chain of responsibility needs to be visible, not vague enough to survive on a technicality.

That matters because AI can produce neat answers for messy problems. It can also produce very confident nonsense. Engineers have always dealt with imperfect information, but AI adds a new wrinkle: the output may look polished even when the assumptions underneath are weak. That makes the engineer’s judgment, and the ability to ask better questions, more than a nice professional trait. It becomes the thing that keeps the work honest.

So the future engineer isn’t boxed in by a single title or discipline. To be honest, the profession looks less like a fixed lane and more like an “unbound” practice. The unbound engineer can move between software, hardware, safety, regulation and human use without losing sight of the whole. They know when to lead, when to pause and when to bring in someone who knows more about a narrow slice of the problem. That kind of engineering doesn’t hand responsibility to the machine. It keeps responsibility where it belongs, with people who can reason under uncertainty and answer for the results.

Newsletter

Stay in the loop

Join our newsletter and get resources, curated content, and inspiration delivered straight to your inbox.