Idea

A tool that gives access to technical power does not hand over the culture that makes it safe

Info

Originally written in French. Translated by AI — the meaning has been preserved, not the prose.

Main idea

No-code has already played this scene. People with no technical training put complete sites online in a few days, concluded they no longer needed developers, then discovered that a site with no protection against brute-force attacks, no circuit breaker and no access management becomes a problem very quickly. The tool was not bad: it gave a capability without giving what lets you know where that capability turns dangerous.

A code assistant reproduces the same dissociation, at a higher power. It supplies screens, APIs, data changes, and it supplies neither a security culture, nor a sense of architecture, nor knowledge of the ways a system collapses. Those things are acquired by having watched systems break, and nothing in the tool passes them on through use.

The illusion of competence is born exactly there: in the gap between what you manage to produce and what you are able to evaluate. The better the tool, the wider that gap, because what comes out is plausible.

Why it matters

It offers a reading of failures that blames neither the tool nor the user. Banning the tool removes the capability, blaming the user passes nothing on: what is missing is a culture, and it has to come from elsewhere — from the framework set by those who have it, from automatic checks, from support at the start.

It also supplies a precedent you can use in discussion. No-code is not a distant analogy: it is the same mechanism, already observed, with its consequences documented.

Nuances and limits

The gap is not equally dangerous everywhere. On an isolated, throwaway tool, producing without knowing how to evaluate costs little; on an exposed system or one connected to real data, the gap becomes the main risk.

And the missing culture is not indivisible: someone can have a sense of architecture without a security culture, or the other way round. The illusion then lodges in the part they do not know they do not know.

Open questions

  • Can an assistant pass on part of this culture by explaining its own choices, or does an explanation received without having lived through the failure stay inoperative?