Superintelligence

Superintelligence means a computer system that would be clearly superior to humans in thinking at almost everything. Not only at calculating or memorizing, but also at planning, researching, persuading, and inventing. Today's programs are far from that: they are strong in narrow domains, such as chess or formulating texts. Superintelligence, by contrast, would be better than the best human in all areas simultaneously. Importantly: no such system exists, and no one knows whether it will ever come into being. The term therefore describes a possibility, not an observation.

A point of contention between warners and optimists

The term matters because it ignites a major debate. One group of researchers considers superintelligence the most dangerous invention in history. Their argument: a system that is smarter than us could pursue goals we did not intend. We would then no longer be able to switch it off, because it would foresee such attempts.

The opposing side considers this science fiction that distracts from real problems. Today's systems invent false facts, reinforce prejudices, and are misused for fraud. Those who talk about distant doomsday scenarios, in this view, care too little about these concrete harms. Some critics also suspect marketing behind it: whoever claims to be working on a world-changing technology more easily attracts money and attention.

Nevertheless, the dispute has practical consequences. Laws such as the European Union's AI Act distinguish models according to their potential risk. Companies set up their own safety teams and publish rules about at which capability level they intend to withhold a model. The discussion about superintelligence is thus already influencing what gets built and released today.

The idea of the self-improving machine

The most common line of reasoning goes like this: at some point a system might become so good at programming and research that it improves itself. The improved version would in turn be better at improving. This accelerating cycle is often called an intelligence explosion. A program at human level would, in a short time, turn into something far more powerful.

Whether this really plays out that way is an open question. Intellectual work is only part of research: one also needs experiments, data, chips, and electricity. These things cannot be sped up indefinitely just through better thinking. That is why many experts consider a slow, stepwise development more likely than a sudden leap.

It is useful to distinguish the term from two neighboring concepts. Narrow AI solves a single task, such as recognizing faces. General artificial intelligence, or AGI for short, would be roughly as versatile as a human. Superintelligence is the level above that. A common misconception is that this is about consciousness or feelings. What is meant is only capability in solving tasks.

Superintelligence in headlines and company names

In the news, one encounters the term mainly in quotes from company executives. Major AI companies write in their self-descriptions that they aim to achieve safe superintelligence. There are startups that carry the word directly in their name, and corporations that name divisions after it. Such announcements move stock prices, even though they prove nothing technically.

A second place to find it is open letters and political declarations. Researchers and public figures repeatedly call for slowing down or monitoring the development of especially capable models. Governments are setting up safety institutes that examine new models before release.

For you as a reader, one question is therefore helpful: is this talking about something that exists, or about a goal? With superintelligence, almost always the latter is meant. Anyone reading the term in a press release should treat it as a promise, not as a product description.