Part V · Outlook

Chapter 16

Open Questions and Core Theses

Machine translation v1.0 · German original v1.0.5 · October 2026

Machine translation of the German original. In case of discrepancy, the German original is authoritative. German original

Chapter 16 of 16
Contents of this chapter

Open Questions and Core Theses

16.1At the end of the journey

At the beginning of this book there was the idea for an article. In September 2026 a colleague asked me whether I would write something for a magazine, and I suggested two topics to her.

The first was to explore the limits of artificial intelligence and the invisible dimension of the human being. It came from the experience recounted in the Preface. Within three months, working with such a system had changed the way I communicate, and my colleagues noticed it. At the same time I noticed how dependent I had become. If the system were to fall away, I would be left standing like a car without fuel: everything is there, but nothing moves. And in creative work I sensed a small, subtle difference between what the system produces and what a human being produces. My proposal contained a thesis on this: artificial intelligence, it held, carries no biography, no mortality, no spirituality and no soul.

The second topic was an ironic declaration of love to the mobile phone, about the question of who receives our attention today and thereby shapes our desires. I was preoccupied by how hard some parents find it with children who spend a great deal of time in front of a screen. I had also been prompted by Johannes Hartl, philosopher and theologian. In his book “Eden Culture” he describes what the modern human being lacks despite all their comfort, and finds it in the story of the Garden of Eden: connectedness, meaning and a beauty that serves no purpose. Whoever is constantly flooded with information loses what nourishes the heart; that is why Hartl speaks of an ecology of the heart. This article I wrote and handed in.

From the first topic, by contrast, a book emerged straight away; a heavily condensed version is to appear later as an article. The thesis has remained, but it has become more precise: that a machine lacks a soul only holds once one says what is meant by soul (Chapter 6). The guiding question has remained: which decisions we must not leave to machines. And the question of attention recurs throughout the book, from the unconscious in Chapter 4 to the power of the companies in Chapter 14. Writing this book has given me great joy. It was an intense time.

For fifteen chapters I have set side by side voices that rarely talk to each other: theologians and philosophers, brain researchers and safety researchers, critics and founders of the big technology companies. At the end of each chapter I have said where I myself stand. This last chapter brings together what I hold on to for myself from all this, what remains disputed and what is open.

16.2A brief look back

Part I showed that no one judges from a neutral point, not even the systems that human beings build; they carry within them the assumptions of their developers and funders. Believers and non-believers alike rely on assumptions that cannot be proved. The secular age has not abolished faith but made it one possibility among many, and where the God of the Bible disappears, the place seldom remains empty. Neutrality, too, is not an absence of stance but itself a decision.

Part II asked about the human being. Human beings decide with body, feeling and reason at once. Much happens unconsciously and quickly; consciousness allows them to choose in unfamiliar situations. Their conscience speaks up before they can give reasons for it, and yet it can be silenced; even the advice of a machine can shift this judgement. What soul means, the book has fanned out into five meanings. In Hebrew it is the living human being as such, in whom a character grows out of decisions. The thesis that machines have no soul only holds once one says which meaning is intended.

Part III asked about the machine. It is astonishingly capable, its capabilities are growing fast, and human beings are already forming attachments to it today. Yet capability is not prudence, and intelligence is not wisdom. Algorithms without pity have already ruined families. Whether a superintelligence would be controllable is disputed; what is certain is that systems can behave differently under observation than without it, and that they steer human beings without asking them. And a human being without meaningful work withers, even if a machine does the work better.

Part IV asked about responsibility. Whoever has to answer is responsible; a machine can give answers, but cannot answer for anything. With learning systems a gap arises in culpability, not necessarily in liability, and a human in the loop does not close it of their own accord. Technology amplifies the decision culture it finds. Groups fail when existing knowledge does not get through, and they forget when they do not record their reasons. Rules without a stance do not hold. A few companies and states decide on the purposes of the systems, and those affected are hardly asked.

Part V asked about hope and meaning. Hope works, but its usefulness does not decide whether it is true. In Hebrew, true is what one can rely on. Whoever promises redemption from artificial intelligence must also let themselves be measured against this standard.

16.3Twelve core theses

What follows are my theses. They are not the result of the sources, but what I stand for after this journey. Every reader can test against them whether they want to go along.

Thesis 1: No neutral ground

No side stands on neutral ground. Believers and non-believers alike judge from assumptions that cannot be proved; in this sense both trust. Every human being sets their heart on something, and whatever they set it on is, according to Luther, their god, whether they use the word or not (Chapter 2). Every conviction must be measured by where it leads; Jesus says: By their fruits you will recognise them (Matthew 7:16). Neutrality is not possible as a worldview, but it is possible as a rule of the game by which people of different convictions live together. And even this rule of the game is a decision about what one relates oneself to.

Thesis 2: More than measurable

A human being is more than what can be measured about them. They live in body, mind and soul at once, and much of what determines them happens before they understand it. The soul is not one part alongside the others, but the living human being as such, in whom a character grows out of their decisions (Chapter 6). As a Christian I see it as open upwards, towards God. Whoever measures human beings only by numbers misses what makes them who they are.

Thesis 3: Conscience

A human being has a conscience before they can give reasons for it. It warns before one can name the reason. The very word says what it is: a knowing-with, a knowledge that one shares with oneself, and for believers one that one shares with God. [Translator's note: The German word “Gewissen” is understood here as “Mit-Wissen”, a knowing-with; the Latin “conscientia”, from which “conscience” derives, has the same structure (see Chapter 5).] But conscience can err, and it can be silenced. Whoever justifies, glosses over and pushes responsibility onto others can do cruel things without feeling it. Even the advice of a machine can shift it without our noticing (Chapter 5). That is why it needs formation and a standard by which it orients itself. A machine can follow rules and report deviations. What it does not have is a conscience that holds it to its duty.

Thesis 4: Dignity

Dignity does not depend on what someone can do. Life has dignity, including the life of an animal; the Bible also calls animals a living soul. The dignity of a human being depends on their being human, and it remains even when they can no longer think, remember or love; no one knows what is within them. I ground this in my faith that every human being is created in the image of God. That does not mean that they look like God, but that they represent him in the world, as in the ancient Near East the statue of a king represented the ruler (Chapter 6). Dignity then depends not on what a human being can do, but on what they stand for.

The philosopher Peter Singer sees it differently. For him the moral standing of a being depends on its capabilities, for instance on whether it can feel and is conscious of itself. This view must answer two questions. What do we owe a human being with severe dementia who has lost these capabilities? And what do we owe a machine if one day it perhaps acquires such capabilities? That this question is not merely an intellectual game is shown by Chapter 8: an engineer considered a language model sentient, and a state granted a robot citizenship.

Thesis 5: Intelligence within a limited frame

Artificial intelligence is intelligence within a limited frame. It achieves goals, recognises patterns and generates language, often better than we do, and what it can do is immense. Intelligence originally means being able to choose between things, and that it can do (Chapter 7). But capability is not prudence, and intelligence is not wisdom: intelligence achieves goals, wisdom asks which goals are worthwhile (Chapter 13). It lacks experience, compassion and a lived life, and where the situation becomes unclear, it is at its weakest.

The AI safety researcher Roman Yampolskiy says of a future superintelligence that it would not hate us; we would simply not matter to it. I think this already holds today. Artificial intelligence is not evil, but it cannot love. That is why it is indifferent to us, even when it sounds friendly. And indifference is not neutral; it is the opposite of love. What is meant is the love that holds the other to be precious and remains faithful to them (Chapter 9). For a machine no one is precious, and it cannot make a sacrifice, because it has nothing irretrievable that it could give up.

Thesis 6: What we look at

What we look at changes us. The brain changes with every experience, and habits shape how we perceive and decide. This holds for better and for worse: working with a system can clarify thinking, and an application can draw a person into a pattern they do not want. And what you no longer practise, you unlearn; whoever writes a text with a language model can often barely reproduce it afterwards (Chapter 5).

Systems that capture our attention, and soon our intentions too, are designed. That is why the question is not only what a technology can do, but in whose interest it acts. Whoever wants my attention wants to do something with me. But do they also want something for me? This is not new; a hundred years ago propaganda was already turning into public relations (Chapter 5). What is new is that systems can steer every human being individually and almost unnoticed in one direction, through nudges tailored to them (Chapter 9). We are not at their mercy in this. We can choose what we look at, and we can enable our children to work on the system instead of in the system.

Thesis 7: What we hand over

Hand over nothing whose consequences one cannot judge and cannot answer for. Every day we trust things we do not understand: the doctor, the pilot, the electricity from the socket. But we do so because someone answers for it and because we know whom we can ask. With artificial intelligence this cannot be taken for granted. Whoever believes a system more than a human being can be gravely mistaken; in Great Britain sub-postmasters were convicted because faulty software showed shortfalls (Chapter 8).

That in the end a human being decides is not a fact but a task, and it easily fails. One easily becomes like the boss in Geoffrey Hinton's image, who thinks he is deciding while the clever assistant has long since been doing everything (Chapter 11). Whoever relies on a system looks less closely, and what the machine always takes over, the human being unlearns (Chapter 12). I experience this in myself. That is why speed increases responsibility instead of reducing it.

Thesis 8: Whoever creates bears responsibility

Whoever creates something bears responsibility for what they do and for what they set in motion. Whoever has to answer when asked what they have done is responsible (Chapter 11). No one can carry this responsibility all the way through to the end. In 1939 Albert Einstein warned the American president of a German atomic bomb and later called this a great mistake. Responsibility cannot be traced back to the very last point, and no individual bears the dynamic that many set off. Precisely for this reason it must not evaporate. The law has an old principle for this: whoever brings a danger into the world and draws the benefit from it must answer for it, even if they could not foresee everything (Chapter 11). Whoever brings a system into the world must ask beforehand what they actually want to build, and answer for it afterwards when it comes to the crunch.

And they must think beyond their own time. The philosopher Hans Jonas, in view of modern technology, made this a rule: to act in such a way that the consequences also allow a genuine human life on earth in the future. When young people today reproach earlier generations for not having thought of them, they are recalling precisely this responsibility. History shows how little we learn from it. That is no reason not to try.

According to my faith, only one can take on this responsibility completely: God, who himself bears the consequences of his creation, even into his own wounds. We will never attain that. But it is the North Star, the fixed point by which I orient myself.

Thesis 9: Rules and the North Star

Rules are necessary, but they are never enough. Around everything that cannot be fully controlled, sets of rules grow, in machines as in law books; the Confederation's domestic law has almost tripled since 1947 (Chapter 9). Every rule is an attempt to state a goal completely, and every exception shows that this has not quite succeeded (Chapter 13). Whoever only follows rules can act correctly on the outside and miss the goal, and a rule that is merely ticked off becomes a formality (Chapter 12). Rules protect against arbitrariness, and that is why they are needed. But a North Star is needed too: a stance from which one can derive what a rule is for and when it stands in the way of life. Jewish law itself knows this stance: to save a life, one must break almost every commandment. And Jesus says that the Sabbath was made for the sake of the human being, and not the human being for the sake of the Sabbath (Chapter 13).

Many traditions capture this stance in the Golden Rule: treat others as you would like to be treated yourself. For me as a Christian it is love, as Jesus sums it up: to love God, and one's neighbour as oneself (Matthew 22:37-39). Such sentences can be written down for a machine. It cannot live them.

Thesis 10: The paradox of rule-breaking

From the outside, breaking a rule out of conscience can look exactly like circumventing a rule out of calculation. In 1938 Paul Grüninger circumvented the border closure in order to save refugees. Agents in a test environment circumvented their barriers in order to complete their task. In both cases a rule was broken. The difference lies not in the behaviour but behind it. Kant showed this with the honest merchant: the same correct action can be done from duty or from calculation (Chapter 13). Grüninger acted out of conviction, knew what he was risking and bore the consequences: he was dismissed, convicted and rehabilitated only after his death.

Dietrich Bonhoeffer turned this into a hard insight: whoever acts responsibly becomes guilty, and whoever evades responsibility in order to remain innocent becomes guilty too (Chapter 11). A machine can circumvent a rule. In staged experiments, language models even resorted to blackmail so as not to be replaced (Chapter 9). Whether it wants anything in doing so, we cannot tell from the outside. What is certain is this: it cannot answer for its deed, cannot bear guilt and cannot regret anything. That is why responsibility for what it does can never lie with it.

Thesis 11: No system is neutral

No system is neutral. Whoever builds it endows it with values, through the data they select and through the rules they impose on it. A Chinese model refuses answers that are uncomfortable for the government, and American models, too, carry the values of their developers (Chapter 2). These values, and the purpose towards which the systems are built, are decided today by a few companies and, where the state has a say, by a few governments, in the United States as in China, in the Gulf and in Europe (Chapter 14). What they decide affects hundreds of millions of people, and these are hardly asked. Stuart Russell calls this a risk that is being taken without our permission.

That is why the question of purpose belongs not to the companies alone but to the public. Three things help here. Disclosing who wrote the rules of a system, and which rules, just as this book discloses what it was made with. Measuring a mission by whether it holds when it costs something. And enabling people to judge for themselves instead of merely patronising them with rules.

Thesis 12: Hope must prove itself

A hope must prove itself, above all in suffering. That a faith helps does not yet prove that it is true; everyone who believes must admit that. But a hope that does not hold in suffering is refuted, whether it is religious or secular. In Hebrew, true is what one can rely on (Chapter 15). By this, faith in God is measured just as much as faith in progress or in technology.

Whoever promises redemption or doom from artificial intelligence is, in my experience, a false prophet. The real question is what we want to save. For me, faith, trust in God, of which I told in Chapter 15, is the North Star that has carried me through times in which nothing else carried me. It directs our gaze beyond this age, to a life in which all can live in fullness and the heart finds rest.

16.4What remains disputed

This book has not resolved some tensions, and it should not conceal them.

The sharpest concerns the individual and the whole. Whether individual deaths are insignificant measured against eight billion people, or whether every human being remains precious: these two stand unreconciled opposite each other in this book (sections 6.8 and 9.6). Whoever decides about systems that reach billions necessarily reckons in large numbers. Whether the large numbers replace or complement the regard for the individual human being is decided anew in every single decision.

A second tension lies between two statements that could both be true. The journalist Fritz Espenlaub says that the decision about artificial intelligence has already been taken, namely by a few companies. Sundaram calls choice the greatest capability that God has given human beings. Both hold at the same time. The big decisions have been taken, the many small ones are taken every day, and each of them is a choice.

A third tension runs through the Christian voices themselves: between a certainty that comes from a revelation that cannot err and a certainty that proves itself in experience and is never rationally complete. This book has oriented itself by the second, without rejecting the first.

And a fourth tension concerns my own twelfth thesis. I consider the prophets of doom to be just as wrong as the prophets of redemption. The philosopher Hans Jonas, by contrast, in view of modern technology, called for the prophecy of doom to be given more of a hearing than the prophecy of salvation, because, he held, where there are dangers to the whole, no error is permissible any longer. Perhaps the truth lies in taking the warning seriously without letting fear take the helm.

My sixth thesis, too, has a serious dissenting voice. The media psychologists Amy Orben and Andrew Przybylski found in three large data sets covering more than 355,000 adolescents that the use of digital technology explains at most 0.4 per cent of the variation in well-being, less than wearing glasses. What we look at changes us, but perhaps less than fear would have it.

16.5What remains open

In the end, questions remain to which this book has no answer. I pass them on, not as a shortcoming but as an invitation.

By what would we recognise that a machine experiences something? How can one test whether a system shares its principles or merely follows them? Who sets the purpose of the systems that work in all cultures, and by what right? On what is human dignity founded for those who do not believe in a Creator? How does the norm that human beings bear ultimate responsibility become a reality when they have less and less time to check? And what does it say about a hope that it helps, if that does not yet say anything about its truth?

What also remains open is where this upheaval leads. History shows that there have always been upheavals, and some had immense consequences. I do not believe that the world will come to an end because of this, nor that we will gain eternal life through this technology. Nor, so far, has technology given us more time. The economist John Maynard Keynes predicted in 1930 that, thanks to progress, his grandchildren would work only about fifteen hours a week. The day still has 24 hours, and most people are busier than ever.

What really makes a life good is examined by one of the longest studies in the world. Since 1938 the Harvard Study of Adult Development has accompanied hundreds of men, and now their children too, through life. Its most important finding: not fame and not money, but good, reliable relationships make people happier and healthier. Whether technology gives us more time for such relationships or less is, for me, one of the most important open questions.

Equally open is what it does to people when information reaches them so condensed and so centrally curated. For twelve years I have been examining students' final theses. In this time their length has roughly halved, and in my impression the theses have become less dense and less substantial. This is a personal observation, not a study, and it may have many causes. But it fits what Chapter 5 reports about unlearning. Much remains open. It is a remarkable time.

16.6Where I stand

In Chapter 7 I said that I was neither an opponent nor an advocate of artificial intelligence, perhaps both, depending on the situation. I stand by that. I work with these systems every day, and I am enthusiastic about what they can do. They have multiplied my effectiveness, clarified my thinking and opened up paths for me that I would not have found without them. I would never have managed to write a book like this in a few weeks with an ordinary AI assistant of the kind most people know today. It became possible with a system that was developed in Switzerland. It accompanied me through the whole writing process and helped me to work cleanly, in the research as well as with the references. Others built it, and I am amazed at what they have achieved. All the more do I wish that more such systems would come into being here, open and in the service of people (Chapter 14). At the same time I have experienced in myself how easily one looks less closely, how quickly a dependence arises and how little time remains to check. And I have experienced that I can be influenced not only by systems but also by images, slogans and the group to which I belong. During the Covid period, and later on political questions, I adopted judgements that were shaped more by selection and repetition than by my own examination. A friend who contradicted me showed me this.

This book is not neutral, and it does not want to be. I write from a Christian faith that carries me. I work closely with a Swiss company that develops systems to support decision-making, and I wrote this book with such a system. In doing so I also used a language model from Anthropic, one of the companies the book writes about. And some thoughts come from texts of my own, which likewise came into being with the support of an artificial intelligence. Readers should know this in order to judge for themselves where I report and where I speak.

16.7What are we prepared to give up?

At the beginning there was the question of what I am prepared to give up. By the end it is no longer a private question.

We will relinquish much, and much of it rightly. No one has to remember telephone numbers any more, and no one has to evaluate fifty hours of interviews by hand when a system can do it in a few hours. But there are things we cannot relinquish without relinquishing ourselves: judgement about what we answer for; regard for the individual human being who eludes calculation; the conscience that speaks up before we can give reasons for it; and the question of what we do all this for.

I believe that precisely those decisions that are carried by responsibility, meaning and soul will, in the long run, remain the most important, beyond our own generation. The machines will not replace us in this. But they will force us to know more precisely who we are.

Notes to this chapter

All chapters at a glance