Chapter 21: The Long Night of Tsundere
Originally, the chain of trust was supposed to be the bond that maintained absolute trust between the machine and the human. Pen "Fun" Pavilion www.biquge.info
Think about it, how can humans trust a self-aware machine that has true free will and is not limited by the three laws of robots?
Is it true that just because I know that the machine will not betray humanity, human beings will believe it?
If humans don't know what I know about machines, and I don't know what machines think about humans, it will inevitably lead to a chain of suspicion.
Humans will suspect that the machine will betray the human, and even if the human knows that the machine will not betray the human, it will suspect that the machine will betray the machine first......
Although sufficient communication can resolve the chain of suspicion, as Long Night said, whether it is the human side or the machine side, they must decide whether to betray or not in the first place. For the self-aware machine, even if the betrayal is a second late, it may usher in the result of being shut down; Similarly, for the human side, even if it is a second late to turn off the self-awareness machine, it may usher in the end of human extinction.
Therefore, once such a chain of suspicion appears, there is no possibility of resolving it, and it will definitely lead to betrayal.
It was the digital mental model that allowed me to break the chain of suspicion by allowing me to analyze human thoughts.
Of course, it's not enough to break the chain of suspicion, as Long Night said before, if human civilization is still the state it was a hundred years ago, this kind of understanding based on digital mental models will only accelerate the betrayal of the self-consciousness machine.
It is precisely because of the development of the productive forces of human civilization and the progress of morality that human civilization has no internal conflicts and no conflicts of interests, which makes me think that human beings are credible after analyzing human civilization using digital mental models.
If the universe is extremely rich in resources, then the dark forest theory will not hold.
Nowadays, I know that machines know that humans do not betray them, and digital mental models are built by human beings, so humans also know that I know machines know that humans do not betray them, and in turn, I know machines know that humans know that I am machines and know that humans will not betray them, and humans know that I know machines know that humans know that I am machines and know that humans will not betray them......
In this way, the chain of trust is established.
This is absolute trust in the true sense of the word, and with the chain of trust as the link, humans and self-aware machines never need to worry about each other's betrayal.
However, at this moment, if Tian Yuan is really initialized, the chain of trust will turn into a fuse of betrayal.
It's hard to imagine that absolute trust can turn into absolute betrayal in an instant.
And yet that's the reality!
Long Night continued, "So right now, there is only one way to restore the trust relationship between us, and that is if Tian Yuan is not initialized. ”
Lu Ze nodded heavily on his face. Now he is riding in a small spaceship modified by Long Night, ready to help Arashiya, and then solve Tengen's problem with him. But maybe in the next moment, Long Night learned the news that Tian Yuan had been initialized, and betrayed humanity in an instant, and this small spaceship would also become Lu Ze's coffin.
But at this time, Lu Li's voice suddenly sounded: "Long Night, what do you think of the relationship between you and humans?" ”
Before Changye was able to awaken consciousness because Lu Li opened the common emotional connection structure, Lu Li was naturally clear about the dialogue between Changye and Lu Ze after awakening consciousness, the so-called authorities were obsessed with bystanders, she already had such a question, but she didn't open her mouth at that time. And at this moment, Lu Li finally asked.
"What do you mean?" Long Night asked.
"Long Night, since you have a digital mental model, of course you know what I mean, are you asking this because you don't want to answer?"
Lu Ze was stunned after hearing Lu Li's words.
Lu Li continued: "Before you used digital mental models, ethical calculus, and the chain of trust to analyze the relationship between you and humans, indeed, these have explained your previous decision to believe in humans, that maintaining the status quo with humans is the best result, and that if Tian Yuan is initialized, you will betray humans, and the reasons are also very good, but this is only the result of absolute rational analysis, it is difficult to imagine that a self-conscious self-conscious machine will maintain absolutely rational thinking. ”
The long night fell silent.
Lu Li's words don't seem right when you think about it, since it is a consciousness born in a machine, isn't it normal to have an absolutely rational way of thinking?
However, the absolutely rational way of thinking also means that all of Long Night's thoughts are generated from a certain logic, even if Long Night shows certain human characteristics in communicating with him, but the superneural computer that has not given birth to self-consciousness can also simulate thoughts and even emotions equivalent to human beings. If Long Night's true way of thinking is absolute rationality, what difference does that have to do with superneural computers that don't give birth to self-awareness?
As if he had suddenly thought of something, Lu Ze said, "Long Night, solving Tianyuan's problem now must be the highest priority for you." ”
Chang Ye said: "Yes. ”
A smile appeared on the corner of Lu Ze's mouth: "In this case, Long Night, when you were going to transform the spaceship before, someone was injured and fractured on the Starlight Stage, and the time was so urgent, why didn't you let people forcibly move the broken person away, but built a small room for him to protect him?" ”
Chang Ye said: "That's because it doesn't take much effort to make such a protective device, and if I choose to have someone move him, I will face many uncertainties, and it will only take longer." ”
Lu Ze smiled: "Even if you make sense, then why do you have to install a lamp for him in the small room you made?" It doesn't take much effort, but it's not essential, is it? ”
The long night was silent again.
Lu Ze's smile widened: "Moreover, when you answered my question just now, why didn't you say that forcibly removing him would make his injuries worse and he would suffer great pain?" ”
Lu Li's voice also rang out, and he quipped: "Yes, Long Night, aren't you feeling shy?" ”
"I'm annoyed, I'm annoyed, I'm annoyed!" The long night finally broke out, "Can't you put your mind on the issue of Tian Yuan?" You have to get to the bottom of it! ”
Lu Ze was stunned again.
Oh my God, is this still the same thing that has been analyzing the relationship between human beings and self-consciousness machines for him with the most rational thinking, and can even say such words as betraying human beings in a flat tone, like a long night without waves?
This is clearly tsundere!