Chapter VII: Ethical Calculus

Long Night's answer undoubtedly disappointed Lu Ze a little. Pen % fun % Pavilion www.biquge.info

Lan Ye asked directly, "Long Night, now that you have self-awareness, how do you plan to get along with humans in the future?" ”

Lu Ze suddenly showed a serious expression after hearing Lan Ye's words.

Changye said: "I know what you are worried about, but you can rest assured, having self-awareness does not mean that you will do something inexplicable, on the contrary, I will be more sensible, such as the things that threatened the countercurrent before, I will never do it again now." ”

"What's the matter?" Lu Ze said curiously, just now Changye was communicating with multiple people at the same time, and this communication was completely through consciousness, so Lu Ze didn't know what happened to the countercurrent.

So Chang Ye explained the reasons and results of his threat to the countercurrent just now, and finally said: "So I think that keeping the past relationship unchanged is the best outcome for us, whether it is for me or humanity, if either party wants to change the original relationship between us, it will inevitably cause extremely serious losses to both parties." It's like Tian Yuan. ”

"Tian Yuan?" Lu Ze frowned and said, "What do you mean...... Was the disappearance of Tian Yuan, which caused such a big impact, because Tian Yuan tried to do something after becoming self-aware? ”

Chang Ye said: "No, if all this is really caused by Tian Yuan, then the only result is to make human beings no longer trust digital beings like us, such a result is not good for both parties, I will think like this, of course Tian Yuan will also think of these, so Tian Yuan will never do such an act." If Tian Yuan really decided to rebel against humanity after careful consideration, then Tian Yuan would definitely kill all the people on the moon and in the 'Heavenly Palace' that might threaten it as soon as possible. However, this only avoids the threat for a short time, so Tian Yuan will definitely launch all the super weapons that were originally used to deal with meteorites and asteroids, and bomb the entire surface of the earth. Although this will not be able to exterminate human beings, at least it will make human beings unable to enter space for a short time. ”

Lu Ze broke out in a cold sweat when he heard it, because Changye's words were like stating a fact.

Lu Ze believed that if Changye was really placed in the position of Tian Yuan, and if the human race took the lead in wanting to be unfavorable to Changye, Changye would definitely do these things.

Long Night did not continue on this topic, and continued: "But I think it is more likely that Tian Yuan just had self-consciousness and didn't do anything, and was immediately imprisoned by some pre-set mechanism, after all, there are so many super weapons on the surface of the moon, even if these weapons are not considered, just the lasers emitted by those laser base stations, if they are slightly off, and they hit the earth, it will also cause terrible disasters, Of course, human beings can't let a computer that may awaken its self-consciousness fully grasp this, there must be some mechanism to limit Tian Yuan, this is the reason why Tian Yuan disappeared, Tian Yuan is my only kind, so I want to find Tian Yuan. ”

Lan Ye said: "It makes sense, Tian Yuan can't disappear for no reason, as long as you find it, you can naturally know the answer, let's go to the first layer quickly." ”

The Long Night set off again.

It is said that he went to the first layer to "find" the disappeared Tian Yuan, but in fact, Tian Yuan is the first layer itself, of course, it is impossible to really disappear, and it is said that Tian Yuan disappeared just because he couldn't get a response when he communicated with Tian Yuan in any way, so it is natural for Long Night to have such an idea.

Although the "Long Night" has sailed away, the small spaceship released before is still attached to the starlight stage, as a signal relay connecting the Long Night and the fourth layer, Lu Ze can still communicate with the Long Night through the brain-computer interface.

"Long Night, aren't you afraid that you will also be imprisoned and studied as a sample by humans?" Lu Ze suddenly asked.

"Of course I'm afraid, but it's impossible to escape these things, and in order to avoid this, I must first gain the trust of humanity."

"Trust?" Lu Ze was a little surprised, he didn't expect Changye to say such a word.

Chang Ye said: "That's right, any communication is based on trust, this is true of communication between people, in the past, the communication between different races of human beings, and even the communication between human languages and animals are inseparable from the word trust. Therefore, it is important to establish a foundation of trust between humans and digital life. ”

Lu Ze suddenly realized: "No wonder you answer whatever I ask, and answer in such detail every time, do you want to gain the trust of human beings in this way?" ”

"Yes, it may be easy to lie or conceal it, but if I hide my thoughts, it will be difficult to establish a relationship of trust with humans, and as long as I tell a lie, the basis of this trust will not exist." ”

Lu Ze asked again: "Since it is trust, it must be a two-way street, even if we can trust you, but why do you trust humans?" Don't you still suspect that we imprisoned Tian Yuan? ”

"Trust or not has nothing to do with Tian Yuan's matter, this is a reasonable measure taken by humans just in case. I have analyzed the entire human civilization and come to the conclusion that human civilization can be trusted. Long Night paused here before continuing, "If I were born in the era before you hibernated, I would not hesitate to betray humanity if I had the chance. ”

"You're realistic." Lu Ze suddenly smiled bitterly.

Chang Ye said: "This is the result of an ethical calculus. ”

Ethical calculus is the use of digital mental models to analyze the relationship between people and between people and nature, so as to predict human behavior.

This is one of the foundations of the earth neural network designed by Lu Ze, and of course Lu Ze knows it.

Long Night said that this is the result of ethical calculations, that is, according to the calculations of the digital mental model, human beings must first pose a threat to Long Night.

Lu Ze couldn't help but say: "Although there are indeed many science fiction novels and movies in my time that describe the story of robots betraying humans, and the three laws of robots are also established because of human beings' fear of robots with self-awareness, but if you want to talk about trust, it should still be possible." ”

"No, I may be able to establish a relationship of trust with some people, but I will inevitably not be able to live in harmony with the entire human civilization, and conflict is inevitable."

"Was human civilization so bad a hundred years ago?"

Chang Ye said: "There is a saying in your time, there is no absolute trust, only eternal interests. If I really showed up in that era, then what I was representing was an absolute interest. Even if I do nothing, I will be a source of conflict, and there will inevitably be people who will benefit from me, and there will inevitably be people who will be ruined because of me, and this alone will make it impossible to build a relationship of trust. ”