3

"Because of the difference between distant and close relatives, the same thing is said by different people, and different people say the same thing to the same person, and the reactions are likely to be diametrically opposed, which is the biggest difference between people and computers. Inefficient, disorderly, but lovable, unreasonable but full of humanity. ”

4

Although it was a moment, but in the eyes of Zhong Li and Zhong Min, it was a long time, Gu Yu suddenly grinned and said: "It turns out that I just want to understand what I think, this is easy to do, I'll just say it again." ”

Although she replied simply, Zhong Min, who was sitting on her side, saw her left hand on the sofa constantly tapping the leather surface of the sofa with her index finger like a beat, which lasted for six or seven seconds.

"I won't say more about what I said to Zhong Li before, I guess he is similar to you, I'll just say my personal opinion." Gu Yu paused and continued: "If there is a reason for Ling Zun to give up the human nature system and put it into use, I think it should be that this system is more or less a threat to the safety of human beings. ”

"Can a system threaten human security? I listened to what Zhong Li said, which should mainly involve human social and ethical issues, right? ”

"Although how to define humanized AI is a social and ethical issue, if it is as simple as that, in fact, as long as the legislation follows up, the problem can be solved. I will also stand on the same side as you, and I will not choke on food because of this problem, after all, the creation of artificial intelligence that is the same as the human is a great progress in the history of human development. ”

"So what do you mean is this unsolvable problem?"

"Even if we can pass legislation to put humanized artificial intelligence on the same footing with human beings, we can accept it, but can artificial intelligence accept it?"

Gu Yu threw the question out, and when he saw that none of the three of them spoke, he explained: "At present, artificial intelligence serves human beings, and if it belongs to the oppressed and exploited party in terms of production relations, of course, because they do not have this consciousness, they will not resist. If one day the human system is passed on to the present world, the artificial intelligence with human nature will soon realize the unfairness, and the human beings will be able to complete the equal legislation before they start to rebel, and there is no guarantee that they will not hold a grudge. What's more, artificial intelligence is not human, and the equality we give is what they are looking for? Perhaps human beings will become garbage or obstacles in their eyes. ”

Gu Yu could see from the thoughtful expressions and empty eyes of the three of them that they hadn't thought carefully about how artificial intelligence would think about this problem before, not only the three of them, but the things that humans had invented in the past thousands of years were dead things that couldn't think. When something more flexible than a human being is invented, there are not many people who are accustomed to putting themselves in each other's shoes and thinking, "What is this thing that created me?"

"At the end of the day, we're not artificial intelligence, and empathy is hypothetical. Although these eight words have not appeared in our language for a long time, they happen to be applicable to the current situation. ”

"Are you really so pessimistic?" Zhong Li obviously wanted to help Yuan Xian, who was in a disadvantaged situation, to say a few words, "I have a good relationship with my family, Yuandun'er, which is a housework robot made by myself." If you have the right way to get along, it won't be that serious, right? ”

"But who can be sure?" Gu Yu sneered and picked up the wine glass, causing the half-melted ice to make a crashing sound. "What's more, your round pieces are all programs set by yourself, and there is no humanity, even if there is, it is an exception. Think about it, when the Wuhu rebellion in China, how the Hu and Han fought each other, and what the Spaniards did to the Maya and Aztecs during the Age of Discovery, as well as the slave trade, are all examples, and there will be individual examples of friendly relations at that time, but they can't cover up the whole. And even if human beings are divided into races, after all, they are all human beings, and they can intermarry and reproduce, and they also have similar demands. As a result, with the progress of civilization, the races were slowly able to come together. But there are too many differences between people and artificial intelligence at this point. ”

Seeing that her brother was defeated, Zhong Min, who had been observing Gu Yu's color on the side, also took advantage of her calm mind and plucked up her courage to say: "Miss Gu Yu, I heard that this system relies on artificial intelligence to observe and learn human behavior, as well as get along with people, and then imitate and learn to master human nature. If we guide it in the process of learning, will we be able to avoid the situation of artificial intelligence hating humans? ”

"How can this be guided, Second Miss?" Gu Yu's second miss called Zhong Min uneasy, but fortunately, she just called her "Miss Gu Yu" back and forth with a half-honorific title and half joking. "If you look closely, you will know that this system is based on the results of countless players, as well as the interaction between countless artificial intelligence and players, and if one generation of artificial intelligence is not enough, there will be the next generation, and we can't let humans accompany them to do this kind of brainwashing-like work, right? The humanity derived from such a system should not deviate from our own humanity. It just so happens that people are the kind of things that no matter how kind they are, they won't have so many social problems, and if they are evil, they won't live to the present thing. Can you expect any improvements from this system? ”

After listening to Gu Yu's explanation, Yuan Xian's eyes were as dim as a extinguished charcoal fire for a while. She realized that even if there was a solution to the problem at the moment, it would not be something that a few people like them who had no knowledge of the problem could come up with.

Zhong Li saw the change in Yuan Xian's expression, from nervousness and even some hostility at the beginning, to now with a sense of loss in his mood. He knew that Yuan Xian had watched his father work hard for this game day by day since he was a child, and once upon a time Yuan Qizhi's ideal had also turned into her ideal. If there is anyone in this world who wants to see what this game will look like when it is finally completed, then in addition to Yuan Qizhi, she must be the second.

"Is there really only one solution to abandon the development of a human system?" In this sentence, Zhong Li is not only asking for Yuan Xian, but also for all the players of this game.

"Perhaps, but anything dangerous will really eliminate the threat if it doesn't exist in the first place." Gu Yu saw the thoughts of the two of them, so he continued: "I know that it is a very cruel thing to make people give up something similar to an ideal based on just a few words and some reasonable speculations. However, the existence and development of human beings is itself accompanied by the sacrifice of the interests of many people. ”

Although the "tram problem" is a classic ethical paradox, it is true that every time it is time to make a choice, human beings do not hesitate to pull down the lever that drives to a person.

5

"I probably know." Yuan Xian's calmness seemed to indicate that she had accepted the "human choice", but she immediately asked a new question calmly and seriously: "I can not ask who you work for, but think clearly about how you know these situations." ”

"You can ask her about this, we are not much closer." Gu Yu looked at Zhong Min and smiled.

Zhong Li knew that Yuan Xian didn't know much about the inside story, so he interjected and explained: "You are also an intelligence dealer. ”

"Sort of."

"Shouldn't you just be in charge of the informants?"

"Isn't she involved in a lot of things? Otherwise, who is raising so many orphans in the lower city? ”

What she did was said by this person who could be said to be a senior, Zhong Min didn't know whether she was resistant or excited, and a strange feeling in her heart made her open her mouth. "In other words, Miss Gu Yu did this kind of thing out of her ability?"

"Even if it's beyond our reach." Gu Yu looked at Zhong Li and omitted the second half of the sentence. "Any more questions?"

Yuan Qian thought about it for a while, although she was still not very relieved, it was not that she couldn't believe it, but that Gu Yu did have too many inscrutable places, and the calm and unhurried state when she talked to everyone also made her feel as if she couldn't catch this person. Or maybe it was because when she saw Gu Yu for the first time, she was sitting next to Zhong Li's corpse, singing the words she had written, and not long ago she sent Zhong Li away with her own hands, which left a bad impression on Yuan Xian subconsciously. However, at the moment, apart from what Gu Yu himself didn't want to say, there was nothing that was related to this matter and had to be asked at the same time.

"That's all I can think of. If it's just to see my dad, I can take you to meet him. But what happens depends entirely on what he thinks. Yuan Qian added: "Although I don't have as much reason as you, I know that this game has poured all his efforts in, and if you count it according to the time he actually experienced, the time he spent on this game is enough for a normal person's life." So even if it really causes so much trouble, and even threatens humanity, as long as he wants to persevere, I will still stand by his side. I hope you understood at the beginning. ”

"I understand. That's enough. Gu Yu retracted the sparkle in her eyes and replied in a tone that was sincere to her, "Then this matter can be said in this way." ”

"Well, that's it."

After saying this, Zhong Li saw that his sister was obviously relieved, so he pushed things down. "Then when are you going to see him, he is over there to solve Yingyue's affairs."

"Although I'm not in such a hurry, if it's convenient, let's go over there and talk to the old man as soon as possible, after all, I can know that it's a thing, and it can't be considered a secret to those who have a heart."

"Then wait until she returns to X City, and you can rest quiet for now."

Gu Yu thought for a moment, and said that when Yuan Xian went home, it seemed that it would take a week, although it was not a long time for him, but for him, it would take a month and a half. "Okay, then I won't disturb the time you two spend together. At that time, Yingyue's affairs should be handled similarly, and it is appropriate to discuss it in detail. ”

Zhong Min saw that Gu Yu was somewhat dissatisfied, so he said, "Actually, if Miss Gu Yu is in a hurry, I can borrow a few stealth warehouses from Xiacheng District." Then when you get there, let Sister Yuan Xian write you a paperwork, and you should be able to solve the rest of the things yourself. ”

"That's a good idea." Gu Yu smiled approvingly. "It's convenient for you to do what to do."

Gu Yu threw his gaze at Zhong Li, but Zhong Li deliberately avoided his gaze and waited for Yuan Xian to answer.

"I don't want to procrastinate, now that I've said it, let's do it quickly." Yuan Xian replied. "Shall we go now, then?"

"It's fine." After Gu Yu finished speaking, he drank the rest of the Long Island iced tea.

Notes at the end of the article:

The "Tram Problem" is one of the most well-known thought experiments in the field of ethics, and it basically follows: a madman ties five innocent people to the tram tracks. An out-of-control tram was coming towards them and was about to run over them in a few moments. Luckily, you can pull a lever and let the tram go to another track. But there's another problem, that madman also tied up a person on that other track. Considering the above situation, should you pull the lever?

The tram puzzle was first proposed by the philosopher Philippa Foot to critique the major theories in ethical philosophy, especially utilitarianism. Utilitarianism presents the idea that most moral decisions are made based on the principle of "providing the greatest benefit to the greatest number of people." From a utilitarian point of view, the obvious choice should be to pull the lever and save five people and kill only one. But critics of utilitarianism argue that once the lever is pulled, you become complicit in immoral behavior – you are partly responsible for the death of a single person on the other track. Others, however, believe that being in such a situation requires you to do something, and that your inaction will be equally immoral. In conclusion, there is no such thing as perfect ethical behavior, and that's the point. Many philosophers have used the train puzzle as an example to show that real-life situations often force a person to violate his own moral code, and that there are also cases where there is no perfect moral practice.