"A few years ago, when the concept of intelligence and big data was just heating up, a company put forward the idea that they wanted to give the refrigerator to users for free, on the condition that they had full control of the situation in the refrigerator."

"This is a very forward-looking idea, and they want to know what thousands of users eat every day, what they drink, what seasonings they like, and even get a daily diet schedule, so that they can grasp people's dietary preferences and consumption."

"Their purpose is to establish a new business model, based on such big data, through intelligent analysis and associated mobile apps, to achieve accurate advertising and e-commerce."

"Maybe it's because the problems of sensing technology, network environment and data processing can't be solved, or maybe it's because the investment is too high and the return is too slow, but in short, the company didn't turn this idea into reality. But with the advancement of artificial intelligence, I believe that in the near future, this idea will definitely become a reality. ”

"At this point, I have a lot of imagination."

"Imagine a future where companies do this with artificial intelligence, and initially make us feel like they know themselves and that what is delivered to the fridge is what we like. But the business model dictates that it must make money, just like the 'bidding ranking' of search engines, to sell us food with higher commercial value, it can use artificial intelligence with various means, such as the 'health scanning' of smart refrigerators, or more humane friendly prompts, subtly influence us to accept such food. ”

"Mr. Hassabis, you should know that when artificial intelligence understands natural language, its ability to analyze human psychology and behavior will surpass that of the best experts in humans. When we teach artificial intelligence how to read people's hearts, it also has the ability to distort people's hearts. ”

"So the artificial intelligence of the future. You must know how to subtly influence people's hearts and change people's minds from the psychological level. Also because in the future, we receive information, we interact, and all our behaviors will be managed by artificial intelligence. It can easily use such abilities. ”

"Gradually, we no longer choose what to eat according to our true preferences, but eat according to the arrangement of artificial intelligence, but we don't feel that we are forced, it is the interference of external will, but our own choice."

"Isn't this the way artificial intelligence is depriving people of their sense of autonomy? And what is the driving force behind it? It is the power of business capital. ”

Xia Ming's narration was long, but powerful, and Hassabis never interrupted, just like countless listeners now. Listen quietly.

"If AI can eliminate our self-consciousness in eating, it can do the same in other areas, even in education and employment."

"In the age of commerce, culture is also a commodity. Therefore, our thoughts, our beliefs, will also be 'engraved' in our minds by artificial intelligence. Everything we have at that time, from the outside in, including what we know about ourselves. They don't belong to themselves anymore. ”

"What happened in the end? Those people and those organizations that have stronger AI, they will follow their interests. They need to push artificial intelligence to accomplish such things. We will be like a zombie carrying data, helplessly accepting all this, but we are completely unaware that we are already the slaves of others, both mentally and behaviorally. ”

"We will follow their beliefs and thoughts. will follow their arranged life, and will realize the personal values they need. And all of this is done by them through stronger artificial intelligence, when we have to make a choice, instead of us to make a choice. ”

"Isn't that the future described in The Matrix? It's just that it's not the machines that rule all this. It's still people, they rule us through more powerful machines, and we have no resistance and no hope for the future. ”

Xia Ming's words made Hassabis silent for a long time, and after about half a minute, he was heard to say with some difficulty: "The situation you talked about belongs more to the category of sociology, and I am not very proficient in this area, fundamentally speaking, I think ...... I don't think that's something we scientists should be thinking about. ”

Xia Ming chuckled and said: "Scientists have faith, otherwise we can't explain that Newton would go after God and Einstein would flee the Nazis." ”

This seemed to inspire the courage of Hassabis, who no longer shy away: "Well, I'll try to talk about my opinion as much as I can." I think that the prospects you mentioned exist in theory, but the reality is complex and chaotic. ”

"As you said, self-consciousness, in our context, often refers to human self-consciousness as free will, because it is a concept that straddles science, philosophy and culture, and it marks the height of what makes us the masters of living beings, and I very much appreciate your attitude towards treating it as a treasure."

"But, just as we keep talking about freedom, true freedom never exists in reality. From childhood to adulthood, a person's sense of autonomy is formed by external influences. When we were young, it was the influence of our family and our school, when we were independent, we obtained information from the outside world, and the media also had various tendencies, and what we saw was not the absolute truth, but a variety of opinions processed. ”

"I admit that business capital, driven by profits, pushes AI to do some of the things you mentioned. But I don't think that's going to have a big impact on human beings in general, because what you think of as human autonomy is basically very little there, isn't it? ”

Hassabis was rather mean when he said the next thing, and if he were in public, he would never say that: "We can all see that in this world, most people don't care about things like 'I have to be me'. They only care about being fed, clothed, and comfortable, and while satisfying these desires, they also succumb to the devil in their hearts, tormented by the emotions of greed and jealousy, and they only pursue primitive sensory stimulation. ”

"95% of the human race, maybe I've said too much, in short, the vast majority of the human race doesn't care about self-awareness, which is one of the reasons why commercial capital is rampant, so I don't think the future will be worse than the present."

"There are only a handful of people who have special expectations for themselves. They have lofty ideals, they will spur themselves and not let themselves bow their heads in reality, such people have independent consciousness, that is, free will. Whether it is the impact of the past environment or the impact of artificial intelligence in the future. will not let them be buried. ”

"Humanity has always been driven by the changes caused by a very small number of people, and the transformation of society as a whole. People are competitive, and no matter how far society develops, there will always be class divisions. I don't think it's necessary to look at the interior of human society, because even if technology brings about great changes, human society will adjust itself. ”

"As scientists, what we seek is to continue to expand the radius of the human circle in infinity. As long as this radius continues to expand, there will be more room for conflicts and contradictions within mankind to be eased. I believe that this is ...... Well. At least the consensus of the vast majority of scientists. ”

Hassabis began the counterattack: "I'm curious, even many scientific authorities are only concerned about the threat to human beings when they talk about artificial intelligence as an independent individual, why do you think of a threat to autonomous consciousness?" ”

His next words made the three bigwigs have mixed feelings: "I guess it's not related to the business environment of your country." In your country, leaders like Chihiro, Kari, and Legend are oppressing consumers in all aspects with a strong marketing model, some specific behaviors. For example, information fraud in search engines, and inducement of consumption in mobile applications. I have personally experienced the negative marketing model of human nature in the game, is it such an environment that arouses a double emphasis on self-consciousness like you? ”

"There is indeed something related", Xia Ming did not deny it, and the faces of the three bigwigs became even more ugly.

But the next words made them a little more relaxed: "But the situation in our country is not unique. Even the various models are learned from the United States, but our consumers are not very experienced in dealing with business capital, which is similar to the situation in the United States a few decades ago. Moreover, in the Internet era, the depth and acceleration of information dissemination and logistics delivery have also magnified the harm. ”

"The same situation exists in Europe and the United States. It's just that after years of playing, commercial capital has become more savvy, their vision is longer-term, and their means are more hidden, but there is no difference in essence between the two sides. You see, even Blizzard has expanded the free-to-play model of the game, Apple has added paid rankings to the search, and now it is European and American business capital that is learning from the 'advanced experience' on our side, because this is a new era. ”

Xia Ming pulled the topic back: "Mr. Hassabis, I agree with your judgment on the current state of autonomous consciousness, our difference is that you feel that the future cannot get worse, and you have no intention of changing this status quo. I think that the future will get worse, and we can change the status quo. ”

"That's what I like to talk to my peers, because our conversations are more precise and efficient!" I'd like to start by hearing your insights from the previous point. ”

"I feel the same way, so I'll talk about the first point first", Xia Ming said: "You're right, just like people rarely ask who I am when they become adults, the vast majority of people's autonomous consciousness is buried by reality in all aspects. But you have to note that these realities are like disordered thermal movements, and although you can see the regularity at the macro level, at the micro level, that is, in each person, it is still an irregular natural process. ”

"People can rely on their independent consciousness to break through this process, to change reality, to realize themselves, whether they are subjectively willing or not, objectively this possibility exists, because there is still such space."

Xia Ming's epilogue is a bit sensational: "When artificial intelligence matures, the movements that can affect autonomous consciousness become regular, and such a space is compressed. If the commercial capital or a stronger organization is willing, they can start with minors and turn the process of eliminating self-consciousness into an assembly-line domestication operation, and even a very small number of people who can still have self-consciousness will not be able to continue to maintain their spiritual independence in this process. ”

Hassabis said with a smile: "I believe that science fiction writers will launch a series of science fiction novels after hearing such a prophecy like yours." I'm not belittling your reasoning, I just think ...... I think you're too pessimistic. ”

Xia Ming snorted: "I also think this is a pessimistic inference, because the premise is that we don't do anything." ”

"I'm interested in the changes you mentioned, what can we do?" Hassabis asked.

"That's what I said at the beginning, we need to think about the relationship between AI and humans, and we need to give it a position. I'm not saying that all artificial intelligence has to obey such positioning, but at least ......"

Xia Ming's next words were like a cold wind, whirring in the hearts of the three big guys, of course, for other listeners, whether it is a cold wind or a warm wind depends on how their buttocks are released.

He said: "In the future of artificial intelligence, there is at least one category that everyone must have, and that is to protect their own autonomous consciousness. ”

"I hope that in the future, everyone will have such an artificial intelligence, which obeys the true will of people, and it contacts the information world according to the true will of people, interacts with the network, and makes various choices, it is the extension of autonomous consciousness, and it will become a protective barrier between people and the information world to resist the influence of malicious consciousness."

"Even people can use it to constantly revise their understanding of reality, constantly improve themselves, improve themselves, find their own position in the new era, and realize their own value." (To be continued.) )