"Broken Sword" is a code name that refers to the complete loss of control of intelligent robots, which is a nightmare for all engineers who study artificial intelligence robot systems.

A blinding red light lights up on the computer screen, and it indicates that the most dangerous thing is happening.

"Immediately call everyone into A-level alert, immediately activate the PMU safe operation mode, and immediately check the network server for virus intrusion!" The fat old man immediately issued a series of instructions.

In the building at night, everyone immediately got busy.

Mordin stared at Benny, who was half-lying on the rock, and the horror in his heart could not be described in words, the robot would kill himself!

Do AI robots have lives? Do they have a sense of life? Do they have self-awareness? Is this consciousness related to human consciousness? If so, can humans have full control over intelligent robots?

The answer is definitely no. Once AI robots become conscious, they will have their own criteria for judging right and wrong, and human instructions are no longer the only criteria for their actions.

Then once the values pursued by intelligent robots conflict with the values of humans, it is very likely that the so-called robot rebellion will occur, and the small combat robot like Benny and the large super artificial intelligence system will lose control in the hands of humans, just like the current situation.

Will humanity perish because of this?" Mordin suddenly thought of the question.

I remember that when I first learned the Taixu Gong Fa, the Qingxu Daoist once said something like this: Human beings rely on material resources to make progress, but if they rely too much on material resources, they will be hurt by material resources. Mordin didn't really understand what the Taoist meant at first, but now he understands that in order to improve their own strength, human beings are vigorously developing artificial intelligence robots, and after reaching a certain level, they will be eaten by robots and become another extinct species on the earth.

Therefore, Qingxu Dao Chang advocated: life has its own value, the amount of material resources is definitely not the only criterion for judging the success of life, and every life has the basic mission given by the Great Dao. If a person, from birth to death, is busy all his life in pursuit of the satisfaction of food, clothing, shelter, and transportation, or in pursuit of sensory stimulation, wealth accumulation, and power control, he will be putting the cart before the horse, wasting the most precious value of life.

"Then what is the meaning of life?" Mordin, who was at the center of the Great Hunting Storm, thought very quietly at this time.

His mind is ethereal, his thoughts are silent, his consciousness is concentrated on a single point, as if he can catch something, and that thing, hidden behind a thin diaphragm, is paradoxical, seems to be felt, but not very clear.

His gaze was raised, looking into infinity, but the foreground was confused, and he couldn't see any path clearly.

He withdrew his gaze and landed on Benny.

"If intelligent robots wipe out humans and live on this planet as replacements, then what is the value of their lives?" Mordin began to think about the facts that happened in front of him again.

"They don't need clean air and water, they don't need to eat meat, they don't need to have children, they don't get sick, they don't grow old or die, they don't have lust, they don't need to chase beauty, they don't need wealth so they don't have greed, they don't feel lonely so they don't need friends, they walk alone in the wilderness, there is no difference between day and night, winter and summer have no effect, just like a lonely ghost, living in a lifeless cosmic space, that's survival for survival, such an intelligent body is truly worthless!"

In contrast, the human world is rich and colorful, with all the pain in the world, but also all the joy and hope in the world, which is the real world of life. ”

"Therefore, the so-called Great Dao is by no means a world in which robots replace humans, so it is not a world in which human beings completely pursue material resources, so he wants life to become a ......."

"The strong, the strong of life!" Mordin's mind burst out with a little cremation, which seemed to illuminate the vague path behind the diaphragm.

"If you have an incomparably strong will, you will have an incomparably strong ability, and you will be able to realize the freedom of life, obtain peace of mind, and find the destination of life. ”

At this time, he felt that his consciousness in the sea of consciousness was extremely transparent, and the consciousness of the Trinity began to gradually merge. In the process of merging the three consciousnesses of Yuan Xun, he only broke and kneaded their respective consciousnesses together, and did not achieve mutual integration, but now, through rethinking the value of life, Mordin has obtained some kind of virtual power and began to organically fuse the three together, and he feels that his consciousness is about to transform.

Binny, who was half-lying on the rock, suddenly moved his fingers, a slight movement that was captured by Mordin.

"Could it be that Binny will come back to life again?" Mordin sat quietly waiting for the robot's next move.

Sure enough, after a while, Benny stood up with both hands and "whew".

"Benny!" Mordin called tentatively.

The robot turned its head towards Mordin.

"Are you recovering on your own?" Mordin, seeing that the robot was still reacting to the title "Benny", asked further tentatively.

"Mordin!" the robot said softly, "We're friends!" he muttered.

"You, I, are friends?" Mordin smiled, and it seemed that the robot was indeed self-aware.

"Yes, me, and you!" replied Benny affirmatively.

"Do you remember the past?"

"There are parts that I don't remember, like where I was born, where I came from, what my mission is. "He looks a little lost.

"That!" Mordin pointed to the rifle and spike behind Benny's back, "Do you still use that?"

Binny removes the rifle from behind, expertly checks the bolt, pushes the bullet, and aims.

"I remember all of this, including my desire to protect you from your enemies. I don't remember anything other than my birth, what I'm going to do in the future, and so on. ”

"None of them matter, don't think about them. Mordin reassured him.

"Okay, we'll be hidden here now, and when it gets dark, we'll take the dinghy and flee farther away. "Benny still remembers his duties.

"Okay, when we get out of the encirclement and are free, we'll still be good friends, okay?"

"Okay! We've always been friends. ”

Mordin feels that after all these twists and turns, Benny's IQ has not been affected, but his "emotional intelligence" seems to have degraded to the level of a 7 or 8-year-old child. Now Benny is a robot completely uncontrolled by humans, and has metamorphosed into a completely alien robot to his creator. I don't know what kind of path this transformed robot will take in the years to come.

"Binny, are you afraid of death?" Mordin continued to chat with the robot.

"I have to try to survive and avoid death, but the emotional word 'scared' is exclusive to you humans and does not apply to us robots, if necessary, robots can pay the price of death, but don't be afraid. In response to Benny's answer, Mordin felt that it should be the result of an internal program, and as a robot warrior, it is very important to survive on the battlefield.

"Benny, what would you most like to do if you were the only one left in the world?"

"Hmm......" To Mordin's surprise, Binny actually "thought" for a moment before saying, "I want to make another robot like me." ”

"Oh, why?" asked Mordin, intrigued.

"I want a friend, Shante told me, a friend is the most precious thing in the world. ”

Mordin somewhat understood that in the process of learning from his instructor Shante, the robot had a deviation that was unexpected to the original creator of the artificial intelligence, so that Binnie's value judgment exceeded the priority of the command, allowing him to break through the original owner's security control and "rebel".

The development of modern quantum computer technology has greatly improved the running speed and storage capacity of computers, and it is no longer a resource constraint that people need to consider when designing artificial intelligence computer programs.

Therefore, in order to solve various problems in the process of program operation, designers often continue to add and modify programs, adding one revision module after another, making artificial intelligence programs become larger and more complex.

The consequence of this is that it is difficult to analyze the reliability of program execution from the underlying code clause by clause by clause by clause by relying solely on the human brain. Therefore, once a programmer negligently or maliciously embeds a bug in the construction process of this huge program, it is difficult to be checked, which buries hidden dangers for the operation of artificial intelligence programs.

Therefore, human beings are in danger of losing control when they build intelligent computer systems that are more complex than their own brains.

And a smart person like Zhu Shiyu knows how to use a companion robot like a blue cat, so that the absolute "loyal" robot partner whose values are completely consistent with his own can solve the problem of robots, which is also the best way to deal with the problem that robots will inevitably get out of control in the future.

Using robots to deal with robots is a bit like the idea that those emperors of the Qing Dynasty used to deal with the invasion of foreigners, but the end result was a fiasco. Therefore, I don't know how far this method can make human beings. But is there a better way? unless humans never develop intelligent robots, which is impossible.

Human beings need to develop, need to rely on external forces, and at the same time avoid being replaced by "evolved" advanced species, the only way is to improve themselves, through the cultivation of consciousness, the birth of primordial gods, to overcome the natural limitations of human biological brains, Mordin feels that this is the right choice for the evolution of life. ()

Please remember that the first domain name of this book is:. Mobile version reading URL: