HK349 GMM/Gaussian hybrid model and pupil tracking
PS: I sincerely ask you to subscribe to "Hackers", which is very important to "Hackers" and very important to Makuyama. How far "Hacker" can go depends on how many genuine subscriptions there are, and I sincerely ask for support.
The second operating system prepared by Shi Lei is based on the GMM/Gaussian hybrid model, which is mainly used to develop the speech system.
The so-called high-style hybrid model is a kind of model that uses the Gaussian probability density function to accurately quantify the transaction, and decomposes a transaction into several Gaussian probability density functions, that is, normal distribution curves.
The GMM model is commonly used for speech recognition and has gained a wide range of applications in the computer field. Although the speech recognition made by the GMM model will have a false recognition rate of about 20-30%, as long as the speech is standard enough and the behavior dynamic recognition engine monitors lip language, this error recognition rate will be greatly reduced.
In terms of lip language, the dynamic behavior of lips can be captured through the dynamic recognition engine. As for the voice command is standard enough, it is not something that Shi Lei can control, after all, the local dialect is different, and it can only be based on Mandarin as the standard.
Shi Lei can respond with certainty, if you want to play "The Brave World" well, then you must have a standard Mandarin. Maybe with the popularity of "The Brave World", there will be a boom in learning Mandarin in the Xia Kingdom!
If this is the case, "The Brave World" may be officially recommended by Xia Guo, and if it can really be officially recommended, then "The World of the Brave" will definitely soar!
The GMM Gaussian hybrid model is not complicated, in natural language processing, this is only a shallow learning neural network. In 06, a professor at the University of Toronto, Canada, published an academic paper in the top scientific journal Science. It introduces the problem of deep learning neural networks. Many hidden layer artificial neural networks have excellent feature learning capabilities, and the learned features have a more essential description of the data. This is the deep learning neural network that corresponds to the shallow learning neural network.
Before Shi Lei's rebirth, in 2012, Stanford University and a large-scale computer system expert, jointly using 16,000 Core.CPUs, built a model called Deep.Neural.Networks/Deep Neural Network, which once made a simultaneous translation from English to Xia Chinese, this translation process is very smooth, there is no half a point of lag, and the error rate is not even one percent!
That pseudo-AI of the Angel Council. It was built using the DNN deep neural network model!
It's a pity that Shi Lei doesn't have time for the time being, so he can only do a shallow neural network based on GMM, make a speech recognition system, and then use a dynamic behavioral recognition engine. Lip recognition scheme to reduce the recognition error rate.
About the voice system. After it was developed. It can not only be quoted in "The World of the Brave", but also applied in many ways.
Especially when combined with a dynamic recognition engine for behavior, it's a very powerful system. With a voice recognition system, Shi Lei can control the computer with his voice.
When the time comes, Shi Lei can even simulate the attack of two people by himself, or he can fight with himself. To make a better disguise for his own identity.
There are also monitoring systems that can also be done to a better extent. For example, in the medical monitoring system, some patients who cannot move can speak, so such patients. You can operate the medical system by voice, call nurses or doctors, and other services.
Regarding the GMM-based voice system, in Shi Lei's mind, there is another idea, that is
Returning to the theme of developing "The World of the Brave", a real somatosensory game can be formed with the dynamic recognition engine of behavior and the assistance of the GMM voice system.
As for another difficulty, the problem of the character action system, Shi Lei plans to develop a third auxiliary operating system. That is, the dynamic recognition engine is used to track the player's pupils, and then the software is used to calculate and determine the focus of the player's gaze.
Regarding the pupil tracking technique, there is no patent application in this era, and Shi Lei can just take over this technique. The original patentee of this technology was Nokia, but unfortunately Nokia declined in later generations and was completely killed by Android in seconds.
The pupil tracking technique, which is used in "The World of the Brave", has many benefits. Combined with the dynamic behavior recognition engine and GMM voice system, it can perfectly realize some difficult somatosensory operations.
For example, light power, in reality, it is absolutely impossible for players to achieve somatosensory operations. As an example, if the player is on a cliff and wants to fly down.
At this time, using somatosensory operation, it is impossible to find a place to jump, right? Therefore, the pupil tracking technique can be applied, using the pupil tracking technique, and then with a small jump action, you can jump off the cliff.
As for the various footholds of the cliff, the player's focus is determined, and then the characters in the game are controlled according to the pupil tracking technique.
To illustrate another example, for example, in "The World of the Brave", throwing knives or bow and arrow attacks, and other hidden weapon throws, although players can easily make these actions, they can't just throw one direction, right?
If you throw one direction and dynamically recognize the engine according to the behavior, although it can force the judgment to lock on the target, what about when facing multiple targets? Then there will be nothing that can be done!
If you have the pupil tracking technique, you can calculate the visual focus by judging the pupil gaze, so as to confirm which target the game target is locked, so as to facilitate accurate attacks.
Counting the pupil tracking technique, "The World of the Brave" has introduced three sets of control methods, which combine to form a perfect game control scheme.
In 2007, on January 1, New Year's Day, at more than 5 o'clock in the afternoon, Shi Lei built the foundation for the completion of the GMM model. As for the pupil tracking technique and lip reading technique, it is completely possible to change the strategy method by the dynamic recognition engine of the behavior and directly realize this technique.
After getting up from the chair and stretching, Shi Lei walked out of the bedroom. Prepare in the fridge and find something to eat.
Due to the development of the GMM model and the production of the voice system, at lunchtime, Shi Lei simply ate a little food to satisfy his hunger. As a foodie, Shi Lei's hunger-tolerant attribute is absolutely infinitely close to zero, he is hungry now and wants to find something to eat.
When I opened the refrigerator, I saw that it was empty because it had not been replenished for a long time. I don't even have milk!
"it!" Shi Lei couldn't help but complain, "Nima, isn't this going to starve to death?" ”
Returning to the bedroom, grabbing the car keys on the computer desk, Shi Lei prepared to go out to eat. By the way, I will purchase some reserves. But when he just walked out the door, the phone was in the pocket of his pants. And it rang.
The caller ID is Ouyang Xiang. Shi Lei's face was overjoyed, and he hurriedly pressed the connect button.
"Hey, Happy New Year's Day, Ouyang!" Shi Lei spoke first.
Ouyang Xiang's voice was resolute and powerful, with a clear and clear voice, "Shi Lei." Happy New Year's Day. Are you in King Nga Court? ”
"Yes, I'm here!" Shi Lei responded, and he suddenly remembered that Ouyang Xiang seemed to be single in Jingyayuan. Ouyang Xiang's father died early, and she seems to have a very bad relationship with her mother.
"Shi Lei, come over for dinner later!" Ouyang Xiang's voice carried a sense of concern and a faint joy.
Shi Lei was happy in his heart, and secretly guessed why Ouyang Xiang suddenly asked him to come over for dinner. Although the relationship between the two of them eased because Shi Lei took the initiative to let Ouyang Xiang go to work in the anti-drug team.
But this kind of thing has always been Shi Lei's cheekiness, and Ouyang Xiang has never taken the initiative to mention it.
Although I can't understand why Ouyang Xiang took the initiative to ask him to go to rice, but there is such a good thing as rice, how can Shi Lei let it go?
"Ah, Ouyang, you're so good, I love you to death, I'll come over right away!" Shi Lei hurriedly said on the phone.
Ouyang Xiang snorted lightly, "Young poor mouth, come if you want to come!" After finishing speaking, Ouyang Xiang hung up the phone directly.
Shi Lei walked into the elevator humming a little song, and the phone in his hand rang again. Shi Lei thought it was Ouyang Xiang, and when he was about to connect, he saw that it was Li Zhiyue!
This discovery startled Shi Lei, and he was just about to connect with Ouyang Xiangkouhua.
'Nima, Nima, before you get on the phone next time, be sure to look at the caller ID!' It almost made a big mistake, making Shi Lei break out in a cold sweat on his forehead.
Taking a deep breath, Shi Lei answered the phone, and said in a flat tone as much as possible: "Zhiyue, Happy New Year's Day!" ”
Li Zhiyue responded, "Shi Lei, Happy New Year's Day." ”
Shi Lei Zhilu said that if there was no matter, it would be impossible for Li Zhiyue to take the initiative to call him, especially in this life, when Li Zhiyue was not disfigured and had no psychological pressure, it was unlikely that he would take the initiative to call him.
Since Li Zhiyue took the initiative to call, it means that Li Zhiyue should have something, "Zhiyue, are you okay lately?" ”
Li Zhiyue responded with some absent-mindedness: "It's okay. ”
Shi Lei could hear that Li Zhiyue was not in the mood to chat, he knew Li Zhiyue very well, so he took the initiative to ask: "Zhiyue, do you have anything to do with me?" ”
"I" Li Zhiyue's tone was full of hesitation, "I"
Shi Lei was a little anxious, "Zhiyue, what is the matter?" Isn't that Wu Bin who is harassing you again? Wu Bin in Shi Lei's mouth, is a calligraphy teacher of the Art Department of Shuangqing University, only 28 years old, can be described as young and promising in Shuangqing University, once went to Li Zhiyue's home, and was originally deeply pleased by Li Zhiyue's mother Huang Fen.
Li Zhiyue denied: "It's not Wu Bin! He's not coming to harass me now. ”
"What's the matter, Zhiyue, tell me what's the matter! Whatever it is, I'll help you! Shi Lei asked anxiously.
In the previous life, between Shi Lei and Li Zhiyue, there was a constant bond, the platonic love between the two, even if the time interval is long, even if he is relived for a lifetime, Shi Lei will still not forget!
In this life, because he saw Li Zhiyue again and saw the flawless Li Zhiyue, Shi Lei loved her even more!
Li Zhiyue was silent and did not speak.
"Zhiyue, if you don't say it, I'll go to your house now!" Shi Lei couldn't help but ask a little tougher.
(To be continued.) )