Chapter 706: Technically Stuck in the Neck (Ask for Subscription)
Xue Minglushan Waterfall Khan, said in his heart that we are white prostitutes, hey, do you have to promote rice and fight rice?
In fact, he has already grasped a lot of the structures in GPT-1 in the process of training the plot AI of "Out of the Troubled Times", this AI is unsupervised training, which saves manpower very much and saves Xue Ming a lot of effort, so he relies heavily on OpenAI's achievements in plot compilation, and of course he has a lot of achievements.
OpenAI is an AI research force jointly organized by many bigwigs in Silicon Valley, which can be said to concentrate the top resources in the field of AI, and because it is a non-profit organization, it is very generous, and basically everything researched is open source and very nice.
But this time is not ordinary, because the research results of GPT-2 this time are so showy, if it is used to spread rumors, the entire Internet can be destroyed.
If this AI is open to editing, it can definitely be fake, because all kinds of writing points are clear, the routines are very skillful, and the shipment is particularly fast, with a self-media login and release script that automatically distributes messages, invincible! It can compile fake news into a serial, the kind with extremely complete logic, give it a beginning and it can make up a whole set of rumors, the more mature and sensible people are, the easier it is to believe.
It can even debate with others, because it has the function of reading comprehension, and the Q&A is a small case, which is why GPT-2 is relatively easy to transform into a translation AI.
Therefore, OpenAI does not release complete pre-trained models, nor does it release trained models, and developers can only get the castrated version from Github. Even if it is a castrated version, the quality of the commercial translation used in the overseas version of "Out of the Mountain in Troubled Times" is much better, which Zhou Minxi has personally experienced.
This is good news for castration. But Chu Yuan is not happy, if there is no good one, forget it, if there is a good one, you can only use one without a cock, what is going on?
"Hey Xue Ming, you say that OpenAI has given the question and the answer? Can we reverse engineer the problem solving process? Let's solve him and put it on Github, how cool do you say? The siege lions all over the world know that we are awesome. Besides, you can't get used to OpenAI, you can't give them this broom to cherish themselves, don't you say?"
Xue Ming's face changed: "Uh...... Yes, yes, but it will take time!"
"How long will it take?"
"This ...... We don't have computing power, and it will take a long, long, long time. ”
"How can there be no computing power? Domestic cloud computing resources are so sufficient, why don't we spend money to buy computing power?"
Xue Ming was embarrassed and said: "No, we can't buy TPU cloud resources, this AI training is very inefficient with ordinary CPUs, and GPUs are also poor, so it's best to use TPU." But there is no domestic. ”
"Isn't TPU Google's dedicated processor for tensor streams, and you use tensor streaming models to train deep learning models?"
"Yes, yes, there are some open source libraries in China that can be used as alternatives, but I use tensor streams, so it's best to use the computing power of TPU, otherwise it's too laborious. After he finished speaking, he added: "There are the most people who use tensor flow in China." ”
"Is it possible to apply for computing power from Google? I remember that Google has the relevant computing power to supply externally, right? And it's completely free. ”
"Yes, but it won't be given to us, it's for non-commercial users to conduct research, let's do this, although it's also a research, but it's ......"
"!" Chu Yuanxi slapped his thigh, for this matter, it is not impossible for Xue Ming to lie about the research plan to Google, and it is not impossible for Xue Ming to disguise the identity of an individual, but once it is exposed, the valuation of the Ba people will be greatly affected, and even lose money, which is impossible for Chu Yuanxi to bear.
But Google withdrew from the Celestial Empire early, and Google's services could not be bought in China. Xue Ming uses other people's architectures and has no problem training AI by himself, but when it comes to reverse engineering, there is no problem with computing power bottlenecks.
In other words, Chu Yuanxi finally felt the situation of being stuck in the neck technologically, and enjoyed the treatment that only a cutting-edge enterprise in science and technology can enjoy!
"Then I want to get it out even more!" Chu Yuanxi directly found the CTO and CSO of Xiaokang after patting his thigh, briefly explained the situation, and then asked: "Is it possible for us to ensure technical independence?"
"Is this necessary?" Zhou Mingjun was surprised, "The current science and technology world is a hodgepodge trend, and it can't be cut at all, so we don't need to worry about it, right?"
Unexpectedly, Chu Yuanxi didn't speak, Cao Xiang didn't speak, but Xue Ming spoke: "That's not necessarily, what if Emperor Mi asks Microsoft to disconnect Github from us?"
"What are you talking about?" Zhou Mingjun looked at Xue Ming like a fool, they are peers, both are engaged in AI, although they have not reached the point of winning or losing in different places, and there is no theoretical entanglement of interests between the two companies, but it is inevitable that it will be a little weird in a few meetings.
"Broken Github, is it hard to imagine? With Github, domestic artificial intelligence is basically the same as Midi, and the feeling of being a few months behind, without Github, it will be ten years straight back. Now that the competition between the two countries in science and technology is so fierce, it is difficult to say. Breaking off the other has an impact on the Midi, and there is no damage to the Github Midi, just build a wall. ”
Github is an open-source library hosting platform, because of the advanced form of the standout, can be shared and discussed, the snowball is getting bigger and bigger, and now the siege lions all over the world are contributing their own code on it, especially the siege lions in terms of AI rely on it.
The Celestial Empire doesn't know how many AI siege lions have shared Midi's technological achievements from above, such as the Ba people, such as the future well-off. Of course, there are also some powerful siege lions who can contribute their wisdom in reverse and share it with the world.
"I think that although the problem that Xue Ming said has not yet appeared, we can't help but consider the possibility of its appearance. Chu Yuanxi became very entangled, because to face this possible situation, he needed to burn money, and burn money for a problem that did not exist, so he was painful and entangled. However, Midi broke that Github is not unharmed, Github belongs to Microsoft, and last year it spent 7.5 billion dollars of stock private placement to merge and acquire. What is the value of its existence as a platform? It is a user, a user who has broken the Celestial Empire, its value has plummeted by more than one-third, and there are other losses, and it is impossible for Microsoft to lose nothing. ”
"Nothing is impossible to happen in a trade war, and I think the issue Xue Ming said is highly urgent and should be considered. Cao Xiang saw that Chu Yuanxi showed signs of retreating, and decided to support Xue Ming. And Chu Yuanxi seriously doubted that there was some office politics under his rule, but he had no evidence. Moreover, Cao Xiang has just returned from Silicon Valley, and it has only been a month since he returned to China, so what he said should be the most authoritative.