Although the search engines represented by Baidu and Google in later generations eventually presented users with only a simple page with only a search bar and a search button, what is hidden in the background of the page is a huge system composed of thousands of servers, astronomical massive data, and a complex search engine software, and the core of this system is the search engine.

Although the search engine is very complex, the overall architecture of the system is not complicated, mainly composed of network data collection module, data analysis and sorting module, database, user query request analysis module, etc., and the workflow is also very simple:

The network data collection module is a very important module, its main function is to scrape web page information from the network and send it back to the search engine server, this module has a very vivid name, called the web spider, some people call it a web robot, the reason why it is called a web spider, because the spider will step on the spider silk it spits and walk on the web, and the web spider does not spin the silk itself, but the hyperlinks on the Internet connect countless web pages into a huge web, and the web spider will keep crawling around on this web, The reason why collecting web page information is called a web bot is because this crawling search process is completely automated.

The web spider will collect the web page information, send it back to the search engine server, and the network data analysis module will analyze it, and assign a certain weight to each web page according to a certain algorithm, and sort the web page.

Judging the quality of a search engine, to a large extent, depends on this sorting algorithm, an excellent full-text search engine, can optimize the sorting, so that users can get the information they want for the first time, without continuing to turn the page, therefore, this sorting algorithm will be the core technology of the entire search engine.

In fact, he did not plan to complete the development of the search engine independently from beginning to end, but was ready to set up a development team in Xuan Nie to work together to complete the development of the entire system, however, the web page information weight allocation and sorting module, as the most important and core part, he had to develop it himself, and after the development was completed, it would be regarded as the company's core technical secret, apply for a patent for it, and use the law to protect it.

As for other non-core modules, even important functional modules such as web spiders, it is not difficult to develop after figuring out how they work, so he is ready to leave it to the development team to do it, and he will not do it himself.

A complete set of search engine development documents is not something that can be made in a while, Xiao Yuan just drew some architecture diagrams and flowcharts on scratch paper at night, and then went to bed.

Starting from the second day, it took Xiao Yuan three days to write a first draft of the overall structural design document of the entire system, and then he went to Xuanne Company, gathered Tang Xinyu and Gu Wolf together, and repeatedly discussed, modified, and changed the draft of the development document, so that many days passed in a hurry.

At the same time, Tang Xinyu also began to adjust the structure of Xuanne Network Technology Co., Ltd. and established a network security division, which will take Xuanne firewall as the core of network security products and related businesses, all of which will be classified into the network security division.

Standing side by side with the Network Security Division, Tang Xinyu began to set up a search engine division, and Gu Wolf also cooperated with Tang Xinyu to set up a search engine development team according to the predetermined plan.

In addition to continuing to improve the Xuanne open source community construction plan, Duan Yanyue is also starting to set up Xuanne's third special business division - Xuanne Open Source Division, the reason why this division is special is because this division is different from the other two divisions, although it is nominally subordinate to Xuanne Company, but whether it is financial rights, or management rights, are completely independent, after the establishment of this division, Duan Yanyue also began to recruit people, the organization of the open source division.

After Yang Jingchen met with Duan Yanyue last time, a week later, he won 400Mbps of free network bandwidth for the University Open Source Software Alliance that the school was preparing to form for the Xuanne Open Source Community, which was temporarily enough for a while in the early stage of the construction of the University Open Source Alliance.

After getting the network bandwidth, Xiao Yuan made a list of equipment for Duan Yanyue, and allocated one million to her, asking Duan Yanyue to purchase equipment according to the list and deploy it at Jiangzhou University, and asked Gu Wolf to arrange technical personnel to assist Duan Yanyue in migrating the Xuanni Forum to the education network, and transforming and upgrading it according to Duan Yanyue's requirements.

In short, during this period of time, as several core members of Xuanne's entrepreneurial team, Xiao Yuan, Tang Xinyu, Gu Wolf, and Duan Yanyue are all extremely busy, and it is not an exaggeration to describe it as a continuous rotation.

…………

The time soon entered the end of July, the search engine development team was formed, Gu Wolf is still the leader of the development team, originally Gu Wolf wanted Xiao Yuan to be the team leader, but Xiao Yuan resigned, because he could not stay in this development team for a long time, after he finished his work, there were other important things to do, if he was the team leader, at that time, he had to return to Gu Wolf, and changing generals in battle has always been a taboo for soldiers.

Although Xiao Yuan did not serve as the patriarch of the development team, everyone in the development team knew that Xiao Yuan was also a shareholder of the company, so that the members of the development team were very polite to him.

However, what the members of the development team know is only that, what they don't know is that the overall architecture of this search engine was designed by Xiao Yuan, and they don't even know that the core module of the search engine - the web page weight allocation and sorting algorithm will also be developed by themselves.

The reason why he wants to do this, Xiao Yuan has his own considerations, because he can't be the leader of the development team, and he is destined to be unsuitable to be the core of the development team, but as a development team, there must be a core person, this character can only be Gu Wolf in addition to him, if the people in the development team know the truth, then he will become a very special existence in the development team, and this existence is very unfavorable to Gu Wolf's core position, and then it will also have a very negative impact on the development team.

Therefore, from the first day Xiao Yuan entered the development team, he asked Gu Wolf to deliberately conceal everything, and even when assigning development tasks, the development task of the core algorithm was also taken away by Gu Wolf, and Xiao Yuan was assigned to a very marginal module, so that the impression to the development team was that Xiao Yuan was here to play soy sauce at all, and it didn't matter whether there was anything or not, but this was the result that Xiao Yuan himself was happy to see.

Because the preliminary documents are detailed, and the software architecture designed by Xiao Yuan is very beneficial to the division of labor and cooperation, the development work is going very smoothly, Xiao Yuan will go to work on time and get off work every day like ordinary employees, and he can also do what he likes, and he is full of expectations for the future.

But when the time came to July 27th, he had to leave the company temporarily, because this day was the day when the college entrance examination results were officially announced.

ps: There are too many things to consider in this chapter, and I changed and changed, and I just thought about it exhaustively, but it was okay to write it, and it was a long sigh of relief.