readx;? NetSense search engine. Pen Fun Pavilion wWw. ｂiquge。 ｉｎfo

In the future, it has the only interactive open catalog management system in China!

The most important thing is that the basic search of Netyi is suitable, and the query results are rigorous and detailed, which can help users find the most important and relevant content. For example, when NetEase Search analyzes a web page, it also considers relevant content on other web pages linked to that web page. NetEase Search will also list those pages with close search terms first.

When searching for multiple terms, NetSearch will only return those pages that match all of the user's search criteria. There is no need to put "and" or "" between keywords. If a user wants to narrow down their search, they just need to enter more keywords and just leave a space in the middle of the keyword.

This is completely in line with Zhang Wei's existing needs, although the name of net search is not very famous in later generations, but when it comes to another name, I believe many people will be familiar with it - there is a search!

Among them, there is a search including web search, shopping search, massive dictionary, video search, image search and a series of others, the intelligent results and selected search in it is the mode that Zhang Wei wants now, he immediately recalled the search process, combined with his own guess.

According to the situation at the time of search, Zhang Wei began to speculate that many parts should be no different from traditional search, so modern search needs to filter links that are not related to the topic according to a certain web page analysis algorithm, retain useful links and put them into the resource manager queue waiting to be crawled, and then, according to a certain search strategy, select the web resources to be crawled next from the queue, and repeat the above process until a certain condition of the system is reached, filter, and index for later queries and retrievals!

In other words, the premise requires a program or script that automatically scrapes information from the World Wide Web.

These words are nonsense for ordinary people, but Zhang Wei knows that it is not nonsense for professionals!

Aren't Chris et al. just in need of a process?

Zhang Wei quickly picked up the pen and notebook and recorded it, these don't need to use his brain at all, because they are all things that he has personally experienced, and he only needs to follow the steps to add his own ideas.

Yaoyao played for a while and said, "Zhang Wei, do you want to play with the computer?"

"Not for now. Zhang Wei wrote in the notebook.

Yaoyao made a naughty grimace at Liu Tingcheng, "Look, Zhang Wei doesn't use it, I'll play for a while." ”

Liu Qingcheng cried and laughed: "You, you, then play for a while, keep your eyes away from the computer." ”

Yaoyao clicked the mouse and shouted, "Sister, come and teach me how to type." ”

Zhang Wei looked up and smiled: "So you can't type?"

Party!

Two lines!

Wu Xing!

He wrote it in no time!

The mood is completely excited, these things are written, it is estimated that they can help Chris, right? Zhang Wei is looking forward to it!

……

I went to bed very late.

But Zhang Wei got up early.

Pulled Zheng Wen again and ran around the netscape.

As soon as I walked in, I saw that the staff in the office area were busy, and when I saw Zhang Wei and Zheng Wen, these employees greeted each other.

“boss。 ”

"Mr. Zheng. ”

"Mr. Zhang. ”

Everyone smiled.

It just so happened that Chris had just come to work.

Zhang Wei smiled and said, "You guys are busy first, Chris, you come over for a while." As soon as he finished speaking, he saw the technicians in charge of developing this product walk in, and he added, "You all come here, I'll talk to you about something." ”

Chris said, "What's the matter? We're still busy developing products, and we were a little bit eyebrow last night. ”

Roman said: "Yes, maybe this is a breakthrough. ”

Taylor yawned and said, "But I'm so tired that I didn't go to bed until two o'clock last night, and I got up at six o'clock in the morning." ”

You can see that everyone is very tired.

Zhang Wei and Zheng Wen glanced at each other, and did not go upstairs, but directly pulled everyone to the desk in the corner of the side, and asked someone to bring chairs.

The crowd sat down.

"Then I'll tell you about the process I guessed, and you can hear any inspiration. Zhang Wei took out a small notebook and opened it.

Hearing this, Chris was stunned.

Taylor was stunned.

Roman and the others were also a little dumbfounded.

What do you say? What do you guess? This can guess and can still inspire us? Yesterday you said that you want to ask someone, why is it now your own guess? So many elite technicians have only a slight eyebrow after a long time, and you can only guess as a person who doesn't even understand the Internet? I go, you think you are God? You are the Creator? How can you think it can become a reality?

The crowd was speechless.

Chris held back for a long time, and he was embarrassed to say anything else, "Then you say we'll listen." ”

Zhang Wei also knew that they didn't believe it, and said, "Anyway, you just listen and see if you don't have anything to lose, right?"

Taylor incredulously, "Will it inspire us?"

"I think there will be. Zhang Wei glanced at the text on the notebook and said, "You need to filter the links that are not related to the topic according to a certain web page analysis algorithm, keep the useful links and put them in the explorer queue waiting to be crawled." ”

Zheng Wen didn't quite understand, and glanced at everyone.

But these people in front of them understand, how they feel at first glance...... According to what Zhang Wei said, it contains three steps: first, the user provides the seed URL; second, the seed queue; third, the scheduling module selects the URL to enter the crawling queue of the crawling module, everyone is a professional, and they know that it is completely feasible when they hear it! Zhang Wei's speculation is simply amazing! Listening to this speculation, they all look at each other, how can they not think of such a simple thing? What the more than a dozen elites present did not expect actually made a person who does not understand the Internet think of it!

Chris couldn't help but exclaim, "What an idea!"

Zhang Wei smiled and said: "I continued, and then selected the next web page resources to be crawled from the queue according to a certain search strategy, and repeated the above process until it stopped when a certain condition of the system was reached. ”

Chris got excited and said: "That is, the crawling module reads the configuration file of the site, and can crawl according to the frequency of execution, and when the scraping result is returned, it will be returned to the pipeline interface, which is the completion of the extraction!"

Roman also said: "Then put the newly discovered connection in the linkbase into the module, and finally let the scheduling module select the URL to enter the crawling queue of the crawling module, and then you can give feedback!"

Zhang Wei and Zheng Wen didn't understand this, and they heard it in the rain, but what these professionals said next made them understand at least a little, and this speculation was feasible!

Taylor stammered, "This ...... That's the scraping process?"

Chris was very adamant: "I think there is an 80 percent success rate!

Hearing the most professional Chris say this, more than a dozen people looked at Zhang Wei in amazement, they couldn't understand how a layman on the Internet could roughly deduce the process? Could this be a natural demon? No wonder people can take charge of huge assets in their teens! No wonder Huajin Capital is managed in a good way! Heaven is really different, some people are born different from others! (To be continued.) )