At 9 am on November 8, 2020, the Law School of Southeast University held the third online activity of big data and Internet law Youth Academic Salon. The salon was presided over by researcher Wang Lusheng, vice president of Law School of Southeast University, and Yao Chengcheng, NLP engineer of Anhui Fuchi Information Technology Co., Ltd., was invited to give the theme lecture analysis of the basis and application of Web Crawler. All teachers and students of the judicial big data base of the people's court participated in the activity.

The theme lecture is divided into theory and practice. Mr. Yao Chengcheng first introduced the era background of the emergence of crawler technology and the general situation of Internet development around the web crawler foundation. He described the working principle of search engine in detail, and explained in detail four types of crawler: general web crawler, focused crawler, incremental crawler and deep web crawler.

In the actual combat part, engineer Yao Chengcheng combined with the web crawler application train collector to explain and demonstrate the operation. Mr. Yao first introduced the common multi web page collection methods, and then introduced how to automatically obtain the hyperlink web address by searching for the coding rules of the website address; combined with music website, government credit website and other case demonstration, explained the software operation steps, and introduced the encryption and anti pickpocket measures of the referee document website.

Vice president Wang Lusheng summarized the activities and pointed out that understanding the progress of web crawler technology and mastering the working principle of crawler software is of great significance to the research on legal regulation of web crawler technology and mining legal big data resources. The judicial big data base will organize a series of lectures around the judicial big data mining technology to provide intellectual guarantee for teachers and students of the base to carry out research on big data and Internet law.