Open Access Open Access  Restricted Access Subscription Access

Clothing Information Collection Based on Theme Web Crawler


Affiliations
1 School of Computer and Communication, Human Institute of Engineering Xiangtan 411104, China
 

With the rapid development of big data technology, many 'sleeping' data can be utilized, but the source of data is the key point. The previous methods of obtaining data can no longer meet the demand. This article uses python web crawler to down jacket of Alibaba International Station. Information (shell material, structure type, fill material, process information, and style information) is crawled and stored in the MongoDB database for data sources for apparel information analysis.

Keywords

Data Mining, Python Web Crawler, Clothing Information Analysis, Down Jacket.
User
Notifications
Font Size

  • Yang Wengang, Han Haitao. Archives Information Collection Based on Topic Web Crawler in Big Data Background [J]. LANT World, 2015, 478 (20):20-21.
  • Jia Qiran. Design and Implementation of a Python-Specific Web Crawler [J]. Computer Knowledge and Technology, 2017, 13(12): 47-49.
  • Jiang Shanbiao, Huang Kailin, Lu Yujiang, etc. Design and Implementation of Professional Web Crawler Based on Python [J].Enterprise Science and Technology Development, 2016 (8): 17-19.
  • Li Daizhen, Xie Liyan, Qian Shenyi, et al. Design and Implementation of Distributed Reptilian System Based on Scapy [J].Journal of Hubei University for Nationalities (Natural Science Edition), 2017, 35 (3): 317-322.
  • Sun Bing.Design and Implementation of Python-based Multithread Network Crawler [J].Network Security Technology and Applications, 2018(4).
  • Zhang Shuxin. Design and implementation of commodity information collection system based on web crawler[D]. Xiamen University, 2016.
  • Zheng Zheng, Zhao Fei, Zhou Xin-hua.Research and Implementation of Enterprise Policy Information Collection Based on Theme Web Crawler[J].Computer Knowledge and Technology, 2017, 13 (5X): 49-51.
  • Wang Bin,Zhang Yunwei,Liu Jian,et al.A design of web crawler for agricultural information subject[J].Anhui Agricultural Science,2009,37(20): 9699-9700.
  • Liu Zhijie. Topic web crawler search strategy and topic identification method [D]. Wuhan Institute of Technology, 2017.
  • Liu Jiancheng, Wu Baoguo, Chen Dong.Research and development of forest management knowledge acquisition system based on Web crawler[J].Journal of Zhejiang Agricultural and Forestry University, 2017, 34 (4): 743-750.

Abstract Views: 201

PDF Views: 0




  • Clothing Information Collection Based on Theme Web Crawler

Abstract Views: 201  |  PDF Views: 0

Authors

Tang Zhi-hang
School of Computer and Communication, Human Institute of Engineering Xiangtan 411104, China
Li Jun
School of Computer and Communication, Human Institute of Engineering Xiangtan 411104, China
Zhou Yu-Ying
School of Computer and Communication, Human Institute of Engineering Xiangtan 411104, China

Abstract


With the rapid development of big data technology, many 'sleeping' data can be utilized, but the source of data is the key point. The previous methods of obtaining data can no longer meet the demand. This article uses python web crawler to down jacket of Alibaba International Station. Information (shell material, structure type, fill material, process information, and style information) is crawled and stored in the MongoDB database for data sources for apparel information analysis.

Keywords


Data Mining, Python Web Crawler, Clothing Information Analysis, Down Jacket.

References