Title:
METHOD AND APPARATUS FOR MANAGING IP PROXY POOL, AND COMPUTER DEVICE AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2022/134768
Kind Code:
A1
Abstract:
The present application relates to the field of data crawling, and in particular, to a method and apparatus for managing an IP proxy pool, and a computer device and a storage medium. The method comprises: receiving an IP usage request of a client, invoking a queue head IP at the queue head position of an IP queue according to a polling principle, and determining whether the response time of the queue head IP is lower than a preset threshold value; if the response time of the queue head IP is lower than or equal to the preset threshold value, sending the queue head IP to the client; and receiving feedback information returned by the client and indicating that a queue head IP request is successful, and moving the queue head IP to the queue tail position of the IP queue. According to the present application, the balance of an IP load is achieved and a high-quality proxy IP is fully utilized; in addition, stuttering or blockage caused by a same proxy IP being used by multiple clients simultaneously is avoided, thereby improving the stability and effectiveness of the proxy IP in a proxy pool.
Inventors:
DONG RUNHUA (CN)
Application Number:
PCT/CN2021/124374
Publication Date:
June 30, 2022
Filing Date:
October 18, 2021
Export Citation:
Assignee:
ONE CONNECT SMART TECH CO LTD SHENZHEN (CN)
International Classes:
G06F16/951; G06F16/9535
Foreign References:
| CN112671945A | 2021-04-16 | |||
| CN109743411A | 2019-05-10 | |||
| US20170374197A1 | 2017-12-28 | |||
| US6842906B1 | 2005-01-11 |
Other References:
RESOLVEWANG: " How to Design a Good Proxy IP Pool", 4 March 2018 (2018-03-04), XP055945315, Retrieved from the Internet
RESOLVEWANG: "Core Strategies of High-Availability HAipproxy", 5 March 2018 (2018-03-05), XP055945316, Retrieved from the Internet
RESOLVEWANG: "Core Strategies of High-Availability HAipproxy", 5 March 2018 (2018-03-05), XP055945316, Retrieved from the Internet
Attorney, Agent or Firm:
SHENZHEN ZHONGDING INTELLECTUAL PROPERTY AGENCY (CN)
Download PDF: