The invention discloses a network
crawling method, and the method comprises the following steps: storing a plurality of proxy IPs acquired at intervals of a preset period in a preset proxy IP
pool; verifying each proxy IP in the proxy IP
pool one by one, and judging validity of the acquired proxy IPs; recording the proxy IPs, determined as valid, in a white
list in the proxy IP
pool, and recordingthe proxy IPs, determined as invalid, in a
black list in the proxy IP pool; when that the current proxy IP satisfies a preset proxy substitution condition is detected, selecting one proxy IP from thewhite
list in the proxy IP pool; and taking the selected proxy IP as a new proxy IP and performing data
crawling. The invention also provides a terminal and a storage medium. With the method, the terminal and the storage medium provided by the invention, a problem of IP limitation in a process of quickly
crawling data in quantity many times for a long time of the same proxy IP can be solved effectively.