IT序号网

grequests异步请求

developer 2021年05月26日 编程语言 424 0
import grequests 
from bs4 import BeautifulSoup 
def get_title(rep): 
    soup = BeautifulSoup(rep.text, 'html.parser') 
    lis = soup.find('ol', class_='grid_view').find_all('li') 
for li in lis: 
        title = li.find('span', class_="title").text 
print(title) 
reps = (grequests.get('https://movie.douban.com/top250?start={}&filter='.format(i*25)) for i in range(10)) 
for rep in grequests.map(reps): 
    get_title(rep) 

复制代码


评论关闭
IT序号网

微信公众号号:IT虾米 (左侧二维码扫一扫)欢迎添加!