从零基础开始教你爬取全网妹子图！难道你就不想在室友面前装逼？

18beautiful_url = re.findall(pattern01,html_text)

19print(beautiful_url)

20print(len(beautiful_url))

21# 3.2 获取简介

22pattern02 = r''

23beautiful_words = re.findall(pattern02,html_text)

24print(beautiful_words)

25print(len(beautiful_words))

运行结果：

230

3.4 请求单个页面,正则匹配图片url

3.4.1 页面分析

单组照片页面分析

3.4.2 代码实现

1for i in range(len(beautiful_url)):

2 # 4.1 请求单个页面

3 picture_codes = requests.get(beautiful_url[i])

4 picture_codes.encoding = 'gb2312'

5 picture_words = picture_codes.text

6 # 4.2 在页面中找到图片url

7 # print(picture_words)

8 pattern03 = r''%beautiful_words[i]

9 picture_url = re.findall(pattern03,picture_words)

10 print(picture_url)

3.4.3 运行结果

1# 这里获取的并不是全部，而是每个妹纸的第一张图

2['http://t2.hddhhn.com/uploads/tu/201803/9999/f45065ed61.jpg']，['http://t2.hddhhn.com/uploads/tu/201803/9999/9126579004.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/320ab4622e.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/1fde4d7a1f.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/ef21eaa896.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/e1697062d3.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/419c69bec1.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/4302dc643c.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/df7ff261b0.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/b7b870636f.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/11ec3cf8b2.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/10a0a11a02.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/53e4e2717c.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/7431e6e040.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/228cf34f62.jpg']，

3['http://t2.hddhhn.com/uploads/tu/201807/9999/a9b7d62201.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/ba91f1e60e.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/76da610fa9.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/3ed260e5ae.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/3d93b5fd09.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/280277b310.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/b69662e2d9.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/fbf7a9178b.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/3f9a20a7da.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/691c12fa18.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/249d3362c4.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/29ea1b5fb7.jpg']，['http://t2.hddhhn.com/uploads/tu/201807/9999/db087ab231.jpg']，['http://t2.hddhhn.com/uploads/tu/201803/9999/1a9b5f8522.jpg']，['http://t2.hddhhn.com/uploads/tu/201803/9999/9b597acb26.jpg']

3.5 每个妹纸页面内翻页，爬取所有的图片地址

3.5.1 页面分析

页面翻页分析

我们只用获取网页内代码即可实现页面翻转（即跳转url）

3.5.2 代码实现

1# 4.3 翻页爬取

2# 4.3.1 获取翻页链接

3pattern04 = r"

4pictures_url = re.findall(pattern04,picture_words)

5print(pictures_url)

6print(pattern03)

7# 4.3.2 翻页，获取图片地址

8for j in range(len(pictures_url)):

9 other_picture_url = r'http://www.27270.com/ent/meinvtupian/2018/{0}'.format(pictures_url[j])

10 pictures_codes = requests.get(other_picture_url)

11 pictures_codes.encoding = 'gb2312'

12 pictures_words = pictures_codes.text

13 picture_02 = re.findall(pattern03,pictures_words)

14 picture_address.append(picture_02)

15print(picture_address)

3.5.3 运行结果

1['261848_2.html','261848_3.html','261848_4.html','261848_5.html','261848_6.html','261848_7.html','261848_8.html']

2

3[['http://t2.hddhhn.com/uploads/tu/201803/9999/f45065ed61.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/88e0742045.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/c8d4eba79b.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/78e50b4522.jpg'],

4['http://t2.hddhhn.com/uploads/tu/201803/9999/c435bee80c.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/c8411d490e.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/0e7442531e.jpg'],['http://t2.hddhhn.com/uploads/tu/201803/9999/7aff8c935f.jpg']]

3.6 下载图片

3.6.1 专门写个下载图片函数

1# 下载图片函数

2'''

3folder_name : 分类文件夹名称，按图片简介

4picture_address ： 一组图片的链接

5'''

6def download_pictures(folder_name,picture_address):

7 file_path = r'G:Beautiful{0}'.format(folder_name)

8 if not os.path.exits(file_path):

9 # 新建一个文件夹

10 os.mkdir(os.path.join(r'G:Beautiful',folder_name))

11 # 下载图片保存到新建文件夹

12 for i in range(len(picture_address)):

13 # 下载文件（wb,以二进制格式写入）

14 with open(r'G:Beautiful{0}{1}.jpg'.format(folder_name,i+1),'wb') as f:

15 # 根据下载链接，发送请求，下载图片

16 response = requests.get(picture_address[i][0])

17 f.write(response.content)

3.6.2 运行结果

运行结果

爬取结果（文字有点露骨）

单组皂片示例，看图片大小，挺清晰的

4. 上面只是爬取了主页面的所有妹纸图片，如何实现在主页面翻页呢？

希望大家根据在单个妹子网页翻页的方法（3.5），自己动手写出如何在主页面翻页，爬取更多妹纸图！

实现下图页面翻页

?

（编辑：李大同）

【声明】本站内容均来自网络，其相关言论仅代表作者个人观点，不代表本站立场。若无意侵犯到您的权利，请及时与联系站长删除相关内容!