爬取校花图片保存到本地文件夹下（requests+re）

分手后的思念是犯贱 2022-10-22 07:58 254阅读 0赞

# 一、爬取网站分析 #

爬取目标网址：[http://www.521609.com/tuku/shz/][http_www.521609.com_tuku_shz]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70]  
通过分析可得，该界面数据使用静态加载方式，所以获取到网页源代码，再对源代码进行数据解析即可（使用re正则表达式进行数据的匹配）。

# 二、程序源代码 #

import re # 正则表达式
    import os # 创建文件夹
    
    import requests
    import urllib.request
    
    # 请求头设置
    headers = {
        
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36"
        }
    # 创建空文件夹，用来存储照片
    dirName = 'ImgLibs'
    if not os.path.exists(dirName):
        os.mkdir(dirName)
    # 获取网页源代码
    url = "http://www.521609.com/tuku/shz/"
    page_text = requests.get(url = url,headers = headers).text
    
    # 解析源码
    ex = '<li>.*?<img src="(.*?)" alt=.*?</li>'
    img_src_list = re.findall(ex,page_text,re.S) #re.S用来解决换行问题
    # 持久化存储
    for src in img_src_list:
        src = 'http://www.521609.com' + src
        imgPath = dirName + '/' + src.split('/')[-1]
        response = requests.get(url = src,headers = headers)
        img_data = response.content
        with open(imgPath,'wb') as fp:
            fp.write(img_data)
        print(imgPath,'下载成功')

# 三、运行结果 #

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70 1]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70 2]

[http_www.521609.com_tuku_shz]: http://www.521609.com/tuku/shz/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70]: /images/20221022/2a67a3494c1d470b9ff43988140517ce.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70 1]: /images/20221022/04394b16122b46cfb853a1ec89903481.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2dldHNfcw_size_16_color_FFFFFF_t_70 2]: /images/20221022/c4eef8d1d08a438aa93abb29d9a743bc.png