Windows7 Python3 搭建Scrapy 爬虫框架

我会带着你远行 2023-10-18 16:02 128阅读 0赞

Windows7（64位） Python3.7 安装Scrapy 提示如下错误信息：

![20190324113133640.png][]

解决办法：

1.在python库中下载twisted相应的包（.whl文件）

官网地址：[https://www.lfd.uci.edu/~gohlke/pythonlibs/][https_www.lfd.uci.edu_gohlke_pythonlibs]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3V6aGl3ZW5nYW5n_size_16_color_FFFFFF_t_70][]

2、python 通过pip 安装本地whl 软件包。

d:\whl>pip install wheel  #pip 安装whell
    Collecting wheel
      Downloading https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fb
    e9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl
    Installing collected packages: wheel
    Successfully installed wheel-0.33.1
    
    d:\whl>pip install D:\whl\Twisted-18.7.0-cp37-cp37m-win_amd64.whl   #pip 本地安装**.whl软件

3、python 安装scrapy,并验证是否安装成功

d:\whl>pip install scrapy  #安装scrapy 爬虫框架
    d:\whl>scrapy     #验证scrapy 爬虫框架是否安装成功
    Scrapy 1.6.0 - no active project
    
    Usage:
      scrapy <command> [options] [args]
    
    Available commands:
      bench         Run quick benchmark test
      fetch         Fetch a URL using the Scrapy downloader
      genspider     Generate new spider using pre-defined templates
      runspider     Run a self-contained spider (without creating a project)
      settings      Get settings values
      shell         Interactive scraping console
      startproject  Create new project
      version       Print Scrapy version
      view          Open URL in browser, as seen by Scrapy
    
      [ more ]      More commands available when run from project directory
    
    Use "scrapy <command> -h" to see more info about a command

[20190324113133640.png]: https://img-blog.csdnimg.cn/20190324113133640.png
[https_www.lfd.uci.edu_gohlke_pythonlibs]: https://www.lfd.uci.edu/~gohlke/pythonlibs/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3V6aGl3ZW5nYW5n_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20190324113441729.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3V6aGl3ZW5nYW5n,size_16,color_FFFFFF,t_70