Python 100天-從新手到大師學習筆記Day74:Scrapy分布式實現

Scrapy分布式实现

  1. 安装Scrapy-Redis。
  2. 配置Redis服务器。
  3. 修改配置文件。

Scrapyd分布式部署

  1. 安装Scrapyd
  2. 修改配置文件

安装Scrapyd-Client

Written by

Machine Learning / Deep Learning / Python / Flutter cakeresume.com/yanwei-liu

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store