Scrapy · Option
DOWNLOAD_DELAY
Scrapy settings configure components and request downloading. Use global settings for defaults and DOWNLOAD_SLOTS for per-domain concurrency, delays, and jitter.
Last updated
- Since
- 2.19.0
Syntax
SCRAPY_SETTINGS_MODULE = "myproject.settings"
DOWNLOAD_DELAY = 2.5
DOWNLOAD_DELAY_JITTER = 0.5
DOWNLOAD_SLOTS = {"example.com": {"concurrency": 1, "delay": 2, "jitter": 0}}In-depth API docs are only for subscribers: parameters, examples, common mistakes and interview practice.
SubscribeRelated
CONCURRENT_REQUESTS_PER_DOMAINDOWNLOAD_HANDLERSDOWNLOAD_FAIL_ON_DATALOSSRequest.metadownload_slotdownload_timeoutdownload_maxsizedownload_warnsize