Skip to content
masterclass Buddy
Start learning

Scrapy · Command

scrapy shell

Scrapy shell is an interactive Python console for testing scraping code. It lets you fetch pages and try CSS or XPath selectors before running a spider.

Last updated

Syntax

scrapy shell [url]
fetch(url[, redirect=True])
fetch(request)
view(response)
shelp()

In-depth API docs are only for subscribers: parameters, examples, common mistakes and interview practice.

Subscribe
  • shelp()
  • fetch()
  • view()
  • response
  • request
  • scrapy shell
  • Selector
  • XPath selectors

Source: Scrapy shell — Scrapy 2.19.0 documentation. Checked 2026-11-03.