Scrapy screenshot

Scrapy

Frameworks & Libraries

About

The world’s most-used open source data extraction framework

A fast, open-source web-crawling framework for Python.

Features & use cases

  • Agent Skills for Scrapy
  • A project built to scale
  • Extend Scrapy with community add-ons
  • Everything you need in core, everything else is an extension away
  • Over a decade of releases, and counting
  • Trusted by developers in production

Section titles taken from scrapy.org, checked 2026-08-01.

Where Scrapy appears

Similar tools

Alternatives & related tools

Crawlee preview

Crawlee

An open-source web scraping and crawling library for Node.

Dnd Kit preview
New

Dnd Kit

Framework-agnostic toolkit for building drag and drop interfaces.

beUI preview
New

beUI

Motion toolkit of animated components for React and Next.js.

OpenTUI preview
New

OpenTUI

Terminal UI core written in Zig with TypeScript bindings for building CLIs.

Input OTP preview
New

Input OTP

Accessible one-time password input for React, styled to fit.

Sonner preview
New

Sonner

Opinionated toast component for React, sensible defaults out of the box.

Context.dev preview
New

Context.dev

Scraping API that returns structured data instead of raw HTML.

NumberFlow preview
New

NumberFlow

Animated number component for React with accessible transitions.

More in Frameworks & Libraries

See all 84
shadcn/ui preview

shadcn/ui

Beautifully designed components you can copy and paste into apps.

Tailark preview

Tailark

Modern, responsive, pre-built blocks for marketing websites.

21st.dev preview

21st.dev

The npm for design engineers, copy-paste minimal React components.

Theatre.js preview

Theatre.js

A motion-design toolfor the web with a visual editor.