# Install scrapy with Homebrew, pacman

Web crawling & scraping framework. Version 2.17.0 via Homebrew; verified 2026-07-08. Also installable with pacman: sudo pacman -S scrapy.

## Install

```sh
sudo av install brew:scrapy
```

Additional install commands:

### macOS

- Homebrew (100%):

```sh
brew install scrapy
```

  Evidence: local Homebrew formula metadata

### Linux

- pacman (92%):

```sh
sudo pacman -S scrapy
```

  Evidence: Arch Linux sync databases: scrapy from https://geo.mirror.pkgbuild.com/extra/os/x86_64/extra.db.tar.gz

## Package facts

- **Package key:** brew:scrapy
- **Package manager:** Homebrew
- **Package manager page:** <https://formulae.brew.sh/formula/scrapy>
- **Version:** 2.17.0
- **Source summary:** Web crawling & scraping framework
- **Homepage:** <https://scrapy.org>
- **Repository:** <https://github.com/scrapy/scrapy>
- **Upstream docs:** <https://scrapy.org>
- **License:** BSD-3-Clause
- **Source archive:** <https://files.pythonhosted.org/packages/35/9f/9800513193aacb44825f0b9a75e4e6d4a0c416e9ed23ca3aac7374d03d17/scrapy-2.17.0.tar.gz>
- **Last updated:** 2026-07-08T14:27:19Z
- **Generated:** 2026-08-04T22:13:35+00:00

## Executables

- scrapy (cli)
- scrapy (alias)

## Dependencies

- certifi
- cryptography
- python@3.14

## Uses from macOS

- libxml2
- libxslt

## Install behavior

- Post-install hook: not defined
- Bottle: available on arm64_linux, arm64_sequoia, arm64_sonoma, arm64_tahoe, sonoma, x86_64_linux

## Freshness

- Page generated: 2026-08-04
- Package-manager version: 2.17.0
- Package-manager updated: 2026-07-08
- Local data: ok
- Upstream repository: https://scrapy.org
- info: Release/tag comparison is only available for GitHub repositories.

## Security Notes

No matching local secret-handling manifest was found for scrapy. Package metadata is still published here so future coverage has a stable package URL.



## Configuration and credential file locations

These source-backed paths show where this package keeps local settings or durable credentials. Automic Vault can use them as review targets for secret scanning, migration, and command approval.


## Configuration files

- Unix: /etc/scrapy.cfg, ~/.config/scrapy.cfg, ~/.scrapy.cfg, scrapy.cfg
- Windows: c:\scrapy\scrapy.cfg, scrapy.cfg
## Source Database Details

- **Source Database:** Homebrew formula API
- **Tap:** homebrew/core
- **Full Name:** scrapy
- **Version Scheme:** 0
- **Revision:** 0
- **Head Version:** HEAD
- **Bottle Stable Root URL:** <https://ghcr.io/v2/homebrew/core>
- **Deprecated:** no
- **Disabled:** no
- **Keg Only:** no
- **URL Keys:** head, stable

## Other Package-Manager Records

- pacman - scrapy - 2.17.0-1: normalized package name match | Arch Linux sync databases: scrapy from https://geo.mirror.pkgbuild.com/extra/os/x86_64/extra.db.tar.gz | A fast high-level scraping and web crawling framework | https://scrapy.org


## Related links

- [Terminal utility packages](https://pkg.so/terminal-utilities/) - Matched terminal and command-line workflow metadata.
- [Text processing packages](https://pkg.so/text-processing-tools/) - Matched text, document, or structured-data processing metadata.
- [Language runtime packages](https://pkg.so/language-runtime-packages/) - Matched language runtime, compiler, or interpreter metadata.
- [Networking and protocol packages](https://pkg.so/networking-protocol-tools/) - Matched network, protocol, or remote-service metadata.
- [python@3.14](https://pkg.so/brew/python-3-14/) - Runtime dependency declared by Homebrew.
- [trafilatura](https://pkg.so/brew/trafilatura/) - Shares pkgdb curated category or tags: cli, data, python, web-crawling, web-scraping.
- [csvkit](https://pkg.so/brew/csvkit/) - Shares pkgdb curated category or tags: cli, data, python.
- [visidata](https://pkg.so/brew/visidata/) - Shares pkgdb curated category or tags: cli, data, python.
- [sqlite-utils](https://pkg.so/brew/sqlite-utils/) - Shares pkgdb curated category or tags: cli, data, python.
- [iredis](https://pkg.so/brew/iredis/) - Shares pkgdb curated category or tags: cli, data, python.
- [kaskade](https://pkg.so/brew/kaskade/) - Shares pkgdb curated category or tags: cli, data, python.
- [mysql-to-sqlite3](https://pkg.so/brew/mysql-to-sqlite3/) - Shares pkgdb curated category or tags: cli, data, python.
- [xidel](https://pkg.so/brew/xidel/) - Shares pkgdb curated category or tags: cli, data, web-scraping.
- [datalad](https://pkg.so/brew/datalad/) - Both packages touch the same language runtime or ecosystem. Shared terms: certifi, cli, cryptography, data, python.

## Combined YAML source

View the package source record on GitHub. [combined/scrapy.yml](https://github.com/mxcl/pkgdb/blob/main/combined/scrapy.yml)


## Sources

- pkg.so package database
- Geiger risk classifier
- package-page enrichment
- curated configuration and credential file locations
- package version freshness
- pkgdb category and tag curation
- package relationship graph
- external package-manager database matches
- cross-ecosystem install command graph