install

Additional install commands

macOS

Homebrewverified · 100%

brew install shub

local Homebrew formula metadata

overview

Package summary

Scrapinghub command-line client

Project links

Commands and aliases

shub

history

Project history and usage

shub is Scrapinghub's command-line client for deploying scraping projects and dependencies, scheduling spiders, and retrieving job data and logs.

Project history

Scrapinghub developed shub as its command-line client. The maintained Python project has evolved across multiple runtime generations: its official README documents compatibility pins for older Python versions and currently requires Python 3.10 or newer.

Adoption history

shub is distributed as the shub Python package and as a Homebrew formula. Its documentation spans deployment, scheduling, data retrieval, logging, and custom images, making it the general command-line interface for Scrapinghub/Scrapy Cloud workflows.

How it is used

Run shub login to create the global configuration and store an API key. From a project directory, use shub deploy to create or consume scrapinghub.yml and deploy code, then use scheduling, log, and item commands to operate remote spiders and inspect results.

Why package nerds care

shub packages a hosted scraping platform's deployment and operations workflow into a scriptable CLI. It is notable for joining local Scrapy project metadata, API-key authentication, version-control-derived release identifiers, and remote job operations.

Timeline

2.13.0: Last documented shub line for Python versions older than 3.6.
2.15.4: Last documented shub line for Python versions older than 3.9.
2.16.0: Last documented shub line for Python versions older than 3.10.
2.18.1: Version identified by the current official documentation.

Related projects

Scrapy supplies the common crawler project model; Scrapy Cloud is the hosted deployment target; shub-image and shub-workflow extend related deployment and workflow use cases.

Sources

Official configuration documentation: https://shub.readthedocs.io/en/latest/configuration.html
Official documentation: https://shub.readthedocs.io/
Official repository: https://github.com/scrapinghub/shub

security posture

No protected-tool coverage found yet

No matching local secret-handling manifest was found for shub. Package metadata is still published here so future coverage has a stable package URL.

Install behavior

No Homebrew post-install hook is recorded in formula metadata.
Homebrew bottle metadata is available for 6 platform targets.
Installs with 3 runtime dependencies.

Recommended review

Before unattended agent use, check whether the tool reads plaintext credentials, writes remote state, publishes artifacts, or shells out to plugins.

local files

Configuration and credential file locations

These source-backed paths show where this package keeps local settings or durable credentials. Automic Vault can use them as review targets for secret scanning, migration, and command approval.

Configuration files

Config paths the tool may read or write during local use.

Unix: <project-root>/scrapinghub.yml

Credential files

Credential-bearing paths to review before unattended agent runs.

Unix: ~/.scrapinghub.yml

executables

Installed executables

Command	Kind	Exposure	Note
`shub`	cli	global executable

freshness

Version and freshness

These signals separate page generation age, package-manager activity, and upstream release comparison. Version lag is warned only when an evidence URL and comparable versions are present.

page generated2026-09-19

manager version2.18.1

manager updated2026-09-13

local dataok

upstreamnot checked

latest detectednot detected

https://shub.readthedocs.io/en/latest/

infoRelease/tag comparison is only available for GitHub repositories.https://shub.readthedocs.io/en/latest/none confidence

install metadata

Package metadata

Package key	brew:shub
Version	2.18.1
Package manager	Homebrew
Package manager page	https://formulae.brew.sh/formula/shub
Homepage	https://shub.readthedocs.io/en/latest/
Repository	https://github.com/scrapinghub/shub
Upstream docs	https://shub.readthedocs.io/en/latest/
License	BSD-3-Clause
Source archive	https://files.pythonhosted.org/packages/41/c0/e4cd695b5335dab990dafe0e773382f509d6d8cf77124ca523a66e928439/shub-2.18.1.tar.gz
Last updated	2026-09-13T09:06:21Z
Pulse	updated
Dependencies	certifi, libyaml, python@3.14
Bottle	available (on arm64_linux, arm64_sequoia, arm64_sonoma, arm64_tahoe, sonoma, x86_64_linux)
Homebrew post-install	not defined
Service	none declared

registry facts

Source database details

Source Database	Homebrew formula API
Tap	homebrew/core
Full Name	shub
Version Scheme	0
Revision	0
Head Version	HEAD
Bottle Stable Root URL	https://ghcr.io/v2/homebrew/core
Deprecated	no
Disabled	no
Keg Only	no
URL Keys	head stable

package graph

Links come from deterministic package relationships, av.db category and tag curation, ecosystem matches, and package hub membership.

source trail

Generated from repository data

This page is generated by av-web from the private package SQLite artifact built by scripts/generate-pkg-sqlite.py.

Combined YAML source

View the package source record on GitHub.

combined/shub.yml

Used sources

Geiger risk classifier
cross-ecosystem install command graph
curated configuration and credential file locations
curated package history
package relationship graph
package version freshness
package-page enrichment
pkg.so package database
pkgdb category and tag curation

Install shub with Homebrew