使用 Homebrew, MacPorts 安装 maxwell

项目链接

• 主页
• 仓库

命令和别名

• maxwell
• maxwell-bootstrap

项目历史

The official repository describes Maxwell as a CDC application that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms. Its changelog starts in March 2015 with a first possible release that included basic Kafka support and JSON output of binlog deltas.

Early 2015 releases quickly added Kafka command-line options, persisted binlog positions inside MySQL, primary-key capture, Kafka keys, MySQL 5.6 support, transaction IDs, and server-id fixes. Later releases extended producers, monitoring, high availability, MariaDB compatibility, MySQL 8 support, parser fixes, and security dependency updates.

采用历史

Maxwell found a niche among teams that wanted MySQL CDC without running a full Kafka Connect stack. Its official README frames use cases as ETL, audit logs, cache invalidation, search indexing, and inter-service communication, and the GitHub project shows thousands of stars and many releases.

使用方式

Users run `bin/maxwell` with MySQL connection credentials and a producer target such as stdout, Kafka, Kinesis, NATS, Pub/Sub, BigQuery, RabbitMQ, Redis, SNS, or SQS. Configuration can be passed by command line, scoped environment variables, or a Java `config.properties` file, and secrets such as MySQL passwords commonly live in those configuration paths.

为什么软件包爱好者会关心

Maxwell is significant to data-package users because it turns a database replication stream into line-oriented JSON events that can be piped through standard streaming infrastructure. It is also a good example of a Java service packaged as a CLI daemon for operational use.

时间线

• 2015-03-04: First possible Maxwell release with basic Kafka support and JSON binlog deltas.
• 2015-03-18: Maxwell begins storing last-written binlog position inside the MySQL master.
• 2015-04-06: Primary-key capture and single-topic output arrive.
• 2015-09-15: v0.11.0 adds transaction information in Kafka stream output.
• 2021: Releases add SNS, NATS, high availability, Docker multi-platform builds, and log4j security updates.
• 2024: Official changelog still records active parser and dependency maintenance.

Related projects

• MySQL binlog, Apache Kafka, Amazon Kinesis, RabbitMQ, Redis, Google Pub/Sub, Debezium

来源

• https://github.com/zendesk/maxwell
• https://github.com/zendesk/maxwell/blob/master/config.properties.example
• https://maxwells-daemon.io/changelog/
• https://maxwells-daemon.io/config/
• https://maxwells-daemon.io/quickstart/