maxwell

Maxwell's daemon, a mysql-to-json kafka producer

4047
1010
Java

This is Maxwell’s daemon, a change data capture application
that reads MySQL binlogs and writes data changes as JSON to Kafka, Kinesis, and other streaming platforms.

↓ Download |
⚝ Source / Community |
☝ Getting Started |
☷ Reference

What’s it for?

  • ETL of all sorts
  • maintaining an audit log of all changes to your database
  • cache building/expiring
  • search indexing
  • inter-service communication

It goes like this:

  mysql> update `test`.`maxwell` set mycol = 55, daemon = 'Stanislaw Lem';
  maxwell -> kafka: 
  {
    "database": "test",
    "table": "maxwell",
    "type": "update",
    "ts": 1449786310,
    "data": { "id":1, "daemon": "Stanislaw Lem", "mycol": 55 },
    "old": { "mycol":, 23, "daemon": "what once was" }
  }