IntroductionMySQL replication slave features a powerful capability of ignoring conflicts like duplicate key error, key not found errors etc. while applying row events. This is exceptionally useful while doing row based replication(RBR) from the master when the slave already contains some data which may conflict with the data coming from the master. In MySQL 5.7 we extend this capability while applying row events from mysql-binlog files using mysqlbinlog tool. This enhancement will prevent such errors from aborting mysql client in case of conflicts like the ones mentioned above.
RationalePrior to MySQL 5.7 we have been using the mysqlbinlog tool as follows.
shell$> mysqlbinlog master.000001|mysql -uroot -hexample.com -ps3cret
This allows us to pipe the output of mysqlbinlog to mysql, and works as long as the row events from the mysqlbinlog do not conflict with the data already present on the mysql server on example.com. However in case of conflicts, the mysql client aborts and the we have to restart the whole process again skipping the event and starting from the next event using the start-position option. This is a problem in case of multiple conflicts.
How to useThe enhancement is pretty simple to use. mysqlbinlog in MySQL 5.7.0 provides command line options to enable this feature.
To use this from the command line simply use the short option
shell$> mysqlbinlog master.000001 -i | mysql -uroot -hexample.com -ps3cret
or use full option
shell$> mysqlbinlog master.000001 --idempotent | mysql -uroot -hexample.com -ps3cret
How does it workIn MySQL server version 5.7.1 we have introduced a new session system variable as rbr_exec_mode which can be set to STRICT or IDEMPOTENT. When set to IDEMPOTENT, the server does not throw out any conflict errors for that particular session.
When executed with -i or --idempotent option the mysql binlog writes
SET SESSION RBR_EXEC_MODE=IDEMPOTENT;
to the output file or to the stdout. When piped into MySQL client this directs the server to use the idempotent mode while applying row events.
This enhancement is available in MySQL 5.7.1 which can be downloaded from the MySQL download page. So go try it out and let us know your valuable feedback using the comment section.