rusuly / mysqlcdc Goto Github PK
View Code? Open in Web Editor NEWMySQL/MariaDB binlog replication client for .NET
License: Other
MySQL/MariaDB binlog replication client for .NET
License: Other
Hi , if connect maxscale binlog-server , it failed, pls give some suggestion
options.Hostname = {binlogserver}.hostname;
options.Port = {binlogserver}.port;
options.Username = {binlogserver}.username;
options.Password = {binlogserver}.password;
我想获取TableMetadata.ColumnNames,但是它一是null,是我使用的不对吗?
以下是我启动mysql容器和配置:
[mysqld]
server_id= 1
log-bin=/var/lib/mysql/mysql-bin
expire_logs_days=30
character-set-server=utf8mb4
binlog_format=row
binlog_row_metadata = full
binlog_row_image = full
binlog_rows_query_log_events = on
docker run -p 3306:3306 --name mysql8 -v /home/mysql8/mysqld.cnf:/etc/mysql/mysql.conf.d/mysqld.cnf -v /home/mysql8/conf:/etc/mysql/conf.d -v /home/mysql8/logs:/logs -v /home/mysql8/data:/var/lib/mysql -e MYSQL_ROOT_PASSWORD=123.abc -d mysql:latest
Hi @rusuly
We use mysql 5.7
TableMetadata.ColumnNames = null ( just on mysql:8 )
And we have to query
from INFORMATION_SCHEMA.COLUMNS
where TABLE_NAME='AspNetUsers' and TABLE_SCHEMA='Identity'
order by ORDINAL_POSITION;
But we don't know when columns change in runtime to requery
Thanks
While those 2 issues have independent root cause they are quite similar in a nature:
VARCHAR field value assigned as "", once gets through MySQL binlog, is parsed as null.
JSON field type value assigned as { "key": "" }
, once gets through MySQL binlog, is parsed by MySqlCdc.Providers.MySql.JsonParser.Parse() as { "key": null }
, thus making empty JSON string interpreted as null.
The code responsible for the latter issue might be around the line:
Is it possible to get the logs for a specific table or are the only two options to set the binlog_do_db
and/or filter the results?
Any hint on what could be the issue?
I'm using MySQL 8.0.23
þbin�� `�� y } � � 8.0.23 �� `�
� � � a ��� ����
** �4
(�Î~
¨�� `#� � œ € ]�Ùy9 `"� O ë � � ê
‡"bÂ�üh�—8� ¶��N9 `�� K 6� � � � � � E ��std�! ! ÿ �ÿ test BEGINÿ¾�b9 `�� K �� € 3INSERT INTO test (id, name)
VALUES
( 1, 3 )×ãd�9 `�� : »� X � �test �test ����È �� ��üÿ I`« 9 `�� * å� X � � �ÿ � �3—õ�W9 `�� � �� - nõ_;~� `"� O S� �� � ¾´örbÂ�üx�—8� e+§o~� `�� K ž� � � � � � E ��std�! ! ÿ �ÿ test BEGINÍÓ±£~� `�� T ò� € <INSERT INTO test (id, name)
VALUES
( 1, "asdasdas" )‡20Ë~� `�� : ,� X � �test �test ����È �� ��üÿ !œüc~� `�� 1 ]� X � � �ÿ � �asdasdasjÕŸ;~� `�� � |� s rË×=� `"� O Ë� �� � ‡5¼ubÂ�üx�—8� Õsh5� `�� K �� � � � � � E ��std�! ! ÿ �ÿ test BEGIN0GKð� `�� T j� € <INSERT INTO test (id, name)
VALUES
( 1, "asdasdas" )BÛtô� `�� : ¤� X � �test �test ����È �� ��üÿ Cî©� `�� 1 Õ� X � � �ÿ � �asdasdas“@Öî� `�� � ô� v rO�i½� `"� O C� �� � ¹|´vbÂ�üw�—8� bV!)½� `�� K Ž� � � � � � E ��std�! ! ÿ �ÿ test BEGIN�¶¾f½� `�� U ã� € =INSERT INTO test (id, name)
VALUES
( 3333, "asdasd" )�öø�½� `�� : �� X � �test �test ����È �� ��üÿ jÙm¢½� `�� / L� X � � �ÿ �
�asdasdÈßØt½� `�� � k� w Š6Ì(Â� `"� O º� �� � ���wbÂ�üw�—8� ËÔw¸Â� `�� K �� � � � � � E ��std�! ! ÿ �ÿ test BEGIN>ÝM¶Â� `�� U Z� € =INSERT INTO test (id, name)
VALUES
( 3333, "asdasd" )�¸«ZÂ� `�� : ”� X � �test �test ����È �� ��üÿ �\Œ<Â� `�� / Ã� X � � �ÿ �
�asdasdüL¢�Â� `�� � â� y y+œ�Ã� `"� O 1� �� � þW�wbÂ�üw�—8� ¶c”µÃ� `�� K |� � � � � � E ��std�! ! ÿ �ÿ test BEGINAWËÃ� `�� U Ñ� € =INSERT INTO test (id, name)
VALUES
( 3333, "asdasd" )üjŒäÃ� `�� : � X � �test �test ����È �� ��üÿ û‚E*Ã� `�� / : X � � �ÿ �
�asdasdèlÔÃ� `�� � Y z Ыäà
Contents of my binlog.. could it be an encoding issue?
BinlogClient should support the following SSL strategies:
See implementation
The CancellationToken
should be added for each asynchronous method.
hi @rusuly this lib can use Production Environment? This is exactly the library I want. tks.
hi,How to use TableId to find the corresponding table name?
Why QueryEvent when updating or deleting? Thanks.
DB version: 10.4.14-MariaDB-1:10.4.14+maria~bionic-log
{
"ThreadId": 1256467,
"Duration": 0,
"ErrorCode": 0,
"StatusVariables": "AAAAAAABAAAgVAAAAAAGA3N0ZAQtAC0ACAA=",
"DatabaseName": "test",
"SqlStatement": "delete from Blogs where Id=3",
"Header": {
"Timestamp": 1616726245,
"EventType": "QUERY_EVENT",
"ServerId": 1,
"EventLength": 95,
"NextEventPosition": 68015770,
"EventFlags": 0
}
}
{
"ThreadId": 1235967,
"Duration": 0,
"ErrorCode": 0,
"StatusVariables": "AAAAAAABAAAAAAAAAAAGA3N0ZAQhACEACAA=",
"DatabaseName": "zentao",
"SqlStatement": "UPDATE `zt_cron` SET `status` = 'normal' wHeRe id = '1'",
"Header": {
"Timestamp": 1616726197,
"EventType": "QUERY_EVENT",
"ServerId": 1,
"EventLength": 125,
"NextEventPosition": 68013704,
"EventFlags": 0
}
}
I would like to point out that binlog_row_metadata variable does not exists neither in 5.6 nor 5.7 for mysql
If you want to update your readme accordingly I can find that var only in 8.0 version
Best regards
Lorenzo Grandi
Specify the database to subscribe to or ignore.
I fisrt used FromStart()
to get all transactions, then use FromGtid(“1d8dab31-b1c3-11e9-bd4f-00155d452816:4051-4097”)
, but got a error:
Event stream error. ErrorCode: 1236, ErrorMessage: Cannot replicate because the master purged required binary logs. Replicate the missing transactions from elsewhere, or provision a new slave from backup. Consider increasing the master's binary log expiration period. To find the missing transactions, see the master's error log or the manual for GTID_SUBTRACT., SqlState:HY000
mysql> show binlog events in 'mysql-bin.000001';
+------------------+-------+----------------+-----------+-------------+----------------------------------------------------------------------------------------------+
| Log_name | Pos | Event_type | Server_id | End_log_pos | Info |
+------------------+-------+----------------+-----------+-------------+----------------------------------------------------------------------------------------------+
| mysql-bin.000001 | 4 | Format_desc | 1 | 124 | Server ver: 8.0.17, Binlog ver: 4 |
| mysql-bin.000001 | 124 | Previous_gtids | 1 | 155 | |
| mysql-bin.000001 | 155 | Gtid | 1 | 234 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4051' |
| mysql-bin.000001 | 234 | Query | 1 | 324 | BEGIN |
| mysql-bin.000001 | 324 | Table_map | 1 | 641 | table_id: 97 (dev.hedwig.byzan.hedwig.subscriptionconfig) |
| mysql-bin.000001 | 641 | Update_rows | 1 | 813 | table_id: 97 flags: STMT_END_F |
| mysql-bin.000001 | 813 | Xid | 1 | 844 | COMMIT /* xid=47 */ |
| mysql-bin.000001 | 844 | Gtid | 1 | 923 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4052' |
| mysql-bin.000001 | 923 | Query | 1 | 1009 | BEGIN |
| mysql-bin.000001 | 1009 | Table_map | 1 | 1359 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 1359 | Write_rows | 1 | 1568 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 1568 | Table_map | 1 | 1855 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 1855 | Write_rows | 1 | 2268 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 2268 | Table_map | 1 | 2517 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 2517 | Write_rows | 1 | 2668 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 2668 | Xid | 1 | 2699 | COMMIT /* xid=52 */ |
| mysql-bin.000001 | 2699 | Gtid | 1 | 2776 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4053' |
| mysql-bin.000001 | 2776 | Query | 1 | 2939 | use `dev.suez.binlog`; DROP TABLE `suez.binlog.gtid` /* generated by server */ /* xid=141 */ |
| mysql-bin.000001 | 2939 | Gtid | 1 | 3018 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4054' |
| mysql-bin.000001 | 3018 | Query | 1 | 3108 | BEGIN |
| mysql-bin.000001 | 3108 | Table_map | 1 | 3425 | table_id: 97 (dev.hedwig.byzan.hedwig.subscriptionconfig) |
| mysql-bin.000001 | 3425 | Update_rows | 1 | 3597 | table_id: 97 flags: STMT_END_F |
| mysql-bin.000001 | 3597 | Xid | 1 | 3628 | COMMIT /* xid=167 */ |
| mysql-bin.000001 | 3628 | Gtid | 1 | 3707 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4055' |
| mysql-bin.000001 | 3707 | Query | 1 | 3793 | BEGIN |
| mysql-bin.000001 | 3793 | Table_map | 1 | 4143 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 4143 | Write_rows | 1 | 4352 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 4352 | Table_map | 1 | 4639 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 4639 | Write_rows | 1 | 5052 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 5052 | Table_map | 1 | 5301 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 5301 | Write_rows | 1 | 5452 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 5452 | Xid | 1 | 5483 | COMMIT /* xid=173 */ |
| mysql-bin.000001 | 5483 | Gtid | 1 | 5562 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4056' |
| mysql-bin.000001 | 5562 | Query | 1 | 5652 | BEGIN |
| mysql-bin.000001 | 5652 | Table_map | 1 | 5969 | table_id: 97 (dev.hedwig.byzan.hedwig.subscriptionconfig) |
| mysql-bin.000001 | 5969 | Update_rows | 1 | 6141 | table_id: 97 flags: STMT_END_F |
| mysql-bin.000001 | 6141 | Xid | 1 | 6172 | COMMIT /* xid=205 */ |
| mysql-bin.000001 | 6172 | Gtid | 1 | 6251 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4057' |
| mysql-bin.000001 | 6251 | Query | 1 | 6337 | BEGIN |
| mysql-bin.000001 | 6337 | Table_map | 1 | 6687 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 6687 | Delete_rows | 1 | 9278 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 9278 | Xid | 1 | 9309 | COMMIT /* xid=233 */ |
| mysql-bin.000001 | 9309 | Gtid | 1 | 9388 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4058' |
| mysql-bin.000001 | 9388 | Query | 1 | 9474 | BEGIN |
| mysql-bin.000001 | 9474 | Table_map | 1 | 9761 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 9761 | Delete_rows | 1 | 15567 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 15567 | Xid | 1 | 15598 | COMMIT /* xid=237 */ |
| mysql-bin.000001 | 15598 | Gtid | 1 | 15677 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4059' |
| mysql-bin.000001 | 15677 | Query | 1 | 15763 | BEGIN |
| mysql-bin.000001 | 15763 | Table_map | 1 | 16012 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 16012 | Delete_rows | 1 | 17773 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 17773 | Xid | 1 | 17804 | COMMIT /* xid=241 */ |
| mysql-bin.000001 | 17804 | Gtid | 1 | 17883 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4060' |
| mysql-bin.000001 | 17883 | Query | 1 | 17969 | BEGIN |
| mysql-bin.000001 | 17969 | Table_map | 1 | 18319 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 18319 | Write_rows | 1 | 18528 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 18528 | Table_map | 1 | 18815 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 18815 | Write_rows | 1 | 19228 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 19228 | Table_map | 1 | 19477 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 19477 | Write_rows | 1 | 19628 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 19628 | Xid | 1 | 19659 | COMMIT /* xid=251 */ |
| mysql-bin.000001 | 19659 | Gtid | 1 | 19738 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4061' |
| mysql-bin.000001 | 19738 | Query | 1 | 19824 | BEGIN |
| mysql-bin.000001 | 19824 | Table_map | 1 | 20174 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 20174 | Write_rows | 1 | 20383 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 20383 | Table_map | 1 | 20670 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 20670 | Write_rows | 1 | 21083 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 21083 | Table_map | 1 | 21332 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 21332 | Write_rows | 1 | 21483 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 21483 | Xid | 1 | 21514 | COMMIT /* xid=262 */ |
| mysql-bin.000001 | 21514 | Gtid | 1 | 21593 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4062' |
| mysql-bin.000001 | 21593 | Query | 1 | 21679 | BEGIN |
| mysql-bin.000001 | 21679 | Table_map | 1 | 22029 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 22029 | Write_rows | 1 | 22238 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 22238 | Table_map | 1 | 22525 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 22525 | Write_rows | 1 | 22938 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 22938 | Table_map | 1 | 23187 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 23187 | Write_rows | 1 | 23338 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 23338 | Xid | 1 | 23369 | COMMIT /* xid=273 */ |
| mysql-bin.000001 | 23369 | Gtid | 1 | 23448 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4063' |
| mysql-bin.000001 | 23448 | Query | 1 | 23534 | BEGIN |
| mysql-bin.000001 | 23534 | Table_map | 1 | 23884 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 23884 | Delete_rows | 1 | 24437 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 24437 | Xid | 1 | 24468 | COMMIT /* xid=329 */ |
| mysql-bin.000001 | 24468 | Gtid | 1 | 24547 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4064' |
| mysql-bin.000001 | 24547 | Query | 1 | 24633 | BEGIN |
| mysql-bin.000001 | 24633 | Table_map | 1 | 24920 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 24920 | Delete_rows | 1 | 26087 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 26087 | Xid | 1 | 26118 | COMMIT /* xid=333 */ |
| mysql-bin.000001 | 26118 | Gtid | 1 | 26197 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4065' |
| mysql-bin.000001 | 26197 | Query | 1 | 26283 | BEGIN |
| mysql-bin.000001 | 26283 | Table_map | 1 | 26532 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 26532 | Delete_rows | 1 | 26913 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 26913 | Xid | 1 | 26944 | COMMIT /* xid=345 */ |
| mysql-bin.000001 | 26944 | Gtid | 1 | 27023 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4066' |
| mysql-bin.000001 | 27023 | Query | 1 | 27109 | BEGIN |
| mysql-bin.000001 | 27109 | Table_map | 1 | 27459 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 27459 | Write_rows | 1 | 27668 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 27668 | Table_map | 1 | 27955 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 27955 | Write_rows | 1 | 28368 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 28368 | Table_map | 1 | 28617 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 28617 | Write_rows | 1 | 28768 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 28768 | Xid | 1 | 28799 | COMMIT /* xid=355 */ |
| mysql-bin.000001 | 28799 | Gtid | 1 | 28878 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4067' |
| mysql-bin.000001 | 28878 | Query | 1 | 28964 | BEGIN |
| mysql-bin.000001 | 28964 | Table_map | 1 | 29314 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 29314 | Write_rows | 1 | 29523 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 29523 | Table_map | 1 | 29810 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 29810 | Write_rows | 1 | 30223 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 30223 | Table_map | 1 | 30472 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 30472 | Write_rows | 1 | 30623 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 30623 | Xid | 1 | 30654 | COMMIT /* xid=366 */ |
| mysql-bin.000001 | 30654 | Gtid | 1 | 30733 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4068' |
| mysql-bin.000001 | 30733 | Query | 1 | 30819 | BEGIN |
| mysql-bin.000001 | 30819 | Table_map | 1 | 31169 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 31169 | Write_rows | 1 | 31378 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 31378 | Table_map | 1 | 31665 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 31665 | Write_rows | 1 | 32078 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 32078 | Table_map | 1 | 32327 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 32327 | Write_rows | 1 | 32478 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 32478 | Xid | 1 | 32509 | COMMIT /* xid=377 */ |
| mysql-bin.000001 | 32509 | Gtid | 1 | 32588 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4069' |
| mysql-bin.000001 | 32588 | Query | 1 | 32674 | BEGIN |
| mysql-bin.000001 | 32674 | Table_map | 1 | 32923 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 32923 | Delete_rows | 1 | 33304 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 33304 | Xid | 1 | 33335 | COMMIT /* xid=425 */ |
| mysql-bin.000001 | 33335 | Gtid | 1 | 33414 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4070' |
| mysql-bin.000001 | 33414 | Query | 1 | 33500 | BEGIN |
| mysql-bin.000001 | 33500 | Table_map | 1 | 33787 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 33787 | Delete_rows | 1 | 34954 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 34954 | Xid | 1 | 34985 | COMMIT /* xid=429 */ |
| mysql-bin.000001 | 34985 | Gtid | 1 | 35064 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4071' |
| mysql-bin.000001 | 35064 | Query | 1 | 35150 | BEGIN |
| mysql-bin.000001 | 35150 | Table_map | 1 | 35500 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 35500 | Delete_rows | 1 | 36053 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 36053 | Xid | 1 | 36084 | COMMIT /* xid=433 */ |
| mysql-bin.000001 | 36084 | Gtid | 1 | 36163 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4072' |
| mysql-bin.000001 | 36163 | Query | 1 | 36249 | BEGIN |
| mysql-bin.000001 | 36249 | Table_map | 1 | 36599 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 36599 | Write_rows | 1 | 36808 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 36808 | Table_map | 1 | 37095 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 37095 | Write_rows | 1 | 37508 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 37508 | Table_map | 1 | 37757 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 37757 | Write_rows | 1 | 37908 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 37908 | Xid | 1 | 37939 | COMMIT /* xid=443 */ |
| mysql-bin.000001 | 37939 | Gtid | 1 | 38018 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4073' |
| mysql-bin.000001 | 38018 | Query | 1 | 38104 | BEGIN |
| mysql-bin.000001 | 38104 | Table_map | 1 | 38353 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 38353 | Write_rows | 1 | 38503 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 38503 | Xid | 1 | 38534 | COMMIT /* xid=454 */ |
| mysql-bin.000001 | 38534 | Gtid | 1 | 38613 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4074' |
| mysql-bin.000001 | 38613 | Query | 1 | 38699 | BEGIN |
| mysql-bin.000001 | 38699 | Table_map | 1 | 39049 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 39049 | Write_rows | 1 | 39258 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 39258 | Table_map | 1 | 39545 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 39545 | Write_rows | 1 | 39958 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 39958 | Table_map | 1 | 40207 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 40207 | Write_rows | 1 | 40358 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 40358 | Xid | 1 | 40389 | COMMIT /* xid=461 */ |
| mysql-bin.000001 | 40389 | Gtid | 1 | 40468 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4075' |
| mysql-bin.000001 | 40468 | Query | 1 | 40554 | BEGIN |
| mysql-bin.000001 | 40554 | Table_map | 1 | 40904 | table_id: 98 (dev.suez.binlog.suez.binlog.column) |
| mysql-bin.000001 | 40904 | Write_rows | 1 | 41113 | table_id: 98 flags: STMT_END_F |
| mysql-bin.000001 | 41113 | Table_map | 1 | 41400 | table_id: 99 (dev.suez.binlog.suez.binlog.table) |
| mysql-bin.000001 | 41400 | Write_rows | 1 | 41813 | table_id: 99 flags: STMT_END_F |
| mysql-bin.000001 | 41813 | Table_map | 1 | 42062 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 42062 | Write_rows | 1 | 42213 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 42213 | Xid | 1 | 42244 | COMMIT /* xid=478 */ |
| mysql-bin.000001 | 42244 | Gtid | 1 | 42323 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4076' |
| mysql-bin.000001 | 42323 | Query | 1 | 42409 | BEGIN |
| mysql-bin.000001 | 42409 | Table_map | 1 | 42658 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 42658 | Write_rows | 1 | 42808 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 42808 | Xid | 1 | 42839 | COMMIT /* xid=489 */ |
| mysql-bin.000001 | 42839 | Gtid | 1 | 42918 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4077' |
| mysql-bin.000001 | 42918 | Query | 1 | 43004 | BEGIN |
| mysql-bin.000001 | 43004 | Table_map | 1 | 43253 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 43253 | Write_rows | 1 | 43403 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 43403 | Xid | 1 | 43434 | COMMIT /* xid=496 */ |
| mysql-bin.000001 | 43434 | Gtid | 1 | 43513 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4078' |
| mysql-bin.000001 | 43513 | Query | 1 | 43599 | BEGIN |
| mysql-bin.000001 | 43599 | Table_map | 1 | 43848 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 43848 | Write_rows | 1 | 43998 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 43998 | Xid | 1 | 44029 | COMMIT /* xid=503 */ |
| mysql-bin.000001 | 44029 | Gtid | 1 | 44108 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4079' |
| mysql-bin.000001 | 44108 | Query | 1 | 44194 | BEGIN |
| mysql-bin.000001 | 44194 | Table_map | 1 | 44443 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 44443 | Write_rows | 1 | 44593 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 44593 | Xid | 1 | 44624 | COMMIT /* xid=510 */ |
| mysql-bin.000001 | 44624 | Gtid | 1 | 44703 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4080' |
| mysql-bin.000001 | 44703 | Query | 1 | 44789 | BEGIN |
| mysql-bin.000001 | 44789 | Table_map | 1 | 45038 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 45038 | Write_rows | 1 | 45188 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 45188 | Xid | 1 | 45219 | COMMIT /* xid=523 */ |
| mysql-bin.000001 | 45219 | Gtid | 1 | 45298 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4081' |
| mysql-bin.000001 | 45298 | Query | 1 | 45384 | BEGIN |
| mysql-bin.000001 | 45384 | Table_map | 1 | 45633 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 45633 | Write_rows | 1 | 45783 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 45783 | Xid | 1 | 45814 | COMMIT /* xid=530 */ |
| mysql-bin.000001 | 45814 | Gtid | 1 | 45893 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4082' |
| mysql-bin.000001 | 45893 | Query | 1 | 45979 | BEGIN |
| mysql-bin.000001 | 45979 | Table_map | 1 | 46228 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 46228 | Write_rows | 1 | 46378 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 46378 | Xid | 1 | 46409 | COMMIT /* xid=537 */ |
| mysql-bin.000001 | 46409 | Gtid | 1 | 46488 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4083' |
| mysql-bin.000001 | 46488 | Query | 1 | 46574 | BEGIN |
| mysql-bin.000001 | 46574 | Table_map | 1 | 46823 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 46823 | Write_rows | 1 | 46973 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 46973 | Xid | 1 | 47004 | COMMIT /* xid=544 */ |
| mysql-bin.000001 | 47004 | Gtid | 1 | 47083 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4084' |
| mysql-bin.000001 | 47083 | Query | 1 | 47169 | BEGIN |
| mysql-bin.000001 | 47169 | Table_map | 1 | 47418 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 47418 | Write_rows | 1 | 47568 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 47568 | Xid | 1 | 47599 | COMMIT /* xid=551 */ |
| mysql-bin.000001 | 47599 | Gtid | 1 | 47678 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4085' |
| mysql-bin.000001 | 47678 | Query | 1 | 47764 | BEGIN |
| mysql-bin.000001 | 47764 | Table_map | 1 | 48013 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 48013 | Write_rows | 1 | 48163 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 48163 | Xid | 1 | 48194 | COMMIT /* xid=564 */ |
| mysql-bin.000001 | 48194 | Gtid | 1 | 48273 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4086' |
| mysql-bin.000001 | 48273 | Query | 1 | 48359 | BEGIN |
| mysql-bin.000001 | 48359 | Table_map | 1 | 48608 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 48608 | Write_rows | 1 | 48758 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 48758 | Xid | 1 | 48789 | COMMIT /* xid=571 */ |
| mysql-bin.000001 | 48789 | Gtid | 1 | 48868 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4087' |
| mysql-bin.000001 | 48868 | Query | 1 | 48954 | BEGIN |
| mysql-bin.000001 | 48954 | Table_map | 1 | 49203 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 49203 | Write_rows | 1 | 49353 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 49353 | Xid | 1 | 49384 | COMMIT /* xid=578 */ |
| mysql-bin.000001 | 49384 | Gtid | 1 | 49463 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4088' |
| mysql-bin.000001 | 49463 | Query | 1 | 49549 | BEGIN |
| mysql-bin.000001 | 49549 | Table_map | 1 | 49798 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 49798 | Write_rows | 1 | 49948 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 49948 | Xid | 1 | 49979 | COMMIT /* xid=585 */ |
| mysql-bin.000001 | 49979 | Gtid | 1 | 50058 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4089' |
| mysql-bin.000001 | 50058 | Query | 1 | 50144 | BEGIN |
| mysql-bin.000001 | 50144 | Table_map | 1 | 50393 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 50393 | Write_rows | 1 | 50543 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 50543 | Xid | 1 | 50574 | COMMIT /* xid=592 */ |
| mysql-bin.000001 | 50574 | Gtid | 1 | 50653 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4090' |
| mysql-bin.000001 | 50653 | Query | 1 | 50739 | BEGIN |
| mysql-bin.000001 | 50739 | Table_map | 1 | 50988 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 50988 | Write_rows | 1 | 51138 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 51138 | Xid | 1 | 51169 | COMMIT /* xid=611 */ |
| mysql-bin.000001 | 51169 | Gtid | 1 | 51248 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4091' |
| mysql-bin.000001 | 51248 | Query | 1 | 51334 | BEGIN |
| mysql-bin.000001 | 51334 | Table_map | 1 | 51583 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 51583 | Write_rows | 1 | 51733 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 51733 | Xid | 1 | 51764 | COMMIT /* xid=630 */ |
| mysql-bin.000001 | 51764 | Gtid | 1 | 51843 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4092' |
| mysql-bin.000001 | 51843 | Query | 1 | 51929 | BEGIN |
| mysql-bin.000001 | 51929 | Table_map | 1 | 52178 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 52178 | Write_rows | 1 | 52328 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 52328 | Xid | 1 | 52359 | COMMIT /* xid=661 */ |
| mysql-bin.000001 | 52359 | Gtid | 1 | 52438 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4093' |
| mysql-bin.000001 | 52438 | Query | 1 | 52524 | BEGIN |
| mysql-bin.000001 | 52524 | Table_map | 1 | 52773 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 52773 | Write_rows | 1 | 52923 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 52923 | Xid | 1 | 52954 | COMMIT /* xid=686 */ |
| mysql-bin.000001 | 52954 | Gtid | 1 | 53033 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4094' |
| mysql-bin.000001 | 53033 | Query | 1 | 53119 | BEGIN |
| mysql-bin.000001 | 53119 | Table_map | 1 | 53368 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 53368 | Write_rows | 1 | 53518 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 53518 | Xid | 1 | 53549 | COMMIT /* xid=705 */ |
| mysql-bin.000001 | 53549 | Gtid | 1 | 53628 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4095' |
| mysql-bin.000001 | 53628 | Query | 1 | 53714 | BEGIN |
| mysql-bin.000001 | 53714 | Table_map | 1 | 53963 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 53963 | Write_rows | 1 | 54113 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 54113 | Xid | 1 | 54144 | COMMIT /* xid=718 */ |
| mysql-bin.000001 | 54144 | Gtid | 1 | 54223 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4096' |
| mysql-bin.000001 | 54223 | Query | 1 | 54309 | BEGIN |
| mysql-bin.000001 | 54309 | Table_map | 1 | 54558 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 54558 | Write_rows | 1 | 54708 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 54708 | Xid | 1 | 54739 | COMMIT /* xid=725 */ |
| mysql-bin.000001 | 54739 | Gtid | 1 | 54818 | SET @@SESSION.GTID_NEXT= '1d8dab31-b1c3-11e9-bd4f-00155d452816:4097' |
| mysql-bin.000001 | 54818 | Query | 1 | 54904 | BEGIN |
| mysql-bin.000001 | 54904 | Table_map | 1 | 55153 | table_id: 100 (dev.suez.binlog.suez.binlog.transaction) |
| mysql-bin.000001 | 55153 | Write_rows | 1 | 55303 | table_id: 100 flags: STMT_END_F |
| mysql-bin.000001 | 55303 | Xid | 1 | 55334 | COMMIT /* xid=732 */ |
+------------------+-------+----------------+-----------+-------------+----------------------------------------------------------------------------------------------+
278 rows in set (0.00 sec)
Hello, I think it's even better if we can get the parameters.
Thank you so much for writing a great thing
The following error makes me question
Can't use multiple BinlogClients?
This error occurs when running two binlogclients on my computer
ConnectionOptions.Username is different
ConnectionOptions.Hostname is different
ConnectionOptions.ServerId is different
System.TimeoutException: Could not receive a master heartbeat within the specified interval
at MySqlCdc.TimeoutExtensions.WithTimeout[TResult](Task`1 task, TimeSpan timeoutSpan, String timeoutMessage)
at MySqlCdc.Network.EventStreamChannel.ReadPacketAsync(TimeSpan timeout, CancellationToken cancellationToken)+MoveNext()
at MySqlCdc.Network.EventStreamChannel.ReadPacketAsync(TimeSpan timeout, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
at MySqlCdc.BinlogClient.Replicate(CancellationToken cancellationToken)+MoveNext()
at MySqlCdc.BinlogClient.Replicate(CancellationToken cancellationToken)+MoveNext()
at MySqlCdc.BinlogClient.Replicate(CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
This is a very low priority task.
Implement parsing opaque values in MySQL Server 5.7.8+ JSON type.
Hello, this is a great library~
I know that the column name is not included in the raw event data, but I need using the clolumn name to get the data from cells, so I want to ask that is there some way to get the affected column names?
Thanks.
My database is MariaDB 10.3
1 rows were updated
{
"TableId": 271,
"Flags": 1,
"ColumnsNumber": 3,
"ColumnsPresentBeforeUpdate": [
true,
true,
true
],
"ColumnsPresentAfterUpdate": [
true,
true,
true
],
"Rows": [
{
"BeforeUpdate": {
"Cells": [
2,
"data1",
18
]
},
"AfterUpdate": {
"Cells": [
2,
"data1",
19
]
}
}
],
"Header": {
"Timestamp": 1627033235,
"EventType": "MYSQL_UPDATE_ROWS_EVENT_V2",
"ServerId": 1,
"EventLength": 78,
"NextEventPosition": 12237,
"EventFlags": 0
}
}
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.