Giter Site home page Giter Site logo

flink CDC监控mysql表,表更新报错Encountered change event for table test.student whose schema isn't known to this connector about flink-cdc-connectors HOT 7 CLOSED

ververica avatar ververica commented on June 26, 2024
flink CDC监控mysql表,表更新报错Encountered change event for table test.student whose schema isn't known to this connector

from flink-cdc-connectors.

Comments (7)

zZxiaowang avatar zZxiaowang commented on June 26, 2024 1

我的库名是小写,但是也会出现这种问题 image

我试了试 。CDC的earliest模式在这块是不支持下划线的

from flink-cdc-connectors.

shizhengchao avatar shizhengchao commented on June 26, 2024

properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下

  1. 首先确保下mysql是否设置了如下配置:
server-id         = 123
log_bin           = mysql-bin 
binlog_format     = ROW 
binlog_row_image  = FULL 
expire_logs_days  = 10 
  1. 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';

from flink-cdc-connectors.

yangxusun9 avatar yangxusun9 commented on June 26, 2024

properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下

  1. 首先确保下mysql是否设置了如下配置:
server-id         = 123
log_bin           = mysql-bin 
binlog_format     = ROW 
binlog_row_image  = FULL 
expire_logs_days  = 10 
  1. 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';

from flink-cdc-connectors.

yangxusun9 avatar yangxusun9 commented on June 26, 2024

是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常

from flink-cdc-connectors.

shizhengchao avatar shizhengchao commented on June 26, 2024

是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常

正解,是debezium获取到mysql里的所有数据库的时候,会和你传入的 dbname比较,比较的时候传入的dbname被转成小写了,所以tableid找不到。

from flink-cdc-connectors.

lykpass avatar lykpass commented on June 26, 2024

我的库名是小写,但是也会出现这种问题
image

from flink-cdc-connectors.

lcchaoliu avatar lcchaoliu commented on June 26, 2024

mysql CDC的earliest模式不支持表名带下划线的. 这个问题官方什么时候回修复

from flink-cdc-connectors.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.