Comments (7)
我试了试 。CDC的earliest模式在这块是不支持下划线的
from flink-cdc-connectors.
properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下
- 首先确保下mysql是否设置了如下配置:
server-id = 123
log_bin = mysql-bin
binlog_format = ROW
binlog_row_image = FULL
expire_logs_days = 10
- 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';
from flink-cdc-connectors.
properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下
- 首先确保下mysql是否设置了如下配置:
server-id = 123 log_bin = mysql-bin binlog_format = ROW binlog_row_image = FULL expire_logs_days = 10
- 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';
from flink-cdc-connectors.
是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常
from flink-cdc-connectors.
是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常
正解,是debezium获取到mysql里的所有数据库的时候,会和你传入的 dbname比较,比较的时候传入的dbname被转成小写了,所以tableid找不到。
from flink-cdc-connectors.
from flink-cdc-connectors.
mysql CDC的earliest模式不支持表名带下划线的. 这个问题官方什么时候回修复
from flink-cdc-connectors.
Related Issues (20)
- Data lost after rename table HOT 1
- 文档页面404 HOT 7
- How to do MySQL to MySQL pipeline HOT 5
- Flink CDC may occur binlog can't be find when dynamic added table repeatedly HOT 2
- 一个单节点群集中flink cdc任务超过20个后出错,请问如何调整 HOT 1
- 社区群满了,还有其他群吗 HOT 2
- The db history topic or its content is fully or partially missing. Please check database history topic configuration and re-execute the snapshot
- The db history topic or its content is fully or partially missing.
- The db history topic or its content is fully or partially missing. HOT 1
- Flink OceanBase CDC事务ID获取 HOT 2
- FlinkCDC3.0的任务cancel之后,怎样启动指定checkpoint HOT 1
- ChunkKeyColumns that synchronize multiple tables without a primary key need to be concatenated a lot. Why not simply pass Map<ObjectPath, String> chunkKeys HOT 2
- flinksql设置并发后,会报错Database connection failed when starting copy(postgres-cdc) HOT 2
- Error due to Flink CDC using deprecated `flink-conf.yaml` in light of Flink's full YAML 1.2 support since version 1.19 HOT 2
- The XML dependency of Flink Oracle CDC conflicts with the XML related classes of Java8:ERROR StatusLogger Caught javax.xml.parsers.ParserConfigurationException HOT 3
- 如何通过yarn-session运行flink cdc作业?
- Oracle problem,sync fail HOT 1
- flink mongodb cdc 方式同步数据,mongodb 4.2版本的不支持,update的更新数据同步吗 HOT 4
- I found flink-cdc supported connectors using YAML definition,its very convenient,i love it.so my question is when other pipeline is supported?for example,i want sync data form oracle to pg or pg to mysql.Thanks! HOT 1
- Flink Mongodb CDC在遇到DDL操作(eg: db.c.drop()),程序报错, 期待相应功能的支持 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flink-cdc-connectors.