Comments (2)
fubinzh
commented on June 14, 2024
@Mannoj87 DM is used to replicate Mysql(A) to TiDB, right? The table 'dm_meta.task-test_syncer_checkpoint' in TiDB is created by DM to store the metadata of DM. I think the error "Table 'dm_meta.task-test_syncer_checkpoint' doesn't exist" might happen if you create DM task first then create cdc changefeed.
If you don't need 'dm_meta.task-test_syncer_checkpoint' to be synced to Mysql(B), you can config CDC changefeed to not sync 'dm_meta.task-test_syncer_checkpoint', by adding configuration like below to your changefeed configuration, refer to https://docs.pingcap.com/tidb/stable/ticdc-changefeed-config#changefeed-configuration-parameters for details.
[filter]
rules = ['*.*', '!dm_meta.*']
from tiflow.
asddongmen
commented on June 14, 2024
Close it since there is no more update.
from tiflow.
Related Issues (20)
- TiCDC may fail if pipelined DML transactions occur during incremental scans
- correct ticdc_changefeed_meet_error alert rule evaluation expression
- row changed event physical table id is spread over the code base
- Can add new api to collect the sync statistics?
- Tiflow depends on packages in LGPL-3.0
- simplify the table id related logic
- remove duplicate partition table boolean field from the table name
- schema snapshot takes a long time to initialize when synchronize 150k tables in single changefeed HOT 1
- mounter do not allocate memory for temporary column info slice
- Support output raw change event for mq and cloud storage sink
- Support to specify the initial value of syncpointTs with parameter
- ticdc: Removed error type detection in `CheckIsTiDB` HOT 1
- p2p may discard scheduling messages when synchronize 150k tables in single changefeed
- the scheduling time is too long when synchronize 150k tables in single changefeed
- Changefeed cannot be updated after removing filter from configuration file HOT 2
- data inconsistency after inject kill all cdc chaos HOT 4
- sink(ticdc): redundant log HOT 1
- Kafka consumer panic HOT 2
- csv and maxwell unit test use schema test helper
- puller(ticdc): should split all update kv entries in puller when sink module is in safe mode
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tiflow.