Comments (3)
tables:
- table1
- table2
from synch.
- table: order_goods
- table: invoice_order
[root@localhost ~]# synch --alias mysql_db etl --schema clickhouse --renew
2021-08-17 10:28:20 - synch.reader:29 - DEBUG - select COLUMN_NAME from information_schema.COLUMNS where TABLE_SCHEMA='clickhouse' and TABLE_NAME='order_goods' and COLUMN_KEY='PRI'
2021-08-17 10:28:20 - synch.reader:29 - DEBUG - select COLUMN_NAME from information_schema.COLUMNS where TABLE_SCHEMA='clickhouse' and TABLE_NAME='invoice_order' and COLUMN_KEY='PRI'
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - drop table clickhouse.invoice_order
2021-08-17 10:28:20 - synch.replication.etl:92 - INFO - drop table success:clickhouse.invoice_order
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - select count(*)from system.tables where database = 'clickhouse' and name = 'invoice_order'
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - CREATE TABLE clickhouse.invoice_order ENGINE = MergeTree ORDER BY id AS SELECT * FROM mysql('172.16.0.40:3306', 'clickhouse', 'invoice_order', 'ch_repl', 'ch_repl') limit 0
2021-08-17 10:28:20 - synch.replication.clickhouse:44 - DEBUG - select COLUMN_NAME, COLUMN_TYPE,IS_NULLABLE from information_schema.COLUMNS where TABLE_NAME = 'invoice_order' and COLUMN_TYPE like '%decimal%'and TABLE_SCHEMA = 'clickhouse'
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - alter table clickhouse.invoice_order modify column money_paid Nullable(Decimal(10,2))
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - alter table clickhouse.invoice_order modify column refund_money Nullable(Decimal(10,2))
2021-08-17 10:28:20 - synch.replication.clickhouse:33 - DEBUG - insert into clickhouse.invoice_order SELECT * FROM mysql('172.16.0.40:3306', 'clickhouse', 'invoice_order', 'ch_repl', 'ch_repl')
2021-08-17 10:29:15 - synch.replication.etl:114 - INFO - full data etl for clickhouse.invoice_order success
[root@localhost ~]#
配置文件如上写,但是直接运行 只同步了一张表,前面的那一张表 没有同步完成
from synch.
用了最新版本之后 问题解决了,thanks 作者。
from synch.
Related Issues (20)
- pymysql.util 依赖问题 HOT 4
- 支持windows调试吗 HOT 1
- pip install error HOT 2
- 支持表通配符配置 HOT 4
- 一些修复 希望检阅合并一下代码
- redis队列消费后,队列中的消息不删除 HOT 2
- 增量同步的时候支持mysql定期删数据吗? HOT 1
- 可以不填写redis和kafka进行启动吗 HOT 1
- AttributeError: 'NoneType' object has no attribute 'get' HOT 1
- UnicodeDecodeError - 'utf-8' codec can't decode byte 0xff HOT 1
- AttributeError: 'NoneType' object has no attribute 'get' HOT 8
- BUG HOT 1
- postgres全量同步,数据过大导致错误
- 日志问题
- mysql到clickhouse HOT 2
- mysql同步到clickhouse全量初始化会超时 HOT 1
- 源数据时间有1970-01-01时间 增量同步失败
- 能否增加自定义目标数据库表名?
- 如何添加Oracle数据库? HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from synch.