tana8m/db2-debezium-kafka-connector

This is a sample CDC setup using debezium-connector for db2 as source and kafka topic as sink.

This is a sample CDC setup using debezium-connector for db2 as source and kafka topic as sink.

Commands to follow:

# pre-requisites:
#  - curl
#  - docker

# to create and start the docker container services
export CP_VERSION=5.4.3
docker-compose up --build

# to stop the running docker container services
docker-compose stop

# to start the stopped docker container services
docker-compose start

# to stop and delete the docker container services
docker-compose down

# curl commands to check status of conector
curl -i -X POST -H "Accept: application/json" -H "Content-Type: application/json" http://localhost:8083/connectors -d @db2-connector-source.json
curl -i -X GET -H "Accept: application/json" http://localhost:8083/connectors/db2-connector-source
curl -i -X GET -H "Accept: application/json" http://localhost:8083/connectors/db2-connector-source/status
curl -i -X DELETE -H "Accept: application/json" http://localhost:8083/connectors/db2-connector-source
curl -i -X POST -H "Accept: application/json" http://localhost:8083/connectors/db2-connector-source/tasks/0/restart # can be used to restart failed connector task upon delay in db2 startup

# db2 cli shell command
docker exec -it db2 bash -c "su - db2inst1"

# kafka topic commands
docker exec -it kafkacat kafkacat -b kafka:29092 -t testdb.DB2INST1.ORDERS -C
docker exec -it kafkacat kafkacat -b kafka:29092 -L

kafka-console-consumer --bootstrap-server kafka:29092 --topic testdb.DB2INST1.ORDERS --from-beginning
kafka-topics --zookeeper zookeeper:2181 --list

DB2 ASN CDC possible function calls:

VALUES ASNCDC.ASNCDCSERVICES('start','asncdc'); --ENABLE_DB_CDC
VALUES ASNCDC.ASNCDCSERVICES('stop','asncdc'); --DISABLE_DB_CDC
VALUES ASNCDC.ASNCDCSERVICES('status','asncdc'); --STATUS_DB_CDC
VALUES ASNCDC.ASNCDCSERVICES('reinit','asncdc'); --RESTART_ASN_CDC
CALL ASNCDC.ADDTABLE('DB2INST1', '#'); --ENABLE_TABLE_CDC
CALL ASNCDC.REMOVETABLE('DB2INST1', '#'); --DISABLE_TABLE_CDC
-- '#' -> tableName in UPPERCASE

Reference links:

• https://debezium.io/documentation/reference/connectors/db2.html
• https://github.com/debezium/debezium-incubator/blob/v1.3.1.Final/debezium-connector-db2/src/test/docker/db2-cdc-docker