databendcloud/databend-kafka-connect

Databend Kafka Connector

Databend Kafka Connect Sink

The connector is available in beta stage for early adopters. If you notice a problem, please file an issue.

About

databend-kafka-connect is the official Kafka Connect sink connector for Databend. The Kafka connector delivers data from a Kafka topic to a Databend table. The detail introduction docs available in docs page

Install from source

• Requirements:
  • JDK 11
  • Maven
• Clone from repo: git clone https://github.com/databendcloud/databend-kafka-connect.git
• From the root of the project:
  • Build and package debezium server: mvn -Passembly -Dmaven.test.skip package
  • After building, you will get the jar file in target dir. Just put it into kafka libs dir.
  • Create databend.properties file in kafka config dir and config it: nano config/databend.properties, you can check the example configuration in application.properties.example
  • config your source connect such as kafka mysql connector
  • Start or restart the Kafka Connect workers.: bin/connect-standalone.sh config/connect-standalone.properties config/databend.properties config/mysql.properties

More details about configure kafka connector, please read Configure Self-Managed Connectors.

Contributing

You are warmly welcome to hack on debezium-server-databend. We have prepared a guide CONTRIBUTING.md.