Comments (3)
Hi Hans
I am facing the same issue.
from kafka-connect-mongodb.
hi @sourjya123 & @RAHULMJP
the logback.xml file in the project itself is not meant to change log level for running the connector on your connect server. so no matter what you put there it won't have any effect. the way you configure connect logging is based on a different log4j.properties
files that comes with the installation / package you use. there is a nice blog post which also shows how to configure the logging into files.
https://rmoff.net/post/kafka-connect-change-log-level-and-write-log-to-file/
I think that should do it for what you need. Also in the newest Kafka release 2.4 you will be able to dynamically change the log level for any connector even during runtime via the REST API.
Let me know if you need anything else. Thx for reaching out!
from kafka-connect-mongodb.
hi @sourjya123 & @RAHULMJP
the logback.xml file in the project itself is not meant to change log level for running the connector on your connect server. so no matter what you put there it won't have any effect. the way you configure connect logging is based on a differentlog4j.properties
files that comes with the installation / package you use. there is a nice blog post which also shows how to configure the logging into files.
https://rmoff.net/post/kafka-connect-change-log-level-and-write-log-to-file/I think that should do it for what you need. Also in the newest Kafka release 2.4 you will be able to dynamically change the log level for any connector even during runtime via the REST API.
Let me know if you need anything else. Thx for reaching out!
Thanks it is working now.
My another question is if my kafka has 3 brokers and want to send to mongo using this connector. can this connector can handle multiple messages? Or do I need to create another and handle when more traffic comes.
from kafka-connect-mongodb.
Related Issues (20)
- Error while starting sink connector HOT 3
- Handling of Null values for a field in Sink Record HOT 3
- Are there any configuration setting to get fullDocument Json only? HOT 1
- Replace strategy setting BsonId HOT 3
- support new compound shard key handling of Debezium Source Connector
- Version 1.4.0 on Confluent Hub HOT 3
- Avro schema "TopicNameStrategy" error HOT 1
- Removed records are put back again immediately. HOT 4
- where is the jar? HOT 1
- Use two WriteModel Strategies in one config? HOT 5
- Cannot convert Record to BSON HOT 2
- Issue with MongoDB sink connector, Records inserted to MongoDB are in the form of CDC structure instead of a mongo document structure HOT 1
- Is there "update"(NOT "replace") as operation type of the result from MongoSinkConnector? HOT 4
- Can I customize Kafka topic from MongoSourceConnector? HOT 1
- Error with shard mongoDB
- Error: `operationType` field is doc is missing
- Post Processor Chain not working HOT 3
- MongoDB Sink Connector Fails with NullPointerException HOT 1
- Question: has this been removed from Confluent Hub? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-connect-mongodb.