payu/fluent-plugin-masking

Fluentd filter plugin to mask sensitive or privacy records in event messages

fluent-plugin-masking's Issues

Masking Password

is it possible to mask if the password is being printed like this.
2020-06-12 12:18:17.433000000 +0530 MyService: {"traceId":"a065669a08ce23d3","spanId":"a065669a08ce23d3","spanExportable":"true","X-Span-Export":"true","level":"INFO","X-B3-SpanId":"a065669a08ce23d3","logger":"com.sreyas.Controller","X-B3-TraceId":"a065669a08ce23d3","thread":"http-nio-8094-exec-6","message":"XXXXXXXX received... check..data [host=localhost, port=999, uuid=uuid, password:admin@123, time=2020-06-04 16:20:40.246, licId=licid]","Source":"MyService","TAG":"MyService"}

I have specified password in the file but it is not getting masked..

Any thoughts.?

Fields not getting masked

Hi,

I am trying to test this plugin on Windows 10 using td-agent v4, but defined fields are not getting masked. I ran td-agent in debug mode as well, but no there is message on what is going wrong. During td-agent startup, plugin does get loaded and fields to be masked are also read properly.

As you can see from attached files, I am trying to mask the key "ProviderName" and "Computer". This is the output (with dummy value for "Computer" tag), as you can see both keys are not getting masked:

--- sample log entries ---
2022-01-06 12:37:55.877141700 +0530 winevt.raw: {"ProviderName":"Nexthink Collector","ProviderGUID":"","EventID":"3221225728","Level":"2","Task":"1","Opcode":"0","Keywords":"0x80000000000000","TimeCreated":"2022/01/06 07:07:55.85937600","EventRecordID":"198171","ActivityID":"","RelatedActivityID":"","ProcessID":"0","ThreadID":"0","Channel":"Application","Computer":"N-LAPTOPID.domain.net","UserID":"","Version":"0","Description":"Connection to Nexthink Appliance cannot be established: Websocket error: Host not found: [Host not found] [appliance host: engine9.domain.net:8443]","EventData":["Connection to Nexthink Appliance cannot be established: Websocket error: Host not found: [Host not found] [appliance host: engine9.domain.net:8443]"]}

2022-01-06 12:34:13.877078900 +0530 winevt.raw: {"ProviderName":"ESENT","ProviderGUID":"","EventID":"102","Level":"4","Task":"1","Opcode":"0","Keywords":"0x80000000000000","TimeCreated":"2022/01/06 07:04:12.183182000","EventRecordID":"198155","ActivityID":"","RelatedActivityID":"","ProcessID":"0","ThreadID":"0","Channel":"Application","Computer":"N-LAPTOPID.domain.net","UserID":"","Version":"0","Description":"Video.UI (18280,P,98) {F28496CB-2EF7-4366-B722-51C0D5BFB252}: The database engine (10.00.18363.0000) is starting a new instance (0).","EventData":["Video.UI","18280,P,98","{F28496CB-2EF7-4366-B722-51C0D5BFB252}: ","0","10","00","18363","0000"]}
--- sample log entries ---

--- startup log ---
2022-01-06 12:27:03 +0530 [info]: adding match pattern="winevt.raw" type="stdout"
2022-01-06 12:27:05 +0530 [info]: adding filter pattern="**" type="masking"
black list fields:
ProviderName
Computer
--- startup log ---

Any ideas on what could be going wrong here? Thanks in advance.

test-files.zip

case insensitive support

• we should support case insensitive configuration fields using the '/i' annotation

tests: Add code coverage

add unit test code coverage + badge in README

feat: Allow specific logs to skip the masking

Add ability to exclude logs from being masked by some parameter (service-name, etc)

chore: Add CI/CD pipeline

Add CI/CD pipeline for testing and releases