loomltd/fluent-plugin-out_tcp_secure

Fluentd output plugin for sending raw tcp tls/ssl logs directly to your sub-domain.

fluent-plugin-out_tcp_secure's Issues

configuring CA certificate

Hello Team,

We want to use loomsystems plugin with ssl on our fluentd pods (pods -> OpennShift). We have already created docker images where loomsystems plugin is installed. We also could start the pods.
The problem is, that we can't enable the ssl verification on receiver (logstash) side because of an SSL error:
2019-05-27 12:15:06 +0000 [warn]: #0 failed to flush the buffer. retry_time=0 next_retry_seconds=2019-05-27 12:15:07 +0000 chunk="589dcf5ad61b5b0fc5b0b28d9a978f2e" error_class=OpenSSL::SSL::SSLError error="SSL_write: bad write retry"

We think, this is because we can't configure the used CA certificate.
Is there a way to configure the CA certificate for loomsystems plugin
(We would use it similarly as the forward plugin: https://docs.fluentd.org/output/forward
Here we can configure the CA certificate with tls_cert_path option.)

Thank you for the answer in advance!

Rename to generic fluent-plugin-out_tcp_secure?

This plugin seems very useful for my needs (forwarding JSON events directly into a raw TCP listener), however I do not see any Loom Systems specific functionality in here. I'm hesitant to integrate it into my solution because I believe it will cause confusion that we're trying to integrate with a 3rd party that we have no actual dependency on.

Don't get me wrong, I think it's a shame that basic transports are not covered under the base fluentd plugins, and I appreciate that you put in the time to develop this, but it seems like it would be adopted and used more if it didn't feel like an advertisement for Loom.

Getting fluent parse error in logstash

I'm using fluentd v12.33 docker image with logstash version 6.2.2 docker image provided by elastic.co and fluent codec plugin version 3.1.5

[2018-03-19T14:01:26,385][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 1:Fixnum>, :data=>125}
[2018-03-19T14:01:26,386][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 1:Fixnum>, :data=>125}
[2018-03-19T14:01:26,387][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 1:Fixnum>, :data=>125}
[2018-03-19T14:01:26,387][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 1:Fixnum>, :data=>92}
[2018-03-19T14:01:26,388][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 0:Fixnum>, :data=>34}
[2018-03-19T14:01:26,389][ERROR][logstash.codecs.fluent   ] Fluent parse error, original data now in message field {:error=>#<NoMethodError: undefined method `merge' for 0:Fixnum>, :data=>32}

Am I using the right component version to use loomsystems plugin or was it qualified and tested with some other version?

My fluentd config is

<match **>
   @type loomsystems
   host "myhost.com"
   port "12345"
   use_ssl false
</match>

And logstash config is

input {
  tcp {
    codec => fluent
    port => 12345
  }
}