Incompatible with td-agent 3 and 4!

[splunk]

Incompatible with td-agent 3 and 4!

[gp510]

Thanks @pranavmarla, glad you were able to get this working with td-agent 4. We will add this to our backlog as an enhancement request.

[pranavmarla]

Great, thank you @gp510 !

[rockb1017]

Thank you for reporting and telling us the workaround!
I looked into it and the issue is coming from openid_connect gem is requiring active_model gem, and it requires tz_info ~> 1.1. either these gems fix their dependencies or we have to avoid using them.

[hvaghani221]

Hey @pranavmarla, I was able to install fluend-hec v1.2.9 plugin in both td-agent 3 and td-agent 4 and received logs in splunk.

Result for td-agent 4

$ rpm -qa | grep td-agent
td-agent-4.3.0-1.el7.x86_64

$ sudo td-agent-gem install fluent-plugin-splunk-hec
Fetching attr_required-1.0.1.gem
Fetching connection_pool-2.2.5.gem
Fetching net-http-persistent-3.1.0.gem
Fetching mail-2.7.1.gem
Fetching activemodel-7.0.0.gem
Fetching validate_url-1.0.13.gem
Fetching mini_mime-1.1.2.gem
Fetching i18n-1.8.11.gem
Fetching activesupport-7.0.0.gem
Fetching validate_email-0.1.6.gem
Fetching aes_key_wrap-1.1.0.gem
Fetching json-jwt-1.13.0.gem
Fetching swd-1.3.0.gem
Fetching webfinger-1.2.0.gem
Fetching fluent-plugin-splunk-hec-1.2.9.gem
Fetching rack-2.2.3.gem
Fetching rack-oauth2-1.19.0.gem
Fetching openid_connect-1.1.8.gem
Successfully installed connection_pool-2.2.5
Successfully installed net-http-persistent-3.1.0
Successfully installed attr_required-1.0.1
Successfully installed i18n-1.8.11
Successfully installed activesupport-7.0.0
Successfully installed activemodel-7.0.0
Successfully installed validate_url-1.0.13
Successfully installed mini_mime-1.1.2
Successfully installed mail-2.7.1
Successfully installed validate_email-0.1.6
Successfully installed aes_key_wrap-1.1.0
Successfully installed json-jwt-1.13.0
Successfully installed swd-1.3.0
Successfully installed webfinger-1.2.0
Successfully installed rack-2.2.3
Successfully installed rack-oauth2-1.19.0
Successfully installed openid_connect-1.1.8
Successfully installed fluent-plugin-splunk-hec-1.2.9
Parsing documentation for connection_pool-2.2.5
Installing ri documentation for connection_pool-2.2.5
Parsing documentation for net-http-persistent-3.1.0
Installing ri documentation for net-http-persistent-3.1.0
Parsing documentation for attr_required-1.0.1
Installing ri documentation for attr_required-1.0.1
Parsing documentation for i18n-1.8.11
Installing ri documentation for i18n-1.8.11
Parsing documentation for activesupport-7.0.0
Installing ri documentation for activesupport-7.0.0
Parsing documentation for activemodel-7.0.0
Installing ri documentation for activemodel-7.0.0
Parsing documentation for validate_url-1.0.13
Installing ri documentation for validate_url-1.0.13
Parsing documentation for mini_mime-1.1.2
Installing ri documentation for mini_mime-1.1.2
Parsing documentation for mail-2.7.1
Installing ri documentation for mail-2.7.1
Parsing documentation for validate_email-0.1.6
Installing ri documentation for validate_email-0.1.6
Parsing documentation for aes_key_wrap-1.1.0
Installing ri documentation for aes_key_wrap-1.1.0
Parsing documentation for json-jwt-1.13.0
Installing ri documentation for json-jwt-1.13.0
Parsing documentation for swd-1.3.0
Installing ri documentation for swd-1.3.0
Parsing documentation for webfinger-1.2.0
Installing ri documentation for webfinger-1.2.0
Parsing documentation for rack-2.2.3
Installing ri documentation for rack-2.2.3
Parsing documentation for rack-oauth2-1.19.0
Installing ri documentation for rack-oauth2-1.19.0
Parsing documentation for openid_connect-1.1.8
Installing ri documentation for openid_connect-1.1.8
Parsing documentation for fluent-plugin-splunk-hec-1.2.9
Installing ri documentation for fluent-plugin-splunk-hec-1.2.9
Done installing documentation for connection_pool, net-http-persistent, attr_required, i18n, activesupport, activemodel, validate_url, mini_mime, mail, validate_email, aes_key_wrap, json-jwt, swd, webfinger, rack, rack-oauth2, openid_connect, fluent-plugin-splunk-hec after 22 seconds
18 gems installed

Result for td-agent 3

$ rpm -qa | grep td-agent
td-agent-3.8.1-0.el7.x86_64

$ sudo td-agent-gem install fluent-plugin-splunk-hec
Fetching: connection_pool-2.2.5.gem (100%)
Successfully installed connection_pool-2.2.5
Fetching: net-http-persistent-3.1.0.gem (100%)
Successfully installed net-http-persistent-3.1.0
Fetching: attr_required-1.0.1.gem (100%)
Successfully installed attr_required-1.0.1
Fetching: i18n-1.8.11.gem (100%)
Successfully installed i18n-1.8.11
Fetching: activesupport-7.0.0.gem (100%)
ERROR:  Error installing fluent-plugin-splunk-hec:
        activesupport requires Ruby version >= 2.7.0.
$ sudo td-agent-gem install -f fluent-plugin-splunk-hec
Successfully installed activesupport-7.0.0
Fetching: activemodel-7.0.0.gem (100%)
Successfully installed activemodel-7.0.0
Fetching: validate_url-1.0.13.gem (100%)
Successfully installed validate_url-1.0.13
Fetching: mini_mime-1.1.2.gem (100%)
Successfully installed mini_mime-1.1.2
Fetching: mail-2.7.1.gem (100%)
Successfully installed mail-2.7.1
Fetching: validate_email-0.1.6.gem (100%)
Successfully installed validate_email-0.1.6
Fetching: bindata-2.4.10.gem (100%)
Successfully installed bindata-2.4.10
Fetching: aes_key_wrap-1.1.0.gem (100%)
Successfully installed aes_key_wrap-1.1.0
Fetching: json-jwt-1.13.0.gem (100%)
Successfully installed json-jwt-1.13.0
Fetching: swd-1.3.0.gem (100%)
Successfully installed swd-1.3.0
Fetching: webfinger-1.2.0.gem (100%)
Successfully installed webfinger-1.2.0
Fetching: rack-2.2.3.gem (100%)
Successfully installed rack-2.2.3
Fetching: rack-oauth2-1.19.0.gem (100%)
Successfully installed rack-oauth2-1.19.0
Fetching: openid_connect-1.1.8.gem (100%)
Successfully installed openid_connect-1.1.8
Fetching: prometheus-client-2.1.0.gem (100%)
Successfully installed prometheus-client-2.1.0
Fetching: fluent-plugin-splunk-hec-1.2.9.gem (100%)
Successfully installed fluent-plugin-splunk-hec-1.2.9
Parsing documentation for activesupport-7.0.0
Installing ri documentation for activesupport-7.0.0
Parsing documentation for activemodel-7.0.0
Installing ri documentation for activemodel-7.0.0
Parsing documentation for validate_url-1.0.13
Installing ri documentation for validate_url-1.0.13
Parsing documentation for mini_mime-1.1.2
Installing ri documentation for mini_mime-1.1.2
Parsing documentation for mail-2.7.1
Installing ri documentation for mail-2.7.1
Parsing documentation for validate_email-0.1.6
Installing ri documentation for validate_email-0.1.6
Parsing documentation for bindata-2.4.10
Installing ri documentation for bindata-2.4.10
Parsing documentation for aes_key_wrap-1.1.0
Installing ri documentation for aes_key_wrap-1.1.0
Parsing documentation for json-jwt-1.13.0
Installing ri documentation for json-jwt-1.13.0
Parsing documentation for swd-1.3.0
Installing ri documentation for swd-1.3.0
Parsing documentation for webfinger-1.2.0
Installing ri documentation for webfinger-1.2.0
Parsing documentation for rack-2.2.3
Installing ri documentation for rack-2.2.3
Parsing documentation for rack-oauth2-1.19.0
Installing ri documentation for rack-oauth2-1.19.0
Parsing documentation for openid_connect-1.1.8
Installing ri documentation for openid_connect-1.1.8
Parsing documentation for prometheus-client-2.1.0
Installing ri documentation for prometheus-client-2.1.0
Parsing documentation for fluent-plugin-splunk-hec-1.2.9
Installing ri documentation for fluent-plugin-splunk-hec-1.2.9
Done installing documentation for activesupport, activemodel, validate_url, mini_mime, mail, validate_email, bindata, aes_key_wrap, json-jwt, swd, webfinger, rack, rack-oauth2, openid_connect, prometheus-client, fluent-plugin-splunk-hec after 28 seconds
16 gems installed

I wasn't able to install the gem directly, but was able to install using -f flag. You need to set require_ssl_min_version to false value if you are using td-agent 3.

[pranavmarla]

Thanks @harshit-splunk . I was able to confirm that this issue is no longer present when installing the Splunk plugin with td-agent 4 (specifically, the Splunk plugin is now able to handle the newer version of tzinfo that is installed by td-agent 4). Presumably, this is because one of the gems @rockb1017 mentioned above fixed their dependencies.