id/kafka-el7-rpm

A set of scripts to package Apache Kafka into an rpm (CentOS/RedHat 7)

kafka-redhat7-rpm

A set of scripts to package kafka into an rpm.

Requires CentOS/RedHat 7 or Docker.

Prerequisites

sudo yum install make rpmdevtools wget

or Docker.

Building

make rpm

or use Docker

docker build -t kafka-build . && docker run -ti -v $(pwd)/RPMS:/root/RPMS kafka-build

Resulting RPM will be available at $(shell pwd)/RPMS/x86_64

Installing and operating

sudo yum install kafka*.rpm
sudo systemctl start kafka
sudo systemctl enable kafka

Default locations

binaries: /opt/kafka
data: /var/lib/kafka
logs: /var/log/kafka
configs: /etc/kafka, /etc/sysconfig/kafka

kafka-graphite

Built from https://github.com/damienclaveau/kafka-graphite

kafka-el7-rpm's Issues

kafka 0.9.0.1 start errors on cent 7

Hi,

Did you manage to use this with:

KAFKA_VERSION ?= 0.9.0.1
SCALA_VERSION ?= 2.11

I get this errors at start:

systemctl start kafka

Failed to issue method call: Unit kafka.service failed to load: Bad message. See system logs and 'systemctl status kafka.service' for details.

systemctl status kafka

kafka.service - Kafka
Loaded: error (Reason: Bad message)
Drop-In: /usr/lib/systemd/system/kafka.service.d
└─classpath.conf
Active: inactive (dead)

Feb 19 23:53:20 kick systemd[1]: [/usr/lib/systemd/system/kafka.service.d/classpath.conf:3] Missing '='.

save configuration file when uninstall package

rpm -e kafka-x.x.x will delete /etc/kafka/server.properties directly which is undesirable.
The usual way is save the configuration file into /etc/kafka/server.properties.rpmsave
Hope we can support this feature

zookeeper.service missing

I had to add this file for zookeeper

`
$ cat /etc/systemd/system/zookeeper.service
[Unit]
Requires=network.target remote-fs.target
After=network.target remote-fs.target

[Service]
Type=simple
User=kafka
ExecStart=/opt/kafka/bin/zookeeper-server-start.sh /opt/kafka/config/zookeeper.properties
ExecStop=/opt/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormal

[Install]
WantedBy=multi-user.target

`

Based on information at https://www.vultr.com/docs/how-to-install-apache-kafka-on-centos-7

kafka-*.sh makes mkdir error message

After installing the rpm, when I run kafka shell scripts such as /opt/kafka/bin/kafka-topics.sh
mkdir error occurs as follows:

$ /opt/kafka/bin/kafka-topics.sh --list --zookeeper localhost:2181
mkdir: cannot create directory '/opt/kafka/bin/../logs': Permission denied

It seems that the log directory is not properly set somewhere in the code.

Workaround: sudo mkdir /opt/kafka/logs

Error 4 while trying to 'make rpm'

[root@server kafka-el7-rpm-master]# make rpm
gpg --import KEYS
gpg: key 53038328: public key "Chris Douglas [email protected]" imported
gpg: key 99369B56: public key "Neha Narkhede (Key for signing code and releases) [email protected]" imported
gpg: key 99369B56: "Neha Narkhede (Key for signing code and releases) [email protected]" not changed
gpg: key 575A2645: public key "Neha Narkhede (Key used for signing releases) [email protected]" imported
gpg: key 7F1183BD: public key "Joe Stein (CODE SIGNING KEY) [email protected]" imported
gpg: key E0A61EEA: public key "Jun Rao [email protected]" imported
gpg: Total number processed: 6
gpg: imported: 5 (RSA: 5)
gpg: unchanged: 1
gpg --verify kafka_2.10-0.8.2.1.tgz.asc kafka_2.10-0.8.2.1.tgz
gpg: Signature made Thu 26 Feb 2015 05:31:17 PM EST using RSA key ID E0A61EEA
gpg: Good signature from "Jun Rao [email protected]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg: There is no indication that the signature belongs to the owner.
Primary key fingerprint: 7452 AFD2 2A9E FB5A BF6C 66EE AB61 F70F E0A6 1EEA
make: *** [kafka-graphite-1.0.0.jar] Error 4

/opt folder

I think if the goal of this RPM is to be integrated into Fedora/RedHat/CentOS the path should be /usr/share/kafka not /opt.

make: *** [kafka_2.12-1.0.1.tgz.asc] Error 8

Hello. Try build kafka

docker build -t kafka-build . && docker run -ti -v $(pwd)/RPMS:/root/RPMS kafka-build
....
gpg: no ultimately trusted keys found
make: *** [kafka_2.12-1.0.1.tgz.asc] Error 8