Manual Upgrade of Kafka

muanang — Wed, 27 Apr 2016 15:46:29 GMT

We're currently using HDP 2.3.2.

How can we manually upgrade the kafka to 0.9.x?

Thank in advance!

Re: Manual Upgrade of Kafka

pminovic — Wed, 27 Apr 2016 19:59:14 GMT

For manual upgrade, with disclaimer provided by Emil, you can follow these steps

Download the .repo file of HDP-2.4 for your OS (if you have no Internet access you need to setup a local repo). Links can be found here.
Stop your Kafka broker
Backup config files in /etc/kafka/conf
Run "yum upgrade kafka" (or zypper if you are on Suse)
Follow the steps here to configure and start Kafka. You can reuse your old configs, but will need some new ones like "listeners". Be sure to set log.dirs and zookeeper.connect to the values used before the upgrade
Start kafka, either from the command-line (link above), it might also work from Ambari.
If you face issues I've listed 4 known issues here: https://community.hortonworks.com/content/kbentry/29224/troubleshooting-kafka-upgrade.html

muanang — Thu, 28 Apr 2016 07:37:53 GMT

Will try this to our dev cluster.