Manual Upgrade of Kafka

[#1]

We're currently using HDP 2.3.2.

How can we manually upgrade the kafka to 0.9.x?

Thank in advance!

[#2 · Accepted solution]

For manual upgrade, with disclaimer provided by Emil, you can follow these steps

• Download the .repo file of HDP-2.4 for your OS (if you have no Internet access you need to setup a local repo). Links can be found here.
• Stop your Kafka broker
• Backup config files in /etc/kafka/conf
• Run "yum upgrade kafka" (or zypper if you are on Suse)
• Follow the steps here to configure and start Kafka. You can reuse your old configs, but will need some new ones like "listeners". Be sure to set log.dirs and zookeeper.connect to the values used before the upgrade
• Start kafka, either from the command-line (link above), it might also work from Ambari.
• If you face issues I've listed 4 known issues here: https://community.hortonworks.com/content/kbentry/29224/troubleshooting-kafka-upgrade.html

[#3]

Thanks @Predrag Minovic!

Will try this to our dev cluster.