Upgrade All components in Ambari other than Kafka

[#1]

Is it possible to upgrade all components like hive, mr,tez, spark and just leave out Kafka. The reason is kafka is running in 0.8.1 version and upgrading to 0.9 - consumer jobs will get impacted. After 0.8.2 onwards the moved away from ZK dependencies to broker and we are not sure how much time it will take to re-write the kafka consumer jobs.

[#2 · Accepted solution]

@Anandha L Ranganathan

Every distribution of HDP is created and tested so that components are compatible with each other. So, if you want to upgrade all components in Ambari other than Kafka, while it is definitely possible, we don't recommend it for supportability and compatibility. Essentially, if you go this route, you are trying to create a distro of your own which won't be worth the pain due to possible unknown BUGs, support issues and other challenges.

Better take your time, upgrade Dev cluster, re-write consumer jobs and then upgrade prod once you have tested everything. This would ensure smooth upgrade. Else time and effort saved here can result into pain in other areas down the road as mentioned above. Hope it helps!!