Support Questions
Find answers, ask questions, and share your expertise

Upgrade All components in Ambari other than Kafka

Solved Go to solution

Upgrade All components in Ambari other than Kafka

Expert Contributor

Is it possible to upgrade all components like hive, mr,tez, spark and just leave out Kafka. The reason is kafka is running in 0.8.1 version and upgrading to 0.9 - consumer jobs will get impacted. After 0.8.2 onwards the moved away from ZK dependencies to broker and we are not sure how much time it will take to re-write the kafka consumer jobs.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Upgrade All components in Ambari other than Kafka

@Anandha L Ranganathan

Every distribution of HDP is created and tested so that components are compatible with each other. So, if you want to upgrade all components in Ambari other than Kafka, while it is definitely possible, we don't recommend it for supportability and compatibility. Essentially, if you go this route, you are trying to create a distro of your own which won't be worth the pain due to possible unknown BUGs, support issues and other challenges.

Better take your time, upgrade Dev cluster, re-write consumer jobs and then upgrade prod once you have tested everything. This would ensure smooth upgrade. Else time and effort saved here can result into pain in other areas down the road as mentioned above. Hope it helps!!

View solution in original post

1 REPLY 1
Highlighted

Re: Upgrade All components in Ambari other than Kafka

@Anandha L Ranganathan

Every distribution of HDP is created and tested so that components are compatible with each other. So, if you want to upgrade all components in Ambari other than Kafka, while it is definitely possible, we don't recommend it for supportability and compatibility. Essentially, if you go this route, you are trying to create a distro of your own which won't be worth the pain due to possible unknown BUGs, support issues and other challenges.

Better take your time, upgrade Dev cluster, re-write consumer jobs and then upgrade prod once you have tested everything. This would ensure smooth upgrade. Else time and effort saved here can result into pain in other areas down the road as mentioned above. Hope it helps!!

View solution in original post