Reply
Explorer
Posts: 21
Registered: ‎12-13-2016
Accepted Solution

BDR jobs run on 1 server

I have 34 hosts in my cluster. I have several BDR jobs and they all run on the same host. Shouldn't they be running on different hosts? What determines which host a job runs on?

Cloudera Employee
Posts: 275
Registered: ‎07-08-2013

Re: BDR jobs run on 1 server

[ Edited ]

The BDR should run on different hosts, does your CM Server version match our release notes [0]

 

Only use healthy HDFS/Hive hosts for launching replication jobs

BDR Replication Host Selection Policy has been updated. The process that launches and coordinates a HDFS/Hive replication job will now only run on the following hosts:
  • Hosts that run any role of the HDFS/Hive Service (for HDFS or Hive replication)
  • Hosts that have a Non-Gateway role
  • Hosts where the health status is in the GOOD or CONCERNING state with preference given to GOOD
  • Hosts that are whitelisted, if configured

Cloudera: OPSAPS-40040

 

 

 

[0] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#id_pd...

[1] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#rn_59...

Explorer
Posts: 21
Registered: ‎12-13-2016

Re: BDR jobs run on 1 server

The fix for this was to upgrade CM from 5.8.3 to 5.14.3

Announcements