BDR jobs run on 1 server

DanielWhite — Tue, 03 Apr 2018 14:12:45 GMT

I have 34 hosts in my cluster. I have several BDR jobs and they all run on the same host. Shouldn't they be running on different hosts? What determines which host a job runs on?

Re: BDR jobs run on 1 server

michalis — Tue, 03 Apr 2018 23:00:28 GMT

The BDR should run on different hosts, does your CM Server version match our release notes [0]

Only use healthy HDFS/Hive hosts for launching replication jobs

BDR Replication Host Selection Policy has been updated. The process that launches and coordinates a HDFS/Hive replication job will now only run on the following hosts:

Hosts that run any role of the HDFS/Hive Service (for HDFS or Hive replication)
Hosts that have a Non-Gateway role
Hosts where the health status is in the GOOD or CONCERNING state with preference given to GOOD
Hosts that are whitelisted, if configured

Cloudera: OPSAPS-40040

[0] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#id_pd4_vrn_l1b

[1] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#rn_593

Re: BDR jobs run on 1 server

DanielWhite — Mon, 27 Aug 2018 20:12:56 GMT

The fix for this was to upgrade CM from 5.8.3 to 5.14.3

question Re: BDR jobs run on 1 server in Support Questions

BDR jobs run on 1 server

Re: BDR jobs run on 1 server

Re: BDR jobs run on 1 server