Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Anyone knows how to disable the replication of table column statistics?

avatar
New Contributor

I found the problem while i run the hive BDR and it took 2 hours.

Cloudera support inform us that's the bug and workaround is to disable 

 

 

The possible way to work around is to disable the replication of table column statistics but we don't know how?

 

Anyone has idea?

 

This slowness is most probably because of a fix (OPSAPS-62843) that was introduced in 7.1.7 SP1 to have a hotfix of a functional error (reported in ENGESC-8654), but having the disadvantage of decline in performance.

The performance decline has already been reported and discussed in several other escalations, e.g. ENGESC-15274.

 

So the possible ways to go forward with the solution is

 

---> to wait until the fix for the performance decline (OPSAPS-65104) gets released,

 

---> or to apply a workaround on the nodes of the target cluster that would disable the replication of table column statistics, but would enhance the performance. For that the file /opt/cloudera/cm-agent/service/dr/chive.sh would have to be modified on each node of the target cluster.

 

Thank you,

2 REPLIES 2

avatar
Master Collaborator

This issue would be fixed in our upcoming release. You can check for a hotfix.

 

You can try adding the below workaround as well to see if performance improves.

a. On the target cluster, Go to CM-> Hive-> Configuration
b. Add "HIVE_REPL_STATS_ENGINE=hive" to the "Hive Replication Environment Advanced Configuration Snippet (Safety Valve)" configuration .

 

Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

avatar
Community Manager

@DNADatangineer Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks


Regards,

Diana Torres,
Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: