question Re: How to use the parameters which been not listing in cloudera manager config section ? in Archives of Support Questions (Read Only)

How to use the parameters which been not listing in cloudera manager config section ?

Bommuraj Paramaraj — Fri, 16 Sep 2022 09:01:20 GMT

Good day to you all,

I was checking my namenode and found,
i am seeing hadoop configurations below locations. (/etc/hadoop/conf.cloudera.hdfs4 & /run/cloudera-scm-agent/process/9484-namenodes-failover)

root@stats-2624:/etc/hadoop/conf.cloudera.hdfs4# ls
core-site.xml hdfs-site.xml taskcontroller.cfg
hadoop-env.sh log4j.properties

also,

root@stats-2624:/run/cloudera-scm-agent/process/9484-namenodes-failover# ls
cloudera_manager_agent_fencer.py hdfs.keytab
cloudera_manager_agent_fencer_secret_key.txt hdfs-site.xml
cloudera-monitor.properties http-auth-signature-secret
core-site.xml log4j.properties
dfs_hosts_allow.txt logs
dfs_hosts_exclude.txt navigator.client.properties
event-filter-rules.json topology.map
hadoop-metrics2.properties topology.py

Question here ,

1. what is a difference between these configs ?

2. We are able to change the configs in cloudera manager for the parameters which been listed there,
Means, There are few parameters are missing in the Cloudera Manager, if i need those parameters how can i use that ?

Kindly share your suggestion on it.

Best Regards,
BOmmuraj

Re: How to use the parameters which been not listing in cloudera manager config section ?

Manikumar Juttukonda — Mon, 30 Jun 2014 15:52:45 GMT

the /etc/hadoop/conf is the default path that hadoop uses
/run/cloudera....... is the one that cloudera services export the confs and run from there, either way it works, if you make any changes on CM it gets effective in /run/cloudera.... and when you deploy client configs it gets reflected in /etc/hadoop....
Its just the CM way of doing/running things, no big difference...

If you want to add a property to the cluster configuration there is an option in cloudera manager which allows you to add new configurations, I am not sure where can we find it but there is a way to do it as far as i know...

Thanks

Re: How to use the parameters which been not listing in cloudera manager config section ?

Bommuraj Paramaraj — Mon, 30 Jun 2014 16:05:10 GMT

Thank you Manikumar for your input.

I just found below location in cloudera manager to add the custome parameters.

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED -> HDFS Service Environment Safety Valve

Best Regards,
Bommuraj