Support Questions

Find answers, ask questions, and share your expertise

How to use the parameters which been not listing in cloudera manager config section ?

avatar

Good day to you all,

I was checking my namenode and found,
i am seeing hadoop configurations below locations. (/etc/hadoop/conf.cloudera.hdfs4 & /run/cloudera-scm-agent/process/9484-namenodes-failover)


root@stats-2624:/etc/hadoop/conf.cloudera.hdfs4# ls
core-site.xml hdfs-site.xml taskcontroller.cfg
hadoop-env.sh log4j.properties


also,

root@stats-2624:/run/cloudera-scm-agent/process/9484-namenodes-failover# ls
cloudera_manager_agent_fencer.py hdfs.keytab
cloudera_manager_agent_fencer_secret_key.txt hdfs-site.xml
cloudera-monitor.properties http-auth-signature-secret
core-site.xml log4j.properties
dfs_hosts_allow.txt logs
dfs_hosts_exclude.txt navigator.client.properties
event-filter-rules.json topology.map
hadoop-metrics2.properties topology.py

 

 

Question here ,

 

1. what is a difference between these configs ?

 

2. We are able to change the configs in cloudera manager for the parameters which been listed there,
Means, There are few parameters are missing in the Cloudera Manager, if i need those parameters how can i use that ?

 

Kindly share your suggestion on it.

Best Regards,
BOmmuraj

1 ACCEPTED SOLUTION

avatar

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj

View solution in original post

2 REPLIES 2

avatar
Expert Contributor
the /etc/hadoop/conf is the default path that hadoop uses
/run/cloudera....... is the one that cloudera services export the confs and run from there, either way it works, if you make any changes on CM it gets effective in /run/cloudera.... and when you deploy client configs it gets reflected in /etc/hadoop....
Its just the CM way of doing/running things, no big difference...

If you want to add a property to the cluster configuration there is an option in cloudera manager which allows you to add new configurations, I am not sure where can we find it but there is a way to do it as far as i know...

Thanks
Em Jay

avatar

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj