Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to use the parameters which been not listing in cloudera manager config section ?

avatar

Good day to you all,

I was checking my namenode and found,
i am seeing hadoop configurations below locations. (/etc/hadoop/conf.cloudera.hdfs4 & /run/cloudera-scm-agent/process/9484-namenodes-failover)


root@stats-2624:/etc/hadoop/conf.cloudera.hdfs4# ls
core-site.xml hdfs-site.xml taskcontroller.cfg
hadoop-env.sh log4j.properties


also,

root@stats-2624:/run/cloudera-scm-agent/process/9484-namenodes-failover# ls
cloudera_manager_agent_fencer.py hdfs.keytab
cloudera_manager_agent_fencer_secret_key.txt hdfs-site.xml
cloudera-monitor.properties http-auth-signature-secret
core-site.xml log4j.properties
dfs_hosts_allow.txt logs
dfs_hosts_exclude.txt navigator.client.properties
event-filter-rules.json topology.map
hadoop-metrics2.properties topology.py

 

 

Question here ,

 

1. what is a difference between these configs ?

 

2. We are able to change the configs in cloudera manager for the parameters which been listed there,
Means, There are few parameters are missing in the Cloudera Manager, if i need those parameters how can i use that ?

 

Kindly share your suggestion on it.

Best Regards,
BOmmuraj

1 ACCEPTED SOLUTION

avatar

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj

View solution in original post

2 REPLIES 2

avatar
Expert Contributor
the /etc/hadoop/conf is the default path that hadoop uses
/run/cloudera....... is the one that cloudera services export the confs and run from there, either way it works, if you make any changes on CM it gets effective in /run/cloudera.... and when you deploy client configs it gets reflected in /etc/hadoop....
Its just the CM way of doing/running things, no big difference...

If you want to add a property to the cluster configuration there is an option in cloudera manager which allows you to add new configurations, I am not sure where can we find it but there is a way to do it as far as i know...

Thanks
Em Jay

avatar

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj