Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to use the parameters which been not listing in cloudera manager config section ?

Solved Go to solution

How to use the parameters which been not listing in cloudera manager config section ?

Good day to you all,

I was checking my namenode and found,
i am seeing hadoop configurations below locations. (/etc/hadoop/conf.cloudera.hdfs4 & /run/cloudera-scm-agent/process/9484-namenodes-failover)


root@stats-2624:/etc/hadoop/conf.cloudera.hdfs4# ls
core-site.xml hdfs-site.xml taskcontroller.cfg
hadoop-env.sh log4j.properties


also,

root@stats-2624:/run/cloudera-scm-agent/process/9484-namenodes-failover# ls
cloudera_manager_agent_fencer.py hdfs.keytab
cloudera_manager_agent_fencer_secret_key.txt hdfs-site.xml
cloudera-monitor.properties http-auth-signature-secret
core-site.xml log4j.properties
dfs_hosts_allow.txt logs
dfs_hosts_exclude.txt navigator.client.properties
event-filter-rules.json topology.map
hadoop-metrics2.properties topology.py

 

 

Question here ,

 

1. what is a difference between these configs ?

 

2. We are able to change the configs in cloudera manager for the parameters which been listed there,
Means, There are few parameters are missing in the Cloudera Manager, if i need those parameters how can i use that ?

 

Kindly share your suggestion on it.

Best Regards,
BOmmuraj

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to use the parameters which been not listing in cloudera manager config section ?

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj

2 REPLIES 2

Re: How to use the parameters which been not listing in cloudera manager config section ?

Expert Contributor
the /etc/hadoop/conf is the default path that hadoop uses
/run/cloudera....... is the one that cloudera services export the confs and run from there, either way it works, if you make any changes on CM it gets effective in /run/cloudera.... and when you deploy client configs it gets reflected in /etc/hadoop....
Its just the CM way of doing/running things, no big difference...

If you want to add a property to the cluster configuration there is an option in cloudera manager which allows you to add new configurations, I am not sure where can we find it but there is a way to do it as far as i know...

Thanks
Em Jay

Re: How to use the parameters which been not listing in cloudera manager config section ?

Thank you  Manikumar for your input.

 

I just found  below location in cloudera manager to add the custome parameters.

 

HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED ->  HDFS Service Environment Safety Valve

 

Best  Regards,
Bommuraj