- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to use the parameters which been not listing in cloudera manager config section ?
- Labels:
-
Apache Hadoop
-
Cloudera Manager
-
HDFS
Created on ‎06-26-2014 12:24 PM - edited ‎09-16-2022 02:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Good day to you all,
I was checking my namenode and found,
i am seeing hadoop configurations below locations. (/etc/hadoop/conf.cloudera.hdfs4 & /run/cloudera-scm-agent/process/9484-namenodes-failover)
root@stats-2624:/etc/hadoop/conf.cloudera.hdfs4# ls
core-site.xml hdfs-site.xml taskcontroller.cfg
hadoop-env.sh log4j.properties
also,
root@stats-2624:/run/cloudera-scm-agent/process/9484-namenodes-failover# ls
cloudera_manager_agent_fencer.py hdfs.keytab
cloudera_manager_agent_fencer_secret_key.txt hdfs-site.xml
cloudera-monitor.properties http-auth-signature-secret
core-site.xml log4j.properties
dfs_hosts_allow.txt logs
dfs_hosts_exclude.txt navigator.client.properties
event-filter-rules.json topology.map
hadoop-metrics2.properties topology.py
Question here ,
1. what is a difference between these configs ?
2. We are able to change the configs in cloudera manager for the parameters which been listed there,
Means, There are few parameters are missing in the Cloudera Manager, if i need those parameters how can i use that ?
Kindly share your suggestion on it.
Best Regards,
BOmmuraj
Created ‎06-30-2014 09:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you Manikumar for your input.
I just found below location in cloudera manager to add the custome parameters.
HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED -> HDFS Service Environment Safety Valve
Best Regards,
Bommuraj
Created ‎06-30-2014 08:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
/run/cloudera....... is the one that cloudera services export the confs and run from there, either way it works, if you make any changes on CM it gets effective in /run/cloudera.... and when you deploy client configs it gets reflected in /etc/hadoop....
Its just the CM way of doing/running things, no big difference...
If you want to add a property to the cluster configuration there is an option in cloudera manager which allows you to add new configurations, I am not sure where can we find it but there is a way to do it as far as i know...
Thanks
Created ‎06-30-2014 09:05 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you Manikumar for your input.
I just found below location in cloudera manager to add the custome parameters.
HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED -> HDFS Service Environment Safety Valve
Best Regards,
Bommuraj
