Member since
03-21-2016
38
Posts
5
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
17445 | 01-29-2017 09:04 AM | |
2010 | 01-04-2017 08:19 AM | |
1089 | 10-12-2016 05:36 AM | |
2033 | 10-12-2016 05:26 AM |
11-27-2016
08:26 AM
@jss Thanks a lot. That solved my issue and I am not getting DN heapsize alerts anymore.
... View more
11-13-2016
12:05 PM
@jss I am using oracle jdk 1.7 and hadoop components are also using jdk 1.7 version. [root@mst1 hadoop]# su - hdfs
[hdfs@mst1 ~]$ java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
[root@edge1 ~]# su - hdfs
[hdfs@edge1 ~]$ java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
Java versions are correct but still jps not working in edge node.
... View more
11-13-2016
09:09 AM
1 Kudo
Hi Team, Running jps command in edge node shows "Process Information Unavailable" but when I run the same command in master node, it shows all the process clearly. Any help would be appreciated. [root@edge1 ~]# jps
20712 -- process information unavailable
23022 -- process information unavailable
21612 -- process information unavailable
20888 -- process information unavailable
22085 -- process information unavailable
22650 -- process information unavailable
19360 -- process information unavailable
22768 -- process information unavailable
22324 -- process information unavailable
29348 -- process information unavailable
20591 -- process information unavailable
19212 -- process information unavailable
24930 Main
20433 -- process information unavailable
22509 -- process information unavailable
22878 -- process information unavailable
20692 -- process information unavailable
[root@edge1 ~]# java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
[root@edge1 ~]# echo $JAVA_HOME
/usr/java/jdk1.7.0_67
[root@edge1 ~]# which jps
/usr/java/jdk1.7.0_67/bin/jps
[root@mst1 ~]# jps
5799 Elasticsearch
20959 RunJar
3493 SparkSubmit
15483 JobHistoryServer
14100 AmbariServer
21783 jar
31019 Jps
4617 EmbeddedServer
8597 HMaster
2859 Main
4415 JournalNode
12748 Bootstrap
6858 NameNode
30657 UnixAuthenticationService
9303 RunJar
10945 HistoryServer
4698 QuorumPeerMain
11951 ApplicationHistoryServer
19142 RunJar
5819 DFSZKFailoverController
16870 ResourceManager
10152 HRegionServer
[root@mst1 ~]# echo $JAVA_HOME
/usr/java/jdk1.7.0_67
[root@mst1 ~]# which java
/usr/java/jdk1.7.0_67/bin/java
[root@mst1 ~]# which jps
/usr/java/jdk1.7.0_67/bin/jps
[root@mst1 ~]# java -version
java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
... View more
11-03-2016
04:47 AM
Hi Team, I am using HDP 2.4.2 and I have 39 Datanodes in a cluster. Initially, there was 1GB heapsize of DN by default. Then it started to send warning alerts from every datanode even though there was no ingestion/job running. So, I increased the DN heapsize to 2GB but still it is sending me alerts consuming 60-70% heapsize and sometimes 80-90% even though cluster is idle. Is there any calculation/formula how much heapsize should I provide in Datanodes?? Please help. Thanks, Rahul
... View more
Labels:
- Labels:
-
Apache Hadoop
10-12-2016
05:36 AM
1 Kudo
@Constantin Stanca Hi Constantin, The issue was that a hadoop folder got created previously under /usr/hdp folder since there should be only 2 folders named 2.4.2.0-258 and current under /usr/hdp. There should not be any additional folders apart from two folders. After removing the hadoop folder from /usr/hdp, the issue got resolved. Thanks, Rahul
... View more
10-12-2016
05:26 AM
1 Kudo
@Deepak Sharma @Vipin Rathor Hi All, The users are in ou=staff,ou=lab,ou=users,dc=example,dc=com and groups are in ou=Groups,dc=example,dc=com and also users are syncing properly. In groups config, everything was correct. But the issue was in user search base which I had initially given as ou=lab,ou=users,dc=example,dc=com. So I changed the user search base to ou=staff,ou=lab,ou=users,dc=example,dc=com and then all my groups started to sync. Finally I can see my groups under groups tab in ranger. Thank you all for all the help and ideas you provided. Thanks, Rahul
... View more
09-26-2016
11:46 AM
@Deepak Sharma Hi Deepak, Users that belong to the groups other than those 4 syncd groups are syncing properly. I dont have any issue in user sync, I have issues only with group sync. Thanks, Rahul
... View more
09-26-2016
10:16 AM
Hi Team, I have configured group config in ambari as: Group Member Attribute=member Group Name Attribute: cn Group Object Class: group Group Search Base: ou=Groups,dc=example,dc=com Group Search Filter: cn=* ranger.usersync.ldap.referral: follow I have done ldapsearch for one group bdg_itadmin_s as shown below: # bdg_itadmin_s, example, example.com
dn: CN=bdg_itadmin_s,OU=Groups,DC=example,DC=com
objectClass: top
objectClass: group
cn: bdg_itadmin_s
distinguishedName: CN=bdg_itadmin_s,OU=Groups,DC=example,DC=com
instanceType: 4
whenCreated: 20160926083435.0Z
whenChanged: 20160926083435.0Z
uSNCreated: 11545972
uSNChanged: 11545972
name: bdg_itadmin_s
objectGUID:: iTJZ3zcD9UK6Xi40sxRB3A==
objectSid:: AQUAAAAAAAUVAAAADqCFIi054a3apg99awsAAA==
sAMAccountName: bdg_itadmin_s
sAMAccountType: 268435456
groupType: -2147483646
objectCategory: CN=Group,CN=Schema,CN=Configuration,DC=example,DC=com
dSCorePropagationData: 16010101000000.0Z # search result
search: 2
result: 0 Success
control: 1.2.840.113556.1.4.319 false MIQAAAAFAgEABAA=
pagedresults: cookie= # numResponses: 2
# numEntries: 1 Also we have 15 groups configured in AD, however we are able to see only 4 groups in ranger after restarting ranger. I am attaching the screenshot for your kind review. Can you please help us here?? Regards, Rahul
... View more
Labels:
- Labels:
-
Apache Ranger
09-08-2016
09:32 PM
Hi Team, During installation from ambari, the HDP clients successfully got installed in one of our datanodes. However it seems like there is some error in datanode which we are not able to troubleshoot the issue. The heartbeat response is receiving as can be seen in ambari-agent.log file.I am attaching the screenshot for your kind review. Can you please help us here??
Thanks, Rahul
... View more
Labels:
- Labels:
-
Apache Ambari
08-25-2016
09:53 AM
@Harini Yadav Hi Harini, Thanks for the answer. However can you please help us in raising this concern as a bug for the above subject so that it will get available in the next release. Thanks, Rahul
... View more
- « Previous
-
- 1
- 2
- Next »